diff --git a/.gitattributes b/.gitattributes
index a6344aac8c09253b3b630fb776ae94478aa0275b..8e36b4a5ec84f1913f5fbd0e338b84efc22c336c 100644
--- a/.gitattributes
+++ b/.gitattributes
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+checkpoint-1088/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-272/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-544/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-816/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
diff --git a/README.md b/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9ffaf32045885341f44f9850f1ee3bc5e6ffa9dd
--- /dev/null
+++ b/README.md
@@ -0,0 +1,202 @@
+---
+base_model: PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1
\ No newline at end of file
diff --git a/adapter_config.json b/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..1c579cbcbf6740cc6c934f1581b6cf66e692fe73
--- /dev/null
+++ b/adapter_config.json
@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "PocketDoc/Dans-PersonalityEngine-V1.1.0-12b",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": null,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "down_proj",
+    "v_proj",
+    "o_proj",
+    "up_proj",
+    "k_proj",
+    "gate_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": true
+}
\ No newline at end of file
diff --git a/adapter_model.safetensors b/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..806e3619c8030f53e08abcd6250432c8f04235f9
--- /dev/null
+++ b/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:866acc0f7d32e7ea89fe355667d349175c12476b0e2777f78da44966deec3355
+size 63984
diff --git a/checkpoint-1088/README.md b/checkpoint-1088/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9ffaf32045885341f44f9850f1ee3bc5e6ffa9dd
--- /dev/null
+++ b/checkpoint-1088/README.md
@@ -0,0 +1,202 @@
+---
+base_model: PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1
\ No newline at end of file
diff --git a/checkpoint-1088/adapter_config.json b/checkpoint-1088/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..1c579cbcbf6740cc6c934f1581b6cf66e692fe73
--- /dev/null
+++ b/checkpoint-1088/adapter_config.json
@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "PocketDoc/Dans-PersonalityEngine-V1.1.0-12b",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": null,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "down_proj",
+    "v_proj",
+    "o_proj",
+    "up_proj",
+    "k_proj",
+    "gate_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": true
+}
\ No newline at end of file
diff --git a/checkpoint-1088/adapter_model.safetensors b/checkpoint-1088/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b5806921986b15f6e048a782683e733c4d0d6df9
--- /dev/null
+++ b/checkpoint-1088/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df491e432d8027ecbbad52d28143daf841e649f498857c06fa97b071af5ea90d
+size 912337968
diff --git a/checkpoint-1088/global_step1087/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7ae6a086f4e00a07021fd2e2e9f9b521c8bc5ab4
--- /dev/null
+++ b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b50dbe111d1b03bdebdc805b2e5aaa234b40bb001d854ab32bab1d3e2a35b0e9
+size 536671408
diff --git a/checkpoint-1088/global_step1087/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7b6d222c73c034193ea1322df9e3cda52c398ffb
--- /dev/null
+++ b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1754371282ab0865ba5219740dd2b86ed869fd174c3587ec85551de310f5e409
+size 536671408
diff --git a/checkpoint-1088/global_step1087/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7782f53414f6f1246cf2c4fc2ebbb81956a5eb86
--- /dev/null
+++ b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc79aeaafc0f17431e540cd4cb3b7694afff72f6c110ecf8ff0642a24c1dbea6
+size 536671408
diff --git a/checkpoint-1088/global_step1087/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b38c6a5a11abe568f1adaf32f20dd501f996a51f
--- /dev/null
+++ b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c98b6849217b28844bc9638b4106941c028df09a8cb3b43909c88047673e1a03
+size 536671408
diff --git a/checkpoint-1088/global_step1087/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..d59eb59bef13d04d593784d18ec56f50342ae9f0
--- /dev/null
+++ b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0bc903c3e3a584f2e48c3f70bb6b679852386ff96e2ca1f1abfcde347be7d847
+size 536671408
diff --git a/checkpoint-1088/global_step1087/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..607987a50a1473b3ecc95d3761791944f97bca75
--- /dev/null
+++ b/checkpoint-1088/global_step1087/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8e96e3d96f92652530fb360bde70252d85f056efd9fddbad9269be872dde4b45
+size 536671408
diff --git a/checkpoint-1088/global_step1087/zero_pp_rank_0_mp_rank_00_model_states.pt b/checkpoint-1088/global_step1087/zero_pp_rank_0_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..6bc8aa5bd234a01f8fe9b012938259155e5da791
--- /dev/null
+++ b/checkpoint-1088/global_step1087/zero_pp_rank_0_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76ab7229f036d544c444a147553b95db692e6ce66a96b69106b7f3b844096d12
+size 557022
diff --git a/checkpoint-1088/global_step1087/zero_pp_rank_1_mp_rank_00_model_states.pt b/checkpoint-1088/global_step1087/zero_pp_rank_1_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..cb22b6818348383c681c9674474805932b76f2d6
--- /dev/null
+++ b/checkpoint-1088/global_step1087/zero_pp_rank_1_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f7b1441c85fd26a0da9e15a1246ce52643e380d2c23a5d013e7f4e267e19117
+size 557022
diff --git a/checkpoint-1088/global_step1087/zero_pp_rank_2_mp_rank_00_model_states.pt b/checkpoint-1088/global_step1087/zero_pp_rank_2_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ffa7f1efa1c40af23ee7964c1533a6cff227c81d
--- /dev/null
+++ b/checkpoint-1088/global_step1087/zero_pp_rank_2_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c17aba143197527cb89068f16e31505e784165fd2c1ec7a85b9acc8db241c71
+size 557022
diff --git a/checkpoint-1088/global_step1087/zero_pp_rank_3_mp_rank_00_model_states.pt b/checkpoint-1088/global_step1087/zero_pp_rank_3_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..0a59b4a40c641ae89a6ce695a8da7d1793c4f30b
--- /dev/null
+++ b/checkpoint-1088/global_step1087/zero_pp_rank_3_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9f3b3b6d5beb0a955f1aa179bf73144670908b7aa5a8cfa452f3e89ff3eb9b99
+size 557022
diff --git a/checkpoint-1088/global_step1087/zero_pp_rank_4_mp_rank_00_model_states.pt b/checkpoint-1088/global_step1087/zero_pp_rank_4_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..5be46df69c361dc3063d0b8f23323ea7cdfb94cb
--- /dev/null
+++ b/checkpoint-1088/global_step1087/zero_pp_rank_4_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18deb8f0f2fe2c4fc3ff656204e66dd492571a4ca5641178b9dea0b71f1382b6
+size 557022
diff --git a/checkpoint-1088/global_step1087/zero_pp_rank_5_mp_rank_00_model_states.pt b/checkpoint-1088/global_step1087/zero_pp_rank_5_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..186abc92690a95e3245ad93152be3d1ed9a1661d
--- /dev/null
+++ b/checkpoint-1088/global_step1087/zero_pp_rank_5_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:494eea17100e816053c09137e78e0ad35d0c8ef3f45af3b5c6128c4d88005860
+size 557022
diff --git a/checkpoint-1088/latest b/checkpoint-1088/latest
new file mode 100644
index 0000000000000000000000000000000000000000..f5ff96e7f954efeadc60a1e27c3177e96c05cd46
--- /dev/null
+++ b/checkpoint-1088/latest
@@ -0,0 +1 @@
+global_step1087
\ No newline at end of file
diff --git a/checkpoint-1088/rng_state_0.pth b/checkpoint-1088/rng_state_0.pth
new file mode 100644
index 0000000000000000000000000000000000000000..44fc77e025541a90a7285030d4c68a0801a74e9a
--- /dev/null
+++ b/checkpoint-1088/rng_state_0.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c43624b5a1ed02a5c9d895603098dd5983d2ca52531122bf765cfe3dcefa0c64
+size 15472
diff --git a/checkpoint-1088/rng_state_1.pth b/checkpoint-1088/rng_state_1.pth
new file mode 100644
index 0000000000000000000000000000000000000000..b681804411a6a325b36d988814905ad112b0403a
--- /dev/null
+++ b/checkpoint-1088/rng_state_1.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0fe387d9b7a364b4274dcfda3b94ce1b5af2d53a9991d66a119fbaed2520c55d
+size 15472
diff --git a/checkpoint-1088/rng_state_2.pth b/checkpoint-1088/rng_state_2.pth
new file mode 100644
index 0000000000000000000000000000000000000000..b3858a5dcc51648a3c8bf248d4c7bda4bdb56f35
--- /dev/null
+++ b/checkpoint-1088/rng_state_2.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19b07121e40d488efdfaade27de9499ca3a1b1eab6662ca970f9b98ede3b96c2
+size 15472
diff --git a/checkpoint-1088/rng_state_3.pth b/checkpoint-1088/rng_state_3.pth
new file mode 100644
index 0000000000000000000000000000000000000000..3a03db11f4bd700e753526358f432019b14fcb01
--- /dev/null
+++ b/checkpoint-1088/rng_state_3.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:977b026ab7400e78aa5630b413f81f37bf35daf0f24805dd379eb83c7b7e6300
+size 15472
diff --git a/checkpoint-1088/rng_state_4.pth b/checkpoint-1088/rng_state_4.pth
new file mode 100644
index 0000000000000000000000000000000000000000..4de6af89247df00a6593dc8b5b35338878f0ab96
--- /dev/null
+++ b/checkpoint-1088/rng_state_4.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa2f52d8375c58c6c0a4a691f8d943b39b357fe2378e3e4a313d4f68d7bb6ad4
+size 15472
diff --git a/checkpoint-1088/rng_state_5.pth b/checkpoint-1088/rng_state_5.pth
new file mode 100644
index 0000000000000000000000000000000000000000..093bde4a19b187faf9e8ccba4925acbcea2b45fb
--- /dev/null
+++ b/checkpoint-1088/rng_state_5.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9f7b3a6b3620873c3f8b34b4133943e3a04ca74e605d6508339386d46d312a4
+size 15472
diff --git a/checkpoint-1088/scheduler.pt b/checkpoint-1088/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..d6455be712ae34caeb2966f6d81bb9e7e062e56d
--- /dev/null
+++ b/checkpoint-1088/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd6eb30e8b5f8cbb1326d5bb704d3bd40172a80d739f1452a83b1fb68ecfc310
+size 1064
diff --git a/checkpoint-1088/special_tokens_map.json b/checkpoint-1088/special_tokens_map.json
new file mode 100644
index 0000000000000000000000000000000000000000..547986c0f0567961dd9ff48218defed8e4d5aa59
--- /dev/null
+++ b/checkpoint-1088/special_tokens_map.json
@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}
diff --git a/checkpoint-1088/tokenizer.json b/checkpoint-1088/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..cff17babe3bd564f7a3005727b02f44432e0facf
--- /dev/null
+++ b/checkpoint-1088/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee57bd3271d8c200a06df40f9d7c94f8bb8f085b5cfb2d40907a794560df2ec3
+size 17078342
diff --git a/checkpoint-1088/tokenizer_config.json b/checkpoint-1088/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..0f13a1776083b5998049a3aad730d95f5e74f8cd
--- /dev/null
+++ b/checkpoint-1088/tokenizer_config.json
@@ -0,0 +1,8016 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "<SPECIAL_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "5": {
+      "content": "[AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "[/AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "[TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "8": {
+      "content": "[/TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "9": {
+      "content": "[TOOL_CALLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "10": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "11": {
+      "content": "[PREFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "12": {
+      "content": "[MIDDLE]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "13": {
+      "content": "[SUFFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "14": {
+      "content": "<SPECIAL_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "15": {
+      "content": "<SPECIAL_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "16": {
+      "content": "<SPECIAL_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "17": {
+      "content": "<SPECIAL_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "18": {
+      "content": "<SPECIAL_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "19": {
+      "content": "<SPECIAL_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "20": {
+      "content": "<SPECIAL_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "21": {
+      "content": "<SPECIAL_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "22": {
+      "content": "<SPECIAL_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "23": {
+      "content": "<SPECIAL_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "24": {
+      "content": "<SPECIAL_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "25": {
+      "content": "<SPECIAL_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "26": {
+      "content": "<SPECIAL_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "27": {
+      "content": "<SPECIAL_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "28": {
+      "content": "<SPECIAL_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "29": {
+      "content": "<SPECIAL_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "30": {
+      "content": "<SPECIAL_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "31": {
+      "content": "<SPECIAL_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32": {
+      "content": "<SPECIAL_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "33": {
+      "content": "<SPECIAL_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "34": {
+      "content": "<SPECIAL_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "35": {
+      "content": "<SPECIAL_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "36": {
+      "content": "<SPECIAL_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "37": {
+      "content": "<SPECIAL_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "38": {
+      "content": "<SPECIAL_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "39": {
+      "content": "<SPECIAL_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "40": {
+      "content": "<SPECIAL_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "41": {
+      "content": "<SPECIAL_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "42": {
+      "content": "<SPECIAL_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "43": {
+      "content": "<SPECIAL_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "44": {
+      "content": "<SPECIAL_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "45": {
+      "content": "<SPECIAL_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "46": {
+      "content": "<SPECIAL_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "47": {
+      "content": "<SPECIAL_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "48": {
+      "content": "<SPECIAL_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49": {
+      "content": "<SPECIAL_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50": {
+      "content": "<SPECIAL_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "51": {
+      "content": "<SPECIAL_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "52": {
+      "content": "<SPECIAL_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "53": {
+      "content": "<SPECIAL_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "54": {
+      "content": "<SPECIAL_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "55": {
+      "content": "<SPECIAL_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "56": {
+      "content": "<SPECIAL_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "57": {
+      "content": "<SPECIAL_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "58": {
+      "content": "<SPECIAL_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "59": {
+      "content": "<SPECIAL_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "60": {
+      "content": "<SPECIAL_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "61": {
+      "content": "<SPECIAL_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "62": {
+      "content": "<SPECIAL_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "63": {
+      "content": "<SPECIAL_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "64": {
+      "content": "<SPECIAL_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "65": {
+      "content": "<SPECIAL_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "66": {
+      "content": "<SPECIAL_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "67": {
+      "content": "<SPECIAL_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "68": {
+      "content": "<SPECIAL_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "69": {
+      "content": "<SPECIAL_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "70": {
+      "content": "<SPECIAL_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "71": {
+      "content": "<SPECIAL_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "72": {
+      "content": "<SPECIAL_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "73": {
+      "content": "<SPECIAL_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "74": {
+      "content": "<SPECIAL_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "75": {
+      "content": "<SPECIAL_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "76": {
+      "content": "<SPECIAL_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "77": {
+      "content": "<SPECIAL_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "78": {
+      "content": "<SPECIAL_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "79": {
+      "content": "<SPECIAL_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "80": {
+      "content": "<SPECIAL_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "81": {
+      "content": "<SPECIAL_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "82": {
+      "content": "<SPECIAL_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "83": {
+      "content": "<SPECIAL_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "84": {
+      "content": "<SPECIAL_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "85": {
+      "content": "<SPECIAL_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "86": {
+      "content": "<SPECIAL_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "87": {
+      "content": "<SPECIAL_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "88": {
+      "content": "<SPECIAL_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "89": {
+      "content": "<SPECIAL_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "90": {
+      "content": "<SPECIAL_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "91": {
+      "content": "<SPECIAL_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "92": {
+      "content": "<SPECIAL_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "93": {
+      "content": "<SPECIAL_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "94": {
+      "content": "<SPECIAL_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "95": {
+      "content": "<SPECIAL_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "96": {
+      "content": "<SPECIAL_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "97": {
+      "content": "<SPECIAL_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "98": {
+      "content": "<SPECIAL_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "99": {
+      "content": "<SPECIAL_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "<SPECIAL_100>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "<SPECIAL_101>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "<SPECIAL_102>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "<SPECIAL_103>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "104": {
+      "content": "<SPECIAL_104>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "105": {
+      "content": "<SPECIAL_105>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "106": {
+      "content": "<SPECIAL_106>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "107": {
+      "content": "<SPECIAL_107>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "108": {
+      "content": "<SPECIAL_108>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "109": {
+      "content": "<SPECIAL_109>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "110": {
+      "content": "<SPECIAL_110>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "111": {
+      "content": "<SPECIAL_111>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "112": {
+      "content": "<SPECIAL_112>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "113": {
+      "content": "<SPECIAL_113>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "114": {
+      "content": "<SPECIAL_114>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "115": {
+      "content": "<SPECIAL_115>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "116": {
+      "content": "<SPECIAL_116>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "117": {
+      "content": "<SPECIAL_117>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "118": {
+      "content": "<SPECIAL_118>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "119": {
+      "content": "<SPECIAL_119>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "120": {
+      "content": "<SPECIAL_120>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "121": {
+      "content": "<SPECIAL_121>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "122": {
+      "content": "<SPECIAL_122>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "123": {
+      "content": "<SPECIAL_123>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "124": {
+      "content": "<SPECIAL_124>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "125": {
+      "content": "<SPECIAL_125>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "126": {
+      "content": "<SPECIAL_126>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "127": {
+      "content": "<SPECIAL_127>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128": {
+      "content": "<SPECIAL_128>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "129": {
+      "content": "<SPECIAL_129>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "130": {
+      "content": "<SPECIAL_130>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "131": {
+      "content": "<SPECIAL_131>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "132": {
+      "content": "<SPECIAL_132>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "133": {
+      "content": "<SPECIAL_133>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "134": {
+      "content": "<SPECIAL_134>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "135": {
+      "content": "<SPECIAL_135>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "136": {
+      "content": "<SPECIAL_136>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "137": {
+      "content": "<SPECIAL_137>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "138": {
+      "content": "<SPECIAL_138>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "139": {
+      "content": "<SPECIAL_139>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "140": {
+      "content": "<SPECIAL_140>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "141": {
+      "content": "<SPECIAL_141>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "142": {
+      "content": "<SPECIAL_142>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "143": {
+      "content": "<SPECIAL_143>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144": {
+      "content": "<SPECIAL_144>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145": {
+      "content": "<SPECIAL_145>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "146": {
+      "content": "<SPECIAL_146>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "147": {
+      "content": "<SPECIAL_147>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "148": {
+      "content": "<SPECIAL_148>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "149": {
+      "content": "<SPECIAL_149>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "150": {
+      "content": "<SPECIAL_150>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151": {
+      "content": "<SPECIAL_151>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "152": {
+      "content": "<SPECIAL_152>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "153": {
+      "content": "<SPECIAL_153>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "154": {
+      "content": "<SPECIAL_154>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "155": {
+      "content": "<SPECIAL_155>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "156": {
+      "content": "<SPECIAL_156>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "157": {
+      "content": "<SPECIAL_157>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "158": {
+      "content": "<SPECIAL_158>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "159": {
+      "content": "<SPECIAL_159>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "160": {
+      "content": "<SPECIAL_160>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "161": {
+      "content": "<SPECIAL_161>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "162": {
+      "content": "<SPECIAL_162>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "163": {
+      "content": "<SPECIAL_163>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "164": {
+      "content": "<SPECIAL_164>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "165": {
+      "content": "<SPECIAL_165>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "166": {
+      "content": "<SPECIAL_166>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "167": {
+      "content": "<SPECIAL_167>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "168": {
+      "content": "<SPECIAL_168>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "169": {
+      "content": "<SPECIAL_169>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "170": {
+      "content": "<SPECIAL_170>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "171": {
+      "content": "<SPECIAL_171>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "172": {
+      "content": "<SPECIAL_172>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "173": {
+      "content": "<SPECIAL_173>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "174": {
+      "content": "<SPECIAL_174>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "175": {
+      "content": "<SPECIAL_175>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "176": {
+      "content": "<SPECIAL_176>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "177": {
+      "content": "<SPECIAL_177>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "178": {
+      "content": "<SPECIAL_178>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "179": {
+      "content": "<SPECIAL_179>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "180": {
+      "content": "<SPECIAL_180>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "181": {
+      "content": "<SPECIAL_181>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "182": {
+      "content": "<SPECIAL_182>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "183": {
+      "content": "<SPECIAL_183>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "184": {
+      "content": "<SPECIAL_184>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "185": {
+      "content": "<SPECIAL_185>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "186": {
+      "content": "<SPECIAL_186>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "187": {
+      "content": "<SPECIAL_187>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "188": {
+      "content": "<SPECIAL_188>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "189": {
+      "content": "<SPECIAL_189>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "190": {
+      "content": "<SPECIAL_190>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "191": {
+      "content": "<SPECIAL_191>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "192": {
+      "content": "<SPECIAL_192>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "193": {
+      "content": "<SPECIAL_193>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "194": {
+      "content": "<SPECIAL_194>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "195": {
+      "content": "<SPECIAL_195>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "196": {
+      "content": "<SPECIAL_196>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "197": {
+      "content": "<SPECIAL_197>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "198": {
+      "content": "<SPECIAL_198>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "199": {
+      "content": "<SPECIAL_199>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "200": {
+      "content": "<SPECIAL_200>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "201": {
+      "content": "<SPECIAL_201>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "202": {
+      "content": "<SPECIAL_202>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "203": {
+      "content": "<SPECIAL_203>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "204": {
+      "content": "<SPECIAL_204>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "205": {
+      "content": "<SPECIAL_205>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "206": {
+      "content": "<SPECIAL_206>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "207": {
+      "content": "<SPECIAL_207>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "208": {
+      "content": "<SPECIAL_208>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "209": {
+      "content": "<SPECIAL_209>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "210": {
+      "content": "<SPECIAL_210>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "211": {
+      "content": "<SPECIAL_211>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "212": {
+      "content": "<SPECIAL_212>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "213": {
+      "content": "<SPECIAL_213>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "214": {
+      "content": "<SPECIAL_214>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "215": {
+      "content": "<SPECIAL_215>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "216": {
+      "content": "<SPECIAL_216>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "217": {
+      "content": "<SPECIAL_217>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "218": {
+      "content": "<SPECIAL_218>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "219": {
+      "content": "<SPECIAL_219>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "220": {
+      "content": "<SPECIAL_220>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "221": {
+      "content": "<SPECIAL_221>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "222": {
+      "content": "<SPECIAL_222>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "223": {
+      "content": "<SPECIAL_223>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "224": {
+      "content": "<SPECIAL_224>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "225": {
+      "content": "<SPECIAL_225>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "226": {
+      "content": "<SPECIAL_226>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "227": {
+      "content": "<SPECIAL_227>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "228": {
+      "content": "<SPECIAL_228>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "229": {
+      "content": "<SPECIAL_229>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "230": {
+      "content": "<SPECIAL_230>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "231": {
+      "content": "<SPECIAL_231>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "232": {
+      "content": "<SPECIAL_232>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "233": {
+      "content": "<SPECIAL_233>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "234": {
+      "content": "<SPECIAL_234>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "235": {
+      "content": "<SPECIAL_235>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "236": {
+      "content": "<SPECIAL_236>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "237": {
+      "content": "<SPECIAL_237>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "238": {
+      "content": "<SPECIAL_238>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "239": {
+      "content": "<SPECIAL_239>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "240": {
+      "content": "<SPECIAL_240>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "241": {
+      "content": "<SPECIAL_241>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "242": {
+      "content": "<SPECIAL_242>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "243": {
+      "content": "<SPECIAL_243>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "244": {
+      "content": "<SPECIAL_244>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "245": {
+      "content": "<SPECIAL_245>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "246": {
+      "content": "<SPECIAL_246>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "247": {
+      "content": "<SPECIAL_247>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248": {
+      "content": "<SPECIAL_248>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "249": {
+      "content": "<SPECIAL_249>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "250": {
+      "content": "<SPECIAL_250>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "251": {
+      "content": "<SPECIAL_251>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "252": {
+      "content": "<SPECIAL_252>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "253": {
+      "content": "<SPECIAL_253>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "254": {
+      "content": "<SPECIAL_254>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255": {
+      "content": "<SPECIAL_255>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256": {
+      "content": "<SPECIAL_256>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "257": {
+      "content": "<SPECIAL_257>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "258": {
+      "content": "<SPECIAL_258>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "259": {
+      "content": "<SPECIAL_259>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "260": {
+      "content": "<SPECIAL_260>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "261": {
+      "content": "<SPECIAL_261>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "262": {
+      "content": "<SPECIAL_262>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "263": {
+      "content": "<SPECIAL_263>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "264": {
+      "content": "<SPECIAL_264>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "265": {
+      "content": "<SPECIAL_265>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "266": {
+      "content": "<SPECIAL_266>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "267": {
+      "content": "<SPECIAL_267>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "268": {
+      "content": "<SPECIAL_268>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "269": {
+      "content": "<SPECIAL_269>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "270": {
+      "content": "<SPECIAL_270>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "271": {
+      "content": "<SPECIAL_271>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "272": {
+      "content": "<SPECIAL_272>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "273": {
+      "content": "<SPECIAL_273>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "274": {
+      "content": "<SPECIAL_274>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "275": {
+      "content": "<SPECIAL_275>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "276": {
+      "content": "<SPECIAL_276>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "277": {
+      "content": "<SPECIAL_277>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "278": {
+      "content": "<SPECIAL_278>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "279": {
+      "content": "<SPECIAL_279>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "280": {
+      "content": "<SPECIAL_280>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "281": {
+      "content": "<SPECIAL_281>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "282": {
+      "content": "<SPECIAL_282>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "283": {
+      "content": "<SPECIAL_283>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "284": {
+      "content": "<SPECIAL_284>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "285": {
+      "content": "<SPECIAL_285>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "286": {
+      "content": "<SPECIAL_286>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "287": {
+      "content": "<SPECIAL_287>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "288": {
+      "content": "<SPECIAL_288>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "289": {
+      "content": "<SPECIAL_289>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "290": {
+      "content": "<SPECIAL_290>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "291": {
+      "content": "<SPECIAL_291>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "292": {
+      "content": "<SPECIAL_292>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "293": {
+      "content": "<SPECIAL_293>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "294": {
+      "content": "<SPECIAL_294>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "295": {
+      "content": "<SPECIAL_295>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "296": {
+      "content": "<SPECIAL_296>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "297": {
+      "content": "<SPECIAL_297>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "298": {
+      "content": "<SPECIAL_298>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "299": {
+      "content": "<SPECIAL_299>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "300": {
+      "content": "<SPECIAL_300>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "301": {
+      "content": "<SPECIAL_301>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "302": {
+      "content": "<SPECIAL_302>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "303": {
+      "content": "<SPECIAL_303>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "304": {
+      "content": "<SPECIAL_304>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "305": {
+      "content": "<SPECIAL_305>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "306": {
+      "content": "<SPECIAL_306>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "307": {
+      "content": "<SPECIAL_307>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "308": {
+      "content": "<SPECIAL_308>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "309": {
+      "content": "<SPECIAL_309>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "310": {
+      "content": "<SPECIAL_310>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "311": {
+      "content": "<SPECIAL_311>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "312": {
+      "content": "<SPECIAL_312>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "313": {
+      "content": "<SPECIAL_313>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "314": {
+      "content": "<SPECIAL_314>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "315": {
+      "content": "<SPECIAL_315>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "316": {
+      "content": "<SPECIAL_316>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "317": {
+      "content": "<SPECIAL_317>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "318": {
+      "content": "<SPECIAL_318>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "319": {
+      "content": "<SPECIAL_319>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "320": {
+      "content": "<SPECIAL_320>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "321": {
+      "content": "<SPECIAL_321>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "322": {
+      "content": "<SPECIAL_322>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "323": {
+      "content": "<SPECIAL_323>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "324": {
+      "content": "<SPECIAL_324>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "325": {
+      "content": "<SPECIAL_325>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "326": {
+      "content": "<SPECIAL_326>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "327": {
+      "content": "<SPECIAL_327>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "328": {
+      "content": "<SPECIAL_328>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "329": {
+      "content": "<SPECIAL_329>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "330": {
+      "content": "<SPECIAL_330>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "331": {
+      "content": "<SPECIAL_331>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "332": {
+      "content": "<SPECIAL_332>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "333": {
+      "content": "<SPECIAL_333>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "334": {
+      "content": "<SPECIAL_334>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "335": {
+      "content": "<SPECIAL_335>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "336": {
+      "content": "<SPECIAL_336>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "337": {
+      "content": "<SPECIAL_337>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "338": {
+      "content": "<SPECIAL_338>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "339": {
+      "content": "<SPECIAL_339>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "340": {
+      "content": "<SPECIAL_340>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "341": {
+      "content": "<SPECIAL_341>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "342": {
+      "content": "<SPECIAL_342>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "343": {
+      "content": "<SPECIAL_343>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "344": {
+      "content": "<SPECIAL_344>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "345": {
+      "content": "<SPECIAL_345>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "346": {
+      "content": "<SPECIAL_346>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "347": {
+      "content": "<SPECIAL_347>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "348": {
+      "content": "<SPECIAL_348>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "349": {
+      "content": "<SPECIAL_349>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "350": {
+      "content": "<SPECIAL_350>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "351": {
+      "content": "<SPECIAL_351>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "352": {
+      "content": "<SPECIAL_352>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "353": {
+      "content": "<SPECIAL_353>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "354": {
+      "content": "<SPECIAL_354>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "355": {
+      "content": "<SPECIAL_355>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "356": {
+      "content": "<SPECIAL_356>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "357": {
+      "content": "<SPECIAL_357>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "358": {
+      "content": "<SPECIAL_358>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "359": {
+      "content": "<SPECIAL_359>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "360": {
+      "content": "<SPECIAL_360>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "361": {
+      "content": "<SPECIAL_361>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "362": {
+      "content": "<SPECIAL_362>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "363": {
+      "content": "<SPECIAL_363>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "364": {
+      "content": "<SPECIAL_364>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "365": {
+      "content": "<SPECIAL_365>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "366": {
+      "content": "<SPECIAL_366>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "367": {
+      "content": "<SPECIAL_367>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "368": {
+      "content": "<SPECIAL_368>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "369": {
+      "content": "<SPECIAL_369>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "370": {
+      "content": "<SPECIAL_370>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "371": {
+      "content": "<SPECIAL_371>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "372": {
+      "content": "<SPECIAL_372>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "373": {
+      "content": "<SPECIAL_373>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "374": {
+      "content": "<SPECIAL_374>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "375": {
+      "content": "<SPECIAL_375>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "376": {
+      "content": "<SPECIAL_376>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "377": {
+      "content": "<SPECIAL_377>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "378": {
+      "content": "<SPECIAL_378>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "379": {
+      "content": "<SPECIAL_379>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "380": {
+      "content": "<SPECIAL_380>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "381": {
+      "content": "<SPECIAL_381>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "382": {
+      "content": "<SPECIAL_382>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "383": {
+      "content": "<SPECIAL_383>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "384": {
+      "content": "<SPECIAL_384>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "385": {
+      "content": "<SPECIAL_385>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "386": {
+      "content": "<SPECIAL_386>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "387": {
+      "content": "<SPECIAL_387>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "388": {
+      "content": "<SPECIAL_388>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "389": {
+      "content": "<SPECIAL_389>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "390": {
+      "content": "<SPECIAL_390>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "391": {
+      "content": "<SPECIAL_391>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "392": {
+      "content": "<SPECIAL_392>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "393": {
+      "content": "<SPECIAL_393>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "394": {
+      "content": "<SPECIAL_394>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "395": {
+      "content": "<SPECIAL_395>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "396": {
+      "content": "<SPECIAL_396>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "397": {
+      "content": "<SPECIAL_397>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "398": {
+      "content": "<SPECIAL_398>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "399": {
+      "content": "<SPECIAL_399>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "400": {
+      "content": "<SPECIAL_400>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "401": {
+      "content": "<SPECIAL_401>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "402": {
+      "content": "<SPECIAL_402>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "403": {
+      "content": "<SPECIAL_403>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "404": {
+      "content": "<SPECIAL_404>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "405": {
+      "content": "<SPECIAL_405>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "406": {
+      "content": "<SPECIAL_406>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "407": {
+      "content": "<SPECIAL_407>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "408": {
+      "content": "<SPECIAL_408>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "409": {
+      "content": "<SPECIAL_409>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "410": {
+      "content": "<SPECIAL_410>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "411": {
+      "content": "<SPECIAL_411>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "412": {
+      "content": "<SPECIAL_412>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "413": {
+      "content": "<SPECIAL_413>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "414": {
+      "content": "<SPECIAL_414>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "415": {
+      "content": "<SPECIAL_415>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "416": {
+      "content": "<SPECIAL_416>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "417": {
+      "content": "<SPECIAL_417>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "418": {
+      "content": "<SPECIAL_418>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "419": {
+      "content": "<SPECIAL_419>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "420": {
+      "content": "<SPECIAL_420>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "421": {
+      "content": "<SPECIAL_421>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "422": {
+      "content": "<SPECIAL_422>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "423": {
+      "content": "<SPECIAL_423>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "424": {
+      "content": "<SPECIAL_424>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "425": {
+      "content": "<SPECIAL_425>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "426": {
+      "content": "<SPECIAL_426>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "427": {
+      "content": "<SPECIAL_427>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "428": {
+      "content": "<SPECIAL_428>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "429": {
+      "content": "<SPECIAL_429>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "430": {
+      "content": "<SPECIAL_430>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "431": {
+      "content": "<SPECIAL_431>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "432": {
+      "content": "<SPECIAL_432>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "433": {
+      "content": "<SPECIAL_433>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "434": {
+      "content": "<SPECIAL_434>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "435": {
+      "content": "<SPECIAL_435>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "436": {
+      "content": "<SPECIAL_436>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "437": {
+      "content": "<SPECIAL_437>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "438": {
+      "content": "<SPECIAL_438>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "439": {
+      "content": "<SPECIAL_439>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "440": {
+      "content": "<SPECIAL_440>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "441": {
+      "content": "<SPECIAL_441>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "442": {
+      "content": "<SPECIAL_442>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "443": {
+      "content": "<SPECIAL_443>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "444": {
+      "content": "<SPECIAL_444>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "445": {
+      "content": "<SPECIAL_445>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "446": {
+      "content": "<SPECIAL_446>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "447": {
+      "content": "<SPECIAL_447>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "448": {
+      "content": "<SPECIAL_448>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "449": {
+      "content": "<SPECIAL_449>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "450": {
+      "content": "<SPECIAL_450>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "451": {
+      "content": "<SPECIAL_451>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "452": {
+      "content": "<SPECIAL_452>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "453": {
+      "content": "<SPECIAL_453>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "454": {
+      "content": "<SPECIAL_454>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "455": {
+      "content": "<SPECIAL_455>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "456": {
+      "content": "<SPECIAL_456>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "457": {
+      "content": "<SPECIAL_457>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "458": {
+      "content": "<SPECIAL_458>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "459": {
+      "content": "<SPECIAL_459>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "460": {
+      "content": "<SPECIAL_460>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "461": {
+      "content": "<SPECIAL_461>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "462": {
+      "content": "<SPECIAL_462>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "463": {
+      "content": "<SPECIAL_463>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "464": {
+      "content": "<SPECIAL_464>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "465": {
+      "content": "<SPECIAL_465>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "466": {
+      "content": "<SPECIAL_466>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "467": {
+      "content": "<SPECIAL_467>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "468": {
+      "content": "<SPECIAL_468>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "469": {
+      "content": "<SPECIAL_469>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "470": {
+      "content": "<SPECIAL_470>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "471": {
+      "content": "<SPECIAL_471>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "472": {
+      "content": "<SPECIAL_472>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "473": {
+      "content": "<SPECIAL_473>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "474": {
+      "content": "<SPECIAL_474>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "475": {
+      "content": "<SPECIAL_475>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "476": {
+      "content": "<SPECIAL_476>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "477": {
+      "content": "<SPECIAL_477>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "478": {
+      "content": "<SPECIAL_478>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "479": {
+      "content": "<SPECIAL_479>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "480": {
+      "content": "<SPECIAL_480>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "481": {
+      "content": "<SPECIAL_481>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "482": {
+      "content": "<SPECIAL_482>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "483": {
+      "content": "<SPECIAL_483>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "484": {
+      "content": "<SPECIAL_484>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "485": {
+      "content": "<SPECIAL_485>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "486": {
+      "content": "<SPECIAL_486>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "487": {
+      "content": "<SPECIAL_487>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "488": {
+      "content": "<SPECIAL_488>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "489": {
+      "content": "<SPECIAL_489>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "490": {
+      "content": "<SPECIAL_490>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "491": {
+      "content": "<SPECIAL_491>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "492": {
+      "content": "<SPECIAL_492>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "493": {
+      "content": "<SPECIAL_493>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "494": {
+      "content": "<SPECIAL_494>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "495": {
+      "content": "<SPECIAL_495>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "496": {
+      "content": "<SPECIAL_496>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "497": {
+      "content": "<SPECIAL_497>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "498": {
+      "content": "<SPECIAL_498>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "499": {
+      "content": "<SPECIAL_499>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "500": {
+      "content": "<SPECIAL_500>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "501": {
+      "content": "<SPECIAL_501>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "502": {
+      "content": "<SPECIAL_502>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "503": {
+      "content": "<SPECIAL_503>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "504": {
+      "content": "<SPECIAL_504>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "505": {
+      "content": "<SPECIAL_505>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "506": {
+      "content": "<SPECIAL_506>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "507": {
+      "content": "<SPECIAL_507>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "508": {
+      "content": "<SPECIAL_508>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "509": {
+      "content": "<SPECIAL_509>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "510": {
+      "content": "<SPECIAL_510>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "511": {
+      "content": "<SPECIAL_511>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "512": {
+      "content": "<SPECIAL_512>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "513": {
+      "content": "<SPECIAL_513>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "514": {
+      "content": "<SPECIAL_514>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "515": {
+      "content": "<SPECIAL_515>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "516": {
+      "content": "<SPECIAL_516>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "517": {
+      "content": "<SPECIAL_517>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "518": {
+      "content": "<SPECIAL_518>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "519": {
+      "content": "<SPECIAL_519>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "520": {
+      "content": "<SPECIAL_520>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "521": {
+      "content": "<SPECIAL_521>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "522": {
+      "content": "<SPECIAL_522>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "523": {
+      "content": "<SPECIAL_523>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "524": {
+      "content": "<SPECIAL_524>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "525": {
+      "content": "<SPECIAL_525>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "526": {
+      "content": "<SPECIAL_526>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "527": {
+      "content": "<SPECIAL_527>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "528": {
+      "content": "<SPECIAL_528>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "529": {
+      "content": "<SPECIAL_529>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "530": {
+      "content": "<SPECIAL_530>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "531": {
+      "content": "<SPECIAL_531>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "532": {
+      "content": "<SPECIAL_532>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "533": {
+      "content": "<SPECIAL_533>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "534": {
+      "content": "<SPECIAL_534>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "535": {
+      "content": "<SPECIAL_535>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "536": {
+      "content": "<SPECIAL_536>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "537": {
+      "content": "<SPECIAL_537>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "538": {
+      "content": "<SPECIAL_538>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "539": {
+      "content": "<SPECIAL_539>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "540": {
+      "content": "<SPECIAL_540>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "541": {
+      "content": "<SPECIAL_541>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "542": {
+      "content": "<SPECIAL_542>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "543": {
+      "content": "<SPECIAL_543>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "544": {
+      "content": "<SPECIAL_544>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "545": {
+      "content": "<SPECIAL_545>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "546": {
+      "content": "<SPECIAL_546>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "547": {
+      "content": "<SPECIAL_547>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "548": {
+      "content": "<SPECIAL_548>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "549": {
+      "content": "<SPECIAL_549>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "550": {
+      "content": "<SPECIAL_550>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "551": {
+      "content": "<SPECIAL_551>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "552": {
+      "content": "<SPECIAL_552>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "553": {
+      "content": "<SPECIAL_553>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "554": {
+      "content": "<SPECIAL_554>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "555": {
+      "content": "<SPECIAL_555>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "556": {
+      "content": "<SPECIAL_556>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "557": {
+      "content": "<SPECIAL_557>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "558": {
+      "content": "<SPECIAL_558>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "559": {
+      "content": "<SPECIAL_559>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "560": {
+      "content": "<SPECIAL_560>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "561": {
+      "content": "<SPECIAL_561>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "562": {
+      "content": "<SPECIAL_562>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "563": {
+      "content": "<SPECIAL_563>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "564": {
+      "content": "<SPECIAL_564>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "565": {
+      "content": "<SPECIAL_565>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "566": {
+      "content": "<SPECIAL_566>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "567": {
+      "content": "<SPECIAL_567>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "568": {
+      "content": "<SPECIAL_568>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "569": {
+      "content": "<SPECIAL_569>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "570": {
+      "content": "<SPECIAL_570>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "571": {
+      "content": "<SPECIAL_571>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "572": {
+      "content": "<SPECIAL_572>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "573": {
+      "content": "<SPECIAL_573>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "574": {
+      "content": "<SPECIAL_574>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "575": {
+      "content": "<SPECIAL_575>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "576": {
+      "content": "<SPECIAL_576>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "577": {
+      "content": "<SPECIAL_577>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "578": {
+      "content": "<SPECIAL_578>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "579": {
+      "content": "<SPECIAL_579>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "580": {
+      "content": "<SPECIAL_580>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "581": {
+      "content": "<SPECIAL_581>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "582": {
+      "content": "<SPECIAL_582>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "583": {
+      "content": "<SPECIAL_583>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "584": {
+      "content": "<SPECIAL_584>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "585": {
+      "content": "<SPECIAL_585>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "586": {
+      "content": "<SPECIAL_586>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "587": {
+      "content": "<SPECIAL_587>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "588": {
+      "content": "<SPECIAL_588>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "589": {
+      "content": "<SPECIAL_589>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "590": {
+      "content": "<SPECIAL_590>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "591": {
+      "content": "<SPECIAL_591>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "592": {
+      "content": "<SPECIAL_592>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "593": {
+      "content": "<SPECIAL_593>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "594": {
+      "content": "<SPECIAL_594>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "595": {
+      "content": "<SPECIAL_595>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "596": {
+      "content": "<SPECIAL_596>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "597": {
+      "content": "<SPECIAL_597>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "598": {
+      "content": "<SPECIAL_598>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "599": {
+      "content": "<SPECIAL_599>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "600": {
+      "content": "<SPECIAL_600>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "601": {
+      "content": "<SPECIAL_601>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "602": {
+      "content": "<SPECIAL_602>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "603": {
+      "content": "<SPECIAL_603>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "604": {
+      "content": "<SPECIAL_604>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "605": {
+      "content": "<SPECIAL_605>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "606": {
+      "content": "<SPECIAL_606>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "607": {
+      "content": "<SPECIAL_607>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "608": {
+      "content": "<SPECIAL_608>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "609": {
+      "content": "<SPECIAL_609>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "610": {
+      "content": "<SPECIAL_610>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "611": {
+      "content": "<SPECIAL_611>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "612": {
+      "content": "<SPECIAL_612>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "613": {
+      "content": "<SPECIAL_613>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "614": {
+      "content": "<SPECIAL_614>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "615": {
+      "content": "<SPECIAL_615>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "616": {
+      "content": "<SPECIAL_616>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "617": {
+      "content": "<SPECIAL_617>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "618": {
+      "content": "<SPECIAL_618>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "619": {
+      "content": "<SPECIAL_619>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "620": {
+      "content": "<SPECIAL_620>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "621": {
+      "content": "<SPECIAL_621>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "622": {
+      "content": "<SPECIAL_622>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "623": {
+      "content": "<SPECIAL_623>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "624": {
+      "content": "<SPECIAL_624>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "625": {
+      "content": "<SPECIAL_625>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "626": {
+      "content": "<SPECIAL_626>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "627": {
+      "content": "<SPECIAL_627>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "628": {
+      "content": "<SPECIAL_628>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "629": {
+      "content": "<SPECIAL_629>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "630": {
+      "content": "<SPECIAL_630>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "631": {
+      "content": "<SPECIAL_631>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "632": {
+      "content": "<SPECIAL_632>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "633": {
+      "content": "<SPECIAL_633>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "634": {
+      "content": "<SPECIAL_634>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "635": {
+      "content": "<SPECIAL_635>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "636": {
+      "content": "<SPECIAL_636>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "637": {
+      "content": "<SPECIAL_637>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "638": {
+      "content": "<SPECIAL_638>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "639": {
+      "content": "<SPECIAL_639>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "640": {
+      "content": "<SPECIAL_640>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "641": {
+      "content": "<SPECIAL_641>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "642": {
+      "content": "<SPECIAL_642>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "643": {
+      "content": "<SPECIAL_643>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "644": {
+      "content": "<SPECIAL_644>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "645": {
+      "content": "<SPECIAL_645>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "646": {
+      "content": "<SPECIAL_646>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "647": {
+      "content": "<SPECIAL_647>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "648": {
+      "content": "<SPECIAL_648>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "649": {
+      "content": "<SPECIAL_649>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "650": {
+      "content": "<SPECIAL_650>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "651": {
+      "content": "<SPECIAL_651>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "652": {
+      "content": "<SPECIAL_652>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "653": {
+      "content": "<SPECIAL_653>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "654": {
+      "content": "<SPECIAL_654>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "655": {
+      "content": "<SPECIAL_655>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "656": {
+      "content": "<SPECIAL_656>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "657": {
+      "content": "<SPECIAL_657>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "658": {
+      "content": "<SPECIAL_658>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "659": {
+      "content": "<SPECIAL_659>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "660": {
+      "content": "<SPECIAL_660>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "661": {
+      "content": "<SPECIAL_661>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "662": {
+      "content": "<SPECIAL_662>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "663": {
+      "content": "<SPECIAL_663>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "664": {
+      "content": "<SPECIAL_664>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "665": {
+      "content": "<SPECIAL_665>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "666": {
+      "content": "<SPECIAL_666>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "667": {
+      "content": "<SPECIAL_667>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "668": {
+      "content": "<SPECIAL_668>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "669": {
+      "content": "<SPECIAL_669>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "670": {
+      "content": "<SPECIAL_670>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "671": {
+      "content": "<SPECIAL_671>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "672": {
+      "content": "<SPECIAL_672>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "673": {
+      "content": "<SPECIAL_673>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "674": {
+      "content": "<SPECIAL_674>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "675": {
+      "content": "<SPECIAL_675>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "676": {
+      "content": "<SPECIAL_676>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "677": {
+      "content": "<SPECIAL_677>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "678": {
+      "content": "<SPECIAL_678>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "679": {
+      "content": "<SPECIAL_679>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "680": {
+      "content": "<SPECIAL_680>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "681": {
+      "content": "<SPECIAL_681>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "682": {
+      "content": "<SPECIAL_682>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "683": {
+      "content": "<SPECIAL_683>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "684": {
+      "content": "<SPECIAL_684>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "685": {
+      "content": "<SPECIAL_685>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "686": {
+      "content": "<SPECIAL_686>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "687": {
+      "content": "<SPECIAL_687>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "688": {
+      "content": "<SPECIAL_688>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "689": {
+      "content": "<SPECIAL_689>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "690": {
+      "content": "<SPECIAL_690>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "691": {
+      "content": "<SPECIAL_691>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "692": {
+      "content": "<SPECIAL_692>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "693": {
+      "content": "<SPECIAL_693>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "694": {
+      "content": "<SPECIAL_694>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "695": {
+      "content": "<SPECIAL_695>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "696": {
+      "content": "<SPECIAL_696>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "697": {
+      "content": "<SPECIAL_697>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "698": {
+      "content": "<SPECIAL_698>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "699": {
+      "content": "<SPECIAL_699>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "700": {
+      "content": "<SPECIAL_700>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "701": {
+      "content": "<SPECIAL_701>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "702": {
+      "content": "<SPECIAL_702>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "703": {
+      "content": "<SPECIAL_703>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "704": {
+      "content": "<SPECIAL_704>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "705": {
+      "content": "<SPECIAL_705>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "706": {
+      "content": "<SPECIAL_706>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "707": {
+      "content": "<SPECIAL_707>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "708": {
+      "content": "<SPECIAL_708>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "709": {
+      "content": "<SPECIAL_709>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "710": {
+      "content": "<SPECIAL_710>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "711": {
+      "content": "<SPECIAL_711>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "712": {
+      "content": "<SPECIAL_712>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "713": {
+      "content": "<SPECIAL_713>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "714": {
+      "content": "<SPECIAL_714>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "715": {
+      "content": "<SPECIAL_715>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "716": {
+      "content": "<SPECIAL_716>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "717": {
+      "content": "<SPECIAL_717>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "718": {
+      "content": "<SPECIAL_718>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "719": {
+      "content": "<SPECIAL_719>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "720": {
+      "content": "<SPECIAL_720>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "721": {
+      "content": "<SPECIAL_721>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "722": {
+      "content": "<SPECIAL_722>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "723": {
+      "content": "<SPECIAL_723>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "724": {
+      "content": "<SPECIAL_724>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "725": {
+      "content": "<SPECIAL_725>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "726": {
+      "content": "<SPECIAL_726>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "727": {
+      "content": "<SPECIAL_727>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "728": {
+      "content": "<SPECIAL_728>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "729": {
+      "content": "<SPECIAL_729>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "730": {
+      "content": "<SPECIAL_730>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "731": {
+      "content": "<SPECIAL_731>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "732": {
+      "content": "<SPECIAL_732>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "733": {
+      "content": "<SPECIAL_733>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "734": {
+      "content": "<SPECIAL_734>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "735": {
+      "content": "<SPECIAL_735>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "736": {
+      "content": "<SPECIAL_736>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "737": {
+      "content": "<SPECIAL_737>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "738": {
+      "content": "<SPECIAL_738>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "739": {
+      "content": "<SPECIAL_739>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "740": {
+      "content": "<SPECIAL_740>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "741": {
+      "content": "<SPECIAL_741>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "742": {
+      "content": "<SPECIAL_742>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "743": {
+      "content": "<SPECIAL_743>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "744": {
+      "content": "<SPECIAL_744>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "745": {
+      "content": "<SPECIAL_745>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "746": {
+      "content": "<SPECIAL_746>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "747": {
+      "content": "<SPECIAL_747>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "748": {
+      "content": "<SPECIAL_748>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "749": {
+      "content": "<SPECIAL_749>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "750": {
+      "content": "<SPECIAL_750>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "751": {
+      "content": "<SPECIAL_751>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "752": {
+      "content": "<SPECIAL_752>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "753": {
+      "content": "<SPECIAL_753>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "754": {
+      "content": "<SPECIAL_754>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "755": {
+      "content": "<SPECIAL_755>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "756": {
+      "content": "<SPECIAL_756>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "757": {
+      "content": "<SPECIAL_757>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "758": {
+      "content": "<SPECIAL_758>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "759": {
+      "content": "<SPECIAL_759>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "760": {
+      "content": "<SPECIAL_760>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "761": {
+      "content": "<SPECIAL_761>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "762": {
+      "content": "<SPECIAL_762>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "763": {
+      "content": "<SPECIAL_763>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "764": {
+      "content": "<SPECIAL_764>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "765": {
+      "content": "<SPECIAL_765>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "766": {
+      "content": "<SPECIAL_766>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "767": {
+      "content": "<SPECIAL_767>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "768": {
+      "content": "<SPECIAL_768>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "769": {
+      "content": "<SPECIAL_769>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "770": {
+      "content": "<SPECIAL_770>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "771": {
+      "content": "<SPECIAL_771>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "772": {
+      "content": "<SPECIAL_772>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "773": {
+      "content": "<SPECIAL_773>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "774": {
+      "content": "<SPECIAL_774>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "775": {
+      "content": "<SPECIAL_775>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "776": {
+      "content": "<SPECIAL_776>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "777": {
+      "content": "<SPECIAL_777>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "778": {
+      "content": "<SPECIAL_778>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "779": {
+      "content": "<SPECIAL_779>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "780": {
+      "content": "<SPECIAL_780>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "781": {
+      "content": "<SPECIAL_781>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "782": {
+      "content": "<SPECIAL_782>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "783": {
+      "content": "<SPECIAL_783>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "784": {
+      "content": "<SPECIAL_784>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "785": {
+      "content": "<SPECIAL_785>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "786": {
+      "content": "<SPECIAL_786>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "787": {
+      "content": "<SPECIAL_787>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "788": {
+      "content": "<SPECIAL_788>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "789": {
+      "content": "<SPECIAL_789>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "790": {
+      "content": "<SPECIAL_790>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "791": {
+      "content": "<SPECIAL_791>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "792": {
+      "content": "<SPECIAL_792>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "793": {
+      "content": "<SPECIAL_793>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "794": {
+      "content": "<SPECIAL_794>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "795": {
+      "content": "<SPECIAL_795>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "796": {
+      "content": "<SPECIAL_796>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "797": {
+      "content": "<SPECIAL_797>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "798": {
+      "content": "<SPECIAL_798>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "799": {
+      "content": "<SPECIAL_799>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "800": {
+      "content": "<SPECIAL_800>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "801": {
+      "content": "<SPECIAL_801>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "802": {
+      "content": "<SPECIAL_802>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "803": {
+      "content": "<SPECIAL_803>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "804": {
+      "content": "<SPECIAL_804>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "805": {
+      "content": "<SPECIAL_805>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "806": {
+      "content": "<SPECIAL_806>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "807": {
+      "content": "<SPECIAL_807>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "808": {
+      "content": "<SPECIAL_808>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "809": {
+      "content": "<SPECIAL_809>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "810": {
+      "content": "<SPECIAL_810>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "811": {
+      "content": "<SPECIAL_811>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "812": {
+      "content": "<SPECIAL_812>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "813": {
+      "content": "<SPECIAL_813>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "814": {
+      "content": "<SPECIAL_814>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "815": {
+      "content": "<SPECIAL_815>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "816": {
+      "content": "<SPECIAL_816>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "817": {
+      "content": "<SPECIAL_817>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "818": {
+      "content": "<SPECIAL_818>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "819": {
+      "content": "<SPECIAL_819>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "820": {
+      "content": "<SPECIAL_820>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "821": {
+      "content": "<SPECIAL_821>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "822": {
+      "content": "<SPECIAL_822>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "823": {
+      "content": "<SPECIAL_823>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "824": {
+      "content": "<SPECIAL_824>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "825": {
+      "content": "<SPECIAL_825>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "826": {
+      "content": "<SPECIAL_826>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "827": {
+      "content": "<SPECIAL_827>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "828": {
+      "content": "<SPECIAL_828>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "829": {
+      "content": "<SPECIAL_829>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "830": {
+      "content": "<SPECIAL_830>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "831": {
+      "content": "<SPECIAL_831>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "832": {
+      "content": "<SPECIAL_832>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "833": {
+      "content": "<SPECIAL_833>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "834": {
+      "content": "<SPECIAL_834>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "835": {
+      "content": "<SPECIAL_835>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "836": {
+      "content": "<SPECIAL_836>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "837": {
+      "content": "<SPECIAL_837>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "838": {
+      "content": "<SPECIAL_838>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "839": {
+      "content": "<SPECIAL_839>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "840": {
+      "content": "<SPECIAL_840>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "841": {
+      "content": "<SPECIAL_841>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "842": {
+      "content": "<SPECIAL_842>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "843": {
+      "content": "<SPECIAL_843>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "844": {
+      "content": "<SPECIAL_844>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "845": {
+      "content": "<SPECIAL_845>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "846": {
+      "content": "<SPECIAL_846>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "847": {
+      "content": "<SPECIAL_847>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "848": {
+      "content": "<SPECIAL_848>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "849": {
+      "content": "<SPECIAL_849>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "850": {
+      "content": "<SPECIAL_850>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "851": {
+      "content": "<SPECIAL_851>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "852": {
+      "content": "<SPECIAL_852>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "853": {
+      "content": "<SPECIAL_853>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "854": {
+      "content": "<SPECIAL_854>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "855": {
+      "content": "<SPECIAL_855>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "856": {
+      "content": "<SPECIAL_856>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "857": {
+      "content": "<SPECIAL_857>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "858": {
+      "content": "<SPECIAL_858>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "859": {
+      "content": "<SPECIAL_859>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "860": {
+      "content": "<SPECIAL_860>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "861": {
+      "content": "<SPECIAL_861>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "862": {
+      "content": "<SPECIAL_862>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "863": {
+      "content": "<SPECIAL_863>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "864": {
+      "content": "<SPECIAL_864>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "865": {
+      "content": "<SPECIAL_865>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "866": {
+      "content": "<SPECIAL_866>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "867": {
+      "content": "<SPECIAL_867>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "868": {
+      "content": "<SPECIAL_868>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "869": {
+      "content": "<SPECIAL_869>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "870": {
+      "content": "<SPECIAL_870>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "871": {
+      "content": "<SPECIAL_871>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "872": {
+      "content": "<SPECIAL_872>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "873": {
+      "content": "<SPECIAL_873>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "874": {
+      "content": "<SPECIAL_874>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "875": {
+      "content": "<SPECIAL_875>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "876": {
+      "content": "<SPECIAL_876>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "877": {
+      "content": "<SPECIAL_877>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "878": {
+      "content": "<SPECIAL_878>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "879": {
+      "content": "<SPECIAL_879>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "880": {
+      "content": "<SPECIAL_880>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "881": {
+      "content": "<SPECIAL_881>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "882": {
+      "content": "<SPECIAL_882>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "883": {
+      "content": "<SPECIAL_883>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "884": {
+      "content": "<SPECIAL_884>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "885": {
+      "content": "<SPECIAL_885>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "886": {
+      "content": "<SPECIAL_886>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "887": {
+      "content": "<SPECIAL_887>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "888": {
+      "content": "<SPECIAL_888>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "889": {
+      "content": "<SPECIAL_889>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "890": {
+      "content": "<SPECIAL_890>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "891": {
+      "content": "<SPECIAL_891>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "892": {
+      "content": "<SPECIAL_892>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "893": {
+      "content": "<SPECIAL_893>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "894": {
+      "content": "<SPECIAL_894>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "895": {
+      "content": "<SPECIAL_895>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "896": {
+      "content": "<SPECIAL_896>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "897": {
+      "content": "<SPECIAL_897>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "898": {
+      "content": "<SPECIAL_898>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "899": {
+      "content": "<SPECIAL_899>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "900": {
+      "content": "<SPECIAL_900>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "901": {
+      "content": "<SPECIAL_901>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "902": {
+      "content": "<SPECIAL_902>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "903": {
+      "content": "<SPECIAL_903>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "904": {
+      "content": "<SPECIAL_904>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "905": {
+      "content": "<SPECIAL_905>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "906": {
+      "content": "<SPECIAL_906>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "907": {
+      "content": "<SPECIAL_907>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "908": {
+      "content": "<SPECIAL_908>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "909": {
+      "content": "<SPECIAL_909>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "910": {
+      "content": "<SPECIAL_910>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "911": {
+      "content": "<SPECIAL_911>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "912": {
+      "content": "<SPECIAL_912>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "913": {
+      "content": "<SPECIAL_913>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "914": {
+      "content": "<SPECIAL_914>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "915": {
+      "content": "<SPECIAL_915>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "916": {
+      "content": "<SPECIAL_916>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "917": {
+      "content": "<SPECIAL_917>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "918": {
+      "content": "<SPECIAL_918>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "919": {
+      "content": "<SPECIAL_919>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "920": {
+      "content": "<SPECIAL_920>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "921": {
+      "content": "<SPECIAL_921>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "922": {
+      "content": "<SPECIAL_922>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "923": {
+      "content": "<SPECIAL_923>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "924": {
+      "content": "<SPECIAL_924>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "925": {
+      "content": "<SPECIAL_925>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "926": {
+      "content": "<SPECIAL_926>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "927": {
+      "content": "<SPECIAL_927>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "928": {
+      "content": "<SPECIAL_928>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "929": {
+      "content": "<SPECIAL_929>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "930": {
+      "content": "<SPECIAL_930>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "931": {
+      "content": "<SPECIAL_931>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "932": {
+      "content": "<SPECIAL_932>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "933": {
+      "content": "<SPECIAL_933>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "934": {
+      "content": "<SPECIAL_934>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "935": {
+      "content": "<SPECIAL_935>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "936": {
+      "content": "<SPECIAL_936>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "937": {
+      "content": "<SPECIAL_937>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "938": {
+      "content": "<SPECIAL_938>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "939": {
+      "content": "<SPECIAL_939>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "940": {
+      "content": "<SPECIAL_940>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "941": {
+      "content": "<SPECIAL_941>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "942": {
+      "content": "<SPECIAL_942>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "943": {
+      "content": "<SPECIAL_943>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "944": {
+      "content": "<SPECIAL_944>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "945": {
+      "content": "<SPECIAL_945>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "946": {
+      "content": "<SPECIAL_946>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "947": {
+      "content": "<SPECIAL_947>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "948": {
+      "content": "<SPECIAL_948>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "949": {
+      "content": "<SPECIAL_949>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "950": {
+      "content": "<SPECIAL_950>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "951": {
+      "content": "<SPECIAL_951>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "952": {
+      "content": "<SPECIAL_952>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "953": {
+      "content": "<SPECIAL_953>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "954": {
+      "content": "<SPECIAL_954>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "955": {
+      "content": "<SPECIAL_955>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "956": {
+      "content": "<SPECIAL_956>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "957": {
+      "content": "<SPECIAL_957>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "958": {
+      "content": "<SPECIAL_958>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "959": {
+      "content": "<SPECIAL_959>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "960": {
+      "content": "<SPECIAL_960>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "961": {
+      "content": "<SPECIAL_961>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "962": {
+      "content": "<SPECIAL_962>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "963": {
+      "content": "<SPECIAL_963>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "964": {
+      "content": "<SPECIAL_964>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "965": {
+      "content": "<SPECIAL_965>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "966": {
+      "content": "<SPECIAL_966>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "967": {
+      "content": "<SPECIAL_967>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "968": {
+      "content": "<SPECIAL_968>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "969": {
+      "content": "<SPECIAL_969>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "970": {
+      "content": "<SPECIAL_970>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "971": {
+      "content": "<SPECIAL_971>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "972": {
+      "content": "<SPECIAL_972>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "973": {
+      "content": "<SPECIAL_973>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "974": {
+      "content": "<SPECIAL_974>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "975": {
+      "content": "<SPECIAL_975>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "976": {
+      "content": "<SPECIAL_976>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "977": {
+      "content": "<SPECIAL_977>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "978": {
+      "content": "<SPECIAL_978>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "979": {
+      "content": "<SPECIAL_979>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "980": {
+      "content": "<SPECIAL_980>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "981": {
+      "content": "<SPECIAL_981>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "982": {
+      "content": "<SPECIAL_982>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "983": {
+      "content": "<SPECIAL_983>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "984": {
+      "content": "<SPECIAL_984>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "985": {
+      "content": "<SPECIAL_985>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "986": {
+      "content": "<SPECIAL_986>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "987": {
+      "content": "<SPECIAL_987>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "988": {
+      "content": "<SPECIAL_988>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "989": {
+      "content": "<SPECIAL_989>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "990": {
+      "content": "<SPECIAL_990>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "991": {
+      "content": "<SPECIAL_991>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "992": {
+      "content": "<SPECIAL_992>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "993": {
+      "content": "<SPECIAL_993>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "994": {
+      "content": "<SPECIAL_994>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "995": {
+      "content": "<SPECIAL_995>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "996": {
+      "content": "<SPECIAL_996>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "997": {
+      "content": "<SPECIAL_997>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "998": {
+      "content": "<SPECIAL_998>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "999": {
+      "content": "<SPECIAL_999>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "extra_special_tokens": {},
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "tokenizer_class": "PreTrainedTokenizer",
+  "unk_token": "<unk>"
+}
diff --git a/checkpoint-1088/trainer_state.json b/checkpoint-1088/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..0cf06bfe8b9537eab1ca0520582bb95066a0523d
--- /dev/null
+++ b/checkpoint-1088/trainer_state.json
@@ -0,0 +1,7722 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.997245179063361,
+  "eval_steps": 136,
+  "global_step": 1088,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0018365472910927456,
+      "grad_norm": 0.49180246368465724,
+      "learning_rate": 0.0,
+      "loss": 1.3574,
+      "step": 1
+    },
+    {
+      "epoch": 0.0018365472910927456,
+      "eval_loss": 2.4259753227233887,
+      "eval_runtime": 39.8169,
+      "eval_samples_per_second": 5.149,
+      "eval_steps_per_second": 0.452,
+      "step": 1
+    },
+    {
+      "epoch": 0.0036730945821854912,
+      "grad_norm": 0.3994587341086747,
+      "learning_rate": 2.5000000000000004e-07,
+      "loss": 1.444,
+      "step": 2
+    },
+    {
+      "epoch": 0.005509641873278237,
+      "grad_norm": 0.39017597145072364,
+      "learning_rate": 5.000000000000001e-07,
+      "loss": 1.5149,
+      "step": 3
+    },
+    {
+      "epoch": 0.0073461891643709825,
+      "grad_norm": 0.47444439480391987,
+      "learning_rate": 7.5e-07,
+      "loss": 1.5855,
+      "step": 4
+    },
+    {
+      "epoch": 0.009182736455463728,
+      "grad_norm": 0.794434599507836,
+      "learning_rate": 1.0000000000000002e-06,
+      "loss": 1.6531,
+      "step": 5
+    },
+    {
+      "epoch": 0.011019283746556474,
+      "grad_norm": 0.7108153394196348,
+      "learning_rate": 1.25e-06,
+      "loss": 1.7881,
+      "step": 6
+    },
+    {
+      "epoch": 0.012855831037649219,
+      "grad_norm": 0.5204076611421804,
+      "learning_rate": 1.5e-06,
+      "loss": 1.5592,
+      "step": 7
+    },
+    {
+      "epoch": 0.014692378328741965,
+      "grad_norm": 0.7569351115766059,
+      "learning_rate": 1.75e-06,
+      "loss": 1.5735,
+      "step": 8
+    },
+    {
+      "epoch": 0.01652892561983471,
+      "grad_norm": 0.5678098307469198,
+      "learning_rate": 2.0000000000000003e-06,
+      "loss": 1.5934,
+      "step": 9
+    },
+    {
+      "epoch": 0.018365472910927456,
+      "grad_norm": 0.40098167184732914,
+      "learning_rate": 2.25e-06,
+      "loss": 1.688,
+      "step": 10
+    },
+    {
+      "epoch": 0.020202020202020204,
+      "grad_norm": 0.4268491869708594,
+      "learning_rate": 2.5e-06,
+      "loss": 1.6286,
+      "step": 11
+    },
+    {
+      "epoch": 0.02203856749311295,
+      "grad_norm": 0.5835872767276206,
+      "learning_rate": 2.7500000000000004e-06,
+      "loss": 1.679,
+      "step": 12
+    },
+    {
+      "epoch": 0.023875114784205693,
+      "grad_norm": 0.41861495783037117,
+      "learning_rate": 3e-06,
+      "loss": 1.7093,
+      "step": 13
+    },
+    {
+      "epoch": 0.025711662075298437,
+      "grad_norm": 0.3375113108661923,
+      "learning_rate": 3.2500000000000002e-06,
+      "loss": 1.7431,
+      "step": 14
+    },
+    {
+      "epoch": 0.027548209366391185,
+      "grad_norm": 0.48885555509704504,
+      "learning_rate": 3.5e-06,
+      "loss": 1.4873,
+      "step": 15
+    },
+    {
+      "epoch": 0.02938475665748393,
+      "grad_norm": 0.4483288005954393,
+      "learning_rate": 3.7500000000000005e-06,
+      "loss": 1.6619,
+      "step": 16
+    },
+    {
+      "epoch": 0.031221303948576674,
+      "grad_norm": 0.4299802045225574,
+      "learning_rate": 4.000000000000001e-06,
+      "loss": 1.6997,
+      "step": 17
+    },
+    {
+      "epoch": 0.03305785123966942,
+      "grad_norm": 0.5824485228901973,
+      "learning_rate": 4.25e-06,
+      "loss": 1.691,
+      "step": 18
+    },
+    {
+      "epoch": 0.03489439853076217,
+      "grad_norm": 0.32860558551239133,
+      "learning_rate": 4.5e-06,
+      "loss": 1.5414,
+      "step": 19
+    },
+    {
+      "epoch": 0.03673094582185491,
+      "grad_norm": 1.7514560949718712,
+      "learning_rate": 4.75e-06,
+      "loss": 1.522,
+      "step": 20
+    },
+    {
+      "epoch": 0.03856749311294766,
+      "grad_norm": 0.3844467204577219,
+      "learning_rate": 5e-06,
+      "loss": 1.6948,
+      "step": 21
+    },
+    {
+      "epoch": 0.04040404040404041,
+      "grad_norm": 0.329345071029554,
+      "learning_rate": 5.2500000000000006e-06,
+      "loss": 1.509,
+      "step": 22
+    },
+    {
+      "epoch": 0.04224058769513315,
+      "grad_norm": 0.28268786055882505,
+      "learning_rate": 5.500000000000001e-06,
+      "loss": 1.5563,
+      "step": 23
+    },
+    {
+      "epoch": 0.0440771349862259,
+      "grad_norm": 0.3422617324754064,
+      "learning_rate": 5.75e-06,
+      "loss": 1.5615,
+      "step": 24
+    },
+    {
+      "epoch": 0.04591368227731864,
+      "grad_norm": 0.33860326348440456,
+      "learning_rate": 6e-06,
+      "loss": 1.7008,
+      "step": 25
+    },
+    {
+      "epoch": 0.047750229568411386,
+      "grad_norm": 0.2789219845798442,
+      "learning_rate": 6.25e-06,
+      "loss": 1.5667,
+      "step": 26
+    },
+    {
+      "epoch": 0.049586776859504134,
+      "grad_norm": 0.37047693270617005,
+      "learning_rate": 6.5000000000000004e-06,
+      "loss": 1.5557,
+      "step": 27
+    },
+    {
+      "epoch": 0.051423324150596875,
+      "grad_norm": 0.3368470842339362,
+      "learning_rate": 6.750000000000001e-06,
+      "loss": 1.6045,
+      "step": 28
+    },
+    {
+      "epoch": 0.05325987144168962,
+      "grad_norm": 0.30344837893854465,
+      "learning_rate": 7e-06,
+      "loss": 1.6766,
+      "step": 29
+    },
+    {
+      "epoch": 0.05509641873278237,
+      "grad_norm": 0.6359004570618099,
+      "learning_rate": 7.25e-06,
+      "loss": 1.6499,
+      "step": 30
+    },
+    {
+      "epoch": 0.05693296602387511,
+      "grad_norm": 0.3258591226646554,
+      "learning_rate": 7.500000000000001e-06,
+      "loss": 1.6565,
+      "step": 31
+    },
+    {
+      "epoch": 0.05876951331496786,
+      "grad_norm": 0.3697834149605013,
+      "learning_rate": 7.75e-06,
+      "loss": 1.4883,
+      "step": 32
+    },
+    {
+      "epoch": 0.06060606060606061,
+      "grad_norm": 0.265668853003883,
+      "learning_rate": 8.000000000000001e-06,
+      "loss": 1.8289,
+      "step": 33
+    },
+    {
+      "epoch": 0.06244260789715335,
+      "grad_norm": 0.39987679350668315,
+      "learning_rate": 8.25e-06,
+      "loss": 1.6633,
+      "step": 34
+    },
+    {
+      "epoch": 0.0642791551882461,
+      "grad_norm": 0.39636333420956993,
+      "learning_rate": 8.5e-06,
+      "loss": 1.2298,
+      "step": 35
+    },
+    {
+      "epoch": 0.06611570247933884,
+      "grad_norm": 0.3464362348603123,
+      "learning_rate": 8.750000000000001e-06,
+      "loss": 1.485,
+      "step": 36
+    },
+    {
+      "epoch": 0.06795224977043159,
+      "grad_norm": 0.31616445355046285,
+      "learning_rate": 9e-06,
+      "loss": 1.5553,
+      "step": 37
+    },
+    {
+      "epoch": 0.06978879706152434,
+      "grad_norm": 0.4441888412468937,
+      "learning_rate": 9.250000000000001e-06,
+      "loss": 1.5967,
+      "step": 38
+    },
+    {
+      "epoch": 0.07162534435261708,
+      "grad_norm": 0.3547318554597848,
+      "learning_rate": 9.5e-06,
+      "loss": 1.5006,
+      "step": 39
+    },
+    {
+      "epoch": 0.07346189164370982,
+      "grad_norm": 0.27557088472944596,
+      "learning_rate": 9.75e-06,
+      "loss": 1.5673,
+      "step": 40
+    },
+    {
+      "epoch": 0.07529843893480258,
+      "grad_norm": 0.2956312497066916,
+      "learning_rate": 1e-05,
+      "loss": 1.4936,
+      "step": 41
+    },
+    {
+      "epoch": 0.07713498622589532,
+      "grad_norm": 0.2322611308466898,
+      "learning_rate": 9.999994591993822e-06,
+      "loss": 1.4759,
+      "step": 42
+    },
+    {
+      "epoch": 0.07897153351698806,
+      "grad_norm": 0.22039029040435731,
+      "learning_rate": 9.999978367986988e-06,
+      "loss": 1.6625,
+      "step": 43
+    },
+    {
+      "epoch": 0.08080808080808081,
+      "grad_norm": 0.3446344059315139,
+      "learning_rate": 9.999951328014591e-06,
+      "loss": 1.6309,
+      "step": 44
+    },
+    {
+      "epoch": 0.08264462809917356,
+      "grad_norm": 0.23666900781940328,
+      "learning_rate": 9.999913472135126e-06,
+      "loss": 1.5347,
+      "step": 45
+    },
+    {
+      "epoch": 0.0844811753902663,
+      "grad_norm": 0.2840328883351318,
+      "learning_rate": 9.999864800430482e-06,
+      "loss": 1.5115,
+      "step": 46
+    },
+    {
+      "epoch": 0.08631772268135904,
+      "grad_norm": 0.2407651293731456,
+      "learning_rate": 9.999805313005946e-06,
+      "loss": 1.4199,
+      "step": 47
+    },
+    {
+      "epoch": 0.0881542699724518,
+      "grad_norm": 0.24925631476018442,
+      "learning_rate": 9.999735009990202e-06,
+      "loss": 1.7008,
+      "step": 48
+    },
+    {
+      "epoch": 0.08999081726354453,
+      "grad_norm": 0.2502728573485842,
+      "learning_rate": 9.99965389153533e-06,
+      "loss": 1.6181,
+      "step": 49
+    },
+    {
+      "epoch": 0.09182736455463728,
+      "grad_norm": 0.23272569963887466,
+      "learning_rate": 9.999561957816803e-06,
+      "loss": 1.4668,
+      "step": 50
+    },
+    {
+      "epoch": 0.09366391184573003,
+      "grad_norm": 0.23492521900860228,
+      "learning_rate": 9.999459209033495e-06,
+      "loss": 1.6884,
+      "step": 51
+    },
+    {
+      "epoch": 0.09550045913682277,
+      "grad_norm": 0.24231529936066795,
+      "learning_rate": 9.999345645407671e-06,
+      "loss": 1.3811,
+      "step": 52
+    },
+    {
+      "epoch": 0.09733700642791551,
+      "grad_norm": 0.23749137313908725,
+      "learning_rate": 9.999221267184993e-06,
+      "loss": 1.6599,
+      "step": 53
+    },
+    {
+      "epoch": 0.09917355371900827,
+      "grad_norm": 0.2631749052017168,
+      "learning_rate": 9.999086074634516e-06,
+      "loss": 1.5321,
+      "step": 54
+    },
+    {
+      "epoch": 0.10101010101010101,
+      "grad_norm": 0.265780364913351,
+      "learning_rate": 9.998940068048688e-06,
+      "loss": 1.7954,
+      "step": 55
+    },
+    {
+      "epoch": 0.10284664830119375,
+      "grad_norm": 0.23373755925772408,
+      "learning_rate": 9.998783247743353e-06,
+      "loss": 1.6503,
+      "step": 56
+    },
+    {
+      "epoch": 0.1046831955922865,
+      "grad_norm": 0.26345499971500486,
+      "learning_rate": 9.998615614057743e-06,
+      "loss": 1.6842,
+      "step": 57
+    },
+    {
+      "epoch": 0.10651974288337925,
+      "grad_norm": 0.22858688890828285,
+      "learning_rate": 9.998437167354485e-06,
+      "loss": 1.6053,
+      "step": 58
+    },
+    {
+      "epoch": 0.10835629017447199,
+      "grad_norm": 0.22732836541277007,
+      "learning_rate": 9.998247908019594e-06,
+      "loss": 1.5357,
+      "step": 59
+    },
+    {
+      "epoch": 0.11019283746556474,
+      "grad_norm": 0.21575052353545032,
+      "learning_rate": 9.998047836462476e-06,
+      "loss": 1.5875,
+      "step": 60
+    },
+    {
+      "epoch": 0.11202938475665748,
+      "grad_norm": 0.3308350003540223,
+      "learning_rate": 9.997836953115927e-06,
+      "loss": 1.9333,
+      "step": 61
+    },
+    {
+      "epoch": 0.11386593204775022,
+      "grad_norm": 0.24160639887541288,
+      "learning_rate": 9.99761525843613e-06,
+      "loss": 1.6121,
+      "step": 62
+    },
+    {
+      "epoch": 0.11570247933884298,
+      "grad_norm": 0.23537591666009566,
+      "learning_rate": 9.997382752902658e-06,
+      "loss": 1.6341,
+      "step": 63
+    },
+    {
+      "epoch": 0.11753902662993572,
+      "grad_norm": 0.30577270648255184,
+      "learning_rate": 9.997139437018463e-06,
+      "loss": 1.4635,
+      "step": 64
+    },
+    {
+      "epoch": 0.11937557392102846,
+      "grad_norm": 0.24971896873950858,
+      "learning_rate": 9.996885311309892e-06,
+      "loss": 1.8186,
+      "step": 65
+    },
+    {
+      "epoch": 0.12121212121212122,
+      "grad_norm": 0.25847791225683553,
+      "learning_rate": 9.996620376326667e-06,
+      "loss": 1.491,
+      "step": 66
+    },
+    {
+      "epoch": 0.12304866850321396,
+      "grad_norm": 0.24031460889715148,
+      "learning_rate": 9.996344632641895e-06,
+      "loss": 1.6563,
+      "step": 67
+    },
+    {
+      "epoch": 0.1248852157943067,
+      "grad_norm": 0.2550524831797301,
+      "learning_rate": 9.996058080852067e-06,
+      "loss": 1.6427,
+      "step": 68
+    },
+    {
+      "epoch": 0.12672176308539945,
+      "grad_norm": 0.22467108780123965,
+      "learning_rate": 9.995760721577053e-06,
+      "loss": 1.4595,
+      "step": 69
+    },
+    {
+      "epoch": 0.1285583103764922,
+      "grad_norm": 0.282181674918973,
+      "learning_rate": 9.995452555460098e-06,
+      "loss": 1.6837,
+      "step": 70
+    },
+    {
+      "epoch": 0.13039485766758493,
+      "grad_norm": 0.5727450301366364,
+      "learning_rate": 9.995133583167833e-06,
+      "loss": 1.6003,
+      "step": 71
+    },
+    {
+      "epoch": 0.1322314049586777,
+      "grad_norm": 0.22744917091853156,
+      "learning_rate": 9.994803805390257e-06,
+      "loss": 1.3544,
+      "step": 72
+    },
+    {
+      "epoch": 0.13406795224977044,
+      "grad_norm": 0.22395196659772004,
+      "learning_rate": 9.994463222840748e-06,
+      "loss": 1.6198,
+      "step": 73
+    },
+    {
+      "epoch": 0.13590449954086317,
+      "grad_norm": 0.2098292344869194,
+      "learning_rate": 9.994111836256049e-06,
+      "loss": 1.5059,
+      "step": 74
+    },
+    {
+      "epoch": 0.13774104683195593,
+      "grad_norm": 0.22329332454983955,
+      "learning_rate": 9.993749646396286e-06,
+      "loss": 1.4666,
+      "step": 75
+    },
+    {
+      "epoch": 0.13957759412304868,
+      "grad_norm": 1.131446258847722,
+      "learning_rate": 9.993376654044948e-06,
+      "loss": 1.5164,
+      "step": 76
+    },
+    {
+      "epoch": 0.1414141414141414,
+      "grad_norm": 0.22716717526603358,
+      "learning_rate": 9.992992860008893e-06,
+      "loss": 1.4978,
+      "step": 77
+    },
+    {
+      "epoch": 0.14325068870523416,
+      "grad_norm": 0.24179796579866508,
+      "learning_rate": 9.992598265118344e-06,
+      "loss": 1.3147,
+      "step": 78
+    },
+    {
+      "epoch": 0.14508723599632692,
+      "grad_norm": 0.2127244611718112,
+      "learning_rate": 9.99219287022689e-06,
+      "loss": 1.4498,
+      "step": 79
+    },
+    {
+      "epoch": 0.14692378328741965,
+      "grad_norm": 0.27213431233903435,
+      "learning_rate": 9.991776676211483e-06,
+      "loss": 1.8822,
+      "step": 80
+    },
+    {
+      "epoch": 0.1487603305785124,
+      "grad_norm": 0.22988463490869612,
+      "learning_rate": 9.991349683972435e-06,
+      "loss": 1.4995,
+      "step": 81
+    },
+    {
+      "epoch": 0.15059687786960516,
+      "grad_norm": 0.23481878477688978,
+      "learning_rate": 9.990911894433415e-06,
+      "loss": 1.5132,
+      "step": 82
+    },
+    {
+      "epoch": 0.15243342516069788,
+      "grad_norm": 0.37026228973170716,
+      "learning_rate": 9.990463308541452e-06,
+      "loss": 1.5846,
+      "step": 83
+    },
+    {
+      "epoch": 0.15426997245179064,
+      "grad_norm": 0.34328184021255104,
+      "learning_rate": 9.990003927266928e-06,
+      "loss": 1.5882,
+      "step": 84
+    },
+    {
+      "epoch": 0.1561065197428834,
+      "grad_norm": 0.2239251502463014,
+      "learning_rate": 9.989533751603578e-06,
+      "loss": 1.5294,
+      "step": 85
+    },
+    {
+      "epoch": 0.15794306703397612,
+      "grad_norm": 0.2531093496713428,
+      "learning_rate": 9.989052782568484e-06,
+      "loss": 1.4136,
+      "step": 86
+    },
+    {
+      "epoch": 0.15977961432506887,
+      "grad_norm": 0.22960377831673873,
+      "learning_rate": 9.988561021202083e-06,
+      "loss": 1.5179,
+      "step": 87
+    },
+    {
+      "epoch": 0.16161616161616163,
+      "grad_norm": 0.2353475082843009,
+      "learning_rate": 9.988058468568154e-06,
+      "loss": 1.5986,
+      "step": 88
+    },
+    {
+      "epoch": 0.16345270890725436,
+      "grad_norm": 0.2095228695568511,
+      "learning_rate": 9.987545125753818e-06,
+      "loss": 1.7077,
+      "step": 89
+    },
+    {
+      "epoch": 0.1652892561983471,
+      "grad_norm": 0.25954954331361235,
+      "learning_rate": 9.987020993869543e-06,
+      "loss": 1.5786,
+      "step": 90
+    },
+    {
+      "epoch": 0.16712580348943984,
+      "grad_norm": 0.3475458310303135,
+      "learning_rate": 9.986486074049131e-06,
+      "loss": 1.6145,
+      "step": 91
+    },
+    {
+      "epoch": 0.1689623507805326,
+      "grad_norm": 0.26936951415786353,
+      "learning_rate": 9.98594036744972e-06,
+      "loss": 1.7652,
+      "step": 92
+    },
+    {
+      "epoch": 0.17079889807162535,
+      "grad_norm": 0.21373420050407635,
+      "learning_rate": 9.985383875251783e-06,
+      "loss": 1.6871,
+      "step": 93
+    },
+    {
+      "epoch": 0.17263544536271808,
+      "grad_norm": 0.23205711833790327,
+      "learning_rate": 9.98481659865913e-06,
+      "loss": 1.4672,
+      "step": 94
+    },
+    {
+      "epoch": 0.17447199265381083,
+      "grad_norm": 0.26381334544086116,
+      "learning_rate": 9.98423853889889e-06,
+      "loss": 1.6741,
+      "step": 95
+    },
+    {
+      "epoch": 0.1763085399449036,
+      "grad_norm": 0.24396664978240085,
+      "learning_rate": 9.983649697221528e-06,
+      "loss": 1.5546,
+      "step": 96
+    },
+    {
+      "epoch": 0.1781450872359963,
+      "grad_norm": 0.2533801841511916,
+      "learning_rate": 9.983050074900824e-06,
+      "loss": 1.6902,
+      "step": 97
+    },
+    {
+      "epoch": 0.17998163452708907,
+      "grad_norm": 0.2115479895852038,
+      "learning_rate": 9.982439673233885e-06,
+      "loss": 1.6094,
+      "step": 98
+    },
+    {
+      "epoch": 0.18181818181818182,
+      "grad_norm": 0.22659674725493387,
+      "learning_rate": 9.98181849354113e-06,
+      "loss": 1.3953,
+      "step": 99
+    },
+    {
+      "epoch": 0.18365472910927455,
+      "grad_norm": 0.4346020173346875,
+      "learning_rate": 9.981186537166301e-06,
+      "loss": 1.4842,
+      "step": 100
+    },
+    {
+      "epoch": 0.1854912764003673,
+      "grad_norm": 0.22752027491511684,
+      "learning_rate": 9.980543805476447e-06,
+      "loss": 1.6125,
+      "step": 101
+    },
+    {
+      "epoch": 0.18732782369146006,
+      "grad_norm": 0.2178158645117292,
+      "learning_rate": 9.979890299861923e-06,
+      "loss": 1.3843,
+      "step": 102
+    },
+    {
+      "epoch": 0.1891643709825528,
+      "grad_norm": 0.2629457576326313,
+      "learning_rate": 9.979226021736396e-06,
+      "loss": 1.5034,
+      "step": 103
+    },
+    {
+      "epoch": 0.19100091827364554,
+      "grad_norm": 0.2638758563035785,
+      "learning_rate": 9.978550972536834e-06,
+      "loss": 1.2882,
+      "step": 104
+    },
+    {
+      "epoch": 0.1928374655647383,
+      "grad_norm": 0.25957055432676646,
+      "learning_rate": 9.977865153723508e-06,
+      "loss": 1.5669,
+      "step": 105
+    },
+    {
+      "epoch": 0.19467401285583102,
+      "grad_norm": 0.2107272760638706,
+      "learning_rate": 9.977168566779976e-06,
+      "loss": 1.4316,
+      "step": 106
+    },
+    {
+      "epoch": 0.19651056014692378,
+      "grad_norm": 0.23996444946668347,
+      "learning_rate": 9.976461213213104e-06,
+      "loss": 1.5958,
+      "step": 107
+    },
+    {
+      "epoch": 0.19834710743801653,
+      "grad_norm": 0.3866853138626082,
+      "learning_rate": 9.975743094553037e-06,
+      "loss": 1.6301,
+      "step": 108
+    },
+    {
+      "epoch": 0.20018365472910926,
+      "grad_norm": 0.2659575860373734,
+      "learning_rate": 9.975014212353212e-06,
+      "loss": 1.6435,
+      "step": 109
+    },
+    {
+      "epoch": 0.20202020202020202,
+      "grad_norm": 0.25698703101518205,
+      "learning_rate": 9.974274568190349e-06,
+      "loss": 1.4947,
+      "step": 110
+    },
+    {
+      "epoch": 0.20385674931129477,
+      "grad_norm": 0.23394729883248447,
+      "learning_rate": 9.973524163664447e-06,
+      "loss": 1.5486,
+      "step": 111
+    },
+    {
+      "epoch": 0.2056932966023875,
+      "grad_norm": 0.2682338169486529,
+      "learning_rate": 9.972763000398784e-06,
+      "loss": 1.562,
+      "step": 112
+    },
+    {
+      "epoch": 0.20752984389348025,
+      "grad_norm": 0.22594240276292787,
+      "learning_rate": 9.971991080039912e-06,
+      "loss": 1.6665,
+      "step": 113
+    },
+    {
+      "epoch": 0.209366391184573,
+      "grad_norm": 0.2716099274981758,
+      "learning_rate": 9.971208404257647e-06,
+      "loss": 1.6069,
+      "step": 114
+    },
+    {
+      "epoch": 0.21120293847566574,
+      "grad_norm": 0.215642600558555,
+      "learning_rate": 9.970414974745077e-06,
+      "loss": 1.426,
+      "step": 115
+    },
+    {
+      "epoch": 0.2130394857667585,
+      "grad_norm": 0.26192594390837787,
+      "learning_rate": 9.96961079321855e-06,
+      "loss": 1.4929,
+      "step": 116
+    },
+    {
+      "epoch": 0.21487603305785125,
+      "grad_norm": 0.24076680870279565,
+      "learning_rate": 9.968795861417676e-06,
+      "loss": 1.5116,
+      "step": 117
+    },
+    {
+      "epoch": 0.21671258034894397,
+      "grad_norm": 0.20785778608018918,
+      "learning_rate": 9.967970181105315e-06,
+      "loss": 1.4824,
+      "step": 118
+    },
+    {
+      "epoch": 0.21854912764003673,
+      "grad_norm": 0.2474137833375562,
+      "learning_rate": 9.967133754067581e-06,
+      "loss": 1.6394,
+      "step": 119
+    },
+    {
+      "epoch": 0.22038567493112948,
+      "grad_norm": 0.2415950163286452,
+      "learning_rate": 9.966286582113838e-06,
+      "loss": 1.4747,
+      "step": 120
+    },
+    {
+      "epoch": 0.2222222222222222,
+      "grad_norm": 0.25397048864143756,
+      "learning_rate": 9.965428667076687e-06,
+      "loss": 1.626,
+      "step": 121
+    },
+    {
+      "epoch": 0.22405876951331496,
+      "grad_norm": 0.27597092429735764,
+      "learning_rate": 9.964560010811972e-06,
+      "loss": 1.4853,
+      "step": 122
+    },
+    {
+      "epoch": 0.22589531680440772,
+      "grad_norm": 0.2773282618369793,
+      "learning_rate": 9.963680615198774e-06,
+      "loss": 1.2673,
+      "step": 123
+    },
+    {
+      "epoch": 0.22773186409550045,
+      "grad_norm": 0.2863982446521439,
+      "learning_rate": 9.962790482139402e-06,
+      "loss": 1.4531,
+      "step": 124
+    },
+    {
+      "epoch": 0.2295684113865932,
+      "grad_norm": 0.24940341962059176,
+      "learning_rate": 9.961889613559396e-06,
+      "loss": 1.5392,
+      "step": 125
+    },
+    {
+      "epoch": 0.23140495867768596,
+      "grad_norm": 0.2692207944659178,
+      "learning_rate": 9.960978011407516e-06,
+      "loss": 1.3452,
+      "step": 126
+    },
+    {
+      "epoch": 0.23324150596877868,
+      "grad_norm": 0.2394265357414062,
+      "learning_rate": 9.960055677655743e-06,
+      "loss": 1.4267,
+      "step": 127
+    },
+    {
+      "epoch": 0.23507805325987144,
+      "grad_norm": 0.2396211231483559,
+      "learning_rate": 9.95912261429927e-06,
+      "loss": 1.669,
+      "step": 128
+    },
+    {
+      "epoch": 0.2369146005509642,
+      "grad_norm": 0.22480647337089882,
+      "learning_rate": 9.958178823356503e-06,
+      "loss": 1.3276,
+      "step": 129
+    },
+    {
+      "epoch": 0.23875114784205692,
+      "grad_norm": 0.2322223276315898,
+      "learning_rate": 9.957224306869053e-06,
+      "loss": 1.6457,
+      "step": 130
+    },
+    {
+      "epoch": 0.24058769513314968,
+      "grad_norm": 0.28675358511507826,
+      "learning_rate": 9.956259066901733e-06,
+      "loss": 1.4844,
+      "step": 131
+    },
+    {
+      "epoch": 0.24242424242424243,
+      "grad_norm": 0.23506904729263256,
+      "learning_rate": 9.955283105542551e-06,
+      "loss": 1.5401,
+      "step": 132
+    },
+    {
+      "epoch": 0.24426078971533516,
+      "grad_norm": 0.25409979083106216,
+      "learning_rate": 9.954296424902709e-06,
+      "loss": 1.5796,
+      "step": 133
+    },
+    {
+      "epoch": 0.2460973370064279,
+      "grad_norm": 0.27537727017693314,
+      "learning_rate": 9.953299027116598e-06,
+      "loss": 1.7015,
+      "step": 134
+    },
+    {
+      "epoch": 0.24793388429752067,
+      "grad_norm": 0.255527421712665,
+      "learning_rate": 9.95229091434179e-06,
+      "loss": 1.6943,
+      "step": 135
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "grad_norm": 0.2758931212786201,
+      "learning_rate": 9.95127208875904e-06,
+      "loss": 1.6373,
+      "step": 136
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "eval_loss": 2.332951307296753,
+      "eval_runtime": 38.5842,
+      "eval_samples_per_second": 5.313,
+      "eval_steps_per_second": 0.467,
+      "step": 136
+    },
+    {
+      "epoch": 0.2516069788797062,
+      "grad_norm": 0.4849948087122718,
+      "learning_rate": 9.950242552572272e-06,
+      "loss": 1.5843,
+      "step": 137
+    },
+    {
+      "epoch": 0.2534435261707989,
+      "grad_norm": 0.27082023040786063,
+      "learning_rate": 9.949202308008581e-06,
+      "loss": 1.466,
+      "step": 138
+    },
+    {
+      "epoch": 0.25528007346189163,
+      "grad_norm": 0.21412319589684112,
+      "learning_rate": 9.948151357318228e-06,
+      "loss": 1.5575,
+      "step": 139
+    },
+    {
+      "epoch": 0.2571166207529844,
+      "grad_norm": 0.2630300060870272,
+      "learning_rate": 9.94708970277463e-06,
+      "loss": 1.8459,
+      "step": 140
+    },
+    {
+      "epoch": 0.25895316804407714,
+      "grad_norm": 0.29584228360860926,
+      "learning_rate": 9.946017346674362e-06,
+      "loss": 1.4765,
+      "step": 141
+    },
+    {
+      "epoch": 0.26078971533516987,
+      "grad_norm": 0.20420849217608372,
+      "learning_rate": 9.944934291337146e-06,
+      "loss": 1.3963,
+      "step": 142
+    },
+    {
+      "epoch": 0.26262626262626265,
+      "grad_norm": 0.2383087119690396,
+      "learning_rate": 9.943840539105853e-06,
+      "loss": 1.6948,
+      "step": 143
+    },
+    {
+      "epoch": 0.2644628099173554,
+      "grad_norm": 0.22707287878559146,
+      "learning_rate": 9.942736092346487e-06,
+      "loss": 1.5627,
+      "step": 144
+    },
+    {
+      "epoch": 0.2662993572084481,
+      "grad_norm": 0.2209791613669926,
+      "learning_rate": 9.941620953448195e-06,
+      "loss": 1.6011,
+      "step": 145
+    },
+    {
+      "epoch": 0.2681359044995409,
+      "grad_norm": 0.23620122895922513,
+      "learning_rate": 9.940495124823241e-06,
+      "loss": 1.4172,
+      "step": 146
+    },
+    {
+      "epoch": 0.2699724517906336,
+      "grad_norm": 0.4575809432111337,
+      "learning_rate": 9.939358608907026e-06,
+      "loss": 1.8045,
+      "step": 147
+    },
+    {
+      "epoch": 0.27180899908172634,
+      "grad_norm": 0.25576228816691954,
+      "learning_rate": 9.938211408158063e-06,
+      "loss": 1.5559,
+      "step": 148
+    },
+    {
+      "epoch": 0.2736455463728191,
+      "grad_norm": 0.32262207355286887,
+      "learning_rate": 9.937053525057977e-06,
+      "loss": 1.6491,
+      "step": 149
+    },
+    {
+      "epoch": 0.27548209366391185,
+      "grad_norm": 0.29602023759033497,
+      "learning_rate": 9.935884962111506e-06,
+      "loss": 1.6518,
+      "step": 150
+    },
+    {
+      "epoch": 0.2773186409550046,
+      "grad_norm": 0.24182886602369053,
+      "learning_rate": 9.934705721846487e-06,
+      "loss": 1.5457,
+      "step": 151
+    },
+    {
+      "epoch": 0.27915518824609736,
+      "grad_norm": 0.2247571699952089,
+      "learning_rate": 9.933515806813856e-06,
+      "loss": 1.481,
+      "step": 152
+    },
+    {
+      "epoch": 0.2809917355371901,
+      "grad_norm": 0.24890915769392072,
+      "learning_rate": 9.932315219587641e-06,
+      "loss": 1.618,
+      "step": 153
+    },
+    {
+      "epoch": 0.2828282828282828,
+      "grad_norm": 0.2597194625874549,
+      "learning_rate": 9.931103962764955e-06,
+      "loss": 1.5653,
+      "step": 154
+    },
+    {
+      "epoch": 0.2846648301193756,
+      "grad_norm": 0.23725030845640346,
+      "learning_rate": 9.92988203896599e-06,
+      "loss": 1.4677,
+      "step": 155
+    },
+    {
+      "epoch": 0.2865013774104683,
+      "grad_norm": 0.20619150412894088,
+      "learning_rate": 9.928649450834015e-06,
+      "loss": 1.6779,
+      "step": 156
+    },
+    {
+      "epoch": 0.28833792470156105,
+      "grad_norm": 0.23919303859135752,
+      "learning_rate": 9.927406201035368e-06,
+      "loss": 1.4417,
+      "step": 157
+    },
+    {
+      "epoch": 0.29017447199265384,
+      "grad_norm": 0.2244668514529571,
+      "learning_rate": 9.926152292259452e-06,
+      "loss": 1.7272,
+      "step": 158
+    },
+    {
+      "epoch": 0.29201101928374656,
+      "grad_norm": 0.26954841337527125,
+      "learning_rate": 9.924887727218724e-06,
+      "loss": 1.6068,
+      "step": 159
+    },
+    {
+      "epoch": 0.2938475665748393,
+      "grad_norm": 0.32951953455251004,
+      "learning_rate": 9.923612508648693e-06,
+      "loss": 1.406,
+      "step": 160
+    },
+    {
+      "epoch": 0.2956841138659321,
+      "grad_norm": 0.2698529792514822,
+      "learning_rate": 9.922326639307918e-06,
+      "loss": 1.683,
+      "step": 161
+    },
+    {
+      "epoch": 0.2975206611570248,
+      "grad_norm": 0.22420186125700636,
+      "learning_rate": 9.921030121977992e-06,
+      "loss": 1.5398,
+      "step": 162
+    },
+    {
+      "epoch": 0.29935720844811753,
+      "grad_norm": 0.24335042870850987,
+      "learning_rate": 9.919722959463545e-06,
+      "loss": 1.5752,
+      "step": 163
+    },
+    {
+      "epoch": 0.3011937557392103,
+      "grad_norm": 0.272993009874352,
+      "learning_rate": 9.918405154592234e-06,
+      "loss": 1.6791,
+      "step": 164
+    },
+    {
+      "epoch": 0.30303030303030304,
+      "grad_norm": 0.36447396005561716,
+      "learning_rate": 9.917076710214739e-06,
+      "loss": 1.8303,
+      "step": 165
+    },
+    {
+      "epoch": 0.30486685032139577,
+      "grad_norm": 0.266743073761148,
+      "learning_rate": 9.915737629204754e-06,
+      "loss": 1.652,
+      "step": 166
+    },
+    {
+      "epoch": 0.30670339761248855,
+      "grad_norm": 0.22394219745904015,
+      "learning_rate": 9.914387914458983e-06,
+      "loss": 1.5615,
+      "step": 167
+    },
+    {
+      "epoch": 0.3085399449035813,
+      "grad_norm": 0.23075889412968112,
+      "learning_rate": 9.91302756889713e-06,
+      "loss": 1.6447,
+      "step": 168
+    },
+    {
+      "epoch": 0.310376492194674,
+      "grad_norm": 0.2441975693564735,
+      "learning_rate": 9.911656595461899e-06,
+      "loss": 1.5981,
+      "step": 169
+    },
+    {
+      "epoch": 0.3122130394857668,
+      "grad_norm": 0.21377545765414097,
+      "learning_rate": 9.910274997118982e-06,
+      "loss": 1.6066,
+      "step": 170
+    },
+    {
+      "epoch": 0.3140495867768595,
+      "grad_norm": 0.21518096806340806,
+      "learning_rate": 9.908882776857057e-06,
+      "loss": 1.199,
+      "step": 171
+    },
+    {
+      "epoch": 0.31588613406795224,
+      "grad_norm": 0.22989533865542952,
+      "learning_rate": 9.907479937687779e-06,
+      "loss": 1.6019,
+      "step": 172
+    },
+    {
+      "epoch": 0.317722681359045,
+      "grad_norm": 0.24187157970795195,
+      "learning_rate": 9.906066482645774e-06,
+      "loss": 1.5453,
+      "step": 173
+    },
+    {
+      "epoch": 0.31955922865013775,
+      "grad_norm": 0.28880156295741904,
+      "learning_rate": 9.904642414788627e-06,
+      "loss": 1.6518,
+      "step": 174
+    },
+    {
+      "epoch": 0.3213957759412305,
+      "grad_norm": 0.3064989299701211,
+      "learning_rate": 9.903207737196892e-06,
+      "loss": 1.5614,
+      "step": 175
+    },
+    {
+      "epoch": 0.32323232323232326,
+      "grad_norm": 0.5501951504862674,
+      "learning_rate": 9.90176245297406e-06,
+      "loss": 1.3988,
+      "step": 176
+    },
+    {
+      "epoch": 0.325068870523416,
+      "grad_norm": 0.23086867624049656,
+      "learning_rate": 9.900306565246579e-06,
+      "loss": 1.4688,
+      "step": 177
+    },
+    {
+      "epoch": 0.3269054178145087,
+      "grad_norm": 0.24109267951104685,
+      "learning_rate": 9.898840077163824e-06,
+      "loss": 1.342,
+      "step": 178
+    },
+    {
+      "epoch": 0.3287419651056015,
+      "grad_norm": 0.221519141054226,
+      "learning_rate": 9.89736299189811e-06,
+      "loss": 1.6468,
+      "step": 179
+    },
+    {
+      "epoch": 0.3305785123966942,
+      "grad_norm": 0.2134481965910651,
+      "learning_rate": 9.89587531264467e-06,
+      "loss": 1.4762,
+      "step": 180
+    },
+    {
+      "epoch": 0.33241505968778695,
+      "grad_norm": 0.30273218459666634,
+      "learning_rate": 9.894377042621654e-06,
+      "loss": 1.2952,
+      "step": 181
+    },
+    {
+      "epoch": 0.3342516069788797,
+      "grad_norm": 0.2643249012553608,
+      "learning_rate": 9.892868185070125e-06,
+      "loss": 1.5922,
+      "step": 182
+    },
+    {
+      "epoch": 0.33608815426997246,
+      "grad_norm": 0.3017798778461224,
+      "learning_rate": 9.891348743254046e-06,
+      "loss": 1.3327,
+      "step": 183
+    },
+    {
+      "epoch": 0.3379247015610652,
+      "grad_norm": 0.198099058736144,
+      "learning_rate": 9.889818720460281e-06,
+      "loss": 1.4528,
+      "step": 184
+    },
+    {
+      "epoch": 0.3397612488521579,
+      "grad_norm": 0.2342720457991802,
+      "learning_rate": 9.888278119998573e-06,
+      "loss": 1.396,
+      "step": 185
+    },
+    {
+      "epoch": 0.3415977961432507,
+      "grad_norm": 0.30360601805904236,
+      "learning_rate": 9.886726945201556e-06,
+      "loss": 1.5982,
+      "step": 186
+    },
+    {
+      "epoch": 0.3434343434343434,
+      "grad_norm": 0.2890684354336481,
+      "learning_rate": 9.885165199424738e-06,
+      "loss": 1.3935,
+      "step": 187
+    },
+    {
+      "epoch": 0.34527089072543615,
+      "grad_norm": 0.2574557316071565,
+      "learning_rate": 9.883592886046486e-06,
+      "loss": 1.449,
+      "step": 188
+    },
+    {
+      "epoch": 0.34710743801652894,
+      "grad_norm": 0.23195985985184547,
+      "learning_rate": 9.882010008468038e-06,
+      "loss": 1.4909,
+      "step": 189
+    },
+    {
+      "epoch": 0.34894398530762166,
+      "grad_norm": 0.2539011848151687,
+      "learning_rate": 9.880416570113472e-06,
+      "loss": 1.5123,
+      "step": 190
+    },
+    {
+      "epoch": 0.3507805325987144,
+      "grad_norm": 0.26954455617431194,
+      "learning_rate": 9.878812574429722e-06,
+      "loss": 1.4445,
+      "step": 191
+    },
+    {
+      "epoch": 0.3526170798898072,
+      "grad_norm": 0.23141695311529595,
+      "learning_rate": 9.877198024886553e-06,
+      "loss": 1.9045,
+      "step": 192
+    },
+    {
+      "epoch": 0.3544536271808999,
+      "grad_norm": 0.2750943021523168,
+      "learning_rate": 9.875572924976568e-06,
+      "loss": 1.5868,
+      "step": 193
+    },
+    {
+      "epoch": 0.3562901744719926,
+      "grad_norm": 0.23421966078059409,
+      "learning_rate": 9.873937278215181e-06,
+      "loss": 1.7534,
+      "step": 194
+    },
+    {
+      "epoch": 0.3581267217630854,
+      "grad_norm": 0.24409550991932608,
+      "learning_rate": 9.87229108814063e-06,
+      "loss": 1.4753,
+      "step": 195
+    },
+    {
+      "epoch": 0.35996326905417814,
+      "grad_norm": 0.24998063066925763,
+      "learning_rate": 9.870634358313956e-06,
+      "loss": 1.6574,
+      "step": 196
+    },
+    {
+      "epoch": 0.36179981634527086,
+      "grad_norm": 0.2630317204109116,
+      "learning_rate": 9.868967092319003e-06,
+      "loss": 1.6794,
+      "step": 197
+    },
+    {
+      "epoch": 0.36363636363636365,
+      "grad_norm": 0.21473616516429722,
+      "learning_rate": 9.867289293762403e-06,
+      "loss": 1.7626,
+      "step": 198
+    },
+    {
+      "epoch": 0.3654729109274564,
+      "grad_norm": 0.3020374891635284,
+      "learning_rate": 9.865600966273576e-06,
+      "loss": 1.5234,
+      "step": 199
+    },
+    {
+      "epoch": 0.3673094582185491,
+      "grad_norm": 0.24122137539024896,
+      "learning_rate": 9.863902113504713e-06,
+      "loss": 1.5807,
+      "step": 200
+    },
+    {
+      "epoch": 0.3691460055096419,
+      "grad_norm": 0.2240345557985464,
+      "learning_rate": 9.86219273913078e-06,
+      "loss": 1.4635,
+      "step": 201
+    },
+    {
+      "epoch": 0.3709825528007346,
+      "grad_norm": 0.2561505890958098,
+      "learning_rate": 9.860472846849498e-06,
+      "loss": 1.5781,
+      "step": 202
+    },
+    {
+      "epoch": 0.37281910009182734,
+      "grad_norm": 0.2629334369467521,
+      "learning_rate": 9.858742440381343e-06,
+      "loss": 1.3698,
+      "step": 203
+    },
+    {
+      "epoch": 0.3746556473829201,
+      "grad_norm": 0.2643820816427679,
+      "learning_rate": 9.857001523469534e-06,
+      "loss": 1.6831,
+      "step": 204
+    },
+    {
+      "epoch": 0.37649219467401285,
+      "grad_norm": 0.27568924761133784,
+      "learning_rate": 9.855250099880026e-06,
+      "loss": 1.5586,
+      "step": 205
+    },
+    {
+      "epoch": 0.3783287419651056,
+      "grad_norm": 0.23562831853645116,
+      "learning_rate": 9.853488173401504e-06,
+      "loss": 1.4529,
+      "step": 206
+    },
+    {
+      "epoch": 0.38016528925619836,
+      "grad_norm": 0.24270051421435648,
+      "learning_rate": 9.851715747845372e-06,
+      "loss": 1.5449,
+      "step": 207
+    },
+    {
+      "epoch": 0.3820018365472911,
+      "grad_norm": 0.3141794855298513,
+      "learning_rate": 9.849932827045746e-06,
+      "loss": 1.6011,
+      "step": 208
+    },
+    {
+      "epoch": 0.3838383838383838,
+      "grad_norm": 0.2347451989106533,
+      "learning_rate": 9.848139414859441e-06,
+      "loss": 1.7994,
+      "step": 209
+    },
+    {
+      "epoch": 0.3856749311294766,
+      "grad_norm": 0.22998314428761488,
+      "learning_rate": 9.846335515165974e-06,
+      "loss": 1.5024,
+      "step": 210
+    },
+    {
+      "epoch": 0.3875114784205693,
+      "grad_norm": 0.2914601119925799,
+      "learning_rate": 9.844521131867546e-06,
+      "loss": 1.6718,
+      "step": 211
+    },
+    {
+      "epoch": 0.38934802571166205,
+      "grad_norm": 0.27307242607178106,
+      "learning_rate": 9.842696268889032e-06,
+      "loss": 1.6705,
+      "step": 212
+    },
+    {
+      "epoch": 0.39118457300275483,
+      "grad_norm": 0.26989044058601575,
+      "learning_rate": 9.840860930177984e-06,
+      "loss": 1.5762,
+      "step": 213
+    },
+    {
+      "epoch": 0.39302112029384756,
+      "grad_norm": 0.23544376195311703,
+      "learning_rate": 9.839015119704607e-06,
+      "loss": 1.4928,
+      "step": 214
+    },
+    {
+      "epoch": 0.3948576675849403,
+      "grad_norm": 0.40380733954206144,
+      "learning_rate": 9.837158841461767e-06,
+      "loss": 1.5587,
+      "step": 215
+    },
+    {
+      "epoch": 0.39669421487603307,
+      "grad_norm": 0.2416750029017525,
+      "learning_rate": 9.835292099464965e-06,
+      "loss": 1.4265,
+      "step": 216
+    },
+    {
+      "epoch": 0.3985307621671258,
+      "grad_norm": 0.20943162169896912,
+      "learning_rate": 9.833414897752346e-06,
+      "loss": 1.5836,
+      "step": 217
+    },
+    {
+      "epoch": 0.4003673094582185,
+      "grad_norm": 0.24319317049956413,
+      "learning_rate": 9.831527240384677e-06,
+      "loss": 1.6154,
+      "step": 218
+    },
+    {
+      "epoch": 0.4022038567493113,
+      "grad_norm": 0.2375469014345421,
+      "learning_rate": 9.829629131445342e-06,
+      "loss": 1.5652,
+      "step": 219
+    },
+    {
+      "epoch": 0.40404040404040403,
+      "grad_norm": 0.27739989413008637,
+      "learning_rate": 9.827720575040335e-06,
+      "loss": 1.5439,
+      "step": 220
+    },
+    {
+      "epoch": 0.40587695133149676,
+      "grad_norm": 0.24247147004672653,
+      "learning_rate": 9.825801575298248e-06,
+      "loss": 1.4613,
+      "step": 221
+    },
+    {
+      "epoch": 0.40771349862258954,
+      "grad_norm": 0.29413816874548104,
+      "learning_rate": 9.82387213637027e-06,
+      "loss": 1.4005,
+      "step": 222
+    },
+    {
+      "epoch": 0.40955004591368227,
+      "grad_norm": 0.21318983016138546,
+      "learning_rate": 9.821932262430164e-06,
+      "loss": 1.4747,
+      "step": 223
+    },
+    {
+      "epoch": 0.411386593204775,
+      "grad_norm": 0.24655890709082884,
+      "learning_rate": 9.819981957674273e-06,
+      "loss": 1.6599,
+      "step": 224
+    },
+    {
+      "epoch": 0.4132231404958678,
+      "grad_norm": 0.23420376177876423,
+      "learning_rate": 9.818021226321502e-06,
+      "loss": 1.5039,
+      "step": 225
+    },
+    {
+      "epoch": 0.4150596877869605,
+      "grad_norm": 0.23379966460981552,
+      "learning_rate": 9.816050072613306e-06,
+      "loss": 1.775,
+      "step": 226
+    },
+    {
+      "epoch": 0.41689623507805323,
+      "grad_norm": 0.30210714633151925,
+      "learning_rate": 9.814068500813692e-06,
+      "loss": 1.5692,
+      "step": 227
+    },
+    {
+      "epoch": 0.418732782369146,
+      "grad_norm": 0.24124025669836516,
+      "learning_rate": 9.812076515209201e-06,
+      "loss": 1.5682,
+      "step": 228
+    },
+    {
+      "epoch": 0.42056932966023874,
+      "grad_norm": 0.40694547415364124,
+      "learning_rate": 9.8100741201089e-06,
+      "loss": 1.3886,
+      "step": 229
+    },
+    {
+      "epoch": 0.42240587695133147,
+      "grad_norm": 0.5017797555556736,
+      "learning_rate": 9.808061319844376e-06,
+      "loss": 1.5096,
+      "step": 230
+    },
+    {
+      "epoch": 0.42424242424242425,
+      "grad_norm": 0.2395927998641603,
+      "learning_rate": 9.806038118769724e-06,
+      "loss": 1.6511,
+      "step": 231
+    },
+    {
+      "epoch": 0.426078971533517,
+      "grad_norm": 0.26346897129489716,
+      "learning_rate": 9.804004521261537e-06,
+      "loss": 1.4852,
+      "step": 232
+    },
+    {
+      "epoch": 0.4279155188246097,
+      "grad_norm": 0.21927054884906805,
+      "learning_rate": 9.801960531718898e-06,
+      "loss": 1.3796,
+      "step": 233
+    },
+    {
+      "epoch": 0.4297520661157025,
+      "grad_norm": 0.21216613988150154,
+      "learning_rate": 9.79990615456337e-06,
+      "loss": 1.3236,
+      "step": 234
+    },
+    {
+      "epoch": 0.4315886134067952,
+      "grad_norm": 0.2439837140444034,
+      "learning_rate": 9.797841394238987e-06,
+      "loss": 1.4752,
+      "step": 235
+    },
+    {
+      "epoch": 0.43342516069788795,
+      "grad_norm": 0.20264650772176668,
+      "learning_rate": 9.795766255212242e-06,
+      "loss": 1.4633,
+      "step": 236
+    },
+    {
+      "epoch": 0.43526170798898073,
+      "grad_norm": 0.2214142026219714,
+      "learning_rate": 9.793680741972084e-06,
+      "loss": 1.524,
+      "step": 237
+    },
+    {
+      "epoch": 0.43709825528007346,
+      "grad_norm": 0.32400463641987054,
+      "learning_rate": 9.791584859029901e-06,
+      "loss": 1.7717,
+      "step": 238
+    },
+    {
+      "epoch": 0.4389348025711662,
+      "grad_norm": 0.25353704234527624,
+      "learning_rate": 9.789478610919508e-06,
+      "loss": 1.4503,
+      "step": 239
+    },
+    {
+      "epoch": 0.44077134986225897,
+      "grad_norm": 0.28666088570706005,
+      "learning_rate": 9.787362002197147e-06,
+      "loss": 1.5374,
+      "step": 240
+    },
+    {
+      "epoch": 0.4426078971533517,
+      "grad_norm": 0.2575712788223055,
+      "learning_rate": 9.785235037441473e-06,
+      "loss": 1.3976,
+      "step": 241
+    },
+    {
+      "epoch": 0.4444444444444444,
+      "grad_norm": 0.235205219080783,
+      "learning_rate": 9.783097721253543e-06,
+      "loss": 1.6037,
+      "step": 242
+    },
+    {
+      "epoch": 0.4462809917355372,
+      "grad_norm": 0.23780080068966725,
+      "learning_rate": 9.780950058256802e-06,
+      "loss": 1.679,
+      "step": 243
+    },
+    {
+      "epoch": 0.44811753902662993,
+      "grad_norm": 0.3404150158565561,
+      "learning_rate": 9.778792053097079e-06,
+      "loss": 1.3573,
+      "step": 244
+    },
+    {
+      "epoch": 0.44995408631772266,
+      "grad_norm": 0.21082516759926104,
+      "learning_rate": 9.77662371044258e-06,
+      "loss": 1.4932,
+      "step": 245
+    },
+    {
+      "epoch": 0.45179063360881544,
+      "grad_norm": 0.24031601796602936,
+      "learning_rate": 9.774445034983864e-06,
+      "loss": 1.7397,
+      "step": 246
+    },
+    {
+      "epoch": 0.45362718089990817,
+      "grad_norm": 0.2207009467162113,
+      "learning_rate": 9.77225603143385e-06,
+      "loss": 1.585,
+      "step": 247
+    },
+    {
+      "epoch": 0.4554637281910009,
+      "grad_norm": 0.2551403718915401,
+      "learning_rate": 9.770056704527797e-06,
+      "loss": 1.4924,
+      "step": 248
+    },
+    {
+      "epoch": 0.4573002754820937,
+      "grad_norm": 0.23525171894308203,
+      "learning_rate": 9.767847059023292e-06,
+      "loss": 1.5658,
+      "step": 249
+    },
+    {
+      "epoch": 0.4591368227731864,
+      "grad_norm": 0.2340311514550259,
+      "learning_rate": 9.765627099700248e-06,
+      "loss": 1.7361,
+      "step": 250
+    },
+    {
+      "epoch": 0.46097337006427913,
+      "grad_norm": 0.3425610884720096,
+      "learning_rate": 9.763396831360884e-06,
+      "loss": 1.4723,
+      "step": 251
+    },
+    {
+      "epoch": 0.4628099173553719,
+      "grad_norm": 0.232643381531555,
+      "learning_rate": 9.761156258829723e-06,
+      "loss": 1.5543,
+      "step": 252
+    },
+    {
+      "epoch": 0.46464646464646464,
+      "grad_norm": 0.3601600310692427,
+      "learning_rate": 9.75890538695358e-06,
+      "loss": 1.4195,
+      "step": 253
+    },
+    {
+      "epoch": 0.46648301193755737,
+      "grad_norm": 0.2625087171937245,
+      "learning_rate": 9.756644220601541e-06,
+      "loss": 1.7209,
+      "step": 254
+    },
+    {
+      "epoch": 0.46831955922865015,
+      "grad_norm": 0.36091521146763844,
+      "learning_rate": 9.75437276466497e-06,
+      "loss": 1.4435,
+      "step": 255
+    },
+    {
+      "epoch": 0.4701561065197429,
+      "grad_norm": 0.22970766162190284,
+      "learning_rate": 9.752091024057485e-06,
+      "loss": 1.3894,
+      "step": 256
+    },
+    {
+      "epoch": 0.4719926538108356,
+      "grad_norm": 0.2708039374301605,
+      "learning_rate": 9.749799003714954e-06,
+      "loss": 1.4717,
+      "step": 257
+    },
+    {
+      "epoch": 0.4738292011019284,
+      "grad_norm": 0.22940138762480203,
+      "learning_rate": 9.747496708595482e-06,
+      "loss": 1.532,
+      "step": 258
+    },
+    {
+      "epoch": 0.4756657483930211,
+      "grad_norm": 0.27196638223072084,
+      "learning_rate": 9.745184143679398e-06,
+      "loss": 1.4425,
+      "step": 259
+    },
+    {
+      "epoch": 0.47750229568411384,
+      "grad_norm": 0.24883578158794614,
+      "learning_rate": 9.742861313969246e-06,
+      "loss": 1.4882,
+      "step": 260
+    },
+    {
+      "epoch": 0.4793388429752066,
+      "grad_norm": 0.24541193855388124,
+      "learning_rate": 9.74052822448978e-06,
+      "loss": 1.4851,
+      "step": 261
+    },
+    {
+      "epoch": 0.48117539026629935,
+      "grad_norm": 0.249310294245501,
+      "learning_rate": 9.738184880287946e-06,
+      "loss": 1.6463,
+      "step": 262
+    },
+    {
+      "epoch": 0.4830119375573921,
+      "grad_norm": 0.25707806827316415,
+      "learning_rate": 9.735831286432869e-06,
+      "loss": 1.6118,
+      "step": 263
+    },
+    {
+      "epoch": 0.48484848484848486,
+      "grad_norm": 0.22547510302041615,
+      "learning_rate": 9.733467448015849e-06,
+      "loss": 1.3343,
+      "step": 264
+    },
+    {
+      "epoch": 0.4866850321395776,
+      "grad_norm": 0.21415297945638267,
+      "learning_rate": 9.731093370150349e-06,
+      "loss": 1.8938,
+      "step": 265
+    },
+    {
+      "epoch": 0.4885215794306703,
+      "grad_norm": 0.25553884577553115,
+      "learning_rate": 9.728709057971979e-06,
+      "loss": 1.6681,
+      "step": 266
+    },
+    {
+      "epoch": 0.4903581267217631,
+      "grad_norm": 0.23479399192488148,
+      "learning_rate": 9.72631451663849e-06,
+      "loss": 1.3781,
+      "step": 267
+    },
+    {
+      "epoch": 0.4921946740128558,
+      "grad_norm": 0.2549932602973557,
+      "learning_rate": 9.723909751329759e-06,
+      "loss": 1.444,
+      "step": 268
+    },
+    {
+      "epoch": 0.49403122130394855,
+      "grad_norm": 0.24071196589287586,
+      "learning_rate": 9.721494767247779e-06,
+      "loss": 1.5817,
+      "step": 269
+    },
+    {
+      "epoch": 0.49586776859504134,
+      "grad_norm": 0.23040782897953827,
+      "learning_rate": 9.719069569616653e-06,
+      "loss": 1.2528,
+      "step": 270
+    },
+    {
+      "epoch": 0.49770431588613406,
+      "grad_norm": 0.2371564859647457,
+      "learning_rate": 9.71663416368257e-06,
+      "loss": 1.7053,
+      "step": 271
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "grad_norm": 0.2489215879444709,
+      "learning_rate": 9.71418855471381e-06,
+      "loss": 1.4637,
+      "step": 272
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "eval_loss": 2.313441038131714,
+      "eval_runtime": 39.8034,
+      "eval_samples_per_second": 5.15,
+      "eval_steps_per_second": 0.452,
+      "step": 272
+    },
+    {
+      "epoch": 0.5013774104683195,
+      "grad_norm": 0.40359885890108993,
+      "learning_rate": 9.71173274800072e-06,
+      "loss": 1.2163,
+      "step": 273
+    },
+    {
+      "epoch": 0.5032139577594124,
+      "grad_norm": 0.19808277732817645,
+      "learning_rate": 9.709266748855704e-06,
+      "loss": 1.4049,
+      "step": 274
+    },
+    {
+      "epoch": 0.5050505050505051,
+      "grad_norm": 0.226114084447551,
+      "learning_rate": 9.70679056261322e-06,
+      "loss": 1.4663,
+      "step": 275
+    },
+    {
+      "epoch": 0.5068870523415978,
+      "grad_norm": 0.28094120861132194,
+      "learning_rate": 9.704304194629759e-06,
+      "loss": 1.553,
+      "step": 276
+    },
+    {
+      "epoch": 0.5087235996326905,
+      "grad_norm": 0.25995397574576745,
+      "learning_rate": 9.70180765028384e-06,
+      "loss": 1.6668,
+      "step": 277
+    },
+    {
+      "epoch": 0.5105601469237833,
+      "grad_norm": 0.26456909599184886,
+      "learning_rate": 9.699300934975993e-06,
+      "loss": 1.65,
+      "step": 278
+    },
+    {
+      "epoch": 0.512396694214876,
+      "grad_norm": 0.24248635440559377,
+      "learning_rate": 9.696784054128749e-06,
+      "loss": 1.3412,
+      "step": 279
+    },
+    {
+      "epoch": 0.5142332415059688,
+      "grad_norm": 0.2550690355279568,
+      "learning_rate": 9.694257013186635e-06,
+      "loss": 1.4855,
+      "step": 280
+    },
+    {
+      "epoch": 0.5160697887970616,
+      "grad_norm": 0.21051919872331962,
+      "learning_rate": 9.691719817616148e-06,
+      "loss": 1.4878,
+      "step": 281
+    },
+    {
+      "epoch": 0.5179063360881543,
+      "grad_norm": 0.2906151537123627,
+      "learning_rate": 9.689172472905759e-06,
+      "loss": 1.5423,
+      "step": 282
+    },
+    {
+      "epoch": 0.519742883379247,
+      "grad_norm": 0.24818058874303423,
+      "learning_rate": 9.686614984565888e-06,
+      "loss": 1.6553,
+      "step": 283
+    },
+    {
+      "epoch": 0.5215794306703397,
+      "grad_norm": 0.26642964980256184,
+      "learning_rate": 9.6840473581289e-06,
+      "loss": 1.5103,
+      "step": 284
+    },
+    {
+      "epoch": 0.5234159779614325,
+      "grad_norm": 0.2303123782267836,
+      "learning_rate": 9.681469599149093e-06,
+      "loss": 1.6623,
+      "step": 285
+    },
+    {
+      "epoch": 0.5252525252525253,
+      "grad_norm": 0.24975276980001815,
+      "learning_rate": 9.67888171320268e-06,
+      "loss": 1.5287,
+      "step": 286
+    },
+    {
+      "epoch": 0.527089072543618,
+      "grad_norm": 0.2839866917432431,
+      "learning_rate": 9.676283705887783e-06,
+      "loss": 1.5488,
+      "step": 287
+    },
+    {
+      "epoch": 0.5289256198347108,
+      "grad_norm": 0.3725151799153614,
+      "learning_rate": 9.673675582824416e-06,
+      "loss": 1.6329,
+      "step": 288
+    },
+    {
+      "epoch": 0.5307621671258035,
+      "grad_norm": 0.23277841474742347,
+      "learning_rate": 9.671057349654481e-06,
+      "loss": 1.6651,
+      "step": 289
+    },
+    {
+      "epoch": 0.5325987144168962,
+      "grad_norm": 0.24462057980980875,
+      "learning_rate": 9.668429012041742e-06,
+      "loss": 1.6452,
+      "step": 290
+    },
+    {
+      "epoch": 0.5344352617079889,
+      "grad_norm": 0.2801240375568796,
+      "learning_rate": 9.66579057567183e-06,
+      "loss": 1.6393,
+      "step": 291
+    },
+    {
+      "epoch": 0.5362718089990818,
+      "grad_norm": 0.22898727154751725,
+      "learning_rate": 9.663142046252213e-06,
+      "loss": 1.477,
+      "step": 292
+    },
+    {
+      "epoch": 0.5381083562901745,
+      "grad_norm": 0.27990182962352084,
+      "learning_rate": 9.660483429512198e-06,
+      "loss": 1.4522,
+      "step": 293
+    },
+    {
+      "epoch": 0.5399449035812672,
+      "grad_norm": 0.22721916937264164,
+      "learning_rate": 9.657814731202912e-06,
+      "loss": 1.6287,
+      "step": 294
+    },
+    {
+      "epoch": 0.54178145087236,
+      "grad_norm": 0.20163925656594917,
+      "learning_rate": 9.65513595709729e-06,
+      "loss": 1.404,
+      "step": 295
+    },
+    {
+      "epoch": 0.5436179981634527,
+      "grad_norm": 0.2926816198519085,
+      "learning_rate": 9.652447112990063e-06,
+      "loss": 1.3317,
+      "step": 296
+    },
+    {
+      "epoch": 0.5454545454545454,
+      "grad_norm": 0.21224236603779129,
+      "learning_rate": 9.649748204697741e-06,
+      "loss": 1.5832,
+      "step": 297
+    },
+    {
+      "epoch": 0.5472910927456383,
+      "grad_norm": 0.23696642392017095,
+      "learning_rate": 9.647039238058613e-06,
+      "loss": 1.4347,
+      "step": 298
+    },
+    {
+      "epoch": 0.549127640036731,
+      "grad_norm": 0.2540682989198533,
+      "learning_rate": 9.644320218932723e-06,
+      "loss": 1.3552,
+      "step": 299
+    },
+    {
+      "epoch": 0.5509641873278237,
+      "grad_norm": 0.3059021786701049,
+      "learning_rate": 9.641591153201856e-06,
+      "loss": 1.4477,
+      "step": 300
+    },
+    {
+      "epoch": 0.5528007346189164,
+      "grad_norm": 0.24608144306135712,
+      "learning_rate": 9.63885204676954e-06,
+      "loss": 1.4933,
+      "step": 301
+    },
+    {
+      "epoch": 0.5546372819100092,
+      "grad_norm": 0.2284951016394001,
+      "learning_rate": 9.63610290556101e-06,
+      "loss": 1.6014,
+      "step": 302
+    },
+    {
+      "epoch": 0.5564738292011019,
+      "grad_norm": 0.24446543124145687,
+      "learning_rate": 9.63334373552322e-06,
+      "loss": 1.4619,
+      "step": 303
+    },
+    {
+      "epoch": 0.5583103764921947,
+      "grad_norm": 0.2567728903743156,
+      "learning_rate": 9.63057454262481e-06,
+      "loss": 1.7054,
+      "step": 304
+    },
+    {
+      "epoch": 0.5601469237832875,
+      "grad_norm": 0.24400856152428735,
+      "learning_rate": 9.627795332856107e-06,
+      "loss": 1.5498,
+      "step": 305
+    },
+    {
+      "epoch": 0.5619834710743802,
+      "grad_norm": 0.23187407709208915,
+      "learning_rate": 9.625006112229102e-06,
+      "loss": 1.378,
+      "step": 306
+    },
+    {
+      "epoch": 0.5638200183654729,
+      "grad_norm": 0.217938745912038,
+      "learning_rate": 9.622206886777448e-06,
+      "loss": 1.4351,
+      "step": 307
+    },
+    {
+      "epoch": 0.5656565656565656,
+      "grad_norm": 0.24566673140048742,
+      "learning_rate": 9.619397662556434e-06,
+      "loss": 1.5534,
+      "step": 308
+    },
+    {
+      "epoch": 0.5674931129476584,
+      "grad_norm": 0.2682969741856791,
+      "learning_rate": 9.616578445642982e-06,
+      "loss": 1.4522,
+      "step": 309
+    },
+    {
+      "epoch": 0.5693296602387512,
+      "grad_norm": 0.23354861589018816,
+      "learning_rate": 9.613749242135627e-06,
+      "loss": 1.462,
+      "step": 310
+    },
+    {
+      "epoch": 0.5711662075298439,
+      "grad_norm": 0.22532237045597867,
+      "learning_rate": 9.61091005815451e-06,
+      "loss": 1.4351,
+      "step": 311
+    },
+    {
+      "epoch": 0.5730027548209367,
+      "grad_norm": 0.21311914562358464,
+      "learning_rate": 9.608060899841361e-06,
+      "loss": 1.7438,
+      "step": 312
+    },
+    {
+      "epoch": 0.5748393021120294,
+      "grad_norm": 0.2447872447833896,
+      "learning_rate": 9.605201773359485e-06,
+      "loss": 1.5586,
+      "step": 313
+    },
+    {
+      "epoch": 0.5766758494031221,
+      "grad_norm": 0.23045392404633464,
+      "learning_rate": 9.602332684893754e-06,
+      "loss": 1.4347,
+      "step": 314
+    },
+    {
+      "epoch": 0.5785123966942148,
+      "grad_norm": 0.23490326797451772,
+      "learning_rate": 9.599453640650585e-06,
+      "loss": 1.5357,
+      "step": 315
+    },
+    {
+      "epoch": 0.5803489439853077,
+      "grad_norm": 0.22245719768167882,
+      "learning_rate": 9.596564646857934e-06,
+      "loss": 1.5031,
+      "step": 316
+    },
+    {
+      "epoch": 0.5821854912764004,
+      "grad_norm": 0.2241576449726403,
+      "learning_rate": 9.59366570976528e-06,
+      "loss": 1.5591,
+      "step": 317
+    },
+    {
+      "epoch": 0.5840220385674931,
+      "grad_norm": 0.23221143989290613,
+      "learning_rate": 9.590756835643613e-06,
+      "loss": 1.7365,
+      "step": 318
+    },
+    {
+      "epoch": 0.5858585858585859,
+      "grad_norm": 0.22260605020813307,
+      "learning_rate": 9.587838030785413e-06,
+      "loss": 1.5891,
+      "step": 319
+    },
+    {
+      "epoch": 0.5876951331496786,
+      "grad_norm": 0.24074123539891878,
+      "learning_rate": 9.584909301504649e-06,
+      "loss": 1.6429,
+      "step": 320
+    },
+    {
+      "epoch": 0.5895316804407713,
+      "grad_norm": 0.24999236076625003,
+      "learning_rate": 9.581970654136752e-06,
+      "loss": 1.4635,
+      "step": 321
+    },
+    {
+      "epoch": 0.5913682277318641,
+      "grad_norm": 0.24138213962275842,
+      "learning_rate": 9.579022095038614e-06,
+      "loss": 1.4685,
+      "step": 322
+    },
+    {
+      "epoch": 0.5932047750229569,
+      "grad_norm": 0.23761063303866614,
+      "learning_rate": 9.576063630588563e-06,
+      "loss": 1.502,
+      "step": 323
+    },
+    {
+      "epoch": 0.5950413223140496,
+      "grad_norm": 0.23598358847125375,
+      "learning_rate": 9.573095267186361e-06,
+      "loss": 1.515,
+      "step": 324
+    },
+    {
+      "epoch": 0.5968778696051423,
+      "grad_norm": 0.22832909205335236,
+      "learning_rate": 9.570117011253173e-06,
+      "loss": 1.4807,
+      "step": 325
+    },
+    {
+      "epoch": 0.5987144168962351,
+      "grad_norm": 0.24117133297678936,
+      "learning_rate": 9.567128869231575e-06,
+      "loss": 1.5613,
+      "step": 326
+    },
+    {
+      "epoch": 0.6005509641873278,
+      "grad_norm": 0.3736566093680088,
+      "learning_rate": 9.56413084758552e-06,
+      "loss": 1.5542,
+      "step": 327
+    },
+    {
+      "epoch": 0.6023875114784206,
+      "grad_norm": 0.21663673460406355,
+      "learning_rate": 9.561122952800336e-06,
+      "loss": 1.7194,
+      "step": 328
+    },
+    {
+      "epoch": 0.6042240587695134,
+      "grad_norm": 0.2125100847818667,
+      "learning_rate": 9.55810519138271e-06,
+      "loss": 1.8111,
+      "step": 329
+    },
+    {
+      "epoch": 0.6060606060606061,
+      "grad_norm": 0.23381422950443456,
+      "learning_rate": 9.55507756986067e-06,
+      "loss": 1.461,
+      "step": 330
+    },
+    {
+      "epoch": 0.6078971533516988,
+      "grad_norm": 0.2977798664197012,
+      "learning_rate": 9.552040094783575e-06,
+      "loss": 1.5266,
+      "step": 331
+    },
+    {
+      "epoch": 0.6097337006427915,
+      "grad_norm": 0.2219906624573214,
+      "learning_rate": 9.548992772722097e-06,
+      "loss": 1.5105,
+      "step": 332
+    },
+    {
+      "epoch": 0.6115702479338843,
+      "grad_norm": 0.25219046567315495,
+      "learning_rate": 9.545935610268213e-06,
+      "loss": 1.5179,
+      "step": 333
+    },
+    {
+      "epoch": 0.6134067952249771,
+      "grad_norm": 0.22072558243113488,
+      "learning_rate": 9.542868614035182e-06,
+      "loss": 1.587,
+      "step": 334
+    },
+    {
+      "epoch": 0.6152433425160698,
+      "grad_norm": 0.291264791118564,
+      "learning_rate": 9.53979179065754e-06,
+      "loss": 1.6009,
+      "step": 335
+    },
+    {
+      "epoch": 0.6170798898071626,
+      "grad_norm": 0.27555767370579204,
+      "learning_rate": 9.536705146791076e-06,
+      "loss": 1.4902,
+      "step": 336
+    },
+    {
+      "epoch": 0.6189164370982553,
+      "grad_norm": 0.3560500138536834,
+      "learning_rate": 9.533608689112827e-06,
+      "loss": 1.4053,
+      "step": 337
+    },
+    {
+      "epoch": 0.620752984389348,
+      "grad_norm": 0.22581426937660223,
+      "learning_rate": 9.530502424321062e-06,
+      "loss": 1.3816,
+      "step": 338
+    },
+    {
+      "epoch": 0.6225895316804407,
+      "grad_norm": 0.22611206052943753,
+      "learning_rate": 9.527386359135254e-06,
+      "loss": 1.4149,
+      "step": 339
+    },
+    {
+      "epoch": 0.6244260789715336,
+      "grad_norm": 0.25279806678865613,
+      "learning_rate": 9.524260500296087e-06,
+      "loss": 1.6033,
+      "step": 340
+    },
+    {
+      "epoch": 0.6262626262626263,
+      "grad_norm": 0.27657948317697195,
+      "learning_rate": 9.521124854565425e-06,
+      "loss": 1.6497,
+      "step": 341
+    },
+    {
+      "epoch": 0.628099173553719,
+      "grad_norm": 0.27642525359962034,
+      "learning_rate": 9.517979428726306e-06,
+      "loss": 1.9425,
+      "step": 342
+    },
+    {
+      "epoch": 0.6299357208448118,
+      "grad_norm": 0.24498751269775337,
+      "learning_rate": 9.514824229582922e-06,
+      "loss": 1.5756,
+      "step": 343
+    },
+    {
+      "epoch": 0.6317722681359045,
+      "grad_norm": 0.23199154562408514,
+      "learning_rate": 9.511659263960607e-06,
+      "loss": 1.7103,
+      "step": 344
+    },
+    {
+      "epoch": 0.6336088154269972,
+      "grad_norm": 0.24499400426596973,
+      "learning_rate": 9.508484538705823e-06,
+      "loss": 1.7538,
+      "step": 345
+    },
+    {
+      "epoch": 0.63544536271809,
+      "grad_norm": 0.2507783598400131,
+      "learning_rate": 9.505300060686145e-06,
+      "loss": 1.6243,
+      "step": 346
+    },
+    {
+      "epoch": 0.6372819100091828,
+      "grad_norm": 0.3348756652505991,
+      "learning_rate": 9.50210583679024e-06,
+      "loss": 1.5188,
+      "step": 347
+    },
+    {
+      "epoch": 0.6391184573002755,
+      "grad_norm": 0.24441005383223785,
+      "learning_rate": 9.498901873927865e-06,
+      "loss": 1.4454,
+      "step": 348
+    },
+    {
+      "epoch": 0.6409550045913682,
+      "grad_norm": 0.2507000333701989,
+      "learning_rate": 9.495688179029838e-06,
+      "loss": 1.6245,
+      "step": 349
+    },
+    {
+      "epoch": 0.642791551882461,
+      "grad_norm": 0.24754540410863546,
+      "learning_rate": 9.492464759048033e-06,
+      "loss": 1.4104,
+      "step": 350
+    },
+    {
+      "epoch": 0.6446280991735537,
+      "grad_norm": 0.26737000313540454,
+      "learning_rate": 9.48923162095536e-06,
+      "loss": 1.6173,
+      "step": 351
+    },
+    {
+      "epoch": 0.6464646464646465,
+      "grad_norm": 0.2582858797490392,
+      "learning_rate": 9.48598877174575e-06,
+      "loss": 1.5501,
+      "step": 352
+    },
+    {
+      "epoch": 0.6483011937557392,
+      "grad_norm": 0.23212846839574947,
+      "learning_rate": 9.482736218434144e-06,
+      "loss": 1.5724,
+      "step": 353
+    },
+    {
+      "epoch": 0.650137741046832,
+      "grad_norm": 0.23218434605900706,
+      "learning_rate": 9.479473968056472e-06,
+      "loss": 1.4088,
+      "step": 354
+    },
+    {
+      "epoch": 0.6519742883379247,
+      "grad_norm": 0.2578729569151409,
+      "learning_rate": 9.476202027669644e-06,
+      "loss": 1.4826,
+      "step": 355
+    },
+    {
+      "epoch": 0.6538108356290174,
+      "grad_norm": 0.2154021538644954,
+      "learning_rate": 9.472920404351527e-06,
+      "loss": 1.3663,
+      "step": 356
+    },
+    {
+      "epoch": 0.6556473829201102,
+      "grad_norm": 0.27334033545305675,
+      "learning_rate": 9.469629105200937e-06,
+      "loss": 1.6778,
+      "step": 357
+    },
+    {
+      "epoch": 0.657483930211203,
+      "grad_norm": 0.29665620542669136,
+      "learning_rate": 9.466328137337623e-06,
+      "loss": 1.6483,
+      "step": 358
+    },
+    {
+      "epoch": 0.6593204775022957,
+      "grad_norm": 0.25732766746595215,
+      "learning_rate": 9.463017507902245e-06,
+      "loss": 1.6422,
+      "step": 359
+    },
+    {
+      "epoch": 0.6611570247933884,
+      "grad_norm": 0.22608595687187208,
+      "learning_rate": 9.459697224056364e-06,
+      "loss": 1.4751,
+      "step": 360
+    },
+    {
+      "epoch": 0.6629935720844812,
+      "grad_norm": 0.24483796123632973,
+      "learning_rate": 9.45636729298243e-06,
+      "loss": 1.6614,
+      "step": 361
+    },
+    {
+      "epoch": 0.6648301193755739,
+      "grad_norm": 0.21225379478527837,
+      "learning_rate": 9.453027721883751e-06,
+      "loss": 1.7302,
+      "step": 362
+    },
+    {
+      "epoch": 0.6666666666666666,
+      "grad_norm": 0.26429778829676437,
+      "learning_rate": 9.449678517984503e-06,
+      "loss": 1.7002,
+      "step": 363
+    },
+    {
+      "epoch": 0.6685032139577594,
+      "grad_norm": 0.26129846226407893,
+      "learning_rate": 9.446319688529688e-06,
+      "loss": 1.505,
+      "step": 364
+    },
+    {
+      "epoch": 0.6703397612488522,
+      "grad_norm": 0.24293627375696744,
+      "learning_rate": 9.442951240785135e-06,
+      "loss": 1.616,
+      "step": 365
+    },
+    {
+      "epoch": 0.6721763085399449,
+      "grad_norm": 0.2631927129942196,
+      "learning_rate": 9.439573182037478e-06,
+      "loss": 1.6593,
+      "step": 366
+    },
+    {
+      "epoch": 0.6740128558310376,
+      "grad_norm": 0.2512323899150732,
+      "learning_rate": 9.436185519594145e-06,
+      "loss": 1.5735,
+      "step": 367
+    },
+    {
+      "epoch": 0.6758494031221304,
+      "grad_norm": 0.5854956658746846,
+      "learning_rate": 9.432788260783333e-06,
+      "loss": 1.5307,
+      "step": 368
+    },
+    {
+      "epoch": 0.6776859504132231,
+      "grad_norm": 0.2532527127845924,
+      "learning_rate": 9.429381412954e-06,
+      "loss": 1.3514,
+      "step": 369
+    },
+    {
+      "epoch": 0.6795224977043158,
+      "grad_norm": 0.22892141489196347,
+      "learning_rate": 9.425964983475848e-06,
+      "loss": 1.5846,
+      "step": 370
+    },
+    {
+      "epoch": 0.6813590449954087,
+      "grad_norm": 0.3092853890062792,
+      "learning_rate": 9.422538979739307e-06,
+      "loss": 1.2921,
+      "step": 371
+    },
+    {
+      "epoch": 0.6831955922865014,
+      "grad_norm": 0.25717541532306365,
+      "learning_rate": 9.419103409155517e-06,
+      "loss": 1.5299,
+      "step": 372
+    },
+    {
+      "epoch": 0.6850321395775941,
+      "grad_norm": 0.2554573529209432,
+      "learning_rate": 9.415658279156312e-06,
+      "loss": 1.6284,
+      "step": 373
+    },
+    {
+      "epoch": 0.6868686868686869,
+      "grad_norm": 0.2720753683925479,
+      "learning_rate": 9.412203597194204e-06,
+      "loss": 1.4538,
+      "step": 374
+    },
+    {
+      "epoch": 0.6887052341597796,
+      "grad_norm": 0.25694738444316845,
+      "learning_rate": 9.408739370742372e-06,
+      "loss": 1.6709,
+      "step": 375
+    },
+    {
+      "epoch": 0.6905417814508723,
+      "grad_norm": 0.23142193114218948,
+      "learning_rate": 9.405265607294638e-06,
+      "loss": 1.5729,
+      "step": 376
+    },
+    {
+      "epoch": 0.6923783287419651,
+      "grad_norm": 0.6276509400617444,
+      "learning_rate": 9.401782314365458e-06,
+      "loss": 1.4751,
+      "step": 377
+    },
+    {
+      "epoch": 0.6942148760330579,
+      "grad_norm": 0.23891845253084326,
+      "learning_rate": 9.398289499489897e-06,
+      "loss": 1.7754,
+      "step": 378
+    },
+    {
+      "epoch": 0.6960514233241506,
+      "grad_norm": 0.21871931719886073,
+      "learning_rate": 9.39478717022362e-06,
+      "loss": 1.4614,
+      "step": 379
+    },
+    {
+      "epoch": 0.6978879706152433,
+      "grad_norm": 0.26099154202292374,
+      "learning_rate": 9.391275334142879e-06,
+      "loss": 1.4168,
+      "step": 380
+    },
+    {
+      "epoch": 0.699724517906336,
+      "grad_norm": 0.2354655594620819,
+      "learning_rate": 9.387753998844482e-06,
+      "loss": 1.6517,
+      "step": 381
+    },
+    {
+      "epoch": 0.7015610651974288,
+      "grad_norm": 0.39436529660636566,
+      "learning_rate": 9.384223171945793e-06,
+      "loss": 1.5878,
+      "step": 382
+    },
+    {
+      "epoch": 0.7033976124885216,
+      "grad_norm": 0.253934593084282,
+      "learning_rate": 9.380682861084703e-06,
+      "loss": 1.4456,
+      "step": 383
+    },
+    {
+      "epoch": 0.7052341597796143,
+      "grad_norm": 0.275985389911898,
+      "learning_rate": 9.377133073919622e-06,
+      "loss": 1.4548,
+      "step": 384
+    },
+    {
+      "epoch": 0.7070707070707071,
+      "grad_norm": 0.274347449615472,
+      "learning_rate": 9.37357381812946e-06,
+      "loss": 1.4328,
+      "step": 385
+    },
+    {
+      "epoch": 0.7089072543617998,
+      "grad_norm": 0.23606491033625135,
+      "learning_rate": 9.370005101413605e-06,
+      "loss": 1.418,
+      "step": 386
+    },
+    {
+      "epoch": 0.7107438016528925,
+      "grad_norm": 0.31465431130895255,
+      "learning_rate": 9.366426931491917e-06,
+      "loss": 1.5906,
+      "step": 387
+    },
+    {
+      "epoch": 0.7125803489439853,
+      "grad_norm": 0.34193996513257946,
+      "learning_rate": 9.362839316104701e-06,
+      "loss": 1.5417,
+      "step": 388
+    },
+    {
+      "epoch": 0.7144168962350781,
+      "grad_norm": 0.22556493806007524,
+      "learning_rate": 9.359242263012693e-06,
+      "loss": 1.7724,
+      "step": 389
+    },
+    {
+      "epoch": 0.7162534435261708,
+      "grad_norm": 0.2680416851368413,
+      "learning_rate": 9.355635779997052e-06,
+      "loss": 1.6457,
+      "step": 390
+    },
+    {
+      "epoch": 0.7180899908172635,
+      "grad_norm": 0.24689515414196325,
+      "learning_rate": 9.352019874859326e-06,
+      "loss": 1.568,
+      "step": 391
+    },
+    {
+      "epoch": 0.7199265381083563,
+      "grad_norm": 0.21347041125386362,
+      "learning_rate": 9.348394555421454e-06,
+      "loss": 1.7583,
+      "step": 392
+    },
+    {
+      "epoch": 0.721763085399449,
+      "grad_norm": 0.46467653443410706,
+      "learning_rate": 9.344759829525734e-06,
+      "loss": 1.5016,
+      "step": 393
+    },
+    {
+      "epoch": 0.7235996326905417,
+      "grad_norm": 0.23251022201282956,
+      "learning_rate": 9.341115705034813e-06,
+      "loss": 1.4531,
+      "step": 394
+    },
+    {
+      "epoch": 0.7254361799816346,
+      "grad_norm": 0.2635599798354954,
+      "learning_rate": 9.33746218983167e-06,
+      "loss": 1.6209,
+      "step": 395
+    },
+    {
+      "epoch": 0.7272727272727273,
+      "grad_norm": 0.274528346084071,
+      "learning_rate": 9.3337992918196e-06,
+      "loss": 1.423,
+      "step": 396
+    },
+    {
+      "epoch": 0.72910927456382,
+      "grad_norm": 0.22452326304098907,
+      "learning_rate": 9.330127018922195e-06,
+      "loss": 1.6043,
+      "step": 397
+    },
+    {
+      "epoch": 0.7309458218549127,
+      "grad_norm": 0.23441816537644192,
+      "learning_rate": 9.32644537908332e-06,
+      "loss": 1.3519,
+      "step": 398
+    },
+    {
+      "epoch": 0.7327823691460055,
+      "grad_norm": 0.23890498709588182,
+      "learning_rate": 9.32275438026711e-06,
+      "loss": 1.5404,
+      "step": 399
+    },
+    {
+      "epoch": 0.7346189164370982,
+      "grad_norm": 0.21291317553932287,
+      "learning_rate": 9.31905403045794e-06,
+      "loss": 1.5691,
+      "step": 400
+    },
+    {
+      "epoch": 0.736455463728191,
+      "grad_norm": 0.22613473470643639,
+      "learning_rate": 9.315344337660422e-06,
+      "loss": 1.4559,
+      "step": 401
+    },
+    {
+      "epoch": 0.7382920110192838,
+      "grad_norm": 0.23269103930259752,
+      "learning_rate": 9.311625309899366e-06,
+      "loss": 1.3702,
+      "step": 402
+    },
+    {
+      "epoch": 0.7401285583103765,
+      "grad_norm": 0.20796226054959077,
+      "learning_rate": 9.307896955219787e-06,
+      "loss": 1.4569,
+      "step": 403
+    },
+    {
+      "epoch": 0.7419651056014692,
+      "grad_norm": 0.23674950969933053,
+      "learning_rate": 9.304159281686867e-06,
+      "loss": 1.5614,
+      "step": 404
+    },
+    {
+      "epoch": 0.743801652892562,
+      "grad_norm": 0.2166339431037937,
+      "learning_rate": 9.300412297385954e-06,
+      "loss": 1.5903,
+      "step": 405
+    },
+    {
+      "epoch": 0.7456382001836547,
+      "grad_norm": 0.376582090077921,
+      "learning_rate": 9.296656010422532e-06,
+      "loss": 1.5696,
+      "step": 406
+    },
+    {
+      "epoch": 0.7474747474747475,
+      "grad_norm": 0.2507106267047962,
+      "learning_rate": 9.29289042892221e-06,
+      "loss": 1.4167,
+      "step": 407
+    },
+    {
+      "epoch": 0.7493112947658402,
+      "grad_norm": 0.21978547524853728,
+      "learning_rate": 9.289115561030704e-06,
+      "loss": 1.6598,
+      "step": 408
+    },
+    {
+      "epoch": 0.7493112947658402,
+      "eval_loss": 2.3061842918395996,
+      "eval_runtime": 40.5501,
+      "eval_samples_per_second": 5.055,
+      "eval_steps_per_second": 0.444,
+      "step": 408
+    },
+    {
+      "epoch": 0.751147842056933,
+      "grad_norm": 0.2335920969105023,
+      "learning_rate": 9.285331414913816e-06,
+      "loss": 1.4038,
+      "step": 409
+    },
+    {
+      "epoch": 0.7529843893480257,
+      "grad_norm": 0.28229727560433654,
+      "learning_rate": 9.281537998757421e-06,
+      "loss": 1.3303,
+      "step": 410
+    },
+    {
+      "epoch": 0.7548209366391184,
+      "grad_norm": 0.23757995428362888,
+      "learning_rate": 9.277735320767449e-06,
+      "loss": 1.3841,
+      "step": 411
+    },
+    {
+      "epoch": 0.7566574839302111,
+      "grad_norm": 0.24758854422732826,
+      "learning_rate": 9.27392338916986e-06,
+      "loss": 1.624,
+      "step": 412
+    },
+    {
+      "epoch": 0.758494031221304,
+      "grad_norm": 0.2627291719598822,
+      "learning_rate": 9.270102212210632e-06,
+      "loss": 1.7343,
+      "step": 413
+    },
+    {
+      "epoch": 0.7603305785123967,
+      "grad_norm": 0.29750352907343186,
+      "learning_rate": 9.266271798155748e-06,
+      "loss": 1.6209,
+      "step": 414
+    },
+    {
+      "epoch": 0.7621671258034894,
+      "grad_norm": 0.23822029512893117,
+      "learning_rate": 9.262432155291167e-06,
+      "loss": 1.513,
+      "step": 415
+    },
+    {
+      "epoch": 0.7640036730945822,
+      "grad_norm": 0.21093681279730364,
+      "learning_rate": 9.258583291922814e-06,
+      "loss": 1.5292,
+      "step": 416
+    },
+    {
+      "epoch": 0.7658402203856749,
+      "grad_norm": 0.26293015719040297,
+      "learning_rate": 9.254725216376562e-06,
+      "loss": 1.5138,
+      "step": 417
+    },
+    {
+      "epoch": 0.7676767676767676,
+      "grad_norm": 0.23385317706303402,
+      "learning_rate": 9.250857936998206e-06,
+      "loss": 1.3565,
+      "step": 418
+    },
+    {
+      "epoch": 0.7695133149678605,
+      "grad_norm": 0.38700660904810047,
+      "learning_rate": 9.246981462153456e-06,
+      "loss": 1.4129,
+      "step": 419
+    },
+    {
+      "epoch": 0.7713498622589532,
+      "grad_norm": 0.22885668314514052,
+      "learning_rate": 9.243095800227913e-06,
+      "loss": 1.7462,
+      "step": 420
+    },
+    {
+      "epoch": 0.7731864095500459,
+      "grad_norm": 0.21379597965346503,
+      "learning_rate": 9.239200959627048e-06,
+      "loss": 1.6085,
+      "step": 421
+    },
+    {
+      "epoch": 0.7750229568411386,
+      "grad_norm": 0.22354309327698976,
+      "learning_rate": 9.235296948776194e-06,
+      "loss": 1.6027,
+      "step": 422
+    },
+    {
+      "epoch": 0.7768595041322314,
+      "grad_norm": 0.33114539095121254,
+      "learning_rate": 9.231383776120512e-06,
+      "loss": 1.5652,
+      "step": 423
+    },
+    {
+      "epoch": 0.7786960514233241,
+      "grad_norm": 0.2628333136775673,
+      "learning_rate": 9.22746145012499e-06,
+      "loss": 1.4293,
+      "step": 424
+    },
+    {
+      "epoch": 0.7805325987144169,
+      "grad_norm": 0.2512363336874892,
+      "learning_rate": 9.223529979274411e-06,
+      "loss": 1.6437,
+      "step": 425
+    },
+    {
+      "epoch": 0.7823691460055097,
+      "grad_norm": 0.2375037995789399,
+      "learning_rate": 9.219589372073344e-06,
+      "loss": 1.6051,
+      "step": 426
+    },
+    {
+      "epoch": 0.7842056932966024,
+      "grad_norm": 0.3071445167943931,
+      "learning_rate": 9.215639637046121e-06,
+      "loss": 1.4219,
+      "step": 427
+    },
+    {
+      "epoch": 0.7860422405876951,
+      "grad_norm": 0.22189183823448244,
+      "learning_rate": 9.211680782736818e-06,
+      "loss": 1.4985,
+      "step": 428
+    },
+    {
+      "epoch": 0.7878787878787878,
+      "grad_norm": 0.25580090731799854,
+      "learning_rate": 9.207712817709237e-06,
+      "loss": 1.4033,
+      "step": 429
+    },
+    {
+      "epoch": 0.7897153351698806,
+      "grad_norm": 0.24812653746151964,
+      "learning_rate": 9.203735750546891e-06,
+      "loss": 1.3742,
+      "step": 430
+    },
+    {
+      "epoch": 0.7915518824609734,
+      "grad_norm": 0.24863294067441372,
+      "learning_rate": 9.19974958985298e-06,
+      "loss": 1.5571,
+      "step": 431
+    },
+    {
+      "epoch": 0.7933884297520661,
+      "grad_norm": 0.2836367707982348,
+      "learning_rate": 9.19575434425038e-06,
+      "loss": 1.6326,
+      "step": 432
+    },
+    {
+      "epoch": 0.7952249770431589,
+      "grad_norm": 0.22384740224875363,
+      "learning_rate": 9.191750022381613e-06,
+      "loss": 1.4628,
+      "step": 433
+    },
+    {
+      "epoch": 0.7970615243342516,
+      "grad_norm": 0.2250518915942832,
+      "learning_rate": 9.18773663290884e-06,
+      "loss": 1.5826,
+      "step": 434
+    },
+    {
+      "epoch": 0.7988980716253443,
+      "grad_norm": 0.2439126131273036,
+      "learning_rate": 9.183714184513832e-06,
+      "loss": 1.603,
+      "step": 435
+    },
+    {
+      "epoch": 0.800734618916437,
+      "grad_norm": 0.24495825317270972,
+      "learning_rate": 9.179682685897963e-06,
+      "loss": 1.469,
+      "step": 436
+    },
+    {
+      "epoch": 0.8025711662075299,
+      "grad_norm": 0.21768361761008279,
+      "learning_rate": 9.175642145782179e-06,
+      "loss": 1.4976,
+      "step": 437
+    },
+    {
+      "epoch": 0.8044077134986226,
+      "grad_norm": 0.26701765806787003,
+      "learning_rate": 9.171592572906985e-06,
+      "loss": 1.5952,
+      "step": 438
+    },
+    {
+      "epoch": 0.8062442607897153,
+      "grad_norm": 0.21065992974075412,
+      "learning_rate": 9.16753397603243e-06,
+      "loss": 1.5322,
+      "step": 439
+    },
+    {
+      "epoch": 0.8080808080808081,
+      "grad_norm": 0.27599402518484223,
+      "learning_rate": 9.16346636393808e-06,
+      "loss": 1.3606,
+      "step": 440
+    },
+    {
+      "epoch": 0.8099173553719008,
+      "grad_norm": 0.3021312730547759,
+      "learning_rate": 9.159389745423003e-06,
+      "loss": 1.584,
+      "step": 441
+    },
+    {
+      "epoch": 0.8117539026629935,
+      "grad_norm": 0.21998110932041243,
+      "learning_rate": 9.155304129305749e-06,
+      "loss": 1.4583,
+      "step": 442
+    },
+    {
+      "epoch": 0.8135904499540864,
+      "grad_norm": 0.2329768737772725,
+      "learning_rate": 9.151209524424333e-06,
+      "loss": 1.4508,
+      "step": 443
+    },
+    {
+      "epoch": 0.8154269972451791,
+      "grad_norm": 0.2578363729671407,
+      "learning_rate": 9.147105939636216e-06,
+      "loss": 1.5392,
+      "step": 444
+    },
+    {
+      "epoch": 0.8172635445362718,
+      "grad_norm": 0.2365004570955238,
+      "learning_rate": 9.142993383818284e-06,
+      "loss": 1.632,
+      "step": 445
+    },
+    {
+      "epoch": 0.8191000918273645,
+      "grad_norm": 0.21742880728132308,
+      "learning_rate": 9.138871865866824e-06,
+      "loss": 1.3645,
+      "step": 446
+    },
+    {
+      "epoch": 0.8209366391184573,
+      "grad_norm": 0.23059966917774738,
+      "learning_rate": 9.134741394697517e-06,
+      "loss": 1.3386,
+      "step": 447
+    },
+    {
+      "epoch": 0.82277318640955,
+      "grad_norm": 0.24309425578366148,
+      "learning_rate": 9.130601979245407e-06,
+      "loss": 1.38,
+      "step": 448
+    },
+    {
+      "epoch": 0.8246097337006428,
+      "grad_norm": 0.21478191767990237,
+      "learning_rate": 9.126453628464889e-06,
+      "loss": 1.76,
+      "step": 449
+    },
+    {
+      "epoch": 0.8264462809917356,
+      "grad_norm": 0.25682509893819777,
+      "learning_rate": 9.122296351329683e-06,
+      "loss": 1.4405,
+      "step": 450
+    },
+    {
+      "epoch": 0.8282828282828283,
+      "grad_norm": 0.23365435124291448,
+      "learning_rate": 9.118130156832823e-06,
+      "loss": 1.4337,
+      "step": 451
+    },
+    {
+      "epoch": 0.830119375573921,
+      "grad_norm": 0.2415984482071214,
+      "learning_rate": 9.113955053986632e-06,
+      "loss": 1.6131,
+      "step": 452
+    },
+    {
+      "epoch": 0.8319559228650137,
+      "grad_norm": 0.26943745232610666,
+      "learning_rate": 9.109771051822702e-06,
+      "loss": 1.4698,
+      "step": 453
+    },
+    {
+      "epoch": 0.8337924701561065,
+      "grad_norm": 0.2074005721654442,
+      "learning_rate": 9.105578159391876e-06,
+      "loss": 1.5938,
+      "step": 454
+    },
+    {
+      "epoch": 0.8356290174471993,
+      "grad_norm": 0.21993568441683473,
+      "learning_rate": 9.10137638576423e-06,
+      "loss": 1.4473,
+      "step": 455
+    },
+    {
+      "epoch": 0.837465564738292,
+      "grad_norm": 0.2225235136645375,
+      "learning_rate": 9.097165740029053e-06,
+      "loss": 1.7787,
+      "step": 456
+    },
+    {
+      "epoch": 0.8393021120293848,
+      "grad_norm": 0.22980927731633988,
+      "learning_rate": 9.09294623129482e-06,
+      "loss": 1.5131,
+      "step": 457
+    },
+    {
+      "epoch": 0.8411386593204775,
+      "grad_norm": 0.525766821192798,
+      "learning_rate": 9.088717868689186e-06,
+      "loss": 1.5409,
+      "step": 458
+    },
+    {
+      "epoch": 0.8429752066115702,
+      "grad_norm": 0.2263260760581893,
+      "learning_rate": 9.084480661358954e-06,
+      "loss": 1.5803,
+      "step": 459
+    },
+    {
+      "epoch": 0.8448117539026629,
+      "grad_norm": 0.24950337121155466,
+      "learning_rate": 9.080234618470063e-06,
+      "loss": 1.7144,
+      "step": 460
+    },
+    {
+      "epoch": 0.8466483011937558,
+      "grad_norm": 0.21067429427962073,
+      "learning_rate": 9.07597974920756e-06,
+      "loss": 1.662,
+      "step": 461
+    },
+    {
+      "epoch": 0.8484848484848485,
+      "grad_norm": 0.2308216794274888,
+      "learning_rate": 9.071716062775592e-06,
+      "loss": 1.5284,
+      "step": 462
+    },
+    {
+      "epoch": 0.8503213957759412,
+      "grad_norm": 0.25595362098568153,
+      "learning_rate": 9.067443568397378e-06,
+      "loss": 1.7066,
+      "step": 463
+    },
+    {
+      "epoch": 0.852157943067034,
+      "grad_norm": 0.2892000674805998,
+      "learning_rate": 9.063162275315182e-06,
+      "loss": 1.559,
+      "step": 464
+    },
+    {
+      "epoch": 0.8539944903581267,
+      "grad_norm": 0.28340515745622036,
+      "learning_rate": 9.058872192790314e-06,
+      "loss": 1.4001,
+      "step": 465
+    },
+    {
+      "epoch": 0.8558310376492194,
+      "grad_norm": 0.2294106234149869,
+      "learning_rate": 9.054573330103087e-06,
+      "loss": 1.4574,
+      "step": 466
+    },
+    {
+      "epoch": 0.8576675849403123,
+      "grad_norm": 0.24497945362812937,
+      "learning_rate": 9.05026569655281e-06,
+      "loss": 1.5943,
+      "step": 467
+    },
+    {
+      "epoch": 0.859504132231405,
+      "grad_norm": 0.253470755772231,
+      "learning_rate": 9.045949301457774e-06,
+      "loss": 1.5505,
+      "step": 468
+    },
+    {
+      "epoch": 0.8613406795224977,
+      "grad_norm": 0.2492429347432005,
+      "learning_rate": 9.041624154155208e-06,
+      "loss": 1.5801,
+      "step": 469
+    },
+    {
+      "epoch": 0.8631772268135904,
+      "grad_norm": 0.26092005188633716,
+      "learning_rate": 9.037290264001286e-06,
+      "loss": 1.6384,
+      "step": 470
+    },
+    {
+      "epoch": 0.8650137741046832,
+      "grad_norm": 0.22072784533883108,
+      "learning_rate": 9.032947640371086e-06,
+      "loss": 1.6069,
+      "step": 471
+    },
+    {
+      "epoch": 0.8668503213957759,
+      "grad_norm": 0.22398684213158268,
+      "learning_rate": 9.028596292658585e-06,
+      "loss": 1.5495,
+      "step": 472
+    },
+    {
+      "epoch": 0.8686868686868687,
+      "grad_norm": 0.2027554437403566,
+      "learning_rate": 9.02423623027663e-06,
+      "loss": 1.5387,
+      "step": 473
+    },
+    {
+      "epoch": 0.8705234159779615,
+      "grad_norm": 0.23717640601226908,
+      "learning_rate": 9.019867462656915e-06,
+      "loss": 1.5579,
+      "step": 474
+    },
+    {
+      "epoch": 0.8723599632690542,
+      "grad_norm": 0.22501657795548555,
+      "learning_rate": 9.01548999924997e-06,
+      "loss": 1.3586,
+      "step": 475
+    },
+    {
+      "epoch": 0.8741965105601469,
+      "grad_norm": 0.21644485895311025,
+      "learning_rate": 9.011103849525139e-06,
+      "loss": 1.8106,
+      "step": 476
+    },
+    {
+      "epoch": 0.8760330578512396,
+      "grad_norm": 0.45331532023795523,
+      "learning_rate": 9.006709022970547e-06,
+      "loss": 1.5949,
+      "step": 477
+    },
+    {
+      "epoch": 0.8778696051423324,
+      "grad_norm": 0.2651826534678187,
+      "learning_rate": 9.002305529093095e-06,
+      "loss": 1.1691,
+      "step": 478
+    },
+    {
+      "epoch": 0.8797061524334252,
+      "grad_norm": 0.2676840437065319,
+      "learning_rate": 8.997893377418432e-06,
+      "loss": 1.4198,
+      "step": 479
+    },
+    {
+      "epoch": 0.8815426997245179,
+      "grad_norm": 0.2308528854306592,
+      "learning_rate": 8.993472577490936e-06,
+      "loss": 1.4812,
+      "step": 480
+    },
+    {
+      "epoch": 0.8833792470156107,
+      "grad_norm": 0.20636713087022784,
+      "learning_rate": 8.98904313887369e-06,
+      "loss": 1.6178,
+      "step": 481
+    },
+    {
+      "epoch": 0.8852157943067034,
+      "grad_norm": 0.29618906487535407,
+      "learning_rate": 8.984605071148471e-06,
+      "loss": 1.5748,
+      "step": 482
+    },
+    {
+      "epoch": 0.8870523415977961,
+      "grad_norm": 0.24284044940826433,
+      "learning_rate": 8.980158383915714e-06,
+      "loss": 1.7419,
+      "step": 483
+    },
+    {
+      "epoch": 0.8888888888888888,
+      "grad_norm": 0.22881808189787375,
+      "learning_rate": 8.975703086794505e-06,
+      "loss": 1.4035,
+      "step": 484
+    },
+    {
+      "epoch": 0.8907254361799817,
+      "grad_norm": 0.5882914193304096,
+      "learning_rate": 8.971239189422555e-06,
+      "loss": 1.5501,
+      "step": 485
+    },
+    {
+      "epoch": 0.8925619834710744,
+      "grad_norm": 0.23820272367736536,
+      "learning_rate": 8.966766701456177e-06,
+      "loss": 1.5487,
+      "step": 486
+    },
+    {
+      "epoch": 0.8943985307621671,
+      "grad_norm": 0.22512062456776769,
+      "learning_rate": 8.962285632570266e-06,
+      "loss": 1.7015,
+      "step": 487
+    },
+    {
+      "epoch": 0.8962350780532599,
+      "grad_norm": 0.22468181674999985,
+      "learning_rate": 8.957795992458285e-06,
+      "loss": 1.379,
+      "step": 488
+    },
+    {
+      "epoch": 0.8980716253443526,
+      "grad_norm": 0.24683192515184557,
+      "learning_rate": 8.953297790832231e-06,
+      "loss": 1.5196,
+      "step": 489
+    },
+    {
+      "epoch": 0.8999081726354453,
+      "grad_norm": 0.24472352067207945,
+      "learning_rate": 8.948791037422629e-06,
+      "loss": 1.5634,
+      "step": 490
+    },
+    {
+      "epoch": 0.9017447199265382,
+      "grad_norm": 0.23757734063602157,
+      "learning_rate": 8.944275741978495e-06,
+      "loss": 1.6768,
+      "step": 491
+    },
+    {
+      "epoch": 0.9035812672176309,
+      "grad_norm": 0.23765942801452902,
+      "learning_rate": 8.939751914267329e-06,
+      "loss": 1.4796,
+      "step": 492
+    },
+    {
+      "epoch": 0.9054178145087236,
+      "grad_norm": 0.2493616211295045,
+      "learning_rate": 8.935219564075087e-06,
+      "loss": 1.7449,
+      "step": 493
+    },
+    {
+      "epoch": 0.9072543617998163,
+      "grad_norm": 0.21740219428376328,
+      "learning_rate": 8.93067870120616e-06,
+      "loss": 1.4374,
+      "step": 494
+    },
+    {
+      "epoch": 0.9090909090909091,
+      "grad_norm": 0.2482842265282672,
+      "learning_rate": 8.92612933548335e-06,
+      "loss": 1.7847,
+      "step": 495
+    },
+    {
+      "epoch": 0.9109274563820018,
+      "grad_norm": 0.19968002281932487,
+      "learning_rate": 8.921571476747861e-06,
+      "loss": 1.6578,
+      "step": 496
+    },
+    {
+      "epoch": 0.9127640036730946,
+      "grad_norm": 0.23718063305783535,
+      "learning_rate": 8.917005134859263e-06,
+      "loss": 1.478,
+      "step": 497
+    },
+    {
+      "epoch": 0.9146005509641874,
+      "grad_norm": 0.2472130753216968,
+      "learning_rate": 8.912430319695478e-06,
+      "loss": 1.5453,
+      "step": 498
+    },
+    {
+      "epoch": 0.9164370982552801,
+      "grad_norm": 0.24331817867045824,
+      "learning_rate": 8.907847041152757e-06,
+      "loss": 1.5475,
+      "step": 499
+    },
+    {
+      "epoch": 0.9182736455463728,
+      "grad_norm": 0.34075220788764593,
+      "learning_rate": 8.90325530914566e-06,
+      "loss": 1.7455,
+      "step": 500
+    },
+    {
+      "epoch": 0.9201101928374655,
+      "grad_norm": 0.1973440685550195,
+      "learning_rate": 8.89865513360703e-06,
+      "loss": 1.5224,
+      "step": 501
+    },
+    {
+      "epoch": 0.9219467401285583,
+      "grad_norm": 0.2392375532163106,
+      "learning_rate": 8.894046524487984e-06,
+      "loss": 1.3295,
+      "step": 502
+    },
+    {
+      "epoch": 0.9237832874196511,
+      "grad_norm": 0.2564773830917158,
+      "learning_rate": 8.889429491757872e-06,
+      "loss": 1.533,
+      "step": 503
+    },
+    {
+      "epoch": 0.9256198347107438,
+      "grad_norm": 0.2205455403328584,
+      "learning_rate": 8.884804045404272e-06,
+      "loss": 1.4521,
+      "step": 504
+    },
+    {
+      "epoch": 0.9274563820018366,
+      "grad_norm": 0.25135270284304534,
+      "learning_rate": 8.88017019543296e-06,
+      "loss": 1.4876,
+      "step": 505
+    },
+    {
+      "epoch": 0.9292929292929293,
+      "grad_norm": 0.251544235242601,
+      "learning_rate": 8.875527951867895e-06,
+      "loss": 1.3732,
+      "step": 506
+    },
+    {
+      "epoch": 0.931129476584022,
+      "grad_norm": 0.23610950027399946,
+      "learning_rate": 8.870877324751186e-06,
+      "loss": 1.3661,
+      "step": 507
+    },
+    {
+      "epoch": 0.9329660238751147,
+      "grad_norm": 0.2699351751142409,
+      "learning_rate": 8.86621832414308e-06,
+      "loss": 1.6805,
+      "step": 508
+    },
+    {
+      "epoch": 0.9348025711662076,
+      "grad_norm": 0.2719550299817604,
+      "learning_rate": 8.861550960121946e-06,
+      "loss": 1.2125,
+      "step": 509
+    },
+    {
+      "epoch": 0.9366391184573003,
+      "grad_norm": 0.23740235364217568,
+      "learning_rate": 8.856875242784228e-06,
+      "loss": 1.4639,
+      "step": 510
+    },
+    {
+      "epoch": 0.938475665748393,
+      "grad_norm": 0.2407044180789032,
+      "learning_rate": 8.852191182244456e-06,
+      "loss": 1.6759,
+      "step": 511
+    },
+    {
+      "epoch": 0.9403122130394858,
+      "grad_norm": 0.22822388370160415,
+      "learning_rate": 8.8474987886352e-06,
+      "loss": 1.5468,
+      "step": 512
+    },
+    {
+      "epoch": 0.9421487603305785,
+      "grad_norm": 0.20492274919803016,
+      "learning_rate": 8.842798072107055e-06,
+      "loss": 1.5179,
+      "step": 513
+    },
+    {
+      "epoch": 0.9439853076216712,
+      "grad_norm": 0.25012220364392496,
+      "learning_rate": 8.838089042828626e-06,
+      "loss": 1.7403,
+      "step": 514
+    },
+    {
+      "epoch": 0.945821854912764,
+      "grad_norm": 0.21419223860479567,
+      "learning_rate": 8.833371710986493e-06,
+      "loss": 1.5632,
+      "step": 515
+    },
+    {
+      "epoch": 0.9476584022038568,
+      "grad_norm": 0.2607121295111944,
+      "learning_rate": 8.828646086785203e-06,
+      "loss": 1.3563,
+      "step": 516
+    },
+    {
+      "epoch": 0.9494949494949495,
+      "grad_norm": 0.204811481952745,
+      "learning_rate": 8.823912180447237e-06,
+      "loss": 1.5761,
+      "step": 517
+    },
+    {
+      "epoch": 0.9513314967860422,
+      "grad_norm": 0.26470613517398467,
+      "learning_rate": 8.819170002212992e-06,
+      "loss": 1.7127,
+      "step": 518
+    },
+    {
+      "epoch": 0.953168044077135,
+      "grad_norm": 0.2610250808679381,
+      "learning_rate": 8.81441956234076e-06,
+      "loss": 1.5655,
+      "step": 519
+    },
+    {
+      "epoch": 0.9550045913682277,
+      "grad_norm": 0.2337315187549265,
+      "learning_rate": 8.809660871106705e-06,
+      "loss": 1.5154,
+      "step": 520
+    },
+    {
+      "epoch": 0.9568411386593205,
+      "grad_norm": 0.23170078740278124,
+      "learning_rate": 8.804893938804839e-06,
+      "loss": 1.5717,
+      "step": 521
+    },
+    {
+      "epoch": 0.9586776859504132,
+      "grad_norm": 0.22632743502454025,
+      "learning_rate": 8.800118775747003e-06,
+      "loss": 1.6218,
+      "step": 522
+    },
+    {
+      "epoch": 0.960514233241506,
+      "grad_norm": 0.2205915233922398,
+      "learning_rate": 8.795335392262841e-06,
+      "loss": 1.4909,
+      "step": 523
+    },
+    {
+      "epoch": 0.9623507805325987,
+      "grad_norm": 0.21145323033626462,
+      "learning_rate": 8.790543798699778e-06,
+      "loss": 1.5984,
+      "step": 524
+    },
+    {
+      "epoch": 0.9641873278236914,
+      "grad_norm": 0.20970398911022825,
+      "learning_rate": 8.785744005423003e-06,
+      "loss": 1.4622,
+      "step": 525
+    },
+    {
+      "epoch": 0.9660238751147842,
+      "grad_norm": 0.23298402376870314,
+      "learning_rate": 8.78093602281544e-06,
+      "loss": 1.5884,
+      "step": 526
+    },
+    {
+      "epoch": 0.967860422405877,
+      "grad_norm": 0.27324051793792004,
+      "learning_rate": 8.77611986127773e-06,
+      "loss": 1.4594,
+      "step": 527
+    },
+    {
+      "epoch": 0.9696969696969697,
+      "grad_norm": 0.2331172811203617,
+      "learning_rate": 8.771295531228204e-06,
+      "loss": 1.525,
+      "step": 528
+    },
+    {
+      "epoch": 0.9715335169880625,
+      "grad_norm": 0.31490123000969455,
+      "learning_rate": 8.766463043102864e-06,
+      "loss": 1.5453,
+      "step": 529
+    },
+    {
+      "epoch": 0.9733700642791552,
+      "grad_norm": 0.22547389438032928,
+      "learning_rate": 8.761622407355364e-06,
+      "loss": 1.6573,
+      "step": 530
+    },
+    {
+      "epoch": 0.9752066115702479,
+      "grad_norm": 0.21974629433018228,
+      "learning_rate": 8.756773634456975e-06,
+      "loss": 1.396,
+      "step": 531
+    },
+    {
+      "epoch": 0.9770431588613406,
+      "grad_norm": 0.21230467225101732,
+      "learning_rate": 8.751916734896577e-06,
+      "loss": 1.6261,
+      "step": 532
+    },
+    {
+      "epoch": 0.9788797061524335,
+      "grad_norm": 0.2645261233289859,
+      "learning_rate": 8.747051719180626e-06,
+      "loss": 1.435,
+      "step": 533
+    },
+    {
+      "epoch": 0.9807162534435262,
+      "grad_norm": 0.2234025047049364,
+      "learning_rate": 8.742178597833137e-06,
+      "loss": 1.5244,
+      "step": 534
+    },
+    {
+      "epoch": 0.9825528007346189,
+      "grad_norm": 0.2573392390616289,
+      "learning_rate": 8.737297381395657e-06,
+      "loss": 1.8973,
+      "step": 535
+    },
+    {
+      "epoch": 0.9843893480257117,
+      "grad_norm": 0.27996089327128665,
+      "learning_rate": 8.732408080427247e-06,
+      "loss": 1.5882,
+      "step": 536
+    },
+    {
+      "epoch": 0.9862258953168044,
+      "grad_norm": 0.21778812033730788,
+      "learning_rate": 8.727510705504453e-06,
+      "loss": 1.3809,
+      "step": 537
+    },
+    {
+      "epoch": 0.9880624426078971,
+      "grad_norm": 0.2504419591715746,
+      "learning_rate": 8.72260526722129e-06,
+      "loss": 1.4216,
+      "step": 538
+    },
+    {
+      "epoch": 0.98989898989899,
+      "grad_norm": 0.21877782640292506,
+      "learning_rate": 8.717691776189214e-06,
+      "loss": 1.4832,
+      "step": 539
+    },
+    {
+      "epoch": 0.9917355371900827,
+      "grad_norm": 0.2522185082572152,
+      "learning_rate": 8.7127702430371e-06,
+      "loss": 1.5983,
+      "step": 540
+    },
+    {
+      "epoch": 0.9935720844811754,
+      "grad_norm": 0.2468951810241973,
+      "learning_rate": 8.707840678411223e-06,
+      "loss": 1.3155,
+      "step": 541
+    },
+    {
+      "epoch": 0.9954086317722681,
+      "grad_norm": 0.24726883324778043,
+      "learning_rate": 8.702903092975226e-06,
+      "loss": 1.7388,
+      "step": 542
+    },
+    {
+      "epoch": 0.9972451790633609,
+      "grad_norm": 0.26412381788140465,
+      "learning_rate": 8.69795749741011e-06,
+      "loss": 1.5106,
+      "step": 543
+    },
+    {
+      "epoch": 0.9990817263544536,
+      "grad_norm": 0.2482433438633285,
+      "learning_rate": 8.693003902414194e-06,
+      "loss": 1.5944,
+      "step": 544
+    },
+    {
+      "epoch": 0.9990817263544536,
+      "eval_loss": 2.2991089820861816,
+      "eval_runtime": 40.0535,
+      "eval_samples_per_second": 5.118,
+      "eval_steps_per_second": 0.449,
+      "step": 544
+    },
+    {
+      "epoch": 1.0,
+      "grad_norm": 0.2482433438633285,
+      "learning_rate": 8.688042318703111e-06,
+      "loss": 0.7922,
+      "step": 545
+    },
+    {
+      "epoch": 1.0018365472910928,
+      "grad_norm": 0.25123655382867355,
+      "learning_rate": 8.683072757009772e-06,
+      "loss": 1.7327,
+      "step": 546
+    },
+    {
+      "epoch": 1.0036730945821855,
+      "grad_norm": 0.24537805082936553,
+      "learning_rate": 8.678095228084343e-06,
+      "loss": 1.555,
+      "step": 547
+    },
+    {
+      "epoch": 1.0055096418732783,
+      "grad_norm": 0.3081499543511565,
+      "learning_rate": 8.673109742694227e-06,
+      "loss": 1.5413,
+      "step": 548
+    },
+    {
+      "epoch": 1.007346189164371,
+      "grad_norm": 0.2592676032839899,
+      "learning_rate": 8.66811631162404e-06,
+      "loss": 1.492,
+      "step": 549
+    },
+    {
+      "epoch": 1.0091827364554637,
+      "grad_norm": 0.2904580639450211,
+      "learning_rate": 8.663114945675582e-06,
+      "loss": 1.5716,
+      "step": 550
+    },
+    {
+      "epoch": 1.0110192837465566,
+      "grad_norm": 0.21713926154530397,
+      "learning_rate": 8.65810565566782e-06,
+      "loss": 1.594,
+      "step": 551
+    },
+    {
+      "epoch": 1.0128558310376492,
+      "grad_norm": 0.2261416556272091,
+      "learning_rate": 8.653088452436866e-06,
+      "loss": 1.4634,
+      "step": 552
+    },
+    {
+      "epoch": 1.014692378328742,
+      "grad_norm": 0.22760563071654394,
+      "learning_rate": 8.648063346835943e-06,
+      "loss": 1.5002,
+      "step": 553
+    },
+    {
+      "epoch": 1.0165289256198347,
+      "grad_norm": 0.26019149703803174,
+      "learning_rate": 8.643030349735373e-06,
+      "loss": 1.6903,
+      "step": 554
+    },
+    {
+      "epoch": 1.0183654729109275,
+      "grad_norm": 0.2212436573171587,
+      "learning_rate": 8.637989472022548e-06,
+      "loss": 1.285,
+      "step": 555
+    },
+    {
+      "epoch": 1.02020202020202,
+      "grad_norm": 0.26107556496621437,
+      "learning_rate": 8.632940724601908e-06,
+      "loss": 1.19,
+      "step": 556
+    },
+    {
+      "epoch": 1.022038567493113,
+      "grad_norm": 0.2348097298637921,
+      "learning_rate": 8.627884118394913e-06,
+      "loss": 1.5094,
+      "step": 557
+    },
+    {
+      "epoch": 1.0238751147842058,
+      "grad_norm": 0.2534817343289944,
+      "learning_rate": 8.622819664340031e-06,
+      "loss": 1.6285,
+      "step": 558
+    },
+    {
+      "epoch": 1.0257116620752984,
+      "grad_norm": 1.0852928984602161,
+      "learning_rate": 8.617747373392697e-06,
+      "loss": 1.4635,
+      "step": 559
+    },
+    {
+      "epoch": 1.0275482093663912,
+      "grad_norm": 0.23192664878880379,
+      "learning_rate": 8.612667256525305e-06,
+      "loss": 1.5068,
+      "step": 560
+    },
+    {
+      "epoch": 1.0293847566574839,
+      "grad_norm": 0.2289762149123353,
+      "learning_rate": 8.607579324727175e-06,
+      "loss": 1.4366,
+      "step": 561
+    },
+    {
+      "epoch": 1.0312213039485767,
+      "grad_norm": 0.3341007679918475,
+      "learning_rate": 8.602483589004536e-06,
+      "loss": 1.4833,
+      "step": 562
+    },
+    {
+      "epoch": 1.0330578512396693,
+      "grad_norm": 0.35202654468246536,
+      "learning_rate": 8.597380060380493e-06,
+      "loss": 1.4242,
+      "step": 563
+    },
+    {
+      "epoch": 1.0348943985307621,
+      "grad_norm": 0.23511338029802462,
+      "learning_rate": 8.592268749895016e-06,
+      "loss": 1.4497,
+      "step": 564
+    },
+    {
+      "epoch": 1.036730945821855,
+      "grad_norm": 0.2645205013517766,
+      "learning_rate": 8.5871496686049e-06,
+      "loss": 1.5035,
+      "step": 565
+    },
+    {
+      "epoch": 1.0385674931129476,
+      "grad_norm": 0.2311579476869345,
+      "learning_rate": 8.582022827583758e-06,
+      "loss": 1.7116,
+      "step": 566
+    },
+    {
+      "epoch": 1.0404040404040404,
+      "grad_norm": 0.21777675033528562,
+      "learning_rate": 8.576888237921983e-06,
+      "loss": 1.6819,
+      "step": 567
+    },
+    {
+      "epoch": 1.042240587695133,
+      "grad_norm": 0.2873222375547828,
+      "learning_rate": 8.571745910726733e-06,
+      "loss": 1.5841,
+      "step": 568
+    },
+    {
+      "epoch": 1.044077134986226,
+      "grad_norm": 0.21809668347430947,
+      "learning_rate": 8.566595857121902e-06,
+      "loss": 1.4695,
+      "step": 569
+    },
+    {
+      "epoch": 1.0459136822773187,
+      "grad_norm": 1.448742350026709,
+      "learning_rate": 8.5614380882481e-06,
+      "loss": 1.5256,
+      "step": 570
+    },
+    {
+      "epoch": 1.0477502295684114,
+      "grad_norm": 0.23057516973048772,
+      "learning_rate": 8.556272615262623e-06,
+      "loss": 1.4582,
+      "step": 571
+    },
+    {
+      "epoch": 1.0495867768595042,
+      "grad_norm": 0.2830445961299178,
+      "learning_rate": 8.551099449339438e-06,
+      "loss": 1.5283,
+      "step": 572
+    },
+    {
+      "epoch": 1.0514233241505968,
+      "grad_norm": 0.24777574486235304,
+      "learning_rate": 8.545918601669147e-06,
+      "loss": 1.5377,
+      "step": 573
+    },
+    {
+      "epoch": 1.0532598714416896,
+      "grad_norm": 0.25712571630654524,
+      "learning_rate": 8.540730083458976e-06,
+      "loss": 1.396,
+      "step": 574
+    },
+    {
+      "epoch": 1.0550964187327825,
+      "grad_norm": 0.24275902794807133,
+      "learning_rate": 8.535533905932739e-06,
+      "loss": 1.4394,
+      "step": 575
+    },
+    {
+      "epoch": 1.056932966023875,
+      "grad_norm": 0.25586410636861384,
+      "learning_rate": 8.530330080330818e-06,
+      "loss": 1.497,
+      "step": 576
+    },
+    {
+      "epoch": 1.058769513314968,
+      "grad_norm": 0.2841455219574643,
+      "learning_rate": 8.525118617910144e-06,
+      "loss": 1.538,
+      "step": 577
+    },
+    {
+      "epoch": 1.0606060606060606,
+      "grad_norm": 0.2524100566649326,
+      "learning_rate": 8.519899529944166e-06,
+      "loss": 1.5387,
+      "step": 578
+    },
+    {
+      "epoch": 1.0624426078971534,
+      "grad_norm": 0.23467399537898634,
+      "learning_rate": 8.514672827722824e-06,
+      "loss": 1.3737,
+      "step": 579
+    },
+    {
+      "epoch": 1.064279155188246,
+      "grad_norm": 0.2539929102151058,
+      "learning_rate": 8.509438522552537e-06,
+      "loss": 1.6057,
+      "step": 580
+    },
+    {
+      "epoch": 1.0661157024793388,
+      "grad_norm": 0.23061637702881907,
+      "learning_rate": 8.504196625756166e-06,
+      "loss": 1.4044,
+      "step": 581
+    },
+    {
+      "epoch": 1.0679522497704317,
+      "grad_norm": 0.2587924141956031,
+      "learning_rate": 8.498947148672994e-06,
+      "loss": 1.3914,
+      "step": 582
+    },
+    {
+      "epoch": 1.0697887970615243,
+      "grad_norm": 0.24233082939060765,
+      "learning_rate": 8.493690102658703e-06,
+      "loss": 1.5213,
+      "step": 583
+    },
+    {
+      "epoch": 1.0716253443526171,
+      "grad_norm": 0.2502337234889473,
+      "learning_rate": 8.48842549908535e-06,
+      "loss": 1.3456,
+      "step": 584
+    },
+    {
+      "epoch": 1.0734618916437098,
+      "grad_norm": 0.2541968409852936,
+      "learning_rate": 8.483153349341336e-06,
+      "loss": 1.6049,
+      "step": 585
+    },
+    {
+      "epoch": 1.0752984389348026,
+      "grad_norm": 0.21627065109349963,
+      "learning_rate": 8.477873664831388e-06,
+      "loss": 1.4925,
+      "step": 586
+    },
+    {
+      "epoch": 1.0771349862258952,
+      "grad_norm": 0.22881610801325541,
+      "learning_rate": 8.472586456976534e-06,
+      "loss": 1.3223,
+      "step": 587
+    },
+    {
+      "epoch": 1.078971533516988,
+      "grad_norm": 0.24206939505346056,
+      "learning_rate": 8.467291737214078e-06,
+      "loss": 1.4918,
+      "step": 588
+    },
+    {
+      "epoch": 1.0808080808080809,
+      "grad_norm": 0.21011894651478288,
+      "learning_rate": 8.461989516997565e-06,
+      "loss": 1.3396,
+      "step": 589
+    },
+    {
+      "epoch": 1.0826446280991735,
+      "grad_norm": 0.2517596023046296,
+      "learning_rate": 8.456679807796774e-06,
+      "loss": 1.5094,
+      "step": 590
+    },
+    {
+      "epoch": 1.0844811753902663,
+      "grad_norm": 0.22719471330309043,
+      "learning_rate": 8.45136262109768e-06,
+      "loss": 1.4592,
+      "step": 591
+    },
+    {
+      "epoch": 1.086317722681359,
+      "grad_norm": 0.24930635006933696,
+      "learning_rate": 8.446037968402438e-06,
+      "loss": 1.6766,
+      "step": 592
+    },
+    {
+      "epoch": 1.0881542699724518,
+      "grad_norm": 0.21939568323560954,
+      "learning_rate": 8.440705861229344e-06,
+      "loss": 1.4538,
+      "step": 593
+    },
+    {
+      "epoch": 1.0899908172635446,
+      "grad_norm": 0.26053029521632814,
+      "learning_rate": 8.43536631111283e-06,
+      "loss": 1.3987,
+      "step": 594
+    },
+    {
+      "epoch": 1.0918273645546372,
+      "grad_norm": 0.23986894817042073,
+      "learning_rate": 8.430019329603423e-06,
+      "loss": 1.7005,
+      "step": 595
+    },
+    {
+      "epoch": 1.09366391184573,
+      "grad_norm": 0.21801456173726347,
+      "learning_rate": 8.424664928267724e-06,
+      "loss": 1.5571,
+      "step": 596
+    },
+    {
+      "epoch": 1.0955004591368227,
+      "grad_norm": 0.2893290553978988,
+      "learning_rate": 8.41930311868839e-06,
+      "loss": 1.5334,
+      "step": 597
+    },
+    {
+      "epoch": 1.0973370064279155,
+      "grad_norm": 0.24472364821129983,
+      "learning_rate": 8.4139339124641e-06,
+      "loss": 1.6033,
+      "step": 598
+    },
+    {
+      "epoch": 1.0991735537190084,
+      "grad_norm": 0.2443517137830122,
+      "learning_rate": 8.408557321209534e-06,
+      "loss": 1.5365,
+      "step": 599
+    },
+    {
+      "epoch": 1.101010101010101,
+      "grad_norm": 0.26997028267058526,
+      "learning_rate": 8.403173356555348e-06,
+      "loss": 1.5572,
+      "step": 600
+    },
+    {
+      "epoch": 1.1028466483011938,
+      "grad_norm": 0.2480886208288665,
+      "learning_rate": 8.397782030148147e-06,
+      "loss": 1.6098,
+      "step": 601
+    },
+    {
+      "epoch": 1.1046831955922864,
+      "grad_norm": 0.6782476762876417,
+      "learning_rate": 8.392383353650463e-06,
+      "loss": 1.5232,
+      "step": 602
+    },
+    {
+      "epoch": 1.1065197428833793,
+      "grad_norm": 0.2356280053432311,
+      "learning_rate": 8.386977338740724e-06,
+      "loss": 1.3312,
+      "step": 603
+    },
+    {
+      "epoch": 1.108356290174472,
+      "grad_norm": 0.24055852428031851,
+      "learning_rate": 8.381563997113235e-06,
+      "loss": 1.4306,
+      "step": 604
+    },
+    {
+      "epoch": 1.1101928374655647,
+      "grad_norm": 0.2426057612064612,
+      "learning_rate": 8.376143340478153e-06,
+      "loss": 1.6529,
+      "step": 605
+    },
+    {
+      "epoch": 1.1120293847566576,
+      "grad_norm": 0.2484194086734517,
+      "learning_rate": 8.370715380561455e-06,
+      "loss": 1.6209,
+      "step": 606
+    },
+    {
+      "epoch": 1.1138659320477502,
+      "grad_norm": 0.2091161376280446,
+      "learning_rate": 8.365280129104912e-06,
+      "loss": 1.768,
+      "step": 607
+    },
+    {
+      "epoch": 1.115702479338843,
+      "grad_norm": 0.21010090473977264,
+      "learning_rate": 8.35983759786608e-06,
+      "loss": 1.5471,
+      "step": 608
+    },
+    {
+      "epoch": 1.1175390266299357,
+      "grad_norm": 0.20654219823058445,
+      "learning_rate": 8.354387798618254e-06,
+      "loss": 1.4369,
+      "step": 609
+    },
+    {
+      "epoch": 1.1193755739210285,
+      "grad_norm": 0.21252385116315373,
+      "learning_rate": 8.348930743150453e-06,
+      "loss": 1.4925,
+      "step": 610
+    },
+    {
+      "epoch": 1.121212121212121,
+      "grad_norm": 0.23916865273973958,
+      "learning_rate": 8.34346644326739e-06,
+      "loss": 1.4318,
+      "step": 611
+    },
+    {
+      "epoch": 1.123048668503214,
+      "grad_norm": 0.2473004130028652,
+      "learning_rate": 8.337994910789457e-06,
+      "loss": 1.3704,
+      "step": 612
+    },
+    {
+      "epoch": 1.1248852157943068,
+      "grad_norm": 0.21955986794017143,
+      "learning_rate": 8.332516157552684e-06,
+      "loss": 1.6168,
+      "step": 613
+    },
+    {
+      "epoch": 1.1267217630853994,
+      "grad_norm": 0.22205609284625075,
+      "learning_rate": 8.327030195408723e-06,
+      "loss": 1.2926,
+      "step": 614
+    },
+    {
+      "epoch": 1.1285583103764922,
+      "grad_norm": 0.263864161571003,
+      "learning_rate": 8.321537036224822e-06,
+      "loss": 1.5341,
+      "step": 615
+    },
+    {
+      "epoch": 1.1303948576675849,
+      "grad_norm": 0.23516213157995472,
+      "learning_rate": 8.316036691883796e-06,
+      "loss": 1.6097,
+      "step": 616
+    },
+    {
+      "epoch": 1.1322314049586777,
+      "grad_norm": 0.24052656138833545,
+      "learning_rate": 8.310529174284004e-06,
+      "loss": 1.4662,
+      "step": 617
+    },
+    {
+      "epoch": 1.1340679522497705,
+      "grad_norm": 0.2396327813688888,
+      "learning_rate": 8.305014495339319e-06,
+      "loss": 1.5582,
+      "step": 618
+    },
+    {
+      "epoch": 1.1359044995408631,
+      "grad_norm": 0.22695869472725907,
+      "learning_rate": 8.299492666979114e-06,
+      "loss": 1.2423,
+      "step": 619
+    },
+    {
+      "epoch": 1.137741046831956,
+      "grad_norm": 0.2830556165473928,
+      "learning_rate": 8.293963701148215e-06,
+      "loss": 1.6616,
+      "step": 620
+    },
+    {
+      "epoch": 1.1395775941230486,
+      "grad_norm": 0.25128924093201527,
+      "learning_rate": 8.288427609806899e-06,
+      "loss": 1.5479,
+      "step": 621
+    },
+    {
+      "epoch": 1.1414141414141414,
+      "grad_norm": 0.23823257489910915,
+      "learning_rate": 8.282884404930852e-06,
+      "loss": 1.4531,
+      "step": 622
+    },
+    {
+      "epoch": 1.1432506887052343,
+      "grad_norm": 0.2169452673331494,
+      "learning_rate": 8.277334098511147e-06,
+      "loss": 1.4788,
+      "step": 623
+    },
+    {
+      "epoch": 1.145087235996327,
+      "grad_norm": 0.2905961317813161,
+      "learning_rate": 8.271776702554221e-06,
+      "loss": 1.5503,
+      "step": 624
+    },
+    {
+      "epoch": 1.1469237832874197,
+      "grad_norm": 0.2440714857888354,
+      "learning_rate": 8.266212229081846e-06,
+      "loss": 1.4501,
+      "step": 625
+    },
+    {
+      "epoch": 1.1487603305785123,
+      "grad_norm": 0.213213589804518,
+      "learning_rate": 8.260640690131108e-06,
+      "loss": 1.4492,
+      "step": 626
+    },
+    {
+      "epoch": 1.1505968778696052,
+      "grad_norm": 0.23437161712673651,
+      "learning_rate": 8.255062097754371e-06,
+      "loss": 1.5111,
+      "step": 627
+    },
+    {
+      "epoch": 1.1524334251606978,
+      "grad_norm": 0.20618402331394328,
+      "learning_rate": 8.249476464019259e-06,
+      "loss": 1.5325,
+      "step": 628
+    },
+    {
+      "epoch": 1.1542699724517906,
+      "grad_norm": 0.22659823180486846,
+      "learning_rate": 8.243883801008632e-06,
+      "loss": 1.4732,
+      "step": 629
+    },
+    {
+      "epoch": 1.1561065197428835,
+      "grad_norm": 0.5998677861802245,
+      "learning_rate": 8.238284120820549e-06,
+      "loss": 1.5377,
+      "step": 630
+    },
+    {
+      "epoch": 1.157943067033976,
+      "grad_norm": 0.2698674524108185,
+      "learning_rate": 8.232677435568252e-06,
+      "loss": 1.4979,
+      "step": 631
+    },
+    {
+      "epoch": 1.159779614325069,
+      "grad_norm": 0.20529816428658398,
+      "learning_rate": 8.227063757380141e-06,
+      "loss": 1.4952,
+      "step": 632
+    },
+    {
+      "epoch": 1.1616161616161615,
+      "grad_norm": 0.2273780867927969,
+      "learning_rate": 8.221443098399733e-06,
+      "loss": 1.6565,
+      "step": 633
+    },
+    {
+      "epoch": 1.1634527089072544,
+      "grad_norm": 0.24433874393165086,
+      "learning_rate": 8.215815470785655e-06,
+      "loss": 1.5764,
+      "step": 634
+    },
+    {
+      "epoch": 1.165289256198347,
+      "grad_norm": 0.2856532742091204,
+      "learning_rate": 8.210180886711603e-06,
+      "loss": 1.4408,
+      "step": 635
+    },
+    {
+      "epoch": 1.1671258034894398,
+      "grad_norm": 0.24118846977617991,
+      "learning_rate": 8.204539358366325e-06,
+      "loss": 1.601,
+      "step": 636
+    },
+    {
+      "epoch": 1.1689623507805327,
+      "grad_norm": 0.20626688664328777,
+      "learning_rate": 8.198890897953586e-06,
+      "loss": 1.8095,
+      "step": 637
+    },
+    {
+      "epoch": 1.1707988980716253,
+      "grad_norm": 0.6284004866056194,
+      "learning_rate": 8.193235517692154e-06,
+      "loss": 1.4371,
+      "step": 638
+    },
+    {
+      "epoch": 1.1726354453627181,
+      "grad_norm": 0.23853353758157897,
+      "learning_rate": 8.187573229815757e-06,
+      "loss": 1.4212,
+      "step": 639
+    },
+    {
+      "epoch": 1.1744719926538107,
+      "grad_norm": 0.2879866157971752,
+      "learning_rate": 8.181904046573075e-06,
+      "loss": 1.7247,
+      "step": 640
+    },
+    {
+      "epoch": 1.1763085399449036,
+      "grad_norm": 0.24339771945291888,
+      "learning_rate": 8.176227980227693e-06,
+      "loss": 1.4935,
+      "step": 641
+    },
+    {
+      "epoch": 1.1781450872359964,
+      "grad_norm": 0.23124975641952975,
+      "learning_rate": 8.170545043058097e-06,
+      "loss": 1.5613,
+      "step": 642
+    },
+    {
+      "epoch": 1.179981634527089,
+      "grad_norm": 0.21189387531914136,
+      "learning_rate": 8.164855247357628e-06,
+      "loss": 1.5664,
+      "step": 643
+    },
+    {
+      "epoch": 1.1818181818181819,
+      "grad_norm": 0.24171564426205538,
+      "learning_rate": 8.159158605434468e-06,
+      "loss": 1.5857,
+      "step": 644
+    },
+    {
+      "epoch": 1.1836547291092745,
+      "grad_norm": 0.5762435233520594,
+      "learning_rate": 8.153455129611605e-06,
+      "loss": 1.5551,
+      "step": 645
+    },
+    {
+      "epoch": 1.1854912764003673,
+      "grad_norm": 0.24567321845709728,
+      "learning_rate": 8.147744832226815e-06,
+      "loss": 1.6507,
+      "step": 646
+    },
+    {
+      "epoch": 1.1873278236914602,
+      "grad_norm": 0.2058397175376501,
+      "learning_rate": 8.142027725632622e-06,
+      "loss": 1.67,
+      "step": 647
+    },
+    {
+      "epoch": 1.1891643709825528,
+      "grad_norm": 0.23921899423672816,
+      "learning_rate": 8.136303822196291e-06,
+      "loss": 1.3641,
+      "step": 648
+    },
+    {
+      "epoch": 1.1910009182736456,
+      "grad_norm": 0.30231315345826854,
+      "learning_rate": 8.130573134299782e-06,
+      "loss": 1.3477,
+      "step": 649
+    },
+    {
+      "epoch": 1.1928374655647382,
+      "grad_norm": 0.22560319938066786,
+      "learning_rate": 8.12483567433973e-06,
+      "loss": 1.5749,
+      "step": 650
+    },
+    {
+      "epoch": 1.194674012855831,
+      "grad_norm": 0.23140551991013897,
+      "learning_rate": 8.119091454727427e-06,
+      "loss": 1.5127,
+      "step": 651
+    },
+    {
+      "epoch": 1.1965105601469237,
+      "grad_norm": 0.2513575348384973,
+      "learning_rate": 8.11334048788878e-06,
+      "loss": 1.4975,
+      "step": 652
+    },
+    {
+      "epoch": 1.1983471074380165,
+      "grad_norm": 0.2327532164827635,
+      "learning_rate": 8.107582786264299e-06,
+      "loss": 1.6873,
+      "step": 653
+    },
+    {
+      "epoch": 1.2001836547291092,
+      "grad_norm": 0.22482575564896123,
+      "learning_rate": 8.101818362309051e-06,
+      "loss": 1.4014,
+      "step": 654
+    },
+    {
+      "epoch": 1.202020202020202,
+      "grad_norm": 0.24529386319059354,
+      "learning_rate": 8.09604722849266e-06,
+      "loss": 1.6443,
+      "step": 655
+    },
+    {
+      "epoch": 1.2038567493112948,
+      "grad_norm": 0.22687654727578463,
+      "learning_rate": 8.09026939729925e-06,
+      "loss": 1.6704,
+      "step": 656
+    },
+    {
+      "epoch": 1.2056932966023874,
+      "grad_norm": 0.208268755246811,
+      "learning_rate": 8.084484881227449e-06,
+      "loss": 1.5679,
+      "step": 657
+    },
+    {
+      "epoch": 1.2075298438934803,
+      "grad_norm": 0.21310630774681036,
+      "learning_rate": 8.078693692790325e-06,
+      "loss": 1.4717,
+      "step": 658
+    },
+    {
+      "epoch": 1.209366391184573,
+      "grad_norm": 0.22105695777423623,
+      "learning_rate": 8.072895844515398e-06,
+      "loss": 1.6775,
+      "step": 659
+    },
+    {
+      "epoch": 1.2112029384756657,
+      "grad_norm": 0.25921274981827536,
+      "learning_rate": 8.067091348944587e-06,
+      "loss": 1.6739,
+      "step": 660
+    },
+    {
+      "epoch": 1.2130394857667586,
+      "grad_norm": 0.23273938553415982,
+      "learning_rate": 8.061280218634192e-06,
+      "loss": 1.6909,
+      "step": 661
+    },
+    {
+      "epoch": 1.2148760330578512,
+      "grad_norm": 0.28515248987807656,
+      "learning_rate": 8.055462466154862e-06,
+      "loss": 1.2906,
+      "step": 662
+    },
+    {
+      "epoch": 1.216712580348944,
+      "grad_norm": 0.22585050251167946,
+      "learning_rate": 8.049638104091575e-06,
+      "loss": 1.5408,
+      "step": 663
+    },
+    {
+      "epoch": 1.2185491276400366,
+      "grad_norm": 0.25027308334051257,
+      "learning_rate": 8.043807145043604e-06,
+      "loss": 1.4935,
+      "step": 664
+    },
+    {
+      "epoch": 1.2203856749311295,
+      "grad_norm": 0.2488600429795027,
+      "learning_rate": 8.037969601624495e-06,
+      "loss": 1.6285,
+      "step": 665
+    },
+    {
+      "epoch": 1.2222222222222223,
+      "grad_norm": 0.2326483163361331,
+      "learning_rate": 8.032125486462037e-06,
+      "loss": 1.6027,
+      "step": 666
+    },
+    {
+      "epoch": 1.224058769513315,
+      "grad_norm": 0.3031224549473356,
+      "learning_rate": 8.026274812198235e-06,
+      "loss": 1.5161,
+      "step": 667
+    },
+    {
+      "epoch": 1.2258953168044078,
+      "grad_norm": 0.2327369128693008,
+      "learning_rate": 8.020417591489279e-06,
+      "loss": 1.4811,
+      "step": 668
+    },
+    {
+      "epoch": 1.2277318640955004,
+      "grad_norm": 0.2729819241312185,
+      "learning_rate": 8.014553837005527e-06,
+      "loss": 1.4844,
+      "step": 669
+    },
+    {
+      "epoch": 1.2295684113865932,
+      "grad_norm": 0.25673382776635867,
+      "learning_rate": 8.008683561431463e-06,
+      "loss": 1.5585,
+      "step": 670
+    },
+    {
+      "epoch": 1.231404958677686,
+      "grad_norm": 0.2633879747502126,
+      "learning_rate": 8.002806777465685e-06,
+      "loss": 1.3361,
+      "step": 671
+    },
+    {
+      "epoch": 1.2332415059687787,
+      "grad_norm": 0.4185330332994026,
+      "learning_rate": 7.996923497820866e-06,
+      "loss": 1.6391,
+      "step": 672
+    },
+    {
+      "epoch": 1.2350780532598715,
+      "grad_norm": 0.22369971333997035,
+      "learning_rate": 7.99103373522373e-06,
+      "loss": 1.7274,
+      "step": 673
+    },
+    {
+      "epoch": 1.2369146005509641,
+      "grad_norm": 0.24044282161090655,
+      "learning_rate": 7.985137502415027e-06,
+      "loss": 1.4211,
+      "step": 674
+    },
+    {
+      "epoch": 1.238751147842057,
+      "grad_norm": 0.2935202034100143,
+      "learning_rate": 7.9792348121495e-06,
+      "loss": 1.2459,
+      "step": 675
+    },
+    {
+      "epoch": 1.2405876951331496,
+      "grad_norm": 0.22157832211839776,
+      "learning_rate": 7.973325677195869e-06,
+      "loss": 1.4539,
+      "step": 676
+    },
+    {
+      "epoch": 1.2424242424242424,
+      "grad_norm": 0.24668465392267197,
+      "learning_rate": 7.967410110336782e-06,
+      "loss": 1.4469,
+      "step": 677
+    },
+    {
+      "epoch": 1.244260789715335,
+      "grad_norm": 0.2555940790799855,
+      "learning_rate": 7.961488124368813e-06,
+      "loss": 1.5601,
+      "step": 678
+    },
+    {
+      "epoch": 1.2460973370064279,
+      "grad_norm": 0.23036945990648297,
+      "learning_rate": 7.955559732102414e-06,
+      "loss": 1.3647,
+      "step": 679
+    },
+    {
+      "epoch": 1.2479338842975207,
+      "grad_norm": 0.20887737266237028,
+      "learning_rate": 7.9496249463619e-06,
+      "loss": 1.4313,
+      "step": 680
+    },
+    {
+      "epoch": 1.2479338842975207,
+      "eval_loss": 2.2916746139526367,
+      "eval_runtime": 38.5791,
+      "eval_samples_per_second": 5.314,
+      "eval_steps_per_second": 0.467,
+      "step": 680
+    },
+    {
+      "epoch": 1.2497704315886133,
+      "grad_norm": 0.28511804221730047,
+      "learning_rate": 7.943683779985412e-06,
+      "loss": 1.6532,
+      "step": 681
+    },
+    {
+      "epoch": 1.2516069788797062,
+      "grad_norm": 0.28040352247728734,
+      "learning_rate": 7.937736245824898e-06,
+      "loss": 1.4731,
+      "step": 682
+    },
+    {
+      "epoch": 1.2534435261707988,
+      "grad_norm": 0.2506655959884705,
+      "learning_rate": 7.931782356746076e-06,
+      "loss": 1.4813,
+      "step": 683
+    },
+    {
+      "epoch": 1.2552800734618916,
+      "grad_norm": 0.24609807077855472,
+      "learning_rate": 7.925822125628415e-06,
+      "loss": 1.6422,
+      "step": 684
+    },
+    {
+      "epoch": 1.2571166207529845,
+      "grad_norm": 0.2679826355117991,
+      "learning_rate": 7.919855565365102e-06,
+      "loss": 1.4304,
+      "step": 685
+    },
+    {
+      "epoch": 1.258953168044077,
+      "grad_norm": 0.2136139959253996,
+      "learning_rate": 7.913882688863015e-06,
+      "loss": 1.4723,
+      "step": 686
+    },
+    {
+      "epoch": 1.26078971533517,
+      "grad_norm": 0.21181884838242626,
+      "learning_rate": 7.907903509042696e-06,
+      "loss": 1.428,
+      "step": 687
+    },
+    {
+      "epoch": 1.2626262626262625,
+      "grad_norm": 0.23531366813436308,
+      "learning_rate": 7.901918038838318e-06,
+      "loss": 1.3371,
+      "step": 688
+    },
+    {
+      "epoch": 1.2644628099173554,
+      "grad_norm": 0.24164865702276508,
+      "learning_rate": 7.895926291197667e-06,
+      "loss": 1.7756,
+      "step": 689
+    },
+    {
+      "epoch": 1.2662993572084482,
+      "grad_norm": 0.21062389569023543,
+      "learning_rate": 7.889928279082108e-06,
+      "loss": 1.3927,
+      "step": 690
+    },
+    {
+      "epoch": 1.2681359044995408,
+      "grad_norm": 0.2074000186711054,
+      "learning_rate": 7.883924015466554e-06,
+      "loss": 1.484,
+      "step": 691
+    },
+    {
+      "epoch": 1.2699724517906337,
+      "grad_norm": 0.2387562365554438,
+      "learning_rate": 7.877913513339444e-06,
+      "loss": 1.5137,
+      "step": 692
+    },
+    {
+      "epoch": 1.2718089990817263,
+      "grad_norm": 0.516662377477242,
+      "learning_rate": 7.871896785702707e-06,
+      "loss": 1.4716,
+      "step": 693
+    },
+    {
+      "epoch": 1.2736455463728191,
+      "grad_norm": 0.2397429749697421,
+      "learning_rate": 7.86587384557175e-06,
+      "loss": 1.4607,
+      "step": 694
+    },
+    {
+      "epoch": 1.275482093663912,
+      "grad_norm": 0.24982714799055714,
+      "learning_rate": 7.859844705975405e-06,
+      "loss": 1.3678,
+      "step": 695
+    },
+    {
+      "epoch": 1.2773186409550046,
+      "grad_norm": 0.24213016325923115,
+      "learning_rate": 7.853809379955926e-06,
+      "loss": 1.5956,
+      "step": 696
+    },
+    {
+      "epoch": 1.2791551882460974,
+      "grad_norm": 0.5032455281053377,
+      "learning_rate": 7.847767880568944e-06,
+      "loss": 1.5566,
+      "step": 697
+    },
+    {
+      "epoch": 1.28099173553719,
+      "grad_norm": 0.2619847914674294,
+      "learning_rate": 7.841720220883446e-06,
+      "loss": 1.4272,
+      "step": 698
+    },
+    {
+      "epoch": 1.2828282828282829,
+      "grad_norm": 0.24860484103037345,
+      "learning_rate": 7.835666413981744e-06,
+      "loss": 1.5111,
+      "step": 699
+    },
+    {
+      "epoch": 1.2846648301193757,
+      "grad_norm": 0.22131497360679758,
+      "learning_rate": 7.829606472959445e-06,
+      "loss": 1.6785,
+      "step": 700
+    },
+    {
+      "epoch": 1.2865013774104683,
+      "grad_norm": 0.22543726289551383,
+      "learning_rate": 7.823540410925434e-06,
+      "loss": 1.4734,
+      "step": 701
+    },
+    {
+      "epoch": 1.288337924701561,
+      "grad_norm": 0.2445382639920126,
+      "learning_rate": 7.81746824100183e-06,
+      "loss": 1.374,
+      "step": 702
+    },
+    {
+      "epoch": 1.2901744719926538,
+      "grad_norm": 0.22310896972898842,
+      "learning_rate": 7.811389976323963e-06,
+      "loss": 1.6159,
+      "step": 703
+    },
+    {
+      "epoch": 1.2920110192837466,
+      "grad_norm": 0.2480657407835977,
+      "learning_rate": 7.80530563004035e-06,
+      "loss": 1.6499,
+      "step": 704
+    },
+    {
+      "epoch": 1.2938475665748392,
+      "grad_norm": 0.26277048171510314,
+      "learning_rate": 7.799215215312667e-06,
+      "loss": 1.6124,
+      "step": 705
+    },
+    {
+      "epoch": 1.295684113865932,
+      "grad_norm": 0.24829226079425715,
+      "learning_rate": 7.793118745315713e-06,
+      "loss": 1.5359,
+      "step": 706
+    },
+    {
+      "epoch": 1.2975206611570247,
+      "grad_norm": 0.2792056287076263,
+      "learning_rate": 7.787016233237387e-06,
+      "loss": 1.4507,
+      "step": 707
+    },
+    {
+      "epoch": 1.2993572084481175,
+      "grad_norm": 0.23333586007805976,
+      "learning_rate": 7.780907692278657e-06,
+      "loss": 1.5978,
+      "step": 708
+    },
+    {
+      "epoch": 1.3011937557392104,
+      "grad_norm": 0.232312920030107,
+      "learning_rate": 7.774793135653537e-06,
+      "loss": 1.5415,
+      "step": 709
+    },
+    {
+      "epoch": 1.303030303030303,
+      "grad_norm": 0.3527876369018892,
+      "learning_rate": 7.768672576589046e-06,
+      "loss": 1.492,
+      "step": 710
+    },
+    {
+      "epoch": 1.3048668503213958,
+      "grad_norm": 0.22483173449652616,
+      "learning_rate": 7.7625460283252e-06,
+      "loss": 1.5673,
+      "step": 711
+    },
+    {
+      "epoch": 1.3067033976124884,
+      "grad_norm": 0.22545586469260495,
+      "learning_rate": 7.756413504114955e-06,
+      "loss": 1.4843,
+      "step": 712
+    },
+    {
+      "epoch": 1.3085399449035813,
+      "grad_norm": 0.21610719172730797,
+      "learning_rate": 7.750275017224208e-06,
+      "loss": 1.4673,
+      "step": 713
+    },
+    {
+      "epoch": 1.3103764921946741,
+      "grad_norm": 0.23308407573698572,
+      "learning_rate": 7.744130580931746e-06,
+      "loss": 1.598,
+      "step": 714
+    },
+    {
+      "epoch": 1.3122130394857667,
+      "grad_norm": 0.3081156550370704,
+      "learning_rate": 7.737980208529232e-06,
+      "loss": 1.7712,
+      "step": 715
+    },
+    {
+      "epoch": 1.3140495867768596,
+      "grad_norm": 0.2277299881607153,
+      "learning_rate": 7.731823913321162e-06,
+      "loss": 1.5439,
+      "step": 716
+    },
+    {
+      "epoch": 1.3158861340679522,
+      "grad_norm": 0.2261790457696541,
+      "learning_rate": 7.725661708624855e-06,
+      "loss": 1.4424,
+      "step": 717
+    },
+    {
+      "epoch": 1.317722681359045,
+      "grad_norm": 0.2237354785201151,
+      "learning_rate": 7.719493607770402e-06,
+      "loss": 1.3813,
+      "step": 718
+    },
+    {
+      "epoch": 1.3195592286501379,
+      "grad_norm": 0.2471817629434866,
+      "learning_rate": 7.713319624100657e-06,
+      "loss": 1.3034,
+      "step": 719
+    },
+    {
+      "epoch": 1.3213957759412305,
+      "grad_norm": 0.3035039372001864,
+      "learning_rate": 7.707139770971196e-06,
+      "loss": 1.6639,
+      "step": 720
+    },
+    {
+      "epoch": 1.3232323232323233,
+      "grad_norm": 0.2091045117588451,
+      "learning_rate": 7.700954061750295e-06,
+      "loss": 1.6283,
+      "step": 721
+    },
+    {
+      "epoch": 1.325068870523416,
+      "grad_norm": 0.21999656684817168,
+      "learning_rate": 7.69476250981889e-06,
+      "loss": 1.6883,
+      "step": 722
+    },
+    {
+      "epoch": 1.3269054178145088,
+      "grad_norm": 0.22296688905927023,
+      "learning_rate": 7.688565128570564e-06,
+      "loss": 1.2859,
+      "step": 723
+    },
+    {
+      "epoch": 1.3287419651056016,
+      "grad_norm": 0.29298559189022394,
+      "learning_rate": 7.682361931411511e-06,
+      "loss": 1.4206,
+      "step": 724
+    },
+    {
+      "epoch": 1.3305785123966942,
+      "grad_norm": 0.2372201100489932,
+      "learning_rate": 7.676152931760496e-06,
+      "loss": 1.4129,
+      "step": 725
+    },
+    {
+      "epoch": 1.3324150596877868,
+      "grad_norm": 0.24453486585164116,
+      "learning_rate": 7.66993814304885e-06,
+      "loss": 1.4764,
+      "step": 726
+    },
+    {
+      "epoch": 1.3342516069788797,
+      "grad_norm": 0.2429372306381853,
+      "learning_rate": 7.663717578720412e-06,
+      "loss": 1.439,
+      "step": 727
+    },
+    {
+      "epoch": 1.3360881542699725,
+      "grad_norm": 0.2816987421723553,
+      "learning_rate": 7.657491252231525e-06,
+      "loss": 1.3778,
+      "step": 728
+    },
+    {
+      "epoch": 1.3379247015610651,
+      "grad_norm": 0.25580047908874903,
+      "learning_rate": 7.651259177050996e-06,
+      "loss": 1.4052,
+      "step": 729
+    },
+    {
+      "epoch": 1.339761248852158,
+      "grad_norm": 0.2510332954403161,
+      "learning_rate": 7.645021366660063e-06,
+      "loss": 1.2693,
+      "step": 730
+    },
+    {
+      "epoch": 1.3415977961432506,
+      "grad_norm": 0.2538337398976697,
+      "learning_rate": 7.638777834552372e-06,
+      "loss": 1.6005,
+      "step": 731
+    },
+    {
+      "epoch": 1.3434343434343434,
+      "grad_norm": 0.21284374524917304,
+      "learning_rate": 7.632528594233948e-06,
+      "loss": 1.5806,
+      "step": 732
+    },
+    {
+      "epoch": 1.3452708907254363,
+      "grad_norm": 0.2900240672988352,
+      "learning_rate": 7.626273659223166e-06,
+      "loss": 1.3743,
+      "step": 733
+    },
+    {
+      "epoch": 1.3471074380165289,
+      "grad_norm": 0.211923591929452,
+      "learning_rate": 7.620013043050713e-06,
+      "loss": 1.4109,
+      "step": 734
+    },
+    {
+      "epoch": 1.3489439853076217,
+      "grad_norm": 0.23819471628055552,
+      "learning_rate": 7.61374675925957e-06,
+      "loss": 1.5683,
+      "step": 735
+    },
+    {
+      "epoch": 1.3507805325987143,
+      "grad_norm": 0.22267648817304916,
+      "learning_rate": 7.607474821404981e-06,
+      "loss": 1.5718,
+      "step": 736
+    },
+    {
+      "epoch": 1.3526170798898072,
+      "grad_norm": 0.20897528565945356,
+      "learning_rate": 7.601197243054411e-06,
+      "loss": 1.5803,
+      "step": 737
+    },
+    {
+      "epoch": 1.3544536271809,
+      "grad_norm": 0.23836237710000147,
+      "learning_rate": 7.59491403778754e-06,
+      "loss": 1.6094,
+      "step": 738
+    },
+    {
+      "epoch": 1.3562901744719926,
+      "grad_norm": 0.21379466003351494,
+      "learning_rate": 7.588625219196208e-06,
+      "loss": 1.6618,
+      "step": 739
+    },
+    {
+      "epoch": 1.3581267217630855,
+      "grad_norm": 0.21583132750196843,
+      "learning_rate": 7.582330800884405e-06,
+      "loss": 1.6781,
+      "step": 740
+    },
+    {
+      "epoch": 1.359963269054178,
+      "grad_norm": 0.26758972397704306,
+      "learning_rate": 7.576030796468233e-06,
+      "loss": 1.4949,
+      "step": 741
+    },
+    {
+      "epoch": 1.361799816345271,
+      "grad_norm": 0.2172026210777453,
+      "learning_rate": 7.569725219575877e-06,
+      "loss": 1.3427,
+      "step": 742
+    },
+    {
+      "epoch": 1.3636363636363638,
+      "grad_norm": 0.26283840849216944,
+      "learning_rate": 7.563414083847573e-06,
+      "loss": 1.5264,
+      "step": 743
+    },
+    {
+      "epoch": 1.3654729109274564,
+      "grad_norm": 0.2699008470427587,
+      "learning_rate": 7.557097402935592e-06,
+      "loss": 1.6242,
+      "step": 744
+    },
+    {
+      "epoch": 1.367309458218549,
+      "grad_norm": 0.22341256290864062,
+      "learning_rate": 7.5507751905041885e-06,
+      "loss": 1.5183,
+      "step": 745
+    },
+    {
+      "epoch": 1.3691460055096418,
+      "grad_norm": 0.29886287460973576,
+      "learning_rate": 7.544447460229587e-06,
+      "loss": 1.4214,
+      "step": 746
+    },
+    {
+      "epoch": 1.3709825528007347,
+      "grad_norm": 0.30173645884694444,
+      "learning_rate": 7.538114225799955e-06,
+      "loss": 1.6159,
+      "step": 747
+    },
+    {
+      "epoch": 1.3728191000918273,
+      "grad_norm": 0.236212235821713,
+      "learning_rate": 7.531775500915357e-06,
+      "loss": 1.6939,
+      "step": 748
+    },
+    {
+      "epoch": 1.3746556473829201,
+      "grad_norm": 0.27558934861916207,
+      "learning_rate": 7.525431299287737e-06,
+      "loss": 1.6312,
+      "step": 749
+    },
+    {
+      "epoch": 1.3764921946740127,
+      "grad_norm": 0.21133929879138727,
+      "learning_rate": 7.519081634640891e-06,
+      "loss": 1.6883,
+      "step": 750
+    },
+    {
+      "epoch": 1.3783287419651056,
+      "grad_norm": 0.27270482697444587,
+      "learning_rate": 7.512726520710429e-06,
+      "loss": 1.436,
+      "step": 751
+    },
+    {
+      "epoch": 1.3801652892561984,
+      "grad_norm": 0.22422109696434905,
+      "learning_rate": 7.506365971243746e-06,
+      "loss": 1.5348,
+      "step": 752
+    },
+    {
+      "epoch": 1.382001836547291,
+      "grad_norm": 0.2411464169416929,
+      "learning_rate": 7.500000000000001e-06,
+      "loss": 1.2626,
+      "step": 753
+    },
+    {
+      "epoch": 1.3838383838383839,
+      "grad_norm": 0.21994274170001296,
+      "learning_rate": 7.493628620750077e-06,
+      "loss": 1.6835,
+      "step": 754
+    },
+    {
+      "epoch": 1.3856749311294765,
+      "grad_norm": 0.22298996950590438,
+      "learning_rate": 7.4872518472765594e-06,
+      "loss": 1.5464,
+      "step": 755
+    },
+    {
+      "epoch": 1.3875114784205693,
+      "grad_norm": 0.23997347026368712,
+      "learning_rate": 7.4808696933737e-06,
+      "loss": 1.4657,
+      "step": 756
+    },
+    {
+      "epoch": 1.3893480257116622,
+      "grad_norm": 0.23630438290502187,
+      "learning_rate": 7.474482172847391e-06,
+      "loss": 1.418,
+      "step": 757
+    },
+    {
+      "epoch": 1.3911845730027548,
+      "grad_norm": 0.25966655230420865,
+      "learning_rate": 7.4680892995151264e-06,
+      "loss": 1.5673,
+      "step": 758
+    },
+    {
+      "epoch": 1.3930211202938476,
+      "grad_norm": 0.2325283451835453,
+      "learning_rate": 7.461691087205993e-06,
+      "loss": 1.4393,
+      "step": 759
+    },
+    {
+      "epoch": 1.3948576675849402,
+      "grad_norm": 0.21802842523556412,
+      "learning_rate": 7.4552875497606145e-06,
+      "loss": 1.3584,
+      "step": 760
+    },
+    {
+      "epoch": 1.396694214876033,
+      "grad_norm": 0.20229431369606604,
+      "learning_rate": 7.4488787010311425e-06,
+      "loss": 1.4294,
+      "step": 761
+    },
+    {
+      "epoch": 1.398530762167126,
+      "grad_norm": 0.2351243430924033,
+      "learning_rate": 7.442464554881213e-06,
+      "loss": 1.5712,
+      "step": 762
+    },
+    {
+      "epoch": 1.4003673094582185,
+      "grad_norm": 0.23000822536409413,
+      "learning_rate": 7.436045125185923e-06,
+      "loss": 1.6317,
+      "step": 763
+    },
+    {
+      "epoch": 1.4022038567493114,
+      "grad_norm": 0.23883309786560977,
+      "learning_rate": 7.429620425831795e-06,
+      "loss": 1.3215,
+      "step": 764
+    },
+    {
+      "epoch": 1.404040404040404,
+      "grad_norm": 0.22881088145004524,
+      "learning_rate": 7.423190470716761e-06,
+      "loss": 1.4168,
+      "step": 765
+    },
+    {
+      "epoch": 1.4058769513314968,
+      "grad_norm": 0.2834968472773536,
+      "learning_rate": 7.416755273750112e-06,
+      "loss": 1.5954,
+      "step": 766
+    },
+    {
+      "epoch": 1.4077134986225897,
+      "grad_norm": 0.2398048082352695,
+      "learning_rate": 7.4103148488524824e-06,
+      "loss": 1.6907,
+      "step": 767
+    },
+    {
+      "epoch": 1.4095500459136823,
+      "grad_norm": 0.21682770246574481,
+      "learning_rate": 7.403869209955814e-06,
+      "loss": 1.8173,
+      "step": 768
+    },
+    {
+      "epoch": 1.4113865932047749,
+      "grad_norm": 0.23796700613883842,
+      "learning_rate": 7.3974183710033334e-06,
+      "loss": 1.4551,
+      "step": 769
+    },
+    {
+      "epoch": 1.4132231404958677,
+      "grad_norm": 0.21064249534142893,
+      "learning_rate": 7.390962345949506e-06,
+      "loss": 1.273,
+      "step": 770
+    },
+    {
+      "epoch": 1.4150596877869606,
+      "grad_norm": 0.24453714591564318,
+      "learning_rate": 7.384501148760024e-06,
+      "loss": 1.6789,
+      "step": 771
+    },
+    {
+      "epoch": 1.4168962350780532,
+      "grad_norm": 0.25495278331832055,
+      "learning_rate": 7.3780347934117646e-06,
+      "loss": 1.6647,
+      "step": 772
+    },
+    {
+      "epoch": 1.418732782369146,
+      "grad_norm": 0.22716103674772303,
+      "learning_rate": 7.371563293892761e-06,
+      "loss": 1.4259,
+      "step": 773
+    },
+    {
+      "epoch": 1.4205693296602386,
+      "grad_norm": 0.2778893615716731,
+      "learning_rate": 7.365086664202183e-06,
+      "loss": 1.5771,
+      "step": 774
+    },
+    {
+      "epoch": 1.4224058769513315,
+      "grad_norm": 0.21461080054346077,
+      "learning_rate": 7.3586049183502875e-06,
+      "loss": 1.6258,
+      "step": 775
+    },
+    {
+      "epoch": 1.4242424242424243,
+      "grad_norm": 0.2376542090826269,
+      "learning_rate": 7.3521180703584025e-06,
+      "loss": 1.6032,
+      "step": 776
+    },
+    {
+      "epoch": 1.426078971533517,
+      "grad_norm": 0.2281816677205824,
+      "learning_rate": 7.345626134258897e-06,
+      "loss": 1.5994,
+      "step": 777
+    },
+    {
+      "epoch": 1.4279155188246098,
+      "grad_norm": 0.2364780239575377,
+      "learning_rate": 7.339129124095141e-06,
+      "loss": 1.5055,
+      "step": 778
+    },
+    {
+      "epoch": 1.4297520661157024,
+      "grad_norm": 0.23009999576259169,
+      "learning_rate": 7.3326270539214826e-06,
+      "loss": 1.597,
+      "step": 779
+    },
+    {
+      "epoch": 1.4315886134067952,
+      "grad_norm": 0.29716639871417605,
+      "learning_rate": 7.326119937803219e-06,
+      "loss": 1.4146,
+      "step": 780
+    },
+    {
+      "epoch": 1.433425160697888,
+      "grad_norm": 0.23733262947356001,
+      "learning_rate": 7.319607789816555e-06,
+      "loss": 1.4938,
+      "step": 781
+    },
+    {
+      "epoch": 1.4352617079889807,
+      "grad_norm": 0.261287890785371,
+      "learning_rate": 7.3130906240485886e-06,
+      "loss": 1.4872,
+      "step": 782
+    },
+    {
+      "epoch": 1.4370982552800735,
+      "grad_norm": 0.19719689520430514,
+      "learning_rate": 7.306568454597269e-06,
+      "loss": 1.4053,
+      "step": 783
+    },
+    {
+      "epoch": 1.4389348025711661,
+      "grad_norm": 0.26516505212824587,
+      "learning_rate": 7.3000412955713694e-06,
+      "loss": 1.6561,
+      "step": 784
+    },
+    {
+      "epoch": 1.440771349862259,
+      "grad_norm": 0.21033165114887953,
+      "learning_rate": 7.293509161090453e-06,
+      "loss": 1.4114,
+      "step": 785
+    },
+    {
+      "epoch": 1.4426078971533518,
+      "grad_norm": 0.23433797165794368,
+      "learning_rate": 7.286972065284854e-06,
+      "loss": 1.4791,
+      "step": 786
+    },
+    {
+      "epoch": 1.4444444444444444,
+      "grad_norm": 0.22419929718237094,
+      "learning_rate": 7.28043002229563e-06,
+      "loss": 1.6343,
+      "step": 787
+    },
+    {
+      "epoch": 1.4462809917355373,
+      "grad_norm": 0.24907933840327323,
+      "learning_rate": 7.273883046274547e-06,
+      "loss": 1.2378,
+      "step": 788
+    },
+    {
+      "epoch": 1.4481175390266299,
+      "grad_norm": 0.4238360648529547,
+      "learning_rate": 7.2673311513840395e-06,
+      "loss": 1.5069,
+      "step": 789
+    },
+    {
+      "epoch": 1.4499540863177227,
+      "grad_norm": 0.2662432650528045,
+      "learning_rate": 7.260774351797183e-06,
+      "loss": 1.7745,
+      "step": 790
+    },
+    {
+      "epoch": 1.4517906336088156,
+      "grad_norm": 0.20673042637363245,
+      "learning_rate": 7.2542126616976596e-06,
+      "loss": 1.4525,
+      "step": 791
+    },
+    {
+      "epoch": 1.4536271808999082,
+      "grad_norm": 0.21420686611771902,
+      "learning_rate": 7.247646095279738e-06,
+      "loss": 1.7167,
+      "step": 792
+    },
+    {
+      "epoch": 1.4554637281910008,
+      "grad_norm": 0.23017808194322006,
+      "learning_rate": 7.241074666748228e-06,
+      "loss": 1.4619,
+      "step": 793
+    },
+    {
+      "epoch": 1.4573002754820936,
+      "grad_norm": 0.26604136306841353,
+      "learning_rate": 7.234498390318461e-06,
+      "loss": 1.568,
+      "step": 794
+    },
+    {
+      "epoch": 1.4591368227731865,
+      "grad_norm": 0.22179140301277936,
+      "learning_rate": 7.227917280216254e-06,
+      "loss": 1.462,
+      "step": 795
+    },
+    {
+      "epoch": 1.460973370064279,
+      "grad_norm": 0.24198533262458394,
+      "learning_rate": 7.2213313506778815e-06,
+      "loss": 1.554,
+      "step": 796
+    },
+    {
+      "epoch": 1.462809917355372,
+      "grad_norm": 0.23659697045516584,
+      "learning_rate": 7.214740615950041e-06,
+      "loss": 1.3295,
+      "step": 797
+    },
+    {
+      "epoch": 1.4646464646464645,
+      "grad_norm": 0.24078632801408795,
+      "learning_rate": 7.208145090289828e-06,
+      "loss": 1.6444,
+      "step": 798
+    },
+    {
+      "epoch": 1.4664830119375574,
+      "grad_norm": 0.27618370077665483,
+      "learning_rate": 7.201544787964698e-06,
+      "loss": 1.7188,
+      "step": 799
+    },
+    {
+      "epoch": 1.4683195592286502,
+      "grad_norm": 0.2260553812482853,
+      "learning_rate": 7.194939723252442e-06,
+      "loss": 1.7874,
+      "step": 800
+    },
+    {
+      "epoch": 1.4701561065197428,
+      "grad_norm": 0.23624090344081144,
+      "learning_rate": 7.188329910441154e-06,
+      "loss": 1.5623,
+      "step": 801
+    },
+    {
+      "epoch": 1.4719926538108357,
+      "grad_norm": 0.2511532187869398,
+      "learning_rate": 7.181715363829196e-06,
+      "loss": 1.4932,
+      "step": 802
+    },
+    {
+      "epoch": 1.4738292011019283,
+      "grad_norm": 0.24894592482296926,
+      "learning_rate": 7.175096097725169e-06,
+      "loss": 1.5337,
+      "step": 803
+    },
+    {
+      "epoch": 1.4756657483930211,
+      "grad_norm": 0.2620746859322951,
+      "learning_rate": 7.168472126447891e-06,
+      "loss": 1.4622,
+      "step": 804
+    },
+    {
+      "epoch": 1.477502295684114,
+      "grad_norm": 0.23994960465192608,
+      "learning_rate": 7.161843464326349e-06,
+      "loss": 1.6129,
+      "step": 805
+    },
+    {
+      "epoch": 1.4793388429752066,
+      "grad_norm": 0.21387650493153448,
+      "learning_rate": 7.155210125699683e-06,
+      "loss": 1.5073,
+      "step": 806
+    },
+    {
+      "epoch": 1.4811753902662994,
+      "grad_norm": 0.22723238722818195,
+      "learning_rate": 7.148572124917148e-06,
+      "loss": 1.4857,
+      "step": 807
+    },
+    {
+      "epoch": 1.483011937557392,
+      "grad_norm": 0.21390061150757966,
+      "learning_rate": 7.141929476338083e-06,
+      "loss": 1.6107,
+      "step": 808
+    },
+    {
+      "epoch": 1.4848484848484849,
+      "grad_norm": 0.26926066183837966,
+      "learning_rate": 7.135282194331881e-06,
+      "loss": 1.5157,
+      "step": 809
+    },
+    {
+      "epoch": 1.4866850321395777,
+      "grad_norm": 0.2150831797481532,
+      "learning_rate": 7.128630293277959e-06,
+      "loss": 1.5721,
+      "step": 810
+    },
+    {
+      "epoch": 1.4885215794306703,
+      "grad_norm": 0.25449702533158935,
+      "learning_rate": 7.121973787565727e-06,
+      "loss": 1.3162,
+      "step": 811
+    },
+    {
+      "epoch": 1.4903581267217632,
+      "grad_norm": 0.2922128124425705,
+      "learning_rate": 7.1153126915945535e-06,
+      "loss": 1.4407,
+      "step": 812
+    },
+    {
+      "epoch": 1.4921946740128558,
+      "grad_norm": 0.2384193264591213,
+      "learning_rate": 7.1086470197737405e-06,
+      "loss": 1.4986,
+      "step": 813
+    },
+    {
+      "epoch": 1.4940312213039486,
+      "grad_norm": 0.25025181781875105,
+      "learning_rate": 7.10197678652248e-06,
+      "loss": 1.6087,
+      "step": 814
+    },
+    {
+      "epoch": 1.4958677685950414,
+      "grad_norm": 0.27273771091987126,
+      "learning_rate": 7.095302006269842e-06,
+      "loss": 1.4817,
+      "step": 815
+    },
+    {
+      "epoch": 1.497704315886134,
+      "grad_norm": 0.21638483381394144,
+      "learning_rate": 7.0886226934547265e-06,
+      "loss": 1.4827,
+      "step": 816
+    },
+    {
+      "epoch": 1.497704315886134,
+      "eval_loss": 2.289696216583252,
+      "eval_runtime": 39.2753,
+      "eval_samples_per_second": 5.22,
+      "eval_steps_per_second": 0.458,
+      "step": 816
+    },
+    {
+      "epoch": 1.4995408631772267,
+      "grad_norm": 0.24534571271016542,
+      "learning_rate": 7.0819388625258385e-06,
+      "loss": 1.7234,
+      "step": 817
+    },
+    {
+      "epoch": 1.5013774104683195,
+      "grad_norm": 0.20433761546540194,
+      "learning_rate": 7.07525052794166e-06,
+      "loss": 1.6987,
+      "step": 818
+    },
+    {
+      "epoch": 1.5032139577594124,
+      "grad_norm": 0.22748392904284964,
+      "learning_rate": 7.06855770417041e-06,
+      "loss": 1.462,
+      "step": 819
+    },
+    {
+      "epoch": 1.5050505050505052,
+      "grad_norm": 0.26424353723831606,
+      "learning_rate": 7.061860405690022e-06,
+      "loss": 1.6373,
+      "step": 820
+    },
+    {
+      "epoch": 1.5068870523415978,
+      "grad_norm": 0.2509267729088736,
+      "learning_rate": 7.05515864698811e-06,
+      "loss": 1.386,
+      "step": 821
+    },
+    {
+      "epoch": 1.5087235996326904,
+      "grad_norm": 0.2356989266263434,
+      "learning_rate": 7.048452442561935e-06,
+      "loss": 1.4541,
+      "step": 822
+    },
+    {
+      "epoch": 1.5105601469237833,
+      "grad_norm": 0.3336003640286475,
+      "learning_rate": 7.041741806918372e-06,
+      "loss": 1.4698,
+      "step": 823
+    },
+    {
+      "epoch": 1.512396694214876,
+      "grad_norm": 0.22924976407202924,
+      "learning_rate": 7.035026754573888e-06,
+      "loss": 1.4633,
+      "step": 824
+    },
+    {
+      "epoch": 1.514233241505969,
+      "grad_norm": 0.4180452910829899,
+      "learning_rate": 7.028307300054499e-06,
+      "loss": 1.7021,
+      "step": 825
+    },
+    {
+      "epoch": 1.5160697887970616,
+      "grad_norm": 0.33621999009934883,
+      "learning_rate": 7.021583457895746e-06,
+      "loss": 1.4731,
+      "step": 826
+    },
+    {
+      "epoch": 1.5179063360881542,
+      "grad_norm": 0.23962799467300885,
+      "learning_rate": 7.014855242642662e-06,
+      "loss": 1.5013,
+      "step": 827
+    },
+    {
+      "epoch": 1.519742883379247,
+      "grad_norm": 0.38418726458648156,
+      "learning_rate": 7.0081226688497396e-06,
+      "loss": 1.6005,
+      "step": 828
+    },
+    {
+      "epoch": 1.5215794306703398,
+      "grad_norm": 0.23836512793639617,
+      "learning_rate": 7.0013857510808934e-06,
+      "loss": 1.6352,
+      "step": 829
+    },
+    {
+      "epoch": 1.5234159779614325,
+      "grad_norm": 0.2824624176744843,
+      "learning_rate": 6.994644503909449e-06,
+      "loss": 1.7589,
+      "step": 830
+    },
+    {
+      "epoch": 1.5252525252525253,
+      "grad_norm": 0.21864781561909352,
+      "learning_rate": 6.987898941918082e-06,
+      "loss": 1.5761,
+      "step": 831
+    },
+    {
+      "epoch": 1.527089072543618,
+      "grad_norm": 0.21209116379217816,
+      "learning_rate": 6.981149079698812e-06,
+      "loss": 1.2043,
+      "step": 832
+    },
+    {
+      "epoch": 1.5289256198347108,
+      "grad_norm": 0.2382992092161349,
+      "learning_rate": 6.974394931852957e-06,
+      "loss": 1.4049,
+      "step": 833
+    },
+    {
+      "epoch": 1.5307621671258036,
+      "grad_norm": 0.2151315542514688,
+      "learning_rate": 6.967636512991108e-06,
+      "loss": 1.608,
+      "step": 834
+    },
+    {
+      "epoch": 1.5325987144168962,
+      "grad_norm": 0.37558198118220903,
+      "learning_rate": 6.960873837733089e-06,
+      "loss": 1.683,
+      "step": 835
+    },
+    {
+      "epoch": 1.5344352617079888,
+      "grad_norm": 0.21683299467867548,
+      "learning_rate": 6.954106920707939e-06,
+      "loss": 1.5724,
+      "step": 836
+    },
+    {
+      "epoch": 1.5362718089990817,
+      "grad_norm": 0.23451288468805462,
+      "learning_rate": 6.94733577655387e-06,
+      "loss": 1.4723,
+      "step": 837
+    },
+    {
+      "epoch": 1.5381083562901745,
+      "grad_norm": 0.24109520586691752,
+      "learning_rate": 6.940560419918238e-06,
+      "loss": 1.6521,
+      "step": 838
+    },
+    {
+      "epoch": 1.5399449035812673,
+      "grad_norm": 0.2989440353587498,
+      "learning_rate": 6.933780865457508e-06,
+      "loss": 1.3496,
+      "step": 839
+    },
+    {
+      "epoch": 1.54178145087236,
+      "grad_norm": 0.25482334174657356,
+      "learning_rate": 6.926997127837233e-06,
+      "loss": 1.4335,
+      "step": 840
+    },
+    {
+      "epoch": 1.5436179981634526,
+      "grad_norm": 0.4182201378575673,
+      "learning_rate": 6.920209221732007e-06,
+      "loss": 1.5908,
+      "step": 841
+    },
+    {
+      "epoch": 1.5454545454545454,
+      "grad_norm": 0.3008098071796498,
+      "learning_rate": 6.913417161825449e-06,
+      "loss": 1.3033,
+      "step": 842
+    },
+    {
+      "epoch": 1.5472910927456383,
+      "grad_norm": 0.33502999488480356,
+      "learning_rate": 6.90662096281016e-06,
+      "loss": 1.5535,
+      "step": 843
+    },
+    {
+      "epoch": 1.549127640036731,
+      "grad_norm": 0.2710402725589549,
+      "learning_rate": 6.899820639387689e-06,
+      "loss": 1.5855,
+      "step": 844
+    },
+    {
+      "epoch": 1.5509641873278237,
+      "grad_norm": 0.2806286561499266,
+      "learning_rate": 6.893016206268518e-06,
+      "loss": 1.8592,
+      "step": 845
+    },
+    {
+      "epoch": 1.5528007346189163,
+      "grad_norm": 0.2517383531940968,
+      "learning_rate": 6.886207678172011e-06,
+      "loss": 1.4192,
+      "step": 846
+    },
+    {
+      "epoch": 1.5546372819100092,
+      "grad_norm": 0.5048464619815336,
+      "learning_rate": 6.879395069826394e-06,
+      "loss": 1.7586,
+      "step": 847
+    },
+    {
+      "epoch": 1.556473829201102,
+      "grad_norm": 0.5224416864024541,
+      "learning_rate": 6.872578395968717e-06,
+      "loss": 1.2583,
+      "step": 848
+    },
+    {
+      "epoch": 1.5583103764921948,
+      "grad_norm": 0.2113900933525535,
+      "learning_rate": 6.865757671344827e-06,
+      "loss": 1.664,
+      "step": 849
+    },
+    {
+      "epoch": 1.5601469237832875,
+      "grad_norm": 0.2244012910667799,
+      "learning_rate": 6.858932910709331e-06,
+      "loss": 1.5231,
+      "step": 850
+    },
+    {
+      "epoch": 1.56198347107438,
+      "grad_norm": 0.2304445044163046,
+      "learning_rate": 6.85210412882557e-06,
+      "loss": 1.58,
+      "step": 851
+    },
+    {
+      "epoch": 1.563820018365473,
+      "grad_norm": 0.20850190581663056,
+      "learning_rate": 6.845271340465579e-06,
+      "loss": 1.4974,
+      "step": 852
+    },
+    {
+      "epoch": 1.5656565656565657,
+      "grad_norm": 0.2085622514845621,
+      "learning_rate": 6.838434560410064e-06,
+      "loss": 1.5066,
+      "step": 853
+    },
+    {
+      "epoch": 1.5674931129476584,
+      "grad_norm": 0.2500931349332275,
+      "learning_rate": 6.831593803448366e-06,
+      "loss": 1.2773,
+      "step": 854
+    },
+    {
+      "epoch": 1.5693296602387512,
+      "grad_norm": 0.20852695790075998,
+      "learning_rate": 6.824749084378428e-06,
+      "loss": 1.6822,
+      "step": 855
+    },
+    {
+      "epoch": 1.5711662075298438,
+      "grad_norm": 0.23893614276515843,
+      "learning_rate": 6.817900418006758e-06,
+      "loss": 1.4837,
+      "step": 856
+    },
+    {
+      "epoch": 1.5730027548209367,
+      "grad_norm": 0.24002344733012076,
+      "learning_rate": 6.811047819148413e-06,
+      "loss": 1.2664,
+      "step": 857
+    },
+    {
+      "epoch": 1.5748393021120295,
+      "grad_norm": 0.22240253375314142,
+      "learning_rate": 6.80419130262695e-06,
+      "loss": 1.5475,
+      "step": 858
+    },
+    {
+      "epoch": 1.576675849403122,
+      "grad_norm": 0.28228411304651463,
+      "learning_rate": 6.7973308832744035e-06,
+      "loss": 1.5915,
+      "step": 859
+    },
+    {
+      "epoch": 1.5785123966942147,
+      "grad_norm": 0.21815617372778504,
+      "learning_rate": 6.7904665759312475e-06,
+      "loss": 1.6374,
+      "step": 860
+    },
+    {
+      "epoch": 1.5803489439853076,
+      "grad_norm": 0.21522587935454457,
+      "learning_rate": 6.783598395446371e-06,
+      "loss": 1.6484,
+      "step": 861
+    },
+    {
+      "epoch": 1.5821854912764004,
+      "grad_norm": 0.2669655571460158,
+      "learning_rate": 6.776726356677037e-06,
+      "loss": 1.5048,
+      "step": 862
+    },
+    {
+      "epoch": 1.5840220385674932,
+      "grad_norm": 0.20755247892639223,
+      "learning_rate": 6.769850474488859e-06,
+      "loss": 1.6062,
+      "step": 863
+    },
+    {
+      "epoch": 1.5858585858585859,
+      "grad_norm": 0.2086556361014703,
+      "learning_rate": 6.7629707637557594e-06,
+      "loss": 1.6054,
+      "step": 864
+    },
+    {
+      "epoch": 1.5876951331496785,
+      "grad_norm": 0.23006420110158152,
+      "learning_rate": 6.756087239359948e-06,
+      "loss": 1.5913,
+      "step": 865
+    },
+    {
+      "epoch": 1.5895316804407713,
+      "grad_norm": 0.24973491821651733,
+      "learning_rate": 6.74919991619188e-06,
+      "loss": 1.5617,
+      "step": 866
+    },
+    {
+      "epoch": 1.5913682277318641,
+      "grad_norm": 0.2023476040844053,
+      "learning_rate": 6.742308809150232e-06,
+      "loss": 1.3217,
+      "step": 867
+    },
+    {
+      "epoch": 1.593204775022957,
+      "grad_norm": 0.27229428310704107,
+      "learning_rate": 6.7354139331418615e-06,
+      "loss": 1.4343,
+      "step": 868
+    },
+    {
+      "epoch": 1.5950413223140496,
+      "grad_norm": 0.23291759152254213,
+      "learning_rate": 6.728515303081782e-06,
+      "loss": 1.8223,
+      "step": 869
+    },
+    {
+      "epoch": 1.5968778696051422,
+      "grad_norm": 0.23663063523186068,
+      "learning_rate": 6.721612933893128e-06,
+      "loss": 1.3882,
+      "step": 870
+    },
+    {
+      "epoch": 1.598714416896235,
+      "grad_norm": 0.21692037931994412,
+      "learning_rate": 6.714706840507122e-06,
+      "loss": 1.7461,
+      "step": 871
+    },
+    {
+      "epoch": 1.600550964187328,
+      "grad_norm": 0.26135485816960885,
+      "learning_rate": 6.70779703786304e-06,
+      "loss": 1.3223,
+      "step": 872
+    },
+    {
+      "epoch": 1.6023875114784207,
+      "grad_norm": 0.20696306018949653,
+      "learning_rate": 6.700883540908185e-06,
+      "loss": 1.5158,
+      "step": 873
+    },
+    {
+      "epoch": 1.6042240587695134,
+      "grad_norm": 0.24565024217670867,
+      "learning_rate": 6.693966364597851e-06,
+      "loss": 1.5036,
+      "step": 874
+    },
+    {
+      "epoch": 1.606060606060606,
+      "grad_norm": 0.24314069526069804,
+      "learning_rate": 6.687045523895292e-06,
+      "loss": 1.4829,
+      "step": 875
+    },
+    {
+      "epoch": 1.6078971533516988,
+      "grad_norm": 0.2627188578072625,
+      "learning_rate": 6.680121033771687e-06,
+      "loss": 1.7079,
+      "step": 876
+    },
+    {
+      "epoch": 1.6097337006427916,
+      "grad_norm": 0.21981579252504846,
+      "learning_rate": 6.673192909206109e-06,
+      "loss": 1.4424,
+      "step": 877
+    },
+    {
+      "epoch": 1.6115702479338843,
+      "grad_norm": 0.27785867552417237,
+      "learning_rate": 6.666261165185496e-06,
+      "loss": 1.3508,
+      "step": 878
+    },
+    {
+      "epoch": 1.613406795224977,
+      "grad_norm": 0.2343166737016591,
+      "learning_rate": 6.6593258167046115e-06,
+      "loss": 1.519,
+      "step": 879
+    },
+    {
+      "epoch": 1.6152433425160697,
+      "grad_norm": 0.21885101797519985,
+      "learning_rate": 6.65238687876602e-06,
+      "loss": 1.6061,
+      "step": 880
+    },
+    {
+      "epoch": 1.6170798898071626,
+      "grad_norm": 0.26574620907243063,
+      "learning_rate": 6.64544436638005e-06,
+      "loss": 1.3345,
+      "step": 881
+    },
+    {
+      "epoch": 1.6189164370982554,
+      "grad_norm": 0.23256158974382404,
+      "learning_rate": 6.63849829456476e-06,
+      "loss": 1.6419,
+      "step": 882
+    },
+    {
+      "epoch": 1.620752984389348,
+      "grad_norm": 0.20870617513829498,
+      "learning_rate": 6.63154867834591e-06,
+      "loss": 1.458,
+      "step": 883
+    },
+    {
+      "epoch": 1.6225895316804406,
+      "grad_norm": 0.24213744764788506,
+      "learning_rate": 6.6245955327569285e-06,
+      "loss": 1.3763,
+      "step": 884
+    },
+    {
+      "epoch": 1.6244260789715335,
+      "grad_norm": 0.328080431339847,
+      "learning_rate": 6.617638872838874e-06,
+      "loss": 1.3158,
+      "step": 885
+    },
+    {
+      "epoch": 1.6262626262626263,
+      "grad_norm": 0.22668323520379627,
+      "learning_rate": 6.610678713640414e-06,
+      "loss": 1.4405,
+      "step": 886
+    },
+    {
+      "epoch": 1.6280991735537191,
+      "grad_norm": 0.2361703097075199,
+      "learning_rate": 6.603715070217779e-06,
+      "loss": 1.4619,
+      "step": 887
+    },
+    {
+      "epoch": 1.6299357208448118,
+      "grad_norm": 0.20773231509853798,
+      "learning_rate": 6.596747957634741e-06,
+      "loss": 1.5472,
+      "step": 888
+    },
+    {
+      "epoch": 1.6317722681359044,
+      "grad_norm": 0.2644547619572768,
+      "learning_rate": 6.589777390962575e-06,
+      "loss": 1.6157,
+      "step": 889
+    },
+    {
+      "epoch": 1.6336088154269972,
+      "grad_norm": 0.2300480886021228,
+      "learning_rate": 6.58280338528003e-06,
+      "loss": 1.468,
+      "step": 890
+    },
+    {
+      "epoch": 1.63544536271809,
+      "grad_norm": 0.2135707770286183,
+      "learning_rate": 6.5758259556732896e-06,
+      "loss": 1.5056,
+      "step": 891
+    },
+    {
+      "epoch": 1.6372819100091829,
+      "grad_norm": 0.21534082246944516,
+      "learning_rate": 6.5688451172359476e-06,
+      "loss": 1.5672,
+      "step": 892
+    },
+    {
+      "epoch": 1.6391184573002755,
+      "grad_norm": 0.2284247973206323,
+      "learning_rate": 6.561860885068972e-06,
+      "loss": 1.6167,
+      "step": 893
+    },
+    {
+      "epoch": 1.6409550045913681,
+      "grad_norm": 0.30830345396671577,
+      "learning_rate": 6.5548732742806686e-06,
+      "loss": 1.5562,
+      "step": 894
+    },
+    {
+      "epoch": 1.642791551882461,
+      "grad_norm": 0.2260358742771939,
+      "learning_rate": 6.547882299986658e-06,
+      "loss": 1.4839,
+      "step": 895
+    },
+    {
+      "epoch": 1.6446280991735538,
+      "grad_norm": 0.2698775921430231,
+      "learning_rate": 6.540887977309829e-06,
+      "loss": 1.4151,
+      "step": 896
+    },
+    {
+      "epoch": 1.6464646464646466,
+      "grad_norm": 0.20721733023235483,
+      "learning_rate": 6.53389032138032e-06,
+      "loss": 1.5766,
+      "step": 897
+    },
+    {
+      "epoch": 1.6483011937557392,
+      "grad_norm": 0.23857266015179301,
+      "learning_rate": 6.526889347335478e-06,
+      "loss": 1.4674,
+      "step": 898
+    },
+    {
+      "epoch": 1.6501377410468319,
+      "grad_norm": 0.26240869115950244,
+      "learning_rate": 6.519885070319827e-06,
+      "loss": 1.591,
+      "step": 899
+    },
+    {
+      "epoch": 1.6519742883379247,
+      "grad_norm": 0.2936618643411154,
+      "learning_rate": 6.512877505485034e-06,
+      "loss": 1.4314,
+      "step": 900
+    },
+    {
+      "epoch": 1.6538108356290175,
+      "grad_norm": 0.27136030971065583,
+      "learning_rate": 6.505866667989884e-06,
+      "loss": 1.5116,
+      "step": 901
+    },
+    {
+      "epoch": 1.6556473829201102,
+      "grad_norm": 0.28454476792055433,
+      "learning_rate": 6.498852573000236e-06,
+      "loss": 1.5864,
+      "step": 902
+    },
+    {
+      "epoch": 1.657483930211203,
+      "grad_norm": 0.22537392917670648,
+      "learning_rate": 6.491835235688999e-06,
+      "loss": 1.5549,
+      "step": 903
+    },
+    {
+      "epoch": 1.6593204775022956,
+      "grad_norm": 0.21491657648569415,
+      "learning_rate": 6.484814671236092e-06,
+      "loss": 1.3295,
+      "step": 904
+    },
+    {
+      "epoch": 1.6611570247933884,
+      "grad_norm": 0.32560482966071935,
+      "learning_rate": 6.477790894828422e-06,
+      "loss": 1.6574,
+      "step": 905
+    },
+    {
+      "epoch": 1.6629935720844813,
+      "grad_norm": 0.3046758354466081,
+      "learning_rate": 6.4707639216598326e-06,
+      "loss": 1.4144,
+      "step": 906
+    },
+    {
+      "epoch": 1.664830119375574,
+      "grad_norm": 0.2725553702054219,
+      "learning_rate": 6.463733766931096e-06,
+      "loss": 1.4177,
+      "step": 907
+    },
+    {
+      "epoch": 1.6666666666666665,
+      "grad_norm": 2.1718600417024105,
+      "learning_rate": 6.456700445849857e-06,
+      "loss": 1.4338,
+      "step": 908
+    },
+    {
+      "epoch": 1.6685032139577594,
+      "grad_norm": 0.22112986305109744,
+      "learning_rate": 6.449663973630613e-06,
+      "loss": 1.628,
+      "step": 909
+    },
+    {
+      "epoch": 1.6703397612488522,
+      "grad_norm": 0.2487967297886452,
+      "learning_rate": 6.442624365494679e-06,
+      "loss": 1.624,
+      "step": 910
+    },
+    {
+      "epoch": 1.672176308539945,
+      "grad_norm": 0.22214374244600316,
+      "learning_rate": 6.435581636670154e-06,
+      "loss": 1.5697,
+      "step": 911
+    },
+    {
+      "epoch": 1.6740128558310376,
+      "grad_norm": 0.22875456715115547,
+      "learning_rate": 6.428535802391883e-06,
+      "loss": 1.4187,
+      "step": 912
+    },
+    {
+      "epoch": 1.6758494031221303,
+      "grad_norm": 0.22001423226522315,
+      "learning_rate": 6.421486877901436e-06,
+      "loss": 1.5992,
+      "step": 913
+    },
+    {
+      "epoch": 1.677685950413223,
+      "grad_norm": 0.23989987191738912,
+      "learning_rate": 6.414434878447061e-06,
+      "loss": 1.6343,
+      "step": 914
+    },
+    {
+      "epoch": 1.679522497704316,
+      "grad_norm": 0.2613823633311871,
+      "learning_rate": 6.407379819283661e-06,
+      "loss": 1.3207,
+      "step": 915
+    },
+    {
+      "epoch": 1.6813590449954088,
+      "grad_norm": 0.2094517127680056,
+      "learning_rate": 6.400321715672761e-06,
+      "loss": 1.677,
+      "step": 916
+    },
+    {
+      "epoch": 1.6831955922865014,
+      "grad_norm": 0.24776787599274508,
+      "learning_rate": 6.393260582882462e-06,
+      "loss": 1.6835,
+      "step": 917
+    },
+    {
+      "epoch": 1.685032139577594,
+      "grad_norm": 0.23358171538043906,
+      "learning_rate": 6.386196436187428e-06,
+      "loss": 1.4411,
+      "step": 918
+    },
+    {
+      "epoch": 1.6868686868686869,
+      "grad_norm": 0.28081516177979404,
+      "learning_rate": 6.379129290868837e-06,
+      "loss": 1.4613,
+      "step": 919
+    },
+    {
+      "epoch": 1.6887052341597797,
+      "grad_norm": 0.2541559477892955,
+      "learning_rate": 6.372059162214358e-06,
+      "loss": 1.5818,
+      "step": 920
+    },
+    {
+      "epoch": 1.6905417814508723,
+      "grad_norm": 0.22305971602960745,
+      "learning_rate": 6.364986065518106e-06,
+      "loss": 1.4879,
+      "step": 921
+    },
+    {
+      "epoch": 1.6923783287419651,
+      "grad_norm": 0.22994319233301724,
+      "learning_rate": 6.357910016080626e-06,
+      "loss": 1.5042,
+      "step": 922
+    },
+    {
+      "epoch": 1.6942148760330578,
+      "grad_norm": 0.2678473375809703,
+      "learning_rate": 6.350831029208844e-06,
+      "loss": 1.535,
+      "step": 923
+    },
+    {
+      "epoch": 1.6960514233241506,
+      "grad_norm": 0.23857552024787795,
+      "learning_rate": 6.343749120216039e-06,
+      "loss": 1.3602,
+      "step": 924
+    },
+    {
+      "epoch": 1.6978879706152434,
+      "grad_norm": 0.20704280791901641,
+      "learning_rate": 6.336664304421818e-06,
+      "loss": 1.4326,
+      "step": 925
+    },
+    {
+      "epoch": 1.699724517906336,
+      "grad_norm": 0.22735266989954628,
+      "learning_rate": 6.329576597152072e-06,
+      "loss": 1.4916,
+      "step": 926
+    },
+    {
+      "epoch": 1.7015610651974287,
+      "grad_norm": 0.19212539794925945,
+      "learning_rate": 6.322486013738942e-06,
+      "loss": 1.483,
+      "step": 927
+    },
+    {
+      "epoch": 1.7033976124885215,
+      "grad_norm": 0.23990371607977204,
+      "learning_rate": 6.315392569520802e-06,
+      "loss": 1.3939,
+      "step": 928
+    },
+    {
+      "epoch": 1.7052341597796143,
+      "grad_norm": 0.2426666127594861,
+      "learning_rate": 6.308296279842204e-06,
+      "loss": 1.295,
+      "step": 929
+    },
+    {
+      "epoch": 1.7070707070707072,
+      "grad_norm": 0.21640025175547764,
+      "learning_rate": 6.30119716005386e-06,
+      "loss": 1.4007,
+      "step": 930
+    },
+    {
+      "epoch": 1.7089072543617998,
+      "grad_norm": 0.26255860574839185,
+      "learning_rate": 6.294095225512604e-06,
+      "loss": 1.4396,
+      "step": 931
+    },
+    {
+      "epoch": 1.7107438016528924,
+      "grad_norm": 0.22187693952282128,
+      "learning_rate": 6.28699049158136e-06,
+      "loss": 1.5409,
+      "step": 932
+    },
+    {
+      "epoch": 1.7125803489439853,
+      "grad_norm": 0.23158238111341717,
+      "learning_rate": 6.279882973629101e-06,
+      "loss": 1.6856,
+      "step": 933
+    },
+    {
+      "epoch": 1.714416896235078,
+      "grad_norm": 0.21542085932025815,
+      "learning_rate": 6.272772687030834e-06,
+      "loss": 1.3992,
+      "step": 934
+    },
+    {
+      "epoch": 1.716253443526171,
+      "grad_norm": 0.25390525716448753,
+      "learning_rate": 6.265659647167542e-06,
+      "loss": 1.6729,
+      "step": 935
+    },
+    {
+      "epoch": 1.7180899908172635,
+      "grad_norm": 0.22752301227630684,
+      "learning_rate": 6.258543869426175e-06,
+      "loss": 1.4681,
+      "step": 936
+    },
+    {
+      "epoch": 1.7199265381083562,
+      "grad_norm": 0.20216213076362627,
+      "learning_rate": 6.2514253691996e-06,
+      "loss": 1.3549,
+      "step": 937
+    },
+    {
+      "epoch": 1.721763085399449,
+      "grad_norm": 0.21802565516555109,
+      "learning_rate": 6.244304161886574e-06,
+      "loss": 1.2248,
+      "step": 938
+    },
+    {
+      "epoch": 1.7235996326905418,
+      "grad_norm": 0.25445389953574865,
+      "learning_rate": 6.237180262891709e-06,
+      "loss": 1.4898,
+      "step": 939
+    },
+    {
+      "epoch": 1.7254361799816347,
+      "grad_norm": 0.2249059181338093,
+      "learning_rate": 6.230053687625443e-06,
+      "loss": 1.5089,
+      "step": 940
+    },
+    {
+      "epoch": 1.7272727272727273,
+      "grad_norm": 0.21639261828154766,
+      "learning_rate": 6.222924451504001e-06,
+      "loss": 1.398,
+      "step": 941
+    },
+    {
+      "epoch": 1.72910927456382,
+      "grad_norm": 0.23812914583042466,
+      "learning_rate": 6.215792569949362e-06,
+      "loss": 1.4225,
+      "step": 942
+    },
+    {
+      "epoch": 1.7309458218549127,
+      "grad_norm": 0.2592669004102377,
+      "learning_rate": 6.208658058389232e-06,
+      "loss": 1.3926,
+      "step": 943
+    },
+    {
+      "epoch": 1.7327823691460056,
+      "grad_norm": 0.21183503004584925,
+      "learning_rate": 6.2015209322570025e-06,
+      "loss": 1.6671,
+      "step": 944
+    },
+    {
+      "epoch": 1.7346189164370982,
+      "grad_norm": 0.2240097677197832,
+      "learning_rate": 6.194381206991723e-06,
+      "loss": 1.5191,
+      "step": 945
+    },
+    {
+      "epoch": 1.736455463728191,
+      "grad_norm": 0.25705000001621603,
+      "learning_rate": 6.187238898038066e-06,
+      "loss": 1.5381,
+      "step": 946
+    },
+    {
+      "epoch": 1.7382920110192837,
+      "grad_norm": 0.21440894534441093,
+      "learning_rate": 6.180094020846291e-06,
+      "loss": 1.569,
+      "step": 947
+    },
+    {
+      "epoch": 1.7401285583103765,
+      "grad_norm": 0.22766019249742944,
+      "learning_rate": 6.172946590872212e-06,
+      "loss": 1.3525,
+      "step": 948
+    },
+    {
+      "epoch": 1.7419651056014693,
+      "grad_norm": 0.38948464127121485,
+      "learning_rate": 6.165796623577171e-06,
+      "loss": 1.484,
+      "step": 949
+    },
+    {
+      "epoch": 1.743801652892562,
+      "grad_norm": 0.25806369352147535,
+      "learning_rate": 6.158644134427994e-06,
+      "loss": 1.5865,
+      "step": 950
+    },
+    {
+      "epoch": 1.7456382001836546,
+      "grad_norm": 0.2619068152383316,
+      "learning_rate": 6.15148913889696e-06,
+      "loss": 1.3842,
+      "step": 951
+    },
+    {
+      "epoch": 1.7474747474747474,
+      "grad_norm": 0.315731014124608,
+      "learning_rate": 6.144331652461775e-06,
+      "loss": 1.3654,
+      "step": 952
+    },
+    {
+      "epoch": 1.7474747474747474,
+      "eval_loss": 2.284580707550049,
+      "eval_runtime": 39.4834,
+      "eval_samples_per_second": 5.192,
+      "eval_steps_per_second": 0.456,
+      "step": 952
+    },
+    {
+      "epoch": 1.7493112947658402,
+      "grad_norm": 0.22136621883234103,
+      "learning_rate": 6.1371716906055336e-06,
+      "loss": 1.5789,
+      "step": 953
+    },
+    {
+      "epoch": 1.751147842056933,
+      "grad_norm": 0.2147444736300043,
+      "learning_rate": 6.130009268816678e-06,
+      "loss": 1.4757,
+      "step": 954
+    },
+    {
+      "epoch": 1.7529843893480257,
+      "grad_norm": 0.22127818097126392,
+      "learning_rate": 6.122844402588982e-06,
+      "loss": 1.2867,
+      "step": 955
+    },
+    {
+      "epoch": 1.7548209366391183,
+      "grad_norm": 0.226117100466891,
+      "learning_rate": 6.1156771074214995e-06,
+      "loss": 1.5156,
+      "step": 956
+    },
+    {
+      "epoch": 1.7566574839302111,
+      "grad_norm": 0.24368302369241668,
+      "learning_rate": 6.10850739881854e-06,
+      "loss": 1.6935,
+      "step": 957
+    },
+    {
+      "epoch": 1.758494031221304,
+      "grad_norm": 0.22862568303380235,
+      "learning_rate": 6.101335292289636e-06,
+      "loss": 1.4195,
+      "step": 958
+    },
+    {
+      "epoch": 1.7603305785123968,
+      "grad_norm": 0.2530746361312367,
+      "learning_rate": 6.094160803349508e-06,
+      "loss": 1.5231,
+      "step": 959
+    },
+    {
+      "epoch": 1.7621671258034894,
+      "grad_norm": 0.2527724333179515,
+      "learning_rate": 6.086983947518024e-06,
+      "loss": 1.3769,
+      "step": 960
+    },
+    {
+      "epoch": 1.764003673094582,
+      "grad_norm": 0.2364751842786996,
+      "learning_rate": 6.079804740320181e-06,
+      "loss": 1.5722,
+      "step": 961
+    },
+    {
+      "epoch": 1.765840220385675,
+      "grad_norm": 0.3432868531488983,
+      "learning_rate": 6.0726231972860535e-06,
+      "loss": 1.4564,
+      "step": 962
+    },
+    {
+      "epoch": 1.7676767676767677,
+      "grad_norm": 0.2415250148679838,
+      "learning_rate": 6.065439333950776e-06,
+      "loss": 1.3828,
+      "step": 963
+    },
+    {
+      "epoch": 1.7695133149678606,
+      "grad_norm": 0.22749130861972514,
+      "learning_rate": 6.058253165854498e-06,
+      "loss": 1.3783,
+      "step": 964
+    },
+    {
+      "epoch": 1.7713498622589532,
+      "grad_norm": 0.2352568250726592,
+      "learning_rate": 6.051064708542357e-06,
+      "loss": 1.5636,
+      "step": 965
+    },
+    {
+      "epoch": 1.7731864095500458,
+      "grad_norm": 0.2114188117249541,
+      "learning_rate": 6.0438739775644405e-06,
+      "loss": 1.5034,
+      "step": 966
+    },
+    {
+      "epoch": 1.7750229568411386,
+      "grad_norm": 0.2282927830728566,
+      "learning_rate": 6.036680988475756e-06,
+      "loss": 1.5309,
+      "step": 967
+    },
+    {
+      "epoch": 1.7768595041322315,
+      "grad_norm": 0.21393816750693068,
+      "learning_rate": 6.029485756836195e-06,
+      "loss": 1.4093,
+      "step": 968
+    },
+    {
+      "epoch": 1.778696051423324,
+      "grad_norm": 0.2317541765070809,
+      "learning_rate": 6.022288298210502e-06,
+      "loss": 1.4521,
+      "step": 969
+    },
+    {
+      "epoch": 1.780532598714417,
+      "grad_norm": 0.21371917308108535,
+      "learning_rate": 6.015088628168235e-06,
+      "loss": 1.4702,
+      "step": 970
+    },
+    {
+      "epoch": 1.7823691460055096,
+      "grad_norm": 0.2347797063013921,
+      "learning_rate": 6.00788676228374e-06,
+      "loss": 1.514,
+      "step": 971
+    },
+    {
+      "epoch": 1.7842056932966024,
+      "grad_norm": 0.2994608157010906,
+      "learning_rate": 6.00068271613611e-06,
+      "loss": 1.5567,
+      "step": 972
+    },
+    {
+      "epoch": 1.7860422405876952,
+      "grad_norm": 0.25034942798474696,
+      "learning_rate": 5.993476505309154e-06,
+      "loss": 1.5654,
+      "step": 973
+    },
+    {
+      "epoch": 1.7878787878787878,
+      "grad_norm": 0.23018693359801662,
+      "learning_rate": 5.986268145391369e-06,
+      "loss": 1.4099,
+      "step": 974
+    },
+    {
+      "epoch": 1.7897153351698805,
+      "grad_norm": 0.261159561183926,
+      "learning_rate": 5.979057651975893e-06,
+      "loss": 1.4419,
+      "step": 975
+    },
+    {
+      "epoch": 1.7915518824609733,
+      "grad_norm": 0.21861391792147866,
+      "learning_rate": 5.971845040660487e-06,
+      "loss": 1.6308,
+      "step": 976
+    },
+    {
+      "epoch": 1.7933884297520661,
+      "grad_norm": 0.2271886701328977,
+      "learning_rate": 5.964630327047485e-06,
+      "loss": 1.4834,
+      "step": 977
+    },
+    {
+      "epoch": 1.795224977043159,
+      "grad_norm": 0.23428263366297603,
+      "learning_rate": 5.957413526743776e-06,
+      "loss": 1.1933,
+      "step": 978
+    },
+    {
+      "epoch": 1.7970615243342516,
+      "grad_norm": 0.24012690610814938,
+      "learning_rate": 5.9501946553607615e-06,
+      "loss": 1.6154,
+      "step": 979
+    },
+    {
+      "epoch": 1.7988980716253442,
+      "grad_norm": 0.2128487944384168,
+      "learning_rate": 5.9429737285143185e-06,
+      "loss": 1.6033,
+      "step": 980
+    },
+    {
+      "epoch": 1.800734618916437,
+      "grad_norm": 0.3302816742239998,
+      "learning_rate": 5.935750761824777e-06,
+      "loss": 1.485,
+      "step": 981
+    },
+    {
+      "epoch": 1.8025711662075299,
+      "grad_norm": 0.21269946942518322,
+      "learning_rate": 5.928525770916876e-06,
+      "loss": 1.6975,
+      "step": 982
+    },
+    {
+      "epoch": 1.8044077134986227,
+      "grad_norm": 0.2255615103656178,
+      "learning_rate": 5.921298771419731e-06,
+      "loss": 1.4294,
+      "step": 983
+    },
+    {
+      "epoch": 1.8062442607897153,
+      "grad_norm": 0.2114966429611151,
+      "learning_rate": 5.914069778966808e-06,
+      "loss": 1.7131,
+      "step": 984
+    },
+    {
+      "epoch": 1.808080808080808,
+      "grad_norm": 0.2275486040888402,
+      "learning_rate": 5.906838809195879e-06,
+      "loss": 1.6627,
+      "step": 985
+    },
+    {
+      "epoch": 1.8099173553719008,
+      "grad_norm": 0.23195173048390652,
+      "learning_rate": 5.8996058777489985e-06,
+      "loss": 1.6547,
+      "step": 986
+    },
+    {
+      "epoch": 1.8117539026629936,
+      "grad_norm": 0.22405739009506828,
+      "learning_rate": 5.8923710002724595e-06,
+      "loss": 1.5545,
+      "step": 987
+    },
+    {
+      "epoch": 1.8135904499540865,
+      "grad_norm": 0.22670566242366874,
+      "learning_rate": 5.885134192416768e-06,
+      "loss": 1.5119,
+      "step": 988
+    },
+    {
+      "epoch": 1.815426997245179,
+      "grad_norm": 0.21013586421817057,
+      "learning_rate": 5.877895469836604e-06,
+      "loss": 1.6006,
+      "step": 989
+    },
+    {
+      "epoch": 1.8172635445362717,
+      "grad_norm": 0.2200681978978038,
+      "learning_rate": 5.87065484819079e-06,
+      "loss": 1.7101,
+      "step": 990
+    },
+    {
+      "epoch": 1.8191000918273645,
+      "grad_norm": 0.3563677442513671,
+      "learning_rate": 5.863412343142258e-06,
+      "loss": 1.4574,
+      "step": 991
+    },
+    {
+      "epoch": 1.8209366391184574,
+      "grad_norm": 0.24501009908198906,
+      "learning_rate": 5.85616797035801e-06,
+      "loss": 1.4977,
+      "step": 992
+    },
+    {
+      "epoch": 1.82277318640955,
+      "grad_norm": 0.2638958264525975,
+      "learning_rate": 5.848921745509094e-06,
+      "loss": 1.5519,
+      "step": 993
+    },
+    {
+      "epoch": 1.8246097337006428,
+      "grad_norm": 0.2214240494590717,
+      "learning_rate": 5.841673684270559e-06,
+      "loss": 1.4433,
+      "step": 994
+    },
+    {
+      "epoch": 1.8264462809917354,
+      "grad_norm": 0.23279776890078924,
+      "learning_rate": 5.8344238023214305e-06,
+      "loss": 1.5418,
+      "step": 995
+    },
+    {
+      "epoch": 1.8282828282828283,
+      "grad_norm": 0.2196221183754506,
+      "learning_rate": 5.827172115344672e-06,
+      "loss": 1.5188,
+      "step": 996
+    },
+    {
+      "epoch": 1.8301193755739211,
+      "grad_norm": 0.24654503316079854,
+      "learning_rate": 5.819918639027149e-06,
+      "loss": 1.2854,
+      "step": 997
+    },
+    {
+      "epoch": 1.8319559228650137,
+      "grad_norm": 0.22397558516936245,
+      "learning_rate": 5.8126633890595984e-06,
+      "loss": 1.6836,
+      "step": 998
+    },
+    {
+      "epoch": 1.8337924701561064,
+      "grad_norm": 0.24225117329482815,
+      "learning_rate": 5.805406381136598e-06,
+      "loss": 1.6796,
+      "step": 999
+    },
+    {
+      "epoch": 1.8356290174471992,
+      "grad_norm": 0.2452524910363302,
+      "learning_rate": 5.798147630956524e-06,
+      "loss": 1.525,
+      "step": 1000
+    },
+    {
+      "epoch": 1.837465564738292,
+      "grad_norm": 0.28548432424057446,
+      "learning_rate": 5.790887154221521e-06,
+      "loss": 1.3587,
+      "step": 1001
+    },
+    {
+      "epoch": 1.8393021120293849,
+      "grad_norm": 0.2132850118313715,
+      "learning_rate": 5.783624966637471e-06,
+      "loss": 1.4032,
+      "step": 1002
+    },
+    {
+      "epoch": 1.8411386593204775,
+      "grad_norm": 0.26791236054929024,
+      "learning_rate": 5.776361083913959e-06,
+      "loss": 1.47,
+      "step": 1003
+    },
+    {
+      "epoch": 1.84297520661157,
+      "grad_norm": 0.22594931034730711,
+      "learning_rate": 5.76909552176423e-06,
+      "loss": 1.76,
+      "step": 1004
+    },
+    {
+      "epoch": 1.844811753902663,
+      "grad_norm": 0.24978537454212932,
+      "learning_rate": 5.7618282959051685e-06,
+      "loss": 1.4918,
+      "step": 1005
+    },
+    {
+      "epoch": 1.8466483011937558,
+      "grad_norm": 0.34252582866979,
+      "learning_rate": 5.754559422057255e-06,
+      "loss": 1.6619,
+      "step": 1006
+    },
+    {
+      "epoch": 1.8484848484848486,
+      "grad_norm": 0.2324787181436058,
+      "learning_rate": 5.747288915944533e-06,
+      "loss": 1.477,
+      "step": 1007
+    },
+    {
+      "epoch": 1.8503213957759412,
+      "grad_norm": 0.2411185226743017,
+      "learning_rate": 5.740016793294584e-06,
+      "loss": 1.5198,
+      "step": 1008
+    },
+    {
+      "epoch": 1.8521579430670339,
+      "grad_norm": 0.23613786909836318,
+      "learning_rate": 5.7327430698384775e-06,
+      "loss": 1.6222,
+      "step": 1009
+    },
+    {
+      "epoch": 1.8539944903581267,
+      "grad_norm": 0.21047532076629955,
+      "learning_rate": 5.725467761310751e-06,
+      "loss": 1.45,
+      "step": 1010
+    },
+    {
+      "epoch": 1.8558310376492195,
+      "grad_norm": 0.7671173457790165,
+      "learning_rate": 5.718190883449373e-06,
+      "loss": 1.7034,
+      "step": 1011
+    },
+    {
+      "epoch": 1.8576675849403124,
+      "grad_norm": 0.2627020345529076,
+      "learning_rate": 5.7109124519957e-06,
+      "loss": 1.5142,
+      "step": 1012
+    },
+    {
+      "epoch": 1.859504132231405,
+      "grad_norm": 0.2357982177029476,
+      "learning_rate": 5.703632482694453e-06,
+      "loss": 1.5488,
+      "step": 1013
+    },
+    {
+      "epoch": 1.8613406795224976,
+      "grad_norm": 0.2755440489943397,
+      "learning_rate": 5.696350991293682e-06,
+      "loss": 1.4125,
+      "step": 1014
+    },
+    {
+      "epoch": 1.8631772268135904,
+      "grad_norm": 0.21720954339718215,
+      "learning_rate": 5.689067993544726e-06,
+      "loss": 1.5036,
+      "step": 1015
+    },
+    {
+      "epoch": 1.8650137741046833,
+      "grad_norm": 0.21686084134056388,
+      "learning_rate": 5.681783505202182e-06,
+      "loss": 1.5857,
+      "step": 1016
+    },
+    {
+      "epoch": 1.866850321395776,
+      "grad_norm": 0.2612412370255096,
+      "learning_rate": 5.674497542023875e-06,
+      "loss": 1.4066,
+      "step": 1017
+    },
+    {
+      "epoch": 1.8686868686868687,
+      "grad_norm": 0.2358820624405194,
+      "learning_rate": 5.66721011977082e-06,
+      "loss": 1.5131,
+      "step": 1018
+    },
+    {
+      "epoch": 1.8705234159779613,
+      "grad_norm": 0.2547652257634911,
+      "learning_rate": 5.659921254207183e-06,
+      "loss": 1.3244,
+      "step": 1019
+    },
+    {
+      "epoch": 1.8723599632690542,
+      "grad_norm": 0.22462662926347873,
+      "learning_rate": 5.65263096110026e-06,
+      "loss": 1.3795,
+      "step": 1020
+    },
+    {
+      "epoch": 1.874196510560147,
+      "grad_norm": 0.21002555221501365,
+      "learning_rate": 5.645339256220427e-06,
+      "loss": 1.6356,
+      "step": 1021
+    },
+    {
+      "epoch": 1.8760330578512396,
+      "grad_norm": 0.21926808035379428,
+      "learning_rate": 5.638046155341121e-06,
+      "loss": 1.5093,
+      "step": 1022
+    },
+    {
+      "epoch": 1.8778696051423323,
+      "grad_norm": 0.2144160679399332,
+      "learning_rate": 5.630751674238796e-06,
+      "loss": 1.3055,
+      "step": 1023
+    },
+    {
+      "epoch": 1.879706152433425,
+      "grad_norm": 0.2261624478104636,
+      "learning_rate": 5.62345582869289e-06,
+      "loss": 1.307,
+      "step": 1024
+    },
+    {
+      "epoch": 1.881542699724518,
+      "grad_norm": 0.2190695058853984,
+      "learning_rate": 5.616158634485793e-06,
+      "loss": 1.7205,
+      "step": 1025
+    },
+    {
+      "epoch": 1.8833792470156108,
+      "grad_norm": 0.21568127692113973,
+      "learning_rate": 5.608860107402818e-06,
+      "loss": 1.5103,
+      "step": 1026
+    },
+    {
+      "epoch": 1.8852157943067034,
+      "grad_norm": 0.24426426170848076,
+      "learning_rate": 5.601560263232153e-06,
+      "loss": 1.3333,
+      "step": 1027
+    },
+    {
+      "epoch": 1.887052341597796,
+      "grad_norm": 0.23118918825664264,
+      "learning_rate": 5.59425911776484e-06,
+      "loss": 1.4828,
+      "step": 1028
+    },
+    {
+      "epoch": 1.8888888888888888,
+      "grad_norm": 0.2698224620017709,
+      "learning_rate": 5.5869566867947344e-06,
+      "loss": 1.5627,
+      "step": 1029
+    },
+    {
+      "epoch": 1.8907254361799817,
+      "grad_norm": 0.25336120778048327,
+      "learning_rate": 5.579652986118476e-06,
+      "loss": 1.4299,
+      "step": 1030
+    },
+    {
+      "epoch": 1.8925619834710745,
+      "grad_norm": 0.23051190735328148,
+      "learning_rate": 5.572348031535442e-06,
+      "loss": 1.5673,
+      "step": 1031
+    },
+    {
+      "epoch": 1.8943985307621671,
+      "grad_norm": 0.23853619591351208,
+      "learning_rate": 5.565041838847735e-06,
+      "loss": 1.4508,
+      "step": 1032
+    },
+    {
+      "epoch": 1.8962350780532597,
+      "grad_norm": 0.21827102510264274,
+      "learning_rate": 5.557734423860122e-06,
+      "loss": 1.5638,
+      "step": 1033
+    },
+    {
+      "epoch": 1.8980716253443526,
+      "grad_norm": 0.25537074554944644,
+      "learning_rate": 5.5504258023800286e-06,
+      "loss": 1.6682,
+      "step": 1034
+    },
+    {
+      "epoch": 1.8999081726354454,
+      "grad_norm": 0.23019196714185275,
+      "learning_rate": 5.543115990217478e-06,
+      "loss": 1.5746,
+      "step": 1035
+    },
+    {
+      "epoch": 1.9017447199265383,
+      "grad_norm": 0.2311086008431128,
+      "learning_rate": 5.535805003185076e-06,
+      "loss": 1.5079,
+      "step": 1036
+    },
+    {
+      "epoch": 1.9035812672176309,
+      "grad_norm": 0.2143465418125777,
+      "learning_rate": 5.528492857097966e-06,
+      "loss": 1.2951,
+      "step": 1037
+    },
+    {
+      "epoch": 1.9054178145087235,
+      "grad_norm": 0.22335042985661732,
+      "learning_rate": 5.521179567773801e-06,
+      "loss": 1.451,
+      "step": 1038
+    },
+    {
+      "epoch": 1.9072543617998163,
+      "grad_norm": 0.27190663295176865,
+      "learning_rate": 5.513865151032709e-06,
+      "loss": 1.5996,
+      "step": 1039
+    },
+    {
+      "epoch": 1.9090909090909092,
+      "grad_norm": 0.2456150287075836,
+      "learning_rate": 5.506549622697251e-06,
+      "loss": 1.5032,
+      "step": 1040
+    },
+    {
+      "epoch": 1.9109274563820018,
+      "grad_norm": 0.20608965078843122,
+      "learning_rate": 5.499232998592399e-06,
+      "loss": 1.5144,
+      "step": 1041
+    },
+    {
+      "epoch": 1.9127640036730946,
+      "grad_norm": 0.25960647465231923,
+      "learning_rate": 5.491915294545489e-06,
+      "loss": 1.5696,
+      "step": 1042
+    },
+    {
+      "epoch": 1.9146005509641872,
+      "grad_norm": 0.2257967184212604,
+      "learning_rate": 5.484596526386198e-06,
+      "loss": 1.5301,
+      "step": 1043
+    },
+    {
+      "epoch": 1.91643709825528,
+      "grad_norm": 0.23747397710576812,
+      "learning_rate": 5.4772767099465044e-06,
+      "loss": 1.3486,
+      "step": 1044
+    },
+    {
+      "epoch": 1.918273645546373,
+      "grad_norm": 0.23355503400668556,
+      "learning_rate": 5.469955861060653e-06,
+      "loss": 1.5546,
+      "step": 1045
+    },
+    {
+      "epoch": 1.9201101928374655,
+      "grad_norm": 0.23737973442334,
+      "learning_rate": 5.46263399556512e-06,
+      "loss": 1.7185,
+      "step": 1046
+    },
+    {
+      "epoch": 1.9219467401285582,
+      "grad_norm": 0.22566515160566458,
+      "learning_rate": 5.455311129298586e-06,
+      "loss": 1.6068,
+      "step": 1047
+    },
+    {
+      "epoch": 1.923783287419651,
+      "grad_norm": 0.2171877477639194,
+      "learning_rate": 5.447987278101891e-06,
+      "loss": 1.5474,
+      "step": 1048
+    },
+    {
+      "epoch": 1.9256198347107438,
+      "grad_norm": 0.35114891633489426,
+      "learning_rate": 5.44066245781801e-06,
+      "loss": 1.4492,
+      "step": 1049
+    },
+    {
+      "epoch": 1.9274563820018367,
+      "grad_norm": 0.3171733584794431,
+      "learning_rate": 5.43333668429201e-06,
+      "loss": 1.6157,
+      "step": 1050
+    },
+    {
+      "epoch": 1.9292929292929293,
+      "grad_norm": 0.24400258102653016,
+      "learning_rate": 5.426009973371026e-06,
+      "loss": 1.5277,
+      "step": 1051
+    },
+    {
+      "epoch": 1.931129476584022,
+      "grad_norm": 0.22699006924011925,
+      "learning_rate": 5.418682340904211e-06,
+      "loss": 1.503,
+      "step": 1052
+    },
+    {
+      "epoch": 1.9329660238751147,
+      "grad_norm": 0.3660332227664407,
+      "learning_rate": 5.4113538027427245e-06,
+      "loss": 1.38,
+      "step": 1053
+    },
+    {
+      "epoch": 1.9348025711662076,
+      "grad_norm": 0.2214228995917854,
+      "learning_rate": 5.404024374739675e-06,
+      "loss": 1.3244,
+      "step": 1054
+    },
+    {
+      "epoch": 1.9366391184573004,
+      "grad_norm": 0.2221053553807594,
+      "learning_rate": 5.396694072750099e-06,
+      "loss": 1.3337,
+      "step": 1055
+    },
+    {
+      "epoch": 1.938475665748393,
+      "grad_norm": 0.2818763163411878,
+      "learning_rate": 5.389362912630924e-06,
+      "loss": 1.4147,
+      "step": 1056
+    },
+    {
+      "epoch": 1.9403122130394856,
+      "grad_norm": 0.2830207036194131,
+      "learning_rate": 5.382030910240936e-06,
+      "loss": 1.5562,
+      "step": 1057
+    },
+    {
+      "epoch": 1.9421487603305785,
+      "grad_norm": 0.21528330208465044,
+      "learning_rate": 5.374698081440737e-06,
+      "loss": 1.6618,
+      "step": 1058
+    },
+    {
+      "epoch": 1.9439853076216713,
+      "grad_norm": 0.22318222826040585,
+      "learning_rate": 5.367364442092724e-06,
+      "loss": 1.6667,
+      "step": 1059
+    },
+    {
+      "epoch": 1.9458218549127642,
+      "grad_norm": 0.43770554592299926,
+      "learning_rate": 5.360030008061041e-06,
+      "loss": 1.5304,
+      "step": 1060
+    },
+    {
+      "epoch": 1.9476584022038568,
+      "grad_norm": 0.26268374169957176,
+      "learning_rate": 5.352694795211555e-06,
+      "loss": 1.6501,
+      "step": 1061
+    },
+    {
+      "epoch": 1.9494949494949494,
+      "grad_norm": 0.22224915510849155,
+      "learning_rate": 5.345358819411818e-06,
+      "loss": 1.5071,
+      "step": 1062
+    },
+    {
+      "epoch": 1.9513314967860422,
+      "grad_norm": 0.23199217161769817,
+      "learning_rate": 5.338022096531028e-06,
+      "loss": 1.4698,
+      "step": 1063
+    },
+    {
+      "epoch": 1.953168044077135,
+      "grad_norm": 0.2211150284889924,
+      "learning_rate": 5.330684642440003e-06,
+      "loss": 1.5595,
+      "step": 1064
+    },
+    {
+      "epoch": 1.9550045913682277,
+      "grad_norm": 0.2340727807305241,
+      "learning_rate": 5.3233464730111426e-06,
+      "loss": 1.5538,
+      "step": 1065
+    },
+    {
+      "epoch": 1.9568411386593205,
+      "grad_norm": 0.19850193970472843,
+      "learning_rate": 5.316007604118393e-06,
+      "loss": 1.3936,
+      "step": 1066
+    },
+    {
+      "epoch": 1.9586776859504131,
+      "grad_norm": 0.25630183426624453,
+      "learning_rate": 5.308668051637213e-06,
+      "loss": 1.4909,
+      "step": 1067
+    },
+    {
+      "epoch": 1.960514233241506,
+      "grad_norm": 0.22594965428724031,
+      "learning_rate": 5.301327831444542e-06,
+      "loss": 1.7039,
+      "step": 1068
+    },
+    {
+      "epoch": 1.9623507805325988,
+      "grad_norm": 0.23074440805443003,
+      "learning_rate": 5.29398695941876e-06,
+      "loss": 1.5709,
+      "step": 1069
+    },
+    {
+      "epoch": 1.9641873278236914,
+      "grad_norm": 0.26738661344456455,
+      "learning_rate": 5.28664545143966e-06,
+      "loss": 1.7282,
+      "step": 1070
+    },
+    {
+      "epoch": 1.966023875114784,
+      "grad_norm": 0.21927989904481265,
+      "learning_rate": 5.279303323388413e-06,
+      "loss": 1.5063,
+      "step": 1071
+    },
+    {
+      "epoch": 1.9678604224058769,
+      "grad_norm": 0.24526255461596225,
+      "learning_rate": 5.271960591147526e-06,
+      "loss": 1.6804,
+      "step": 1072
+    },
+    {
+      "epoch": 1.9696969696969697,
+      "grad_norm": 0.22412531635837937,
+      "learning_rate": 5.2646172706008154e-06,
+      "loss": 1.6874,
+      "step": 1073
+    },
+    {
+      "epoch": 1.9715335169880626,
+      "grad_norm": 0.2423463136545397,
+      "learning_rate": 5.257273377633373e-06,
+      "loss": 1.6347,
+      "step": 1074
+    },
+    {
+      "epoch": 1.9733700642791552,
+      "grad_norm": 0.2356434298789987,
+      "learning_rate": 5.249928928131523e-06,
+      "loss": 1.6048,
+      "step": 1075
+    },
+    {
+      "epoch": 1.9752066115702478,
+      "grad_norm": 0.2247421446617723,
+      "learning_rate": 5.242583937982798e-06,
+      "loss": 1.4817,
+      "step": 1076
+    },
+    {
+      "epoch": 1.9770431588613406,
+      "grad_norm": 0.2083995245522303,
+      "learning_rate": 5.235238423075899e-06,
+      "loss": 1.4,
+      "step": 1077
+    },
+    {
+      "epoch": 1.9788797061524335,
+      "grad_norm": 0.22335002764108108,
+      "learning_rate": 5.227892399300662e-06,
+      "loss": 1.6643,
+      "step": 1078
+    },
+    {
+      "epoch": 1.9807162534435263,
+      "grad_norm": 0.20883722941202967,
+      "learning_rate": 5.220545882548024e-06,
+      "loss": 1.5669,
+      "step": 1079
+    },
+    {
+      "epoch": 1.982552800734619,
+      "grad_norm": 0.2785620551931093,
+      "learning_rate": 5.213198888709989e-06,
+      "loss": 1.7995,
+      "step": 1080
+    },
+    {
+      "epoch": 1.9843893480257115,
+      "grad_norm": 0.2312892155822358,
+      "learning_rate": 5.20585143367959e-06,
+      "loss": 1.2523,
+      "step": 1081
+    },
+    {
+      "epoch": 1.9862258953168044,
+      "grad_norm": 0.2143436580851898,
+      "learning_rate": 5.198503533350859e-06,
+      "loss": 1.4887,
+      "step": 1082
+    },
+    {
+      "epoch": 1.9880624426078972,
+      "grad_norm": 0.2033120640968114,
+      "learning_rate": 5.191155203618796e-06,
+      "loss": 1.1851,
+      "step": 1083
+    },
+    {
+      "epoch": 1.98989898989899,
+      "grad_norm": 0.23804659089259855,
+      "learning_rate": 5.183806460379324e-06,
+      "loss": 1.5419,
+      "step": 1084
+    },
+    {
+      "epoch": 1.9917355371900827,
+      "grad_norm": 0.2600371163336941,
+      "learning_rate": 5.176457319529264e-06,
+      "loss": 1.4584,
+      "step": 1085
+    },
+    {
+      "epoch": 1.9935720844811753,
+      "grad_norm": 0.26448004514082624,
+      "learning_rate": 5.169107796966293e-06,
+      "loss": 1.2834,
+      "step": 1086
+    },
+    {
+      "epoch": 1.9954086317722681,
+      "grad_norm": 0.21200061804783102,
+      "learning_rate": 5.161757908588917e-06,
+      "loss": 1.567,
+      "step": 1087
+    },
+    {
+      "epoch": 1.997245179063361,
+      "grad_norm": 0.24261676308036623,
+      "learning_rate": 5.154407670296434e-06,
+      "loss": 1.567,
+      "step": 1088
+    },
+    {
+      "epoch": 1.997245179063361,
+      "eval_loss": 2.2809505462646484,
+      "eval_runtime": 42.8979,
+      "eval_samples_per_second": 4.779,
+      "eval_steps_per_second": 0.42,
+      "step": 1088
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 2176,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 4,
+  "save_steps": 272,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 943599450193920.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}
diff --git a/checkpoint-1088/training_args.bin b/checkpoint-1088/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1c89872f76294700d651f52629596dab54835031
--- /dev/null
+++ b/checkpoint-1088/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b66afbb22c27fefe6b63f9f74c2fd602fa1f166c83cc37801706b6aea4e033c
+size 8632
diff --git a/checkpoint-1088/zero_to_fp32.py b/checkpoint-1088/zero_to_fp32.py
new file mode 100644
index 0000000000000000000000000000000000000000..e69ecd9acb5a235ffbf927091051106d902b3d39
--- /dev/null
+++ b/checkpoint-1088/zero_to_fp32.py
@@ -0,0 +1,674 @@
+#!/usr/bin/env python
+
+# Copyright (c) Microsoft Corporation.
+# SPDX-License-Identifier: Apache-2.0
+
+# DeepSpeed Team
+
+# This script extracts fp32 consolidated weights from a zero 1, 2 and 3 DeepSpeed checkpoints. It gets
+# copied into the top level checkpoint dir, so the user can easily do the conversion at any point in
+# the future. Once extracted, the weights don't require DeepSpeed and can be used in any
+# application.
+#
+# example:
+#   python zero_to_fp32.py . output_dir/
+#   or
+#   python zero_to_fp32.py . output_dir/ --safe_serialization
+
+import argparse
+import torch
+import glob
+import math
+import os
+import re
+import json
+from tqdm import tqdm
+from collections import OrderedDict
+from dataclasses import dataclass
+
+# while this script doesn't use deepspeed to recover data, since the checkpoints are pickled with
+# DeepSpeed data structures it has to be available in the current python environment.
+from deepspeed.utils import logger
+from deepspeed.checkpoint.constants import (DS_VERSION, OPTIMIZER_STATE_DICT, SINGLE_PARTITION_OF_FP32_GROUPS,
+                                            FP32_FLAT_GROUPS, ZERO_STAGE, PARTITION_COUNT, PARAM_SHAPES, BUFFER_NAMES,
+                                            FROZEN_PARAM_SHAPES, FROZEN_PARAM_FRAGMENTS)
+
+
+@dataclass
+class zero_model_state:
+    buffers: dict()
+    param_shapes: dict()
+    shared_params: list
+    ds_version: int
+    frozen_param_shapes: dict()
+    frozen_param_fragments: dict()
+
+
+debug = 0
+
+# load to cpu
+device = torch.device('cpu')
+
+
+def atoi(text):
+    return int(text) if text.isdigit() else text
+
+
+def natural_keys(text):
+    '''
+    alist.sort(key=natural_keys) sorts in human order
+    http://nedbatchelder.com/blog/200712/human_sorting.html
+    (See Toothy's implementation in the comments)
+    '''
+    return [atoi(c) for c in re.split(r'(\d+)', text)]
+
+
+def get_model_state_file(checkpoint_dir, zero_stage):
+    if not os.path.isdir(checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{checkpoint_dir}' doesn't exist")
+
+    # there should be only one file
+    if zero_stage <= 2:
+        file = os.path.join(checkpoint_dir, "mp_rank_00_model_states.pt")
+    elif zero_stage == 3:
+        file = os.path.join(checkpoint_dir, "zero_pp_rank_0_mp_rank_00_model_states.pt")
+
+    if not os.path.exists(file):
+        raise FileNotFoundError(f"can't find model states file at '{file}'")
+
+    return file
+
+
+def get_checkpoint_files(checkpoint_dir, glob_pattern):
+    # XXX: need to test that this simple glob rule works for multi-node setup too
+    ckpt_files = sorted(glob.glob(os.path.join(checkpoint_dir, glob_pattern)), key=natural_keys)
+
+    if len(ckpt_files) == 0:
+        raise FileNotFoundError(f"can't find {glob_pattern} files in directory '{checkpoint_dir}'")
+
+    return ckpt_files
+
+
+def get_optim_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_optim_states.pt")
+
+
+def get_model_state_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_model_states.pt")
+
+
+def parse_model_states(files):
+    zero_model_states = []
+    for file in files:
+        state_dict = torch.load(file, map_location=device)
+
+        if BUFFER_NAMES not in state_dict:
+            raise ValueError(f"{file} is not a model state checkpoint")
+        buffer_names = state_dict[BUFFER_NAMES]
+        if debug:
+            print("Found buffers:", buffer_names)
+
+        # recover just the buffers while restoring them to fp32 if they were saved in fp16
+        buffers = {k: v.float() for k, v in state_dict["module"].items() if k in buffer_names}
+        param_shapes = state_dict[PARAM_SHAPES]
+
+        # collect parameters that are included in param_shapes
+        param_names = []
+        for s in param_shapes:
+            for name in s.keys():
+                param_names.append(name)
+
+        # update with frozen parameters
+        frozen_param_shapes = state_dict.get(FROZEN_PARAM_SHAPES, None)
+        if frozen_param_shapes is not None:
+            if debug:
+                print(f"Found frozen_param_shapes: {frozen_param_shapes}")
+            param_names += list(frozen_param_shapes.keys())
+
+        # handle shared params
+        shared_params = [[k, v] for k, v in state_dict["shared_params"].items()]
+
+        ds_version = state_dict.get(DS_VERSION, None)
+
+        frozen_param_fragments = state_dict.get(FROZEN_PARAM_FRAGMENTS, None)
+
+        z_model_state = zero_model_state(buffers=buffers,
+                                         param_shapes=param_shapes,
+                                         shared_params=shared_params,
+                                         ds_version=ds_version,
+                                         frozen_param_shapes=frozen_param_shapes,
+                                         frozen_param_fragments=frozen_param_fragments)
+        zero_model_states.append(z_model_state)
+
+    return zero_model_states
+
+
+def parse_optim_states(files, ds_checkpoint_dir):
+    total_files = len(files)
+    state_dicts = []
+    for f in files:
+        state_dict = torch.load(f, map_location=device)
+        # immediately discard the potentially huge 2 optimizer states as we only care for fp32 master weights
+        # and also handle the case where it was already removed by another helper script
+        state_dict["optimizer_state_dict"].pop("optimizer_state_dict", None)
+        state_dicts.append(state_dict)
+
+    if not ZERO_STAGE in state_dicts[0][OPTIMIZER_STATE_DICT]:
+        raise ValueError(f"{files[0]} is not a zero checkpoint")
+    zero_stage = state_dicts[0][OPTIMIZER_STATE_DICT][ZERO_STAGE]
+    world_size = state_dicts[0][OPTIMIZER_STATE_DICT][PARTITION_COUNT]
+
+    # For ZeRO-2 each param group can have different partition_count as data parallelism for expert
+    # parameters can be different from data parallelism for non-expert parameters. So we can just
+    # use the max of the partition_count to get the dp world_size.
+
+    if type(world_size) is list:
+        world_size = max(world_size)
+
+    if world_size != total_files:
+        raise ValueError(
+            f"Expected {world_size} of '*_optim_states.pt' under '{ds_checkpoint_dir}' but found {total_files} files. "
+            "Possibly due to an overwrite of an old checkpoint, or a checkpoint didn't get saved by one or more processes."
+        )
+
+    # the groups are named differently in each stage
+    if zero_stage <= 2:
+        fp32_groups_key = SINGLE_PARTITION_OF_FP32_GROUPS
+    elif zero_stage == 3:
+        fp32_groups_key = FP32_FLAT_GROUPS
+    else:
+        raise ValueError(f"unknown zero stage {zero_stage}")
+
+    if zero_stage <= 2:
+        fp32_flat_groups = [state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key] for i in range(len(state_dicts))]
+    elif zero_stage == 3:
+        # if there is more than one param group, there will be multiple flattened tensors - one
+        # flattened tensor per group - for simplicity merge them into a single tensor
+        #
+        # XXX: could make the script more memory efficient for when there are multiple groups - it
+        # will require matching the sub-lists of param_shapes for each param group flattened tensor
+
+        fp32_flat_groups = [
+            torch.cat(state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key], 0) for i in range(len(state_dicts))
+        ]
+
+    return zero_stage, world_size, fp32_flat_groups
+
+
+def _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters):
+    """
+    Returns fp32 state_dict reconstructed from ds checkpoint
+
+    Args:
+        - ``ds_checkpoint_dir``: path to the deepspeed checkpoint folder (where the optimizer files are)
+
+    """
+    print(f"Processing zero checkpoint '{ds_checkpoint_dir}'")
+
+    optim_files = get_optim_files(ds_checkpoint_dir)
+    zero_stage, world_size, fp32_flat_groups = parse_optim_states(optim_files, ds_checkpoint_dir)
+    print(f"Detected checkpoint of type zero stage {zero_stage}, world_size: {world_size}")
+
+    model_files = get_model_state_files(ds_checkpoint_dir)
+
+    zero_model_states = parse_model_states(model_files)
+    print(f'Parsing checkpoint created by deepspeed=={zero_model_states[0].ds_version}')
+
+    if zero_stage <= 2:
+        return _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+    elif zero_stage == 3:
+        return _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+
+
+def _zero2_merge_frozen_params(state_dict, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+    frozen_param_fragments = zero_model_states[0].frozen_param_fragments
+
+    if debug:
+        num_elem = sum(s.numel() for s in frozen_param_shapes.values())
+        print(f'rank 0: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in frozen_param_fragments.values()])
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        state_dict[name] = frozen_param_fragments[name]
+
+        if debug:
+            print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _has_callable(obj, fn):
+    attr = getattr(obj, fn, None)
+    return callable(attr)
+
+
+def _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+
+    # Reconstruction protocol:
+    #
+    # XXX: document this
+
+    if debug:
+        for i in range(world_size):
+            for j in range(len(fp32_flat_groups[0])):
+                print(f"{FP32_FLAT_GROUPS}[{i}][{j}].shape={fp32_flat_groups[i][j].shape}")
+
+    # XXX: memory usage doubles here (zero2)
+    num_param_groups = len(fp32_flat_groups[0])
+    merged_single_partition_of_fp32_groups = []
+    for i in range(num_param_groups):
+        merged_partitions = [sd[i] for sd in fp32_flat_groups]
+        full_single_fp32_vector = torch.cat(merged_partitions, 0)
+        merged_single_partition_of_fp32_groups.append(full_single_fp32_vector)
+    avail_numel = sum(
+        [full_single_fp32_vector.numel() for full_single_fp32_vector in merged_single_partition_of_fp32_groups])
+
+    if debug:
+        wanted_params = sum([len(shapes) for shapes in param_shapes])
+        wanted_numel = sum([sum(shape.numel() for shape in shapes.values()) for shapes in param_shapes])
+        # not asserting if there is a mismatch due to possible padding
+        print(f"Have {avail_numel} numels to process.")
+        print(f"Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    total_numel = 0
+    total_params = 0
+    for shapes, full_single_fp32_vector in zip(param_shapes, merged_single_partition_of_fp32_groups):
+        offset = 0
+        avail_numel = full_single_fp32_vector.numel()
+        for name, shape in shapes.items():
+
+            unpartitioned_numel = shape.numel() if _has_callable(shape, 'numel') else math.prod(shape)
+            total_numel += unpartitioned_numel
+            total_params += 1
+
+            if debug:
+                print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+            state_dict[name] = full_single_fp32_vector.narrow(0, offset, unpartitioned_numel).view(shape)
+            offset += unpartitioned_numel
+
+        # Z2 started to align to 2*world_size to improve nccl performance. Therefore both offset and
+        # avail_numel can differ by anywhere between 0..2*world_size. Due to two unrelated complex
+        # paddings performed in the code it's almost impossible to predict the exact numbers w/o the
+        # live optimizer object, so we are checking that the numbers are within the right range
+        align_to = 2 * world_size
+
+        def zero2_align(x):
+            return align_to * math.ceil(x / align_to)
+
+        if debug:
+            print(f"original offset={offset}, avail_numel={avail_numel}")
+
+        offset = zero2_align(offset)
+        avail_numel = zero2_align(avail_numel)
+
+        if debug:
+            print(f"aligned  offset={offset}, avail_numel={avail_numel}")
+
+        # Sanity check
+        if offset != avail_numel:
+            raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero2_merge_frozen_params(state_dict, zero_model_states)
+
+    _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def zero3_partitioned_param_info(unpartitioned_numel, world_size):
+    remainder = unpartitioned_numel % world_size
+    padding_numel = (world_size - remainder) if remainder else 0
+    partitioned_numel = math.ceil(unpartitioned_numel / world_size)
+    return partitioned_numel, padding_numel
+
+
+def _zero3_merge_frozen_params(state_dict, world_size, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    if debug:
+        for i in range(world_size):
+            num_elem = sum(s.numel() for s in zero_model_states[i].frozen_param_fragments.values())
+            print(f'rank {i}: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in zero_model_states[0].frozen_param_fragments.values()]) * world_size
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in zero_model_states[0].frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        param_frags = tuple(model_state.frozen_param_fragments[name] for model_state in zero_model_states)
+        state_dict[name] = torch.cat(param_frags, 0).narrow(0, 0, unpartitioned_numel).view(shape)
+
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Frozen params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+    avail_numel = fp32_flat_groups[0].numel() * world_size
+    # Reconstruction protocol: For zero3 we need to zip the partitions together at boundary of each
+    # param, re-consolidating each param, while dealing with padding if any
+
+    # merge list of dicts, preserving order
+    param_shapes = {k: v for d in param_shapes for k, v in d.items()}
+
+    if debug:
+        for i in range(world_size):
+            print(f"{FP32_FLAT_GROUPS}[{i}].shape={fp32_flat_groups[i].shape}")
+
+        wanted_params = len(param_shapes)
+        wanted_numel = sum(shape.numel() for shape in param_shapes.values())
+        # not asserting if there is a mismatch due to possible padding
+        avail_numel = fp32_flat_groups[0].numel() * world_size
+        print(f"Trainable params: Have {avail_numel} numels to process.")
+        print(f"Trainable params: Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    offset = 0
+    total_numel = 0
+    total_params = 0
+    for name, shape in tqdm(param_shapes.items(), desc='Gathering Sharded Weights'):
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+        total_params += 1
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Trainable params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+        # XXX: memory usage doubles here
+        state_dict[name] = torch.cat(
+            tuple(fp32_flat_groups[i].narrow(0, offset, partitioned_numel) for i in range(world_size)),
+            0).narrow(0, 0, unpartitioned_numel).view(shape)
+        offset += partitioned_numel
+
+    offset *= world_size
+
+    # Sanity check
+    if offset != avail_numel:
+        raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed Trainable fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero3_merge_frozen_params(state_dict, world_size, zero_model_states)
+
+    _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag=None, exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated state_dict that can be loaded with
+    ``load_state_dict()`` and used for training without DeepSpeed or shared with others, for example
+    via a model hub.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in 'latest' file. e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+
+    Returns:
+        - pytorch ``state_dict``
+
+    Note: this approach may not work if your application doesn't have sufficient free CPU memory and
+    you may need to use the offline approach using the ``zero_to_fp32.py`` script that is saved with
+    the checkpoint.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import get_fp32_state_dict_from_zero_checkpoint
+        # do the training and checkpoint saving
+        state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir) # already on cpu
+        model = model.cpu() # move to cpu
+        model.load_state_dict(state_dict)
+        # submit to model hub or save the model to share with others
+
+    In this example the ``model`` will no longer be usable in the deepspeed context of the same
+    application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    If you want it all done for you, use ``load_state_dict_from_zero_checkpoint`` instead.
+
+    """
+    if tag is None:
+        latest_path = os.path.join(checkpoint_dir, 'latest')
+        if os.path.isfile(latest_path):
+            with open(latest_path, 'r') as fd:
+                tag = fd.read().strip()
+        else:
+            raise ValueError(f"Unable to find 'latest' file at {latest_path}")
+
+    ds_checkpoint_dir = os.path.join(checkpoint_dir, tag)
+
+    if not os.path.isdir(ds_checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{ds_checkpoint_dir}' doesn't exist")
+
+    return _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters)
+
+
+def convert_zero_checkpoint_to_fp32_state_dict(checkpoint_dir,
+                                               output_dir,
+                                               max_shard_size="5GB",
+                                               safe_serialization=False,
+                                               tag=None,
+                                               exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict`` file that can be
+    loaded with ``torch.load(file)`` + ``load_state_dict()`` and used for training without DeepSpeed.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``output_dir``: directory to the pytorch fp32 state_dict output files
+        - ``max_shard_size``: the maximum size for a checkpoint before being sharded, default value is 5GB
+        - ``safe_serialization``:  whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+    """
+    # Dependency pre-check
+    if safe_serialization:
+        try:
+            from safetensors.torch import save_file
+        except ImportError:
+            print('If you want to use `safe_serialization`, please `pip install safetensors`')
+            raise
+    if max_shard_size is not None:
+        try:
+            from huggingface_hub import split_torch_state_dict_into_shards
+        except ImportError:
+            print('If you want to use `max_shard_size`, please `pip install huggingface_hub`')
+            raise
+
+    # Convert zero checkpoint to state_dict
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag, exclude_frozen_parameters)
+
+    # Shard the model if it is too big.
+    weights_name = "model.safetensors" if safe_serialization else "pytorch_model.bin"
+    if max_shard_size is not None:
+        filename_pattern = weights_name.replace(".bin", "{suffix}.bin").replace(".safetensors", "{suffix}.safetensors")
+        state_dict_split = split_torch_state_dict_into_shards(state_dict,
+                                                              filename_pattern=filename_pattern,
+                                                              max_shard_size=max_shard_size)
+    else:
+        from collections import namedtuple
+        StateDictSplit = namedtuple("StateDictSplit", ["is_sharded", "filename_to_tensors"])
+        state_dict_split = StateDictSplit(is_sharded=False,
+                                          filename_to_tensors={weights_name: list(state_dict.keys())})
+
+    # Save the model
+    filename_to_tensors = state_dict_split.filename_to_tensors.items()
+    for shard_file, tensors in tqdm(filename_to_tensors, desc="Saving checkpoint shards"):
+        shard = {tensor: state_dict[tensor].contiguous() for tensor in tensors}
+        output_path = os.path.join(output_dir, shard_file)
+        if safe_serialization:
+            save_file(shard, output_path, metadata={"format": "pt"})
+        else:
+            torch.save(shard, output_path)
+
+    # Save index if sharded
+    if state_dict_split.is_sharded:
+        index = {
+            "metadata": state_dict_split.metadata,
+            "weight_map": state_dict_split.tensor_to_filename,
+        }
+        save_index_file = "model.safetensors.index.json" if safe_serialization else "pytorch_model.bin.index.json"
+        save_index_file = os.path.join(output_dir, save_index_file)
+        with open(save_index_file, "w", encoding="utf-8") as f:
+            content = json.dumps(index, indent=2, sort_keys=True) + "\n"
+            f.write(content)
+
+
+def load_state_dict_from_zero_checkpoint(model, checkpoint_dir, tag=None):
+    """
+    1. Put the provided model to cpu
+    2. Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict``
+    3. Load it into the provided model
+
+    Args:
+        - ``model``: the model object to update
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+
+    Returns:
+        - ``model`: modified model
+
+    Make sure you have plenty of CPU memory available before you call this function. If you don't
+    have enough use the ``zero_to_fp32.py`` utility to do the conversion. You will find it
+    conveniently placed for you in the checkpoint folder.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import load_state_dict_from_zero_checkpoint
+        model = load_state_dict_from_zero_checkpoint(trainer.model, checkpoint_dir)
+        # submit to model hub or save the model to share with others
+
+    Note, that once this was run, the ``model`` will no longer be usable in the deepspeed context
+    of the same application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    """
+    logger.info(f"Extracting fp32 weights")
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag)
+
+    logger.info(f"Overwriting model with fp32 weights")
+    model = model.cpu()
+    model.load_state_dict(state_dict, strict=False)
+
+    return model
+
+
+if __name__ == "__main__":
+    parser = argparse.ArgumentParser()
+    parser.add_argument("checkpoint_dir",
+                        type=str,
+                        help="path to the desired checkpoint folder, e.g., path/checkpoint-12")
+    parser.add_argument("output_dir",
+                        type=str,
+                        help="directory to the pytorch fp32 state_dict output files"
+                        "(e.g. path/checkpoint-12-output/)")
+    parser.add_argument(
+        "--max_shard_size",
+        type=str,
+        default="5GB",
+        help="The maximum size for a checkpoint before being sharded. Checkpoints shard will then be each of size"
+        "lower than this size. If expressed as a string, needs to be digits followed by a unit (like `5MB`"
+        "We default it to 5GB in order for models to be able to run easily on free-tier google colab instances"
+        "without CPU OOM issues.")
+    parser.add_argument(
+        "--safe_serialization",
+        default=False,
+        action='store_true',
+        help="Whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).")
+    parser.add_argument("-t",
+                        "--tag",
+                        type=str,
+                        default=None,
+                        help="checkpoint tag used as a unique identifier for checkpoint. e.g., global_step1")
+    parser.add_argument("--exclude_frozen_parameters", action='store_true', help="exclude frozen parameters")
+    parser.add_argument("-d", "--debug", action='store_true', help="enable debug")
+    args = parser.parse_args()
+
+    debug = args.debug
+
+    convert_zero_checkpoint_to_fp32_state_dict(args.checkpoint_dir,
+                                               args.output_dir,
+                                               max_shard_size=args.max_shard_size,
+                                               safe_serialization=args.safe_serialization,
+                                               tag=args.tag,
+                                               exclude_frozen_parameters=args.exclude_frozen_parameters)
diff --git a/checkpoint-272/README.md b/checkpoint-272/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9ffaf32045885341f44f9850f1ee3bc5e6ffa9dd
--- /dev/null
+++ b/checkpoint-272/README.md
@@ -0,0 +1,202 @@
+---
+base_model: PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1
\ No newline at end of file
diff --git a/checkpoint-272/adapter_config.json b/checkpoint-272/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..1c579cbcbf6740cc6c934f1581b6cf66e692fe73
--- /dev/null
+++ b/checkpoint-272/adapter_config.json
@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "PocketDoc/Dans-PersonalityEngine-V1.1.0-12b",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": null,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "down_proj",
+    "v_proj",
+    "o_proj",
+    "up_proj",
+    "k_proj",
+    "gate_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": true
+}
\ No newline at end of file
diff --git a/checkpoint-272/adapter_model.safetensors b/checkpoint-272/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..058ff1e95df0d03f808f7b044ae913310d025f05
--- /dev/null
+++ b/checkpoint-272/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d4509fa43889510cbe8084001a29ba1b970cb1d6701bba5c2f96fd697bd122a4
+size 912337968
diff --git a/checkpoint-272/global_step272/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt b/checkpoint-272/global_step272/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..a4f02fc698dc0c69d69fdeea6cee98a6fd167fb3
--- /dev/null
+++ b/checkpoint-272/global_step272/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed1e0aa003b10295f108471220b4264545082d8bb8ffb67407be4572cd8b84ee
+size 536671408
diff --git a/checkpoint-272/global_step272/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt b/checkpoint-272/global_step272/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..5e6783341f20cc3d75debee885f02a5c92902366
--- /dev/null
+++ b/checkpoint-272/global_step272/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8c316bc97bf822bcbe8b24595f2991290836d532fcd9a93a23ee70d5b2a81eac
+size 536671408
diff --git a/checkpoint-272/global_step272/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt b/checkpoint-272/global_step272/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ca2a842236e83f620dbf6889bb8ce4aef28fdf2a
--- /dev/null
+++ b/checkpoint-272/global_step272/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ac2361546bcfd0b09fad8d6ff0fc4649246e4e3caee4f10b4dc36c7e9148f215
+size 536671408
diff --git a/checkpoint-272/global_step272/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt b/checkpoint-272/global_step272/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..839f213996c6713cf6a94ab05e57df26e55a3f8d
--- /dev/null
+++ b/checkpoint-272/global_step272/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3fac28a0b0ce9d3f712d5ade0d5da00b442e436ccfc37173aefccf0ba67c5b37
+size 536671408
diff --git a/checkpoint-272/global_step272/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt b/checkpoint-272/global_step272/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..4342a644891a2a24e66c8a66cb904ee72f76799f
--- /dev/null
+++ b/checkpoint-272/global_step272/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:baf214a7112b5e98371466f98f4fac3bf480f9ff8e0a20b17999a5e6424b0b8a
+size 536671408
diff --git a/checkpoint-272/global_step272/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt b/checkpoint-272/global_step272/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7baa6ae2cbc7d1577341e25f24007751f0935850
--- /dev/null
+++ b/checkpoint-272/global_step272/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec4bbf0f14b84683d8e165189c4bf1d3ff456ad2297ca096308ace1e756a9fd5
+size 536671408
diff --git a/checkpoint-272/global_step272/zero_pp_rank_0_mp_rank_00_model_states.pt b/checkpoint-272/global_step272/zero_pp_rank_0_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..47b3106253242c2ce859ef337e15a0dc9eff3b84
--- /dev/null
+++ b/checkpoint-272/global_step272/zero_pp_rank_0_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33778d72706fad5543923ba3dc75e8cbf827de0a6f25384ce8738efe35b9f5f1
+size 557022
diff --git a/checkpoint-272/global_step272/zero_pp_rank_1_mp_rank_00_model_states.pt b/checkpoint-272/global_step272/zero_pp_rank_1_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..240fb080d65f4a7552479969cf652b45f772b517
--- /dev/null
+++ b/checkpoint-272/global_step272/zero_pp_rank_1_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:02d676aeb1b3211a11ea156be94187629a51946cf9aa12865a5ca1aebb44f6d6
+size 557022
diff --git a/checkpoint-272/global_step272/zero_pp_rank_2_mp_rank_00_model_states.pt b/checkpoint-272/global_step272/zero_pp_rank_2_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ae810015808e56e8f2b2c5669f7334196aba16a1
--- /dev/null
+++ b/checkpoint-272/global_step272/zero_pp_rank_2_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc270bb63590bade614116e5ca28e6f44d592465e5239c75706e12c5f26cd2d6
+size 557022
diff --git a/checkpoint-272/global_step272/zero_pp_rank_3_mp_rank_00_model_states.pt b/checkpoint-272/global_step272/zero_pp_rank_3_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..778a9d7e5adc80ba5c694f67ba9d7c8a1a462ed1
--- /dev/null
+++ b/checkpoint-272/global_step272/zero_pp_rank_3_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e35cf2f54114b3507dc841bdbd0b50d7e51d54768432ba0f6c1199ce61d6424
+size 557022
diff --git a/checkpoint-272/global_step272/zero_pp_rank_4_mp_rank_00_model_states.pt b/checkpoint-272/global_step272/zero_pp_rank_4_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..1e84baa967fbe7676e227b1249c17890f005b8d5
--- /dev/null
+++ b/checkpoint-272/global_step272/zero_pp_rank_4_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fcb5b4206ff8a6fbf033ea196505f7f68475d92cc85880807a0372c8c063d6c
+size 557022
diff --git a/checkpoint-272/global_step272/zero_pp_rank_5_mp_rank_00_model_states.pt b/checkpoint-272/global_step272/zero_pp_rank_5_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..fc57ef16d28f4cf0f00ad10216c8b0c2d9e84f48
--- /dev/null
+++ b/checkpoint-272/global_step272/zero_pp_rank_5_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:38f9e69789f0f57bdcde9c04c0bd3ca6bec4e6d5c9c924fdef11646ad428326a
+size 557022
diff --git a/checkpoint-272/latest b/checkpoint-272/latest
new file mode 100644
index 0000000000000000000000000000000000000000..27efce4d2a5eafcfb9852baec1b0d40102e85f5d
--- /dev/null
+++ b/checkpoint-272/latest
@@ -0,0 +1 @@
+global_step272
\ No newline at end of file
diff --git a/checkpoint-272/rng_state_0.pth b/checkpoint-272/rng_state_0.pth
new file mode 100644
index 0000000000000000000000000000000000000000..72e0cc23377845f055c1f5f6bf19509c1caf1b30
--- /dev/null
+++ b/checkpoint-272/rng_state_0.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb3331bd90ddc286272b6cce86ab2170797eb38c76c233c76e6d43208f9edc1b
+size 15472
diff --git a/checkpoint-272/rng_state_1.pth b/checkpoint-272/rng_state_1.pth
new file mode 100644
index 0000000000000000000000000000000000000000..5913db1ba140cc37b80e5b3d72c971796b9b1cb9
--- /dev/null
+++ b/checkpoint-272/rng_state_1.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec564fdbfb8acb40e2f030d9f034018e184b3d237a857e3413591f3b433e7311
+size 15472
diff --git a/checkpoint-272/rng_state_2.pth b/checkpoint-272/rng_state_2.pth
new file mode 100644
index 0000000000000000000000000000000000000000..ee781917d6453fadced3c82ac210cf5b93366e47
--- /dev/null
+++ b/checkpoint-272/rng_state_2.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a57cb2b0dbfb931751746effb17eb49dfcf0d167caa9a0e2f8e80012e1889ce
+size 15472
diff --git a/checkpoint-272/rng_state_3.pth b/checkpoint-272/rng_state_3.pth
new file mode 100644
index 0000000000000000000000000000000000000000..e657a85b65c1792445cd10381c57d8f60b40cb3c
--- /dev/null
+++ b/checkpoint-272/rng_state_3.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f128506fa80390d1d034b8c4dcd8c83ff2914e1242c287690073a6c083e3c08d
+size 15472
diff --git a/checkpoint-272/rng_state_4.pth b/checkpoint-272/rng_state_4.pth
new file mode 100644
index 0000000000000000000000000000000000000000..9bec556bee9f30e863e6b885d4f1f2dea3b71de9
--- /dev/null
+++ b/checkpoint-272/rng_state_4.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:64d503e8272bcaca274d0ad05558e1faeb71ba67aca4b066b04d49ffc95d09be
+size 15472
diff --git a/checkpoint-272/rng_state_5.pth b/checkpoint-272/rng_state_5.pth
new file mode 100644
index 0000000000000000000000000000000000000000..6d692d456629fd27e53011fa89da8a2c6a7e4aba
--- /dev/null
+++ b/checkpoint-272/rng_state_5.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd51918d53102d96b3931a2ccf3d9d0dea9b8c22ee80d54faa80bde558cb5201
+size 15472
diff --git a/checkpoint-272/scheduler.pt b/checkpoint-272/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ae3ea5b0c053b2896cb66cb2f08e642ac8da0c5f
--- /dev/null
+++ b/checkpoint-272/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd2ae808741e5dfa06c31e3ddee466d88671f46a0e925d59061fc4e20eb9723f
+size 1064
diff --git a/checkpoint-272/special_tokens_map.json b/checkpoint-272/special_tokens_map.json
new file mode 100644
index 0000000000000000000000000000000000000000..547986c0f0567961dd9ff48218defed8e4d5aa59
--- /dev/null
+++ b/checkpoint-272/special_tokens_map.json
@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}
diff --git a/checkpoint-272/tokenizer.json b/checkpoint-272/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..cff17babe3bd564f7a3005727b02f44432e0facf
--- /dev/null
+++ b/checkpoint-272/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee57bd3271d8c200a06df40f9d7c94f8bb8f085b5cfb2d40907a794560df2ec3
+size 17078342
diff --git a/checkpoint-272/tokenizer_config.json b/checkpoint-272/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..0f13a1776083b5998049a3aad730d95f5e74f8cd
--- /dev/null
+++ b/checkpoint-272/tokenizer_config.json
@@ -0,0 +1,8016 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "<SPECIAL_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "5": {
+      "content": "[AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "[/AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "[TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "8": {
+      "content": "[/TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "9": {
+      "content": "[TOOL_CALLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "10": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "11": {
+      "content": "[PREFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "12": {
+      "content": "[MIDDLE]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "13": {
+      "content": "[SUFFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "14": {
+      "content": "<SPECIAL_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "15": {
+      "content": "<SPECIAL_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "16": {
+      "content": "<SPECIAL_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "17": {
+      "content": "<SPECIAL_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "18": {
+      "content": "<SPECIAL_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "19": {
+      "content": "<SPECIAL_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "20": {
+      "content": "<SPECIAL_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "21": {
+      "content": "<SPECIAL_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "22": {
+      "content": "<SPECIAL_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "23": {
+      "content": "<SPECIAL_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "24": {
+      "content": "<SPECIAL_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "25": {
+      "content": "<SPECIAL_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "26": {
+      "content": "<SPECIAL_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "27": {
+      "content": "<SPECIAL_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "28": {
+      "content": "<SPECIAL_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "29": {
+      "content": "<SPECIAL_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "30": {
+      "content": "<SPECIAL_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "31": {
+      "content": "<SPECIAL_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32": {
+      "content": "<SPECIAL_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "33": {
+      "content": "<SPECIAL_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "34": {
+      "content": "<SPECIAL_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "35": {
+      "content": "<SPECIAL_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "36": {
+      "content": "<SPECIAL_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "37": {
+      "content": "<SPECIAL_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "38": {
+      "content": "<SPECIAL_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "39": {
+      "content": "<SPECIAL_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "40": {
+      "content": "<SPECIAL_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "41": {
+      "content": "<SPECIAL_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "42": {
+      "content": "<SPECIAL_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "43": {
+      "content": "<SPECIAL_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "44": {
+      "content": "<SPECIAL_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "45": {
+      "content": "<SPECIAL_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "46": {
+      "content": "<SPECIAL_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "47": {
+      "content": "<SPECIAL_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "48": {
+      "content": "<SPECIAL_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49": {
+      "content": "<SPECIAL_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50": {
+      "content": "<SPECIAL_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "51": {
+      "content": "<SPECIAL_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "52": {
+      "content": "<SPECIAL_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "53": {
+      "content": "<SPECIAL_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "54": {
+      "content": "<SPECIAL_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "55": {
+      "content": "<SPECIAL_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "56": {
+      "content": "<SPECIAL_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "57": {
+      "content": "<SPECIAL_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "58": {
+      "content": "<SPECIAL_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "59": {
+      "content": "<SPECIAL_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "60": {
+      "content": "<SPECIAL_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "61": {
+      "content": "<SPECIAL_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "62": {
+      "content": "<SPECIAL_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "63": {
+      "content": "<SPECIAL_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "64": {
+      "content": "<SPECIAL_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "65": {
+      "content": "<SPECIAL_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "66": {
+      "content": "<SPECIAL_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "67": {
+      "content": "<SPECIAL_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "68": {
+      "content": "<SPECIAL_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "69": {
+      "content": "<SPECIAL_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "70": {
+      "content": "<SPECIAL_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "71": {
+      "content": "<SPECIAL_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "72": {
+      "content": "<SPECIAL_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "73": {
+      "content": "<SPECIAL_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "74": {
+      "content": "<SPECIAL_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "75": {
+      "content": "<SPECIAL_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "76": {
+      "content": "<SPECIAL_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "77": {
+      "content": "<SPECIAL_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "78": {
+      "content": "<SPECIAL_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "79": {
+      "content": "<SPECIAL_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "80": {
+      "content": "<SPECIAL_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "81": {
+      "content": "<SPECIAL_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "82": {
+      "content": "<SPECIAL_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "83": {
+      "content": "<SPECIAL_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "84": {
+      "content": "<SPECIAL_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "85": {
+      "content": "<SPECIAL_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "86": {
+      "content": "<SPECIAL_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "87": {
+      "content": "<SPECIAL_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "88": {
+      "content": "<SPECIAL_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "89": {
+      "content": "<SPECIAL_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "90": {
+      "content": "<SPECIAL_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "91": {
+      "content": "<SPECIAL_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "92": {
+      "content": "<SPECIAL_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "93": {
+      "content": "<SPECIAL_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "94": {
+      "content": "<SPECIAL_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "95": {
+      "content": "<SPECIAL_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "96": {
+      "content": "<SPECIAL_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "97": {
+      "content": "<SPECIAL_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "98": {
+      "content": "<SPECIAL_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "99": {
+      "content": "<SPECIAL_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "<SPECIAL_100>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "<SPECIAL_101>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "<SPECIAL_102>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "<SPECIAL_103>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "104": {
+      "content": "<SPECIAL_104>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "105": {
+      "content": "<SPECIAL_105>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "106": {
+      "content": "<SPECIAL_106>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "107": {
+      "content": "<SPECIAL_107>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "108": {
+      "content": "<SPECIAL_108>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "109": {
+      "content": "<SPECIAL_109>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "110": {
+      "content": "<SPECIAL_110>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "111": {
+      "content": "<SPECIAL_111>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "112": {
+      "content": "<SPECIAL_112>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "113": {
+      "content": "<SPECIAL_113>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "114": {
+      "content": "<SPECIAL_114>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "115": {
+      "content": "<SPECIAL_115>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "116": {
+      "content": "<SPECIAL_116>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "117": {
+      "content": "<SPECIAL_117>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "118": {
+      "content": "<SPECIAL_118>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "119": {
+      "content": "<SPECIAL_119>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "120": {
+      "content": "<SPECIAL_120>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "121": {
+      "content": "<SPECIAL_121>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "122": {
+      "content": "<SPECIAL_122>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "123": {
+      "content": "<SPECIAL_123>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "124": {
+      "content": "<SPECIAL_124>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "125": {
+      "content": "<SPECIAL_125>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "126": {
+      "content": "<SPECIAL_126>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "127": {
+      "content": "<SPECIAL_127>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128": {
+      "content": "<SPECIAL_128>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "129": {
+      "content": "<SPECIAL_129>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "130": {
+      "content": "<SPECIAL_130>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "131": {
+      "content": "<SPECIAL_131>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "132": {
+      "content": "<SPECIAL_132>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "133": {
+      "content": "<SPECIAL_133>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "134": {
+      "content": "<SPECIAL_134>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "135": {
+      "content": "<SPECIAL_135>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "136": {
+      "content": "<SPECIAL_136>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "137": {
+      "content": "<SPECIAL_137>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "138": {
+      "content": "<SPECIAL_138>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "139": {
+      "content": "<SPECIAL_139>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "140": {
+      "content": "<SPECIAL_140>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "141": {
+      "content": "<SPECIAL_141>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "142": {
+      "content": "<SPECIAL_142>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "143": {
+      "content": "<SPECIAL_143>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144": {
+      "content": "<SPECIAL_144>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145": {
+      "content": "<SPECIAL_145>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "146": {
+      "content": "<SPECIAL_146>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "147": {
+      "content": "<SPECIAL_147>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "148": {
+      "content": "<SPECIAL_148>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "149": {
+      "content": "<SPECIAL_149>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "150": {
+      "content": "<SPECIAL_150>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151": {
+      "content": "<SPECIAL_151>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "152": {
+      "content": "<SPECIAL_152>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "153": {
+      "content": "<SPECIAL_153>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "154": {
+      "content": "<SPECIAL_154>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "155": {
+      "content": "<SPECIAL_155>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "156": {
+      "content": "<SPECIAL_156>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "157": {
+      "content": "<SPECIAL_157>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "158": {
+      "content": "<SPECIAL_158>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "159": {
+      "content": "<SPECIAL_159>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "160": {
+      "content": "<SPECIAL_160>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "161": {
+      "content": "<SPECIAL_161>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "162": {
+      "content": "<SPECIAL_162>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "163": {
+      "content": "<SPECIAL_163>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "164": {
+      "content": "<SPECIAL_164>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "165": {
+      "content": "<SPECIAL_165>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "166": {
+      "content": "<SPECIAL_166>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "167": {
+      "content": "<SPECIAL_167>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "168": {
+      "content": "<SPECIAL_168>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "169": {
+      "content": "<SPECIAL_169>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "170": {
+      "content": "<SPECIAL_170>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "171": {
+      "content": "<SPECIAL_171>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "172": {
+      "content": "<SPECIAL_172>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "173": {
+      "content": "<SPECIAL_173>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "174": {
+      "content": "<SPECIAL_174>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "175": {
+      "content": "<SPECIAL_175>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "176": {
+      "content": "<SPECIAL_176>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "177": {
+      "content": "<SPECIAL_177>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "178": {
+      "content": "<SPECIAL_178>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "179": {
+      "content": "<SPECIAL_179>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "180": {
+      "content": "<SPECIAL_180>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "181": {
+      "content": "<SPECIAL_181>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "182": {
+      "content": "<SPECIAL_182>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "183": {
+      "content": "<SPECIAL_183>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "184": {
+      "content": "<SPECIAL_184>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "185": {
+      "content": "<SPECIAL_185>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "186": {
+      "content": "<SPECIAL_186>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "187": {
+      "content": "<SPECIAL_187>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "188": {
+      "content": "<SPECIAL_188>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "189": {
+      "content": "<SPECIAL_189>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "190": {
+      "content": "<SPECIAL_190>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "191": {
+      "content": "<SPECIAL_191>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "192": {
+      "content": "<SPECIAL_192>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "193": {
+      "content": "<SPECIAL_193>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "194": {
+      "content": "<SPECIAL_194>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "195": {
+      "content": "<SPECIAL_195>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "196": {
+      "content": "<SPECIAL_196>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "197": {
+      "content": "<SPECIAL_197>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "198": {
+      "content": "<SPECIAL_198>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "199": {
+      "content": "<SPECIAL_199>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "200": {
+      "content": "<SPECIAL_200>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "201": {
+      "content": "<SPECIAL_201>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "202": {
+      "content": "<SPECIAL_202>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "203": {
+      "content": "<SPECIAL_203>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "204": {
+      "content": "<SPECIAL_204>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "205": {
+      "content": "<SPECIAL_205>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "206": {
+      "content": "<SPECIAL_206>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "207": {
+      "content": "<SPECIAL_207>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "208": {
+      "content": "<SPECIAL_208>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "209": {
+      "content": "<SPECIAL_209>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "210": {
+      "content": "<SPECIAL_210>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "211": {
+      "content": "<SPECIAL_211>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "212": {
+      "content": "<SPECIAL_212>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "213": {
+      "content": "<SPECIAL_213>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "214": {
+      "content": "<SPECIAL_214>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "215": {
+      "content": "<SPECIAL_215>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "216": {
+      "content": "<SPECIAL_216>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "217": {
+      "content": "<SPECIAL_217>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "218": {
+      "content": "<SPECIAL_218>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "219": {
+      "content": "<SPECIAL_219>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "220": {
+      "content": "<SPECIAL_220>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "221": {
+      "content": "<SPECIAL_221>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "222": {
+      "content": "<SPECIAL_222>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "223": {
+      "content": "<SPECIAL_223>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "224": {
+      "content": "<SPECIAL_224>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "225": {
+      "content": "<SPECIAL_225>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "226": {
+      "content": "<SPECIAL_226>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "227": {
+      "content": "<SPECIAL_227>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "228": {
+      "content": "<SPECIAL_228>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "229": {
+      "content": "<SPECIAL_229>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "230": {
+      "content": "<SPECIAL_230>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "231": {
+      "content": "<SPECIAL_231>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "232": {
+      "content": "<SPECIAL_232>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "233": {
+      "content": "<SPECIAL_233>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "234": {
+      "content": "<SPECIAL_234>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "235": {
+      "content": "<SPECIAL_235>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "236": {
+      "content": "<SPECIAL_236>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "237": {
+      "content": "<SPECIAL_237>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "238": {
+      "content": "<SPECIAL_238>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "239": {
+      "content": "<SPECIAL_239>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "240": {
+      "content": "<SPECIAL_240>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "241": {
+      "content": "<SPECIAL_241>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "242": {
+      "content": "<SPECIAL_242>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "243": {
+      "content": "<SPECIAL_243>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "244": {
+      "content": "<SPECIAL_244>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "245": {
+      "content": "<SPECIAL_245>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "246": {
+      "content": "<SPECIAL_246>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "247": {
+      "content": "<SPECIAL_247>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248": {
+      "content": "<SPECIAL_248>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "249": {
+      "content": "<SPECIAL_249>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "250": {
+      "content": "<SPECIAL_250>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "251": {
+      "content": "<SPECIAL_251>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "252": {
+      "content": "<SPECIAL_252>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "253": {
+      "content": "<SPECIAL_253>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "254": {
+      "content": "<SPECIAL_254>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255": {
+      "content": "<SPECIAL_255>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256": {
+      "content": "<SPECIAL_256>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "257": {
+      "content": "<SPECIAL_257>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "258": {
+      "content": "<SPECIAL_258>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "259": {
+      "content": "<SPECIAL_259>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "260": {
+      "content": "<SPECIAL_260>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "261": {
+      "content": "<SPECIAL_261>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "262": {
+      "content": "<SPECIAL_262>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "263": {
+      "content": "<SPECIAL_263>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "264": {
+      "content": "<SPECIAL_264>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "265": {
+      "content": "<SPECIAL_265>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "266": {
+      "content": "<SPECIAL_266>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "267": {
+      "content": "<SPECIAL_267>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "268": {
+      "content": "<SPECIAL_268>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "269": {
+      "content": "<SPECIAL_269>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "270": {
+      "content": "<SPECIAL_270>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "271": {
+      "content": "<SPECIAL_271>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "272": {
+      "content": "<SPECIAL_272>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "273": {
+      "content": "<SPECIAL_273>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "274": {
+      "content": "<SPECIAL_274>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "275": {
+      "content": "<SPECIAL_275>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "276": {
+      "content": "<SPECIAL_276>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "277": {
+      "content": "<SPECIAL_277>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "278": {
+      "content": "<SPECIAL_278>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "279": {
+      "content": "<SPECIAL_279>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "280": {
+      "content": "<SPECIAL_280>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "281": {
+      "content": "<SPECIAL_281>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "282": {
+      "content": "<SPECIAL_282>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "283": {
+      "content": "<SPECIAL_283>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "284": {
+      "content": "<SPECIAL_284>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "285": {
+      "content": "<SPECIAL_285>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "286": {
+      "content": "<SPECIAL_286>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "287": {
+      "content": "<SPECIAL_287>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "288": {
+      "content": "<SPECIAL_288>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "289": {
+      "content": "<SPECIAL_289>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "290": {
+      "content": "<SPECIAL_290>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "291": {
+      "content": "<SPECIAL_291>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "292": {
+      "content": "<SPECIAL_292>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "293": {
+      "content": "<SPECIAL_293>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "294": {
+      "content": "<SPECIAL_294>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "295": {
+      "content": "<SPECIAL_295>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "296": {
+      "content": "<SPECIAL_296>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "297": {
+      "content": "<SPECIAL_297>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "298": {
+      "content": "<SPECIAL_298>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "299": {
+      "content": "<SPECIAL_299>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "300": {
+      "content": "<SPECIAL_300>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "301": {
+      "content": "<SPECIAL_301>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "302": {
+      "content": "<SPECIAL_302>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "303": {
+      "content": "<SPECIAL_303>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "304": {
+      "content": "<SPECIAL_304>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "305": {
+      "content": "<SPECIAL_305>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "306": {
+      "content": "<SPECIAL_306>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "307": {
+      "content": "<SPECIAL_307>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "308": {
+      "content": "<SPECIAL_308>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "309": {
+      "content": "<SPECIAL_309>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "310": {
+      "content": "<SPECIAL_310>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "311": {
+      "content": "<SPECIAL_311>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "312": {
+      "content": "<SPECIAL_312>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "313": {
+      "content": "<SPECIAL_313>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "314": {
+      "content": "<SPECIAL_314>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "315": {
+      "content": "<SPECIAL_315>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "316": {
+      "content": "<SPECIAL_316>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "317": {
+      "content": "<SPECIAL_317>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "318": {
+      "content": "<SPECIAL_318>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "319": {
+      "content": "<SPECIAL_319>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "320": {
+      "content": "<SPECIAL_320>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "321": {
+      "content": "<SPECIAL_321>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "322": {
+      "content": "<SPECIAL_322>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "323": {
+      "content": "<SPECIAL_323>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "324": {
+      "content": "<SPECIAL_324>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "325": {
+      "content": "<SPECIAL_325>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "326": {
+      "content": "<SPECIAL_326>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "327": {
+      "content": "<SPECIAL_327>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "328": {
+      "content": "<SPECIAL_328>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "329": {
+      "content": "<SPECIAL_329>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "330": {
+      "content": "<SPECIAL_330>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "331": {
+      "content": "<SPECIAL_331>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "332": {
+      "content": "<SPECIAL_332>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "333": {
+      "content": "<SPECIAL_333>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "334": {
+      "content": "<SPECIAL_334>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "335": {
+      "content": "<SPECIAL_335>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "336": {
+      "content": "<SPECIAL_336>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "337": {
+      "content": "<SPECIAL_337>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "338": {
+      "content": "<SPECIAL_338>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "339": {
+      "content": "<SPECIAL_339>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "340": {
+      "content": "<SPECIAL_340>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "341": {
+      "content": "<SPECIAL_341>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "342": {
+      "content": "<SPECIAL_342>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "343": {
+      "content": "<SPECIAL_343>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "344": {
+      "content": "<SPECIAL_344>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "345": {
+      "content": "<SPECIAL_345>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "346": {
+      "content": "<SPECIAL_346>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "347": {
+      "content": "<SPECIAL_347>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "348": {
+      "content": "<SPECIAL_348>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "349": {
+      "content": "<SPECIAL_349>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "350": {
+      "content": "<SPECIAL_350>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "351": {
+      "content": "<SPECIAL_351>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "352": {
+      "content": "<SPECIAL_352>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "353": {
+      "content": "<SPECIAL_353>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "354": {
+      "content": "<SPECIAL_354>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "355": {
+      "content": "<SPECIAL_355>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "356": {
+      "content": "<SPECIAL_356>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "357": {
+      "content": "<SPECIAL_357>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "358": {
+      "content": "<SPECIAL_358>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "359": {
+      "content": "<SPECIAL_359>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "360": {
+      "content": "<SPECIAL_360>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "361": {
+      "content": "<SPECIAL_361>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "362": {
+      "content": "<SPECIAL_362>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "363": {
+      "content": "<SPECIAL_363>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "364": {
+      "content": "<SPECIAL_364>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "365": {
+      "content": "<SPECIAL_365>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "366": {
+      "content": "<SPECIAL_366>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "367": {
+      "content": "<SPECIAL_367>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "368": {
+      "content": "<SPECIAL_368>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "369": {
+      "content": "<SPECIAL_369>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "370": {
+      "content": "<SPECIAL_370>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "371": {
+      "content": "<SPECIAL_371>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "372": {
+      "content": "<SPECIAL_372>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "373": {
+      "content": "<SPECIAL_373>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "374": {
+      "content": "<SPECIAL_374>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "375": {
+      "content": "<SPECIAL_375>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "376": {
+      "content": "<SPECIAL_376>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "377": {
+      "content": "<SPECIAL_377>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "378": {
+      "content": "<SPECIAL_378>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "379": {
+      "content": "<SPECIAL_379>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "380": {
+      "content": "<SPECIAL_380>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "381": {
+      "content": "<SPECIAL_381>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "382": {
+      "content": "<SPECIAL_382>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "383": {
+      "content": "<SPECIAL_383>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "384": {
+      "content": "<SPECIAL_384>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "385": {
+      "content": "<SPECIAL_385>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "386": {
+      "content": "<SPECIAL_386>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "387": {
+      "content": "<SPECIAL_387>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "388": {
+      "content": "<SPECIAL_388>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "389": {
+      "content": "<SPECIAL_389>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "390": {
+      "content": "<SPECIAL_390>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "391": {
+      "content": "<SPECIAL_391>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "392": {
+      "content": "<SPECIAL_392>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "393": {
+      "content": "<SPECIAL_393>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "394": {
+      "content": "<SPECIAL_394>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "395": {
+      "content": "<SPECIAL_395>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "396": {
+      "content": "<SPECIAL_396>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "397": {
+      "content": "<SPECIAL_397>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "398": {
+      "content": "<SPECIAL_398>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "399": {
+      "content": "<SPECIAL_399>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "400": {
+      "content": "<SPECIAL_400>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "401": {
+      "content": "<SPECIAL_401>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "402": {
+      "content": "<SPECIAL_402>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "403": {
+      "content": "<SPECIAL_403>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "404": {
+      "content": "<SPECIAL_404>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "405": {
+      "content": "<SPECIAL_405>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "406": {
+      "content": "<SPECIAL_406>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "407": {
+      "content": "<SPECIAL_407>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "408": {
+      "content": "<SPECIAL_408>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "409": {
+      "content": "<SPECIAL_409>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "410": {
+      "content": "<SPECIAL_410>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "411": {
+      "content": "<SPECIAL_411>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "412": {
+      "content": "<SPECIAL_412>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "413": {
+      "content": "<SPECIAL_413>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "414": {
+      "content": "<SPECIAL_414>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "415": {
+      "content": "<SPECIAL_415>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "416": {
+      "content": "<SPECIAL_416>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "417": {
+      "content": "<SPECIAL_417>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "418": {
+      "content": "<SPECIAL_418>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "419": {
+      "content": "<SPECIAL_419>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "420": {
+      "content": "<SPECIAL_420>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "421": {
+      "content": "<SPECIAL_421>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "422": {
+      "content": "<SPECIAL_422>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "423": {
+      "content": "<SPECIAL_423>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "424": {
+      "content": "<SPECIAL_424>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "425": {
+      "content": "<SPECIAL_425>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "426": {
+      "content": "<SPECIAL_426>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "427": {
+      "content": "<SPECIAL_427>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "428": {
+      "content": "<SPECIAL_428>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "429": {
+      "content": "<SPECIAL_429>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "430": {
+      "content": "<SPECIAL_430>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "431": {
+      "content": "<SPECIAL_431>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "432": {
+      "content": "<SPECIAL_432>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "433": {
+      "content": "<SPECIAL_433>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "434": {
+      "content": "<SPECIAL_434>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "435": {
+      "content": "<SPECIAL_435>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "436": {
+      "content": "<SPECIAL_436>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "437": {
+      "content": "<SPECIAL_437>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "438": {
+      "content": "<SPECIAL_438>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "439": {
+      "content": "<SPECIAL_439>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "440": {
+      "content": "<SPECIAL_440>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "441": {
+      "content": "<SPECIAL_441>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "442": {
+      "content": "<SPECIAL_442>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "443": {
+      "content": "<SPECIAL_443>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "444": {
+      "content": "<SPECIAL_444>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "445": {
+      "content": "<SPECIAL_445>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "446": {
+      "content": "<SPECIAL_446>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "447": {
+      "content": "<SPECIAL_447>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "448": {
+      "content": "<SPECIAL_448>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "449": {
+      "content": "<SPECIAL_449>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "450": {
+      "content": "<SPECIAL_450>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "451": {
+      "content": "<SPECIAL_451>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "452": {
+      "content": "<SPECIAL_452>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "453": {
+      "content": "<SPECIAL_453>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "454": {
+      "content": "<SPECIAL_454>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "455": {
+      "content": "<SPECIAL_455>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "456": {
+      "content": "<SPECIAL_456>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "457": {
+      "content": "<SPECIAL_457>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "458": {
+      "content": "<SPECIAL_458>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "459": {
+      "content": "<SPECIAL_459>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "460": {
+      "content": "<SPECIAL_460>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "461": {
+      "content": "<SPECIAL_461>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "462": {
+      "content": "<SPECIAL_462>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "463": {
+      "content": "<SPECIAL_463>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "464": {
+      "content": "<SPECIAL_464>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "465": {
+      "content": "<SPECIAL_465>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "466": {
+      "content": "<SPECIAL_466>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "467": {
+      "content": "<SPECIAL_467>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "468": {
+      "content": "<SPECIAL_468>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "469": {
+      "content": "<SPECIAL_469>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "470": {
+      "content": "<SPECIAL_470>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "471": {
+      "content": "<SPECIAL_471>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "472": {
+      "content": "<SPECIAL_472>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "473": {
+      "content": "<SPECIAL_473>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "474": {
+      "content": "<SPECIAL_474>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "475": {
+      "content": "<SPECIAL_475>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "476": {
+      "content": "<SPECIAL_476>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "477": {
+      "content": "<SPECIAL_477>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "478": {
+      "content": "<SPECIAL_478>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "479": {
+      "content": "<SPECIAL_479>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "480": {
+      "content": "<SPECIAL_480>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "481": {
+      "content": "<SPECIAL_481>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "482": {
+      "content": "<SPECIAL_482>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "483": {
+      "content": "<SPECIAL_483>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "484": {
+      "content": "<SPECIAL_484>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "485": {
+      "content": "<SPECIAL_485>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "486": {
+      "content": "<SPECIAL_486>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "487": {
+      "content": "<SPECIAL_487>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "488": {
+      "content": "<SPECIAL_488>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "489": {
+      "content": "<SPECIAL_489>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "490": {
+      "content": "<SPECIAL_490>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "491": {
+      "content": "<SPECIAL_491>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "492": {
+      "content": "<SPECIAL_492>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "493": {
+      "content": "<SPECIAL_493>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "494": {
+      "content": "<SPECIAL_494>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "495": {
+      "content": "<SPECIAL_495>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "496": {
+      "content": "<SPECIAL_496>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "497": {
+      "content": "<SPECIAL_497>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "498": {
+      "content": "<SPECIAL_498>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "499": {
+      "content": "<SPECIAL_499>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "500": {
+      "content": "<SPECIAL_500>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "501": {
+      "content": "<SPECIAL_501>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "502": {
+      "content": "<SPECIAL_502>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "503": {
+      "content": "<SPECIAL_503>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "504": {
+      "content": "<SPECIAL_504>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "505": {
+      "content": "<SPECIAL_505>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "506": {
+      "content": "<SPECIAL_506>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "507": {
+      "content": "<SPECIAL_507>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "508": {
+      "content": "<SPECIAL_508>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "509": {
+      "content": "<SPECIAL_509>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "510": {
+      "content": "<SPECIAL_510>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "511": {
+      "content": "<SPECIAL_511>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "512": {
+      "content": "<SPECIAL_512>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "513": {
+      "content": "<SPECIAL_513>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "514": {
+      "content": "<SPECIAL_514>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "515": {
+      "content": "<SPECIAL_515>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "516": {
+      "content": "<SPECIAL_516>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "517": {
+      "content": "<SPECIAL_517>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "518": {
+      "content": "<SPECIAL_518>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "519": {
+      "content": "<SPECIAL_519>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "520": {
+      "content": "<SPECIAL_520>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "521": {
+      "content": "<SPECIAL_521>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "522": {
+      "content": "<SPECIAL_522>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "523": {
+      "content": "<SPECIAL_523>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "524": {
+      "content": "<SPECIAL_524>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "525": {
+      "content": "<SPECIAL_525>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "526": {
+      "content": "<SPECIAL_526>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "527": {
+      "content": "<SPECIAL_527>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "528": {
+      "content": "<SPECIAL_528>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "529": {
+      "content": "<SPECIAL_529>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "530": {
+      "content": "<SPECIAL_530>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "531": {
+      "content": "<SPECIAL_531>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "532": {
+      "content": "<SPECIAL_532>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "533": {
+      "content": "<SPECIAL_533>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "534": {
+      "content": "<SPECIAL_534>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "535": {
+      "content": "<SPECIAL_535>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "536": {
+      "content": "<SPECIAL_536>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "537": {
+      "content": "<SPECIAL_537>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "538": {
+      "content": "<SPECIAL_538>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "539": {
+      "content": "<SPECIAL_539>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "540": {
+      "content": "<SPECIAL_540>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "541": {
+      "content": "<SPECIAL_541>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "542": {
+      "content": "<SPECIAL_542>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "543": {
+      "content": "<SPECIAL_543>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "544": {
+      "content": "<SPECIAL_544>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "545": {
+      "content": "<SPECIAL_545>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "546": {
+      "content": "<SPECIAL_546>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "547": {
+      "content": "<SPECIAL_547>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "548": {
+      "content": "<SPECIAL_548>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "549": {
+      "content": "<SPECIAL_549>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "550": {
+      "content": "<SPECIAL_550>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "551": {
+      "content": "<SPECIAL_551>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "552": {
+      "content": "<SPECIAL_552>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "553": {
+      "content": "<SPECIAL_553>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "554": {
+      "content": "<SPECIAL_554>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "555": {
+      "content": "<SPECIAL_555>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "556": {
+      "content": "<SPECIAL_556>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "557": {
+      "content": "<SPECIAL_557>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "558": {
+      "content": "<SPECIAL_558>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "559": {
+      "content": "<SPECIAL_559>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "560": {
+      "content": "<SPECIAL_560>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "561": {
+      "content": "<SPECIAL_561>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "562": {
+      "content": "<SPECIAL_562>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "563": {
+      "content": "<SPECIAL_563>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "564": {
+      "content": "<SPECIAL_564>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "565": {
+      "content": "<SPECIAL_565>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "566": {
+      "content": "<SPECIAL_566>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "567": {
+      "content": "<SPECIAL_567>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "568": {
+      "content": "<SPECIAL_568>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "569": {
+      "content": "<SPECIAL_569>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "570": {
+      "content": "<SPECIAL_570>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "571": {
+      "content": "<SPECIAL_571>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "572": {
+      "content": "<SPECIAL_572>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "573": {
+      "content": "<SPECIAL_573>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "574": {
+      "content": "<SPECIAL_574>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "575": {
+      "content": "<SPECIAL_575>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "576": {
+      "content": "<SPECIAL_576>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "577": {
+      "content": "<SPECIAL_577>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "578": {
+      "content": "<SPECIAL_578>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "579": {
+      "content": "<SPECIAL_579>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "580": {
+      "content": "<SPECIAL_580>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "581": {
+      "content": "<SPECIAL_581>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "582": {
+      "content": "<SPECIAL_582>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "583": {
+      "content": "<SPECIAL_583>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "584": {
+      "content": "<SPECIAL_584>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "585": {
+      "content": "<SPECIAL_585>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "586": {
+      "content": "<SPECIAL_586>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "587": {
+      "content": "<SPECIAL_587>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "588": {
+      "content": "<SPECIAL_588>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "589": {
+      "content": "<SPECIAL_589>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "590": {
+      "content": "<SPECIAL_590>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "591": {
+      "content": "<SPECIAL_591>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "592": {
+      "content": "<SPECIAL_592>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "593": {
+      "content": "<SPECIAL_593>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "594": {
+      "content": "<SPECIAL_594>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "595": {
+      "content": "<SPECIAL_595>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "596": {
+      "content": "<SPECIAL_596>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "597": {
+      "content": "<SPECIAL_597>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "598": {
+      "content": "<SPECIAL_598>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "599": {
+      "content": "<SPECIAL_599>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "600": {
+      "content": "<SPECIAL_600>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "601": {
+      "content": "<SPECIAL_601>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "602": {
+      "content": "<SPECIAL_602>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "603": {
+      "content": "<SPECIAL_603>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "604": {
+      "content": "<SPECIAL_604>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "605": {
+      "content": "<SPECIAL_605>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "606": {
+      "content": "<SPECIAL_606>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "607": {
+      "content": "<SPECIAL_607>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "608": {
+      "content": "<SPECIAL_608>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "609": {
+      "content": "<SPECIAL_609>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "610": {
+      "content": "<SPECIAL_610>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "611": {
+      "content": "<SPECIAL_611>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "612": {
+      "content": "<SPECIAL_612>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "613": {
+      "content": "<SPECIAL_613>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "614": {
+      "content": "<SPECIAL_614>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "615": {
+      "content": "<SPECIAL_615>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "616": {
+      "content": "<SPECIAL_616>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "617": {
+      "content": "<SPECIAL_617>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "618": {
+      "content": "<SPECIAL_618>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "619": {
+      "content": "<SPECIAL_619>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "620": {
+      "content": "<SPECIAL_620>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "621": {
+      "content": "<SPECIAL_621>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "622": {
+      "content": "<SPECIAL_622>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "623": {
+      "content": "<SPECIAL_623>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "624": {
+      "content": "<SPECIAL_624>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "625": {
+      "content": "<SPECIAL_625>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "626": {
+      "content": "<SPECIAL_626>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "627": {
+      "content": "<SPECIAL_627>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "628": {
+      "content": "<SPECIAL_628>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "629": {
+      "content": "<SPECIAL_629>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "630": {
+      "content": "<SPECIAL_630>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "631": {
+      "content": "<SPECIAL_631>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "632": {
+      "content": "<SPECIAL_632>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "633": {
+      "content": "<SPECIAL_633>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "634": {
+      "content": "<SPECIAL_634>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "635": {
+      "content": "<SPECIAL_635>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "636": {
+      "content": "<SPECIAL_636>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "637": {
+      "content": "<SPECIAL_637>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "638": {
+      "content": "<SPECIAL_638>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "639": {
+      "content": "<SPECIAL_639>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "640": {
+      "content": "<SPECIAL_640>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "641": {
+      "content": "<SPECIAL_641>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "642": {
+      "content": "<SPECIAL_642>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "643": {
+      "content": "<SPECIAL_643>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "644": {
+      "content": "<SPECIAL_644>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "645": {
+      "content": "<SPECIAL_645>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "646": {
+      "content": "<SPECIAL_646>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "647": {
+      "content": "<SPECIAL_647>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "648": {
+      "content": "<SPECIAL_648>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "649": {
+      "content": "<SPECIAL_649>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "650": {
+      "content": "<SPECIAL_650>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "651": {
+      "content": "<SPECIAL_651>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "652": {
+      "content": "<SPECIAL_652>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "653": {
+      "content": "<SPECIAL_653>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "654": {
+      "content": "<SPECIAL_654>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "655": {
+      "content": "<SPECIAL_655>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "656": {
+      "content": "<SPECIAL_656>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "657": {
+      "content": "<SPECIAL_657>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "658": {
+      "content": "<SPECIAL_658>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "659": {
+      "content": "<SPECIAL_659>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "660": {
+      "content": "<SPECIAL_660>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "661": {
+      "content": "<SPECIAL_661>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "662": {
+      "content": "<SPECIAL_662>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "663": {
+      "content": "<SPECIAL_663>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "664": {
+      "content": "<SPECIAL_664>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "665": {
+      "content": "<SPECIAL_665>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "666": {
+      "content": "<SPECIAL_666>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "667": {
+      "content": "<SPECIAL_667>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "668": {
+      "content": "<SPECIAL_668>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "669": {
+      "content": "<SPECIAL_669>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "670": {
+      "content": "<SPECIAL_670>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "671": {
+      "content": "<SPECIAL_671>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "672": {
+      "content": "<SPECIAL_672>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "673": {
+      "content": "<SPECIAL_673>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "674": {
+      "content": "<SPECIAL_674>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "675": {
+      "content": "<SPECIAL_675>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "676": {
+      "content": "<SPECIAL_676>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "677": {
+      "content": "<SPECIAL_677>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "678": {
+      "content": "<SPECIAL_678>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "679": {
+      "content": "<SPECIAL_679>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "680": {
+      "content": "<SPECIAL_680>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "681": {
+      "content": "<SPECIAL_681>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "682": {
+      "content": "<SPECIAL_682>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "683": {
+      "content": "<SPECIAL_683>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "684": {
+      "content": "<SPECIAL_684>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "685": {
+      "content": "<SPECIAL_685>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "686": {
+      "content": "<SPECIAL_686>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "687": {
+      "content": "<SPECIAL_687>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "688": {
+      "content": "<SPECIAL_688>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "689": {
+      "content": "<SPECIAL_689>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "690": {
+      "content": "<SPECIAL_690>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "691": {
+      "content": "<SPECIAL_691>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "692": {
+      "content": "<SPECIAL_692>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "693": {
+      "content": "<SPECIAL_693>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "694": {
+      "content": "<SPECIAL_694>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "695": {
+      "content": "<SPECIAL_695>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "696": {
+      "content": "<SPECIAL_696>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "697": {
+      "content": "<SPECIAL_697>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "698": {
+      "content": "<SPECIAL_698>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "699": {
+      "content": "<SPECIAL_699>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "700": {
+      "content": "<SPECIAL_700>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "701": {
+      "content": "<SPECIAL_701>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "702": {
+      "content": "<SPECIAL_702>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "703": {
+      "content": "<SPECIAL_703>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "704": {
+      "content": "<SPECIAL_704>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "705": {
+      "content": "<SPECIAL_705>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "706": {
+      "content": "<SPECIAL_706>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "707": {
+      "content": "<SPECIAL_707>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "708": {
+      "content": "<SPECIAL_708>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "709": {
+      "content": "<SPECIAL_709>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "710": {
+      "content": "<SPECIAL_710>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "711": {
+      "content": "<SPECIAL_711>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "712": {
+      "content": "<SPECIAL_712>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "713": {
+      "content": "<SPECIAL_713>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "714": {
+      "content": "<SPECIAL_714>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "715": {
+      "content": "<SPECIAL_715>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "716": {
+      "content": "<SPECIAL_716>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "717": {
+      "content": "<SPECIAL_717>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "718": {
+      "content": "<SPECIAL_718>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "719": {
+      "content": "<SPECIAL_719>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "720": {
+      "content": "<SPECIAL_720>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "721": {
+      "content": "<SPECIAL_721>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "722": {
+      "content": "<SPECIAL_722>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "723": {
+      "content": "<SPECIAL_723>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "724": {
+      "content": "<SPECIAL_724>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "725": {
+      "content": "<SPECIAL_725>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "726": {
+      "content": "<SPECIAL_726>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "727": {
+      "content": "<SPECIAL_727>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "728": {
+      "content": "<SPECIAL_728>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "729": {
+      "content": "<SPECIAL_729>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "730": {
+      "content": "<SPECIAL_730>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "731": {
+      "content": "<SPECIAL_731>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "732": {
+      "content": "<SPECIAL_732>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "733": {
+      "content": "<SPECIAL_733>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "734": {
+      "content": "<SPECIAL_734>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "735": {
+      "content": "<SPECIAL_735>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "736": {
+      "content": "<SPECIAL_736>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "737": {
+      "content": "<SPECIAL_737>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "738": {
+      "content": "<SPECIAL_738>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "739": {
+      "content": "<SPECIAL_739>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "740": {
+      "content": "<SPECIAL_740>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "741": {
+      "content": "<SPECIAL_741>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "742": {
+      "content": "<SPECIAL_742>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "743": {
+      "content": "<SPECIAL_743>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "744": {
+      "content": "<SPECIAL_744>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "745": {
+      "content": "<SPECIAL_745>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "746": {
+      "content": "<SPECIAL_746>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "747": {
+      "content": "<SPECIAL_747>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "748": {
+      "content": "<SPECIAL_748>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "749": {
+      "content": "<SPECIAL_749>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "750": {
+      "content": "<SPECIAL_750>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "751": {
+      "content": "<SPECIAL_751>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "752": {
+      "content": "<SPECIAL_752>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "753": {
+      "content": "<SPECIAL_753>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "754": {
+      "content": "<SPECIAL_754>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "755": {
+      "content": "<SPECIAL_755>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "756": {
+      "content": "<SPECIAL_756>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "757": {
+      "content": "<SPECIAL_757>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "758": {
+      "content": "<SPECIAL_758>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "759": {
+      "content": "<SPECIAL_759>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "760": {
+      "content": "<SPECIAL_760>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "761": {
+      "content": "<SPECIAL_761>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "762": {
+      "content": "<SPECIAL_762>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "763": {
+      "content": "<SPECIAL_763>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "764": {
+      "content": "<SPECIAL_764>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "765": {
+      "content": "<SPECIAL_765>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "766": {
+      "content": "<SPECIAL_766>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "767": {
+      "content": "<SPECIAL_767>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "768": {
+      "content": "<SPECIAL_768>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "769": {
+      "content": "<SPECIAL_769>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "770": {
+      "content": "<SPECIAL_770>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "771": {
+      "content": "<SPECIAL_771>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "772": {
+      "content": "<SPECIAL_772>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "773": {
+      "content": "<SPECIAL_773>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "774": {
+      "content": "<SPECIAL_774>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "775": {
+      "content": "<SPECIAL_775>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "776": {
+      "content": "<SPECIAL_776>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "777": {
+      "content": "<SPECIAL_777>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "778": {
+      "content": "<SPECIAL_778>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "779": {
+      "content": "<SPECIAL_779>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "780": {
+      "content": "<SPECIAL_780>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "781": {
+      "content": "<SPECIAL_781>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "782": {
+      "content": "<SPECIAL_782>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "783": {
+      "content": "<SPECIAL_783>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "784": {
+      "content": "<SPECIAL_784>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "785": {
+      "content": "<SPECIAL_785>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "786": {
+      "content": "<SPECIAL_786>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "787": {
+      "content": "<SPECIAL_787>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "788": {
+      "content": "<SPECIAL_788>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "789": {
+      "content": "<SPECIAL_789>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "790": {
+      "content": "<SPECIAL_790>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "791": {
+      "content": "<SPECIAL_791>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "792": {
+      "content": "<SPECIAL_792>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "793": {
+      "content": "<SPECIAL_793>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "794": {
+      "content": "<SPECIAL_794>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "795": {
+      "content": "<SPECIAL_795>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "796": {
+      "content": "<SPECIAL_796>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "797": {
+      "content": "<SPECIAL_797>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "798": {
+      "content": "<SPECIAL_798>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "799": {
+      "content": "<SPECIAL_799>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "800": {
+      "content": "<SPECIAL_800>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "801": {
+      "content": "<SPECIAL_801>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "802": {
+      "content": "<SPECIAL_802>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "803": {
+      "content": "<SPECIAL_803>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "804": {
+      "content": "<SPECIAL_804>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "805": {
+      "content": "<SPECIAL_805>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "806": {
+      "content": "<SPECIAL_806>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "807": {
+      "content": "<SPECIAL_807>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "808": {
+      "content": "<SPECIAL_808>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "809": {
+      "content": "<SPECIAL_809>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "810": {
+      "content": "<SPECIAL_810>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "811": {
+      "content": "<SPECIAL_811>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "812": {
+      "content": "<SPECIAL_812>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "813": {
+      "content": "<SPECIAL_813>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "814": {
+      "content": "<SPECIAL_814>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "815": {
+      "content": "<SPECIAL_815>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "816": {
+      "content": "<SPECIAL_816>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "817": {
+      "content": "<SPECIAL_817>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "818": {
+      "content": "<SPECIAL_818>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "819": {
+      "content": "<SPECIAL_819>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "820": {
+      "content": "<SPECIAL_820>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "821": {
+      "content": "<SPECIAL_821>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "822": {
+      "content": "<SPECIAL_822>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "823": {
+      "content": "<SPECIAL_823>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "824": {
+      "content": "<SPECIAL_824>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "825": {
+      "content": "<SPECIAL_825>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "826": {
+      "content": "<SPECIAL_826>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "827": {
+      "content": "<SPECIAL_827>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "828": {
+      "content": "<SPECIAL_828>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "829": {
+      "content": "<SPECIAL_829>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "830": {
+      "content": "<SPECIAL_830>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "831": {
+      "content": "<SPECIAL_831>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "832": {
+      "content": "<SPECIAL_832>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "833": {
+      "content": "<SPECIAL_833>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "834": {
+      "content": "<SPECIAL_834>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "835": {
+      "content": "<SPECIAL_835>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "836": {
+      "content": "<SPECIAL_836>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "837": {
+      "content": "<SPECIAL_837>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "838": {
+      "content": "<SPECIAL_838>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "839": {
+      "content": "<SPECIAL_839>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "840": {
+      "content": "<SPECIAL_840>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "841": {
+      "content": "<SPECIAL_841>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "842": {
+      "content": "<SPECIAL_842>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "843": {
+      "content": "<SPECIAL_843>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "844": {
+      "content": "<SPECIAL_844>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "845": {
+      "content": "<SPECIAL_845>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "846": {
+      "content": "<SPECIAL_846>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "847": {
+      "content": "<SPECIAL_847>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "848": {
+      "content": "<SPECIAL_848>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "849": {
+      "content": "<SPECIAL_849>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "850": {
+      "content": "<SPECIAL_850>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "851": {
+      "content": "<SPECIAL_851>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "852": {
+      "content": "<SPECIAL_852>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "853": {
+      "content": "<SPECIAL_853>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "854": {
+      "content": "<SPECIAL_854>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "855": {
+      "content": "<SPECIAL_855>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "856": {
+      "content": "<SPECIAL_856>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "857": {
+      "content": "<SPECIAL_857>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "858": {
+      "content": "<SPECIAL_858>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "859": {
+      "content": "<SPECIAL_859>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "860": {
+      "content": "<SPECIAL_860>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "861": {
+      "content": "<SPECIAL_861>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "862": {
+      "content": "<SPECIAL_862>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "863": {
+      "content": "<SPECIAL_863>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "864": {
+      "content": "<SPECIAL_864>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "865": {
+      "content": "<SPECIAL_865>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "866": {
+      "content": "<SPECIAL_866>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "867": {
+      "content": "<SPECIAL_867>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "868": {
+      "content": "<SPECIAL_868>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "869": {
+      "content": "<SPECIAL_869>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "870": {
+      "content": "<SPECIAL_870>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "871": {
+      "content": "<SPECIAL_871>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "872": {
+      "content": "<SPECIAL_872>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "873": {
+      "content": "<SPECIAL_873>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "874": {
+      "content": "<SPECIAL_874>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "875": {
+      "content": "<SPECIAL_875>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "876": {
+      "content": "<SPECIAL_876>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "877": {
+      "content": "<SPECIAL_877>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "878": {
+      "content": "<SPECIAL_878>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "879": {
+      "content": "<SPECIAL_879>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "880": {
+      "content": "<SPECIAL_880>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "881": {
+      "content": "<SPECIAL_881>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "882": {
+      "content": "<SPECIAL_882>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "883": {
+      "content": "<SPECIAL_883>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "884": {
+      "content": "<SPECIAL_884>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "885": {
+      "content": "<SPECIAL_885>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "886": {
+      "content": "<SPECIAL_886>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "887": {
+      "content": "<SPECIAL_887>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "888": {
+      "content": "<SPECIAL_888>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "889": {
+      "content": "<SPECIAL_889>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "890": {
+      "content": "<SPECIAL_890>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "891": {
+      "content": "<SPECIAL_891>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "892": {
+      "content": "<SPECIAL_892>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "893": {
+      "content": "<SPECIAL_893>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "894": {
+      "content": "<SPECIAL_894>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "895": {
+      "content": "<SPECIAL_895>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "896": {
+      "content": "<SPECIAL_896>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "897": {
+      "content": "<SPECIAL_897>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "898": {
+      "content": "<SPECIAL_898>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "899": {
+      "content": "<SPECIAL_899>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "900": {
+      "content": "<SPECIAL_900>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "901": {
+      "content": "<SPECIAL_901>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "902": {
+      "content": "<SPECIAL_902>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "903": {
+      "content": "<SPECIAL_903>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "904": {
+      "content": "<SPECIAL_904>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "905": {
+      "content": "<SPECIAL_905>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "906": {
+      "content": "<SPECIAL_906>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "907": {
+      "content": "<SPECIAL_907>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "908": {
+      "content": "<SPECIAL_908>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "909": {
+      "content": "<SPECIAL_909>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "910": {
+      "content": "<SPECIAL_910>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "911": {
+      "content": "<SPECIAL_911>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "912": {
+      "content": "<SPECIAL_912>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "913": {
+      "content": "<SPECIAL_913>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "914": {
+      "content": "<SPECIAL_914>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "915": {
+      "content": "<SPECIAL_915>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "916": {
+      "content": "<SPECIAL_916>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "917": {
+      "content": "<SPECIAL_917>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "918": {
+      "content": "<SPECIAL_918>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "919": {
+      "content": "<SPECIAL_919>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "920": {
+      "content": "<SPECIAL_920>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "921": {
+      "content": "<SPECIAL_921>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "922": {
+      "content": "<SPECIAL_922>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "923": {
+      "content": "<SPECIAL_923>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "924": {
+      "content": "<SPECIAL_924>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "925": {
+      "content": "<SPECIAL_925>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "926": {
+      "content": "<SPECIAL_926>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "927": {
+      "content": "<SPECIAL_927>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "928": {
+      "content": "<SPECIAL_928>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "929": {
+      "content": "<SPECIAL_929>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "930": {
+      "content": "<SPECIAL_930>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "931": {
+      "content": "<SPECIAL_931>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "932": {
+      "content": "<SPECIAL_932>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "933": {
+      "content": "<SPECIAL_933>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "934": {
+      "content": "<SPECIAL_934>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "935": {
+      "content": "<SPECIAL_935>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "936": {
+      "content": "<SPECIAL_936>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "937": {
+      "content": "<SPECIAL_937>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "938": {
+      "content": "<SPECIAL_938>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "939": {
+      "content": "<SPECIAL_939>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "940": {
+      "content": "<SPECIAL_940>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "941": {
+      "content": "<SPECIAL_941>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "942": {
+      "content": "<SPECIAL_942>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "943": {
+      "content": "<SPECIAL_943>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "944": {
+      "content": "<SPECIAL_944>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "945": {
+      "content": "<SPECIAL_945>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "946": {
+      "content": "<SPECIAL_946>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "947": {
+      "content": "<SPECIAL_947>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "948": {
+      "content": "<SPECIAL_948>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "949": {
+      "content": "<SPECIAL_949>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "950": {
+      "content": "<SPECIAL_950>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "951": {
+      "content": "<SPECIAL_951>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "952": {
+      "content": "<SPECIAL_952>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "953": {
+      "content": "<SPECIAL_953>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "954": {
+      "content": "<SPECIAL_954>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "955": {
+      "content": "<SPECIAL_955>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "956": {
+      "content": "<SPECIAL_956>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "957": {
+      "content": "<SPECIAL_957>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "958": {
+      "content": "<SPECIAL_958>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "959": {
+      "content": "<SPECIAL_959>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "960": {
+      "content": "<SPECIAL_960>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "961": {
+      "content": "<SPECIAL_961>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "962": {
+      "content": "<SPECIAL_962>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "963": {
+      "content": "<SPECIAL_963>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "964": {
+      "content": "<SPECIAL_964>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "965": {
+      "content": "<SPECIAL_965>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "966": {
+      "content": "<SPECIAL_966>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "967": {
+      "content": "<SPECIAL_967>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "968": {
+      "content": "<SPECIAL_968>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "969": {
+      "content": "<SPECIAL_969>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "970": {
+      "content": "<SPECIAL_970>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "971": {
+      "content": "<SPECIAL_971>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "972": {
+      "content": "<SPECIAL_972>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "973": {
+      "content": "<SPECIAL_973>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "974": {
+      "content": "<SPECIAL_974>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "975": {
+      "content": "<SPECIAL_975>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "976": {
+      "content": "<SPECIAL_976>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "977": {
+      "content": "<SPECIAL_977>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "978": {
+      "content": "<SPECIAL_978>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "979": {
+      "content": "<SPECIAL_979>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "980": {
+      "content": "<SPECIAL_980>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "981": {
+      "content": "<SPECIAL_981>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "982": {
+      "content": "<SPECIAL_982>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "983": {
+      "content": "<SPECIAL_983>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "984": {
+      "content": "<SPECIAL_984>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "985": {
+      "content": "<SPECIAL_985>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "986": {
+      "content": "<SPECIAL_986>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "987": {
+      "content": "<SPECIAL_987>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "988": {
+      "content": "<SPECIAL_988>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "989": {
+      "content": "<SPECIAL_989>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "990": {
+      "content": "<SPECIAL_990>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "991": {
+      "content": "<SPECIAL_991>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "992": {
+      "content": "<SPECIAL_992>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "993": {
+      "content": "<SPECIAL_993>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "994": {
+      "content": "<SPECIAL_994>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "995": {
+      "content": "<SPECIAL_995>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "996": {
+      "content": "<SPECIAL_996>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "997": {
+      "content": "<SPECIAL_997>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "998": {
+      "content": "<SPECIAL_998>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "999": {
+      "content": "<SPECIAL_999>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "extra_special_tokens": {},
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "tokenizer_class": "PreTrainedTokenizer",
+  "unk_token": "<unk>"
+}
diff --git a/checkpoint-272/trainer_state.json b/checkpoint-272/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..65816cae7a1a0b010a294726d72e350b499d7514
--- /dev/null
+++ b/checkpoint-272/trainer_state.json
@@ -0,0 +1,1962 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.4995408631772268,
+  "eval_steps": 136,
+  "global_step": 272,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0018365472910927456,
+      "grad_norm": 0.49180246368465724,
+      "learning_rate": 0.0,
+      "loss": 1.3574,
+      "step": 1
+    },
+    {
+      "epoch": 0.0018365472910927456,
+      "eval_loss": 2.4259753227233887,
+      "eval_runtime": 39.8169,
+      "eval_samples_per_second": 5.149,
+      "eval_steps_per_second": 0.452,
+      "step": 1
+    },
+    {
+      "epoch": 0.0036730945821854912,
+      "grad_norm": 0.3994587341086747,
+      "learning_rate": 2.5000000000000004e-07,
+      "loss": 1.444,
+      "step": 2
+    },
+    {
+      "epoch": 0.005509641873278237,
+      "grad_norm": 0.39017597145072364,
+      "learning_rate": 5.000000000000001e-07,
+      "loss": 1.5149,
+      "step": 3
+    },
+    {
+      "epoch": 0.0073461891643709825,
+      "grad_norm": 0.47444439480391987,
+      "learning_rate": 7.5e-07,
+      "loss": 1.5855,
+      "step": 4
+    },
+    {
+      "epoch": 0.009182736455463728,
+      "grad_norm": 0.794434599507836,
+      "learning_rate": 1.0000000000000002e-06,
+      "loss": 1.6531,
+      "step": 5
+    },
+    {
+      "epoch": 0.011019283746556474,
+      "grad_norm": 0.7108153394196348,
+      "learning_rate": 1.25e-06,
+      "loss": 1.7881,
+      "step": 6
+    },
+    {
+      "epoch": 0.012855831037649219,
+      "grad_norm": 0.5204076611421804,
+      "learning_rate": 1.5e-06,
+      "loss": 1.5592,
+      "step": 7
+    },
+    {
+      "epoch": 0.014692378328741965,
+      "grad_norm": 0.7569351115766059,
+      "learning_rate": 1.75e-06,
+      "loss": 1.5735,
+      "step": 8
+    },
+    {
+      "epoch": 0.01652892561983471,
+      "grad_norm": 0.5678098307469198,
+      "learning_rate": 2.0000000000000003e-06,
+      "loss": 1.5934,
+      "step": 9
+    },
+    {
+      "epoch": 0.018365472910927456,
+      "grad_norm": 0.40098167184732914,
+      "learning_rate": 2.25e-06,
+      "loss": 1.688,
+      "step": 10
+    },
+    {
+      "epoch": 0.020202020202020204,
+      "grad_norm": 0.4268491869708594,
+      "learning_rate": 2.5e-06,
+      "loss": 1.6286,
+      "step": 11
+    },
+    {
+      "epoch": 0.02203856749311295,
+      "grad_norm": 0.5835872767276206,
+      "learning_rate": 2.7500000000000004e-06,
+      "loss": 1.679,
+      "step": 12
+    },
+    {
+      "epoch": 0.023875114784205693,
+      "grad_norm": 0.41861495783037117,
+      "learning_rate": 3e-06,
+      "loss": 1.7093,
+      "step": 13
+    },
+    {
+      "epoch": 0.025711662075298437,
+      "grad_norm": 0.3375113108661923,
+      "learning_rate": 3.2500000000000002e-06,
+      "loss": 1.7431,
+      "step": 14
+    },
+    {
+      "epoch": 0.027548209366391185,
+      "grad_norm": 0.48885555509704504,
+      "learning_rate": 3.5e-06,
+      "loss": 1.4873,
+      "step": 15
+    },
+    {
+      "epoch": 0.02938475665748393,
+      "grad_norm": 0.4483288005954393,
+      "learning_rate": 3.7500000000000005e-06,
+      "loss": 1.6619,
+      "step": 16
+    },
+    {
+      "epoch": 0.031221303948576674,
+      "grad_norm": 0.4299802045225574,
+      "learning_rate": 4.000000000000001e-06,
+      "loss": 1.6997,
+      "step": 17
+    },
+    {
+      "epoch": 0.03305785123966942,
+      "grad_norm": 0.5824485228901973,
+      "learning_rate": 4.25e-06,
+      "loss": 1.691,
+      "step": 18
+    },
+    {
+      "epoch": 0.03489439853076217,
+      "grad_norm": 0.32860558551239133,
+      "learning_rate": 4.5e-06,
+      "loss": 1.5414,
+      "step": 19
+    },
+    {
+      "epoch": 0.03673094582185491,
+      "grad_norm": 1.7514560949718712,
+      "learning_rate": 4.75e-06,
+      "loss": 1.522,
+      "step": 20
+    },
+    {
+      "epoch": 0.03856749311294766,
+      "grad_norm": 0.3844467204577219,
+      "learning_rate": 5e-06,
+      "loss": 1.6948,
+      "step": 21
+    },
+    {
+      "epoch": 0.04040404040404041,
+      "grad_norm": 0.329345071029554,
+      "learning_rate": 5.2500000000000006e-06,
+      "loss": 1.509,
+      "step": 22
+    },
+    {
+      "epoch": 0.04224058769513315,
+      "grad_norm": 0.28268786055882505,
+      "learning_rate": 5.500000000000001e-06,
+      "loss": 1.5563,
+      "step": 23
+    },
+    {
+      "epoch": 0.0440771349862259,
+      "grad_norm": 0.3422617324754064,
+      "learning_rate": 5.75e-06,
+      "loss": 1.5615,
+      "step": 24
+    },
+    {
+      "epoch": 0.04591368227731864,
+      "grad_norm": 0.33860326348440456,
+      "learning_rate": 6e-06,
+      "loss": 1.7008,
+      "step": 25
+    },
+    {
+      "epoch": 0.047750229568411386,
+      "grad_norm": 0.2789219845798442,
+      "learning_rate": 6.25e-06,
+      "loss": 1.5667,
+      "step": 26
+    },
+    {
+      "epoch": 0.049586776859504134,
+      "grad_norm": 0.37047693270617005,
+      "learning_rate": 6.5000000000000004e-06,
+      "loss": 1.5557,
+      "step": 27
+    },
+    {
+      "epoch": 0.051423324150596875,
+      "grad_norm": 0.3368470842339362,
+      "learning_rate": 6.750000000000001e-06,
+      "loss": 1.6045,
+      "step": 28
+    },
+    {
+      "epoch": 0.05325987144168962,
+      "grad_norm": 0.30344837893854465,
+      "learning_rate": 7e-06,
+      "loss": 1.6766,
+      "step": 29
+    },
+    {
+      "epoch": 0.05509641873278237,
+      "grad_norm": 0.6359004570618099,
+      "learning_rate": 7.25e-06,
+      "loss": 1.6499,
+      "step": 30
+    },
+    {
+      "epoch": 0.05693296602387511,
+      "grad_norm": 0.3258591226646554,
+      "learning_rate": 7.500000000000001e-06,
+      "loss": 1.6565,
+      "step": 31
+    },
+    {
+      "epoch": 0.05876951331496786,
+      "grad_norm": 0.3697834149605013,
+      "learning_rate": 7.75e-06,
+      "loss": 1.4883,
+      "step": 32
+    },
+    {
+      "epoch": 0.06060606060606061,
+      "grad_norm": 0.265668853003883,
+      "learning_rate": 8.000000000000001e-06,
+      "loss": 1.8289,
+      "step": 33
+    },
+    {
+      "epoch": 0.06244260789715335,
+      "grad_norm": 0.39987679350668315,
+      "learning_rate": 8.25e-06,
+      "loss": 1.6633,
+      "step": 34
+    },
+    {
+      "epoch": 0.0642791551882461,
+      "grad_norm": 0.39636333420956993,
+      "learning_rate": 8.5e-06,
+      "loss": 1.2298,
+      "step": 35
+    },
+    {
+      "epoch": 0.06611570247933884,
+      "grad_norm": 0.3464362348603123,
+      "learning_rate": 8.750000000000001e-06,
+      "loss": 1.485,
+      "step": 36
+    },
+    {
+      "epoch": 0.06795224977043159,
+      "grad_norm": 0.31616445355046285,
+      "learning_rate": 9e-06,
+      "loss": 1.5553,
+      "step": 37
+    },
+    {
+      "epoch": 0.06978879706152434,
+      "grad_norm": 0.4441888412468937,
+      "learning_rate": 9.250000000000001e-06,
+      "loss": 1.5967,
+      "step": 38
+    },
+    {
+      "epoch": 0.07162534435261708,
+      "grad_norm": 0.3547318554597848,
+      "learning_rate": 9.5e-06,
+      "loss": 1.5006,
+      "step": 39
+    },
+    {
+      "epoch": 0.07346189164370982,
+      "grad_norm": 0.27557088472944596,
+      "learning_rate": 9.75e-06,
+      "loss": 1.5673,
+      "step": 40
+    },
+    {
+      "epoch": 0.07529843893480258,
+      "grad_norm": 0.2956312497066916,
+      "learning_rate": 1e-05,
+      "loss": 1.4936,
+      "step": 41
+    },
+    {
+      "epoch": 0.07713498622589532,
+      "grad_norm": 0.2322611308466898,
+      "learning_rate": 9.999994591993822e-06,
+      "loss": 1.4759,
+      "step": 42
+    },
+    {
+      "epoch": 0.07897153351698806,
+      "grad_norm": 0.22039029040435731,
+      "learning_rate": 9.999978367986988e-06,
+      "loss": 1.6625,
+      "step": 43
+    },
+    {
+      "epoch": 0.08080808080808081,
+      "grad_norm": 0.3446344059315139,
+      "learning_rate": 9.999951328014591e-06,
+      "loss": 1.6309,
+      "step": 44
+    },
+    {
+      "epoch": 0.08264462809917356,
+      "grad_norm": 0.23666900781940328,
+      "learning_rate": 9.999913472135126e-06,
+      "loss": 1.5347,
+      "step": 45
+    },
+    {
+      "epoch": 0.0844811753902663,
+      "grad_norm": 0.2840328883351318,
+      "learning_rate": 9.999864800430482e-06,
+      "loss": 1.5115,
+      "step": 46
+    },
+    {
+      "epoch": 0.08631772268135904,
+      "grad_norm": 0.2407651293731456,
+      "learning_rate": 9.999805313005946e-06,
+      "loss": 1.4199,
+      "step": 47
+    },
+    {
+      "epoch": 0.0881542699724518,
+      "grad_norm": 0.24925631476018442,
+      "learning_rate": 9.999735009990202e-06,
+      "loss": 1.7008,
+      "step": 48
+    },
+    {
+      "epoch": 0.08999081726354453,
+      "grad_norm": 0.2502728573485842,
+      "learning_rate": 9.99965389153533e-06,
+      "loss": 1.6181,
+      "step": 49
+    },
+    {
+      "epoch": 0.09182736455463728,
+      "grad_norm": 0.23272569963887466,
+      "learning_rate": 9.999561957816803e-06,
+      "loss": 1.4668,
+      "step": 50
+    },
+    {
+      "epoch": 0.09366391184573003,
+      "grad_norm": 0.23492521900860228,
+      "learning_rate": 9.999459209033495e-06,
+      "loss": 1.6884,
+      "step": 51
+    },
+    {
+      "epoch": 0.09550045913682277,
+      "grad_norm": 0.24231529936066795,
+      "learning_rate": 9.999345645407671e-06,
+      "loss": 1.3811,
+      "step": 52
+    },
+    {
+      "epoch": 0.09733700642791551,
+      "grad_norm": 0.23749137313908725,
+      "learning_rate": 9.999221267184993e-06,
+      "loss": 1.6599,
+      "step": 53
+    },
+    {
+      "epoch": 0.09917355371900827,
+      "grad_norm": 0.2631749052017168,
+      "learning_rate": 9.999086074634516e-06,
+      "loss": 1.5321,
+      "step": 54
+    },
+    {
+      "epoch": 0.10101010101010101,
+      "grad_norm": 0.265780364913351,
+      "learning_rate": 9.998940068048688e-06,
+      "loss": 1.7954,
+      "step": 55
+    },
+    {
+      "epoch": 0.10284664830119375,
+      "grad_norm": 0.23373755925772408,
+      "learning_rate": 9.998783247743353e-06,
+      "loss": 1.6503,
+      "step": 56
+    },
+    {
+      "epoch": 0.1046831955922865,
+      "grad_norm": 0.26345499971500486,
+      "learning_rate": 9.998615614057743e-06,
+      "loss": 1.6842,
+      "step": 57
+    },
+    {
+      "epoch": 0.10651974288337925,
+      "grad_norm": 0.22858688890828285,
+      "learning_rate": 9.998437167354485e-06,
+      "loss": 1.6053,
+      "step": 58
+    },
+    {
+      "epoch": 0.10835629017447199,
+      "grad_norm": 0.22732836541277007,
+      "learning_rate": 9.998247908019594e-06,
+      "loss": 1.5357,
+      "step": 59
+    },
+    {
+      "epoch": 0.11019283746556474,
+      "grad_norm": 0.21575052353545032,
+      "learning_rate": 9.998047836462476e-06,
+      "loss": 1.5875,
+      "step": 60
+    },
+    {
+      "epoch": 0.11202938475665748,
+      "grad_norm": 0.3308350003540223,
+      "learning_rate": 9.997836953115927e-06,
+      "loss": 1.9333,
+      "step": 61
+    },
+    {
+      "epoch": 0.11386593204775022,
+      "grad_norm": 0.24160639887541288,
+      "learning_rate": 9.99761525843613e-06,
+      "loss": 1.6121,
+      "step": 62
+    },
+    {
+      "epoch": 0.11570247933884298,
+      "grad_norm": 0.23537591666009566,
+      "learning_rate": 9.997382752902658e-06,
+      "loss": 1.6341,
+      "step": 63
+    },
+    {
+      "epoch": 0.11753902662993572,
+      "grad_norm": 0.30577270648255184,
+      "learning_rate": 9.997139437018463e-06,
+      "loss": 1.4635,
+      "step": 64
+    },
+    {
+      "epoch": 0.11937557392102846,
+      "grad_norm": 0.24971896873950858,
+      "learning_rate": 9.996885311309892e-06,
+      "loss": 1.8186,
+      "step": 65
+    },
+    {
+      "epoch": 0.12121212121212122,
+      "grad_norm": 0.25847791225683553,
+      "learning_rate": 9.996620376326667e-06,
+      "loss": 1.491,
+      "step": 66
+    },
+    {
+      "epoch": 0.12304866850321396,
+      "grad_norm": 0.24031460889715148,
+      "learning_rate": 9.996344632641895e-06,
+      "loss": 1.6563,
+      "step": 67
+    },
+    {
+      "epoch": 0.1248852157943067,
+      "grad_norm": 0.2550524831797301,
+      "learning_rate": 9.996058080852067e-06,
+      "loss": 1.6427,
+      "step": 68
+    },
+    {
+      "epoch": 0.12672176308539945,
+      "grad_norm": 0.22467108780123965,
+      "learning_rate": 9.995760721577053e-06,
+      "loss": 1.4595,
+      "step": 69
+    },
+    {
+      "epoch": 0.1285583103764922,
+      "grad_norm": 0.282181674918973,
+      "learning_rate": 9.995452555460098e-06,
+      "loss": 1.6837,
+      "step": 70
+    },
+    {
+      "epoch": 0.13039485766758493,
+      "grad_norm": 0.5727450301366364,
+      "learning_rate": 9.995133583167833e-06,
+      "loss": 1.6003,
+      "step": 71
+    },
+    {
+      "epoch": 0.1322314049586777,
+      "grad_norm": 0.22744917091853156,
+      "learning_rate": 9.994803805390257e-06,
+      "loss": 1.3544,
+      "step": 72
+    },
+    {
+      "epoch": 0.13406795224977044,
+      "grad_norm": 0.22395196659772004,
+      "learning_rate": 9.994463222840748e-06,
+      "loss": 1.6198,
+      "step": 73
+    },
+    {
+      "epoch": 0.13590449954086317,
+      "grad_norm": 0.2098292344869194,
+      "learning_rate": 9.994111836256049e-06,
+      "loss": 1.5059,
+      "step": 74
+    },
+    {
+      "epoch": 0.13774104683195593,
+      "grad_norm": 0.22329332454983955,
+      "learning_rate": 9.993749646396286e-06,
+      "loss": 1.4666,
+      "step": 75
+    },
+    {
+      "epoch": 0.13957759412304868,
+      "grad_norm": 1.131446258847722,
+      "learning_rate": 9.993376654044948e-06,
+      "loss": 1.5164,
+      "step": 76
+    },
+    {
+      "epoch": 0.1414141414141414,
+      "grad_norm": 0.22716717526603358,
+      "learning_rate": 9.992992860008893e-06,
+      "loss": 1.4978,
+      "step": 77
+    },
+    {
+      "epoch": 0.14325068870523416,
+      "grad_norm": 0.24179796579866508,
+      "learning_rate": 9.992598265118344e-06,
+      "loss": 1.3147,
+      "step": 78
+    },
+    {
+      "epoch": 0.14508723599632692,
+      "grad_norm": 0.2127244611718112,
+      "learning_rate": 9.99219287022689e-06,
+      "loss": 1.4498,
+      "step": 79
+    },
+    {
+      "epoch": 0.14692378328741965,
+      "grad_norm": 0.27213431233903435,
+      "learning_rate": 9.991776676211483e-06,
+      "loss": 1.8822,
+      "step": 80
+    },
+    {
+      "epoch": 0.1487603305785124,
+      "grad_norm": 0.22988463490869612,
+      "learning_rate": 9.991349683972435e-06,
+      "loss": 1.4995,
+      "step": 81
+    },
+    {
+      "epoch": 0.15059687786960516,
+      "grad_norm": 0.23481878477688978,
+      "learning_rate": 9.990911894433415e-06,
+      "loss": 1.5132,
+      "step": 82
+    },
+    {
+      "epoch": 0.15243342516069788,
+      "grad_norm": 0.37026228973170716,
+      "learning_rate": 9.990463308541452e-06,
+      "loss": 1.5846,
+      "step": 83
+    },
+    {
+      "epoch": 0.15426997245179064,
+      "grad_norm": 0.34328184021255104,
+      "learning_rate": 9.990003927266928e-06,
+      "loss": 1.5882,
+      "step": 84
+    },
+    {
+      "epoch": 0.1561065197428834,
+      "grad_norm": 0.2239251502463014,
+      "learning_rate": 9.989533751603578e-06,
+      "loss": 1.5294,
+      "step": 85
+    },
+    {
+      "epoch": 0.15794306703397612,
+      "grad_norm": 0.2531093496713428,
+      "learning_rate": 9.989052782568484e-06,
+      "loss": 1.4136,
+      "step": 86
+    },
+    {
+      "epoch": 0.15977961432506887,
+      "grad_norm": 0.22960377831673873,
+      "learning_rate": 9.988561021202083e-06,
+      "loss": 1.5179,
+      "step": 87
+    },
+    {
+      "epoch": 0.16161616161616163,
+      "grad_norm": 0.2353475082843009,
+      "learning_rate": 9.988058468568154e-06,
+      "loss": 1.5986,
+      "step": 88
+    },
+    {
+      "epoch": 0.16345270890725436,
+      "grad_norm": 0.2095228695568511,
+      "learning_rate": 9.987545125753818e-06,
+      "loss": 1.7077,
+      "step": 89
+    },
+    {
+      "epoch": 0.1652892561983471,
+      "grad_norm": 0.25954954331361235,
+      "learning_rate": 9.987020993869543e-06,
+      "loss": 1.5786,
+      "step": 90
+    },
+    {
+      "epoch": 0.16712580348943984,
+      "grad_norm": 0.3475458310303135,
+      "learning_rate": 9.986486074049131e-06,
+      "loss": 1.6145,
+      "step": 91
+    },
+    {
+      "epoch": 0.1689623507805326,
+      "grad_norm": 0.26936951415786353,
+      "learning_rate": 9.98594036744972e-06,
+      "loss": 1.7652,
+      "step": 92
+    },
+    {
+      "epoch": 0.17079889807162535,
+      "grad_norm": 0.21373420050407635,
+      "learning_rate": 9.985383875251783e-06,
+      "loss": 1.6871,
+      "step": 93
+    },
+    {
+      "epoch": 0.17263544536271808,
+      "grad_norm": 0.23205711833790327,
+      "learning_rate": 9.98481659865913e-06,
+      "loss": 1.4672,
+      "step": 94
+    },
+    {
+      "epoch": 0.17447199265381083,
+      "grad_norm": 0.26381334544086116,
+      "learning_rate": 9.98423853889889e-06,
+      "loss": 1.6741,
+      "step": 95
+    },
+    {
+      "epoch": 0.1763085399449036,
+      "grad_norm": 0.24396664978240085,
+      "learning_rate": 9.983649697221528e-06,
+      "loss": 1.5546,
+      "step": 96
+    },
+    {
+      "epoch": 0.1781450872359963,
+      "grad_norm": 0.2533801841511916,
+      "learning_rate": 9.983050074900824e-06,
+      "loss": 1.6902,
+      "step": 97
+    },
+    {
+      "epoch": 0.17998163452708907,
+      "grad_norm": 0.2115479895852038,
+      "learning_rate": 9.982439673233885e-06,
+      "loss": 1.6094,
+      "step": 98
+    },
+    {
+      "epoch": 0.18181818181818182,
+      "grad_norm": 0.22659674725493387,
+      "learning_rate": 9.98181849354113e-06,
+      "loss": 1.3953,
+      "step": 99
+    },
+    {
+      "epoch": 0.18365472910927455,
+      "grad_norm": 0.4346020173346875,
+      "learning_rate": 9.981186537166301e-06,
+      "loss": 1.4842,
+      "step": 100
+    },
+    {
+      "epoch": 0.1854912764003673,
+      "grad_norm": 0.22752027491511684,
+      "learning_rate": 9.980543805476447e-06,
+      "loss": 1.6125,
+      "step": 101
+    },
+    {
+      "epoch": 0.18732782369146006,
+      "grad_norm": 0.2178158645117292,
+      "learning_rate": 9.979890299861923e-06,
+      "loss": 1.3843,
+      "step": 102
+    },
+    {
+      "epoch": 0.1891643709825528,
+      "grad_norm": 0.2629457576326313,
+      "learning_rate": 9.979226021736396e-06,
+      "loss": 1.5034,
+      "step": 103
+    },
+    {
+      "epoch": 0.19100091827364554,
+      "grad_norm": 0.2638758563035785,
+      "learning_rate": 9.978550972536834e-06,
+      "loss": 1.2882,
+      "step": 104
+    },
+    {
+      "epoch": 0.1928374655647383,
+      "grad_norm": 0.25957055432676646,
+      "learning_rate": 9.977865153723508e-06,
+      "loss": 1.5669,
+      "step": 105
+    },
+    {
+      "epoch": 0.19467401285583102,
+      "grad_norm": 0.2107272760638706,
+      "learning_rate": 9.977168566779976e-06,
+      "loss": 1.4316,
+      "step": 106
+    },
+    {
+      "epoch": 0.19651056014692378,
+      "grad_norm": 0.23996444946668347,
+      "learning_rate": 9.976461213213104e-06,
+      "loss": 1.5958,
+      "step": 107
+    },
+    {
+      "epoch": 0.19834710743801653,
+      "grad_norm": 0.3866853138626082,
+      "learning_rate": 9.975743094553037e-06,
+      "loss": 1.6301,
+      "step": 108
+    },
+    {
+      "epoch": 0.20018365472910926,
+      "grad_norm": 0.2659575860373734,
+      "learning_rate": 9.975014212353212e-06,
+      "loss": 1.6435,
+      "step": 109
+    },
+    {
+      "epoch": 0.20202020202020202,
+      "grad_norm": 0.25698703101518205,
+      "learning_rate": 9.974274568190349e-06,
+      "loss": 1.4947,
+      "step": 110
+    },
+    {
+      "epoch": 0.20385674931129477,
+      "grad_norm": 0.23394729883248447,
+      "learning_rate": 9.973524163664447e-06,
+      "loss": 1.5486,
+      "step": 111
+    },
+    {
+      "epoch": 0.2056932966023875,
+      "grad_norm": 0.2682338169486529,
+      "learning_rate": 9.972763000398784e-06,
+      "loss": 1.562,
+      "step": 112
+    },
+    {
+      "epoch": 0.20752984389348025,
+      "grad_norm": 0.22594240276292787,
+      "learning_rate": 9.971991080039912e-06,
+      "loss": 1.6665,
+      "step": 113
+    },
+    {
+      "epoch": 0.209366391184573,
+      "grad_norm": 0.2716099274981758,
+      "learning_rate": 9.971208404257647e-06,
+      "loss": 1.6069,
+      "step": 114
+    },
+    {
+      "epoch": 0.21120293847566574,
+      "grad_norm": 0.215642600558555,
+      "learning_rate": 9.970414974745077e-06,
+      "loss": 1.426,
+      "step": 115
+    },
+    {
+      "epoch": 0.2130394857667585,
+      "grad_norm": 0.26192594390837787,
+      "learning_rate": 9.96961079321855e-06,
+      "loss": 1.4929,
+      "step": 116
+    },
+    {
+      "epoch": 0.21487603305785125,
+      "grad_norm": 0.24076680870279565,
+      "learning_rate": 9.968795861417676e-06,
+      "loss": 1.5116,
+      "step": 117
+    },
+    {
+      "epoch": 0.21671258034894397,
+      "grad_norm": 0.20785778608018918,
+      "learning_rate": 9.967970181105315e-06,
+      "loss": 1.4824,
+      "step": 118
+    },
+    {
+      "epoch": 0.21854912764003673,
+      "grad_norm": 0.2474137833375562,
+      "learning_rate": 9.967133754067581e-06,
+      "loss": 1.6394,
+      "step": 119
+    },
+    {
+      "epoch": 0.22038567493112948,
+      "grad_norm": 0.2415950163286452,
+      "learning_rate": 9.966286582113838e-06,
+      "loss": 1.4747,
+      "step": 120
+    },
+    {
+      "epoch": 0.2222222222222222,
+      "grad_norm": 0.25397048864143756,
+      "learning_rate": 9.965428667076687e-06,
+      "loss": 1.626,
+      "step": 121
+    },
+    {
+      "epoch": 0.22405876951331496,
+      "grad_norm": 0.27597092429735764,
+      "learning_rate": 9.964560010811972e-06,
+      "loss": 1.4853,
+      "step": 122
+    },
+    {
+      "epoch": 0.22589531680440772,
+      "grad_norm": 0.2773282618369793,
+      "learning_rate": 9.963680615198774e-06,
+      "loss": 1.2673,
+      "step": 123
+    },
+    {
+      "epoch": 0.22773186409550045,
+      "grad_norm": 0.2863982446521439,
+      "learning_rate": 9.962790482139402e-06,
+      "loss": 1.4531,
+      "step": 124
+    },
+    {
+      "epoch": 0.2295684113865932,
+      "grad_norm": 0.24940341962059176,
+      "learning_rate": 9.961889613559396e-06,
+      "loss": 1.5392,
+      "step": 125
+    },
+    {
+      "epoch": 0.23140495867768596,
+      "grad_norm": 0.2692207944659178,
+      "learning_rate": 9.960978011407516e-06,
+      "loss": 1.3452,
+      "step": 126
+    },
+    {
+      "epoch": 0.23324150596877868,
+      "grad_norm": 0.2394265357414062,
+      "learning_rate": 9.960055677655743e-06,
+      "loss": 1.4267,
+      "step": 127
+    },
+    {
+      "epoch": 0.23507805325987144,
+      "grad_norm": 0.2396211231483559,
+      "learning_rate": 9.95912261429927e-06,
+      "loss": 1.669,
+      "step": 128
+    },
+    {
+      "epoch": 0.2369146005509642,
+      "grad_norm": 0.22480647337089882,
+      "learning_rate": 9.958178823356503e-06,
+      "loss": 1.3276,
+      "step": 129
+    },
+    {
+      "epoch": 0.23875114784205692,
+      "grad_norm": 0.2322223276315898,
+      "learning_rate": 9.957224306869053e-06,
+      "loss": 1.6457,
+      "step": 130
+    },
+    {
+      "epoch": 0.24058769513314968,
+      "grad_norm": 0.28675358511507826,
+      "learning_rate": 9.956259066901733e-06,
+      "loss": 1.4844,
+      "step": 131
+    },
+    {
+      "epoch": 0.24242424242424243,
+      "grad_norm": 0.23506904729263256,
+      "learning_rate": 9.955283105542551e-06,
+      "loss": 1.5401,
+      "step": 132
+    },
+    {
+      "epoch": 0.24426078971533516,
+      "grad_norm": 0.25409979083106216,
+      "learning_rate": 9.954296424902709e-06,
+      "loss": 1.5796,
+      "step": 133
+    },
+    {
+      "epoch": 0.2460973370064279,
+      "grad_norm": 0.27537727017693314,
+      "learning_rate": 9.953299027116598e-06,
+      "loss": 1.7015,
+      "step": 134
+    },
+    {
+      "epoch": 0.24793388429752067,
+      "grad_norm": 0.255527421712665,
+      "learning_rate": 9.95229091434179e-06,
+      "loss": 1.6943,
+      "step": 135
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "grad_norm": 0.2758931212786201,
+      "learning_rate": 9.95127208875904e-06,
+      "loss": 1.6373,
+      "step": 136
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "eval_loss": 2.332951307296753,
+      "eval_runtime": 38.5842,
+      "eval_samples_per_second": 5.313,
+      "eval_steps_per_second": 0.467,
+      "step": 136
+    },
+    {
+      "epoch": 0.2516069788797062,
+      "grad_norm": 0.4849948087122718,
+      "learning_rate": 9.950242552572272e-06,
+      "loss": 1.5843,
+      "step": 137
+    },
+    {
+      "epoch": 0.2534435261707989,
+      "grad_norm": 0.27082023040786063,
+      "learning_rate": 9.949202308008581e-06,
+      "loss": 1.466,
+      "step": 138
+    },
+    {
+      "epoch": 0.25528007346189163,
+      "grad_norm": 0.21412319589684112,
+      "learning_rate": 9.948151357318228e-06,
+      "loss": 1.5575,
+      "step": 139
+    },
+    {
+      "epoch": 0.2571166207529844,
+      "grad_norm": 0.2630300060870272,
+      "learning_rate": 9.94708970277463e-06,
+      "loss": 1.8459,
+      "step": 140
+    },
+    {
+      "epoch": 0.25895316804407714,
+      "grad_norm": 0.29584228360860926,
+      "learning_rate": 9.946017346674362e-06,
+      "loss": 1.4765,
+      "step": 141
+    },
+    {
+      "epoch": 0.26078971533516987,
+      "grad_norm": 0.20420849217608372,
+      "learning_rate": 9.944934291337146e-06,
+      "loss": 1.3963,
+      "step": 142
+    },
+    {
+      "epoch": 0.26262626262626265,
+      "grad_norm": 0.2383087119690396,
+      "learning_rate": 9.943840539105853e-06,
+      "loss": 1.6948,
+      "step": 143
+    },
+    {
+      "epoch": 0.2644628099173554,
+      "grad_norm": 0.22707287878559146,
+      "learning_rate": 9.942736092346487e-06,
+      "loss": 1.5627,
+      "step": 144
+    },
+    {
+      "epoch": 0.2662993572084481,
+      "grad_norm": 0.2209791613669926,
+      "learning_rate": 9.941620953448195e-06,
+      "loss": 1.6011,
+      "step": 145
+    },
+    {
+      "epoch": 0.2681359044995409,
+      "grad_norm": 0.23620122895922513,
+      "learning_rate": 9.940495124823241e-06,
+      "loss": 1.4172,
+      "step": 146
+    },
+    {
+      "epoch": 0.2699724517906336,
+      "grad_norm": 0.4575809432111337,
+      "learning_rate": 9.939358608907026e-06,
+      "loss": 1.8045,
+      "step": 147
+    },
+    {
+      "epoch": 0.27180899908172634,
+      "grad_norm": 0.25576228816691954,
+      "learning_rate": 9.938211408158063e-06,
+      "loss": 1.5559,
+      "step": 148
+    },
+    {
+      "epoch": 0.2736455463728191,
+      "grad_norm": 0.32262207355286887,
+      "learning_rate": 9.937053525057977e-06,
+      "loss": 1.6491,
+      "step": 149
+    },
+    {
+      "epoch": 0.27548209366391185,
+      "grad_norm": 0.29602023759033497,
+      "learning_rate": 9.935884962111506e-06,
+      "loss": 1.6518,
+      "step": 150
+    },
+    {
+      "epoch": 0.2773186409550046,
+      "grad_norm": 0.24182886602369053,
+      "learning_rate": 9.934705721846487e-06,
+      "loss": 1.5457,
+      "step": 151
+    },
+    {
+      "epoch": 0.27915518824609736,
+      "grad_norm": 0.2247571699952089,
+      "learning_rate": 9.933515806813856e-06,
+      "loss": 1.481,
+      "step": 152
+    },
+    {
+      "epoch": 0.2809917355371901,
+      "grad_norm": 0.24890915769392072,
+      "learning_rate": 9.932315219587641e-06,
+      "loss": 1.618,
+      "step": 153
+    },
+    {
+      "epoch": 0.2828282828282828,
+      "grad_norm": 0.2597194625874549,
+      "learning_rate": 9.931103962764955e-06,
+      "loss": 1.5653,
+      "step": 154
+    },
+    {
+      "epoch": 0.2846648301193756,
+      "grad_norm": 0.23725030845640346,
+      "learning_rate": 9.92988203896599e-06,
+      "loss": 1.4677,
+      "step": 155
+    },
+    {
+      "epoch": 0.2865013774104683,
+      "grad_norm": 0.20619150412894088,
+      "learning_rate": 9.928649450834015e-06,
+      "loss": 1.6779,
+      "step": 156
+    },
+    {
+      "epoch": 0.28833792470156105,
+      "grad_norm": 0.23919303859135752,
+      "learning_rate": 9.927406201035368e-06,
+      "loss": 1.4417,
+      "step": 157
+    },
+    {
+      "epoch": 0.29017447199265384,
+      "grad_norm": 0.2244668514529571,
+      "learning_rate": 9.926152292259452e-06,
+      "loss": 1.7272,
+      "step": 158
+    },
+    {
+      "epoch": 0.29201101928374656,
+      "grad_norm": 0.26954841337527125,
+      "learning_rate": 9.924887727218724e-06,
+      "loss": 1.6068,
+      "step": 159
+    },
+    {
+      "epoch": 0.2938475665748393,
+      "grad_norm": 0.32951953455251004,
+      "learning_rate": 9.923612508648693e-06,
+      "loss": 1.406,
+      "step": 160
+    },
+    {
+      "epoch": 0.2956841138659321,
+      "grad_norm": 0.2698529792514822,
+      "learning_rate": 9.922326639307918e-06,
+      "loss": 1.683,
+      "step": 161
+    },
+    {
+      "epoch": 0.2975206611570248,
+      "grad_norm": 0.22420186125700636,
+      "learning_rate": 9.921030121977992e-06,
+      "loss": 1.5398,
+      "step": 162
+    },
+    {
+      "epoch": 0.29935720844811753,
+      "grad_norm": 0.24335042870850987,
+      "learning_rate": 9.919722959463545e-06,
+      "loss": 1.5752,
+      "step": 163
+    },
+    {
+      "epoch": 0.3011937557392103,
+      "grad_norm": 0.272993009874352,
+      "learning_rate": 9.918405154592234e-06,
+      "loss": 1.6791,
+      "step": 164
+    },
+    {
+      "epoch": 0.30303030303030304,
+      "grad_norm": 0.36447396005561716,
+      "learning_rate": 9.917076710214739e-06,
+      "loss": 1.8303,
+      "step": 165
+    },
+    {
+      "epoch": 0.30486685032139577,
+      "grad_norm": 0.266743073761148,
+      "learning_rate": 9.915737629204754e-06,
+      "loss": 1.652,
+      "step": 166
+    },
+    {
+      "epoch": 0.30670339761248855,
+      "grad_norm": 0.22394219745904015,
+      "learning_rate": 9.914387914458983e-06,
+      "loss": 1.5615,
+      "step": 167
+    },
+    {
+      "epoch": 0.3085399449035813,
+      "grad_norm": 0.23075889412968112,
+      "learning_rate": 9.91302756889713e-06,
+      "loss": 1.6447,
+      "step": 168
+    },
+    {
+      "epoch": 0.310376492194674,
+      "grad_norm": 0.2441975693564735,
+      "learning_rate": 9.911656595461899e-06,
+      "loss": 1.5981,
+      "step": 169
+    },
+    {
+      "epoch": 0.3122130394857668,
+      "grad_norm": 0.21377545765414097,
+      "learning_rate": 9.910274997118982e-06,
+      "loss": 1.6066,
+      "step": 170
+    },
+    {
+      "epoch": 0.3140495867768595,
+      "grad_norm": 0.21518096806340806,
+      "learning_rate": 9.908882776857057e-06,
+      "loss": 1.199,
+      "step": 171
+    },
+    {
+      "epoch": 0.31588613406795224,
+      "grad_norm": 0.22989533865542952,
+      "learning_rate": 9.907479937687779e-06,
+      "loss": 1.6019,
+      "step": 172
+    },
+    {
+      "epoch": 0.317722681359045,
+      "grad_norm": 0.24187157970795195,
+      "learning_rate": 9.906066482645774e-06,
+      "loss": 1.5453,
+      "step": 173
+    },
+    {
+      "epoch": 0.31955922865013775,
+      "grad_norm": 0.28880156295741904,
+      "learning_rate": 9.904642414788627e-06,
+      "loss": 1.6518,
+      "step": 174
+    },
+    {
+      "epoch": 0.3213957759412305,
+      "grad_norm": 0.3064989299701211,
+      "learning_rate": 9.903207737196892e-06,
+      "loss": 1.5614,
+      "step": 175
+    },
+    {
+      "epoch": 0.32323232323232326,
+      "grad_norm": 0.5501951504862674,
+      "learning_rate": 9.90176245297406e-06,
+      "loss": 1.3988,
+      "step": 176
+    },
+    {
+      "epoch": 0.325068870523416,
+      "grad_norm": 0.23086867624049656,
+      "learning_rate": 9.900306565246579e-06,
+      "loss": 1.4688,
+      "step": 177
+    },
+    {
+      "epoch": 0.3269054178145087,
+      "grad_norm": 0.24109267951104685,
+      "learning_rate": 9.898840077163824e-06,
+      "loss": 1.342,
+      "step": 178
+    },
+    {
+      "epoch": 0.3287419651056015,
+      "grad_norm": 0.221519141054226,
+      "learning_rate": 9.89736299189811e-06,
+      "loss": 1.6468,
+      "step": 179
+    },
+    {
+      "epoch": 0.3305785123966942,
+      "grad_norm": 0.2134481965910651,
+      "learning_rate": 9.89587531264467e-06,
+      "loss": 1.4762,
+      "step": 180
+    },
+    {
+      "epoch": 0.33241505968778695,
+      "grad_norm": 0.30273218459666634,
+      "learning_rate": 9.894377042621654e-06,
+      "loss": 1.2952,
+      "step": 181
+    },
+    {
+      "epoch": 0.3342516069788797,
+      "grad_norm": 0.2643249012553608,
+      "learning_rate": 9.892868185070125e-06,
+      "loss": 1.5922,
+      "step": 182
+    },
+    {
+      "epoch": 0.33608815426997246,
+      "grad_norm": 0.3017798778461224,
+      "learning_rate": 9.891348743254046e-06,
+      "loss": 1.3327,
+      "step": 183
+    },
+    {
+      "epoch": 0.3379247015610652,
+      "grad_norm": 0.198099058736144,
+      "learning_rate": 9.889818720460281e-06,
+      "loss": 1.4528,
+      "step": 184
+    },
+    {
+      "epoch": 0.3397612488521579,
+      "grad_norm": 0.2342720457991802,
+      "learning_rate": 9.888278119998573e-06,
+      "loss": 1.396,
+      "step": 185
+    },
+    {
+      "epoch": 0.3415977961432507,
+      "grad_norm": 0.30360601805904236,
+      "learning_rate": 9.886726945201556e-06,
+      "loss": 1.5982,
+      "step": 186
+    },
+    {
+      "epoch": 0.3434343434343434,
+      "grad_norm": 0.2890684354336481,
+      "learning_rate": 9.885165199424738e-06,
+      "loss": 1.3935,
+      "step": 187
+    },
+    {
+      "epoch": 0.34527089072543615,
+      "grad_norm": 0.2574557316071565,
+      "learning_rate": 9.883592886046486e-06,
+      "loss": 1.449,
+      "step": 188
+    },
+    {
+      "epoch": 0.34710743801652894,
+      "grad_norm": 0.23195985985184547,
+      "learning_rate": 9.882010008468038e-06,
+      "loss": 1.4909,
+      "step": 189
+    },
+    {
+      "epoch": 0.34894398530762166,
+      "grad_norm": 0.2539011848151687,
+      "learning_rate": 9.880416570113472e-06,
+      "loss": 1.5123,
+      "step": 190
+    },
+    {
+      "epoch": 0.3507805325987144,
+      "grad_norm": 0.26954455617431194,
+      "learning_rate": 9.878812574429722e-06,
+      "loss": 1.4445,
+      "step": 191
+    },
+    {
+      "epoch": 0.3526170798898072,
+      "grad_norm": 0.23141695311529595,
+      "learning_rate": 9.877198024886553e-06,
+      "loss": 1.9045,
+      "step": 192
+    },
+    {
+      "epoch": 0.3544536271808999,
+      "grad_norm": 0.2750943021523168,
+      "learning_rate": 9.875572924976568e-06,
+      "loss": 1.5868,
+      "step": 193
+    },
+    {
+      "epoch": 0.3562901744719926,
+      "grad_norm": 0.23421966078059409,
+      "learning_rate": 9.873937278215181e-06,
+      "loss": 1.7534,
+      "step": 194
+    },
+    {
+      "epoch": 0.3581267217630854,
+      "grad_norm": 0.24409550991932608,
+      "learning_rate": 9.87229108814063e-06,
+      "loss": 1.4753,
+      "step": 195
+    },
+    {
+      "epoch": 0.35996326905417814,
+      "grad_norm": 0.24998063066925763,
+      "learning_rate": 9.870634358313956e-06,
+      "loss": 1.6574,
+      "step": 196
+    },
+    {
+      "epoch": 0.36179981634527086,
+      "grad_norm": 0.2630317204109116,
+      "learning_rate": 9.868967092319003e-06,
+      "loss": 1.6794,
+      "step": 197
+    },
+    {
+      "epoch": 0.36363636363636365,
+      "grad_norm": 0.21473616516429722,
+      "learning_rate": 9.867289293762403e-06,
+      "loss": 1.7626,
+      "step": 198
+    },
+    {
+      "epoch": 0.3654729109274564,
+      "grad_norm": 0.3020374891635284,
+      "learning_rate": 9.865600966273576e-06,
+      "loss": 1.5234,
+      "step": 199
+    },
+    {
+      "epoch": 0.3673094582185491,
+      "grad_norm": 0.24122137539024896,
+      "learning_rate": 9.863902113504713e-06,
+      "loss": 1.5807,
+      "step": 200
+    },
+    {
+      "epoch": 0.3691460055096419,
+      "grad_norm": 0.2240345557985464,
+      "learning_rate": 9.86219273913078e-06,
+      "loss": 1.4635,
+      "step": 201
+    },
+    {
+      "epoch": 0.3709825528007346,
+      "grad_norm": 0.2561505890958098,
+      "learning_rate": 9.860472846849498e-06,
+      "loss": 1.5781,
+      "step": 202
+    },
+    {
+      "epoch": 0.37281910009182734,
+      "grad_norm": 0.2629334369467521,
+      "learning_rate": 9.858742440381343e-06,
+      "loss": 1.3698,
+      "step": 203
+    },
+    {
+      "epoch": 0.3746556473829201,
+      "grad_norm": 0.2643820816427679,
+      "learning_rate": 9.857001523469534e-06,
+      "loss": 1.6831,
+      "step": 204
+    },
+    {
+      "epoch": 0.37649219467401285,
+      "grad_norm": 0.27568924761133784,
+      "learning_rate": 9.855250099880026e-06,
+      "loss": 1.5586,
+      "step": 205
+    },
+    {
+      "epoch": 0.3783287419651056,
+      "grad_norm": 0.23562831853645116,
+      "learning_rate": 9.853488173401504e-06,
+      "loss": 1.4529,
+      "step": 206
+    },
+    {
+      "epoch": 0.38016528925619836,
+      "grad_norm": 0.24270051421435648,
+      "learning_rate": 9.851715747845372e-06,
+      "loss": 1.5449,
+      "step": 207
+    },
+    {
+      "epoch": 0.3820018365472911,
+      "grad_norm": 0.3141794855298513,
+      "learning_rate": 9.849932827045746e-06,
+      "loss": 1.6011,
+      "step": 208
+    },
+    {
+      "epoch": 0.3838383838383838,
+      "grad_norm": 0.2347451989106533,
+      "learning_rate": 9.848139414859441e-06,
+      "loss": 1.7994,
+      "step": 209
+    },
+    {
+      "epoch": 0.3856749311294766,
+      "grad_norm": 0.22998314428761488,
+      "learning_rate": 9.846335515165974e-06,
+      "loss": 1.5024,
+      "step": 210
+    },
+    {
+      "epoch": 0.3875114784205693,
+      "grad_norm": 0.2914601119925799,
+      "learning_rate": 9.844521131867546e-06,
+      "loss": 1.6718,
+      "step": 211
+    },
+    {
+      "epoch": 0.38934802571166205,
+      "grad_norm": 0.27307242607178106,
+      "learning_rate": 9.842696268889032e-06,
+      "loss": 1.6705,
+      "step": 212
+    },
+    {
+      "epoch": 0.39118457300275483,
+      "grad_norm": 0.26989044058601575,
+      "learning_rate": 9.840860930177984e-06,
+      "loss": 1.5762,
+      "step": 213
+    },
+    {
+      "epoch": 0.39302112029384756,
+      "grad_norm": 0.23544376195311703,
+      "learning_rate": 9.839015119704607e-06,
+      "loss": 1.4928,
+      "step": 214
+    },
+    {
+      "epoch": 0.3948576675849403,
+      "grad_norm": 0.40380733954206144,
+      "learning_rate": 9.837158841461767e-06,
+      "loss": 1.5587,
+      "step": 215
+    },
+    {
+      "epoch": 0.39669421487603307,
+      "grad_norm": 0.2416750029017525,
+      "learning_rate": 9.835292099464965e-06,
+      "loss": 1.4265,
+      "step": 216
+    },
+    {
+      "epoch": 0.3985307621671258,
+      "grad_norm": 0.20943162169896912,
+      "learning_rate": 9.833414897752346e-06,
+      "loss": 1.5836,
+      "step": 217
+    },
+    {
+      "epoch": 0.4003673094582185,
+      "grad_norm": 0.24319317049956413,
+      "learning_rate": 9.831527240384677e-06,
+      "loss": 1.6154,
+      "step": 218
+    },
+    {
+      "epoch": 0.4022038567493113,
+      "grad_norm": 0.2375469014345421,
+      "learning_rate": 9.829629131445342e-06,
+      "loss": 1.5652,
+      "step": 219
+    },
+    {
+      "epoch": 0.40404040404040403,
+      "grad_norm": 0.27739989413008637,
+      "learning_rate": 9.827720575040335e-06,
+      "loss": 1.5439,
+      "step": 220
+    },
+    {
+      "epoch": 0.40587695133149676,
+      "grad_norm": 0.24247147004672653,
+      "learning_rate": 9.825801575298248e-06,
+      "loss": 1.4613,
+      "step": 221
+    },
+    {
+      "epoch": 0.40771349862258954,
+      "grad_norm": 0.29413816874548104,
+      "learning_rate": 9.82387213637027e-06,
+      "loss": 1.4005,
+      "step": 222
+    },
+    {
+      "epoch": 0.40955004591368227,
+      "grad_norm": 0.21318983016138546,
+      "learning_rate": 9.821932262430164e-06,
+      "loss": 1.4747,
+      "step": 223
+    },
+    {
+      "epoch": 0.411386593204775,
+      "grad_norm": 0.24655890709082884,
+      "learning_rate": 9.819981957674273e-06,
+      "loss": 1.6599,
+      "step": 224
+    },
+    {
+      "epoch": 0.4132231404958678,
+      "grad_norm": 0.23420376177876423,
+      "learning_rate": 9.818021226321502e-06,
+      "loss": 1.5039,
+      "step": 225
+    },
+    {
+      "epoch": 0.4150596877869605,
+      "grad_norm": 0.23379966460981552,
+      "learning_rate": 9.816050072613306e-06,
+      "loss": 1.775,
+      "step": 226
+    },
+    {
+      "epoch": 0.41689623507805323,
+      "grad_norm": 0.30210714633151925,
+      "learning_rate": 9.814068500813692e-06,
+      "loss": 1.5692,
+      "step": 227
+    },
+    {
+      "epoch": 0.418732782369146,
+      "grad_norm": 0.24124025669836516,
+      "learning_rate": 9.812076515209201e-06,
+      "loss": 1.5682,
+      "step": 228
+    },
+    {
+      "epoch": 0.42056932966023874,
+      "grad_norm": 0.40694547415364124,
+      "learning_rate": 9.8100741201089e-06,
+      "loss": 1.3886,
+      "step": 229
+    },
+    {
+      "epoch": 0.42240587695133147,
+      "grad_norm": 0.5017797555556736,
+      "learning_rate": 9.808061319844376e-06,
+      "loss": 1.5096,
+      "step": 230
+    },
+    {
+      "epoch": 0.42424242424242425,
+      "grad_norm": 0.2395927998641603,
+      "learning_rate": 9.806038118769724e-06,
+      "loss": 1.6511,
+      "step": 231
+    },
+    {
+      "epoch": 0.426078971533517,
+      "grad_norm": 0.26346897129489716,
+      "learning_rate": 9.804004521261537e-06,
+      "loss": 1.4852,
+      "step": 232
+    },
+    {
+      "epoch": 0.4279155188246097,
+      "grad_norm": 0.21927054884906805,
+      "learning_rate": 9.801960531718898e-06,
+      "loss": 1.3796,
+      "step": 233
+    },
+    {
+      "epoch": 0.4297520661157025,
+      "grad_norm": 0.21216613988150154,
+      "learning_rate": 9.79990615456337e-06,
+      "loss": 1.3236,
+      "step": 234
+    },
+    {
+      "epoch": 0.4315886134067952,
+      "grad_norm": 0.2439837140444034,
+      "learning_rate": 9.797841394238987e-06,
+      "loss": 1.4752,
+      "step": 235
+    },
+    {
+      "epoch": 0.43342516069788795,
+      "grad_norm": 0.20264650772176668,
+      "learning_rate": 9.795766255212242e-06,
+      "loss": 1.4633,
+      "step": 236
+    },
+    {
+      "epoch": 0.43526170798898073,
+      "grad_norm": 0.2214142026219714,
+      "learning_rate": 9.793680741972084e-06,
+      "loss": 1.524,
+      "step": 237
+    },
+    {
+      "epoch": 0.43709825528007346,
+      "grad_norm": 0.32400463641987054,
+      "learning_rate": 9.791584859029901e-06,
+      "loss": 1.7717,
+      "step": 238
+    },
+    {
+      "epoch": 0.4389348025711662,
+      "grad_norm": 0.25353704234527624,
+      "learning_rate": 9.789478610919508e-06,
+      "loss": 1.4503,
+      "step": 239
+    },
+    {
+      "epoch": 0.44077134986225897,
+      "grad_norm": 0.28666088570706005,
+      "learning_rate": 9.787362002197147e-06,
+      "loss": 1.5374,
+      "step": 240
+    },
+    {
+      "epoch": 0.4426078971533517,
+      "grad_norm": 0.2575712788223055,
+      "learning_rate": 9.785235037441473e-06,
+      "loss": 1.3976,
+      "step": 241
+    },
+    {
+      "epoch": 0.4444444444444444,
+      "grad_norm": 0.235205219080783,
+      "learning_rate": 9.783097721253543e-06,
+      "loss": 1.6037,
+      "step": 242
+    },
+    {
+      "epoch": 0.4462809917355372,
+      "grad_norm": 0.23780080068966725,
+      "learning_rate": 9.780950058256802e-06,
+      "loss": 1.679,
+      "step": 243
+    },
+    {
+      "epoch": 0.44811753902662993,
+      "grad_norm": 0.3404150158565561,
+      "learning_rate": 9.778792053097079e-06,
+      "loss": 1.3573,
+      "step": 244
+    },
+    {
+      "epoch": 0.44995408631772266,
+      "grad_norm": 0.21082516759926104,
+      "learning_rate": 9.77662371044258e-06,
+      "loss": 1.4932,
+      "step": 245
+    },
+    {
+      "epoch": 0.45179063360881544,
+      "grad_norm": 0.24031601796602936,
+      "learning_rate": 9.774445034983864e-06,
+      "loss": 1.7397,
+      "step": 246
+    },
+    {
+      "epoch": 0.45362718089990817,
+      "grad_norm": 0.2207009467162113,
+      "learning_rate": 9.77225603143385e-06,
+      "loss": 1.585,
+      "step": 247
+    },
+    {
+      "epoch": 0.4554637281910009,
+      "grad_norm": 0.2551403718915401,
+      "learning_rate": 9.770056704527797e-06,
+      "loss": 1.4924,
+      "step": 248
+    },
+    {
+      "epoch": 0.4573002754820937,
+      "grad_norm": 0.23525171894308203,
+      "learning_rate": 9.767847059023292e-06,
+      "loss": 1.5658,
+      "step": 249
+    },
+    {
+      "epoch": 0.4591368227731864,
+      "grad_norm": 0.2340311514550259,
+      "learning_rate": 9.765627099700248e-06,
+      "loss": 1.7361,
+      "step": 250
+    },
+    {
+      "epoch": 0.46097337006427913,
+      "grad_norm": 0.3425610884720096,
+      "learning_rate": 9.763396831360884e-06,
+      "loss": 1.4723,
+      "step": 251
+    },
+    {
+      "epoch": 0.4628099173553719,
+      "grad_norm": 0.232643381531555,
+      "learning_rate": 9.761156258829723e-06,
+      "loss": 1.5543,
+      "step": 252
+    },
+    {
+      "epoch": 0.46464646464646464,
+      "grad_norm": 0.3601600310692427,
+      "learning_rate": 9.75890538695358e-06,
+      "loss": 1.4195,
+      "step": 253
+    },
+    {
+      "epoch": 0.46648301193755737,
+      "grad_norm": 0.2625087171937245,
+      "learning_rate": 9.756644220601541e-06,
+      "loss": 1.7209,
+      "step": 254
+    },
+    {
+      "epoch": 0.46831955922865015,
+      "grad_norm": 0.36091521146763844,
+      "learning_rate": 9.75437276466497e-06,
+      "loss": 1.4435,
+      "step": 255
+    },
+    {
+      "epoch": 0.4701561065197429,
+      "grad_norm": 0.22970766162190284,
+      "learning_rate": 9.752091024057485e-06,
+      "loss": 1.3894,
+      "step": 256
+    },
+    {
+      "epoch": 0.4719926538108356,
+      "grad_norm": 0.2708039374301605,
+      "learning_rate": 9.749799003714954e-06,
+      "loss": 1.4717,
+      "step": 257
+    },
+    {
+      "epoch": 0.4738292011019284,
+      "grad_norm": 0.22940138762480203,
+      "learning_rate": 9.747496708595482e-06,
+      "loss": 1.532,
+      "step": 258
+    },
+    {
+      "epoch": 0.4756657483930211,
+      "grad_norm": 0.27196638223072084,
+      "learning_rate": 9.745184143679398e-06,
+      "loss": 1.4425,
+      "step": 259
+    },
+    {
+      "epoch": 0.47750229568411384,
+      "grad_norm": 0.24883578158794614,
+      "learning_rate": 9.742861313969246e-06,
+      "loss": 1.4882,
+      "step": 260
+    },
+    {
+      "epoch": 0.4793388429752066,
+      "grad_norm": 0.24541193855388124,
+      "learning_rate": 9.74052822448978e-06,
+      "loss": 1.4851,
+      "step": 261
+    },
+    {
+      "epoch": 0.48117539026629935,
+      "grad_norm": 0.249310294245501,
+      "learning_rate": 9.738184880287946e-06,
+      "loss": 1.6463,
+      "step": 262
+    },
+    {
+      "epoch": 0.4830119375573921,
+      "grad_norm": 0.25707806827316415,
+      "learning_rate": 9.735831286432869e-06,
+      "loss": 1.6118,
+      "step": 263
+    },
+    {
+      "epoch": 0.48484848484848486,
+      "grad_norm": 0.22547510302041615,
+      "learning_rate": 9.733467448015849e-06,
+      "loss": 1.3343,
+      "step": 264
+    },
+    {
+      "epoch": 0.4866850321395776,
+      "grad_norm": 0.21415297945638267,
+      "learning_rate": 9.731093370150349e-06,
+      "loss": 1.8938,
+      "step": 265
+    },
+    {
+      "epoch": 0.4885215794306703,
+      "grad_norm": 0.25553884577553115,
+      "learning_rate": 9.728709057971979e-06,
+      "loss": 1.6681,
+      "step": 266
+    },
+    {
+      "epoch": 0.4903581267217631,
+      "grad_norm": 0.23479399192488148,
+      "learning_rate": 9.72631451663849e-06,
+      "loss": 1.3781,
+      "step": 267
+    },
+    {
+      "epoch": 0.4921946740128558,
+      "grad_norm": 0.2549932602973557,
+      "learning_rate": 9.723909751329759e-06,
+      "loss": 1.444,
+      "step": 268
+    },
+    {
+      "epoch": 0.49403122130394855,
+      "grad_norm": 0.24071196589287586,
+      "learning_rate": 9.721494767247779e-06,
+      "loss": 1.5817,
+      "step": 269
+    },
+    {
+      "epoch": 0.49586776859504134,
+      "grad_norm": 0.23040782897953827,
+      "learning_rate": 9.719069569616653e-06,
+      "loss": 1.2528,
+      "step": 270
+    },
+    {
+      "epoch": 0.49770431588613406,
+      "grad_norm": 0.2371564859647457,
+      "learning_rate": 9.71663416368257e-06,
+      "loss": 1.7053,
+      "step": 271
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "grad_norm": 0.2489215879444709,
+      "learning_rate": 9.71418855471381e-06,
+      "loss": 1.4637,
+      "step": 272
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "eval_loss": 2.313441038131714,
+      "eval_runtime": 39.8034,
+      "eval_samples_per_second": 5.15,
+      "eval_steps_per_second": 0.452,
+      "step": 272
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 2176,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 4,
+  "save_steps": 272,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 235355418132480.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}
diff --git a/checkpoint-272/training_args.bin b/checkpoint-272/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1c89872f76294700d651f52629596dab54835031
--- /dev/null
+++ b/checkpoint-272/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b66afbb22c27fefe6b63f9f74c2fd602fa1f166c83cc37801706b6aea4e033c
+size 8632
diff --git a/checkpoint-272/zero_to_fp32.py b/checkpoint-272/zero_to_fp32.py
new file mode 100644
index 0000000000000000000000000000000000000000..e69ecd9acb5a235ffbf927091051106d902b3d39
--- /dev/null
+++ b/checkpoint-272/zero_to_fp32.py
@@ -0,0 +1,674 @@
+#!/usr/bin/env python
+
+# Copyright (c) Microsoft Corporation.
+# SPDX-License-Identifier: Apache-2.0
+
+# DeepSpeed Team
+
+# This script extracts fp32 consolidated weights from a zero 1, 2 and 3 DeepSpeed checkpoints. It gets
+# copied into the top level checkpoint dir, so the user can easily do the conversion at any point in
+# the future. Once extracted, the weights don't require DeepSpeed and can be used in any
+# application.
+#
+# example:
+#   python zero_to_fp32.py . output_dir/
+#   or
+#   python zero_to_fp32.py . output_dir/ --safe_serialization
+
+import argparse
+import torch
+import glob
+import math
+import os
+import re
+import json
+from tqdm import tqdm
+from collections import OrderedDict
+from dataclasses import dataclass
+
+# while this script doesn't use deepspeed to recover data, since the checkpoints are pickled with
+# DeepSpeed data structures it has to be available in the current python environment.
+from deepspeed.utils import logger
+from deepspeed.checkpoint.constants import (DS_VERSION, OPTIMIZER_STATE_DICT, SINGLE_PARTITION_OF_FP32_GROUPS,
+                                            FP32_FLAT_GROUPS, ZERO_STAGE, PARTITION_COUNT, PARAM_SHAPES, BUFFER_NAMES,
+                                            FROZEN_PARAM_SHAPES, FROZEN_PARAM_FRAGMENTS)
+
+
+@dataclass
+class zero_model_state:
+    buffers: dict()
+    param_shapes: dict()
+    shared_params: list
+    ds_version: int
+    frozen_param_shapes: dict()
+    frozen_param_fragments: dict()
+
+
+debug = 0
+
+# load to cpu
+device = torch.device('cpu')
+
+
+def atoi(text):
+    return int(text) if text.isdigit() else text
+
+
+def natural_keys(text):
+    '''
+    alist.sort(key=natural_keys) sorts in human order
+    http://nedbatchelder.com/blog/200712/human_sorting.html
+    (See Toothy's implementation in the comments)
+    '''
+    return [atoi(c) for c in re.split(r'(\d+)', text)]
+
+
+def get_model_state_file(checkpoint_dir, zero_stage):
+    if not os.path.isdir(checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{checkpoint_dir}' doesn't exist")
+
+    # there should be only one file
+    if zero_stage <= 2:
+        file = os.path.join(checkpoint_dir, "mp_rank_00_model_states.pt")
+    elif zero_stage == 3:
+        file = os.path.join(checkpoint_dir, "zero_pp_rank_0_mp_rank_00_model_states.pt")
+
+    if not os.path.exists(file):
+        raise FileNotFoundError(f"can't find model states file at '{file}'")
+
+    return file
+
+
+def get_checkpoint_files(checkpoint_dir, glob_pattern):
+    # XXX: need to test that this simple glob rule works for multi-node setup too
+    ckpt_files = sorted(glob.glob(os.path.join(checkpoint_dir, glob_pattern)), key=natural_keys)
+
+    if len(ckpt_files) == 0:
+        raise FileNotFoundError(f"can't find {glob_pattern} files in directory '{checkpoint_dir}'")
+
+    return ckpt_files
+
+
+def get_optim_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_optim_states.pt")
+
+
+def get_model_state_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_model_states.pt")
+
+
+def parse_model_states(files):
+    zero_model_states = []
+    for file in files:
+        state_dict = torch.load(file, map_location=device)
+
+        if BUFFER_NAMES not in state_dict:
+            raise ValueError(f"{file} is not a model state checkpoint")
+        buffer_names = state_dict[BUFFER_NAMES]
+        if debug:
+            print("Found buffers:", buffer_names)
+
+        # recover just the buffers while restoring them to fp32 if they were saved in fp16
+        buffers = {k: v.float() for k, v in state_dict["module"].items() if k in buffer_names}
+        param_shapes = state_dict[PARAM_SHAPES]
+
+        # collect parameters that are included in param_shapes
+        param_names = []
+        for s in param_shapes:
+            for name in s.keys():
+                param_names.append(name)
+
+        # update with frozen parameters
+        frozen_param_shapes = state_dict.get(FROZEN_PARAM_SHAPES, None)
+        if frozen_param_shapes is not None:
+            if debug:
+                print(f"Found frozen_param_shapes: {frozen_param_shapes}")
+            param_names += list(frozen_param_shapes.keys())
+
+        # handle shared params
+        shared_params = [[k, v] for k, v in state_dict["shared_params"].items()]
+
+        ds_version = state_dict.get(DS_VERSION, None)
+
+        frozen_param_fragments = state_dict.get(FROZEN_PARAM_FRAGMENTS, None)
+
+        z_model_state = zero_model_state(buffers=buffers,
+                                         param_shapes=param_shapes,
+                                         shared_params=shared_params,
+                                         ds_version=ds_version,
+                                         frozen_param_shapes=frozen_param_shapes,
+                                         frozen_param_fragments=frozen_param_fragments)
+        zero_model_states.append(z_model_state)
+
+    return zero_model_states
+
+
+def parse_optim_states(files, ds_checkpoint_dir):
+    total_files = len(files)
+    state_dicts = []
+    for f in files:
+        state_dict = torch.load(f, map_location=device)
+        # immediately discard the potentially huge 2 optimizer states as we only care for fp32 master weights
+        # and also handle the case where it was already removed by another helper script
+        state_dict["optimizer_state_dict"].pop("optimizer_state_dict", None)
+        state_dicts.append(state_dict)
+
+    if not ZERO_STAGE in state_dicts[0][OPTIMIZER_STATE_DICT]:
+        raise ValueError(f"{files[0]} is not a zero checkpoint")
+    zero_stage = state_dicts[0][OPTIMIZER_STATE_DICT][ZERO_STAGE]
+    world_size = state_dicts[0][OPTIMIZER_STATE_DICT][PARTITION_COUNT]
+
+    # For ZeRO-2 each param group can have different partition_count as data parallelism for expert
+    # parameters can be different from data parallelism for non-expert parameters. So we can just
+    # use the max of the partition_count to get the dp world_size.
+
+    if type(world_size) is list:
+        world_size = max(world_size)
+
+    if world_size != total_files:
+        raise ValueError(
+            f"Expected {world_size} of '*_optim_states.pt' under '{ds_checkpoint_dir}' but found {total_files} files. "
+            "Possibly due to an overwrite of an old checkpoint, or a checkpoint didn't get saved by one or more processes."
+        )
+
+    # the groups are named differently in each stage
+    if zero_stage <= 2:
+        fp32_groups_key = SINGLE_PARTITION_OF_FP32_GROUPS
+    elif zero_stage == 3:
+        fp32_groups_key = FP32_FLAT_GROUPS
+    else:
+        raise ValueError(f"unknown zero stage {zero_stage}")
+
+    if zero_stage <= 2:
+        fp32_flat_groups = [state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key] for i in range(len(state_dicts))]
+    elif zero_stage == 3:
+        # if there is more than one param group, there will be multiple flattened tensors - one
+        # flattened tensor per group - for simplicity merge them into a single tensor
+        #
+        # XXX: could make the script more memory efficient for when there are multiple groups - it
+        # will require matching the sub-lists of param_shapes for each param group flattened tensor
+
+        fp32_flat_groups = [
+            torch.cat(state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key], 0) for i in range(len(state_dicts))
+        ]
+
+    return zero_stage, world_size, fp32_flat_groups
+
+
+def _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters):
+    """
+    Returns fp32 state_dict reconstructed from ds checkpoint
+
+    Args:
+        - ``ds_checkpoint_dir``: path to the deepspeed checkpoint folder (where the optimizer files are)
+
+    """
+    print(f"Processing zero checkpoint '{ds_checkpoint_dir}'")
+
+    optim_files = get_optim_files(ds_checkpoint_dir)
+    zero_stage, world_size, fp32_flat_groups = parse_optim_states(optim_files, ds_checkpoint_dir)
+    print(f"Detected checkpoint of type zero stage {zero_stage}, world_size: {world_size}")
+
+    model_files = get_model_state_files(ds_checkpoint_dir)
+
+    zero_model_states = parse_model_states(model_files)
+    print(f'Parsing checkpoint created by deepspeed=={zero_model_states[0].ds_version}')
+
+    if zero_stage <= 2:
+        return _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+    elif zero_stage == 3:
+        return _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+
+
+def _zero2_merge_frozen_params(state_dict, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+    frozen_param_fragments = zero_model_states[0].frozen_param_fragments
+
+    if debug:
+        num_elem = sum(s.numel() for s in frozen_param_shapes.values())
+        print(f'rank 0: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in frozen_param_fragments.values()])
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        state_dict[name] = frozen_param_fragments[name]
+
+        if debug:
+            print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _has_callable(obj, fn):
+    attr = getattr(obj, fn, None)
+    return callable(attr)
+
+
+def _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+
+    # Reconstruction protocol:
+    #
+    # XXX: document this
+
+    if debug:
+        for i in range(world_size):
+            for j in range(len(fp32_flat_groups[0])):
+                print(f"{FP32_FLAT_GROUPS}[{i}][{j}].shape={fp32_flat_groups[i][j].shape}")
+
+    # XXX: memory usage doubles here (zero2)
+    num_param_groups = len(fp32_flat_groups[0])
+    merged_single_partition_of_fp32_groups = []
+    for i in range(num_param_groups):
+        merged_partitions = [sd[i] for sd in fp32_flat_groups]
+        full_single_fp32_vector = torch.cat(merged_partitions, 0)
+        merged_single_partition_of_fp32_groups.append(full_single_fp32_vector)
+    avail_numel = sum(
+        [full_single_fp32_vector.numel() for full_single_fp32_vector in merged_single_partition_of_fp32_groups])
+
+    if debug:
+        wanted_params = sum([len(shapes) for shapes in param_shapes])
+        wanted_numel = sum([sum(shape.numel() for shape in shapes.values()) for shapes in param_shapes])
+        # not asserting if there is a mismatch due to possible padding
+        print(f"Have {avail_numel} numels to process.")
+        print(f"Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    total_numel = 0
+    total_params = 0
+    for shapes, full_single_fp32_vector in zip(param_shapes, merged_single_partition_of_fp32_groups):
+        offset = 0
+        avail_numel = full_single_fp32_vector.numel()
+        for name, shape in shapes.items():
+
+            unpartitioned_numel = shape.numel() if _has_callable(shape, 'numel') else math.prod(shape)
+            total_numel += unpartitioned_numel
+            total_params += 1
+
+            if debug:
+                print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+            state_dict[name] = full_single_fp32_vector.narrow(0, offset, unpartitioned_numel).view(shape)
+            offset += unpartitioned_numel
+
+        # Z2 started to align to 2*world_size to improve nccl performance. Therefore both offset and
+        # avail_numel can differ by anywhere between 0..2*world_size. Due to two unrelated complex
+        # paddings performed in the code it's almost impossible to predict the exact numbers w/o the
+        # live optimizer object, so we are checking that the numbers are within the right range
+        align_to = 2 * world_size
+
+        def zero2_align(x):
+            return align_to * math.ceil(x / align_to)
+
+        if debug:
+            print(f"original offset={offset}, avail_numel={avail_numel}")
+
+        offset = zero2_align(offset)
+        avail_numel = zero2_align(avail_numel)
+
+        if debug:
+            print(f"aligned  offset={offset}, avail_numel={avail_numel}")
+
+        # Sanity check
+        if offset != avail_numel:
+            raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero2_merge_frozen_params(state_dict, zero_model_states)
+
+    _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def zero3_partitioned_param_info(unpartitioned_numel, world_size):
+    remainder = unpartitioned_numel % world_size
+    padding_numel = (world_size - remainder) if remainder else 0
+    partitioned_numel = math.ceil(unpartitioned_numel / world_size)
+    return partitioned_numel, padding_numel
+
+
+def _zero3_merge_frozen_params(state_dict, world_size, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    if debug:
+        for i in range(world_size):
+            num_elem = sum(s.numel() for s in zero_model_states[i].frozen_param_fragments.values())
+            print(f'rank {i}: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in zero_model_states[0].frozen_param_fragments.values()]) * world_size
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in zero_model_states[0].frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        param_frags = tuple(model_state.frozen_param_fragments[name] for model_state in zero_model_states)
+        state_dict[name] = torch.cat(param_frags, 0).narrow(0, 0, unpartitioned_numel).view(shape)
+
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Frozen params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+    avail_numel = fp32_flat_groups[0].numel() * world_size
+    # Reconstruction protocol: For zero3 we need to zip the partitions together at boundary of each
+    # param, re-consolidating each param, while dealing with padding if any
+
+    # merge list of dicts, preserving order
+    param_shapes = {k: v for d in param_shapes for k, v in d.items()}
+
+    if debug:
+        for i in range(world_size):
+            print(f"{FP32_FLAT_GROUPS}[{i}].shape={fp32_flat_groups[i].shape}")
+
+        wanted_params = len(param_shapes)
+        wanted_numel = sum(shape.numel() for shape in param_shapes.values())
+        # not asserting if there is a mismatch due to possible padding
+        avail_numel = fp32_flat_groups[0].numel() * world_size
+        print(f"Trainable params: Have {avail_numel} numels to process.")
+        print(f"Trainable params: Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    offset = 0
+    total_numel = 0
+    total_params = 0
+    for name, shape in tqdm(param_shapes.items(), desc='Gathering Sharded Weights'):
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+        total_params += 1
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Trainable params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+        # XXX: memory usage doubles here
+        state_dict[name] = torch.cat(
+            tuple(fp32_flat_groups[i].narrow(0, offset, partitioned_numel) for i in range(world_size)),
+            0).narrow(0, 0, unpartitioned_numel).view(shape)
+        offset += partitioned_numel
+
+    offset *= world_size
+
+    # Sanity check
+    if offset != avail_numel:
+        raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed Trainable fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero3_merge_frozen_params(state_dict, world_size, zero_model_states)
+
+    _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag=None, exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated state_dict that can be loaded with
+    ``load_state_dict()`` and used for training without DeepSpeed or shared with others, for example
+    via a model hub.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in 'latest' file. e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+
+    Returns:
+        - pytorch ``state_dict``
+
+    Note: this approach may not work if your application doesn't have sufficient free CPU memory and
+    you may need to use the offline approach using the ``zero_to_fp32.py`` script that is saved with
+    the checkpoint.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import get_fp32_state_dict_from_zero_checkpoint
+        # do the training and checkpoint saving
+        state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir) # already on cpu
+        model = model.cpu() # move to cpu
+        model.load_state_dict(state_dict)
+        # submit to model hub or save the model to share with others
+
+    In this example the ``model`` will no longer be usable in the deepspeed context of the same
+    application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    If you want it all done for you, use ``load_state_dict_from_zero_checkpoint`` instead.
+
+    """
+    if tag is None:
+        latest_path = os.path.join(checkpoint_dir, 'latest')
+        if os.path.isfile(latest_path):
+            with open(latest_path, 'r') as fd:
+                tag = fd.read().strip()
+        else:
+            raise ValueError(f"Unable to find 'latest' file at {latest_path}")
+
+    ds_checkpoint_dir = os.path.join(checkpoint_dir, tag)
+
+    if not os.path.isdir(ds_checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{ds_checkpoint_dir}' doesn't exist")
+
+    return _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters)
+
+
+def convert_zero_checkpoint_to_fp32_state_dict(checkpoint_dir,
+                                               output_dir,
+                                               max_shard_size="5GB",
+                                               safe_serialization=False,
+                                               tag=None,
+                                               exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict`` file that can be
+    loaded with ``torch.load(file)`` + ``load_state_dict()`` and used for training without DeepSpeed.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``output_dir``: directory to the pytorch fp32 state_dict output files
+        - ``max_shard_size``: the maximum size for a checkpoint before being sharded, default value is 5GB
+        - ``safe_serialization``:  whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+    """
+    # Dependency pre-check
+    if safe_serialization:
+        try:
+            from safetensors.torch import save_file
+        except ImportError:
+            print('If you want to use `safe_serialization`, please `pip install safetensors`')
+            raise
+    if max_shard_size is not None:
+        try:
+            from huggingface_hub import split_torch_state_dict_into_shards
+        except ImportError:
+            print('If you want to use `max_shard_size`, please `pip install huggingface_hub`')
+            raise
+
+    # Convert zero checkpoint to state_dict
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag, exclude_frozen_parameters)
+
+    # Shard the model if it is too big.
+    weights_name = "model.safetensors" if safe_serialization else "pytorch_model.bin"
+    if max_shard_size is not None:
+        filename_pattern = weights_name.replace(".bin", "{suffix}.bin").replace(".safetensors", "{suffix}.safetensors")
+        state_dict_split = split_torch_state_dict_into_shards(state_dict,
+                                                              filename_pattern=filename_pattern,
+                                                              max_shard_size=max_shard_size)
+    else:
+        from collections import namedtuple
+        StateDictSplit = namedtuple("StateDictSplit", ["is_sharded", "filename_to_tensors"])
+        state_dict_split = StateDictSplit(is_sharded=False,
+                                          filename_to_tensors={weights_name: list(state_dict.keys())})
+
+    # Save the model
+    filename_to_tensors = state_dict_split.filename_to_tensors.items()
+    for shard_file, tensors in tqdm(filename_to_tensors, desc="Saving checkpoint shards"):
+        shard = {tensor: state_dict[tensor].contiguous() for tensor in tensors}
+        output_path = os.path.join(output_dir, shard_file)
+        if safe_serialization:
+            save_file(shard, output_path, metadata={"format": "pt"})
+        else:
+            torch.save(shard, output_path)
+
+    # Save index if sharded
+    if state_dict_split.is_sharded:
+        index = {
+            "metadata": state_dict_split.metadata,
+            "weight_map": state_dict_split.tensor_to_filename,
+        }
+        save_index_file = "model.safetensors.index.json" if safe_serialization else "pytorch_model.bin.index.json"
+        save_index_file = os.path.join(output_dir, save_index_file)
+        with open(save_index_file, "w", encoding="utf-8") as f:
+            content = json.dumps(index, indent=2, sort_keys=True) + "\n"
+            f.write(content)
+
+
+def load_state_dict_from_zero_checkpoint(model, checkpoint_dir, tag=None):
+    """
+    1. Put the provided model to cpu
+    2. Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict``
+    3. Load it into the provided model
+
+    Args:
+        - ``model``: the model object to update
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+
+    Returns:
+        - ``model`: modified model
+
+    Make sure you have plenty of CPU memory available before you call this function. If you don't
+    have enough use the ``zero_to_fp32.py`` utility to do the conversion. You will find it
+    conveniently placed for you in the checkpoint folder.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import load_state_dict_from_zero_checkpoint
+        model = load_state_dict_from_zero_checkpoint(trainer.model, checkpoint_dir)
+        # submit to model hub or save the model to share with others
+
+    Note, that once this was run, the ``model`` will no longer be usable in the deepspeed context
+    of the same application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    """
+    logger.info(f"Extracting fp32 weights")
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag)
+
+    logger.info(f"Overwriting model with fp32 weights")
+    model = model.cpu()
+    model.load_state_dict(state_dict, strict=False)
+
+    return model
+
+
+if __name__ == "__main__":
+    parser = argparse.ArgumentParser()
+    parser.add_argument("checkpoint_dir",
+                        type=str,
+                        help="path to the desired checkpoint folder, e.g., path/checkpoint-12")
+    parser.add_argument("output_dir",
+                        type=str,
+                        help="directory to the pytorch fp32 state_dict output files"
+                        "(e.g. path/checkpoint-12-output/)")
+    parser.add_argument(
+        "--max_shard_size",
+        type=str,
+        default="5GB",
+        help="The maximum size for a checkpoint before being sharded. Checkpoints shard will then be each of size"
+        "lower than this size. If expressed as a string, needs to be digits followed by a unit (like `5MB`"
+        "We default it to 5GB in order for models to be able to run easily on free-tier google colab instances"
+        "without CPU OOM issues.")
+    parser.add_argument(
+        "--safe_serialization",
+        default=False,
+        action='store_true',
+        help="Whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).")
+    parser.add_argument("-t",
+                        "--tag",
+                        type=str,
+                        default=None,
+                        help="checkpoint tag used as a unique identifier for checkpoint. e.g., global_step1")
+    parser.add_argument("--exclude_frozen_parameters", action='store_true', help="exclude frozen parameters")
+    parser.add_argument("-d", "--debug", action='store_true', help="enable debug")
+    args = parser.parse_args()
+
+    debug = args.debug
+
+    convert_zero_checkpoint_to_fp32_state_dict(args.checkpoint_dir,
+                                               args.output_dir,
+                                               max_shard_size=args.max_shard_size,
+                                               safe_serialization=args.safe_serialization,
+                                               tag=args.tag,
+                                               exclude_frozen_parameters=args.exclude_frozen_parameters)
diff --git a/checkpoint-544/README.md b/checkpoint-544/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9ffaf32045885341f44f9850f1ee3bc5e6ffa9dd
--- /dev/null
+++ b/checkpoint-544/README.md
@@ -0,0 +1,202 @@
+---
+base_model: PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1
\ No newline at end of file
diff --git a/checkpoint-544/adapter_config.json b/checkpoint-544/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..1c579cbcbf6740cc6c934f1581b6cf66e692fe73
--- /dev/null
+++ b/checkpoint-544/adapter_config.json
@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "PocketDoc/Dans-PersonalityEngine-V1.1.0-12b",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": null,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "down_proj",
+    "v_proj",
+    "o_proj",
+    "up_proj",
+    "k_proj",
+    "gate_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": true
+}
\ No newline at end of file
diff --git a/checkpoint-544/adapter_model.safetensors b/checkpoint-544/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2918b85a1c89ab3270c3cc371ad31959303fb437
--- /dev/null
+++ b/checkpoint-544/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2dd43f40f3100465e9ee2e79500854a691a448a52bc08e9e56a508c54834b111
+size 912337968
diff --git a/checkpoint-544/global_step544/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt b/checkpoint-544/global_step544/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..12a1df8d8af7364b810afe320ec89e92dfbc2430
--- /dev/null
+++ b/checkpoint-544/global_step544/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6cab90e0a04e0776d1146f638df0b6040d128663e93a9b6ad1662a068150705c
+size 536671408
diff --git a/checkpoint-544/global_step544/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt b/checkpoint-544/global_step544/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..8bb4c69c1f4fb064fa2f1e359503347182adab5f
--- /dev/null
+++ b/checkpoint-544/global_step544/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:856c31a5e64c53bb14e3deac0613194f2ec037c7d315e2548e61a52be5a04e41
+size 536671408
diff --git a/checkpoint-544/global_step544/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt b/checkpoint-544/global_step544/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..e7a0fc9290330fc77e111f53849eb88297fcc185
--- /dev/null
+++ b/checkpoint-544/global_step544/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd4b7b01e8219142d913acf86a75243542522d714437bfc800cacbcdcea89783
+size 536671408
diff --git a/checkpoint-544/global_step544/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt b/checkpoint-544/global_step544/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..371e06373daa58f099d1c9ad12c440e4ff9e15b9
--- /dev/null
+++ b/checkpoint-544/global_step544/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:14717cc9a42564030a4b8eba7114c197960c742004a51103b8905c18426e895c
+size 536671408
diff --git a/checkpoint-544/global_step544/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt b/checkpoint-544/global_step544/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..9e5d1bd83aa1e0d13bd5b1d0e244212ace9fa674
--- /dev/null
+++ b/checkpoint-544/global_step544/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:764d393f727e1948d96da24a35c585510403a2e277c5ee2748a5f0764c99e6c5
+size 536671408
diff --git a/checkpoint-544/global_step544/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt b/checkpoint-544/global_step544/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..92a60a34b14218bdac31db1518cf9816de1c7f12
--- /dev/null
+++ b/checkpoint-544/global_step544/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a517ba9ede12ce1b32388bac230694da5849304335a25ad59c0ce617a5e3056
+size 536671408
diff --git a/checkpoint-544/global_step544/zero_pp_rank_0_mp_rank_00_model_states.pt b/checkpoint-544/global_step544/zero_pp_rank_0_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..cad1743099f6415299ef393bab9f08db56bfbe08
--- /dev/null
+++ b/checkpoint-544/global_step544/zero_pp_rank_0_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:afaf64c8291cbc1b53655a0dca1875c5d9aefb77cc57228d82fde1e04c6a5cdb
+size 557022
diff --git a/checkpoint-544/global_step544/zero_pp_rank_1_mp_rank_00_model_states.pt b/checkpoint-544/global_step544/zero_pp_rank_1_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..f4cb897c7e80d662b237856e99ce08a0dcb9080f
--- /dev/null
+++ b/checkpoint-544/global_step544/zero_pp_rank_1_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd50b70a20b5fb9f1830120a2bce9b70dae2aac447f43453e093752bc02a2a47
+size 557022
diff --git a/checkpoint-544/global_step544/zero_pp_rank_2_mp_rank_00_model_states.pt b/checkpoint-544/global_step544/zero_pp_rank_2_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..0de424f34732270de113bec2f896d1368dec2021
--- /dev/null
+++ b/checkpoint-544/global_step544/zero_pp_rank_2_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6506973e531740a285c6c55c229cfede2b8a21ca28153ee242f4af1af1fa510
+size 557022
diff --git a/checkpoint-544/global_step544/zero_pp_rank_3_mp_rank_00_model_states.pt b/checkpoint-544/global_step544/zero_pp_rank_3_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..85e6c0534a7746476e78d34fb59b6e8a658a3df7
--- /dev/null
+++ b/checkpoint-544/global_step544/zero_pp_rank_3_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:719cda736e4754750b110eae0df52e6011732817130688cb82af402762249b10
+size 557022
diff --git a/checkpoint-544/global_step544/zero_pp_rank_4_mp_rank_00_model_states.pt b/checkpoint-544/global_step544/zero_pp_rank_4_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..93b490af0f2f76bc50e3de48c36ad076b5e3f693
--- /dev/null
+++ b/checkpoint-544/global_step544/zero_pp_rank_4_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6777c15472a00f7c331c1ab465cc59f6e5b8b5f37b774d657bab6d9017b3abfc
+size 557022
diff --git a/checkpoint-544/global_step544/zero_pp_rank_5_mp_rank_00_model_states.pt b/checkpoint-544/global_step544/zero_pp_rank_5_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..6fb7676041d81f0d259d47d856d0d62488fe4f6a
--- /dev/null
+++ b/checkpoint-544/global_step544/zero_pp_rank_5_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bfe395643053ffc3cfe2dadd8ef9f9bda9ba0860e9cd488367b66f9cff3005fd
+size 557022
diff --git a/checkpoint-544/latest b/checkpoint-544/latest
new file mode 100644
index 0000000000000000000000000000000000000000..606df2a525126f7e381b691c76048c61744888b9
--- /dev/null
+++ b/checkpoint-544/latest
@@ -0,0 +1 @@
+global_step544
\ No newline at end of file
diff --git a/checkpoint-544/rng_state_0.pth b/checkpoint-544/rng_state_0.pth
new file mode 100644
index 0000000000000000000000000000000000000000..74563065547c38439fed2943c2e0f24fe9ff4b29
--- /dev/null
+++ b/checkpoint-544/rng_state_0.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32ee9d39067d9db13213230fa4d6b8c141fac95f1dda3f47d058bde8b9296888
+size 15472
diff --git a/checkpoint-544/rng_state_1.pth b/checkpoint-544/rng_state_1.pth
new file mode 100644
index 0000000000000000000000000000000000000000..b6172057dbc45fcd1d8fe6021dfdd163d8d4eaeb
--- /dev/null
+++ b/checkpoint-544/rng_state_1.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:286cd8582b1ffce5caa5717e35e1ca41974cd5f2d1ed01ce1c0c54dade501e81
+size 15472
diff --git a/checkpoint-544/rng_state_2.pth b/checkpoint-544/rng_state_2.pth
new file mode 100644
index 0000000000000000000000000000000000000000..8b1b4cd830118bce66dfac591b0d8a7ce99ac966
--- /dev/null
+++ b/checkpoint-544/rng_state_2.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c23a1842ca63b5c16be29ef270fe92d0c68c8b10db51bf8e41f03108249e8a1
+size 15472
diff --git a/checkpoint-544/rng_state_3.pth b/checkpoint-544/rng_state_3.pth
new file mode 100644
index 0000000000000000000000000000000000000000..c5c6a9eeeba2aabd489679a0dc55f06f175c27b4
--- /dev/null
+++ b/checkpoint-544/rng_state_3.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33356ac81061466244babc84b4040456c5494f260860f17af75784a8385d3d92
+size 15472
diff --git a/checkpoint-544/rng_state_4.pth b/checkpoint-544/rng_state_4.pth
new file mode 100644
index 0000000000000000000000000000000000000000..0b7a630274888663b1249ea5333ed5e9c145df12
--- /dev/null
+++ b/checkpoint-544/rng_state_4.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f42d506db46f752e2a8b46d90328d3aa00ce1ca3165e1a3f376e90224b596ebf
+size 15472
diff --git a/checkpoint-544/rng_state_5.pth b/checkpoint-544/rng_state_5.pth
new file mode 100644
index 0000000000000000000000000000000000000000..a398d025c23431c7440cc12427058c3c2762589d
--- /dev/null
+++ b/checkpoint-544/rng_state_5.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:229e45809650c8c5b6c87101581a1e5b8c8d53cd1f17c648dc930fe121d376cc
+size 15472
diff --git a/checkpoint-544/scheduler.pt b/checkpoint-544/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..c6e7c6adba76644a8747e28adf180335696e9f09
--- /dev/null
+++ b/checkpoint-544/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5ea725446ae4911502ce67e7a511977d2e844b8e62d53b8562809a50ee23822b
+size 1064
diff --git a/checkpoint-544/special_tokens_map.json b/checkpoint-544/special_tokens_map.json
new file mode 100644
index 0000000000000000000000000000000000000000..547986c0f0567961dd9ff48218defed8e4d5aa59
--- /dev/null
+++ b/checkpoint-544/special_tokens_map.json
@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}
diff --git a/checkpoint-544/tokenizer.json b/checkpoint-544/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..cff17babe3bd564f7a3005727b02f44432e0facf
--- /dev/null
+++ b/checkpoint-544/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee57bd3271d8c200a06df40f9d7c94f8bb8f085b5cfb2d40907a794560df2ec3
+size 17078342
diff --git a/checkpoint-544/tokenizer_config.json b/checkpoint-544/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..0f13a1776083b5998049a3aad730d95f5e74f8cd
--- /dev/null
+++ b/checkpoint-544/tokenizer_config.json
@@ -0,0 +1,8016 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "<SPECIAL_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "5": {
+      "content": "[AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "[/AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "[TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "8": {
+      "content": "[/TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "9": {
+      "content": "[TOOL_CALLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "10": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "11": {
+      "content": "[PREFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "12": {
+      "content": "[MIDDLE]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "13": {
+      "content": "[SUFFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "14": {
+      "content": "<SPECIAL_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "15": {
+      "content": "<SPECIAL_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "16": {
+      "content": "<SPECIAL_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "17": {
+      "content": "<SPECIAL_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "18": {
+      "content": "<SPECIAL_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "19": {
+      "content": "<SPECIAL_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "20": {
+      "content": "<SPECIAL_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "21": {
+      "content": "<SPECIAL_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "22": {
+      "content": "<SPECIAL_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "23": {
+      "content": "<SPECIAL_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "24": {
+      "content": "<SPECIAL_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "25": {
+      "content": "<SPECIAL_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "26": {
+      "content": "<SPECIAL_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "27": {
+      "content": "<SPECIAL_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "28": {
+      "content": "<SPECIAL_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "29": {
+      "content": "<SPECIAL_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "30": {
+      "content": "<SPECIAL_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "31": {
+      "content": "<SPECIAL_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32": {
+      "content": "<SPECIAL_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "33": {
+      "content": "<SPECIAL_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "34": {
+      "content": "<SPECIAL_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "35": {
+      "content": "<SPECIAL_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "36": {
+      "content": "<SPECIAL_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "37": {
+      "content": "<SPECIAL_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "38": {
+      "content": "<SPECIAL_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "39": {
+      "content": "<SPECIAL_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "40": {
+      "content": "<SPECIAL_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "41": {
+      "content": "<SPECIAL_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "42": {
+      "content": "<SPECIAL_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "43": {
+      "content": "<SPECIAL_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "44": {
+      "content": "<SPECIAL_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "45": {
+      "content": "<SPECIAL_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "46": {
+      "content": "<SPECIAL_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "47": {
+      "content": "<SPECIAL_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "48": {
+      "content": "<SPECIAL_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49": {
+      "content": "<SPECIAL_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50": {
+      "content": "<SPECIAL_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "51": {
+      "content": "<SPECIAL_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "52": {
+      "content": "<SPECIAL_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "53": {
+      "content": "<SPECIAL_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "54": {
+      "content": "<SPECIAL_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "55": {
+      "content": "<SPECIAL_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "56": {
+      "content": "<SPECIAL_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "57": {
+      "content": "<SPECIAL_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "58": {
+      "content": "<SPECIAL_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "59": {
+      "content": "<SPECIAL_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "60": {
+      "content": "<SPECIAL_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "61": {
+      "content": "<SPECIAL_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "62": {
+      "content": "<SPECIAL_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "63": {
+      "content": "<SPECIAL_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "64": {
+      "content": "<SPECIAL_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "65": {
+      "content": "<SPECIAL_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "66": {
+      "content": "<SPECIAL_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "67": {
+      "content": "<SPECIAL_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "68": {
+      "content": "<SPECIAL_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "69": {
+      "content": "<SPECIAL_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "70": {
+      "content": "<SPECIAL_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "71": {
+      "content": "<SPECIAL_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "72": {
+      "content": "<SPECIAL_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "73": {
+      "content": "<SPECIAL_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "74": {
+      "content": "<SPECIAL_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "75": {
+      "content": "<SPECIAL_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "76": {
+      "content": "<SPECIAL_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "77": {
+      "content": "<SPECIAL_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "78": {
+      "content": "<SPECIAL_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "79": {
+      "content": "<SPECIAL_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "80": {
+      "content": "<SPECIAL_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "81": {
+      "content": "<SPECIAL_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "82": {
+      "content": "<SPECIAL_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "83": {
+      "content": "<SPECIAL_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "84": {
+      "content": "<SPECIAL_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "85": {
+      "content": "<SPECIAL_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "86": {
+      "content": "<SPECIAL_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "87": {
+      "content": "<SPECIAL_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "88": {
+      "content": "<SPECIAL_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "89": {
+      "content": "<SPECIAL_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "90": {
+      "content": "<SPECIAL_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "91": {
+      "content": "<SPECIAL_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "92": {
+      "content": "<SPECIAL_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "93": {
+      "content": "<SPECIAL_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "94": {
+      "content": "<SPECIAL_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "95": {
+      "content": "<SPECIAL_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "96": {
+      "content": "<SPECIAL_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "97": {
+      "content": "<SPECIAL_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "98": {
+      "content": "<SPECIAL_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "99": {
+      "content": "<SPECIAL_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "<SPECIAL_100>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "<SPECIAL_101>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "<SPECIAL_102>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "<SPECIAL_103>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "104": {
+      "content": "<SPECIAL_104>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "105": {
+      "content": "<SPECIAL_105>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "106": {
+      "content": "<SPECIAL_106>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "107": {
+      "content": "<SPECIAL_107>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "108": {
+      "content": "<SPECIAL_108>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "109": {
+      "content": "<SPECIAL_109>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "110": {
+      "content": "<SPECIAL_110>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "111": {
+      "content": "<SPECIAL_111>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "112": {
+      "content": "<SPECIAL_112>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "113": {
+      "content": "<SPECIAL_113>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "114": {
+      "content": "<SPECIAL_114>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "115": {
+      "content": "<SPECIAL_115>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "116": {
+      "content": "<SPECIAL_116>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "117": {
+      "content": "<SPECIAL_117>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "118": {
+      "content": "<SPECIAL_118>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "119": {
+      "content": "<SPECIAL_119>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "120": {
+      "content": "<SPECIAL_120>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "121": {
+      "content": "<SPECIAL_121>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "122": {
+      "content": "<SPECIAL_122>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "123": {
+      "content": "<SPECIAL_123>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "124": {
+      "content": "<SPECIAL_124>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "125": {
+      "content": "<SPECIAL_125>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "126": {
+      "content": "<SPECIAL_126>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "127": {
+      "content": "<SPECIAL_127>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128": {
+      "content": "<SPECIAL_128>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "129": {
+      "content": "<SPECIAL_129>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "130": {
+      "content": "<SPECIAL_130>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "131": {
+      "content": "<SPECIAL_131>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "132": {
+      "content": "<SPECIAL_132>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "133": {
+      "content": "<SPECIAL_133>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "134": {
+      "content": "<SPECIAL_134>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "135": {
+      "content": "<SPECIAL_135>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "136": {
+      "content": "<SPECIAL_136>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "137": {
+      "content": "<SPECIAL_137>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "138": {
+      "content": "<SPECIAL_138>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "139": {
+      "content": "<SPECIAL_139>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "140": {
+      "content": "<SPECIAL_140>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "141": {
+      "content": "<SPECIAL_141>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "142": {
+      "content": "<SPECIAL_142>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "143": {
+      "content": "<SPECIAL_143>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144": {
+      "content": "<SPECIAL_144>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145": {
+      "content": "<SPECIAL_145>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "146": {
+      "content": "<SPECIAL_146>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "147": {
+      "content": "<SPECIAL_147>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "148": {
+      "content": "<SPECIAL_148>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "149": {
+      "content": "<SPECIAL_149>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "150": {
+      "content": "<SPECIAL_150>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151": {
+      "content": "<SPECIAL_151>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "152": {
+      "content": "<SPECIAL_152>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "153": {
+      "content": "<SPECIAL_153>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "154": {
+      "content": "<SPECIAL_154>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "155": {
+      "content": "<SPECIAL_155>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "156": {
+      "content": "<SPECIAL_156>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "157": {
+      "content": "<SPECIAL_157>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "158": {
+      "content": "<SPECIAL_158>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "159": {
+      "content": "<SPECIAL_159>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "160": {
+      "content": "<SPECIAL_160>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "161": {
+      "content": "<SPECIAL_161>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "162": {
+      "content": "<SPECIAL_162>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "163": {
+      "content": "<SPECIAL_163>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "164": {
+      "content": "<SPECIAL_164>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "165": {
+      "content": "<SPECIAL_165>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "166": {
+      "content": "<SPECIAL_166>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "167": {
+      "content": "<SPECIAL_167>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "168": {
+      "content": "<SPECIAL_168>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "169": {
+      "content": "<SPECIAL_169>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "170": {
+      "content": "<SPECIAL_170>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "171": {
+      "content": "<SPECIAL_171>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "172": {
+      "content": "<SPECIAL_172>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "173": {
+      "content": "<SPECIAL_173>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "174": {
+      "content": "<SPECIAL_174>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "175": {
+      "content": "<SPECIAL_175>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "176": {
+      "content": "<SPECIAL_176>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "177": {
+      "content": "<SPECIAL_177>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "178": {
+      "content": "<SPECIAL_178>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "179": {
+      "content": "<SPECIAL_179>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "180": {
+      "content": "<SPECIAL_180>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "181": {
+      "content": "<SPECIAL_181>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "182": {
+      "content": "<SPECIAL_182>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "183": {
+      "content": "<SPECIAL_183>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "184": {
+      "content": "<SPECIAL_184>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "185": {
+      "content": "<SPECIAL_185>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "186": {
+      "content": "<SPECIAL_186>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "187": {
+      "content": "<SPECIAL_187>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "188": {
+      "content": "<SPECIAL_188>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "189": {
+      "content": "<SPECIAL_189>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "190": {
+      "content": "<SPECIAL_190>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "191": {
+      "content": "<SPECIAL_191>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "192": {
+      "content": "<SPECIAL_192>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "193": {
+      "content": "<SPECIAL_193>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "194": {
+      "content": "<SPECIAL_194>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "195": {
+      "content": "<SPECIAL_195>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "196": {
+      "content": "<SPECIAL_196>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "197": {
+      "content": "<SPECIAL_197>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "198": {
+      "content": "<SPECIAL_198>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "199": {
+      "content": "<SPECIAL_199>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "200": {
+      "content": "<SPECIAL_200>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "201": {
+      "content": "<SPECIAL_201>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "202": {
+      "content": "<SPECIAL_202>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "203": {
+      "content": "<SPECIAL_203>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "204": {
+      "content": "<SPECIAL_204>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "205": {
+      "content": "<SPECIAL_205>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "206": {
+      "content": "<SPECIAL_206>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "207": {
+      "content": "<SPECIAL_207>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "208": {
+      "content": "<SPECIAL_208>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "209": {
+      "content": "<SPECIAL_209>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "210": {
+      "content": "<SPECIAL_210>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "211": {
+      "content": "<SPECIAL_211>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "212": {
+      "content": "<SPECIAL_212>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "213": {
+      "content": "<SPECIAL_213>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "214": {
+      "content": "<SPECIAL_214>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "215": {
+      "content": "<SPECIAL_215>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "216": {
+      "content": "<SPECIAL_216>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "217": {
+      "content": "<SPECIAL_217>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "218": {
+      "content": "<SPECIAL_218>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "219": {
+      "content": "<SPECIAL_219>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "220": {
+      "content": "<SPECIAL_220>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "221": {
+      "content": "<SPECIAL_221>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "222": {
+      "content": "<SPECIAL_222>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "223": {
+      "content": "<SPECIAL_223>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "224": {
+      "content": "<SPECIAL_224>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "225": {
+      "content": "<SPECIAL_225>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "226": {
+      "content": "<SPECIAL_226>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "227": {
+      "content": "<SPECIAL_227>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "228": {
+      "content": "<SPECIAL_228>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "229": {
+      "content": "<SPECIAL_229>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "230": {
+      "content": "<SPECIAL_230>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "231": {
+      "content": "<SPECIAL_231>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "232": {
+      "content": "<SPECIAL_232>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "233": {
+      "content": "<SPECIAL_233>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "234": {
+      "content": "<SPECIAL_234>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "235": {
+      "content": "<SPECIAL_235>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "236": {
+      "content": "<SPECIAL_236>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "237": {
+      "content": "<SPECIAL_237>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "238": {
+      "content": "<SPECIAL_238>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "239": {
+      "content": "<SPECIAL_239>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "240": {
+      "content": "<SPECIAL_240>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "241": {
+      "content": "<SPECIAL_241>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "242": {
+      "content": "<SPECIAL_242>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "243": {
+      "content": "<SPECIAL_243>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "244": {
+      "content": "<SPECIAL_244>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "245": {
+      "content": "<SPECIAL_245>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "246": {
+      "content": "<SPECIAL_246>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "247": {
+      "content": "<SPECIAL_247>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248": {
+      "content": "<SPECIAL_248>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "249": {
+      "content": "<SPECIAL_249>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "250": {
+      "content": "<SPECIAL_250>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "251": {
+      "content": "<SPECIAL_251>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "252": {
+      "content": "<SPECIAL_252>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "253": {
+      "content": "<SPECIAL_253>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "254": {
+      "content": "<SPECIAL_254>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255": {
+      "content": "<SPECIAL_255>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256": {
+      "content": "<SPECIAL_256>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "257": {
+      "content": "<SPECIAL_257>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "258": {
+      "content": "<SPECIAL_258>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "259": {
+      "content": "<SPECIAL_259>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "260": {
+      "content": "<SPECIAL_260>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "261": {
+      "content": "<SPECIAL_261>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "262": {
+      "content": "<SPECIAL_262>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "263": {
+      "content": "<SPECIAL_263>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "264": {
+      "content": "<SPECIAL_264>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "265": {
+      "content": "<SPECIAL_265>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "266": {
+      "content": "<SPECIAL_266>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "267": {
+      "content": "<SPECIAL_267>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "268": {
+      "content": "<SPECIAL_268>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "269": {
+      "content": "<SPECIAL_269>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "270": {
+      "content": "<SPECIAL_270>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "271": {
+      "content": "<SPECIAL_271>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "272": {
+      "content": "<SPECIAL_272>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "273": {
+      "content": "<SPECIAL_273>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "274": {
+      "content": "<SPECIAL_274>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "275": {
+      "content": "<SPECIAL_275>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "276": {
+      "content": "<SPECIAL_276>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "277": {
+      "content": "<SPECIAL_277>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "278": {
+      "content": "<SPECIAL_278>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "279": {
+      "content": "<SPECIAL_279>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "280": {
+      "content": "<SPECIAL_280>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "281": {
+      "content": "<SPECIAL_281>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "282": {
+      "content": "<SPECIAL_282>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "283": {
+      "content": "<SPECIAL_283>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "284": {
+      "content": "<SPECIAL_284>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "285": {
+      "content": "<SPECIAL_285>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "286": {
+      "content": "<SPECIAL_286>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "287": {
+      "content": "<SPECIAL_287>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "288": {
+      "content": "<SPECIAL_288>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "289": {
+      "content": "<SPECIAL_289>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "290": {
+      "content": "<SPECIAL_290>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "291": {
+      "content": "<SPECIAL_291>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "292": {
+      "content": "<SPECIAL_292>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "293": {
+      "content": "<SPECIAL_293>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "294": {
+      "content": "<SPECIAL_294>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "295": {
+      "content": "<SPECIAL_295>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "296": {
+      "content": "<SPECIAL_296>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "297": {
+      "content": "<SPECIAL_297>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "298": {
+      "content": "<SPECIAL_298>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "299": {
+      "content": "<SPECIAL_299>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "300": {
+      "content": "<SPECIAL_300>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "301": {
+      "content": "<SPECIAL_301>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "302": {
+      "content": "<SPECIAL_302>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "303": {
+      "content": "<SPECIAL_303>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "304": {
+      "content": "<SPECIAL_304>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "305": {
+      "content": "<SPECIAL_305>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "306": {
+      "content": "<SPECIAL_306>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "307": {
+      "content": "<SPECIAL_307>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "308": {
+      "content": "<SPECIAL_308>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "309": {
+      "content": "<SPECIAL_309>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "310": {
+      "content": "<SPECIAL_310>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "311": {
+      "content": "<SPECIAL_311>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "312": {
+      "content": "<SPECIAL_312>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "313": {
+      "content": "<SPECIAL_313>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "314": {
+      "content": "<SPECIAL_314>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "315": {
+      "content": "<SPECIAL_315>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "316": {
+      "content": "<SPECIAL_316>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "317": {
+      "content": "<SPECIAL_317>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "318": {
+      "content": "<SPECIAL_318>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "319": {
+      "content": "<SPECIAL_319>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "320": {
+      "content": "<SPECIAL_320>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "321": {
+      "content": "<SPECIAL_321>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "322": {
+      "content": "<SPECIAL_322>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "323": {
+      "content": "<SPECIAL_323>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "324": {
+      "content": "<SPECIAL_324>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "325": {
+      "content": "<SPECIAL_325>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "326": {
+      "content": "<SPECIAL_326>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "327": {
+      "content": "<SPECIAL_327>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "328": {
+      "content": "<SPECIAL_328>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "329": {
+      "content": "<SPECIAL_329>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "330": {
+      "content": "<SPECIAL_330>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "331": {
+      "content": "<SPECIAL_331>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "332": {
+      "content": "<SPECIAL_332>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "333": {
+      "content": "<SPECIAL_333>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "334": {
+      "content": "<SPECIAL_334>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "335": {
+      "content": "<SPECIAL_335>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "336": {
+      "content": "<SPECIAL_336>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "337": {
+      "content": "<SPECIAL_337>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "338": {
+      "content": "<SPECIAL_338>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "339": {
+      "content": "<SPECIAL_339>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "340": {
+      "content": "<SPECIAL_340>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "341": {
+      "content": "<SPECIAL_341>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "342": {
+      "content": "<SPECIAL_342>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "343": {
+      "content": "<SPECIAL_343>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "344": {
+      "content": "<SPECIAL_344>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "345": {
+      "content": "<SPECIAL_345>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "346": {
+      "content": "<SPECIAL_346>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "347": {
+      "content": "<SPECIAL_347>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "348": {
+      "content": "<SPECIAL_348>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "349": {
+      "content": "<SPECIAL_349>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "350": {
+      "content": "<SPECIAL_350>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "351": {
+      "content": "<SPECIAL_351>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "352": {
+      "content": "<SPECIAL_352>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "353": {
+      "content": "<SPECIAL_353>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "354": {
+      "content": "<SPECIAL_354>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "355": {
+      "content": "<SPECIAL_355>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "356": {
+      "content": "<SPECIAL_356>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "357": {
+      "content": "<SPECIAL_357>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "358": {
+      "content": "<SPECIAL_358>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "359": {
+      "content": "<SPECIAL_359>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "360": {
+      "content": "<SPECIAL_360>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "361": {
+      "content": "<SPECIAL_361>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "362": {
+      "content": "<SPECIAL_362>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "363": {
+      "content": "<SPECIAL_363>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "364": {
+      "content": "<SPECIAL_364>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "365": {
+      "content": "<SPECIAL_365>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "366": {
+      "content": "<SPECIAL_366>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "367": {
+      "content": "<SPECIAL_367>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "368": {
+      "content": "<SPECIAL_368>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "369": {
+      "content": "<SPECIAL_369>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "370": {
+      "content": "<SPECIAL_370>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "371": {
+      "content": "<SPECIAL_371>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "372": {
+      "content": "<SPECIAL_372>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "373": {
+      "content": "<SPECIAL_373>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "374": {
+      "content": "<SPECIAL_374>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "375": {
+      "content": "<SPECIAL_375>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "376": {
+      "content": "<SPECIAL_376>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "377": {
+      "content": "<SPECIAL_377>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "378": {
+      "content": "<SPECIAL_378>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "379": {
+      "content": "<SPECIAL_379>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "380": {
+      "content": "<SPECIAL_380>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "381": {
+      "content": "<SPECIAL_381>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "382": {
+      "content": "<SPECIAL_382>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "383": {
+      "content": "<SPECIAL_383>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "384": {
+      "content": "<SPECIAL_384>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "385": {
+      "content": "<SPECIAL_385>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "386": {
+      "content": "<SPECIAL_386>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "387": {
+      "content": "<SPECIAL_387>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "388": {
+      "content": "<SPECIAL_388>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "389": {
+      "content": "<SPECIAL_389>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "390": {
+      "content": "<SPECIAL_390>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "391": {
+      "content": "<SPECIAL_391>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "392": {
+      "content": "<SPECIAL_392>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "393": {
+      "content": "<SPECIAL_393>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "394": {
+      "content": "<SPECIAL_394>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "395": {
+      "content": "<SPECIAL_395>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "396": {
+      "content": "<SPECIAL_396>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "397": {
+      "content": "<SPECIAL_397>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "398": {
+      "content": "<SPECIAL_398>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "399": {
+      "content": "<SPECIAL_399>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "400": {
+      "content": "<SPECIAL_400>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "401": {
+      "content": "<SPECIAL_401>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "402": {
+      "content": "<SPECIAL_402>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "403": {
+      "content": "<SPECIAL_403>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "404": {
+      "content": "<SPECIAL_404>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "405": {
+      "content": "<SPECIAL_405>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "406": {
+      "content": "<SPECIAL_406>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "407": {
+      "content": "<SPECIAL_407>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "408": {
+      "content": "<SPECIAL_408>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "409": {
+      "content": "<SPECIAL_409>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "410": {
+      "content": "<SPECIAL_410>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "411": {
+      "content": "<SPECIAL_411>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "412": {
+      "content": "<SPECIAL_412>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "413": {
+      "content": "<SPECIAL_413>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "414": {
+      "content": "<SPECIAL_414>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "415": {
+      "content": "<SPECIAL_415>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "416": {
+      "content": "<SPECIAL_416>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "417": {
+      "content": "<SPECIAL_417>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "418": {
+      "content": "<SPECIAL_418>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "419": {
+      "content": "<SPECIAL_419>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "420": {
+      "content": "<SPECIAL_420>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "421": {
+      "content": "<SPECIAL_421>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "422": {
+      "content": "<SPECIAL_422>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "423": {
+      "content": "<SPECIAL_423>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "424": {
+      "content": "<SPECIAL_424>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "425": {
+      "content": "<SPECIAL_425>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "426": {
+      "content": "<SPECIAL_426>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "427": {
+      "content": "<SPECIAL_427>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "428": {
+      "content": "<SPECIAL_428>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "429": {
+      "content": "<SPECIAL_429>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "430": {
+      "content": "<SPECIAL_430>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "431": {
+      "content": "<SPECIAL_431>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "432": {
+      "content": "<SPECIAL_432>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "433": {
+      "content": "<SPECIAL_433>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "434": {
+      "content": "<SPECIAL_434>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "435": {
+      "content": "<SPECIAL_435>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "436": {
+      "content": "<SPECIAL_436>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "437": {
+      "content": "<SPECIAL_437>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "438": {
+      "content": "<SPECIAL_438>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "439": {
+      "content": "<SPECIAL_439>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "440": {
+      "content": "<SPECIAL_440>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "441": {
+      "content": "<SPECIAL_441>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "442": {
+      "content": "<SPECIAL_442>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "443": {
+      "content": "<SPECIAL_443>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "444": {
+      "content": "<SPECIAL_444>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "445": {
+      "content": "<SPECIAL_445>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "446": {
+      "content": "<SPECIAL_446>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "447": {
+      "content": "<SPECIAL_447>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "448": {
+      "content": "<SPECIAL_448>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "449": {
+      "content": "<SPECIAL_449>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "450": {
+      "content": "<SPECIAL_450>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "451": {
+      "content": "<SPECIAL_451>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "452": {
+      "content": "<SPECIAL_452>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "453": {
+      "content": "<SPECIAL_453>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "454": {
+      "content": "<SPECIAL_454>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "455": {
+      "content": "<SPECIAL_455>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "456": {
+      "content": "<SPECIAL_456>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "457": {
+      "content": "<SPECIAL_457>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "458": {
+      "content": "<SPECIAL_458>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "459": {
+      "content": "<SPECIAL_459>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "460": {
+      "content": "<SPECIAL_460>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "461": {
+      "content": "<SPECIAL_461>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "462": {
+      "content": "<SPECIAL_462>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "463": {
+      "content": "<SPECIAL_463>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "464": {
+      "content": "<SPECIAL_464>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "465": {
+      "content": "<SPECIAL_465>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "466": {
+      "content": "<SPECIAL_466>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "467": {
+      "content": "<SPECIAL_467>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "468": {
+      "content": "<SPECIAL_468>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "469": {
+      "content": "<SPECIAL_469>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "470": {
+      "content": "<SPECIAL_470>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "471": {
+      "content": "<SPECIAL_471>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "472": {
+      "content": "<SPECIAL_472>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "473": {
+      "content": "<SPECIAL_473>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "474": {
+      "content": "<SPECIAL_474>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "475": {
+      "content": "<SPECIAL_475>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "476": {
+      "content": "<SPECIAL_476>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "477": {
+      "content": "<SPECIAL_477>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "478": {
+      "content": "<SPECIAL_478>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "479": {
+      "content": "<SPECIAL_479>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "480": {
+      "content": "<SPECIAL_480>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "481": {
+      "content": "<SPECIAL_481>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "482": {
+      "content": "<SPECIAL_482>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "483": {
+      "content": "<SPECIAL_483>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "484": {
+      "content": "<SPECIAL_484>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "485": {
+      "content": "<SPECIAL_485>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "486": {
+      "content": "<SPECIAL_486>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "487": {
+      "content": "<SPECIAL_487>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "488": {
+      "content": "<SPECIAL_488>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "489": {
+      "content": "<SPECIAL_489>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "490": {
+      "content": "<SPECIAL_490>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "491": {
+      "content": "<SPECIAL_491>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "492": {
+      "content": "<SPECIAL_492>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "493": {
+      "content": "<SPECIAL_493>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "494": {
+      "content": "<SPECIAL_494>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "495": {
+      "content": "<SPECIAL_495>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "496": {
+      "content": "<SPECIAL_496>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "497": {
+      "content": "<SPECIAL_497>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "498": {
+      "content": "<SPECIAL_498>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "499": {
+      "content": "<SPECIAL_499>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "500": {
+      "content": "<SPECIAL_500>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "501": {
+      "content": "<SPECIAL_501>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "502": {
+      "content": "<SPECIAL_502>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "503": {
+      "content": "<SPECIAL_503>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "504": {
+      "content": "<SPECIAL_504>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "505": {
+      "content": "<SPECIAL_505>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "506": {
+      "content": "<SPECIAL_506>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "507": {
+      "content": "<SPECIAL_507>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "508": {
+      "content": "<SPECIAL_508>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "509": {
+      "content": "<SPECIAL_509>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "510": {
+      "content": "<SPECIAL_510>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "511": {
+      "content": "<SPECIAL_511>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "512": {
+      "content": "<SPECIAL_512>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "513": {
+      "content": "<SPECIAL_513>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "514": {
+      "content": "<SPECIAL_514>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "515": {
+      "content": "<SPECIAL_515>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "516": {
+      "content": "<SPECIAL_516>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "517": {
+      "content": "<SPECIAL_517>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "518": {
+      "content": "<SPECIAL_518>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "519": {
+      "content": "<SPECIAL_519>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "520": {
+      "content": "<SPECIAL_520>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "521": {
+      "content": "<SPECIAL_521>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "522": {
+      "content": "<SPECIAL_522>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "523": {
+      "content": "<SPECIAL_523>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "524": {
+      "content": "<SPECIAL_524>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "525": {
+      "content": "<SPECIAL_525>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "526": {
+      "content": "<SPECIAL_526>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "527": {
+      "content": "<SPECIAL_527>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "528": {
+      "content": "<SPECIAL_528>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "529": {
+      "content": "<SPECIAL_529>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "530": {
+      "content": "<SPECIAL_530>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "531": {
+      "content": "<SPECIAL_531>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "532": {
+      "content": "<SPECIAL_532>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "533": {
+      "content": "<SPECIAL_533>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "534": {
+      "content": "<SPECIAL_534>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "535": {
+      "content": "<SPECIAL_535>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "536": {
+      "content": "<SPECIAL_536>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "537": {
+      "content": "<SPECIAL_537>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "538": {
+      "content": "<SPECIAL_538>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "539": {
+      "content": "<SPECIAL_539>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "540": {
+      "content": "<SPECIAL_540>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "541": {
+      "content": "<SPECIAL_541>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "542": {
+      "content": "<SPECIAL_542>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "543": {
+      "content": "<SPECIAL_543>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "544": {
+      "content": "<SPECIAL_544>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "545": {
+      "content": "<SPECIAL_545>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "546": {
+      "content": "<SPECIAL_546>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "547": {
+      "content": "<SPECIAL_547>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "548": {
+      "content": "<SPECIAL_548>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "549": {
+      "content": "<SPECIAL_549>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "550": {
+      "content": "<SPECIAL_550>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "551": {
+      "content": "<SPECIAL_551>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "552": {
+      "content": "<SPECIAL_552>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "553": {
+      "content": "<SPECIAL_553>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "554": {
+      "content": "<SPECIAL_554>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "555": {
+      "content": "<SPECIAL_555>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "556": {
+      "content": "<SPECIAL_556>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "557": {
+      "content": "<SPECIAL_557>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "558": {
+      "content": "<SPECIAL_558>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "559": {
+      "content": "<SPECIAL_559>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "560": {
+      "content": "<SPECIAL_560>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "561": {
+      "content": "<SPECIAL_561>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "562": {
+      "content": "<SPECIAL_562>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "563": {
+      "content": "<SPECIAL_563>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "564": {
+      "content": "<SPECIAL_564>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "565": {
+      "content": "<SPECIAL_565>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "566": {
+      "content": "<SPECIAL_566>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "567": {
+      "content": "<SPECIAL_567>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "568": {
+      "content": "<SPECIAL_568>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "569": {
+      "content": "<SPECIAL_569>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "570": {
+      "content": "<SPECIAL_570>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "571": {
+      "content": "<SPECIAL_571>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "572": {
+      "content": "<SPECIAL_572>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "573": {
+      "content": "<SPECIAL_573>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "574": {
+      "content": "<SPECIAL_574>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "575": {
+      "content": "<SPECIAL_575>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "576": {
+      "content": "<SPECIAL_576>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "577": {
+      "content": "<SPECIAL_577>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "578": {
+      "content": "<SPECIAL_578>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "579": {
+      "content": "<SPECIAL_579>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "580": {
+      "content": "<SPECIAL_580>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "581": {
+      "content": "<SPECIAL_581>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "582": {
+      "content": "<SPECIAL_582>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "583": {
+      "content": "<SPECIAL_583>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "584": {
+      "content": "<SPECIAL_584>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "585": {
+      "content": "<SPECIAL_585>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "586": {
+      "content": "<SPECIAL_586>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "587": {
+      "content": "<SPECIAL_587>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "588": {
+      "content": "<SPECIAL_588>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "589": {
+      "content": "<SPECIAL_589>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "590": {
+      "content": "<SPECIAL_590>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "591": {
+      "content": "<SPECIAL_591>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "592": {
+      "content": "<SPECIAL_592>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "593": {
+      "content": "<SPECIAL_593>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "594": {
+      "content": "<SPECIAL_594>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "595": {
+      "content": "<SPECIAL_595>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "596": {
+      "content": "<SPECIAL_596>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "597": {
+      "content": "<SPECIAL_597>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "598": {
+      "content": "<SPECIAL_598>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "599": {
+      "content": "<SPECIAL_599>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "600": {
+      "content": "<SPECIAL_600>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "601": {
+      "content": "<SPECIAL_601>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "602": {
+      "content": "<SPECIAL_602>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "603": {
+      "content": "<SPECIAL_603>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "604": {
+      "content": "<SPECIAL_604>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "605": {
+      "content": "<SPECIAL_605>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "606": {
+      "content": "<SPECIAL_606>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "607": {
+      "content": "<SPECIAL_607>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "608": {
+      "content": "<SPECIAL_608>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "609": {
+      "content": "<SPECIAL_609>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "610": {
+      "content": "<SPECIAL_610>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "611": {
+      "content": "<SPECIAL_611>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "612": {
+      "content": "<SPECIAL_612>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "613": {
+      "content": "<SPECIAL_613>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "614": {
+      "content": "<SPECIAL_614>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "615": {
+      "content": "<SPECIAL_615>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "616": {
+      "content": "<SPECIAL_616>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "617": {
+      "content": "<SPECIAL_617>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "618": {
+      "content": "<SPECIAL_618>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "619": {
+      "content": "<SPECIAL_619>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "620": {
+      "content": "<SPECIAL_620>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "621": {
+      "content": "<SPECIAL_621>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "622": {
+      "content": "<SPECIAL_622>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "623": {
+      "content": "<SPECIAL_623>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "624": {
+      "content": "<SPECIAL_624>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "625": {
+      "content": "<SPECIAL_625>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "626": {
+      "content": "<SPECIAL_626>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "627": {
+      "content": "<SPECIAL_627>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "628": {
+      "content": "<SPECIAL_628>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "629": {
+      "content": "<SPECIAL_629>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "630": {
+      "content": "<SPECIAL_630>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "631": {
+      "content": "<SPECIAL_631>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "632": {
+      "content": "<SPECIAL_632>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "633": {
+      "content": "<SPECIAL_633>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "634": {
+      "content": "<SPECIAL_634>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "635": {
+      "content": "<SPECIAL_635>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "636": {
+      "content": "<SPECIAL_636>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "637": {
+      "content": "<SPECIAL_637>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "638": {
+      "content": "<SPECIAL_638>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "639": {
+      "content": "<SPECIAL_639>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "640": {
+      "content": "<SPECIAL_640>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "641": {
+      "content": "<SPECIAL_641>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "642": {
+      "content": "<SPECIAL_642>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "643": {
+      "content": "<SPECIAL_643>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "644": {
+      "content": "<SPECIAL_644>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "645": {
+      "content": "<SPECIAL_645>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "646": {
+      "content": "<SPECIAL_646>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "647": {
+      "content": "<SPECIAL_647>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "648": {
+      "content": "<SPECIAL_648>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "649": {
+      "content": "<SPECIAL_649>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "650": {
+      "content": "<SPECIAL_650>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "651": {
+      "content": "<SPECIAL_651>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "652": {
+      "content": "<SPECIAL_652>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "653": {
+      "content": "<SPECIAL_653>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "654": {
+      "content": "<SPECIAL_654>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "655": {
+      "content": "<SPECIAL_655>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "656": {
+      "content": "<SPECIAL_656>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "657": {
+      "content": "<SPECIAL_657>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "658": {
+      "content": "<SPECIAL_658>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "659": {
+      "content": "<SPECIAL_659>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "660": {
+      "content": "<SPECIAL_660>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "661": {
+      "content": "<SPECIAL_661>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "662": {
+      "content": "<SPECIAL_662>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "663": {
+      "content": "<SPECIAL_663>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "664": {
+      "content": "<SPECIAL_664>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "665": {
+      "content": "<SPECIAL_665>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "666": {
+      "content": "<SPECIAL_666>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "667": {
+      "content": "<SPECIAL_667>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "668": {
+      "content": "<SPECIAL_668>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "669": {
+      "content": "<SPECIAL_669>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "670": {
+      "content": "<SPECIAL_670>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "671": {
+      "content": "<SPECIAL_671>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "672": {
+      "content": "<SPECIAL_672>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "673": {
+      "content": "<SPECIAL_673>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "674": {
+      "content": "<SPECIAL_674>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "675": {
+      "content": "<SPECIAL_675>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "676": {
+      "content": "<SPECIAL_676>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "677": {
+      "content": "<SPECIAL_677>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "678": {
+      "content": "<SPECIAL_678>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "679": {
+      "content": "<SPECIAL_679>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "680": {
+      "content": "<SPECIAL_680>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "681": {
+      "content": "<SPECIAL_681>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "682": {
+      "content": "<SPECIAL_682>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "683": {
+      "content": "<SPECIAL_683>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "684": {
+      "content": "<SPECIAL_684>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "685": {
+      "content": "<SPECIAL_685>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "686": {
+      "content": "<SPECIAL_686>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "687": {
+      "content": "<SPECIAL_687>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "688": {
+      "content": "<SPECIAL_688>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "689": {
+      "content": "<SPECIAL_689>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "690": {
+      "content": "<SPECIAL_690>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "691": {
+      "content": "<SPECIAL_691>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "692": {
+      "content": "<SPECIAL_692>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "693": {
+      "content": "<SPECIAL_693>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "694": {
+      "content": "<SPECIAL_694>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "695": {
+      "content": "<SPECIAL_695>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "696": {
+      "content": "<SPECIAL_696>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "697": {
+      "content": "<SPECIAL_697>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "698": {
+      "content": "<SPECIAL_698>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "699": {
+      "content": "<SPECIAL_699>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "700": {
+      "content": "<SPECIAL_700>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "701": {
+      "content": "<SPECIAL_701>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "702": {
+      "content": "<SPECIAL_702>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "703": {
+      "content": "<SPECIAL_703>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "704": {
+      "content": "<SPECIAL_704>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "705": {
+      "content": "<SPECIAL_705>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "706": {
+      "content": "<SPECIAL_706>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "707": {
+      "content": "<SPECIAL_707>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "708": {
+      "content": "<SPECIAL_708>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "709": {
+      "content": "<SPECIAL_709>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "710": {
+      "content": "<SPECIAL_710>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "711": {
+      "content": "<SPECIAL_711>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "712": {
+      "content": "<SPECIAL_712>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "713": {
+      "content": "<SPECIAL_713>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "714": {
+      "content": "<SPECIAL_714>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "715": {
+      "content": "<SPECIAL_715>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "716": {
+      "content": "<SPECIAL_716>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "717": {
+      "content": "<SPECIAL_717>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "718": {
+      "content": "<SPECIAL_718>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "719": {
+      "content": "<SPECIAL_719>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "720": {
+      "content": "<SPECIAL_720>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "721": {
+      "content": "<SPECIAL_721>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "722": {
+      "content": "<SPECIAL_722>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "723": {
+      "content": "<SPECIAL_723>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "724": {
+      "content": "<SPECIAL_724>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "725": {
+      "content": "<SPECIAL_725>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "726": {
+      "content": "<SPECIAL_726>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "727": {
+      "content": "<SPECIAL_727>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "728": {
+      "content": "<SPECIAL_728>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "729": {
+      "content": "<SPECIAL_729>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "730": {
+      "content": "<SPECIAL_730>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "731": {
+      "content": "<SPECIAL_731>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "732": {
+      "content": "<SPECIAL_732>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "733": {
+      "content": "<SPECIAL_733>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "734": {
+      "content": "<SPECIAL_734>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "735": {
+      "content": "<SPECIAL_735>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "736": {
+      "content": "<SPECIAL_736>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "737": {
+      "content": "<SPECIAL_737>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "738": {
+      "content": "<SPECIAL_738>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "739": {
+      "content": "<SPECIAL_739>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "740": {
+      "content": "<SPECIAL_740>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "741": {
+      "content": "<SPECIAL_741>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "742": {
+      "content": "<SPECIAL_742>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "743": {
+      "content": "<SPECIAL_743>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "744": {
+      "content": "<SPECIAL_744>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "745": {
+      "content": "<SPECIAL_745>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "746": {
+      "content": "<SPECIAL_746>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "747": {
+      "content": "<SPECIAL_747>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "748": {
+      "content": "<SPECIAL_748>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "749": {
+      "content": "<SPECIAL_749>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "750": {
+      "content": "<SPECIAL_750>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "751": {
+      "content": "<SPECIAL_751>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "752": {
+      "content": "<SPECIAL_752>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "753": {
+      "content": "<SPECIAL_753>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "754": {
+      "content": "<SPECIAL_754>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "755": {
+      "content": "<SPECIAL_755>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "756": {
+      "content": "<SPECIAL_756>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "757": {
+      "content": "<SPECIAL_757>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "758": {
+      "content": "<SPECIAL_758>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "759": {
+      "content": "<SPECIAL_759>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "760": {
+      "content": "<SPECIAL_760>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "761": {
+      "content": "<SPECIAL_761>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "762": {
+      "content": "<SPECIAL_762>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "763": {
+      "content": "<SPECIAL_763>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "764": {
+      "content": "<SPECIAL_764>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "765": {
+      "content": "<SPECIAL_765>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "766": {
+      "content": "<SPECIAL_766>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "767": {
+      "content": "<SPECIAL_767>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "768": {
+      "content": "<SPECIAL_768>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "769": {
+      "content": "<SPECIAL_769>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "770": {
+      "content": "<SPECIAL_770>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "771": {
+      "content": "<SPECIAL_771>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "772": {
+      "content": "<SPECIAL_772>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "773": {
+      "content": "<SPECIAL_773>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "774": {
+      "content": "<SPECIAL_774>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "775": {
+      "content": "<SPECIAL_775>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "776": {
+      "content": "<SPECIAL_776>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "777": {
+      "content": "<SPECIAL_777>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "778": {
+      "content": "<SPECIAL_778>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "779": {
+      "content": "<SPECIAL_779>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "780": {
+      "content": "<SPECIAL_780>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "781": {
+      "content": "<SPECIAL_781>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "782": {
+      "content": "<SPECIAL_782>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "783": {
+      "content": "<SPECIAL_783>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "784": {
+      "content": "<SPECIAL_784>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "785": {
+      "content": "<SPECIAL_785>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "786": {
+      "content": "<SPECIAL_786>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "787": {
+      "content": "<SPECIAL_787>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "788": {
+      "content": "<SPECIAL_788>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "789": {
+      "content": "<SPECIAL_789>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "790": {
+      "content": "<SPECIAL_790>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "791": {
+      "content": "<SPECIAL_791>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "792": {
+      "content": "<SPECIAL_792>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "793": {
+      "content": "<SPECIAL_793>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "794": {
+      "content": "<SPECIAL_794>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "795": {
+      "content": "<SPECIAL_795>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "796": {
+      "content": "<SPECIAL_796>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "797": {
+      "content": "<SPECIAL_797>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "798": {
+      "content": "<SPECIAL_798>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "799": {
+      "content": "<SPECIAL_799>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "800": {
+      "content": "<SPECIAL_800>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "801": {
+      "content": "<SPECIAL_801>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "802": {
+      "content": "<SPECIAL_802>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "803": {
+      "content": "<SPECIAL_803>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "804": {
+      "content": "<SPECIAL_804>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "805": {
+      "content": "<SPECIAL_805>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "806": {
+      "content": "<SPECIAL_806>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "807": {
+      "content": "<SPECIAL_807>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "808": {
+      "content": "<SPECIAL_808>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "809": {
+      "content": "<SPECIAL_809>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "810": {
+      "content": "<SPECIAL_810>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "811": {
+      "content": "<SPECIAL_811>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "812": {
+      "content": "<SPECIAL_812>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "813": {
+      "content": "<SPECIAL_813>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "814": {
+      "content": "<SPECIAL_814>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "815": {
+      "content": "<SPECIAL_815>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "816": {
+      "content": "<SPECIAL_816>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "817": {
+      "content": "<SPECIAL_817>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "818": {
+      "content": "<SPECIAL_818>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "819": {
+      "content": "<SPECIAL_819>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "820": {
+      "content": "<SPECIAL_820>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "821": {
+      "content": "<SPECIAL_821>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "822": {
+      "content": "<SPECIAL_822>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "823": {
+      "content": "<SPECIAL_823>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "824": {
+      "content": "<SPECIAL_824>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "825": {
+      "content": "<SPECIAL_825>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "826": {
+      "content": "<SPECIAL_826>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "827": {
+      "content": "<SPECIAL_827>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "828": {
+      "content": "<SPECIAL_828>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "829": {
+      "content": "<SPECIAL_829>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "830": {
+      "content": "<SPECIAL_830>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "831": {
+      "content": "<SPECIAL_831>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "832": {
+      "content": "<SPECIAL_832>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "833": {
+      "content": "<SPECIAL_833>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "834": {
+      "content": "<SPECIAL_834>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "835": {
+      "content": "<SPECIAL_835>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "836": {
+      "content": "<SPECIAL_836>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "837": {
+      "content": "<SPECIAL_837>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "838": {
+      "content": "<SPECIAL_838>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "839": {
+      "content": "<SPECIAL_839>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "840": {
+      "content": "<SPECIAL_840>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "841": {
+      "content": "<SPECIAL_841>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "842": {
+      "content": "<SPECIAL_842>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "843": {
+      "content": "<SPECIAL_843>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "844": {
+      "content": "<SPECIAL_844>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "845": {
+      "content": "<SPECIAL_845>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "846": {
+      "content": "<SPECIAL_846>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "847": {
+      "content": "<SPECIAL_847>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "848": {
+      "content": "<SPECIAL_848>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "849": {
+      "content": "<SPECIAL_849>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "850": {
+      "content": "<SPECIAL_850>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "851": {
+      "content": "<SPECIAL_851>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "852": {
+      "content": "<SPECIAL_852>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "853": {
+      "content": "<SPECIAL_853>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "854": {
+      "content": "<SPECIAL_854>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "855": {
+      "content": "<SPECIAL_855>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "856": {
+      "content": "<SPECIAL_856>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "857": {
+      "content": "<SPECIAL_857>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "858": {
+      "content": "<SPECIAL_858>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "859": {
+      "content": "<SPECIAL_859>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "860": {
+      "content": "<SPECIAL_860>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "861": {
+      "content": "<SPECIAL_861>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "862": {
+      "content": "<SPECIAL_862>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "863": {
+      "content": "<SPECIAL_863>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "864": {
+      "content": "<SPECIAL_864>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "865": {
+      "content": "<SPECIAL_865>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "866": {
+      "content": "<SPECIAL_866>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "867": {
+      "content": "<SPECIAL_867>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "868": {
+      "content": "<SPECIAL_868>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "869": {
+      "content": "<SPECIAL_869>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "870": {
+      "content": "<SPECIAL_870>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "871": {
+      "content": "<SPECIAL_871>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "872": {
+      "content": "<SPECIAL_872>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "873": {
+      "content": "<SPECIAL_873>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "874": {
+      "content": "<SPECIAL_874>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "875": {
+      "content": "<SPECIAL_875>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "876": {
+      "content": "<SPECIAL_876>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "877": {
+      "content": "<SPECIAL_877>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "878": {
+      "content": "<SPECIAL_878>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "879": {
+      "content": "<SPECIAL_879>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "880": {
+      "content": "<SPECIAL_880>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "881": {
+      "content": "<SPECIAL_881>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "882": {
+      "content": "<SPECIAL_882>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "883": {
+      "content": "<SPECIAL_883>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "884": {
+      "content": "<SPECIAL_884>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "885": {
+      "content": "<SPECIAL_885>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "886": {
+      "content": "<SPECIAL_886>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "887": {
+      "content": "<SPECIAL_887>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "888": {
+      "content": "<SPECIAL_888>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "889": {
+      "content": "<SPECIAL_889>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "890": {
+      "content": "<SPECIAL_890>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "891": {
+      "content": "<SPECIAL_891>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "892": {
+      "content": "<SPECIAL_892>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "893": {
+      "content": "<SPECIAL_893>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "894": {
+      "content": "<SPECIAL_894>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "895": {
+      "content": "<SPECIAL_895>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "896": {
+      "content": "<SPECIAL_896>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "897": {
+      "content": "<SPECIAL_897>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "898": {
+      "content": "<SPECIAL_898>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "899": {
+      "content": "<SPECIAL_899>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "900": {
+      "content": "<SPECIAL_900>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "901": {
+      "content": "<SPECIAL_901>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "902": {
+      "content": "<SPECIAL_902>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "903": {
+      "content": "<SPECIAL_903>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "904": {
+      "content": "<SPECIAL_904>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "905": {
+      "content": "<SPECIAL_905>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "906": {
+      "content": "<SPECIAL_906>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "907": {
+      "content": "<SPECIAL_907>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "908": {
+      "content": "<SPECIAL_908>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "909": {
+      "content": "<SPECIAL_909>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "910": {
+      "content": "<SPECIAL_910>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "911": {
+      "content": "<SPECIAL_911>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "912": {
+      "content": "<SPECIAL_912>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "913": {
+      "content": "<SPECIAL_913>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "914": {
+      "content": "<SPECIAL_914>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "915": {
+      "content": "<SPECIAL_915>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "916": {
+      "content": "<SPECIAL_916>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "917": {
+      "content": "<SPECIAL_917>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "918": {
+      "content": "<SPECIAL_918>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "919": {
+      "content": "<SPECIAL_919>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "920": {
+      "content": "<SPECIAL_920>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "921": {
+      "content": "<SPECIAL_921>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "922": {
+      "content": "<SPECIAL_922>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "923": {
+      "content": "<SPECIAL_923>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "924": {
+      "content": "<SPECIAL_924>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "925": {
+      "content": "<SPECIAL_925>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "926": {
+      "content": "<SPECIAL_926>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "927": {
+      "content": "<SPECIAL_927>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "928": {
+      "content": "<SPECIAL_928>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "929": {
+      "content": "<SPECIAL_929>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "930": {
+      "content": "<SPECIAL_930>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "931": {
+      "content": "<SPECIAL_931>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "932": {
+      "content": "<SPECIAL_932>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "933": {
+      "content": "<SPECIAL_933>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "934": {
+      "content": "<SPECIAL_934>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "935": {
+      "content": "<SPECIAL_935>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "936": {
+      "content": "<SPECIAL_936>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "937": {
+      "content": "<SPECIAL_937>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "938": {
+      "content": "<SPECIAL_938>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "939": {
+      "content": "<SPECIAL_939>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "940": {
+      "content": "<SPECIAL_940>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "941": {
+      "content": "<SPECIAL_941>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "942": {
+      "content": "<SPECIAL_942>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "943": {
+      "content": "<SPECIAL_943>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "944": {
+      "content": "<SPECIAL_944>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "945": {
+      "content": "<SPECIAL_945>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "946": {
+      "content": "<SPECIAL_946>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "947": {
+      "content": "<SPECIAL_947>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "948": {
+      "content": "<SPECIAL_948>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "949": {
+      "content": "<SPECIAL_949>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "950": {
+      "content": "<SPECIAL_950>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "951": {
+      "content": "<SPECIAL_951>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "952": {
+      "content": "<SPECIAL_952>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "953": {
+      "content": "<SPECIAL_953>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "954": {
+      "content": "<SPECIAL_954>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "955": {
+      "content": "<SPECIAL_955>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "956": {
+      "content": "<SPECIAL_956>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "957": {
+      "content": "<SPECIAL_957>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "958": {
+      "content": "<SPECIAL_958>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "959": {
+      "content": "<SPECIAL_959>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "960": {
+      "content": "<SPECIAL_960>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "961": {
+      "content": "<SPECIAL_961>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "962": {
+      "content": "<SPECIAL_962>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "963": {
+      "content": "<SPECIAL_963>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "964": {
+      "content": "<SPECIAL_964>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "965": {
+      "content": "<SPECIAL_965>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "966": {
+      "content": "<SPECIAL_966>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "967": {
+      "content": "<SPECIAL_967>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "968": {
+      "content": "<SPECIAL_968>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "969": {
+      "content": "<SPECIAL_969>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "970": {
+      "content": "<SPECIAL_970>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "971": {
+      "content": "<SPECIAL_971>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "972": {
+      "content": "<SPECIAL_972>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "973": {
+      "content": "<SPECIAL_973>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "974": {
+      "content": "<SPECIAL_974>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "975": {
+      "content": "<SPECIAL_975>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "976": {
+      "content": "<SPECIAL_976>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "977": {
+      "content": "<SPECIAL_977>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "978": {
+      "content": "<SPECIAL_978>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "979": {
+      "content": "<SPECIAL_979>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "980": {
+      "content": "<SPECIAL_980>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "981": {
+      "content": "<SPECIAL_981>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "982": {
+      "content": "<SPECIAL_982>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "983": {
+      "content": "<SPECIAL_983>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "984": {
+      "content": "<SPECIAL_984>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "985": {
+      "content": "<SPECIAL_985>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "986": {
+      "content": "<SPECIAL_986>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "987": {
+      "content": "<SPECIAL_987>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "988": {
+      "content": "<SPECIAL_988>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "989": {
+      "content": "<SPECIAL_989>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "990": {
+      "content": "<SPECIAL_990>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "991": {
+      "content": "<SPECIAL_991>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "992": {
+      "content": "<SPECIAL_992>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "993": {
+      "content": "<SPECIAL_993>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "994": {
+      "content": "<SPECIAL_994>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "995": {
+      "content": "<SPECIAL_995>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "996": {
+      "content": "<SPECIAL_996>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "997": {
+      "content": "<SPECIAL_997>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "998": {
+      "content": "<SPECIAL_998>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "999": {
+      "content": "<SPECIAL_999>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "extra_special_tokens": {},
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "tokenizer_class": "PreTrainedTokenizer",
+  "unk_token": "<unk>"
+}
diff --git a/checkpoint-544/trainer_state.json b/checkpoint-544/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..ae29bb8304df014044e534caa6bd2aa486c709fd
--- /dev/null
+++ b/checkpoint-544/trainer_state.json
@@ -0,0 +1,3882 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.9990817263544536,
+  "eval_steps": 136,
+  "global_step": 544,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0018365472910927456,
+      "grad_norm": 0.49180246368465724,
+      "learning_rate": 0.0,
+      "loss": 1.3574,
+      "step": 1
+    },
+    {
+      "epoch": 0.0018365472910927456,
+      "eval_loss": 2.4259753227233887,
+      "eval_runtime": 39.8169,
+      "eval_samples_per_second": 5.149,
+      "eval_steps_per_second": 0.452,
+      "step": 1
+    },
+    {
+      "epoch": 0.0036730945821854912,
+      "grad_norm": 0.3994587341086747,
+      "learning_rate": 2.5000000000000004e-07,
+      "loss": 1.444,
+      "step": 2
+    },
+    {
+      "epoch": 0.005509641873278237,
+      "grad_norm": 0.39017597145072364,
+      "learning_rate": 5.000000000000001e-07,
+      "loss": 1.5149,
+      "step": 3
+    },
+    {
+      "epoch": 0.0073461891643709825,
+      "grad_norm": 0.47444439480391987,
+      "learning_rate": 7.5e-07,
+      "loss": 1.5855,
+      "step": 4
+    },
+    {
+      "epoch": 0.009182736455463728,
+      "grad_norm": 0.794434599507836,
+      "learning_rate": 1.0000000000000002e-06,
+      "loss": 1.6531,
+      "step": 5
+    },
+    {
+      "epoch": 0.011019283746556474,
+      "grad_norm": 0.7108153394196348,
+      "learning_rate": 1.25e-06,
+      "loss": 1.7881,
+      "step": 6
+    },
+    {
+      "epoch": 0.012855831037649219,
+      "grad_norm": 0.5204076611421804,
+      "learning_rate": 1.5e-06,
+      "loss": 1.5592,
+      "step": 7
+    },
+    {
+      "epoch": 0.014692378328741965,
+      "grad_norm": 0.7569351115766059,
+      "learning_rate": 1.75e-06,
+      "loss": 1.5735,
+      "step": 8
+    },
+    {
+      "epoch": 0.01652892561983471,
+      "grad_norm": 0.5678098307469198,
+      "learning_rate": 2.0000000000000003e-06,
+      "loss": 1.5934,
+      "step": 9
+    },
+    {
+      "epoch": 0.018365472910927456,
+      "grad_norm": 0.40098167184732914,
+      "learning_rate": 2.25e-06,
+      "loss": 1.688,
+      "step": 10
+    },
+    {
+      "epoch": 0.020202020202020204,
+      "grad_norm": 0.4268491869708594,
+      "learning_rate": 2.5e-06,
+      "loss": 1.6286,
+      "step": 11
+    },
+    {
+      "epoch": 0.02203856749311295,
+      "grad_norm": 0.5835872767276206,
+      "learning_rate": 2.7500000000000004e-06,
+      "loss": 1.679,
+      "step": 12
+    },
+    {
+      "epoch": 0.023875114784205693,
+      "grad_norm": 0.41861495783037117,
+      "learning_rate": 3e-06,
+      "loss": 1.7093,
+      "step": 13
+    },
+    {
+      "epoch": 0.025711662075298437,
+      "grad_norm": 0.3375113108661923,
+      "learning_rate": 3.2500000000000002e-06,
+      "loss": 1.7431,
+      "step": 14
+    },
+    {
+      "epoch": 0.027548209366391185,
+      "grad_norm": 0.48885555509704504,
+      "learning_rate": 3.5e-06,
+      "loss": 1.4873,
+      "step": 15
+    },
+    {
+      "epoch": 0.02938475665748393,
+      "grad_norm": 0.4483288005954393,
+      "learning_rate": 3.7500000000000005e-06,
+      "loss": 1.6619,
+      "step": 16
+    },
+    {
+      "epoch": 0.031221303948576674,
+      "grad_norm": 0.4299802045225574,
+      "learning_rate": 4.000000000000001e-06,
+      "loss": 1.6997,
+      "step": 17
+    },
+    {
+      "epoch": 0.03305785123966942,
+      "grad_norm": 0.5824485228901973,
+      "learning_rate": 4.25e-06,
+      "loss": 1.691,
+      "step": 18
+    },
+    {
+      "epoch": 0.03489439853076217,
+      "grad_norm": 0.32860558551239133,
+      "learning_rate": 4.5e-06,
+      "loss": 1.5414,
+      "step": 19
+    },
+    {
+      "epoch": 0.03673094582185491,
+      "grad_norm": 1.7514560949718712,
+      "learning_rate": 4.75e-06,
+      "loss": 1.522,
+      "step": 20
+    },
+    {
+      "epoch": 0.03856749311294766,
+      "grad_norm": 0.3844467204577219,
+      "learning_rate": 5e-06,
+      "loss": 1.6948,
+      "step": 21
+    },
+    {
+      "epoch": 0.04040404040404041,
+      "grad_norm": 0.329345071029554,
+      "learning_rate": 5.2500000000000006e-06,
+      "loss": 1.509,
+      "step": 22
+    },
+    {
+      "epoch": 0.04224058769513315,
+      "grad_norm": 0.28268786055882505,
+      "learning_rate": 5.500000000000001e-06,
+      "loss": 1.5563,
+      "step": 23
+    },
+    {
+      "epoch": 0.0440771349862259,
+      "grad_norm": 0.3422617324754064,
+      "learning_rate": 5.75e-06,
+      "loss": 1.5615,
+      "step": 24
+    },
+    {
+      "epoch": 0.04591368227731864,
+      "grad_norm": 0.33860326348440456,
+      "learning_rate": 6e-06,
+      "loss": 1.7008,
+      "step": 25
+    },
+    {
+      "epoch": 0.047750229568411386,
+      "grad_norm": 0.2789219845798442,
+      "learning_rate": 6.25e-06,
+      "loss": 1.5667,
+      "step": 26
+    },
+    {
+      "epoch": 0.049586776859504134,
+      "grad_norm": 0.37047693270617005,
+      "learning_rate": 6.5000000000000004e-06,
+      "loss": 1.5557,
+      "step": 27
+    },
+    {
+      "epoch": 0.051423324150596875,
+      "grad_norm": 0.3368470842339362,
+      "learning_rate": 6.750000000000001e-06,
+      "loss": 1.6045,
+      "step": 28
+    },
+    {
+      "epoch": 0.05325987144168962,
+      "grad_norm": 0.30344837893854465,
+      "learning_rate": 7e-06,
+      "loss": 1.6766,
+      "step": 29
+    },
+    {
+      "epoch": 0.05509641873278237,
+      "grad_norm": 0.6359004570618099,
+      "learning_rate": 7.25e-06,
+      "loss": 1.6499,
+      "step": 30
+    },
+    {
+      "epoch": 0.05693296602387511,
+      "grad_norm": 0.3258591226646554,
+      "learning_rate": 7.500000000000001e-06,
+      "loss": 1.6565,
+      "step": 31
+    },
+    {
+      "epoch": 0.05876951331496786,
+      "grad_norm": 0.3697834149605013,
+      "learning_rate": 7.75e-06,
+      "loss": 1.4883,
+      "step": 32
+    },
+    {
+      "epoch": 0.06060606060606061,
+      "grad_norm": 0.265668853003883,
+      "learning_rate": 8.000000000000001e-06,
+      "loss": 1.8289,
+      "step": 33
+    },
+    {
+      "epoch": 0.06244260789715335,
+      "grad_norm": 0.39987679350668315,
+      "learning_rate": 8.25e-06,
+      "loss": 1.6633,
+      "step": 34
+    },
+    {
+      "epoch": 0.0642791551882461,
+      "grad_norm": 0.39636333420956993,
+      "learning_rate": 8.5e-06,
+      "loss": 1.2298,
+      "step": 35
+    },
+    {
+      "epoch": 0.06611570247933884,
+      "grad_norm": 0.3464362348603123,
+      "learning_rate": 8.750000000000001e-06,
+      "loss": 1.485,
+      "step": 36
+    },
+    {
+      "epoch": 0.06795224977043159,
+      "grad_norm": 0.31616445355046285,
+      "learning_rate": 9e-06,
+      "loss": 1.5553,
+      "step": 37
+    },
+    {
+      "epoch": 0.06978879706152434,
+      "grad_norm": 0.4441888412468937,
+      "learning_rate": 9.250000000000001e-06,
+      "loss": 1.5967,
+      "step": 38
+    },
+    {
+      "epoch": 0.07162534435261708,
+      "grad_norm": 0.3547318554597848,
+      "learning_rate": 9.5e-06,
+      "loss": 1.5006,
+      "step": 39
+    },
+    {
+      "epoch": 0.07346189164370982,
+      "grad_norm": 0.27557088472944596,
+      "learning_rate": 9.75e-06,
+      "loss": 1.5673,
+      "step": 40
+    },
+    {
+      "epoch": 0.07529843893480258,
+      "grad_norm": 0.2956312497066916,
+      "learning_rate": 1e-05,
+      "loss": 1.4936,
+      "step": 41
+    },
+    {
+      "epoch": 0.07713498622589532,
+      "grad_norm": 0.2322611308466898,
+      "learning_rate": 9.999994591993822e-06,
+      "loss": 1.4759,
+      "step": 42
+    },
+    {
+      "epoch": 0.07897153351698806,
+      "grad_norm": 0.22039029040435731,
+      "learning_rate": 9.999978367986988e-06,
+      "loss": 1.6625,
+      "step": 43
+    },
+    {
+      "epoch": 0.08080808080808081,
+      "grad_norm": 0.3446344059315139,
+      "learning_rate": 9.999951328014591e-06,
+      "loss": 1.6309,
+      "step": 44
+    },
+    {
+      "epoch": 0.08264462809917356,
+      "grad_norm": 0.23666900781940328,
+      "learning_rate": 9.999913472135126e-06,
+      "loss": 1.5347,
+      "step": 45
+    },
+    {
+      "epoch": 0.0844811753902663,
+      "grad_norm": 0.2840328883351318,
+      "learning_rate": 9.999864800430482e-06,
+      "loss": 1.5115,
+      "step": 46
+    },
+    {
+      "epoch": 0.08631772268135904,
+      "grad_norm": 0.2407651293731456,
+      "learning_rate": 9.999805313005946e-06,
+      "loss": 1.4199,
+      "step": 47
+    },
+    {
+      "epoch": 0.0881542699724518,
+      "grad_norm": 0.24925631476018442,
+      "learning_rate": 9.999735009990202e-06,
+      "loss": 1.7008,
+      "step": 48
+    },
+    {
+      "epoch": 0.08999081726354453,
+      "grad_norm": 0.2502728573485842,
+      "learning_rate": 9.99965389153533e-06,
+      "loss": 1.6181,
+      "step": 49
+    },
+    {
+      "epoch": 0.09182736455463728,
+      "grad_norm": 0.23272569963887466,
+      "learning_rate": 9.999561957816803e-06,
+      "loss": 1.4668,
+      "step": 50
+    },
+    {
+      "epoch": 0.09366391184573003,
+      "grad_norm": 0.23492521900860228,
+      "learning_rate": 9.999459209033495e-06,
+      "loss": 1.6884,
+      "step": 51
+    },
+    {
+      "epoch": 0.09550045913682277,
+      "grad_norm": 0.24231529936066795,
+      "learning_rate": 9.999345645407671e-06,
+      "loss": 1.3811,
+      "step": 52
+    },
+    {
+      "epoch": 0.09733700642791551,
+      "grad_norm": 0.23749137313908725,
+      "learning_rate": 9.999221267184993e-06,
+      "loss": 1.6599,
+      "step": 53
+    },
+    {
+      "epoch": 0.09917355371900827,
+      "grad_norm": 0.2631749052017168,
+      "learning_rate": 9.999086074634516e-06,
+      "loss": 1.5321,
+      "step": 54
+    },
+    {
+      "epoch": 0.10101010101010101,
+      "grad_norm": 0.265780364913351,
+      "learning_rate": 9.998940068048688e-06,
+      "loss": 1.7954,
+      "step": 55
+    },
+    {
+      "epoch": 0.10284664830119375,
+      "grad_norm": 0.23373755925772408,
+      "learning_rate": 9.998783247743353e-06,
+      "loss": 1.6503,
+      "step": 56
+    },
+    {
+      "epoch": 0.1046831955922865,
+      "grad_norm": 0.26345499971500486,
+      "learning_rate": 9.998615614057743e-06,
+      "loss": 1.6842,
+      "step": 57
+    },
+    {
+      "epoch": 0.10651974288337925,
+      "grad_norm": 0.22858688890828285,
+      "learning_rate": 9.998437167354485e-06,
+      "loss": 1.6053,
+      "step": 58
+    },
+    {
+      "epoch": 0.10835629017447199,
+      "grad_norm": 0.22732836541277007,
+      "learning_rate": 9.998247908019594e-06,
+      "loss": 1.5357,
+      "step": 59
+    },
+    {
+      "epoch": 0.11019283746556474,
+      "grad_norm": 0.21575052353545032,
+      "learning_rate": 9.998047836462476e-06,
+      "loss": 1.5875,
+      "step": 60
+    },
+    {
+      "epoch": 0.11202938475665748,
+      "grad_norm": 0.3308350003540223,
+      "learning_rate": 9.997836953115927e-06,
+      "loss": 1.9333,
+      "step": 61
+    },
+    {
+      "epoch": 0.11386593204775022,
+      "grad_norm": 0.24160639887541288,
+      "learning_rate": 9.99761525843613e-06,
+      "loss": 1.6121,
+      "step": 62
+    },
+    {
+      "epoch": 0.11570247933884298,
+      "grad_norm": 0.23537591666009566,
+      "learning_rate": 9.997382752902658e-06,
+      "loss": 1.6341,
+      "step": 63
+    },
+    {
+      "epoch": 0.11753902662993572,
+      "grad_norm": 0.30577270648255184,
+      "learning_rate": 9.997139437018463e-06,
+      "loss": 1.4635,
+      "step": 64
+    },
+    {
+      "epoch": 0.11937557392102846,
+      "grad_norm": 0.24971896873950858,
+      "learning_rate": 9.996885311309892e-06,
+      "loss": 1.8186,
+      "step": 65
+    },
+    {
+      "epoch": 0.12121212121212122,
+      "grad_norm": 0.25847791225683553,
+      "learning_rate": 9.996620376326667e-06,
+      "loss": 1.491,
+      "step": 66
+    },
+    {
+      "epoch": 0.12304866850321396,
+      "grad_norm": 0.24031460889715148,
+      "learning_rate": 9.996344632641895e-06,
+      "loss": 1.6563,
+      "step": 67
+    },
+    {
+      "epoch": 0.1248852157943067,
+      "grad_norm": 0.2550524831797301,
+      "learning_rate": 9.996058080852067e-06,
+      "loss": 1.6427,
+      "step": 68
+    },
+    {
+      "epoch": 0.12672176308539945,
+      "grad_norm": 0.22467108780123965,
+      "learning_rate": 9.995760721577053e-06,
+      "loss": 1.4595,
+      "step": 69
+    },
+    {
+      "epoch": 0.1285583103764922,
+      "grad_norm": 0.282181674918973,
+      "learning_rate": 9.995452555460098e-06,
+      "loss": 1.6837,
+      "step": 70
+    },
+    {
+      "epoch": 0.13039485766758493,
+      "grad_norm": 0.5727450301366364,
+      "learning_rate": 9.995133583167833e-06,
+      "loss": 1.6003,
+      "step": 71
+    },
+    {
+      "epoch": 0.1322314049586777,
+      "grad_norm": 0.22744917091853156,
+      "learning_rate": 9.994803805390257e-06,
+      "loss": 1.3544,
+      "step": 72
+    },
+    {
+      "epoch": 0.13406795224977044,
+      "grad_norm": 0.22395196659772004,
+      "learning_rate": 9.994463222840748e-06,
+      "loss": 1.6198,
+      "step": 73
+    },
+    {
+      "epoch": 0.13590449954086317,
+      "grad_norm": 0.2098292344869194,
+      "learning_rate": 9.994111836256049e-06,
+      "loss": 1.5059,
+      "step": 74
+    },
+    {
+      "epoch": 0.13774104683195593,
+      "grad_norm": 0.22329332454983955,
+      "learning_rate": 9.993749646396286e-06,
+      "loss": 1.4666,
+      "step": 75
+    },
+    {
+      "epoch": 0.13957759412304868,
+      "grad_norm": 1.131446258847722,
+      "learning_rate": 9.993376654044948e-06,
+      "loss": 1.5164,
+      "step": 76
+    },
+    {
+      "epoch": 0.1414141414141414,
+      "grad_norm": 0.22716717526603358,
+      "learning_rate": 9.992992860008893e-06,
+      "loss": 1.4978,
+      "step": 77
+    },
+    {
+      "epoch": 0.14325068870523416,
+      "grad_norm": 0.24179796579866508,
+      "learning_rate": 9.992598265118344e-06,
+      "loss": 1.3147,
+      "step": 78
+    },
+    {
+      "epoch": 0.14508723599632692,
+      "grad_norm": 0.2127244611718112,
+      "learning_rate": 9.99219287022689e-06,
+      "loss": 1.4498,
+      "step": 79
+    },
+    {
+      "epoch": 0.14692378328741965,
+      "grad_norm": 0.27213431233903435,
+      "learning_rate": 9.991776676211483e-06,
+      "loss": 1.8822,
+      "step": 80
+    },
+    {
+      "epoch": 0.1487603305785124,
+      "grad_norm": 0.22988463490869612,
+      "learning_rate": 9.991349683972435e-06,
+      "loss": 1.4995,
+      "step": 81
+    },
+    {
+      "epoch": 0.15059687786960516,
+      "grad_norm": 0.23481878477688978,
+      "learning_rate": 9.990911894433415e-06,
+      "loss": 1.5132,
+      "step": 82
+    },
+    {
+      "epoch": 0.15243342516069788,
+      "grad_norm": 0.37026228973170716,
+      "learning_rate": 9.990463308541452e-06,
+      "loss": 1.5846,
+      "step": 83
+    },
+    {
+      "epoch": 0.15426997245179064,
+      "grad_norm": 0.34328184021255104,
+      "learning_rate": 9.990003927266928e-06,
+      "loss": 1.5882,
+      "step": 84
+    },
+    {
+      "epoch": 0.1561065197428834,
+      "grad_norm": 0.2239251502463014,
+      "learning_rate": 9.989533751603578e-06,
+      "loss": 1.5294,
+      "step": 85
+    },
+    {
+      "epoch": 0.15794306703397612,
+      "grad_norm": 0.2531093496713428,
+      "learning_rate": 9.989052782568484e-06,
+      "loss": 1.4136,
+      "step": 86
+    },
+    {
+      "epoch": 0.15977961432506887,
+      "grad_norm": 0.22960377831673873,
+      "learning_rate": 9.988561021202083e-06,
+      "loss": 1.5179,
+      "step": 87
+    },
+    {
+      "epoch": 0.16161616161616163,
+      "grad_norm": 0.2353475082843009,
+      "learning_rate": 9.988058468568154e-06,
+      "loss": 1.5986,
+      "step": 88
+    },
+    {
+      "epoch": 0.16345270890725436,
+      "grad_norm": 0.2095228695568511,
+      "learning_rate": 9.987545125753818e-06,
+      "loss": 1.7077,
+      "step": 89
+    },
+    {
+      "epoch": 0.1652892561983471,
+      "grad_norm": 0.25954954331361235,
+      "learning_rate": 9.987020993869543e-06,
+      "loss": 1.5786,
+      "step": 90
+    },
+    {
+      "epoch": 0.16712580348943984,
+      "grad_norm": 0.3475458310303135,
+      "learning_rate": 9.986486074049131e-06,
+      "loss": 1.6145,
+      "step": 91
+    },
+    {
+      "epoch": 0.1689623507805326,
+      "grad_norm": 0.26936951415786353,
+      "learning_rate": 9.98594036744972e-06,
+      "loss": 1.7652,
+      "step": 92
+    },
+    {
+      "epoch": 0.17079889807162535,
+      "grad_norm": 0.21373420050407635,
+      "learning_rate": 9.985383875251783e-06,
+      "loss": 1.6871,
+      "step": 93
+    },
+    {
+      "epoch": 0.17263544536271808,
+      "grad_norm": 0.23205711833790327,
+      "learning_rate": 9.98481659865913e-06,
+      "loss": 1.4672,
+      "step": 94
+    },
+    {
+      "epoch": 0.17447199265381083,
+      "grad_norm": 0.26381334544086116,
+      "learning_rate": 9.98423853889889e-06,
+      "loss": 1.6741,
+      "step": 95
+    },
+    {
+      "epoch": 0.1763085399449036,
+      "grad_norm": 0.24396664978240085,
+      "learning_rate": 9.983649697221528e-06,
+      "loss": 1.5546,
+      "step": 96
+    },
+    {
+      "epoch": 0.1781450872359963,
+      "grad_norm": 0.2533801841511916,
+      "learning_rate": 9.983050074900824e-06,
+      "loss": 1.6902,
+      "step": 97
+    },
+    {
+      "epoch": 0.17998163452708907,
+      "grad_norm": 0.2115479895852038,
+      "learning_rate": 9.982439673233885e-06,
+      "loss": 1.6094,
+      "step": 98
+    },
+    {
+      "epoch": 0.18181818181818182,
+      "grad_norm": 0.22659674725493387,
+      "learning_rate": 9.98181849354113e-06,
+      "loss": 1.3953,
+      "step": 99
+    },
+    {
+      "epoch": 0.18365472910927455,
+      "grad_norm": 0.4346020173346875,
+      "learning_rate": 9.981186537166301e-06,
+      "loss": 1.4842,
+      "step": 100
+    },
+    {
+      "epoch": 0.1854912764003673,
+      "grad_norm": 0.22752027491511684,
+      "learning_rate": 9.980543805476447e-06,
+      "loss": 1.6125,
+      "step": 101
+    },
+    {
+      "epoch": 0.18732782369146006,
+      "grad_norm": 0.2178158645117292,
+      "learning_rate": 9.979890299861923e-06,
+      "loss": 1.3843,
+      "step": 102
+    },
+    {
+      "epoch": 0.1891643709825528,
+      "grad_norm": 0.2629457576326313,
+      "learning_rate": 9.979226021736396e-06,
+      "loss": 1.5034,
+      "step": 103
+    },
+    {
+      "epoch": 0.19100091827364554,
+      "grad_norm": 0.2638758563035785,
+      "learning_rate": 9.978550972536834e-06,
+      "loss": 1.2882,
+      "step": 104
+    },
+    {
+      "epoch": 0.1928374655647383,
+      "grad_norm": 0.25957055432676646,
+      "learning_rate": 9.977865153723508e-06,
+      "loss": 1.5669,
+      "step": 105
+    },
+    {
+      "epoch": 0.19467401285583102,
+      "grad_norm": 0.2107272760638706,
+      "learning_rate": 9.977168566779976e-06,
+      "loss": 1.4316,
+      "step": 106
+    },
+    {
+      "epoch": 0.19651056014692378,
+      "grad_norm": 0.23996444946668347,
+      "learning_rate": 9.976461213213104e-06,
+      "loss": 1.5958,
+      "step": 107
+    },
+    {
+      "epoch": 0.19834710743801653,
+      "grad_norm": 0.3866853138626082,
+      "learning_rate": 9.975743094553037e-06,
+      "loss": 1.6301,
+      "step": 108
+    },
+    {
+      "epoch": 0.20018365472910926,
+      "grad_norm": 0.2659575860373734,
+      "learning_rate": 9.975014212353212e-06,
+      "loss": 1.6435,
+      "step": 109
+    },
+    {
+      "epoch": 0.20202020202020202,
+      "grad_norm": 0.25698703101518205,
+      "learning_rate": 9.974274568190349e-06,
+      "loss": 1.4947,
+      "step": 110
+    },
+    {
+      "epoch": 0.20385674931129477,
+      "grad_norm": 0.23394729883248447,
+      "learning_rate": 9.973524163664447e-06,
+      "loss": 1.5486,
+      "step": 111
+    },
+    {
+      "epoch": 0.2056932966023875,
+      "grad_norm": 0.2682338169486529,
+      "learning_rate": 9.972763000398784e-06,
+      "loss": 1.562,
+      "step": 112
+    },
+    {
+      "epoch": 0.20752984389348025,
+      "grad_norm": 0.22594240276292787,
+      "learning_rate": 9.971991080039912e-06,
+      "loss": 1.6665,
+      "step": 113
+    },
+    {
+      "epoch": 0.209366391184573,
+      "grad_norm": 0.2716099274981758,
+      "learning_rate": 9.971208404257647e-06,
+      "loss": 1.6069,
+      "step": 114
+    },
+    {
+      "epoch": 0.21120293847566574,
+      "grad_norm": 0.215642600558555,
+      "learning_rate": 9.970414974745077e-06,
+      "loss": 1.426,
+      "step": 115
+    },
+    {
+      "epoch": 0.2130394857667585,
+      "grad_norm": 0.26192594390837787,
+      "learning_rate": 9.96961079321855e-06,
+      "loss": 1.4929,
+      "step": 116
+    },
+    {
+      "epoch": 0.21487603305785125,
+      "grad_norm": 0.24076680870279565,
+      "learning_rate": 9.968795861417676e-06,
+      "loss": 1.5116,
+      "step": 117
+    },
+    {
+      "epoch": 0.21671258034894397,
+      "grad_norm": 0.20785778608018918,
+      "learning_rate": 9.967970181105315e-06,
+      "loss": 1.4824,
+      "step": 118
+    },
+    {
+      "epoch": 0.21854912764003673,
+      "grad_norm": 0.2474137833375562,
+      "learning_rate": 9.967133754067581e-06,
+      "loss": 1.6394,
+      "step": 119
+    },
+    {
+      "epoch": 0.22038567493112948,
+      "grad_norm": 0.2415950163286452,
+      "learning_rate": 9.966286582113838e-06,
+      "loss": 1.4747,
+      "step": 120
+    },
+    {
+      "epoch": 0.2222222222222222,
+      "grad_norm": 0.25397048864143756,
+      "learning_rate": 9.965428667076687e-06,
+      "loss": 1.626,
+      "step": 121
+    },
+    {
+      "epoch": 0.22405876951331496,
+      "grad_norm": 0.27597092429735764,
+      "learning_rate": 9.964560010811972e-06,
+      "loss": 1.4853,
+      "step": 122
+    },
+    {
+      "epoch": 0.22589531680440772,
+      "grad_norm": 0.2773282618369793,
+      "learning_rate": 9.963680615198774e-06,
+      "loss": 1.2673,
+      "step": 123
+    },
+    {
+      "epoch": 0.22773186409550045,
+      "grad_norm": 0.2863982446521439,
+      "learning_rate": 9.962790482139402e-06,
+      "loss": 1.4531,
+      "step": 124
+    },
+    {
+      "epoch": 0.2295684113865932,
+      "grad_norm": 0.24940341962059176,
+      "learning_rate": 9.961889613559396e-06,
+      "loss": 1.5392,
+      "step": 125
+    },
+    {
+      "epoch": 0.23140495867768596,
+      "grad_norm": 0.2692207944659178,
+      "learning_rate": 9.960978011407516e-06,
+      "loss": 1.3452,
+      "step": 126
+    },
+    {
+      "epoch": 0.23324150596877868,
+      "grad_norm": 0.2394265357414062,
+      "learning_rate": 9.960055677655743e-06,
+      "loss": 1.4267,
+      "step": 127
+    },
+    {
+      "epoch": 0.23507805325987144,
+      "grad_norm": 0.2396211231483559,
+      "learning_rate": 9.95912261429927e-06,
+      "loss": 1.669,
+      "step": 128
+    },
+    {
+      "epoch": 0.2369146005509642,
+      "grad_norm": 0.22480647337089882,
+      "learning_rate": 9.958178823356503e-06,
+      "loss": 1.3276,
+      "step": 129
+    },
+    {
+      "epoch": 0.23875114784205692,
+      "grad_norm": 0.2322223276315898,
+      "learning_rate": 9.957224306869053e-06,
+      "loss": 1.6457,
+      "step": 130
+    },
+    {
+      "epoch": 0.24058769513314968,
+      "grad_norm": 0.28675358511507826,
+      "learning_rate": 9.956259066901733e-06,
+      "loss": 1.4844,
+      "step": 131
+    },
+    {
+      "epoch": 0.24242424242424243,
+      "grad_norm": 0.23506904729263256,
+      "learning_rate": 9.955283105542551e-06,
+      "loss": 1.5401,
+      "step": 132
+    },
+    {
+      "epoch": 0.24426078971533516,
+      "grad_norm": 0.25409979083106216,
+      "learning_rate": 9.954296424902709e-06,
+      "loss": 1.5796,
+      "step": 133
+    },
+    {
+      "epoch": 0.2460973370064279,
+      "grad_norm": 0.27537727017693314,
+      "learning_rate": 9.953299027116598e-06,
+      "loss": 1.7015,
+      "step": 134
+    },
+    {
+      "epoch": 0.24793388429752067,
+      "grad_norm": 0.255527421712665,
+      "learning_rate": 9.95229091434179e-06,
+      "loss": 1.6943,
+      "step": 135
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "grad_norm": 0.2758931212786201,
+      "learning_rate": 9.95127208875904e-06,
+      "loss": 1.6373,
+      "step": 136
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "eval_loss": 2.332951307296753,
+      "eval_runtime": 38.5842,
+      "eval_samples_per_second": 5.313,
+      "eval_steps_per_second": 0.467,
+      "step": 136
+    },
+    {
+      "epoch": 0.2516069788797062,
+      "grad_norm": 0.4849948087122718,
+      "learning_rate": 9.950242552572272e-06,
+      "loss": 1.5843,
+      "step": 137
+    },
+    {
+      "epoch": 0.2534435261707989,
+      "grad_norm": 0.27082023040786063,
+      "learning_rate": 9.949202308008581e-06,
+      "loss": 1.466,
+      "step": 138
+    },
+    {
+      "epoch": 0.25528007346189163,
+      "grad_norm": 0.21412319589684112,
+      "learning_rate": 9.948151357318228e-06,
+      "loss": 1.5575,
+      "step": 139
+    },
+    {
+      "epoch": 0.2571166207529844,
+      "grad_norm": 0.2630300060870272,
+      "learning_rate": 9.94708970277463e-06,
+      "loss": 1.8459,
+      "step": 140
+    },
+    {
+      "epoch": 0.25895316804407714,
+      "grad_norm": 0.29584228360860926,
+      "learning_rate": 9.946017346674362e-06,
+      "loss": 1.4765,
+      "step": 141
+    },
+    {
+      "epoch": 0.26078971533516987,
+      "grad_norm": 0.20420849217608372,
+      "learning_rate": 9.944934291337146e-06,
+      "loss": 1.3963,
+      "step": 142
+    },
+    {
+      "epoch": 0.26262626262626265,
+      "grad_norm": 0.2383087119690396,
+      "learning_rate": 9.943840539105853e-06,
+      "loss": 1.6948,
+      "step": 143
+    },
+    {
+      "epoch": 0.2644628099173554,
+      "grad_norm": 0.22707287878559146,
+      "learning_rate": 9.942736092346487e-06,
+      "loss": 1.5627,
+      "step": 144
+    },
+    {
+      "epoch": 0.2662993572084481,
+      "grad_norm": 0.2209791613669926,
+      "learning_rate": 9.941620953448195e-06,
+      "loss": 1.6011,
+      "step": 145
+    },
+    {
+      "epoch": 0.2681359044995409,
+      "grad_norm": 0.23620122895922513,
+      "learning_rate": 9.940495124823241e-06,
+      "loss": 1.4172,
+      "step": 146
+    },
+    {
+      "epoch": 0.2699724517906336,
+      "grad_norm": 0.4575809432111337,
+      "learning_rate": 9.939358608907026e-06,
+      "loss": 1.8045,
+      "step": 147
+    },
+    {
+      "epoch": 0.27180899908172634,
+      "grad_norm": 0.25576228816691954,
+      "learning_rate": 9.938211408158063e-06,
+      "loss": 1.5559,
+      "step": 148
+    },
+    {
+      "epoch": 0.2736455463728191,
+      "grad_norm": 0.32262207355286887,
+      "learning_rate": 9.937053525057977e-06,
+      "loss": 1.6491,
+      "step": 149
+    },
+    {
+      "epoch": 0.27548209366391185,
+      "grad_norm": 0.29602023759033497,
+      "learning_rate": 9.935884962111506e-06,
+      "loss": 1.6518,
+      "step": 150
+    },
+    {
+      "epoch": 0.2773186409550046,
+      "grad_norm": 0.24182886602369053,
+      "learning_rate": 9.934705721846487e-06,
+      "loss": 1.5457,
+      "step": 151
+    },
+    {
+      "epoch": 0.27915518824609736,
+      "grad_norm": 0.2247571699952089,
+      "learning_rate": 9.933515806813856e-06,
+      "loss": 1.481,
+      "step": 152
+    },
+    {
+      "epoch": 0.2809917355371901,
+      "grad_norm": 0.24890915769392072,
+      "learning_rate": 9.932315219587641e-06,
+      "loss": 1.618,
+      "step": 153
+    },
+    {
+      "epoch": 0.2828282828282828,
+      "grad_norm": 0.2597194625874549,
+      "learning_rate": 9.931103962764955e-06,
+      "loss": 1.5653,
+      "step": 154
+    },
+    {
+      "epoch": 0.2846648301193756,
+      "grad_norm": 0.23725030845640346,
+      "learning_rate": 9.92988203896599e-06,
+      "loss": 1.4677,
+      "step": 155
+    },
+    {
+      "epoch": 0.2865013774104683,
+      "grad_norm": 0.20619150412894088,
+      "learning_rate": 9.928649450834015e-06,
+      "loss": 1.6779,
+      "step": 156
+    },
+    {
+      "epoch": 0.28833792470156105,
+      "grad_norm": 0.23919303859135752,
+      "learning_rate": 9.927406201035368e-06,
+      "loss": 1.4417,
+      "step": 157
+    },
+    {
+      "epoch": 0.29017447199265384,
+      "grad_norm": 0.2244668514529571,
+      "learning_rate": 9.926152292259452e-06,
+      "loss": 1.7272,
+      "step": 158
+    },
+    {
+      "epoch": 0.29201101928374656,
+      "grad_norm": 0.26954841337527125,
+      "learning_rate": 9.924887727218724e-06,
+      "loss": 1.6068,
+      "step": 159
+    },
+    {
+      "epoch": 0.2938475665748393,
+      "grad_norm": 0.32951953455251004,
+      "learning_rate": 9.923612508648693e-06,
+      "loss": 1.406,
+      "step": 160
+    },
+    {
+      "epoch": 0.2956841138659321,
+      "grad_norm": 0.2698529792514822,
+      "learning_rate": 9.922326639307918e-06,
+      "loss": 1.683,
+      "step": 161
+    },
+    {
+      "epoch": 0.2975206611570248,
+      "grad_norm": 0.22420186125700636,
+      "learning_rate": 9.921030121977992e-06,
+      "loss": 1.5398,
+      "step": 162
+    },
+    {
+      "epoch": 0.29935720844811753,
+      "grad_norm": 0.24335042870850987,
+      "learning_rate": 9.919722959463545e-06,
+      "loss": 1.5752,
+      "step": 163
+    },
+    {
+      "epoch": 0.3011937557392103,
+      "grad_norm": 0.272993009874352,
+      "learning_rate": 9.918405154592234e-06,
+      "loss": 1.6791,
+      "step": 164
+    },
+    {
+      "epoch": 0.30303030303030304,
+      "grad_norm": 0.36447396005561716,
+      "learning_rate": 9.917076710214739e-06,
+      "loss": 1.8303,
+      "step": 165
+    },
+    {
+      "epoch": 0.30486685032139577,
+      "grad_norm": 0.266743073761148,
+      "learning_rate": 9.915737629204754e-06,
+      "loss": 1.652,
+      "step": 166
+    },
+    {
+      "epoch": 0.30670339761248855,
+      "grad_norm": 0.22394219745904015,
+      "learning_rate": 9.914387914458983e-06,
+      "loss": 1.5615,
+      "step": 167
+    },
+    {
+      "epoch": 0.3085399449035813,
+      "grad_norm": 0.23075889412968112,
+      "learning_rate": 9.91302756889713e-06,
+      "loss": 1.6447,
+      "step": 168
+    },
+    {
+      "epoch": 0.310376492194674,
+      "grad_norm": 0.2441975693564735,
+      "learning_rate": 9.911656595461899e-06,
+      "loss": 1.5981,
+      "step": 169
+    },
+    {
+      "epoch": 0.3122130394857668,
+      "grad_norm": 0.21377545765414097,
+      "learning_rate": 9.910274997118982e-06,
+      "loss": 1.6066,
+      "step": 170
+    },
+    {
+      "epoch": 0.3140495867768595,
+      "grad_norm": 0.21518096806340806,
+      "learning_rate": 9.908882776857057e-06,
+      "loss": 1.199,
+      "step": 171
+    },
+    {
+      "epoch": 0.31588613406795224,
+      "grad_norm": 0.22989533865542952,
+      "learning_rate": 9.907479937687779e-06,
+      "loss": 1.6019,
+      "step": 172
+    },
+    {
+      "epoch": 0.317722681359045,
+      "grad_norm": 0.24187157970795195,
+      "learning_rate": 9.906066482645774e-06,
+      "loss": 1.5453,
+      "step": 173
+    },
+    {
+      "epoch": 0.31955922865013775,
+      "grad_norm": 0.28880156295741904,
+      "learning_rate": 9.904642414788627e-06,
+      "loss": 1.6518,
+      "step": 174
+    },
+    {
+      "epoch": 0.3213957759412305,
+      "grad_norm": 0.3064989299701211,
+      "learning_rate": 9.903207737196892e-06,
+      "loss": 1.5614,
+      "step": 175
+    },
+    {
+      "epoch": 0.32323232323232326,
+      "grad_norm": 0.5501951504862674,
+      "learning_rate": 9.90176245297406e-06,
+      "loss": 1.3988,
+      "step": 176
+    },
+    {
+      "epoch": 0.325068870523416,
+      "grad_norm": 0.23086867624049656,
+      "learning_rate": 9.900306565246579e-06,
+      "loss": 1.4688,
+      "step": 177
+    },
+    {
+      "epoch": 0.3269054178145087,
+      "grad_norm": 0.24109267951104685,
+      "learning_rate": 9.898840077163824e-06,
+      "loss": 1.342,
+      "step": 178
+    },
+    {
+      "epoch": 0.3287419651056015,
+      "grad_norm": 0.221519141054226,
+      "learning_rate": 9.89736299189811e-06,
+      "loss": 1.6468,
+      "step": 179
+    },
+    {
+      "epoch": 0.3305785123966942,
+      "grad_norm": 0.2134481965910651,
+      "learning_rate": 9.89587531264467e-06,
+      "loss": 1.4762,
+      "step": 180
+    },
+    {
+      "epoch": 0.33241505968778695,
+      "grad_norm": 0.30273218459666634,
+      "learning_rate": 9.894377042621654e-06,
+      "loss": 1.2952,
+      "step": 181
+    },
+    {
+      "epoch": 0.3342516069788797,
+      "grad_norm": 0.2643249012553608,
+      "learning_rate": 9.892868185070125e-06,
+      "loss": 1.5922,
+      "step": 182
+    },
+    {
+      "epoch": 0.33608815426997246,
+      "grad_norm": 0.3017798778461224,
+      "learning_rate": 9.891348743254046e-06,
+      "loss": 1.3327,
+      "step": 183
+    },
+    {
+      "epoch": 0.3379247015610652,
+      "grad_norm": 0.198099058736144,
+      "learning_rate": 9.889818720460281e-06,
+      "loss": 1.4528,
+      "step": 184
+    },
+    {
+      "epoch": 0.3397612488521579,
+      "grad_norm": 0.2342720457991802,
+      "learning_rate": 9.888278119998573e-06,
+      "loss": 1.396,
+      "step": 185
+    },
+    {
+      "epoch": 0.3415977961432507,
+      "grad_norm": 0.30360601805904236,
+      "learning_rate": 9.886726945201556e-06,
+      "loss": 1.5982,
+      "step": 186
+    },
+    {
+      "epoch": 0.3434343434343434,
+      "grad_norm": 0.2890684354336481,
+      "learning_rate": 9.885165199424738e-06,
+      "loss": 1.3935,
+      "step": 187
+    },
+    {
+      "epoch": 0.34527089072543615,
+      "grad_norm": 0.2574557316071565,
+      "learning_rate": 9.883592886046486e-06,
+      "loss": 1.449,
+      "step": 188
+    },
+    {
+      "epoch": 0.34710743801652894,
+      "grad_norm": 0.23195985985184547,
+      "learning_rate": 9.882010008468038e-06,
+      "loss": 1.4909,
+      "step": 189
+    },
+    {
+      "epoch": 0.34894398530762166,
+      "grad_norm": 0.2539011848151687,
+      "learning_rate": 9.880416570113472e-06,
+      "loss": 1.5123,
+      "step": 190
+    },
+    {
+      "epoch": 0.3507805325987144,
+      "grad_norm": 0.26954455617431194,
+      "learning_rate": 9.878812574429722e-06,
+      "loss": 1.4445,
+      "step": 191
+    },
+    {
+      "epoch": 0.3526170798898072,
+      "grad_norm": 0.23141695311529595,
+      "learning_rate": 9.877198024886553e-06,
+      "loss": 1.9045,
+      "step": 192
+    },
+    {
+      "epoch": 0.3544536271808999,
+      "grad_norm": 0.2750943021523168,
+      "learning_rate": 9.875572924976568e-06,
+      "loss": 1.5868,
+      "step": 193
+    },
+    {
+      "epoch": 0.3562901744719926,
+      "grad_norm": 0.23421966078059409,
+      "learning_rate": 9.873937278215181e-06,
+      "loss": 1.7534,
+      "step": 194
+    },
+    {
+      "epoch": 0.3581267217630854,
+      "grad_norm": 0.24409550991932608,
+      "learning_rate": 9.87229108814063e-06,
+      "loss": 1.4753,
+      "step": 195
+    },
+    {
+      "epoch": 0.35996326905417814,
+      "grad_norm": 0.24998063066925763,
+      "learning_rate": 9.870634358313956e-06,
+      "loss": 1.6574,
+      "step": 196
+    },
+    {
+      "epoch": 0.36179981634527086,
+      "grad_norm": 0.2630317204109116,
+      "learning_rate": 9.868967092319003e-06,
+      "loss": 1.6794,
+      "step": 197
+    },
+    {
+      "epoch": 0.36363636363636365,
+      "grad_norm": 0.21473616516429722,
+      "learning_rate": 9.867289293762403e-06,
+      "loss": 1.7626,
+      "step": 198
+    },
+    {
+      "epoch": 0.3654729109274564,
+      "grad_norm": 0.3020374891635284,
+      "learning_rate": 9.865600966273576e-06,
+      "loss": 1.5234,
+      "step": 199
+    },
+    {
+      "epoch": 0.3673094582185491,
+      "grad_norm": 0.24122137539024896,
+      "learning_rate": 9.863902113504713e-06,
+      "loss": 1.5807,
+      "step": 200
+    },
+    {
+      "epoch": 0.3691460055096419,
+      "grad_norm": 0.2240345557985464,
+      "learning_rate": 9.86219273913078e-06,
+      "loss": 1.4635,
+      "step": 201
+    },
+    {
+      "epoch": 0.3709825528007346,
+      "grad_norm": 0.2561505890958098,
+      "learning_rate": 9.860472846849498e-06,
+      "loss": 1.5781,
+      "step": 202
+    },
+    {
+      "epoch": 0.37281910009182734,
+      "grad_norm": 0.2629334369467521,
+      "learning_rate": 9.858742440381343e-06,
+      "loss": 1.3698,
+      "step": 203
+    },
+    {
+      "epoch": 0.3746556473829201,
+      "grad_norm": 0.2643820816427679,
+      "learning_rate": 9.857001523469534e-06,
+      "loss": 1.6831,
+      "step": 204
+    },
+    {
+      "epoch": 0.37649219467401285,
+      "grad_norm": 0.27568924761133784,
+      "learning_rate": 9.855250099880026e-06,
+      "loss": 1.5586,
+      "step": 205
+    },
+    {
+      "epoch": 0.3783287419651056,
+      "grad_norm": 0.23562831853645116,
+      "learning_rate": 9.853488173401504e-06,
+      "loss": 1.4529,
+      "step": 206
+    },
+    {
+      "epoch": 0.38016528925619836,
+      "grad_norm": 0.24270051421435648,
+      "learning_rate": 9.851715747845372e-06,
+      "loss": 1.5449,
+      "step": 207
+    },
+    {
+      "epoch": 0.3820018365472911,
+      "grad_norm": 0.3141794855298513,
+      "learning_rate": 9.849932827045746e-06,
+      "loss": 1.6011,
+      "step": 208
+    },
+    {
+      "epoch": 0.3838383838383838,
+      "grad_norm": 0.2347451989106533,
+      "learning_rate": 9.848139414859441e-06,
+      "loss": 1.7994,
+      "step": 209
+    },
+    {
+      "epoch": 0.3856749311294766,
+      "grad_norm": 0.22998314428761488,
+      "learning_rate": 9.846335515165974e-06,
+      "loss": 1.5024,
+      "step": 210
+    },
+    {
+      "epoch": 0.3875114784205693,
+      "grad_norm": 0.2914601119925799,
+      "learning_rate": 9.844521131867546e-06,
+      "loss": 1.6718,
+      "step": 211
+    },
+    {
+      "epoch": 0.38934802571166205,
+      "grad_norm": 0.27307242607178106,
+      "learning_rate": 9.842696268889032e-06,
+      "loss": 1.6705,
+      "step": 212
+    },
+    {
+      "epoch": 0.39118457300275483,
+      "grad_norm": 0.26989044058601575,
+      "learning_rate": 9.840860930177984e-06,
+      "loss": 1.5762,
+      "step": 213
+    },
+    {
+      "epoch": 0.39302112029384756,
+      "grad_norm": 0.23544376195311703,
+      "learning_rate": 9.839015119704607e-06,
+      "loss": 1.4928,
+      "step": 214
+    },
+    {
+      "epoch": 0.3948576675849403,
+      "grad_norm": 0.40380733954206144,
+      "learning_rate": 9.837158841461767e-06,
+      "loss": 1.5587,
+      "step": 215
+    },
+    {
+      "epoch": 0.39669421487603307,
+      "grad_norm": 0.2416750029017525,
+      "learning_rate": 9.835292099464965e-06,
+      "loss": 1.4265,
+      "step": 216
+    },
+    {
+      "epoch": 0.3985307621671258,
+      "grad_norm": 0.20943162169896912,
+      "learning_rate": 9.833414897752346e-06,
+      "loss": 1.5836,
+      "step": 217
+    },
+    {
+      "epoch": 0.4003673094582185,
+      "grad_norm": 0.24319317049956413,
+      "learning_rate": 9.831527240384677e-06,
+      "loss": 1.6154,
+      "step": 218
+    },
+    {
+      "epoch": 0.4022038567493113,
+      "grad_norm": 0.2375469014345421,
+      "learning_rate": 9.829629131445342e-06,
+      "loss": 1.5652,
+      "step": 219
+    },
+    {
+      "epoch": 0.40404040404040403,
+      "grad_norm": 0.27739989413008637,
+      "learning_rate": 9.827720575040335e-06,
+      "loss": 1.5439,
+      "step": 220
+    },
+    {
+      "epoch": 0.40587695133149676,
+      "grad_norm": 0.24247147004672653,
+      "learning_rate": 9.825801575298248e-06,
+      "loss": 1.4613,
+      "step": 221
+    },
+    {
+      "epoch": 0.40771349862258954,
+      "grad_norm": 0.29413816874548104,
+      "learning_rate": 9.82387213637027e-06,
+      "loss": 1.4005,
+      "step": 222
+    },
+    {
+      "epoch": 0.40955004591368227,
+      "grad_norm": 0.21318983016138546,
+      "learning_rate": 9.821932262430164e-06,
+      "loss": 1.4747,
+      "step": 223
+    },
+    {
+      "epoch": 0.411386593204775,
+      "grad_norm": 0.24655890709082884,
+      "learning_rate": 9.819981957674273e-06,
+      "loss": 1.6599,
+      "step": 224
+    },
+    {
+      "epoch": 0.4132231404958678,
+      "grad_norm": 0.23420376177876423,
+      "learning_rate": 9.818021226321502e-06,
+      "loss": 1.5039,
+      "step": 225
+    },
+    {
+      "epoch": 0.4150596877869605,
+      "grad_norm": 0.23379966460981552,
+      "learning_rate": 9.816050072613306e-06,
+      "loss": 1.775,
+      "step": 226
+    },
+    {
+      "epoch": 0.41689623507805323,
+      "grad_norm": 0.30210714633151925,
+      "learning_rate": 9.814068500813692e-06,
+      "loss": 1.5692,
+      "step": 227
+    },
+    {
+      "epoch": 0.418732782369146,
+      "grad_norm": 0.24124025669836516,
+      "learning_rate": 9.812076515209201e-06,
+      "loss": 1.5682,
+      "step": 228
+    },
+    {
+      "epoch": 0.42056932966023874,
+      "grad_norm": 0.40694547415364124,
+      "learning_rate": 9.8100741201089e-06,
+      "loss": 1.3886,
+      "step": 229
+    },
+    {
+      "epoch": 0.42240587695133147,
+      "grad_norm": 0.5017797555556736,
+      "learning_rate": 9.808061319844376e-06,
+      "loss": 1.5096,
+      "step": 230
+    },
+    {
+      "epoch": 0.42424242424242425,
+      "grad_norm": 0.2395927998641603,
+      "learning_rate": 9.806038118769724e-06,
+      "loss": 1.6511,
+      "step": 231
+    },
+    {
+      "epoch": 0.426078971533517,
+      "grad_norm": 0.26346897129489716,
+      "learning_rate": 9.804004521261537e-06,
+      "loss": 1.4852,
+      "step": 232
+    },
+    {
+      "epoch": 0.4279155188246097,
+      "grad_norm": 0.21927054884906805,
+      "learning_rate": 9.801960531718898e-06,
+      "loss": 1.3796,
+      "step": 233
+    },
+    {
+      "epoch": 0.4297520661157025,
+      "grad_norm": 0.21216613988150154,
+      "learning_rate": 9.79990615456337e-06,
+      "loss": 1.3236,
+      "step": 234
+    },
+    {
+      "epoch": 0.4315886134067952,
+      "grad_norm": 0.2439837140444034,
+      "learning_rate": 9.797841394238987e-06,
+      "loss": 1.4752,
+      "step": 235
+    },
+    {
+      "epoch": 0.43342516069788795,
+      "grad_norm": 0.20264650772176668,
+      "learning_rate": 9.795766255212242e-06,
+      "loss": 1.4633,
+      "step": 236
+    },
+    {
+      "epoch": 0.43526170798898073,
+      "grad_norm": 0.2214142026219714,
+      "learning_rate": 9.793680741972084e-06,
+      "loss": 1.524,
+      "step": 237
+    },
+    {
+      "epoch": 0.43709825528007346,
+      "grad_norm": 0.32400463641987054,
+      "learning_rate": 9.791584859029901e-06,
+      "loss": 1.7717,
+      "step": 238
+    },
+    {
+      "epoch": 0.4389348025711662,
+      "grad_norm": 0.25353704234527624,
+      "learning_rate": 9.789478610919508e-06,
+      "loss": 1.4503,
+      "step": 239
+    },
+    {
+      "epoch": 0.44077134986225897,
+      "grad_norm": 0.28666088570706005,
+      "learning_rate": 9.787362002197147e-06,
+      "loss": 1.5374,
+      "step": 240
+    },
+    {
+      "epoch": 0.4426078971533517,
+      "grad_norm": 0.2575712788223055,
+      "learning_rate": 9.785235037441473e-06,
+      "loss": 1.3976,
+      "step": 241
+    },
+    {
+      "epoch": 0.4444444444444444,
+      "grad_norm": 0.235205219080783,
+      "learning_rate": 9.783097721253543e-06,
+      "loss": 1.6037,
+      "step": 242
+    },
+    {
+      "epoch": 0.4462809917355372,
+      "grad_norm": 0.23780080068966725,
+      "learning_rate": 9.780950058256802e-06,
+      "loss": 1.679,
+      "step": 243
+    },
+    {
+      "epoch": 0.44811753902662993,
+      "grad_norm": 0.3404150158565561,
+      "learning_rate": 9.778792053097079e-06,
+      "loss": 1.3573,
+      "step": 244
+    },
+    {
+      "epoch": 0.44995408631772266,
+      "grad_norm": 0.21082516759926104,
+      "learning_rate": 9.77662371044258e-06,
+      "loss": 1.4932,
+      "step": 245
+    },
+    {
+      "epoch": 0.45179063360881544,
+      "grad_norm": 0.24031601796602936,
+      "learning_rate": 9.774445034983864e-06,
+      "loss": 1.7397,
+      "step": 246
+    },
+    {
+      "epoch": 0.45362718089990817,
+      "grad_norm": 0.2207009467162113,
+      "learning_rate": 9.77225603143385e-06,
+      "loss": 1.585,
+      "step": 247
+    },
+    {
+      "epoch": 0.4554637281910009,
+      "grad_norm": 0.2551403718915401,
+      "learning_rate": 9.770056704527797e-06,
+      "loss": 1.4924,
+      "step": 248
+    },
+    {
+      "epoch": 0.4573002754820937,
+      "grad_norm": 0.23525171894308203,
+      "learning_rate": 9.767847059023292e-06,
+      "loss": 1.5658,
+      "step": 249
+    },
+    {
+      "epoch": 0.4591368227731864,
+      "grad_norm": 0.2340311514550259,
+      "learning_rate": 9.765627099700248e-06,
+      "loss": 1.7361,
+      "step": 250
+    },
+    {
+      "epoch": 0.46097337006427913,
+      "grad_norm": 0.3425610884720096,
+      "learning_rate": 9.763396831360884e-06,
+      "loss": 1.4723,
+      "step": 251
+    },
+    {
+      "epoch": 0.4628099173553719,
+      "grad_norm": 0.232643381531555,
+      "learning_rate": 9.761156258829723e-06,
+      "loss": 1.5543,
+      "step": 252
+    },
+    {
+      "epoch": 0.46464646464646464,
+      "grad_norm": 0.3601600310692427,
+      "learning_rate": 9.75890538695358e-06,
+      "loss": 1.4195,
+      "step": 253
+    },
+    {
+      "epoch": 0.46648301193755737,
+      "grad_norm": 0.2625087171937245,
+      "learning_rate": 9.756644220601541e-06,
+      "loss": 1.7209,
+      "step": 254
+    },
+    {
+      "epoch": 0.46831955922865015,
+      "grad_norm": 0.36091521146763844,
+      "learning_rate": 9.75437276466497e-06,
+      "loss": 1.4435,
+      "step": 255
+    },
+    {
+      "epoch": 0.4701561065197429,
+      "grad_norm": 0.22970766162190284,
+      "learning_rate": 9.752091024057485e-06,
+      "loss": 1.3894,
+      "step": 256
+    },
+    {
+      "epoch": 0.4719926538108356,
+      "grad_norm": 0.2708039374301605,
+      "learning_rate": 9.749799003714954e-06,
+      "loss": 1.4717,
+      "step": 257
+    },
+    {
+      "epoch": 0.4738292011019284,
+      "grad_norm": 0.22940138762480203,
+      "learning_rate": 9.747496708595482e-06,
+      "loss": 1.532,
+      "step": 258
+    },
+    {
+      "epoch": 0.4756657483930211,
+      "grad_norm": 0.27196638223072084,
+      "learning_rate": 9.745184143679398e-06,
+      "loss": 1.4425,
+      "step": 259
+    },
+    {
+      "epoch": 0.47750229568411384,
+      "grad_norm": 0.24883578158794614,
+      "learning_rate": 9.742861313969246e-06,
+      "loss": 1.4882,
+      "step": 260
+    },
+    {
+      "epoch": 0.4793388429752066,
+      "grad_norm": 0.24541193855388124,
+      "learning_rate": 9.74052822448978e-06,
+      "loss": 1.4851,
+      "step": 261
+    },
+    {
+      "epoch": 0.48117539026629935,
+      "grad_norm": 0.249310294245501,
+      "learning_rate": 9.738184880287946e-06,
+      "loss": 1.6463,
+      "step": 262
+    },
+    {
+      "epoch": 0.4830119375573921,
+      "grad_norm": 0.25707806827316415,
+      "learning_rate": 9.735831286432869e-06,
+      "loss": 1.6118,
+      "step": 263
+    },
+    {
+      "epoch": 0.48484848484848486,
+      "grad_norm": 0.22547510302041615,
+      "learning_rate": 9.733467448015849e-06,
+      "loss": 1.3343,
+      "step": 264
+    },
+    {
+      "epoch": 0.4866850321395776,
+      "grad_norm": 0.21415297945638267,
+      "learning_rate": 9.731093370150349e-06,
+      "loss": 1.8938,
+      "step": 265
+    },
+    {
+      "epoch": 0.4885215794306703,
+      "grad_norm": 0.25553884577553115,
+      "learning_rate": 9.728709057971979e-06,
+      "loss": 1.6681,
+      "step": 266
+    },
+    {
+      "epoch": 0.4903581267217631,
+      "grad_norm": 0.23479399192488148,
+      "learning_rate": 9.72631451663849e-06,
+      "loss": 1.3781,
+      "step": 267
+    },
+    {
+      "epoch": 0.4921946740128558,
+      "grad_norm": 0.2549932602973557,
+      "learning_rate": 9.723909751329759e-06,
+      "loss": 1.444,
+      "step": 268
+    },
+    {
+      "epoch": 0.49403122130394855,
+      "grad_norm": 0.24071196589287586,
+      "learning_rate": 9.721494767247779e-06,
+      "loss": 1.5817,
+      "step": 269
+    },
+    {
+      "epoch": 0.49586776859504134,
+      "grad_norm": 0.23040782897953827,
+      "learning_rate": 9.719069569616653e-06,
+      "loss": 1.2528,
+      "step": 270
+    },
+    {
+      "epoch": 0.49770431588613406,
+      "grad_norm": 0.2371564859647457,
+      "learning_rate": 9.71663416368257e-06,
+      "loss": 1.7053,
+      "step": 271
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "grad_norm": 0.2489215879444709,
+      "learning_rate": 9.71418855471381e-06,
+      "loss": 1.4637,
+      "step": 272
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "eval_loss": 2.313441038131714,
+      "eval_runtime": 39.8034,
+      "eval_samples_per_second": 5.15,
+      "eval_steps_per_second": 0.452,
+      "step": 272
+    },
+    {
+      "epoch": 0.5013774104683195,
+      "grad_norm": 0.40359885890108993,
+      "learning_rate": 9.71173274800072e-06,
+      "loss": 1.2163,
+      "step": 273
+    },
+    {
+      "epoch": 0.5032139577594124,
+      "grad_norm": 0.19808277732817645,
+      "learning_rate": 9.709266748855704e-06,
+      "loss": 1.4049,
+      "step": 274
+    },
+    {
+      "epoch": 0.5050505050505051,
+      "grad_norm": 0.226114084447551,
+      "learning_rate": 9.70679056261322e-06,
+      "loss": 1.4663,
+      "step": 275
+    },
+    {
+      "epoch": 0.5068870523415978,
+      "grad_norm": 0.28094120861132194,
+      "learning_rate": 9.704304194629759e-06,
+      "loss": 1.553,
+      "step": 276
+    },
+    {
+      "epoch": 0.5087235996326905,
+      "grad_norm": 0.25995397574576745,
+      "learning_rate": 9.70180765028384e-06,
+      "loss": 1.6668,
+      "step": 277
+    },
+    {
+      "epoch": 0.5105601469237833,
+      "grad_norm": 0.26456909599184886,
+      "learning_rate": 9.699300934975993e-06,
+      "loss": 1.65,
+      "step": 278
+    },
+    {
+      "epoch": 0.512396694214876,
+      "grad_norm": 0.24248635440559377,
+      "learning_rate": 9.696784054128749e-06,
+      "loss": 1.3412,
+      "step": 279
+    },
+    {
+      "epoch": 0.5142332415059688,
+      "grad_norm": 0.2550690355279568,
+      "learning_rate": 9.694257013186635e-06,
+      "loss": 1.4855,
+      "step": 280
+    },
+    {
+      "epoch": 0.5160697887970616,
+      "grad_norm": 0.21051919872331962,
+      "learning_rate": 9.691719817616148e-06,
+      "loss": 1.4878,
+      "step": 281
+    },
+    {
+      "epoch": 0.5179063360881543,
+      "grad_norm": 0.2906151537123627,
+      "learning_rate": 9.689172472905759e-06,
+      "loss": 1.5423,
+      "step": 282
+    },
+    {
+      "epoch": 0.519742883379247,
+      "grad_norm": 0.24818058874303423,
+      "learning_rate": 9.686614984565888e-06,
+      "loss": 1.6553,
+      "step": 283
+    },
+    {
+      "epoch": 0.5215794306703397,
+      "grad_norm": 0.26642964980256184,
+      "learning_rate": 9.6840473581289e-06,
+      "loss": 1.5103,
+      "step": 284
+    },
+    {
+      "epoch": 0.5234159779614325,
+      "grad_norm": 0.2303123782267836,
+      "learning_rate": 9.681469599149093e-06,
+      "loss": 1.6623,
+      "step": 285
+    },
+    {
+      "epoch": 0.5252525252525253,
+      "grad_norm": 0.24975276980001815,
+      "learning_rate": 9.67888171320268e-06,
+      "loss": 1.5287,
+      "step": 286
+    },
+    {
+      "epoch": 0.527089072543618,
+      "grad_norm": 0.2839866917432431,
+      "learning_rate": 9.676283705887783e-06,
+      "loss": 1.5488,
+      "step": 287
+    },
+    {
+      "epoch": 0.5289256198347108,
+      "grad_norm": 0.3725151799153614,
+      "learning_rate": 9.673675582824416e-06,
+      "loss": 1.6329,
+      "step": 288
+    },
+    {
+      "epoch": 0.5307621671258035,
+      "grad_norm": 0.23277841474742347,
+      "learning_rate": 9.671057349654481e-06,
+      "loss": 1.6651,
+      "step": 289
+    },
+    {
+      "epoch": 0.5325987144168962,
+      "grad_norm": 0.24462057980980875,
+      "learning_rate": 9.668429012041742e-06,
+      "loss": 1.6452,
+      "step": 290
+    },
+    {
+      "epoch": 0.5344352617079889,
+      "grad_norm": 0.2801240375568796,
+      "learning_rate": 9.66579057567183e-06,
+      "loss": 1.6393,
+      "step": 291
+    },
+    {
+      "epoch": 0.5362718089990818,
+      "grad_norm": 0.22898727154751725,
+      "learning_rate": 9.663142046252213e-06,
+      "loss": 1.477,
+      "step": 292
+    },
+    {
+      "epoch": 0.5381083562901745,
+      "grad_norm": 0.27990182962352084,
+      "learning_rate": 9.660483429512198e-06,
+      "loss": 1.4522,
+      "step": 293
+    },
+    {
+      "epoch": 0.5399449035812672,
+      "grad_norm": 0.22721916937264164,
+      "learning_rate": 9.657814731202912e-06,
+      "loss": 1.6287,
+      "step": 294
+    },
+    {
+      "epoch": 0.54178145087236,
+      "grad_norm": 0.20163925656594917,
+      "learning_rate": 9.65513595709729e-06,
+      "loss": 1.404,
+      "step": 295
+    },
+    {
+      "epoch": 0.5436179981634527,
+      "grad_norm": 0.2926816198519085,
+      "learning_rate": 9.652447112990063e-06,
+      "loss": 1.3317,
+      "step": 296
+    },
+    {
+      "epoch": 0.5454545454545454,
+      "grad_norm": 0.21224236603779129,
+      "learning_rate": 9.649748204697741e-06,
+      "loss": 1.5832,
+      "step": 297
+    },
+    {
+      "epoch": 0.5472910927456383,
+      "grad_norm": 0.23696642392017095,
+      "learning_rate": 9.647039238058613e-06,
+      "loss": 1.4347,
+      "step": 298
+    },
+    {
+      "epoch": 0.549127640036731,
+      "grad_norm": 0.2540682989198533,
+      "learning_rate": 9.644320218932723e-06,
+      "loss": 1.3552,
+      "step": 299
+    },
+    {
+      "epoch": 0.5509641873278237,
+      "grad_norm": 0.3059021786701049,
+      "learning_rate": 9.641591153201856e-06,
+      "loss": 1.4477,
+      "step": 300
+    },
+    {
+      "epoch": 0.5528007346189164,
+      "grad_norm": 0.24608144306135712,
+      "learning_rate": 9.63885204676954e-06,
+      "loss": 1.4933,
+      "step": 301
+    },
+    {
+      "epoch": 0.5546372819100092,
+      "grad_norm": 0.2284951016394001,
+      "learning_rate": 9.63610290556101e-06,
+      "loss": 1.6014,
+      "step": 302
+    },
+    {
+      "epoch": 0.5564738292011019,
+      "grad_norm": 0.24446543124145687,
+      "learning_rate": 9.63334373552322e-06,
+      "loss": 1.4619,
+      "step": 303
+    },
+    {
+      "epoch": 0.5583103764921947,
+      "grad_norm": 0.2567728903743156,
+      "learning_rate": 9.63057454262481e-06,
+      "loss": 1.7054,
+      "step": 304
+    },
+    {
+      "epoch": 0.5601469237832875,
+      "grad_norm": 0.24400856152428735,
+      "learning_rate": 9.627795332856107e-06,
+      "loss": 1.5498,
+      "step": 305
+    },
+    {
+      "epoch": 0.5619834710743802,
+      "grad_norm": 0.23187407709208915,
+      "learning_rate": 9.625006112229102e-06,
+      "loss": 1.378,
+      "step": 306
+    },
+    {
+      "epoch": 0.5638200183654729,
+      "grad_norm": 0.217938745912038,
+      "learning_rate": 9.622206886777448e-06,
+      "loss": 1.4351,
+      "step": 307
+    },
+    {
+      "epoch": 0.5656565656565656,
+      "grad_norm": 0.24566673140048742,
+      "learning_rate": 9.619397662556434e-06,
+      "loss": 1.5534,
+      "step": 308
+    },
+    {
+      "epoch": 0.5674931129476584,
+      "grad_norm": 0.2682969741856791,
+      "learning_rate": 9.616578445642982e-06,
+      "loss": 1.4522,
+      "step": 309
+    },
+    {
+      "epoch": 0.5693296602387512,
+      "grad_norm": 0.23354861589018816,
+      "learning_rate": 9.613749242135627e-06,
+      "loss": 1.462,
+      "step": 310
+    },
+    {
+      "epoch": 0.5711662075298439,
+      "grad_norm": 0.22532237045597867,
+      "learning_rate": 9.61091005815451e-06,
+      "loss": 1.4351,
+      "step": 311
+    },
+    {
+      "epoch": 0.5730027548209367,
+      "grad_norm": 0.21311914562358464,
+      "learning_rate": 9.608060899841361e-06,
+      "loss": 1.7438,
+      "step": 312
+    },
+    {
+      "epoch": 0.5748393021120294,
+      "grad_norm": 0.2447872447833896,
+      "learning_rate": 9.605201773359485e-06,
+      "loss": 1.5586,
+      "step": 313
+    },
+    {
+      "epoch": 0.5766758494031221,
+      "grad_norm": 0.23045392404633464,
+      "learning_rate": 9.602332684893754e-06,
+      "loss": 1.4347,
+      "step": 314
+    },
+    {
+      "epoch": 0.5785123966942148,
+      "grad_norm": 0.23490326797451772,
+      "learning_rate": 9.599453640650585e-06,
+      "loss": 1.5357,
+      "step": 315
+    },
+    {
+      "epoch": 0.5803489439853077,
+      "grad_norm": 0.22245719768167882,
+      "learning_rate": 9.596564646857934e-06,
+      "loss": 1.5031,
+      "step": 316
+    },
+    {
+      "epoch": 0.5821854912764004,
+      "grad_norm": 0.2241576449726403,
+      "learning_rate": 9.59366570976528e-06,
+      "loss": 1.5591,
+      "step": 317
+    },
+    {
+      "epoch": 0.5840220385674931,
+      "grad_norm": 0.23221143989290613,
+      "learning_rate": 9.590756835643613e-06,
+      "loss": 1.7365,
+      "step": 318
+    },
+    {
+      "epoch": 0.5858585858585859,
+      "grad_norm": 0.22260605020813307,
+      "learning_rate": 9.587838030785413e-06,
+      "loss": 1.5891,
+      "step": 319
+    },
+    {
+      "epoch": 0.5876951331496786,
+      "grad_norm": 0.24074123539891878,
+      "learning_rate": 9.584909301504649e-06,
+      "loss": 1.6429,
+      "step": 320
+    },
+    {
+      "epoch": 0.5895316804407713,
+      "grad_norm": 0.24999236076625003,
+      "learning_rate": 9.581970654136752e-06,
+      "loss": 1.4635,
+      "step": 321
+    },
+    {
+      "epoch": 0.5913682277318641,
+      "grad_norm": 0.24138213962275842,
+      "learning_rate": 9.579022095038614e-06,
+      "loss": 1.4685,
+      "step": 322
+    },
+    {
+      "epoch": 0.5932047750229569,
+      "grad_norm": 0.23761063303866614,
+      "learning_rate": 9.576063630588563e-06,
+      "loss": 1.502,
+      "step": 323
+    },
+    {
+      "epoch": 0.5950413223140496,
+      "grad_norm": 0.23598358847125375,
+      "learning_rate": 9.573095267186361e-06,
+      "loss": 1.515,
+      "step": 324
+    },
+    {
+      "epoch": 0.5968778696051423,
+      "grad_norm": 0.22832909205335236,
+      "learning_rate": 9.570117011253173e-06,
+      "loss": 1.4807,
+      "step": 325
+    },
+    {
+      "epoch": 0.5987144168962351,
+      "grad_norm": 0.24117133297678936,
+      "learning_rate": 9.567128869231575e-06,
+      "loss": 1.5613,
+      "step": 326
+    },
+    {
+      "epoch": 0.6005509641873278,
+      "grad_norm": 0.3736566093680088,
+      "learning_rate": 9.56413084758552e-06,
+      "loss": 1.5542,
+      "step": 327
+    },
+    {
+      "epoch": 0.6023875114784206,
+      "grad_norm": 0.21663673460406355,
+      "learning_rate": 9.561122952800336e-06,
+      "loss": 1.7194,
+      "step": 328
+    },
+    {
+      "epoch": 0.6042240587695134,
+      "grad_norm": 0.2125100847818667,
+      "learning_rate": 9.55810519138271e-06,
+      "loss": 1.8111,
+      "step": 329
+    },
+    {
+      "epoch": 0.6060606060606061,
+      "grad_norm": 0.23381422950443456,
+      "learning_rate": 9.55507756986067e-06,
+      "loss": 1.461,
+      "step": 330
+    },
+    {
+      "epoch": 0.6078971533516988,
+      "grad_norm": 0.2977798664197012,
+      "learning_rate": 9.552040094783575e-06,
+      "loss": 1.5266,
+      "step": 331
+    },
+    {
+      "epoch": 0.6097337006427915,
+      "grad_norm": 0.2219906624573214,
+      "learning_rate": 9.548992772722097e-06,
+      "loss": 1.5105,
+      "step": 332
+    },
+    {
+      "epoch": 0.6115702479338843,
+      "grad_norm": 0.25219046567315495,
+      "learning_rate": 9.545935610268213e-06,
+      "loss": 1.5179,
+      "step": 333
+    },
+    {
+      "epoch": 0.6134067952249771,
+      "grad_norm": 0.22072558243113488,
+      "learning_rate": 9.542868614035182e-06,
+      "loss": 1.587,
+      "step": 334
+    },
+    {
+      "epoch": 0.6152433425160698,
+      "grad_norm": 0.291264791118564,
+      "learning_rate": 9.53979179065754e-06,
+      "loss": 1.6009,
+      "step": 335
+    },
+    {
+      "epoch": 0.6170798898071626,
+      "grad_norm": 0.27555767370579204,
+      "learning_rate": 9.536705146791076e-06,
+      "loss": 1.4902,
+      "step": 336
+    },
+    {
+      "epoch": 0.6189164370982553,
+      "grad_norm": 0.3560500138536834,
+      "learning_rate": 9.533608689112827e-06,
+      "loss": 1.4053,
+      "step": 337
+    },
+    {
+      "epoch": 0.620752984389348,
+      "grad_norm": 0.22581426937660223,
+      "learning_rate": 9.530502424321062e-06,
+      "loss": 1.3816,
+      "step": 338
+    },
+    {
+      "epoch": 0.6225895316804407,
+      "grad_norm": 0.22611206052943753,
+      "learning_rate": 9.527386359135254e-06,
+      "loss": 1.4149,
+      "step": 339
+    },
+    {
+      "epoch": 0.6244260789715336,
+      "grad_norm": 0.25279806678865613,
+      "learning_rate": 9.524260500296087e-06,
+      "loss": 1.6033,
+      "step": 340
+    },
+    {
+      "epoch": 0.6262626262626263,
+      "grad_norm": 0.27657948317697195,
+      "learning_rate": 9.521124854565425e-06,
+      "loss": 1.6497,
+      "step": 341
+    },
+    {
+      "epoch": 0.628099173553719,
+      "grad_norm": 0.27642525359962034,
+      "learning_rate": 9.517979428726306e-06,
+      "loss": 1.9425,
+      "step": 342
+    },
+    {
+      "epoch": 0.6299357208448118,
+      "grad_norm": 0.24498751269775337,
+      "learning_rate": 9.514824229582922e-06,
+      "loss": 1.5756,
+      "step": 343
+    },
+    {
+      "epoch": 0.6317722681359045,
+      "grad_norm": 0.23199154562408514,
+      "learning_rate": 9.511659263960607e-06,
+      "loss": 1.7103,
+      "step": 344
+    },
+    {
+      "epoch": 0.6336088154269972,
+      "grad_norm": 0.24499400426596973,
+      "learning_rate": 9.508484538705823e-06,
+      "loss": 1.7538,
+      "step": 345
+    },
+    {
+      "epoch": 0.63544536271809,
+      "grad_norm": 0.2507783598400131,
+      "learning_rate": 9.505300060686145e-06,
+      "loss": 1.6243,
+      "step": 346
+    },
+    {
+      "epoch": 0.6372819100091828,
+      "grad_norm": 0.3348756652505991,
+      "learning_rate": 9.50210583679024e-06,
+      "loss": 1.5188,
+      "step": 347
+    },
+    {
+      "epoch": 0.6391184573002755,
+      "grad_norm": 0.24441005383223785,
+      "learning_rate": 9.498901873927865e-06,
+      "loss": 1.4454,
+      "step": 348
+    },
+    {
+      "epoch": 0.6409550045913682,
+      "grad_norm": 0.2507000333701989,
+      "learning_rate": 9.495688179029838e-06,
+      "loss": 1.6245,
+      "step": 349
+    },
+    {
+      "epoch": 0.642791551882461,
+      "grad_norm": 0.24754540410863546,
+      "learning_rate": 9.492464759048033e-06,
+      "loss": 1.4104,
+      "step": 350
+    },
+    {
+      "epoch": 0.6446280991735537,
+      "grad_norm": 0.26737000313540454,
+      "learning_rate": 9.48923162095536e-06,
+      "loss": 1.6173,
+      "step": 351
+    },
+    {
+      "epoch": 0.6464646464646465,
+      "grad_norm": 0.2582858797490392,
+      "learning_rate": 9.48598877174575e-06,
+      "loss": 1.5501,
+      "step": 352
+    },
+    {
+      "epoch": 0.6483011937557392,
+      "grad_norm": 0.23212846839574947,
+      "learning_rate": 9.482736218434144e-06,
+      "loss": 1.5724,
+      "step": 353
+    },
+    {
+      "epoch": 0.650137741046832,
+      "grad_norm": 0.23218434605900706,
+      "learning_rate": 9.479473968056472e-06,
+      "loss": 1.4088,
+      "step": 354
+    },
+    {
+      "epoch": 0.6519742883379247,
+      "grad_norm": 0.2578729569151409,
+      "learning_rate": 9.476202027669644e-06,
+      "loss": 1.4826,
+      "step": 355
+    },
+    {
+      "epoch": 0.6538108356290174,
+      "grad_norm": 0.2154021538644954,
+      "learning_rate": 9.472920404351527e-06,
+      "loss": 1.3663,
+      "step": 356
+    },
+    {
+      "epoch": 0.6556473829201102,
+      "grad_norm": 0.27334033545305675,
+      "learning_rate": 9.469629105200937e-06,
+      "loss": 1.6778,
+      "step": 357
+    },
+    {
+      "epoch": 0.657483930211203,
+      "grad_norm": 0.29665620542669136,
+      "learning_rate": 9.466328137337623e-06,
+      "loss": 1.6483,
+      "step": 358
+    },
+    {
+      "epoch": 0.6593204775022957,
+      "grad_norm": 0.25732766746595215,
+      "learning_rate": 9.463017507902245e-06,
+      "loss": 1.6422,
+      "step": 359
+    },
+    {
+      "epoch": 0.6611570247933884,
+      "grad_norm": 0.22608595687187208,
+      "learning_rate": 9.459697224056364e-06,
+      "loss": 1.4751,
+      "step": 360
+    },
+    {
+      "epoch": 0.6629935720844812,
+      "grad_norm": 0.24483796123632973,
+      "learning_rate": 9.45636729298243e-06,
+      "loss": 1.6614,
+      "step": 361
+    },
+    {
+      "epoch": 0.6648301193755739,
+      "grad_norm": 0.21225379478527837,
+      "learning_rate": 9.453027721883751e-06,
+      "loss": 1.7302,
+      "step": 362
+    },
+    {
+      "epoch": 0.6666666666666666,
+      "grad_norm": 0.26429778829676437,
+      "learning_rate": 9.449678517984503e-06,
+      "loss": 1.7002,
+      "step": 363
+    },
+    {
+      "epoch": 0.6685032139577594,
+      "grad_norm": 0.26129846226407893,
+      "learning_rate": 9.446319688529688e-06,
+      "loss": 1.505,
+      "step": 364
+    },
+    {
+      "epoch": 0.6703397612488522,
+      "grad_norm": 0.24293627375696744,
+      "learning_rate": 9.442951240785135e-06,
+      "loss": 1.616,
+      "step": 365
+    },
+    {
+      "epoch": 0.6721763085399449,
+      "grad_norm": 0.2631927129942196,
+      "learning_rate": 9.439573182037478e-06,
+      "loss": 1.6593,
+      "step": 366
+    },
+    {
+      "epoch": 0.6740128558310376,
+      "grad_norm": 0.2512323899150732,
+      "learning_rate": 9.436185519594145e-06,
+      "loss": 1.5735,
+      "step": 367
+    },
+    {
+      "epoch": 0.6758494031221304,
+      "grad_norm": 0.5854956658746846,
+      "learning_rate": 9.432788260783333e-06,
+      "loss": 1.5307,
+      "step": 368
+    },
+    {
+      "epoch": 0.6776859504132231,
+      "grad_norm": 0.2532527127845924,
+      "learning_rate": 9.429381412954e-06,
+      "loss": 1.3514,
+      "step": 369
+    },
+    {
+      "epoch": 0.6795224977043158,
+      "grad_norm": 0.22892141489196347,
+      "learning_rate": 9.425964983475848e-06,
+      "loss": 1.5846,
+      "step": 370
+    },
+    {
+      "epoch": 0.6813590449954087,
+      "grad_norm": 0.3092853890062792,
+      "learning_rate": 9.422538979739307e-06,
+      "loss": 1.2921,
+      "step": 371
+    },
+    {
+      "epoch": 0.6831955922865014,
+      "grad_norm": 0.25717541532306365,
+      "learning_rate": 9.419103409155517e-06,
+      "loss": 1.5299,
+      "step": 372
+    },
+    {
+      "epoch": 0.6850321395775941,
+      "grad_norm": 0.2554573529209432,
+      "learning_rate": 9.415658279156312e-06,
+      "loss": 1.6284,
+      "step": 373
+    },
+    {
+      "epoch": 0.6868686868686869,
+      "grad_norm": 0.2720753683925479,
+      "learning_rate": 9.412203597194204e-06,
+      "loss": 1.4538,
+      "step": 374
+    },
+    {
+      "epoch": 0.6887052341597796,
+      "grad_norm": 0.25694738444316845,
+      "learning_rate": 9.408739370742372e-06,
+      "loss": 1.6709,
+      "step": 375
+    },
+    {
+      "epoch": 0.6905417814508723,
+      "grad_norm": 0.23142193114218948,
+      "learning_rate": 9.405265607294638e-06,
+      "loss": 1.5729,
+      "step": 376
+    },
+    {
+      "epoch": 0.6923783287419651,
+      "grad_norm": 0.6276509400617444,
+      "learning_rate": 9.401782314365458e-06,
+      "loss": 1.4751,
+      "step": 377
+    },
+    {
+      "epoch": 0.6942148760330579,
+      "grad_norm": 0.23891845253084326,
+      "learning_rate": 9.398289499489897e-06,
+      "loss": 1.7754,
+      "step": 378
+    },
+    {
+      "epoch": 0.6960514233241506,
+      "grad_norm": 0.21871931719886073,
+      "learning_rate": 9.39478717022362e-06,
+      "loss": 1.4614,
+      "step": 379
+    },
+    {
+      "epoch": 0.6978879706152433,
+      "grad_norm": 0.26099154202292374,
+      "learning_rate": 9.391275334142879e-06,
+      "loss": 1.4168,
+      "step": 380
+    },
+    {
+      "epoch": 0.699724517906336,
+      "grad_norm": 0.2354655594620819,
+      "learning_rate": 9.387753998844482e-06,
+      "loss": 1.6517,
+      "step": 381
+    },
+    {
+      "epoch": 0.7015610651974288,
+      "grad_norm": 0.39436529660636566,
+      "learning_rate": 9.384223171945793e-06,
+      "loss": 1.5878,
+      "step": 382
+    },
+    {
+      "epoch": 0.7033976124885216,
+      "grad_norm": 0.253934593084282,
+      "learning_rate": 9.380682861084703e-06,
+      "loss": 1.4456,
+      "step": 383
+    },
+    {
+      "epoch": 0.7052341597796143,
+      "grad_norm": 0.275985389911898,
+      "learning_rate": 9.377133073919622e-06,
+      "loss": 1.4548,
+      "step": 384
+    },
+    {
+      "epoch": 0.7070707070707071,
+      "grad_norm": 0.274347449615472,
+      "learning_rate": 9.37357381812946e-06,
+      "loss": 1.4328,
+      "step": 385
+    },
+    {
+      "epoch": 0.7089072543617998,
+      "grad_norm": 0.23606491033625135,
+      "learning_rate": 9.370005101413605e-06,
+      "loss": 1.418,
+      "step": 386
+    },
+    {
+      "epoch": 0.7107438016528925,
+      "grad_norm": 0.31465431130895255,
+      "learning_rate": 9.366426931491917e-06,
+      "loss": 1.5906,
+      "step": 387
+    },
+    {
+      "epoch": 0.7125803489439853,
+      "grad_norm": 0.34193996513257946,
+      "learning_rate": 9.362839316104701e-06,
+      "loss": 1.5417,
+      "step": 388
+    },
+    {
+      "epoch": 0.7144168962350781,
+      "grad_norm": 0.22556493806007524,
+      "learning_rate": 9.359242263012693e-06,
+      "loss": 1.7724,
+      "step": 389
+    },
+    {
+      "epoch": 0.7162534435261708,
+      "grad_norm": 0.2680416851368413,
+      "learning_rate": 9.355635779997052e-06,
+      "loss": 1.6457,
+      "step": 390
+    },
+    {
+      "epoch": 0.7180899908172635,
+      "grad_norm": 0.24689515414196325,
+      "learning_rate": 9.352019874859326e-06,
+      "loss": 1.568,
+      "step": 391
+    },
+    {
+      "epoch": 0.7199265381083563,
+      "grad_norm": 0.21347041125386362,
+      "learning_rate": 9.348394555421454e-06,
+      "loss": 1.7583,
+      "step": 392
+    },
+    {
+      "epoch": 0.721763085399449,
+      "grad_norm": 0.46467653443410706,
+      "learning_rate": 9.344759829525734e-06,
+      "loss": 1.5016,
+      "step": 393
+    },
+    {
+      "epoch": 0.7235996326905417,
+      "grad_norm": 0.23251022201282956,
+      "learning_rate": 9.341115705034813e-06,
+      "loss": 1.4531,
+      "step": 394
+    },
+    {
+      "epoch": 0.7254361799816346,
+      "grad_norm": 0.2635599798354954,
+      "learning_rate": 9.33746218983167e-06,
+      "loss": 1.6209,
+      "step": 395
+    },
+    {
+      "epoch": 0.7272727272727273,
+      "grad_norm": 0.274528346084071,
+      "learning_rate": 9.3337992918196e-06,
+      "loss": 1.423,
+      "step": 396
+    },
+    {
+      "epoch": 0.72910927456382,
+      "grad_norm": 0.22452326304098907,
+      "learning_rate": 9.330127018922195e-06,
+      "loss": 1.6043,
+      "step": 397
+    },
+    {
+      "epoch": 0.7309458218549127,
+      "grad_norm": 0.23441816537644192,
+      "learning_rate": 9.32644537908332e-06,
+      "loss": 1.3519,
+      "step": 398
+    },
+    {
+      "epoch": 0.7327823691460055,
+      "grad_norm": 0.23890498709588182,
+      "learning_rate": 9.32275438026711e-06,
+      "loss": 1.5404,
+      "step": 399
+    },
+    {
+      "epoch": 0.7346189164370982,
+      "grad_norm": 0.21291317553932287,
+      "learning_rate": 9.31905403045794e-06,
+      "loss": 1.5691,
+      "step": 400
+    },
+    {
+      "epoch": 0.736455463728191,
+      "grad_norm": 0.22613473470643639,
+      "learning_rate": 9.315344337660422e-06,
+      "loss": 1.4559,
+      "step": 401
+    },
+    {
+      "epoch": 0.7382920110192838,
+      "grad_norm": 0.23269103930259752,
+      "learning_rate": 9.311625309899366e-06,
+      "loss": 1.3702,
+      "step": 402
+    },
+    {
+      "epoch": 0.7401285583103765,
+      "grad_norm": 0.20796226054959077,
+      "learning_rate": 9.307896955219787e-06,
+      "loss": 1.4569,
+      "step": 403
+    },
+    {
+      "epoch": 0.7419651056014692,
+      "grad_norm": 0.23674950969933053,
+      "learning_rate": 9.304159281686867e-06,
+      "loss": 1.5614,
+      "step": 404
+    },
+    {
+      "epoch": 0.743801652892562,
+      "grad_norm": 0.2166339431037937,
+      "learning_rate": 9.300412297385954e-06,
+      "loss": 1.5903,
+      "step": 405
+    },
+    {
+      "epoch": 0.7456382001836547,
+      "grad_norm": 0.376582090077921,
+      "learning_rate": 9.296656010422532e-06,
+      "loss": 1.5696,
+      "step": 406
+    },
+    {
+      "epoch": 0.7474747474747475,
+      "grad_norm": 0.2507106267047962,
+      "learning_rate": 9.29289042892221e-06,
+      "loss": 1.4167,
+      "step": 407
+    },
+    {
+      "epoch": 0.7493112947658402,
+      "grad_norm": 0.21978547524853728,
+      "learning_rate": 9.289115561030704e-06,
+      "loss": 1.6598,
+      "step": 408
+    },
+    {
+      "epoch": 0.7493112947658402,
+      "eval_loss": 2.3061842918395996,
+      "eval_runtime": 40.5501,
+      "eval_samples_per_second": 5.055,
+      "eval_steps_per_second": 0.444,
+      "step": 408
+    },
+    {
+      "epoch": 0.751147842056933,
+      "grad_norm": 0.2335920969105023,
+      "learning_rate": 9.285331414913816e-06,
+      "loss": 1.4038,
+      "step": 409
+    },
+    {
+      "epoch": 0.7529843893480257,
+      "grad_norm": 0.28229727560433654,
+      "learning_rate": 9.281537998757421e-06,
+      "loss": 1.3303,
+      "step": 410
+    },
+    {
+      "epoch": 0.7548209366391184,
+      "grad_norm": 0.23757995428362888,
+      "learning_rate": 9.277735320767449e-06,
+      "loss": 1.3841,
+      "step": 411
+    },
+    {
+      "epoch": 0.7566574839302111,
+      "grad_norm": 0.24758854422732826,
+      "learning_rate": 9.27392338916986e-06,
+      "loss": 1.624,
+      "step": 412
+    },
+    {
+      "epoch": 0.758494031221304,
+      "grad_norm": 0.2627291719598822,
+      "learning_rate": 9.270102212210632e-06,
+      "loss": 1.7343,
+      "step": 413
+    },
+    {
+      "epoch": 0.7603305785123967,
+      "grad_norm": 0.29750352907343186,
+      "learning_rate": 9.266271798155748e-06,
+      "loss": 1.6209,
+      "step": 414
+    },
+    {
+      "epoch": 0.7621671258034894,
+      "grad_norm": 0.23822029512893117,
+      "learning_rate": 9.262432155291167e-06,
+      "loss": 1.513,
+      "step": 415
+    },
+    {
+      "epoch": 0.7640036730945822,
+      "grad_norm": 0.21093681279730364,
+      "learning_rate": 9.258583291922814e-06,
+      "loss": 1.5292,
+      "step": 416
+    },
+    {
+      "epoch": 0.7658402203856749,
+      "grad_norm": 0.26293015719040297,
+      "learning_rate": 9.254725216376562e-06,
+      "loss": 1.5138,
+      "step": 417
+    },
+    {
+      "epoch": 0.7676767676767676,
+      "grad_norm": 0.23385317706303402,
+      "learning_rate": 9.250857936998206e-06,
+      "loss": 1.3565,
+      "step": 418
+    },
+    {
+      "epoch": 0.7695133149678605,
+      "grad_norm": 0.38700660904810047,
+      "learning_rate": 9.246981462153456e-06,
+      "loss": 1.4129,
+      "step": 419
+    },
+    {
+      "epoch": 0.7713498622589532,
+      "grad_norm": 0.22885668314514052,
+      "learning_rate": 9.243095800227913e-06,
+      "loss": 1.7462,
+      "step": 420
+    },
+    {
+      "epoch": 0.7731864095500459,
+      "grad_norm": 0.21379597965346503,
+      "learning_rate": 9.239200959627048e-06,
+      "loss": 1.6085,
+      "step": 421
+    },
+    {
+      "epoch": 0.7750229568411386,
+      "grad_norm": 0.22354309327698976,
+      "learning_rate": 9.235296948776194e-06,
+      "loss": 1.6027,
+      "step": 422
+    },
+    {
+      "epoch": 0.7768595041322314,
+      "grad_norm": 0.33114539095121254,
+      "learning_rate": 9.231383776120512e-06,
+      "loss": 1.5652,
+      "step": 423
+    },
+    {
+      "epoch": 0.7786960514233241,
+      "grad_norm": 0.2628333136775673,
+      "learning_rate": 9.22746145012499e-06,
+      "loss": 1.4293,
+      "step": 424
+    },
+    {
+      "epoch": 0.7805325987144169,
+      "grad_norm": 0.2512363336874892,
+      "learning_rate": 9.223529979274411e-06,
+      "loss": 1.6437,
+      "step": 425
+    },
+    {
+      "epoch": 0.7823691460055097,
+      "grad_norm": 0.2375037995789399,
+      "learning_rate": 9.219589372073344e-06,
+      "loss": 1.6051,
+      "step": 426
+    },
+    {
+      "epoch": 0.7842056932966024,
+      "grad_norm": 0.3071445167943931,
+      "learning_rate": 9.215639637046121e-06,
+      "loss": 1.4219,
+      "step": 427
+    },
+    {
+      "epoch": 0.7860422405876951,
+      "grad_norm": 0.22189183823448244,
+      "learning_rate": 9.211680782736818e-06,
+      "loss": 1.4985,
+      "step": 428
+    },
+    {
+      "epoch": 0.7878787878787878,
+      "grad_norm": 0.25580090731799854,
+      "learning_rate": 9.207712817709237e-06,
+      "loss": 1.4033,
+      "step": 429
+    },
+    {
+      "epoch": 0.7897153351698806,
+      "grad_norm": 0.24812653746151964,
+      "learning_rate": 9.203735750546891e-06,
+      "loss": 1.3742,
+      "step": 430
+    },
+    {
+      "epoch": 0.7915518824609734,
+      "grad_norm": 0.24863294067441372,
+      "learning_rate": 9.19974958985298e-06,
+      "loss": 1.5571,
+      "step": 431
+    },
+    {
+      "epoch": 0.7933884297520661,
+      "grad_norm": 0.2836367707982348,
+      "learning_rate": 9.19575434425038e-06,
+      "loss": 1.6326,
+      "step": 432
+    },
+    {
+      "epoch": 0.7952249770431589,
+      "grad_norm": 0.22384740224875363,
+      "learning_rate": 9.191750022381613e-06,
+      "loss": 1.4628,
+      "step": 433
+    },
+    {
+      "epoch": 0.7970615243342516,
+      "grad_norm": 0.2250518915942832,
+      "learning_rate": 9.18773663290884e-06,
+      "loss": 1.5826,
+      "step": 434
+    },
+    {
+      "epoch": 0.7988980716253443,
+      "grad_norm": 0.2439126131273036,
+      "learning_rate": 9.183714184513832e-06,
+      "loss": 1.603,
+      "step": 435
+    },
+    {
+      "epoch": 0.800734618916437,
+      "grad_norm": 0.24495825317270972,
+      "learning_rate": 9.179682685897963e-06,
+      "loss": 1.469,
+      "step": 436
+    },
+    {
+      "epoch": 0.8025711662075299,
+      "grad_norm": 0.21768361761008279,
+      "learning_rate": 9.175642145782179e-06,
+      "loss": 1.4976,
+      "step": 437
+    },
+    {
+      "epoch": 0.8044077134986226,
+      "grad_norm": 0.26701765806787003,
+      "learning_rate": 9.171592572906985e-06,
+      "loss": 1.5952,
+      "step": 438
+    },
+    {
+      "epoch": 0.8062442607897153,
+      "grad_norm": 0.21065992974075412,
+      "learning_rate": 9.16753397603243e-06,
+      "loss": 1.5322,
+      "step": 439
+    },
+    {
+      "epoch": 0.8080808080808081,
+      "grad_norm": 0.27599402518484223,
+      "learning_rate": 9.16346636393808e-06,
+      "loss": 1.3606,
+      "step": 440
+    },
+    {
+      "epoch": 0.8099173553719008,
+      "grad_norm": 0.3021312730547759,
+      "learning_rate": 9.159389745423003e-06,
+      "loss": 1.584,
+      "step": 441
+    },
+    {
+      "epoch": 0.8117539026629935,
+      "grad_norm": 0.21998110932041243,
+      "learning_rate": 9.155304129305749e-06,
+      "loss": 1.4583,
+      "step": 442
+    },
+    {
+      "epoch": 0.8135904499540864,
+      "grad_norm": 0.2329768737772725,
+      "learning_rate": 9.151209524424333e-06,
+      "loss": 1.4508,
+      "step": 443
+    },
+    {
+      "epoch": 0.8154269972451791,
+      "grad_norm": 0.2578363729671407,
+      "learning_rate": 9.147105939636216e-06,
+      "loss": 1.5392,
+      "step": 444
+    },
+    {
+      "epoch": 0.8172635445362718,
+      "grad_norm": 0.2365004570955238,
+      "learning_rate": 9.142993383818284e-06,
+      "loss": 1.632,
+      "step": 445
+    },
+    {
+      "epoch": 0.8191000918273645,
+      "grad_norm": 0.21742880728132308,
+      "learning_rate": 9.138871865866824e-06,
+      "loss": 1.3645,
+      "step": 446
+    },
+    {
+      "epoch": 0.8209366391184573,
+      "grad_norm": 0.23059966917774738,
+      "learning_rate": 9.134741394697517e-06,
+      "loss": 1.3386,
+      "step": 447
+    },
+    {
+      "epoch": 0.82277318640955,
+      "grad_norm": 0.24309425578366148,
+      "learning_rate": 9.130601979245407e-06,
+      "loss": 1.38,
+      "step": 448
+    },
+    {
+      "epoch": 0.8246097337006428,
+      "grad_norm": 0.21478191767990237,
+      "learning_rate": 9.126453628464889e-06,
+      "loss": 1.76,
+      "step": 449
+    },
+    {
+      "epoch": 0.8264462809917356,
+      "grad_norm": 0.25682509893819777,
+      "learning_rate": 9.122296351329683e-06,
+      "loss": 1.4405,
+      "step": 450
+    },
+    {
+      "epoch": 0.8282828282828283,
+      "grad_norm": 0.23365435124291448,
+      "learning_rate": 9.118130156832823e-06,
+      "loss": 1.4337,
+      "step": 451
+    },
+    {
+      "epoch": 0.830119375573921,
+      "grad_norm": 0.2415984482071214,
+      "learning_rate": 9.113955053986632e-06,
+      "loss": 1.6131,
+      "step": 452
+    },
+    {
+      "epoch": 0.8319559228650137,
+      "grad_norm": 0.26943745232610666,
+      "learning_rate": 9.109771051822702e-06,
+      "loss": 1.4698,
+      "step": 453
+    },
+    {
+      "epoch": 0.8337924701561065,
+      "grad_norm": 0.2074005721654442,
+      "learning_rate": 9.105578159391876e-06,
+      "loss": 1.5938,
+      "step": 454
+    },
+    {
+      "epoch": 0.8356290174471993,
+      "grad_norm": 0.21993568441683473,
+      "learning_rate": 9.10137638576423e-06,
+      "loss": 1.4473,
+      "step": 455
+    },
+    {
+      "epoch": 0.837465564738292,
+      "grad_norm": 0.2225235136645375,
+      "learning_rate": 9.097165740029053e-06,
+      "loss": 1.7787,
+      "step": 456
+    },
+    {
+      "epoch": 0.8393021120293848,
+      "grad_norm": 0.22980927731633988,
+      "learning_rate": 9.09294623129482e-06,
+      "loss": 1.5131,
+      "step": 457
+    },
+    {
+      "epoch": 0.8411386593204775,
+      "grad_norm": 0.525766821192798,
+      "learning_rate": 9.088717868689186e-06,
+      "loss": 1.5409,
+      "step": 458
+    },
+    {
+      "epoch": 0.8429752066115702,
+      "grad_norm": 0.2263260760581893,
+      "learning_rate": 9.084480661358954e-06,
+      "loss": 1.5803,
+      "step": 459
+    },
+    {
+      "epoch": 0.8448117539026629,
+      "grad_norm": 0.24950337121155466,
+      "learning_rate": 9.080234618470063e-06,
+      "loss": 1.7144,
+      "step": 460
+    },
+    {
+      "epoch": 0.8466483011937558,
+      "grad_norm": 0.21067429427962073,
+      "learning_rate": 9.07597974920756e-06,
+      "loss": 1.662,
+      "step": 461
+    },
+    {
+      "epoch": 0.8484848484848485,
+      "grad_norm": 0.2308216794274888,
+      "learning_rate": 9.071716062775592e-06,
+      "loss": 1.5284,
+      "step": 462
+    },
+    {
+      "epoch": 0.8503213957759412,
+      "grad_norm": 0.25595362098568153,
+      "learning_rate": 9.067443568397378e-06,
+      "loss": 1.7066,
+      "step": 463
+    },
+    {
+      "epoch": 0.852157943067034,
+      "grad_norm": 0.2892000674805998,
+      "learning_rate": 9.063162275315182e-06,
+      "loss": 1.559,
+      "step": 464
+    },
+    {
+      "epoch": 0.8539944903581267,
+      "grad_norm": 0.28340515745622036,
+      "learning_rate": 9.058872192790314e-06,
+      "loss": 1.4001,
+      "step": 465
+    },
+    {
+      "epoch": 0.8558310376492194,
+      "grad_norm": 0.2294106234149869,
+      "learning_rate": 9.054573330103087e-06,
+      "loss": 1.4574,
+      "step": 466
+    },
+    {
+      "epoch": 0.8576675849403123,
+      "grad_norm": 0.24497945362812937,
+      "learning_rate": 9.05026569655281e-06,
+      "loss": 1.5943,
+      "step": 467
+    },
+    {
+      "epoch": 0.859504132231405,
+      "grad_norm": 0.253470755772231,
+      "learning_rate": 9.045949301457774e-06,
+      "loss": 1.5505,
+      "step": 468
+    },
+    {
+      "epoch": 0.8613406795224977,
+      "grad_norm": 0.2492429347432005,
+      "learning_rate": 9.041624154155208e-06,
+      "loss": 1.5801,
+      "step": 469
+    },
+    {
+      "epoch": 0.8631772268135904,
+      "grad_norm": 0.26092005188633716,
+      "learning_rate": 9.037290264001286e-06,
+      "loss": 1.6384,
+      "step": 470
+    },
+    {
+      "epoch": 0.8650137741046832,
+      "grad_norm": 0.22072784533883108,
+      "learning_rate": 9.032947640371086e-06,
+      "loss": 1.6069,
+      "step": 471
+    },
+    {
+      "epoch": 0.8668503213957759,
+      "grad_norm": 0.22398684213158268,
+      "learning_rate": 9.028596292658585e-06,
+      "loss": 1.5495,
+      "step": 472
+    },
+    {
+      "epoch": 0.8686868686868687,
+      "grad_norm": 0.2027554437403566,
+      "learning_rate": 9.02423623027663e-06,
+      "loss": 1.5387,
+      "step": 473
+    },
+    {
+      "epoch": 0.8705234159779615,
+      "grad_norm": 0.23717640601226908,
+      "learning_rate": 9.019867462656915e-06,
+      "loss": 1.5579,
+      "step": 474
+    },
+    {
+      "epoch": 0.8723599632690542,
+      "grad_norm": 0.22501657795548555,
+      "learning_rate": 9.01548999924997e-06,
+      "loss": 1.3586,
+      "step": 475
+    },
+    {
+      "epoch": 0.8741965105601469,
+      "grad_norm": 0.21644485895311025,
+      "learning_rate": 9.011103849525139e-06,
+      "loss": 1.8106,
+      "step": 476
+    },
+    {
+      "epoch": 0.8760330578512396,
+      "grad_norm": 0.45331532023795523,
+      "learning_rate": 9.006709022970547e-06,
+      "loss": 1.5949,
+      "step": 477
+    },
+    {
+      "epoch": 0.8778696051423324,
+      "grad_norm": 0.2651826534678187,
+      "learning_rate": 9.002305529093095e-06,
+      "loss": 1.1691,
+      "step": 478
+    },
+    {
+      "epoch": 0.8797061524334252,
+      "grad_norm": 0.2676840437065319,
+      "learning_rate": 8.997893377418432e-06,
+      "loss": 1.4198,
+      "step": 479
+    },
+    {
+      "epoch": 0.8815426997245179,
+      "grad_norm": 0.2308528854306592,
+      "learning_rate": 8.993472577490936e-06,
+      "loss": 1.4812,
+      "step": 480
+    },
+    {
+      "epoch": 0.8833792470156107,
+      "grad_norm": 0.20636713087022784,
+      "learning_rate": 8.98904313887369e-06,
+      "loss": 1.6178,
+      "step": 481
+    },
+    {
+      "epoch": 0.8852157943067034,
+      "grad_norm": 0.29618906487535407,
+      "learning_rate": 8.984605071148471e-06,
+      "loss": 1.5748,
+      "step": 482
+    },
+    {
+      "epoch": 0.8870523415977961,
+      "grad_norm": 0.24284044940826433,
+      "learning_rate": 8.980158383915714e-06,
+      "loss": 1.7419,
+      "step": 483
+    },
+    {
+      "epoch": 0.8888888888888888,
+      "grad_norm": 0.22881808189787375,
+      "learning_rate": 8.975703086794505e-06,
+      "loss": 1.4035,
+      "step": 484
+    },
+    {
+      "epoch": 0.8907254361799817,
+      "grad_norm": 0.5882914193304096,
+      "learning_rate": 8.971239189422555e-06,
+      "loss": 1.5501,
+      "step": 485
+    },
+    {
+      "epoch": 0.8925619834710744,
+      "grad_norm": 0.23820272367736536,
+      "learning_rate": 8.966766701456177e-06,
+      "loss": 1.5487,
+      "step": 486
+    },
+    {
+      "epoch": 0.8943985307621671,
+      "grad_norm": 0.22512062456776769,
+      "learning_rate": 8.962285632570266e-06,
+      "loss": 1.7015,
+      "step": 487
+    },
+    {
+      "epoch": 0.8962350780532599,
+      "grad_norm": 0.22468181674999985,
+      "learning_rate": 8.957795992458285e-06,
+      "loss": 1.379,
+      "step": 488
+    },
+    {
+      "epoch": 0.8980716253443526,
+      "grad_norm": 0.24683192515184557,
+      "learning_rate": 8.953297790832231e-06,
+      "loss": 1.5196,
+      "step": 489
+    },
+    {
+      "epoch": 0.8999081726354453,
+      "grad_norm": 0.24472352067207945,
+      "learning_rate": 8.948791037422629e-06,
+      "loss": 1.5634,
+      "step": 490
+    },
+    {
+      "epoch": 0.9017447199265382,
+      "grad_norm": 0.23757734063602157,
+      "learning_rate": 8.944275741978495e-06,
+      "loss": 1.6768,
+      "step": 491
+    },
+    {
+      "epoch": 0.9035812672176309,
+      "grad_norm": 0.23765942801452902,
+      "learning_rate": 8.939751914267329e-06,
+      "loss": 1.4796,
+      "step": 492
+    },
+    {
+      "epoch": 0.9054178145087236,
+      "grad_norm": 0.2493616211295045,
+      "learning_rate": 8.935219564075087e-06,
+      "loss": 1.7449,
+      "step": 493
+    },
+    {
+      "epoch": 0.9072543617998163,
+      "grad_norm": 0.21740219428376328,
+      "learning_rate": 8.93067870120616e-06,
+      "loss": 1.4374,
+      "step": 494
+    },
+    {
+      "epoch": 0.9090909090909091,
+      "grad_norm": 0.2482842265282672,
+      "learning_rate": 8.92612933548335e-06,
+      "loss": 1.7847,
+      "step": 495
+    },
+    {
+      "epoch": 0.9109274563820018,
+      "grad_norm": 0.19968002281932487,
+      "learning_rate": 8.921571476747861e-06,
+      "loss": 1.6578,
+      "step": 496
+    },
+    {
+      "epoch": 0.9127640036730946,
+      "grad_norm": 0.23718063305783535,
+      "learning_rate": 8.917005134859263e-06,
+      "loss": 1.478,
+      "step": 497
+    },
+    {
+      "epoch": 0.9146005509641874,
+      "grad_norm": 0.2472130753216968,
+      "learning_rate": 8.912430319695478e-06,
+      "loss": 1.5453,
+      "step": 498
+    },
+    {
+      "epoch": 0.9164370982552801,
+      "grad_norm": 0.24331817867045824,
+      "learning_rate": 8.907847041152757e-06,
+      "loss": 1.5475,
+      "step": 499
+    },
+    {
+      "epoch": 0.9182736455463728,
+      "grad_norm": 0.34075220788764593,
+      "learning_rate": 8.90325530914566e-06,
+      "loss": 1.7455,
+      "step": 500
+    },
+    {
+      "epoch": 0.9201101928374655,
+      "grad_norm": 0.1973440685550195,
+      "learning_rate": 8.89865513360703e-06,
+      "loss": 1.5224,
+      "step": 501
+    },
+    {
+      "epoch": 0.9219467401285583,
+      "grad_norm": 0.2392375532163106,
+      "learning_rate": 8.894046524487984e-06,
+      "loss": 1.3295,
+      "step": 502
+    },
+    {
+      "epoch": 0.9237832874196511,
+      "grad_norm": 0.2564773830917158,
+      "learning_rate": 8.889429491757872e-06,
+      "loss": 1.533,
+      "step": 503
+    },
+    {
+      "epoch": 0.9256198347107438,
+      "grad_norm": 0.2205455403328584,
+      "learning_rate": 8.884804045404272e-06,
+      "loss": 1.4521,
+      "step": 504
+    },
+    {
+      "epoch": 0.9274563820018366,
+      "grad_norm": 0.25135270284304534,
+      "learning_rate": 8.88017019543296e-06,
+      "loss": 1.4876,
+      "step": 505
+    },
+    {
+      "epoch": 0.9292929292929293,
+      "grad_norm": 0.251544235242601,
+      "learning_rate": 8.875527951867895e-06,
+      "loss": 1.3732,
+      "step": 506
+    },
+    {
+      "epoch": 0.931129476584022,
+      "grad_norm": 0.23610950027399946,
+      "learning_rate": 8.870877324751186e-06,
+      "loss": 1.3661,
+      "step": 507
+    },
+    {
+      "epoch": 0.9329660238751147,
+      "grad_norm": 0.2699351751142409,
+      "learning_rate": 8.86621832414308e-06,
+      "loss": 1.6805,
+      "step": 508
+    },
+    {
+      "epoch": 0.9348025711662076,
+      "grad_norm": 0.2719550299817604,
+      "learning_rate": 8.861550960121946e-06,
+      "loss": 1.2125,
+      "step": 509
+    },
+    {
+      "epoch": 0.9366391184573003,
+      "grad_norm": 0.23740235364217568,
+      "learning_rate": 8.856875242784228e-06,
+      "loss": 1.4639,
+      "step": 510
+    },
+    {
+      "epoch": 0.938475665748393,
+      "grad_norm": 0.2407044180789032,
+      "learning_rate": 8.852191182244456e-06,
+      "loss": 1.6759,
+      "step": 511
+    },
+    {
+      "epoch": 0.9403122130394858,
+      "grad_norm": 0.22822388370160415,
+      "learning_rate": 8.8474987886352e-06,
+      "loss": 1.5468,
+      "step": 512
+    },
+    {
+      "epoch": 0.9421487603305785,
+      "grad_norm": 0.20492274919803016,
+      "learning_rate": 8.842798072107055e-06,
+      "loss": 1.5179,
+      "step": 513
+    },
+    {
+      "epoch": 0.9439853076216712,
+      "grad_norm": 0.25012220364392496,
+      "learning_rate": 8.838089042828626e-06,
+      "loss": 1.7403,
+      "step": 514
+    },
+    {
+      "epoch": 0.945821854912764,
+      "grad_norm": 0.21419223860479567,
+      "learning_rate": 8.833371710986493e-06,
+      "loss": 1.5632,
+      "step": 515
+    },
+    {
+      "epoch": 0.9476584022038568,
+      "grad_norm": 0.2607121295111944,
+      "learning_rate": 8.828646086785203e-06,
+      "loss": 1.3563,
+      "step": 516
+    },
+    {
+      "epoch": 0.9494949494949495,
+      "grad_norm": 0.204811481952745,
+      "learning_rate": 8.823912180447237e-06,
+      "loss": 1.5761,
+      "step": 517
+    },
+    {
+      "epoch": 0.9513314967860422,
+      "grad_norm": 0.26470613517398467,
+      "learning_rate": 8.819170002212992e-06,
+      "loss": 1.7127,
+      "step": 518
+    },
+    {
+      "epoch": 0.953168044077135,
+      "grad_norm": 0.2610250808679381,
+      "learning_rate": 8.81441956234076e-06,
+      "loss": 1.5655,
+      "step": 519
+    },
+    {
+      "epoch": 0.9550045913682277,
+      "grad_norm": 0.2337315187549265,
+      "learning_rate": 8.809660871106705e-06,
+      "loss": 1.5154,
+      "step": 520
+    },
+    {
+      "epoch": 0.9568411386593205,
+      "grad_norm": 0.23170078740278124,
+      "learning_rate": 8.804893938804839e-06,
+      "loss": 1.5717,
+      "step": 521
+    },
+    {
+      "epoch": 0.9586776859504132,
+      "grad_norm": 0.22632743502454025,
+      "learning_rate": 8.800118775747003e-06,
+      "loss": 1.6218,
+      "step": 522
+    },
+    {
+      "epoch": 0.960514233241506,
+      "grad_norm": 0.2205915233922398,
+      "learning_rate": 8.795335392262841e-06,
+      "loss": 1.4909,
+      "step": 523
+    },
+    {
+      "epoch": 0.9623507805325987,
+      "grad_norm": 0.21145323033626462,
+      "learning_rate": 8.790543798699778e-06,
+      "loss": 1.5984,
+      "step": 524
+    },
+    {
+      "epoch": 0.9641873278236914,
+      "grad_norm": 0.20970398911022825,
+      "learning_rate": 8.785744005423003e-06,
+      "loss": 1.4622,
+      "step": 525
+    },
+    {
+      "epoch": 0.9660238751147842,
+      "grad_norm": 0.23298402376870314,
+      "learning_rate": 8.78093602281544e-06,
+      "loss": 1.5884,
+      "step": 526
+    },
+    {
+      "epoch": 0.967860422405877,
+      "grad_norm": 0.27324051793792004,
+      "learning_rate": 8.77611986127773e-06,
+      "loss": 1.4594,
+      "step": 527
+    },
+    {
+      "epoch": 0.9696969696969697,
+      "grad_norm": 0.2331172811203617,
+      "learning_rate": 8.771295531228204e-06,
+      "loss": 1.525,
+      "step": 528
+    },
+    {
+      "epoch": 0.9715335169880625,
+      "grad_norm": 0.31490123000969455,
+      "learning_rate": 8.766463043102864e-06,
+      "loss": 1.5453,
+      "step": 529
+    },
+    {
+      "epoch": 0.9733700642791552,
+      "grad_norm": 0.22547389438032928,
+      "learning_rate": 8.761622407355364e-06,
+      "loss": 1.6573,
+      "step": 530
+    },
+    {
+      "epoch": 0.9752066115702479,
+      "grad_norm": 0.21974629433018228,
+      "learning_rate": 8.756773634456975e-06,
+      "loss": 1.396,
+      "step": 531
+    },
+    {
+      "epoch": 0.9770431588613406,
+      "grad_norm": 0.21230467225101732,
+      "learning_rate": 8.751916734896577e-06,
+      "loss": 1.6261,
+      "step": 532
+    },
+    {
+      "epoch": 0.9788797061524335,
+      "grad_norm": 0.2645261233289859,
+      "learning_rate": 8.747051719180626e-06,
+      "loss": 1.435,
+      "step": 533
+    },
+    {
+      "epoch": 0.9807162534435262,
+      "grad_norm": 0.2234025047049364,
+      "learning_rate": 8.742178597833137e-06,
+      "loss": 1.5244,
+      "step": 534
+    },
+    {
+      "epoch": 0.9825528007346189,
+      "grad_norm": 0.2573392390616289,
+      "learning_rate": 8.737297381395657e-06,
+      "loss": 1.8973,
+      "step": 535
+    },
+    {
+      "epoch": 0.9843893480257117,
+      "grad_norm": 0.27996089327128665,
+      "learning_rate": 8.732408080427247e-06,
+      "loss": 1.5882,
+      "step": 536
+    },
+    {
+      "epoch": 0.9862258953168044,
+      "grad_norm": 0.21778812033730788,
+      "learning_rate": 8.727510705504453e-06,
+      "loss": 1.3809,
+      "step": 537
+    },
+    {
+      "epoch": 0.9880624426078971,
+      "grad_norm": 0.2504419591715746,
+      "learning_rate": 8.72260526722129e-06,
+      "loss": 1.4216,
+      "step": 538
+    },
+    {
+      "epoch": 0.98989898989899,
+      "grad_norm": 0.21877782640292506,
+      "learning_rate": 8.717691776189214e-06,
+      "loss": 1.4832,
+      "step": 539
+    },
+    {
+      "epoch": 0.9917355371900827,
+      "grad_norm": 0.2522185082572152,
+      "learning_rate": 8.7127702430371e-06,
+      "loss": 1.5983,
+      "step": 540
+    },
+    {
+      "epoch": 0.9935720844811754,
+      "grad_norm": 0.2468951810241973,
+      "learning_rate": 8.707840678411223e-06,
+      "loss": 1.3155,
+      "step": 541
+    },
+    {
+      "epoch": 0.9954086317722681,
+      "grad_norm": 0.24726883324778043,
+      "learning_rate": 8.702903092975226e-06,
+      "loss": 1.7388,
+      "step": 542
+    },
+    {
+      "epoch": 0.9972451790633609,
+      "grad_norm": 0.26412381788140465,
+      "learning_rate": 8.69795749741011e-06,
+      "loss": 1.5106,
+      "step": 543
+    },
+    {
+      "epoch": 0.9990817263544536,
+      "grad_norm": 0.2482433438633285,
+      "learning_rate": 8.693003902414194e-06,
+      "loss": 1.5944,
+      "step": 544
+    },
+    {
+      "epoch": 0.9990817263544536,
+      "eval_loss": 2.2991089820861816,
+      "eval_runtime": 40.0535,
+      "eval_samples_per_second": 5.118,
+      "eval_steps_per_second": 0.449,
+      "step": 544
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 2176,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 4,
+  "save_steps": 272,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 471536082616320.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}
diff --git a/checkpoint-544/training_args.bin b/checkpoint-544/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1c89872f76294700d651f52629596dab54835031
--- /dev/null
+++ b/checkpoint-544/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b66afbb22c27fefe6b63f9f74c2fd602fa1f166c83cc37801706b6aea4e033c
+size 8632
diff --git a/checkpoint-544/zero_to_fp32.py b/checkpoint-544/zero_to_fp32.py
new file mode 100644
index 0000000000000000000000000000000000000000..e69ecd9acb5a235ffbf927091051106d902b3d39
--- /dev/null
+++ b/checkpoint-544/zero_to_fp32.py
@@ -0,0 +1,674 @@
+#!/usr/bin/env python
+
+# Copyright (c) Microsoft Corporation.
+# SPDX-License-Identifier: Apache-2.0
+
+# DeepSpeed Team
+
+# This script extracts fp32 consolidated weights from a zero 1, 2 and 3 DeepSpeed checkpoints. It gets
+# copied into the top level checkpoint dir, so the user can easily do the conversion at any point in
+# the future. Once extracted, the weights don't require DeepSpeed and can be used in any
+# application.
+#
+# example:
+#   python zero_to_fp32.py . output_dir/
+#   or
+#   python zero_to_fp32.py . output_dir/ --safe_serialization
+
+import argparse
+import torch
+import glob
+import math
+import os
+import re
+import json
+from tqdm import tqdm
+from collections import OrderedDict
+from dataclasses import dataclass
+
+# while this script doesn't use deepspeed to recover data, since the checkpoints are pickled with
+# DeepSpeed data structures it has to be available in the current python environment.
+from deepspeed.utils import logger
+from deepspeed.checkpoint.constants import (DS_VERSION, OPTIMIZER_STATE_DICT, SINGLE_PARTITION_OF_FP32_GROUPS,
+                                            FP32_FLAT_GROUPS, ZERO_STAGE, PARTITION_COUNT, PARAM_SHAPES, BUFFER_NAMES,
+                                            FROZEN_PARAM_SHAPES, FROZEN_PARAM_FRAGMENTS)
+
+
+@dataclass
+class zero_model_state:
+    buffers: dict()
+    param_shapes: dict()
+    shared_params: list
+    ds_version: int
+    frozen_param_shapes: dict()
+    frozen_param_fragments: dict()
+
+
+debug = 0
+
+# load to cpu
+device = torch.device('cpu')
+
+
+def atoi(text):
+    return int(text) if text.isdigit() else text
+
+
+def natural_keys(text):
+    '''
+    alist.sort(key=natural_keys) sorts in human order
+    http://nedbatchelder.com/blog/200712/human_sorting.html
+    (See Toothy's implementation in the comments)
+    '''
+    return [atoi(c) for c in re.split(r'(\d+)', text)]
+
+
+def get_model_state_file(checkpoint_dir, zero_stage):
+    if not os.path.isdir(checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{checkpoint_dir}' doesn't exist")
+
+    # there should be only one file
+    if zero_stage <= 2:
+        file = os.path.join(checkpoint_dir, "mp_rank_00_model_states.pt")
+    elif zero_stage == 3:
+        file = os.path.join(checkpoint_dir, "zero_pp_rank_0_mp_rank_00_model_states.pt")
+
+    if not os.path.exists(file):
+        raise FileNotFoundError(f"can't find model states file at '{file}'")
+
+    return file
+
+
+def get_checkpoint_files(checkpoint_dir, glob_pattern):
+    # XXX: need to test that this simple glob rule works for multi-node setup too
+    ckpt_files = sorted(glob.glob(os.path.join(checkpoint_dir, glob_pattern)), key=natural_keys)
+
+    if len(ckpt_files) == 0:
+        raise FileNotFoundError(f"can't find {glob_pattern} files in directory '{checkpoint_dir}'")
+
+    return ckpt_files
+
+
+def get_optim_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_optim_states.pt")
+
+
+def get_model_state_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_model_states.pt")
+
+
+def parse_model_states(files):
+    zero_model_states = []
+    for file in files:
+        state_dict = torch.load(file, map_location=device)
+
+        if BUFFER_NAMES not in state_dict:
+            raise ValueError(f"{file} is not a model state checkpoint")
+        buffer_names = state_dict[BUFFER_NAMES]
+        if debug:
+            print("Found buffers:", buffer_names)
+
+        # recover just the buffers while restoring them to fp32 if they were saved in fp16
+        buffers = {k: v.float() for k, v in state_dict["module"].items() if k in buffer_names}
+        param_shapes = state_dict[PARAM_SHAPES]
+
+        # collect parameters that are included in param_shapes
+        param_names = []
+        for s in param_shapes:
+            for name in s.keys():
+                param_names.append(name)
+
+        # update with frozen parameters
+        frozen_param_shapes = state_dict.get(FROZEN_PARAM_SHAPES, None)
+        if frozen_param_shapes is not None:
+            if debug:
+                print(f"Found frozen_param_shapes: {frozen_param_shapes}")
+            param_names += list(frozen_param_shapes.keys())
+
+        # handle shared params
+        shared_params = [[k, v] for k, v in state_dict["shared_params"].items()]
+
+        ds_version = state_dict.get(DS_VERSION, None)
+
+        frozen_param_fragments = state_dict.get(FROZEN_PARAM_FRAGMENTS, None)
+
+        z_model_state = zero_model_state(buffers=buffers,
+                                         param_shapes=param_shapes,
+                                         shared_params=shared_params,
+                                         ds_version=ds_version,
+                                         frozen_param_shapes=frozen_param_shapes,
+                                         frozen_param_fragments=frozen_param_fragments)
+        zero_model_states.append(z_model_state)
+
+    return zero_model_states
+
+
+def parse_optim_states(files, ds_checkpoint_dir):
+    total_files = len(files)
+    state_dicts = []
+    for f in files:
+        state_dict = torch.load(f, map_location=device)
+        # immediately discard the potentially huge 2 optimizer states as we only care for fp32 master weights
+        # and also handle the case where it was already removed by another helper script
+        state_dict["optimizer_state_dict"].pop("optimizer_state_dict", None)
+        state_dicts.append(state_dict)
+
+    if not ZERO_STAGE in state_dicts[0][OPTIMIZER_STATE_DICT]:
+        raise ValueError(f"{files[0]} is not a zero checkpoint")
+    zero_stage = state_dicts[0][OPTIMIZER_STATE_DICT][ZERO_STAGE]
+    world_size = state_dicts[0][OPTIMIZER_STATE_DICT][PARTITION_COUNT]
+
+    # For ZeRO-2 each param group can have different partition_count as data parallelism for expert
+    # parameters can be different from data parallelism for non-expert parameters. So we can just
+    # use the max of the partition_count to get the dp world_size.
+
+    if type(world_size) is list:
+        world_size = max(world_size)
+
+    if world_size != total_files:
+        raise ValueError(
+            f"Expected {world_size} of '*_optim_states.pt' under '{ds_checkpoint_dir}' but found {total_files} files. "
+            "Possibly due to an overwrite of an old checkpoint, or a checkpoint didn't get saved by one or more processes."
+        )
+
+    # the groups are named differently in each stage
+    if zero_stage <= 2:
+        fp32_groups_key = SINGLE_PARTITION_OF_FP32_GROUPS
+    elif zero_stage == 3:
+        fp32_groups_key = FP32_FLAT_GROUPS
+    else:
+        raise ValueError(f"unknown zero stage {zero_stage}")
+
+    if zero_stage <= 2:
+        fp32_flat_groups = [state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key] for i in range(len(state_dicts))]
+    elif zero_stage == 3:
+        # if there is more than one param group, there will be multiple flattened tensors - one
+        # flattened tensor per group - for simplicity merge them into a single tensor
+        #
+        # XXX: could make the script more memory efficient for when there are multiple groups - it
+        # will require matching the sub-lists of param_shapes for each param group flattened tensor
+
+        fp32_flat_groups = [
+            torch.cat(state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key], 0) for i in range(len(state_dicts))
+        ]
+
+    return zero_stage, world_size, fp32_flat_groups
+
+
+def _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters):
+    """
+    Returns fp32 state_dict reconstructed from ds checkpoint
+
+    Args:
+        - ``ds_checkpoint_dir``: path to the deepspeed checkpoint folder (where the optimizer files are)
+
+    """
+    print(f"Processing zero checkpoint '{ds_checkpoint_dir}'")
+
+    optim_files = get_optim_files(ds_checkpoint_dir)
+    zero_stage, world_size, fp32_flat_groups = parse_optim_states(optim_files, ds_checkpoint_dir)
+    print(f"Detected checkpoint of type zero stage {zero_stage}, world_size: {world_size}")
+
+    model_files = get_model_state_files(ds_checkpoint_dir)
+
+    zero_model_states = parse_model_states(model_files)
+    print(f'Parsing checkpoint created by deepspeed=={zero_model_states[0].ds_version}')
+
+    if zero_stage <= 2:
+        return _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+    elif zero_stage == 3:
+        return _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+
+
+def _zero2_merge_frozen_params(state_dict, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+    frozen_param_fragments = zero_model_states[0].frozen_param_fragments
+
+    if debug:
+        num_elem = sum(s.numel() for s in frozen_param_shapes.values())
+        print(f'rank 0: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in frozen_param_fragments.values()])
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        state_dict[name] = frozen_param_fragments[name]
+
+        if debug:
+            print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _has_callable(obj, fn):
+    attr = getattr(obj, fn, None)
+    return callable(attr)
+
+
+def _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+
+    # Reconstruction protocol:
+    #
+    # XXX: document this
+
+    if debug:
+        for i in range(world_size):
+            for j in range(len(fp32_flat_groups[0])):
+                print(f"{FP32_FLAT_GROUPS}[{i}][{j}].shape={fp32_flat_groups[i][j].shape}")
+
+    # XXX: memory usage doubles here (zero2)
+    num_param_groups = len(fp32_flat_groups[0])
+    merged_single_partition_of_fp32_groups = []
+    for i in range(num_param_groups):
+        merged_partitions = [sd[i] for sd in fp32_flat_groups]
+        full_single_fp32_vector = torch.cat(merged_partitions, 0)
+        merged_single_partition_of_fp32_groups.append(full_single_fp32_vector)
+    avail_numel = sum(
+        [full_single_fp32_vector.numel() for full_single_fp32_vector in merged_single_partition_of_fp32_groups])
+
+    if debug:
+        wanted_params = sum([len(shapes) for shapes in param_shapes])
+        wanted_numel = sum([sum(shape.numel() for shape in shapes.values()) for shapes in param_shapes])
+        # not asserting if there is a mismatch due to possible padding
+        print(f"Have {avail_numel} numels to process.")
+        print(f"Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    total_numel = 0
+    total_params = 0
+    for shapes, full_single_fp32_vector in zip(param_shapes, merged_single_partition_of_fp32_groups):
+        offset = 0
+        avail_numel = full_single_fp32_vector.numel()
+        for name, shape in shapes.items():
+
+            unpartitioned_numel = shape.numel() if _has_callable(shape, 'numel') else math.prod(shape)
+            total_numel += unpartitioned_numel
+            total_params += 1
+
+            if debug:
+                print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+            state_dict[name] = full_single_fp32_vector.narrow(0, offset, unpartitioned_numel).view(shape)
+            offset += unpartitioned_numel
+
+        # Z2 started to align to 2*world_size to improve nccl performance. Therefore both offset and
+        # avail_numel can differ by anywhere between 0..2*world_size. Due to two unrelated complex
+        # paddings performed in the code it's almost impossible to predict the exact numbers w/o the
+        # live optimizer object, so we are checking that the numbers are within the right range
+        align_to = 2 * world_size
+
+        def zero2_align(x):
+            return align_to * math.ceil(x / align_to)
+
+        if debug:
+            print(f"original offset={offset}, avail_numel={avail_numel}")
+
+        offset = zero2_align(offset)
+        avail_numel = zero2_align(avail_numel)
+
+        if debug:
+            print(f"aligned  offset={offset}, avail_numel={avail_numel}")
+
+        # Sanity check
+        if offset != avail_numel:
+            raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero2_merge_frozen_params(state_dict, zero_model_states)
+
+    _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def zero3_partitioned_param_info(unpartitioned_numel, world_size):
+    remainder = unpartitioned_numel % world_size
+    padding_numel = (world_size - remainder) if remainder else 0
+    partitioned_numel = math.ceil(unpartitioned_numel / world_size)
+    return partitioned_numel, padding_numel
+
+
+def _zero3_merge_frozen_params(state_dict, world_size, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    if debug:
+        for i in range(world_size):
+            num_elem = sum(s.numel() for s in zero_model_states[i].frozen_param_fragments.values())
+            print(f'rank {i}: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in zero_model_states[0].frozen_param_fragments.values()]) * world_size
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in zero_model_states[0].frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        param_frags = tuple(model_state.frozen_param_fragments[name] for model_state in zero_model_states)
+        state_dict[name] = torch.cat(param_frags, 0).narrow(0, 0, unpartitioned_numel).view(shape)
+
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Frozen params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+    avail_numel = fp32_flat_groups[0].numel() * world_size
+    # Reconstruction protocol: For zero3 we need to zip the partitions together at boundary of each
+    # param, re-consolidating each param, while dealing with padding if any
+
+    # merge list of dicts, preserving order
+    param_shapes = {k: v for d in param_shapes for k, v in d.items()}
+
+    if debug:
+        for i in range(world_size):
+            print(f"{FP32_FLAT_GROUPS}[{i}].shape={fp32_flat_groups[i].shape}")
+
+        wanted_params = len(param_shapes)
+        wanted_numel = sum(shape.numel() for shape in param_shapes.values())
+        # not asserting if there is a mismatch due to possible padding
+        avail_numel = fp32_flat_groups[0].numel() * world_size
+        print(f"Trainable params: Have {avail_numel} numels to process.")
+        print(f"Trainable params: Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    offset = 0
+    total_numel = 0
+    total_params = 0
+    for name, shape in tqdm(param_shapes.items(), desc='Gathering Sharded Weights'):
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+        total_params += 1
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Trainable params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+        # XXX: memory usage doubles here
+        state_dict[name] = torch.cat(
+            tuple(fp32_flat_groups[i].narrow(0, offset, partitioned_numel) for i in range(world_size)),
+            0).narrow(0, 0, unpartitioned_numel).view(shape)
+        offset += partitioned_numel
+
+    offset *= world_size
+
+    # Sanity check
+    if offset != avail_numel:
+        raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed Trainable fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero3_merge_frozen_params(state_dict, world_size, zero_model_states)
+
+    _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag=None, exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated state_dict that can be loaded with
+    ``load_state_dict()`` and used for training without DeepSpeed or shared with others, for example
+    via a model hub.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in 'latest' file. e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+
+    Returns:
+        - pytorch ``state_dict``
+
+    Note: this approach may not work if your application doesn't have sufficient free CPU memory and
+    you may need to use the offline approach using the ``zero_to_fp32.py`` script that is saved with
+    the checkpoint.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import get_fp32_state_dict_from_zero_checkpoint
+        # do the training and checkpoint saving
+        state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir) # already on cpu
+        model = model.cpu() # move to cpu
+        model.load_state_dict(state_dict)
+        # submit to model hub or save the model to share with others
+
+    In this example the ``model`` will no longer be usable in the deepspeed context of the same
+    application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    If you want it all done for you, use ``load_state_dict_from_zero_checkpoint`` instead.
+
+    """
+    if tag is None:
+        latest_path = os.path.join(checkpoint_dir, 'latest')
+        if os.path.isfile(latest_path):
+            with open(latest_path, 'r') as fd:
+                tag = fd.read().strip()
+        else:
+            raise ValueError(f"Unable to find 'latest' file at {latest_path}")
+
+    ds_checkpoint_dir = os.path.join(checkpoint_dir, tag)
+
+    if not os.path.isdir(ds_checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{ds_checkpoint_dir}' doesn't exist")
+
+    return _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters)
+
+
+def convert_zero_checkpoint_to_fp32_state_dict(checkpoint_dir,
+                                               output_dir,
+                                               max_shard_size="5GB",
+                                               safe_serialization=False,
+                                               tag=None,
+                                               exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict`` file that can be
+    loaded with ``torch.load(file)`` + ``load_state_dict()`` and used for training without DeepSpeed.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``output_dir``: directory to the pytorch fp32 state_dict output files
+        - ``max_shard_size``: the maximum size for a checkpoint before being sharded, default value is 5GB
+        - ``safe_serialization``:  whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+    """
+    # Dependency pre-check
+    if safe_serialization:
+        try:
+            from safetensors.torch import save_file
+        except ImportError:
+            print('If you want to use `safe_serialization`, please `pip install safetensors`')
+            raise
+    if max_shard_size is not None:
+        try:
+            from huggingface_hub import split_torch_state_dict_into_shards
+        except ImportError:
+            print('If you want to use `max_shard_size`, please `pip install huggingface_hub`')
+            raise
+
+    # Convert zero checkpoint to state_dict
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag, exclude_frozen_parameters)
+
+    # Shard the model if it is too big.
+    weights_name = "model.safetensors" if safe_serialization else "pytorch_model.bin"
+    if max_shard_size is not None:
+        filename_pattern = weights_name.replace(".bin", "{suffix}.bin").replace(".safetensors", "{suffix}.safetensors")
+        state_dict_split = split_torch_state_dict_into_shards(state_dict,
+                                                              filename_pattern=filename_pattern,
+                                                              max_shard_size=max_shard_size)
+    else:
+        from collections import namedtuple
+        StateDictSplit = namedtuple("StateDictSplit", ["is_sharded", "filename_to_tensors"])
+        state_dict_split = StateDictSplit(is_sharded=False,
+                                          filename_to_tensors={weights_name: list(state_dict.keys())})
+
+    # Save the model
+    filename_to_tensors = state_dict_split.filename_to_tensors.items()
+    for shard_file, tensors in tqdm(filename_to_tensors, desc="Saving checkpoint shards"):
+        shard = {tensor: state_dict[tensor].contiguous() for tensor in tensors}
+        output_path = os.path.join(output_dir, shard_file)
+        if safe_serialization:
+            save_file(shard, output_path, metadata={"format": "pt"})
+        else:
+            torch.save(shard, output_path)
+
+    # Save index if sharded
+    if state_dict_split.is_sharded:
+        index = {
+            "metadata": state_dict_split.metadata,
+            "weight_map": state_dict_split.tensor_to_filename,
+        }
+        save_index_file = "model.safetensors.index.json" if safe_serialization else "pytorch_model.bin.index.json"
+        save_index_file = os.path.join(output_dir, save_index_file)
+        with open(save_index_file, "w", encoding="utf-8") as f:
+            content = json.dumps(index, indent=2, sort_keys=True) + "\n"
+            f.write(content)
+
+
+def load_state_dict_from_zero_checkpoint(model, checkpoint_dir, tag=None):
+    """
+    1. Put the provided model to cpu
+    2. Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict``
+    3. Load it into the provided model
+
+    Args:
+        - ``model``: the model object to update
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+
+    Returns:
+        - ``model`: modified model
+
+    Make sure you have plenty of CPU memory available before you call this function. If you don't
+    have enough use the ``zero_to_fp32.py`` utility to do the conversion. You will find it
+    conveniently placed for you in the checkpoint folder.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import load_state_dict_from_zero_checkpoint
+        model = load_state_dict_from_zero_checkpoint(trainer.model, checkpoint_dir)
+        # submit to model hub or save the model to share with others
+
+    Note, that once this was run, the ``model`` will no longer be usable in the deepspeed context
+    of the same application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    """
+    logger.info(f"Extracting fp32 weights")
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag)
+
+    logger.info(f"Overwriting model with fp32 weights")
+    model = model.cpu()
+    model.load_state_dict(state_dict, strict=False)
+
+    return model
+
+
+if __name__ == "__main__":
+    parser = argparse.ArgumentParser()
+    parser.add_argument("checkpoint_dir",
+                        type=str,
+                        help="path to the desired checkpoint folder, e.g., path/checkpoint-12")
+    parser.add_argument("output_dir",
+                        type=str,
+                        help="directory to the pytorch fp32 state_dict output files"
+                        "(e.g. path/checkpoint-12-output/)")
+    parser.add_argument(
+        "--max_shard_size",
+        type=str,
+        default="5GB",
+        help="The maximum size for a checkpoint before being sharded. Checkpoints shard will then be each of size"
+        "lower than this size. If expressed as a string, needs to be digits followed by a unit (like `5MB`"
+        "We default it to 5GB in order for models to be able to run easily on free-tier google colab instances"
+        "without CPU OOM issues.")
+    parser.add_argument(
+        "--safe_serialization",
+        default=False,
+        action='store_true',
+        help="Whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).")
+    parser.add_argument("-t",
+                        "--tag",
+                        type=str,
+                        default=None,
+                        help="checkpoint tag used as a unique identifier for checkpoint. e.g., global_step1")
+    parser.add_argument("--exclude_frozen_parameters", action='store_true', help="exclude frozen parameters")
+    parser.add_argument("-d", "--debug", action='store_true', help="enable debug")
+    args = parser.parse_args()
+
+    debug = args.debug
+
+    convert_zero_checkpoint_to_fp32_state_dict(args.checkpoint_dir,
+                                               args.output_dir,
+                                               max_shard_size=args.max_shard_size,
+                                               safe_serialization=args.safe_serialization,
+                                               tag=args.tag,
+                                               exclude_frozen_parameters=args.exclude_frozen_parameters)
diff --git a/checkpoint-816/README.md b/checkpoint-816/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9ffaf32045885341f44f9850f1ee3bc5e6ffa9dd
--- /dev/null
+++ b/checkpoint-816/README.md
@@ -0,0 +1,202 @@
+---
+base_model: PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1
\ No newline at end of file
diff --git a/checkpoint-816/adapter_config.json b/checkpoint-816/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..1c579cbcbf6740cc6c934f1581b6cf66e692fe73
--- /dev/null
+++ b/checkpoint-816/adapter_config.json
@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "PocketDoc/Dans-PersonalityEngine-V1.1.0-12b",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": null,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "down_proj",
+    "v_proj",
+    "o_proj",
+    "up_proj",
+    "k_proj",
+    "gate_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": true
+}
\ No newline at end of file
diff --git a/checkpoint-816/adapter_model.safetensors b/checkpoint-816/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..fca9196d73a3095748f804fcd73c02586991898d
--- /dev/null
+++ b/checkpoint-816/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:448df8cf9d637039a6f1d42c4b6937f3d9f81c580d5f9901235f4b1f52fdd568
+size 912337968
diff --git a/checkpoint-816/global_step815/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt b/checkpoint-816/global_step815/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..9f5b71f8d4222181e8ae82d634a25ffb972128d7
--- /dev/null
+++ b/checkpoint-816/global_step815/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5c087472b8c3a3b050fb3077a7b6857dfc25ad85e228c0b8a2a5a749883af36
+size 536671408
diff --git a/checkpoint-816/global_step815/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt b/checkpoint-816/global_step815/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..68c11725eafe647b84eb6cf307a6b4f7f151bafe
--- /dev/null
+++ b/checkpoint-816/global_step815/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d9a010cfe5aea15a850730186e7f9f2b54c7f0a72ff97a6f40a89669843da82
+size 536671408
diff --git a/checkpoint-816/global_step815/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt b/checkpoint-816/global_step815/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..2249a1d182b25a482687107ce5d4c414369184b4
--- /dev/null
+++ b/checkpoint-816/global_step815/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8c7ff31f51c1fc9869111628a3faf6557349d915437f540dbd0462e435c56311
+size 536671408
diff --git a/checkpoint-816/global_step815/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt b/checkpoint-816/global_step815/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b0e7f0b416c498b5bd08b05e75dac56148247e43
--- /dev/null
+++ b/checkpoint-816/global_step815/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb97a63fcb85b78d555cf65f066b4625c1d105e2c5f5920557a75e1338eefbe9
+size 536671408
diff --git a/checkpoint-816/global_step815/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt b/checkpoint-816/global_step815/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..9fe1d253973eb2a51aa1b799c83164d0c4c48b8d
--- /dev/null
+++ b/checkpoint-816/global_step815/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca21eeb079692d3f3791ac5a54229efedeb6b0d0781f23eed14e1be7a4991f7e
+size 536671408
diff --git a/checkpoint-816/global_step815/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt b/checkpoint-816/global_step815/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ae4db2c8a34ecfe0bbec378a30e0773bfc6394db
--- /dev/null
+++ b/checkpoint-816/global_step815/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f6e2979b04b17c6de51218aac2d7ea73f0b497890321e659cc3258cb1632d9e
+size 536671408
diff --git a/checkpoint-816/global_step815/zero_pp_rank_0_mp_rank_00_model_states.pt b/checkpoint-816/global_step815/zero_pp_rank_0_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b20f73c1c8260f2ae60569fede417f60345e533b
--- /dev/null
+++ b/checkpoint-816/global_step815/zero_pp_rank_0_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:be7fafc51f16de2a400ef07b8a8d497ef6eb9108a89f454888c4bad1666e8fcf
+size 557022
diff --git a/checkpoint-816/global_step815/zero_pp_rank_1_mp_rank_00_model_states.pt b/checkpoint-816/global_step815/zero_pp_rank_1_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..e9e579463d7c4efad5c8b02f5a237f1eaaf44c22
--- /dev/null
+++ b/checkpoint-816/global_step815/zero_pp_rank_1_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe5979c1a775d05003e3f048b50c030ba193644820902d6ceb38fd46f14e381e
+size 557022
diff --git a/checkpoint-816/global_step815/zero_pp_rank_2_mp_rank_00_model_states.pt b/checkpoint-816/global_step815/zero_pp_rank_2_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..81e638e49997afa3c3a10e30fe91203a601b9b1d
--- /dev/null
+++ b/checkpoint-816/global_step815/zero_pp_rank_2_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9de9ade2cd7005cd94592569f3cb4dfa2e577fdbf3c3ddce0d69c1e30241430
+size 557022
diff --git a/checkpoint-816/global_step815/zero_pp_rank_3_mp_rank_00_model_states.pt b/checkpoint-816/global_step815/zero_pp_rank_3_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..0cc92174778badcccc4ae38983db24b0da06b958
--- /dev/null
+++ b/checkpoint-816/global_step815/zero_pp_rank_3_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74bb91921cb422226cd4d7e8719361b13cbfe00a4a1208e7c830fabaf6083058
+size 557022
diff --git a/checkpoint-816/global_step815/zero_pp_rank_4_mp_rank_00_model_states.pt b/checkpoint-816/global_step815/zero_pp_rank_4_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..3189f5d268ad1d31082ca5aed56917686b628f6b
--- /dev/null
+++ b/checkpoint-816/global_step815/zero_pp_rank_4_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6110768ca8252d4fc008a11994b04ff85b57fdef67401aaca36caa9186cbff44
+size 557022
diff --git a/checkpoint-816/global_step815/zero_pp_rank_5_mp_rank_00_model_states.pt b/checkpoint-816/global_step815/zero_pp_rank_5_mp_rank_00_model_states.pt
new file mode 100644
index 0000000000000000000000000000000000000000..cb79d7f4cbcb0e7475cb3c76243624132dc77eca
--- /dev/null
+++ b/checkpoint-816/global_step815/zero_pp_rank_5_mp_rank_00_model_states.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:07a90b62fb7f38967af124310fcb0d57c9397c5f5e1eb50df86ddce99c0bc98e
+size 557022
diff --git a/checkpoint-816/latest b/checkpoint-816/latest
new file mode 100644
index 0000000000000000000000000000000000000000..c057bc698807fbc4652e6a1e084cb022540c0b70
--- /dev/null
+++ b/checkpoint-816/latest
@@ -0,0 +1 @@
+global_step815
\ No newline at end of file
diff --git a/checkpoint-816/rng_state_0.pth b/checkpoint-816/rng_state_0.pth
new file mode 100644
index 0000000000000000000000000000000000000000..a4ea3bcaa633281d54b8f36bfe01444671fff554
--- /dev/null
+++ b/checkpoint-816/rng_state_0.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:00b511b65260605171c4e343106012878d8d7ccd56dbb8ef3027b49963128379
+size 15472
diff --git a/checkpoint-816/rng_state_1.pth b/checkpoint-816/rng_state_1.pth
new file mode 100644
index 0000000000000000000000000000000000000000..6f689a49608aaa0a04c4229f55b2ba597158f2fd
--- /dev/null
+++ b/checkpoint-816/rng_state_1.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9dba167f103c8032ac486274f0ffda7b2bc9e5c16afc0d546503d44d1f1f9956
+size 15472
diff --git a/checkpoint-816/rng_state_2.pth b/checkpoint-816/rng_state_2.pth
new file mode 100644
index 0000000000000000000000000000000000000000..63c59f4a1fd2cbfd6b0f0cb23937cacca94751e2
--- /dev/null
+++ b/checkpoint-816/rng_state_2.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c669abda9f3007ec4f14266ddbfaf576e0aa0183ed694abe65562147a1efde6
+size 15472
diff --git a/checkpoint-816/rng_state_3.pth b/checkpoint-816/rng_state_3.pth
new file mode 100644
index 0000000000000000000000000000000000000000..b63af744b9caed1d1fa889a37e7c6dfb40e9880a
--- /dev/null
+++ b/checkpoint-816/rng_state_3.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28c332cbf93426ab179bd9a74224ceb85238444421e629636128a19d26ae0e12
+size 15472
diff --git a/checkpoint-816/rng_state_4.pth b/checkpoint-816/rng_state_4.pth
new file mode 100644
index 0000000000000000000000000000000000000000..451fb496eed116a0ff2c2be0a7a613410ba5d8f7
--- /dev/null
+++ b/checkpoint-816/rng_state_4.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9693460f341c426f9616b26d8a0a3bd9d76b19cd5c19be39c1820688e116c44d
+size 15472
diff --git a/checkpoint-816/rng_state_5.pth b/checkpoint-816/rng_state_5.pth
new file mode 100644
index 0000000000000000000000000000000000000000..17a2d94aea03c7fd55877a33b311a5b84713a352
--- /dev/null
+++ b/checkpoint-816/rng_state_5.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99d48f2c70e6f99428ccbd1bb256952edcaaa1ef4c0d21bfdc5f6276ff0ffe29
+size 15472
diff --git a/checkpoint-816/scheduler.pt b/checkpoint-816/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..cf15c906e614d090991db463348f6eb9965c6e4d
--- /dev/null
+++ b/checkpoint-816/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89409947ec3b9b038f73a159fa674a7c3586dab3fe00aab7c4958ae0dd1f1f5a
+size 1064
diff --git a/checkpoint-816/special_tokens_map.json b/checkpoint-816/special_tokens_map.json
new file mode 100644
index 0000000000000000000000000000000000000000..547986c0f0567961dd9ff48218defed8e4d5aa59
--- /dev/null
+++ b/checkpoint-816/special_tokens_map.json
@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}
diff --git a/checkpoint-816/tokenizer.json b/checkpoint-816/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..cff17babe3bd564f7a3005727b02f44432e0facf
--- /dev/null
+++ b/checkpoint-816/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee57bd3271d8c200a06df40f9d7c94f8bb8f085b5cfb2d40907a794560df2ec3
+size 17078342
diff --git a/checkpoint-816/tokenizer_config.json b/checkpoint-816/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..0f13a1776083b5998049a3aad730d95f5e74f8cd
--- /dev/null
+++ b/checkpoint-816/tokenizer_config.json
@@ -0,0 +1,8016 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "<SPECIAL_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "5": {
+      "content": "[AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "[/AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "[TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "8": {
+      "content": "[/TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "9": {
+      "content": "[TOOL_CALLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "10": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "11": {
+      "content": "[PREFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "12": {
+      "content": "[MIDDLE]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "13": {
+      "content": "[SUFFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "14": {
+      "content": "<SPECIAL_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "15": {
+      "content": "<SPECIAL_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "16": {
+      "content": "<SPECIAL_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "17": {
+      "content": "<SPECIAL_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "18": {
+      "content": "<SPECIAL_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "19": {
+      "content": "<SPECIAL_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "20": {
+      "content": "<SPECIAL_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "21": {
+      "content": "<SPECIAL_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "22": {
+      "content": "<SPECIAL_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "23": {
+      "content": "<SPECIAL_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "24": {
+      "content": "<SPECIAL_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "25": {
+      "content": "<SPECIAL_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "26": {
+      "content": "<SPECIAL_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "27": {
+      "content": "<SPECIAL_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "28": {
+      "content": "<SPECIAL_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "29": {
+      "content": "<SPECIAL_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "30": {
+      "content": "<SPECIAL_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "31": {
+      "content": "<SPECIAL_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32": {
+      "content": "<SPECIAL_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "33": {
+      "content": "<SPECIAL_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "34": {
+      "content": "<SPECIAL_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "35": {
+      "content": "<SPECIAL_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "36": {
+      "content": "<SPECIAL_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "37": {
+      "content": "<SPECIAL_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "38": {
+      "content": "<SPECIAL_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "39": {
+      "content": "<SPECIAL_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "40": {
+      "content": "<SPECIAL_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "41": {
+      "content": "<SPECIAL_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "42": {
+      "content": "<SPECIAL_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "43": {
+      "content": "<SPECIAL_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "44": {
+      "content": "<SPECIAL_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "45": {
+      "content": "<SPECIAL_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "46": {
+      "content": "<SPECIAL_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "47": {
+      "content": "<SPECIAL_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "48": {
+      "content": "<SPECIAL_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49": {
+      "content": "<SPECIAL_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50": {
+      "content": "<SPECIAL_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "51": {
+      "content": "<SPECIAL_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "52": {
+      "content": "<SPECIAL_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "53": {
+      "content": "<SPECIAL_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "54": {
+      "content": "<SPECIAL_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "55": {
+      "content": "<SPECIAL_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "56": {
+      "content": "<SPECIAL_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "57": {
+      "content": "<SPECIAL_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "58": {
+      "content": "<SPECIAL_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "59": {
+      "content": "<SPECIAL_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "60": {
+      "content": "<SPECIAL_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "61": {
+      "content": "<SPECIAL_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "62": {
+      "content": "<SPECIAL_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "63": {
+      "content": "<SPECIAL_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "64": {
+      "content": "<SPECIAL_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "65": {
+      "content": "<SPECIAL_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "66": {
+      "content": "<SPECIAL_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "67": {
+      "content": "<SPECIAL_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "68": {
+      "content": "<SPECIAL_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "69": {
+      "content": "<SPECIAL_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "70": {
+      "content": "<SPECIAL_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "71": {
+      "content": "<SPECIAL_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "72": {
+      "content": "<SPECIAL_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "73": {
+      "content": "<SPECIAL_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "74": {
+      "content": "<SPECIAL_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "75": {
+      "content": "<SPECIAL_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "76": {
+      "content": "<SPECIAL_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "77": {
+      "content": "<SPECIAL_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "78": {
+      "content": "<SPECIAL_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "79": {
+      "content": "<SPECIAL_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "80": {
+      "content": "<SPECIAL_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "81": {
+      "content": "<SPECIAL_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "82": {
+      "content": "<SPECIAL_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "83": {
+      "content": "<SPECIAL_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "84": {
+      "content": "<SPECIAL_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "85": {
+      "content": "<SPECIAL_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "86": {
+      "content": "<SPECIAL_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "87": {
+      "content": "<SPECIAL_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "88": {
+      "content": "<SPECIAL_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "89": {
+      "content": "<SPECIAL_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "90": {
+      "content": "<SPECIAL_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "91": {
+      "content": "<SPECIAL_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "92": {
+      "content": "<SPECIAL_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "93": {
+      "content": "<SPECIAL_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "94": {
+      "content": "<SPECIAL_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "95": {
+      "content": "<SPECIAL_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "96": {
+      "content": "<SPECIAL_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "97": {
+      "content": "<SPECIAL_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "98": {
+      "content": "<SPECIAL_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "99": {
+      "content": "<SPECIAL_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "<SPECIAL_100>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "<SPECIAL_101>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "<SPECIAL_102>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "<SPECIAL_103>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "104": {
+      "content": "<SPECIAL_104>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "105": {
+      "content": "<SPECIAL_105>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "106": {
+      "content": "<SPECIAL_106>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "107": {
+      "content": "<SPECIAL_107>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "108": {
+      "content": "<SPECIAL_108>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "109": {
+      "content": "<SPECIAL_109>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "110": {
+      "content": "<SPECIAL_110>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "111": {
+      "content": "<SPECIAL_111>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "112": {
+      "content": "<SPECIAL_112>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "113": {
+      "content": "<SPECIAL_113>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "114": {
+      "content": "<SPECIAL_114>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "115": {
+      "content": "<SPECIAL_115>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "116": {
+      "content": "<SPECIAL_116>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "117": {
+      "content": "<SPECIAL_117>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "118": {
+      "content": "<SPECIAL_118>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "119": {
+      "content": "<SPECIAL_119>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "120": {
+      "content": "<SPECIAL_120>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "121": {
+      "content": "<SPECIAL_121>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "122": {
+      "content": "<SPECIAL_122>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "123": {
+      "content": "<SPECIAL_123>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "124": {
+      "content": "<SPECIAL_124>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "125": {
+      "content": "<SPECIAL_125>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "126": {
+      "content": "<SPECIAL_126>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "127": {
+      "content": "<SPECIAL_127>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128": {
+      "content": "<SPECIAL_128>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "129": {
+      "content": "<SPECIAL_129>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "130": {
+      "content": "<SPECIAL_130>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "131": {
+      "content": "<SPECIAL_131>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "132": {
+      "content": "<SPECIAL_132>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "133": {
+      "content": "<SPECIAL_133>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "134": {
+      "content": "<SPECIAL_134>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "135": {
+      "content": "<SPECIAL_135>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "136": {
+      "content": "<SPECIAL_136>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "137": {
+      "content": "<SPECIAL_137>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "138": {
+      "content": "<SPECIAL_138>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "139": {
+      "content": "<SPECIAL_139>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "140": {
+      "content": "<SPECIAL_140>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "141": {
+      "content": "<SPECIAL_141>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "142": {
+      "content": "<SPECIAL_142>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "143": {
+      "content": "<SPECIAL_143>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144": {
+      "content": "<SPECIAL_144>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145": {
+      "content": "<SPECIAL_145>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "146": {
+      "content": "<SPECIAL_146>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "147": {
+      "content": "<SPECIAL_147>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "148": {
+      "content": "<SPECIAL_148>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "149": {
+      "content": "<SPECIAL_149>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "150": {
+      "content": "<SPECIAL_150>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151": {
+      "content": "<SPECIAL_151>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "152": {
+      "content": "<SPECIAL_152>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "153": {
+      "content": "<SPECIAL_153>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "154": {
+      "content": "<SPECIAL_154>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "155": {
+      "content": "<SPECIAL_155>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "156": {
+      "content": "<SPECIAL_156>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "157": {
+      "content": "<SPECIAL_157>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "158": {
+      "content": "<SPECIAL_158>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "159": {
+      "content": "<SPECIAL_159>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "160": {
+      "content": "<SPECIAL_160>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "161": {
+      "content": "<SPECIAL_161>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "162": {
+      "content": "<SPECIAL_162>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "163": {
+      "content": "<SPECIAL_163>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "164": {
+      "content": "<SPECIAL_164>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "165": {
+      "content": "<SPECIAL_165>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "166": {
+      "content": "<SPECIAL_166>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "167": {
+      "content": "<SPECIAL_167>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "168": {
+      "content": "<SPECIAL_168>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "169": {
+      "content": "<SPECIAL_169>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "170": {
+      "content": "<SPECIAL_170>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "171": {
+      "content": "<SPECIAL_171>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "172": {
+      "content": "<SPECIAL_172>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "173": {
+      "content": "<SPECIAL_173>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "174": {
+      "content": "<SPECIAL_174>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "175": {
+      "content": "<SPECIAL_175>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "176": {
+      "content": "<SPECIAL_176>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "177": {
+      "content": "<SPECIAL_177>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "178": {
+      "content": "<SPECIAL_178>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "179": {
+      "content": "<SPECIAL_179>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "180": {
+      "content": "<SPECIAL_180>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "181": {
+      "content": "<SPECIAL_181>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "182": {
+      "content": "<SPECIAL_182>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "183": {
+      "content": "<SPECIAL_183>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "184": {
+      "content": "<SPECIAL_184>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "185": {
+      "content": "<SPECIAL_185>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "186": {
+      "content": "<SPECIAL_186>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "187": {
+      "content": "<SPECIAL_187>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "188": {
+      "content": "<SPECIAL_188>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "189": {
+      "content": "<SPECIAL_189>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "190": {
+      "content": "<SPECIAL_190>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "191": {
+      "content": "<SPECIAL_191>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "192": {
+      "content": "<SPECIAL_192>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "193": {
+      "content": "<SPECIAL_193>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "194": {
+      "content": "<SPECIAL_194>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "195": {
+      "content": "<SPECIAL_195>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "196": {
+      "content": "<SPECIAL_196>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "197": {
+      "content": "<SPECIAL_197>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "198": {
+      "content": "<SPECIAL_198>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "199": {
+      "content": "<SPECIAL_199>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "200": {
+      "content": "<SPECIAL_200>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "201": {
+      "content": "<SPECIAL_201>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "202": {
+      "content": "<SPECIAL_202>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "203": {
+      "content": "<SPECIAL_203>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "204": {
+      "content": "<SPECIAL_204>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "205": {
+      "content": "<SPECIAL_205>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "206": {
+      "content": "<SPECIAL_206>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "207": {
+      "content": "<SPECIAL_207>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "208": {
+      "content": "<SPECIAL_208>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "209": {
+      "content": "<SPECIAL_209>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "210": {
+      "content": "<SPECIAL_210>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "211": {
+      "content": "<SPECIAL_211>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "212": {
+      "content": "<SPECIAL_212>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "213": {
+      "content": "<SPECIAL_213>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "214": {
+      "content": "<SPECIAL_214>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "215": {
+      "content": "<SPECIAL_215>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "216": {
+      "content": "<SPECIAL_216>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "217": {
+      "content": "<SPECIAL_217>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "218": {
+      "content": "<SPECIAL_218>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "219": {
+      "content": "<SPECIAL_219>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "220": {
+      "content": "<SPECIAL_220>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "221": {
+      "content": "<SPECIAL_221>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "222": {
+      "content": "<SPECIAL_222>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "223": {
+      "content": "<SPECIAL_223>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "224": {
+      "content": "<SPECIAL_224>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "225": {
+      "content": "<SPECIAL_225>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "226": {
+      "content": "<SPECIAL_226>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "227": {
+      "content": "<SPECIAL_227>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "228": {
+      "content": "<SPECIAL_228>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "229": {
+      "content": "<SPECIAL_229>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "230": {
+      "content": "<SPECIAL_230>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "231": {
+      "content": "<SPECIAL_231>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "232": {
+      "content": "<SPECIAL_232>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "233": {
+      "content": "<SPECIAL_233>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "234": {
+      "content": "<SPECIAL_234>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "235": {
+      "content": "<SPECIAL_235>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "236": {
+      "content": "<SPECIAL_236>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "237": {
+      "content": "<SPECIAL_237>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "238": {
+      "content": "<SPECIAL_238>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "239": {
+      "content": "<SPECIAL_239>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "240": {
+      "content": "<SPECIAL_240>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "241": {
+      "content": "<SPECIAL_241>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "242": {
+      "content": "<SPECIAL_242>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "243": {
+      "content": "<SPECIAL_243>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "244": {
+      "content": "<SPECIAL_244>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "245": {
+      "content": "<SPECIAL_245>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "246": {
+      "content": "<SPECIAL_246>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "247": {
+      "content": "<SPECIAL_247>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248": {
+      "content": "<SPECIAL_248>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "249": {
+      "content": "<SPECIAL_249>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "250": {
+      "content": "<SPECIAL_250>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "251": {
+      "content": "<SPECIAL_251>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "252": {
+      "content": "<SPECIAL_252>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "253": {
+      "content": "<SPECIAL_253>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "254": {
+      "content": "<SPECIAL_254>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255": {
+      "content": "<SPECIAL_255>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256": {
+      "content": "<SPECIAL_256>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "257": {
+      "content": "<SPECIAL_257>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "258": {
+      "content": "<SPECIAL_258>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "259": {
+      "content": "<SPECIAL_259>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "260": {
+      "content": "<SPECIAL_260>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "261": {
+      "content": "<SPECIAL_261>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "262": {
+      "content": "<SPECIAL_262>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "263": {
+      "content": "<SPECIAL_263>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "264": {
+      "content": "<SPECIAL_264>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "265": {
+      "content": "<SPECIAL_265>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "266": {
+      "content": "<SPECIAL_266>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "267": {
+      "content": "<SPECIAL_267>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "268": {
+      "content": "<SPECIAL_268>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "269": {
+      "content": "<SPECIAL_269>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "270": {
+      "content": "<SPECIAL_270>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "271": {
+      "content": "<SPECIAL_271>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "272": {
+      "content": "<SPECIAL_272>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "273": {
+      "content": "<SPECIAL_273>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "274": {
+      "content": "<SPECIAL_274>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "275": {
+      "content": "<SPECIAL_275>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "276": {
+      "content": "<SPECIAL_276>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "277": {
+      "content": "<SPECIAL_277>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "278": {
+      "content": "<SPECIAL_278>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "279": {
+      "content": "<SPECIAL_279>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "280": {
+      "content": "<SPECIAL_280>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "281": {
+      "content": "<SPECIAL_281>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "282": {
+      "content": "<SPECIAL_282>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "283": {
+      "content": "<SPECIAL_283>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "284": {
+      "content": "<SPECIAL_284>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "285": {
+      "content": "<SPECIAL_285>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "286": {
+      "content": "<SPECIAL_286>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "287": {
+      "content": "<SPECIAL_287>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "288": {
+      "content": "<SPECIAL_288>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "289": {
+      "content": "<SPECIAL_289>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "290": {
+      "content": "<SPECIAL_290>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "291": {
+      "content": "<SPECIAL_291>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "292": {
+      "content": "<SPECIAL_292>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "293": {
+      "content": "<SPECIAL_293>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "294": {
+      "content": "<SPECIAL_294>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "295": {
+      "content": "<SPECIAL_295>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "296": {
+      "content": "<SPECIAL_296>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "297": {
+      "content": "<SPECIAL_297>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "298": {
+      "content": "<SPECIAL_298>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "299": {
+      "content": "<SPECIAL_299>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "300": {
+      "content": "<SPECIAL_300>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "301": {
+      "content": "<SPECIAL_301>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "302": {
+      "content": "<SPECIAL_302>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "303": {
+      "content": "<SPECIAL_303>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "304": {
+      "content": "<SPECIAL_304>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "305": {
+      "content": "<SPECIAL_305>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "306": {
+      "content": "<SPECIAL_306>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "307": {
+      "content": "<SPECIAL_307>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "308": {
+      "content": "<SPECIAL_308>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "309": {
+      "content": "<SPECIAL_309>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "310": {
+      "content": "<SPECIAL_310>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "311": {
+      "content": "<SPECIAL_311>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "312": {
+      "content": "<SPECIAL_312>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "313": {
+      "content": "<SPECIAL_313>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "314": {
+      "content": "<SPECIAL_314>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "315": {
+      "content": "<SPECIAL_315>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "316": {
+      "content": "<SPECIAL_316>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "317": {
+      "content": "<SPECIAL_317>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "318": {
+      "content": "<SPECIAL_318>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "319": {
+      "content": "<SPECIAL_319>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "320": {
+      "content": "<SPECIAL_320>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "321": {
+      "content": "<SPECIAL_321>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "322": {
+      "content": "<SPECIAL_322>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "323": {
+      "content": "<SPECIAL_323>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "324": {
+      "content": "<SPECIAL_324>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "325": {
+      "content": "<SPECIAL_325>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "326": {
+      "content": "<SPECIAL_326>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "327": {
+      "content": "<SPECIAL_327>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "328": {
+      "content": "<SPECIAL_328>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "329": {
+      "content": "<SPECIAL_329>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "330": {
+      "content": "<SPECIAL_330>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "331": {
+      "content": "<SPECIAL_331>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "332": {
+      "content": "<SPECIAL_332>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "333": {
+      "content": "<SPECIAL_333>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "334": {
+      "content": "<SPECIAL_334>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "335": {
+      "content": "<SPECIAL_335>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "336": {
+      "content": "<SPECIAL_336>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "337": {
+      "content": "<SPECIAL_337>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "338": {
+      "content": "<SPECIAL_338>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "339": {
+      "content": "<SPECIAL_339>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "340": {
+      "content": "<SPECIAL_340>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "341": {
+      "content": "<SPECIAL_341>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "342": {
+      "content": "<SPECIAL_342>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "343": {
+      "content": "<SPECIAL_343>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "344": {
+      "content": "<SPECIAL_344>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "345": {
+      "content": "<SPECIAL_345>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "346": {
+      "content": "<SPECIAL_346>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "347": {
+      "content": "<SPECIAL_347>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "348": {
+      "content": "<SPECIAL_348>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "349": {
+      "content": "<SPECIAL_349>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "350": {
+      "content": "<SPECIAL_350>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "351": {
+      "content": "<SPECIAL_351>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "352": {
+      "content": "<SPECIAL_352>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "353": {
+      "content": "<SPECIAL_353>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "354": {
+      "content": "<SPECIAL_354>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "355": {
+      "content": "<SPECIAL_355>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "356": {
+      "content": "<SPECIAL_356>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "357": {
+      "content": "<SPECIAL_357>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "358": {
+      "content": "<SPECIAL_358>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "359": {
+      "content": "<SPECIAL_359>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "360": {
+      "content": "<SPECIAL_360>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "361": {
+      "content": "<SPECIAL_361>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "362": {
+      "content": "<SPECIAL_362>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "363": {
+      "content": "<SPECIAL_363>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "364": {
+      "content": "<SPECIAL_364>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "365": {
+      "content": "<SPECIAL_365>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "366": {
+      "content": "<SPECIAL_366>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "367": {
+      "content": "<SPECIAL_367>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "368": {
+      "content": "<SPECIAL_368>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "369": {
+      "content": "<SPECIAL_369>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "370": {
+      "content": "<SPECIAL_370>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "371": {
+      "content": "<SPECIAL_371>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "372": {
+      "content": "<SPECIAL_372>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "373": {
+      "content": "<SPECIAL_373>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "374": {
+      "content": "<SPECIAL_374>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "375": {
+      "content": "<SPECIAL_375>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "376": {
+      "content": "<SPECIAL_376>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "377": {
+      "content": "<SPECIAL_377>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "378": {
+      "content": "<SPECIAL_378>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "379": {
+      "content": "<SPECIAL_379>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "380": {
+      "content": "<SPECIAL_380>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "381": {
+      "content": "<SPECIAL_381>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "382": {
+      "content": "<SPECIAL_382>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "383": {
+      "content": "<SPECIAL_383>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "384": {
+      "content": "<SPECIAL_384>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "385": {
+      "content": "<SPECIAL_385>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "386": {
+      "content": "<SPECIAL_386>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "387": {
+      "content": "<SPECIAL_387>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "388": {
+      "content": "<SPECIAL_388>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "389": {
+      "content": "<SPECIAL_389>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "390": {
+      "content": "<SPECIAL_390>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "391": {
+      "content": "<SPECIAL_391>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "392": {
+      "content": "<SPECIAL_392>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "393": {
+      "content": "<SPECIAL_393>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "394": {
+      "content": "<SPECIAL_394>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "395": {
+      "content": "<SPECIAL_395>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "396": {
+      "content": "<SPECIAL_396>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "397": {
+      "content": "<SPECIAL_397>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "398": {
+      "content": "<SPECIAL_398>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "399": {
+      "content": "<SPECIAL_399>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "400": {
+      "content": "<SPECIAL_400>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "401": {
+      "content": "<SPECIAL_401>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "402": {
+      "content": "<SPECIAL_402>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "403": {
+      "content": "<SPECIAL_403>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "404": {
+      "content": "<SPECIAL_404>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "405": {
+      "content": "<SPECIAL_405>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "406": {
+      "content": "<SPECIAL_406>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "407": {
+      "content": "<SPECIAL_407>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "408": {
+      "content": "<SPECIAL_408>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "409": {
+      "content": "<SPECIAL_409>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "410": {
+      "content": "<SPECIAL_410>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "411": {
+      "content": "<SPECIAL_411>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "412": {
+      "content": "<SPECIAL_412>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "413": {
+      "content": "<SPECIAL_413>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "414": {
+      "content": "<SPECIAL_414>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "415": {
+      "content": "<SPECIAL_415>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "416": {
+      "content": "<SPECIAL_416>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "417": {
+      "content": "<SPECIAL_417>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "418": {
+      "content": "<SPECIAL_418>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "419": {
+      "content": "<SPECIAL_419>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "420": {
+      "content": "<SPECIAL_420>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "421": {
+      "content": "<SPECIAL_421>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "422": {
+      "content": "<SPECIAL_422>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "423": {
+      "content": "<SPECIAL_423>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "424": {
+      "content": "<SPECIAL_424>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "425": {
+      "content": "<SPECIAL_425>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "426": {
+      "content": "<SPECIAL_426>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "427": {
+      "content": "<SPECIAL_427>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "428": {
+      "content": "<SPECIAL_428>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "429": {
+      "content": "<SPECIAL_429>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "430": {
+      "content": "<SPECIAL_430>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "431": {
+      "content": "<SPECIAL_431>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "432": {
+      "content": "<SPECIAL_432>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "433": {
+      "content": "<SPECIAL_433>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "434": {
+      "content": "<SPECIAL_434>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "435": {
+      "content": "<SPECIAL_435>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "436": {
+      "content": "<SPECIAL_436>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "437": {
+      "content": "<SPECIAL_437>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "438": {
+      "content": "<SPECIAL_438>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "439": {
+      "content": "<SPECIAL_439>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "440": {
+      "content": "<SPECIAL_440>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "441": {
+      "content": "<SPECIAL_441>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "442": {
+      "content": "<SPECIAL_442>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "443": {
+      "content": "<SPECIAL_443>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "444": {
+      "content": "<SPECIAL_444>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "445": {
+      "content": "<SPECIAL_445>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "446": {
+      "content": "<SPECIAL_446>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "447": {
+      "content": "<SPECIAL_447>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "448": {
+      "content": "<SPECIAL_448>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "449": {
+      "content": "<SPECIAL_449>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "450": {
+      "content": "<SPECIAL_450>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "451": {
+      "content": "<SPECIAL_451>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "452": {
+      "content": "<SPECIAL_452>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "453": {
+      "content": "<SPECIAL_453>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "454": {
+      "content": "<SPECIAL_454>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "455": {
+      "content": "<SPECIAL_455>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "456": {
+      "content": "<SPECIAL_456>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "457": {
+      "content": "<SPECIAL_457>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "458": {
+      "content": "<SPECIAL_458>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "459": {
+      "content": "<SPECIAL_459>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "460": {
+      "content": "<SPECIAL_460>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "461": {
+      "content": "<SPECIAL_461>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "462": {
+      "content": "<SPECIAL_462>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "463": {
+      "content": "<SPECIAL_463>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "464": {
+      "content": "<SPECIAL_464>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "465": {
+      "content": "<SPECIAL_465>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "466": {
+      "content": "<SPECIAL_466>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "467": {
+      "content": "<SPECIAL_467>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "468": {
+      "content": "<SPECIAL_468>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "469": {
+      "content": "<SPECIAL_469>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "470": {
+      "content": "<SPECIAL_470>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "471": {
+      "content": "<SPECIAL_471>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "472": {
+      "content": "<SPECIAL_472>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "473": {
+      "content": "<SPECIAL_473>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "474": {
+      "content": "<SPECIAL_474>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "475": {
+      "content": "<SPECIAL_475>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "476": {
+      "content": "<SPECIAL_476>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "477": {
+      "content": "<SPECIAL_477>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "478": {
+      "content": "<SPECIAL_478>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "479": {
+      "content": "<SPECIAL_479>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "480": {
+      "content": "<SPECIAL_480>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "481": {
+      "content": "<SPECIAL_481>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "482": {
+      "content": "<SPECIAL_482>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "483": {
+      "content": "<SPECIAL_483>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "484": {
+      "content": "<SPECIAL_484>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "485": {
+      "content": "<SPECIAL_485>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "486": {
+      "content": "<SPECIAL_486>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "487": {
+      "content": "<SPECIAL_487>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "488": {
+      "content": "<SPECIAL_488>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "489": {
+      "content": "<SPECIAL_489>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "490": {
+      "content": "<SPECIAL_490>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "491": {
+      "content": "<SPECIAL_491>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "492": {
+      "content": "<SPECIAL_492>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "493": {
+      "content": "<SPECIAL_493>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "494": {
+      "content": "<SPECIAL_494>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "495": {
+      "content": "<SPECIAL_495>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "496": {
+      "content": "<SPECIAL_496>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "497": {
+      "content": "<SPECIAL_497>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "498": {
+      "content": "<SPECIAL_498>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "499": {
+      "content": "<SPECIAL_499>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "500": {
+      "content": "<SPECIAL_500>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "501": {
+      "content": "<SPECIAL_501>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "502": {
+      "content": "<SPECIAL_502>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "503": {
+      "content": "<SPECIAL_503>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "504": {
+      "content": "<SPECIAL_504>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "505": {
+      "content": "<SPECIAL_505>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "506": {
+      "content": "<SPECIAL_506>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "507": {
+      "content": "<SPECIAL_507>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "508": {
+      "content": "<SPECIAL_508>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "509": {
+      "content": "<SPECIAL_509>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "510": {
+      "content": "<SPECIAL_510>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "511": {
+      "content": "<SPECIAL_511>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "512": {
+      "content": "<SPECIAL_512>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "513": {
+      "content": "<SPECIAL_513>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "514": {
+      "content": "<SPECIAL_514>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "515": {
+      "content": "<SPECIAL_515>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "516": {
+      "content": "<SPECIAL_516>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "517": {
+      "content": "<SPECIAL_517>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "518": {
+      "content": "<SPECIAL_518>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "519": {
+      "content": "<SPECIAL_519>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "520": {
+      "content": "<SPECIAL_520>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "521": {
+      "content": "<SPECIAL_521>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "522": {
+      "content": "<SPECIAL_522>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "523": {
+      "content": "<SPECIAL_523>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "524": {
+      "content": "<SPECIAL_524>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "525": {
+      "content": "<SPECIAL_525>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "526": {
+      "content": "<SPECIAL_526>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "527": {
+      "content": "<SPECIAL_527>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "528": {
+      "content": "<SPECIAL_528>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "529": {
+      "content": "<SPECIAL_529>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "530": {
+      "content": "<SPECIAL_530>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "531": {
+      "content": "<SPECIAL_531>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "532": {
+      "content": "<SPECIAL_532>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "533": {
+      "content": "<SPECIAL_533>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "534": {
+      "content": "<SPECIAL_534>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "535": {
+      "content": "<SPECIAL_535>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "536": {
+      "content": "<SPECIAL_536>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "537": {
+      "content": "<SPECIAL_537>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "538": {
+      "content": "<SPECIAL_538>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "539": {
+      "content": "<SPECIAL_539>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "540": {
+      "content": "<SPECIAL_540>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "541": {
+      "content": "<SPECIAL_541>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "542": {
+      "content": "<SPECIAL_542>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "543": {
+      "content": "<SPECIAL_543>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "544": {
+      "content": "<SPECIAL_544>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "545": {
+      "content": "<SPECIAL_545>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "546": {
+      "content": "<SPECIAL_546>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "547": {
+      "content": "<SPECIAL_547>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "548": {
+      "content": "<SPECIAL_548>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "549": {
+      "content": "<SPECIAL_549>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "550": {
+      "content": "<SPECIAL_550>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "551": {
+      "content": "<SPECIAL_551>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "552": {
+      "content": "<SPECIAL_552>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "553": {
+      "content": "<SPECIAL_553>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "554": {
+      "content": "<SPECIAL_554>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "555": {
+      "content": "<SPECIAL_555>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "556": {
+      "content": "<SPECIAL_556>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "557": {
+      "content": "<SPECIAL_557>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "558": {
+      "content": "<SPECIAL_558>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "559": {
+      "content": "<SPECIAL_559>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "560": {
+      "content": "<SPECIAL_560>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "561": {
+      "content": "<SPECIAL_561>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "562": {
+      "content": "<SPECIAL_562>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "563": {
+      "content": "<SPECIAL_563>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "564": {
+      "content": "<SPECIAL_564>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "565": {
+      "content": "<SPECIAL_565>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "566": {
+      "content": "<SPECIAL_566>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "567": {
+      "content": "<SPECIAL_567>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "568": {
+      "content": "<SPECIAL_568>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "569": {
+      "content": "<SPECIAL_569>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "570": {
+      "content": "<SPECIAL_570>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "571": {
+      "content": "<SPECIAL_571>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "572": {
+      "content": "<SPECIAL_572>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "573": {
+      "content": "<SPECIAL_573>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "574": {
+      "content": "<SPECIAL_574>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "575": {
+      "content": "<SPECIAL_575>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "576": {
+      "content": "<SPECIAL_576>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "577": {
+      "content": "<SPECIAL_577>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "578": {
+      "content": "<SPECIAL_578>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "579": {
+      "content": "<SPECIAL_579>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "580": {
+      "content": "<SPECIAL_580>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "581": {
+      "content": "<SPECIAL_581>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "582": {
+      "content": "<SPECIAL_582>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "583": {
+      "content": "<SPECIAL_583>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "584": {
+      "content": "<SPECIAL_584>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "585": {
+      "content": "<SPECIAL_585>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "586": {
+      "content": "<SPECIAL_586>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "587": {
+      "content": "<SPECIAL_587>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "588": {
+      "content": "<SPECIAL_588>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "589": {
+      "content": "<SPECIAL_589>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "590": {
+      "content": "<SPECIAL_590>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "591": {
+      "content": "<SPECIAL_591>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "592": {
+      "content": "<SPECIAL_592>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "593": {
+      "content": "<SPECIAL_593>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "594": {
+      "content": "<SPECIAL_594>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "595": {
+      "content": "<SPECIAL_595>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "596": {
+      "content": "<SPECIAL_596>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "597": {
+      "content": "<SPECIAL_597>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "598": {
+      "content": "<SPECIAL_598>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "599": {
+      "content": "<SPECIAL_599>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "600": {
+      "content": "<SPECIAL_600>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "601": {
+      "content": "<SPECIAL_601>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "602": {
+      "content": "<SPECIAL_602>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "603": {
+      "content": "<SPECIAL_603>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "604": {
+      "content": "<SPECIAL_604>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "605": {
+      "content": "<SPECIAL_605>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "606": {
+      "content": "<SPECIAL_606>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "607": {
+      "content": "<SPECIAL_607>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "608": {
+      "content": "<SPECIAL_608>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "609": {
+      "content": "<SPECIAL_609>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "610": {
+      "content": "<SPECIAL_610>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "611": {
+      "content": "<SPECIAL_611>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "612": {
+      "content": "<SPECIAL_612>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "613": {
+      "content": "<SPECIAL_613>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "614": {
+      "content": "<SPECIAL_614>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "615": {
+      "content": "<SPECIAL_615>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "616": {
+      "content": "<SPECIAL_616>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "617": {
+      "content": "<SPECIAL_617>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "618": {
+      "content": "<SPECIAL_618>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "619": {
+      "content": "<SPECIAL_619>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "620": {
+      "content": "<SPECIAL_620>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "621": {
+      "content": "<SPECIAL_621>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "622": {
+      "content": "<SPECIAL_622>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "623": {
+      "content": "<SPECIAL_623>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "624": {
+      "content": "<SPECIAL_624>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "625": {
+      "content": "<SPECIAL_625>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "626": {
+      "content": "<SPECIAL_626>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "627": {
+      "content": "<SPECIAL_627>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "628": {
+      "content": "<SPECIAL_628>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "629": {
+      "content": "<SPECIAL_629>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "630": {
+      "content": "<SPECIAL_630>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "631": {
+      "content": "<SPECIAL_631>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "632": {
+      "content": "<SPECIAL_632>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "633": {
+      "content": "<SPECIAL_633>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "634": {
+      "content": "<SPECIAL_634>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "635": {
+      "content": "<SPECIAL_635>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "636": {
+      "content": "<SPECIAL_636>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "637": {
+      "content": "<SPECIAL_637>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "638": {
+      "content": "<SPECIAL_638>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "639": {
+      "content": "<SPECIAL_639>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "640": {
+      "content": "<SPECIAL_640>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "641": {
+      "content": "<SPECIAL_641>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "642": {
+      "content": "<SPECIAL_642>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "643": {
+      "content": "<SPECIAL_643>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "644": {
+      "content": "<SPECIAL_644>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "645": {
+      "content": "<SPECIAL_645>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "646": {
+      "content": "<SPECIAL_646>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "647": {
+      "content": "<SPECIAL_647>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "648": {
+      "content": "<SPECIAL_648>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "649": {
+      "content": "<SPECIAL_649>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "650": {
+      "content": "<SPECIAL_650>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "651": {
+      "content": "<SPECIAL_651>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "652": {
+      "content": "<SPECIAL_652>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "653": {
+      "content": "<SPECIAL_653>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "654": {
+      "content": "<SPECIAL_654>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "655": {
+      "content": "<SPECIAL_655>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "656": {
+      "content": "<SPECIAL_656>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "657": {
+      "content": "<SPECIAL_657>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "658": {
+      "content": "<SPECIAL_658>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "659": {
+      "content": "<SPECIAL_659>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "660": {
+      "content": "<SPECIAL_660>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "661": {
+      "content": "<SPECIAL_661>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "662": {
+      "content": "<SPECIAL_662>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "663": {
+      "content": "<SPECIAL_663>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "664": {
+      "content": "<SPECIAL_664>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "665": {
+      "content": "<SPECIAL_665>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "666": {
+      "content": "<SPECIAL_666>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "667": {
+      "content": "<SPECIAL_667>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "668": {
+      "content": "<SPECIAL_668>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "669": {
+      "content": "<SPECIAL_669>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "670": {
+      "content": "<SPECIAL_670>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "671": {
+      "content": "<SPECIAL_671>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "672": {
+      "content": "<SPECIAL_672>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "673": {
+      "content": "<SPECIAL_673>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "674": {
+      "content": "<SPECIAL_674>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "675": {
+      "content": "<SPECIAL_675>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "676": {
+      "content": "<SPECIAL_676>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "677": {
+      "content": "<SPECIAL_677>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "678": {
+      "content": "<SPECIAL_678>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "679": {
+      "content": "<SPECIAL_679>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "680": {
+      "content": "<SPECIAL_680>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "681": {
+      "content": "<SPECIAL_681>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "682": {
+      "content": "<SPECIAL_682>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "683": {
+      "content": "<SPECIAL_683>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "684": {
+      "content": "<SPECIAL_684>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "685": {
+      "content": "<SPECIAL_685>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "686": {
+      "content": "<SPECIAL_686>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "687": {
+      "content": "<SPECIAL_687>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "688": {
+      "content": "<SPECIAL_688>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "689": {
+      "content": "<SPECIAL_689>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "690": {
+      "content": "<SPECIAL_690>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "691": {
+      "content": "<SPECIAL_691>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "692": {
+      "content": "<SPECIAL_692>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "693": {
+      "content": "<SPECIAL_693>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "694": {
+      "content": "<SPECIAL_694>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "695": {
+      "content": "<SPECIAL_695>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "696": {
+      "content": "<SPECIAL_696>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "697": {
+      "content": "<SPECIAL_697>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "698": {
+      "content": "<SPECIAL_698>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "699": {
+      "content": "<SPECIAL_699>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "700": {
+      "content": "<SPECIAL_700>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "701": {
+      "content": "<SPECIAL_701>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "702": {
+      "content": "<SPECIAL_702>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "703": {
+      "content": "<SPECIAL_703>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "704": {
+      "content": "<SPECIAL_704>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "705": {
+      "content": "<SPECIAL_705>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "706": {
+      "content": "<SPECIAL_706>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "707": {
+      "content": "<SPECIAL_707>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "708": {
+      "content": "<SPECIAL_708>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "709": {
+      "content": "<SPECIAL_709>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "710": {
+      "content": "<SPECIAL_710>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "711": {
+      "content": "<SPECIAL_711>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "712": {
+      "content": "<SPECIAL_712>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "713": {
+      "content": "<SPECIAL_713>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "714": {
+      "content": "<SPECIAL_714>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "715": {
+      "content": "<SPECIAL_715>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "716": {
+      "content": "<SPECIAL_716>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "717": {
+      "content": "<SPECIAL_717>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "718": {
+      "content": "<SPECIAL_718>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "719": {
+      "content": "<SPECIAL_719>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "720": {
+      "content": "<SPECIAL_720>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "721": {
+      "content": "<SPECIAL_721>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "722": {
+      "content": "<SPECIAL_722>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "723": {
+      "content": "<SPECIAL_723>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "724": {
+      "content": "<SPECIAL_724>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "725": {
+      "content": "<SPECIAL_725>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "726": {
+      "content": "<SPECIAL_726>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "727": {
+      "content": "<SPECIAL_727>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "728": {
+      "content": "<SPECIAL_728>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "729": {
+      "content": "<SPECIAL_729>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "730": {
+      "content": "<SPECIAL_730>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "731": {
+      "content": "<SPECIAL_731>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "732": {
+      "content": "<SPECIAL_732>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "733": {
+      "content": "<SPECIAL_733>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "734": {
+      "content": "<SPECIAL_734>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "735": {
+      "content": "<SPECIAL_735>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "736": {
+      "content": "<SPECIAL_736>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "737": {
+      "content": "<SPECIAL_737>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "738": {
+      "content": "<SPECIAL_738>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "739": {
+      "content": "<SPECIAL_739>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "740": {
+      "content": "<SPECIAL_740>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "741": {
+      "content": "<SPECIAL_741>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "742": {
+      "content": "<SPECIAL_742>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "743": {
+      "content": "<SPECIAL_743>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "744": {
+      "content": "<SPECIAL_744>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "745": {
+      "content": "<SPECIAL_745>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "746": {
+      "content": "<SPECIAL_746>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "747": {
+      "content": "<SPECIAL_747>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "748": {
+      "content": "<SPECIAL_748>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "749": {
+      "content": "<SPECIAL_749>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "750": {
+      "content": "<SPECIAL_750>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "751": {
+      "content": "<SPECIAL_751>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "752": {
+      "content": "<SPECIAL_752>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "753": {
+      "content": "<SPECIAL_753>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "754": {
+      "content": "<SPECIAL_754>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "755": {
+      "content": "<SPECIAL_755>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "756": {
+      "content": "<SPECIAL_756>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "757": {
+      "content": "<SPECIAL_757>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "758": {
+      "content": "<SPECIAL_758>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "759": {
+      "content": "<SPECIAL_759>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "760": {
+      "content": "<SPECIAL_760>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "761": {
+      "content": "<SPECIAL_761>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "762": {
+      "content": "<SPECIAL_762>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "763": {
+      "content": "<SPECIAL_763>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "764": {
+      "content": "<SPECIAL_764>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "765": {
+      "content": "<SPECIAL_765>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "766": {
+      "content": "<SPECIAL_766>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "767": {
+      "content": "<SPECIAL_767>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "768": {
+      "content": "<SPECIAL_768>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "769": {
+      "content": "<SPECIAL_769>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "770": {
+      "content": "<SPECIAL_770>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "771": {
+      "content": "<SPECIAL_771>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "772": {
+      "content": "<SPECIAL_772>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "773": {
+      "content": "<SPECIAL_773>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "774": {
+      "content": "<SPECIAL_774>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "775": {
+      "content": "<SPECIAL_775>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "776": {
+      "content": "<SPECIAL_776>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "777": {
+      "content": "<SPECIAL_777>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "778": {
+      "content": "<SPECIAL_778>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "779": {
+      "content": "<SPECIAL_779>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "780": {
+      "content": "<SPECIAL_780>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "781": {
+      "content": "<SPECIAL_781>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "782": {
+      "content": "<SPECIAL_782>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "783": {
+      "content": "<SPECIAL_783>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "784": {
+      "content": "<SPECIAL_784>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "785": {
+      "content": "<SPECIAL_785>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "786": {
+      "content": "<SPECIAL_786>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "787": {
+      "content": "<SPECIAL_787>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "788": {
+      "content": "<SPECIAL_788>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "789": {
+      "content": "<SPECIAL_789>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "790": {
+      "content": "<SPECIAL_790>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "791": {
+      "content": "<SPECIAL_791>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "792": {
+      "content": "<SPECIAL_792>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "793": {
+      "content": "<SPECIAL_793>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "794": {
+      "content": "<SPECIAL_794>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "795": {
+      "content": "<SPECIAL_795>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "796": {
+      "content": "<SPECIAL_796>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "797": {
+      "content": "<SPECIAL_797>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "798": {
+      "content": "<SPECIAL_798>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "799": {
+      "content": "<SPECIAL_799>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "800": {
+      "content": "<SPECIAL_800>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "801": {
+      "content": "<SPECIAL_801>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "802": {
+      "content": "<SPECIAL_802>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "803": {
+      "content": "<SPECIAL_803>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "804": {
+      "content": "<SPECIAL_804>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "805": {
+      "content": "<SPECIAL_805>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "806": {
+      "content": "<SPECIAL_806>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "807": {
+      "content": "<SPECIAL_807>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "808": {
+      "content": "<SPECIAL_808>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "809": {
+      "content": "<SPECIAL_809>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "810": {
+      "content": "<SPECIAL_810>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "811": {
+      "content": "<SPECIAL_811>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "812": {
+      "content": "<SPECIAL_812>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "813": {
+      "content": "<SPECIAL_813>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "814": {
+      "content": "<SPECIAL_814>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "815": {
+      "content": "<SPECIAL_815>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "816": {
+      "content": "<SPECIAL_816>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "817": {
+      "content": "<SPECIAL_817>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "818": {
+      "content": "<SPECIAL_818>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "819": {
+      "content": "<SPECIAL_819>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "820": {
+      "content": "<SPECIAL_820>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "821": {
+      "content": "<SPECIAL_821>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "822": {
+      "content": "<SPECIAL_822>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "823": {
+      "content": "<SPECIAL_823>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "824": {
+      "content": "<SPECIAL_824>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "825": {
+      "content": "<SPECIAL_825>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "826": {
+      "content": "<SPECIAL_826>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "827": {
+      "content": "<SPECIAL_827>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "828": {
+      "content": "<SPECIAL_828>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "829": {
+      "content": "<SPECIAL_829>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "830": {
+      "content": "<SPECIAL_830>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "831": {
+      "content": "<SPECIAL_831>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "832": {
+      "content": "<SPECIAL_832>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "833": {
+      "content": "<SPECIAL_833>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "834": {
+      "content": "<SPECIAL_834>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "835": {
+      "content": "<SPECIAL_835>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "836": {
+      "content": "<SPECIAL_836>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "837": {
+      "content": "<SPECIAL_837>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "838": {
+      "content": "<SPECIAL_838>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "839": {
+      "content": "<SPECIAL_839>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "840": {
+      "content": "<SPECIAL_840>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "841": {
+      "content": "<SPECIAL_841>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "842": {
+      "content": "<SPECIAL_842>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "843": {
+      "content": "<SPECIAL_843>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "844": {
+      "content": "<SPECIAL_844>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "845": {
+      "content": "<SPECIAL_845>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "846": {
+      "content": "<SPECIAL_846>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "847": {
+      "content": "<SPECIAL_847>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "848": {
+      "content": "<SPECIAL_848>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "849": {
+      "content": "<SPECIAL_849>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "850": {
+      "content": "<SPECIAL_850>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "851": {
+      "content": "<SPECIAL_851>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "852": {
+      "content": "<SPECIAL_852>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "853": {
+      "content": "<SPECIAL_853>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "854": {
+      "content": "<SPECIAL_854>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "855": {
+      "content": "<SPECIAL_855>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "856": {
+      "content": "<SPECIAL_856>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "857": {
+      "content": "<SPECIAL_857>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "858": {
+      "content": "<SPECIAL_858>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "859": {
+      "content": "<SPECIAL_859>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "860": {
+      "content": "<SPECIAL_860>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "861": {
+      "content": "<SPECIAL_861>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "862": {
+      "content": "<SPECIAL_862>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "863": {
+      "content": "<SPECIAL_863>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "864": {
+      "content": "<SPECIAL_864>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "865": {
+      "content": "<SPECIAL_865>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "866": {
+      "content": "<SPECIAL_866>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "867": {
+      "content": "<SPECIAL_867>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "868": {
+      "content": "<SPECIAL_868>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "869": {
+      "content": "<SPECIAL_869>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "870": {
+      "content": "<SPECIAL_870>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "871": {
+      "content": "<SPECIAL_871>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "872": {
+      "content": "<SPECIAL_872>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "873": {
+      "content": "<SPECIAL_873>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "874": {
+      "content": "<SPECIAL_874>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "875": {
+      "content": "<SPECIAL_875>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "876": {
+      "content": "<SPECIAL_876>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "877": {
+      "content": "<SPECIAL_877>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "878": {
+      "content": "<SPECIAL_878>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "879": {
+      "content": "<SPECIAL_879>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "880": {
+      "content": "<SPECIAL_880>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "881": {
+      "content": "<SPECIAL_881>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "882": {
+      "content": "<SPECIAL_882>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "883": {
+      "content": "<SPECIAL_883>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "884": {
+      "content": "<SPECIAL_884>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "885": {
+      "content": "<SPECIAL_885>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "886": {
+      "content": "<SPECIAL_886>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "887": {
+      "content": "<SPECIAL_887>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "888": {
+      "content": "<SPECIAL_888>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "889": {
+      "content": "<SPECIAL_889>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "890": {
+      "content": "<SPECIAL_890>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "891": {
+      "content": "<SPECIAL_891>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "892": {
+      "content": "<SPECIAL_892>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "893": {
+      "content": "<SPECIAL_893>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "894": {
+      "content": "<SPECIAL_894>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "895": {
+      "content": "<SPECIAL_895>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "896": {
+      "content": "<SPECIAL_896>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "897": {
+      "content": "<SPECIAL_897>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "898": {
+      "content": "<SPECIAL_898>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "899": {
+      "content": "<SPECIAL_899>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "900": {
+      "content": "<SPECIAL_900>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "901": {
+      "content": "<SPECIAL_901>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "902": {
+      "content": "<SPECIAL_902>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "903": {
+      "content": "<SPECIAL_903>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "904": {
+      "content": "<SPECIAL_904>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "905": {
+      "content": "<SPECIAL_905>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "906": {
+      "content": "<SPECIAL_906>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "907": {
+      "content": "<SPECIAL_907>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "908": {
+      "content": "<SPECIAL_908>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "909": {
+      "content": "<SPECIAL_909>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "910": {
+      "content": "<SPECIAL_910>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "911": {
+      "content": "<SPECIAL_911>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "912": {
+      "content": "<SPECIAL_912>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "913": {
+      "content": "<SPECIAL_913>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "914": {
+      "content": "<SPECIAL_914>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "915": {
+      "content": "<SPECIAL_915>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "916": {
+      "content": "<SPECIAL_916>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "917": {
+      "content": "<SPECIAL_917>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "918": {
+      "content": "<SPECIAL_918>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "919": {
+      "content": "<SPECIAL_919>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "920": {
+      "content": "<SPECIAL_920>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "921": {
+      "content": "<SPECIAL_921>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "922": {
+      "content": "<SPECIAL_922>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "923": {
+      "content": "<SPECIAL_923>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "924": {
+      "content": "<SPECIAL_924>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "925": {
+      "content": "<SPECIAL_925>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "926": {
+      "content": "<SPECIAL_926>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "927": {
+      "content": "<SPECIAL_927>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "928": {
+      "content": "<SPECIAL_928>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "929": {
+      "content": "<SPECIAL_929>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "930": {
+      "content": "<SPECIAL_930>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "931": {
+      "content": "<SPECIAL_931>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "932": {
+      "content": "<SPECIAL_932>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "933": {
+      "content": "<SPECIAL_933>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "934": {
+      "content": "<SPECIAL_934>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "935": {
+      "content": "<SPECIAL_935>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "936": {
+      "content": "<SPECIAL_936>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "937": {
+      "content": "<SPECIAL_937>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "938": {
+      "content": "<SPECIAL_938>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "939": {
+      "content": "<SPECIAL_939>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "940": {
+      "content": "<SPECIAL_940>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "941": {
+      "content": "<SPECIAL_941>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "942": {
+      "content": "<SPECIAL_942>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "943": {
+      "content": "<SPECIAL_943>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "944": {
+      "content": "<SPECIAL_944>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "945": {
+      "content": "<SPECIAL_945>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "946": {
+      "content": "<SPECIAL_946>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "947": {
+      "content": "<SPECIAL_947>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "948": {
+      "content": "<SPECIAL_948>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "949": {
+      "content": "<SPECIAL_949>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "950": {
+      "content": "<SPECIAL_950>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "951": {
+      "content": "<SPECIAL_951>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "952": {
+      "content": "<SPECIAL_952>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "953": {
+      "content": "<SPECIAL_953>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "954": {
+      "content": "<SPECIAL_954>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "955": {
+      "content": "<SPECIAL_955>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "956": {
+      "content": "<SPECIAL_956>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "957": {
+      "content": "<SPECIAL_957>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "958": {
+      "content": "<SPECIAL_958>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "959": {
+      "content": "<SPECIAL_959>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "960": {
+      "content": "<SPECIAL_960>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "961": {
+      "content": "<SPECIAL_961>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "962": {
+      "content": "<SPECIAL_962>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "963": {
+      "content": "<SPECIAL_963>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "964": {
+      "content": "<SPECIAL_964>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "965": {
+      "content": "<SPECIAL_965>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "966": {
+      "content": "<SPECIAL_966>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "967": {
+      "content": "<SPECIAL_967>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "968": {
+      "content": "<SPECIAL_968>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "969": {
+      "content": "<SPECIAL_969>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "970": {
+      "content": "<SPECIAL_970>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "971": {
+      "content": "<SPECIAL_971>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "972": {
+      "content": "<SPECIAL_972>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "973": {
+      "content": "<SPECIAL_973>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "974": {
+      "content": "<SPECIAL_974>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "975": {
+      "content": "<SPECIAL_975>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "976": {
+      "content": "<SPECIAL_976>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "977": {
+      "content": "<SPECIAL_977>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "978": {
+      "content": "<SPECIAL_978>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "979": {
+      "content": "<SPECIAL_979>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "980": {
+      "content": "<SPECIAL_980>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "981": {
+      "content": "<SPECIAL_981>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "982": {
+      "content": "<SPECIAL_982>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "983": {
+      "content": "<SPECIAL_983>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "984": {
+      "content": "<SPECIAL_984>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "985": {
+      "content": "<SPECIAL_985>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "986": {
+      "content": "<SPECIAL_986>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "987": {
+      "content": "<SPECIAL_987>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "988": {
+      "content": "<SPECIAL_988>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "989": {
+      "content": "<SPECIAL_989>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "990": {
+      "content": "<SPECIAL_990>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "991": {
+      "content": "<SPECIAL_991>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "992": {
+      "content": "<SPECIAL_992>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "993": {
+      "content": "<SPECIAL_993>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "994": {
+      "content": "<SPECIAL_994>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "995": {
+      "content": "<SPECIAL_995>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "996": {
+      "content": "<SPECIAL_996>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "997": {
+      "content": "<SPECIAL_997>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "998": {
+      "content": "<SPECIAL_998>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "999": {
+      "content": "<SPECIAL_999>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "extra_special_tokens": {},
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "tokenizer_class": "PreTrainedTokenizer",
+  "unk_token": "<unk>"
+}
diff --git a/checkpoint-816/trainer_state.json b/checkpoint-816/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..6cfcd95742ca9758b0e81f7c3ba6d033bb18de0a
--- /dev/null
+++ b/checkpoint-816/trainer_state.json
@@ -0,0 +1,5802 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.497704315886134,
+  "eval_steps": 136,
+  "global_step": 816,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0018365472910927456,
+      "grad_norm": 0.49180246368465724,
+      "learning_rate": 0.0,
+      "loss": 1.3574,
+      "step": 1
+    },
+    {
+      "epoch": 0.0018365472910927456,
+      "eval_loss": 2.4259753227233887,
+      "eval_runtime": 39.8169,
+      "eval_samples_per_second": 5.149,
+      "eval_steps_per_second": 0.452,
+      "step": 1
+    },
+    {
+      "epoch": 0.0036730945821854912,
+      "grad_norm": 0.3994587341086747,
+      "learning_rate": 2.5000000000000004e-07,
+      "loss": 1.444,
+      "step": 2
+    },
+    {
+      "epoch": 0.005509641873278237,
+      "grad_norm": 0.39017597145072364,
+      "learning_rate": 5.000000000000001e-07,
+      "loss": 1.5149,
+      "step": 3
+    },
+    {
+      "epoch": 0.0073461891643709825,
+      "grad_norm": 0.47444439480391987,
+      "learning_rate": 7.5e-07,
+      "loss": 1.5855,
+      "step": 4
+    },
+    {
+      "epoch": 0.009182736455463728,
+      "grad_norm": 0.794434599507836,
+      "learning_rate": 1.0000000000000002e-06,
+      "loss": 1.6531,
+      "step": 5
+    },
+    {
+      "epoch": 0.011019283746556474,
+      "grad_norm": 0.7108153394196348,
+      "learning_rate": 1.25e-06,
+      "loss": 1.7881,
+      "step": 6
+    },
+    {
+      "epoch": 0.012855831037649219,
+      "grad_norm": 0.5204076611421804,
+      "learning_rate": 1.5e-06,
+      "loss": 1.5592,
+      "step": 7
+    },
+    {
+      "epoch": 0.014692378328741965,
+      "grad_norm": 0.7569351115766059,
+      "learning_rate": 1.75e-06,
+      "loss": 1.5735,
+      "step": 8
+    },
+    {
+      "epoch": 0.01652892561983471,
+      "grad_norm": 0.5678098307469198,
+      "learning_rate": 2.0000000000000003e-06,
+      "loss": 1.5934,
+      "step": 9
+    },
+    {
+      "epoch": 0.018365472910927456,
+      "grad_norm": 0.40098167184732914,
+      "learning_rate": 2.25e-06,
+      "loss": 1.688,
+      "step": 10
+    },
+    {
+      "epoch": 0.020202020202020204,
+      "grad_norm": 0.4268491869708594,
+      "learning_rate": 2.5e-06,
+      "loss": 1.6286,
+      "step": 11
+    },
+    {
+      "epoch": 0.02203856749311295,
+      "grad_norm": 0.5835872767276206,
+      "learning_rate": 2.7500000000000004e-06,
+      "loss": 1.679,
+      "step": 12
+    },
+    {
+      "epoch": 0.023875114784205693,
+      "grad_norm": 0.41861495783037117,
+      "learning_rate": 3e-06,
+      "loss": 1.7093,
+      "step": 13
+    },
+    {
+      "epoch": 0.025711662075298437,
+      "grad_norm": 0.3375113108661923,
+      "learning_rate": 3.2500000000000002e-06,
+      "loss": 1.7431,
+      "step": 14
+    },
+    {
+      "epoch": 0.027548209366391185,
+      "grad_norm": 0.48885555509704504,
+      "learning_rate": 3.5e-06,
+      "loss": 1.4873,
+      "step": 15
+    },
+    {
+      "epoch": 0.02938475665748393,
+      "grad_norm": 0.4483288005954393,
+      "learning_rate": 3.7500000000000005e-06,
+      "loss": 1.6619,
+      "step": 16
+    },
+    {
+      "epoch": 0.031221303948576674,
+      "grad_norm": 0.4299802045225574,
+      "learning_rate": 4.000000000000001e-06,
+      "loss": 1.6997,
+      "step": 17
+    },
+    {
+      "epoch": 0.03305785123966942,
+      "grad_norm": 0.5824485228901973,
+      "learning_rate": 4.25e-06,
+      "loss": 1.691,
+      "step": 18
+    },
+    {
+      "epoch": 0.03489439853076217,
+      "grad_norm": 0.32860558551239133,
+      "learning_rate": 4.5e-06,
+      "loss": 1.5414,
+      "step": 19
+    },
+    {
+      "epoch": 0.03673094582185491,
+      "grad_norm": 1.7514560949718712,
+      "learning_rate": 4.75e-06,
+      "loss": 1.522,
+      "step": 20
+    },
+    {
+      "epoch": 0.03856749311294766,
+      "grad_norm": 0.3844467204577219,
+      "learning_rate": 5e-06,
+      "loss": 1.6948,
+      "step": 21
+    },
+    {
+      "epoch": 0.04040404040404041,
+      "grad_norm": 0.329345071029554,
+      "learning_rate": 5.2500000000000006e-06,
+      "loss": 1.509,
+      "step": 22
+    },
+    {
+      "epoch": 0.04224058769513315,
+      "grad_norm": 0.28268786055882505,
+      "learning_rate": 5.500000000000001e-06,
+      "loss": 1.5563,
+      "step": 23
+    },
+    {
+      "epoch": 0.0440771349862259,
+      "grad_norm": 0.3422617324754064,
+      "learning_rate": 5.75e-06,
+      "loss": 1.5615,
+      "step": 24
+    },
+    {
+      "epoch": 0.04591368227731864,
+      "grad_norm": 0.33860326348440456,
+      "learning_rate": 6e-06,
+      "loss": 1.7008,
+      "step": 25
+    },
+    {
+      "epoch": 0.047750229568411386,
+      "grad_norm": 0.2789219845798442,
+      "learning_rate": 6.25e-06,
+      "loss": 1.5667,
+      "step": 26
+    },
+    {
+      "epoch": 0.049586776859504134,
+      "grad_norm": 0.37047693270617005,
+      "learning_rate": 6.5000000000000004e-06,
+      "loss": 1.5557,
+      "step": 27
+    },
+    {
+      "epoch": 0.051423324150596875,
+      "grad_norm": 0.3368470842339362,
+      "learning_rate": 6.750000000000001e-06,
+      "loss": 1.6045,
+      "step": 28
+    },
+    {
+      "epoch": 0.05325987144168962,
+      "grad_norm": 0.30344837893854465,
+      "learning_rate": 7e-06,
+      "loss": 1.6766,
+      "step": 29
+    },
+    {
+      "epoch": 0.05509641873278237,
+      "grad_norm": 0.6359004570618099,
+      "learning_rate": 7.25e-06,
+      "loss": 1.6499,
+      "step": 30
+    },
+    {
+      "epoch": 0.05693296602387511,
+      "grad_norm": 0.3258591226646554,
+      "learning_rate": 7.500000000000001e-06,
+      "loss": 1.6565,
+      "step": 31
+    },
+    {
+      "epoch": 0.05876951331496786,
+      "grad_norm": 0.3697834149605013,
+      "learning_rate": 7.75e-06,
+      "loss": 1.4883,
+      "step": 32
+    },
+    {
+      "epoch": 0.06060606060606061,
+      "grad_norm": 0.265668853003883,
+      "learning_rate": 8.000000000000001e-06,
+      "loss": 1.8289,
+      "step": 33
+    },
+    {
+      "epoch": 0.06244260789715335,
+      "grad_norm": 0.39987679350668315,
+      "learning_rate": 8.25e-06,
+      "loss": 1.6633,
+      "step": 34
+    },
+    {
+      "epoch": 0.0642791551882461,
+      "grad_norm": 0.39636333420956993,
+      "learning_rate": 8.5e-06,
+      "loss": 1.2298,
+      "step": 35
+    },
+    {
+      "epoch": 0.06611570247933884,
+      "grad_norm": 0.3464362348603123,
+      "learning_rate": 8.750000000000001e-06,
+      "loss": 1.485,
+      "step": 36
+    },
+    {
+      "epoch": 0.06795224977043159,
+      "grad_norm": 0.31616445355046285,
+      "learning_rate": 9e-06,
+      "loss": 1.5553,
+      "step": 37
+    },
+    {
+      "epoch": 0.06978879706152434,
+      "grad_norm": 0.4441888412468937,
+      "learning_rate": 9.250000000000001e-06,
+      "loss": 1.5967,
+      "step": 38
+    },
+    {
+      "epoch": 0.07162534435261708,
+      "grad_norm": 0.3547318554597848,
+      "learning_rate": 9.5e-06,
+      "loss": 1.5006,
+      "step": 39
+    },
+    {
+      "epoch": 0.07346189164370982,
+      "grad_norm": 0.27557088472944596,
+      "learning_rate": 9.75e-06,
+      "loss": 1.5673,
+      "step": 40
+    },
+    {
+      "epoch": 0.07529843893480258,
+      "grad_norm": 0.2956312497066916,
+      "learning_rate": 1e-05,
+      "loss": 1.4936,
+      "step": 41
+    },
+    {
+      "epoch": 0.07713498622589532,
+      "grad_norm": 0.2322611308466898,
+      "learning_rate": 9.999994591993822e-06,
+      "loss": 1.4759,
+      "step": 42
+    },
+    {
+      "epoch": 0.07897153351698806,
+      "grad_norm": 0.22039029040435731,
+      "learning_rate": 9.999978367986988e-06,
+      "loss": 1.6625,
+      "step": 43
+    },
+    {
+      "epoch": 0.08080808080808081,
+      "grad_norm": 0.3446344059315139,
+      "learning_rate": 9.999951328014591e-06,
+      "loss": 1.6309,
+      "step": 44
+    },
+    {
+      "epoch": 0.08264462809917356,
+      "grad_norm": 0.23666900781940328,
+      "learning_rate": 9.999913472135126e-06,
+      "loss": 1.5347,
+      "step": 45
+    },
+    {
+      "epoch": 0.0844811753902663,
+      "grad_norm": 0.2840328883351318,
+      "learning_rate": 9.999864800430482e-06,
+      "loss": 1.5115,
+      "step": 46
+    },
+    {
+      "epoch": 0.08631772268135904,
+      "grad_norm": 0.2407651293731456,
+      "learning_rate": 9.999805313005946e-06,
+      "loss": 1.4199,
+      "step": 47
+    },
+    {
+      "epoch": 0.0881542699724518,
+      "grad_norm": 0.24925631476018442,
+      "learning_rate": 9.999735009990202e-06,
+      "loss": 1.7008,
+      "step": 48
+    },
+    {
+      "epoch": 0.08999081726354453,
+      "grad_norm": 0.2502728573485842,
+      "learning_rate": 9.99965389153533e-06,
+      "loss": 1.6181,
+      "step": 49
+    },
+    {
+      "epoch": 0.09182736455463728,
+      "grad_norm": 0.23272569963887466,
+      "learning_rate": 9.999561957816803e-06,
+      "loss": 1.4668,
+      "step": 50
+    },
+    {
+      "epoch": 0.09366391184573003,
+      "grad_norm": 0.23492521900860228,
+      "learning_rate": 9.999459209033495e-06,
+      "loss": 1.6884,
+      "step": 51
+    },
+    {
+      "epoch": 0.09550045913682277,
+      "grad_norm": 0.24231529936066795,
+      "learning_rate": 9.999345645407671e-06,
+      "loss": 1.3811,
+      "step": 52
+    },
+    {
+      "epoch": 0.09733700642791551,
+      "grad_norm": 0.23749137313908725,
+      "learning_rate": 9.999221267184993e-06,
+      "loss": 1.6599,
+      "step": 53
+    },
+    {
+      "epoch": 0.09917355371900827,
+      "grad_norm": 0.2631749052017168,
+      "learning_rate": 9.999086074634516e-06,
+      "loss": 1.5321,
+      "step": 54
+    },
+    {
+      "epoch": 0.10101010101010101,
+      "grad_norm": 0.265780364913351,
+      "learning_rate": 9.998940068048688e-06,
+      "loss": 1.7954,
+      "step": 55
+    },
+    {
+      "epoch": 0.10284664830119375,
+      "grad_norm": 0.23373755925772408,
+      "learning_rate": 9.998783247743353e-06,
+      "loss": 1.6503,
+      "step": 56
+    },
+    {
+      "epoch": 0.1046831955922865,
+      "grad_norm": 0.26345499971500486,
+      "learning_rate": 9.998615614057743e-06,
+      "loss": 1.6842,
+      "step": 57
+    },
+    {
+      "epoch": 0.10651974288337925,
+      "grad_norm": 0.22858688890828285,
+      "learning_rate": 9.998437167354485e-06,
+      "loss": 1.6053,
+      "step": 58
+    },
+    {
+      "epoch": 0.10835629017447199,
+      "grad_norm": 0.22732836541277007,
+      "learning_rate": 9.998247908019594e-06,
+      "loss": 1.5357,
+      "step": 59
+    },
+    {
+      "epoch": 0.11019283746556474,
+      "grad_norm": 0.21575052353545032,
+      "learning_rate": 9.998047836462476e-06,
+      "loss": 1.5875,
+      "step": 60
+    },
+    {
+      "epoch": 0.11202938475665748,
+      "grad_norm": 0.3308350003540223,
+      "learning_rate": 9.997836953115927e-06,
+      "loss": 1.9333,
+      "step": 61
+    },
+    {
+      "epoch": 0.11386593204775022,
+      "grad_norm": 0.24160639887541288,
+      "learning_rate": 9.99761525843613e-06,
+      "loss": 1.6121,
+      "step": 62
+    },
+    {
+      "epoch": 0.11570247933884298,
+      "grad_norm": 0.23537591666009566,
+      "learning_rate": 9.997382752902658e-06,
+      "loss": 1.6341,
+      "step": 63
+    },
+    {
+      "epoch": 0.11753902662993572,
+      "grad_norm": 0.30577270648255184,
+      "learning_rate": 9.997139437018463e-06,
+      "loss": 1.4635,
+      "step": 64
+    },
+    {
+      "epoch": 0.11937557392102846,
+      "grad_norm": 0.24971896873950858,
+      "learning_rate": 9.996885311309892e-06,
+      "loss": 1.8186,
+      "step": 65
+    },
+    {
+      "epoch": 0.12121212121212122,
+      "grad_norm": 0.25847791225683553,
+      "learning_rate": 9.996620376326667e-06,
+      "loss": 1.491,
+      "step": 66
+    },
+    {
+      "epoch": 0.12304866850321396,
+      "grad_norm": 0.24031460889715148,
+      "learning_rate": 9.996344632641895e-06,
+      "loss": 1.6563,
+      "step": 67
+    },
+    {
+      "epoch": 0.1248852157943067,
+      "grad_norm": 0.2550524831797301,
+      "learning_rate": 9.996058080852067e-06,
+      "loss": 1.6427,
+      "step": 68
+    },
+    {
+      "epoch": 0.12672176308539945,
+      "grad_norm": 0.22467108780123965,
+      "learning_rate": 9.995760721577053e-06,
+      "loss": 1.4595,
+      "step": 69
+    },
+    {
+      "epoch": 0.1285583103764922,
+      "grad_norm": 0.282181674918973,
+      "learning_rate": 9.995452555460098e-06,
+      "loss": 1.6837,
+      "step": 70
+    },
+    {
+      "epoch": 0.13039485766758493,
+      "grad_norm": 0.5727450301366364,
+      "learning_rate": 9.995133583167833e-06,
+      "loss": 1.6003,
+      "step": 71
+    },
+    {
+      "epoch": 0.1322314049586777,
+      "grad_norm": 0.22744917091853156,
+      "learning_rate": 9.994803805390257e-06,
+      "loss": 1.3544,
+      "step": 72
+    },
+    {
+      "epoch": 0.13406795224977044,
+      "grad_norm": 0.22395196659772004,
+      "learning_rate": 9.994463222840748e-06,
+      "loss": 1.6198,
+      "step": 73
+    },
+    {
+      "epoch": 0.13590449954086317,
+      "grad_norm": 0.2098292344869194,
+      "learning_rate": 9.994111836256049e-06,
+      "loss": 1.5059,
+      "step": 74
+    },
+    {
+      "epoch": 0.13774104683195593,
+      "grad_norm": 0.22329332454983955,
+      "learning_rate": 9.993749646396286e-06,
+      "loss": 1.4666,
+      "step": 75
+    },
+    {
+      "epoch": 0.13957759412304868,
+      "grad_norm": 1.131446258847722,
+      "learning_rate": 9.993376654044948e-06,
+      "loss": 1.5164,
+      "step": 76
+    },
+    {
+      "epoch": 0.1414141414141414,
+      "grad_norm": 0.22716717526603358,
+      "learning_rate": 9.992992860008893e-06,
+      "loss": 1.4978,
+      "step": 77
+    },
+    {
+      "epoch": 0.14325068870523416,
+      "grad_norm": 0.24179796579866508,
+      "learning_rate": 9.992598265118344e-06,
+      "loss": 1.3147,
+      "step": 78
+    },
+    {
+      "epoch": 0.14508723599632692,
+      "grad_norm": 0.2127244611718112,
+      "learning_rate": 9.99219287022689e-06,
+      "loss": 1.4498,
+      "step": 79
+    },
+    {
+      "epoch": 0.14692378328741965,
+      "grad_norm": 0.27213431233903435,
+      "learning_rate": 9.991776676211483e-06,
+      "loss": 1.8822,
+      "step": 80
+    },
+    {
+      "epoch": 0.1487603305785124,
+      "grad_norm": 0.22988463490869612,
+      "learning_rate": 9.991349683972435e-06,
+      "loss": 1.4995,
+      "step": 81
+    },
+    {
+      "epoch": 0.15059687786960516,
+      "grad_norm": 0.23481878477688978,
+      "learning_rate": 9.990911894433415e-06,
+      "loss": 1.5132,
+      "step": 82
+    },
+    {
+      "epoch": 0.15243342516069788,
+      "grad_norm": 0.37026228973170716,
+      "learning_rate": 9.990463308541452e-06,
+      "loss": 1.5846,
+      "step": 83
+    },
+    {
+      "epoch": 0.15426997245179064,
+      "grad_norm": 0.34328184021255104,
+      "learning_rate": 9.990003927266928e-06,
+      "loss": 1.5882,
+      "step": 84
+    },
+    {
+      "epoch": 0.1561065197428834,
+      "grad_norm": 0.2239251502463014,
+      "learning_rate": 9.989533751603578e-06,
+      "loss": 1.5294,
+      "step": 85
+    },
+    {
+      "epoch": 0.15794306703397612,
+      "grad_norm": 0.2531093496713428,
+      "learning_rate": 9.989052782568484e-06,
+      "loss": 1.4136,
+      "step": 86
+    },
+    {
+      "epoch": 0.15977961432506887,
+      "grad_norm": 0.22960377831673873,
+      "learning_rate": 9.988561021202083e-06,
+      "loss": 1.5179,
+      "step": 87
+    },
+    {
+      "epoch": 0.16161616161616163,
+      "grad_norm": 0.2353475082843009,
+      "learning_rate": 9.988058468568154e-06,
+      "loss": 1.5986,
+      "step": 88
+    },
+    {
+      "epoch": 0.16345270890725436,
+      "grad_norm": 0.2095228695568511,
+      "learning_rate": 9.987545125753818e-06,
+      "loss": 1.7077,
+      "step": 89
+    },
+    {
+      "epoch": 0.1652892561983471,
+      "grad_norm": 0.25954954331361235,
+      "learning_rate": 9.987020993869543e-06,
+      "loss": 1.5786,
+      "step": 90
+    },
+    {
+      "epoch": 0.16712580348943984,
+      "grad_norm": 0.3475458310303135,
+      "learning_rate": 9.986486074049131e-06,
+      "loss": 1.6145,
+      "step": 91
+    },
+    {
+      "epoch": 0.1689623507805326,
+      "grad_norm": 0.26936951415786353,
+      "learning_rate": 9.98594036744972e-06,
+      "loss": 1.7652,
+      "step": 92
+    },
+    {
+      "epoch": 0.17079889807162535,
+      "grad_norm": 0.21373420050407635,
+      "learning_rate": 9.985383875251783e-06,
+      "loss": 1.6871,
+      "step": 93
+    },
+    {
+      "epoch": 0.17263544536271808,
+      "grad_norm": 0.23205711833790327,
+      "learning_rate": 9.98481659865913e-06,
+      "loss": 1.4672,
+      "step": 94
+    },
+    {
+      "epoch": 0.17447199265381083,
+      "grad_norm": 0.26381334544086116,
+      "learning_rate": 9.98423853889889e-06,
+      "loss": 1.6741,
+      "step": 95
+    },
+    {
+      "epoch": 0.1763085399449036,
+      "grad_norm": 0.24396664978240085,
+      "learning_rate": 9.983649697221528e-06,
+      "loss": 1.5546,
+      "step": 96
+    },
+    {
+      "epoch": 0.1781450872359963,
+      "grad_norm": 0.2533801841511916,
+      "learning_rate": 9.983050074900824e-06,
+      "loss": 1.6902,
+      "step": 97
+    },
+    {
+      "epoch": 0.17998163452708907,
+      "grad_norm": 0.2115479895852038,
+      "learning_rate": 9.982439673233885e-06,
+      "loss": 1.6094,
+      "step": 98
+    },
+    {
+      "epoch": 0.18181818181818182,
+      "grad_norm": 0.22659674725493387,
+      "learning_rate": 9.98181849354113e-06,
+      "loss": 1.3953,
+      "step": 99
+    },
+    {
+      "epoch": 0.18365472910927455,
+      "grad_norm": 0.4346020173346875,
+      "learning_rate": 9.981186537166301e-06,
+      "loss": 1.4842,
+      "step": 100
+    },
+    {
+      "epoch": 0.1854912764003673,
+      "grad_norm": 0.22752027491511684,
+      "learning_rate": 9.980543805476447e-06,
+      "loss": 1.6125,
+      "step": 101
+    },
+    {
+      "epoch": 0.18732782369146006,
+      "grad_norm": 0.2178158645117292,
+      "learning_rate": 9.979890299861923e-06,
+      "loss": 1.3843,
+      "step": 102
+    },
+    {
+      "epoch": 0.1891643709825528,
+      "grad_norm": 0.2629457576326313,
+      "learning_rate": 9.979226021736396e-06,
+      "loss": 1.5034,
+      "step": 103
+    },
+    {
+      "epoch": 0.19100091827364554,
+      "grad_norm": 0.2638758563035785,
+      "learning_rate": 9.978550972536834e-06,
+      "loss": 1.2882,
+      "step": 104
+    },
+    {
+      "epoch": 0.1928374655647383,
+      "grad_norm": 0.25957055432676646,
+      "learning_rate": 9.977865153723508e-06,
+      "loss": 1.5669,
+      "step": 105
+    },
+    {
+      "epoch": 0.19467401285583102,
+      "grad_norm": 0.2107272760638706,
+      "learning_rate": 9.977168566779976e-06,
+      "loss": 1.4316,
+      "step": 106
+    },
+    {
+      "epoch": 0.19651056014692378,
+      "grad_norm": 0.23996444946668347,
+      "learning_rate": 9.976461213213104e-06,
+      "loss": 1.5958,
+      "step": 107
+    },
+    {
+      "epoch": 0.19834710743801653,
+      "grad_norm": 0.3866853138626082,
+      "learning_rate": 9.975743094553037e-06,
+      "loss": 1.6301,
+      "step": 108
+    },
+    {
+      "epoch": 0.20018365472910926,
+      "grad_norm": 0.2659575860373734,
+      "learning_rate": 9.975014212353212e-06,
+      "loss": 1.6435,
+      "step": 109
+    },
+    {
+      "epoch": 0.20202020202020202,
+      "grad_norm": 0.25698703101518205,
+      "learning_rate": 9.974274568190349e-06,
+      "loss": 1.4947,
+      "step": 110
+    },
+    {
+      "epoch": 0.20385674931129477,
+      "grad_norm": 0.23394729883248447,
+      "learning_rate": 9.973524163664447e-06,
+      "loss": 1.5486,
+      "step": 111
+    },
+    {
+      "epoch": 0.2056932966023875,
+      "grad_norm": 0.2682338169486529,
+      "learning_rate": 9.972763000398784e-06,
+      "loss": 1.562,
+      "step": 112
+    },
+    {
+      "epoch": 0.20752984389348025,
+      "grad_norm": 0.22594240276292787,
+      "learning_rate": 9.971991080039912e-06,
+      "loss": 1.6665,
+      "step": 113
+    },
+    {
+      "epoch": 0.209366391184573,
+      "grad_norm": 0.2716099274981758,
+      "learning_rate": 9.971208404257647e-06,
+      "loss": 1.6069,
+      "step": 114
+    },
+    {
+      "epoch": 0.21120293847566574,
+      "grad_norm": 0.215642600558555,
+      "learning_rate": 9.970414974745077e-06,
+      "loss": 1.426,
+      "step": 115
+    },
+    {
+      "epoch": 0.2130394857667585,
+      "grad_norm": 0.26192594390837787,
+      "learning_rate": 9.96961079321855e-06,
+      "loss": 1.4929,
+      "step": 116
+    },
+    {
+      "epoch": 0.21487603305785125,
+      "grad_norm": 0.24076680870279565,
+      "learning_rate": 9.968795861417676e-06,
+      "loss": 1.5116,
+      "step": 117
+    },
+    {
+      "epoch": 0.21671258034894397,
+      "grad_norm": 0.20785778608018918,
+      "learning_rate": 9.967970181105315e-06,
+      "loss": 1.4824,
+      "step": 118
+    },
+    {
+      "epoch": 0.21854912764003673,
+      "grad_norm": 0.2474137833375562,
+      "learning_rate": 9.967133754067581e-06,
+      "loss": 1.6394,
+      "step": 119
+    },
+    {
+      "epoch": 0.22038567493112948,
+      "grad_norm": 0.2415950163286452,
+      "learning_rate": 9.966286582113838e-06,
+      "loss": 1.4747,
+      "step": 120
+    },
+    {
+      "epoch": 0.2222222222222222,
+      "grad_norm": 0.25397048864143756,
+      "learning_rate": 9.965428667076687e-06,
+      "loss": 1.626,
+      "step": 121
+    },
+    {
+      "epoch": 0.22405876951331496,
+      "grad_norm": 0.27597092429735764,
+      "learning_rate": 9.964560010811972e-06,
+      "loss": 1.4853,
+      "step": 122
+    },
+    {
+      "epoch": 0.22589531680440772,
+      "grad_norm": 0.2773282618369793,
+      "learning_rate": 9.963680615198774e-06,
+      "loss": 1.2673,
+      "step": 123
+    },
+    {
+      "epoch": 0.22773186409550045,
+      "grad_norm": 0.2863982446521439,
+      "learning_rate": 9.962790482139402e-06,
+      "loss": 1.4531,
+      "step": 124
+    },
+    {
+      "epoch": 0.2295684113865932,
+      "grad_norm": 0.24940341962059176,
+      "learning_rate": 9.961889613559396e-06,
+      "loss": 1.5392,
+      "step": 125
+    },
+    {
+      "epoch": 0.23140495867768596,
+      "grad_norm": 0.2692207944659178,
+      "learning_rate": 9.960978011407516e-06,
+      "loss": 1.3452,
+      "step": 126
+    },
+    {
+      "epoch": 0.23324150596877868,
+      "grad_norm": 0.2394265357414062,
+      "learning_rate": 9.960055677655743e-06,
+      "loss": 1.4267,
+      "step": 127
+    },
+    {
+      "epoch": 0.23507805325987144,
+      "grad_norm": 0.2396211231483559,
+      "learning_rate": 9.95912261429927e-06,
+      "loss": 1.669,
+      "step": 128
+    },
+    {
+      "epoch": 0.2369146005509642,
+      "grad_norm": 0.22480647337089882,
+      "learning_rate": 9.958178823356503e-06,
+      "loss": 1.3276,
+      "step": 129
+    },
+    {
+      "epoch": 0.23875114784205692,
+      "grad_norm": 0.2322223276315898,
+      "learning_rate": 9.957224306869053e-06,
+      "loss": 1.6457,
+      "step": 130
+    },
+    {
+      "epoch": 0.24058769513314968,
+      "grad_norm": 0.28675358511507826,
+      "learning_rate": 9.956259066901733e-06,
+      "loss": 1.4844,
+      "step": 131
+    },
+    {
+      "epoch": 0.24242424242424243,
+      "grad_norm": 0.23506904729263256,
+      "learning_rate": 9.955283105542551e-06,
+      "loss": 1.5401,
+      "step": 132
+    },
+    {
+      "epoch": 0.24426078971533516,
+      "grad_norm": 0.25409979083106216,
+      "learning_rate": 9.954296424902709e-06,
+      "loss": 1.5796,
+      "step": 133
+    },
+    {
+      "epoch": 0.2460973370064279,
+      "grad_norm": 0.27537727017693314,
+      "learning_rate": 9.953299027116598e-06,
+      "loss": 1.7015,
+      "step": 134
+    },
+    {
+      "epoch": 0.24793388429752067,
+      "grad_norm": 0.255527421712665,
+      "learning_rate": 9.95229091434179e-06,
+      "loss": 1.6943,
+      "step": 135
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "grad_norm": 0.2758931212786201,
+      "learning_rate": 9.95127208875904e-06,
+      "loss": 1.6373,
+      "step": 136
+    },
+    {
+      "epoch": 0.2497704315886134,
+      "eval_loss": 2.332951307296753,
+      "eval_runtime": 38.5842,
+      "eval_samples_per_second": 5.313,
+      "eval_steps_per_second": 0.467,
+      "step": 136
+    },
+    {
+      "epoch": 0.2516069788797062,
+      "grad_norm": 0.4849948087122718,
+      "learning_rate": 9.950242552572272e-06,
+      "loss": 1.5843,
+      "step": 137
+    },
+    {
+      "epoch": 0.2534435261707989,
+      "grad_norm": 0.27082023040786063,
+      "learning_rate": 9.949202308008581e-06,
+      "loss": 1.466,
+      "step": 138
+    },
+    {
+      "epoch": 0.25528007346189163,
+      "grad_norm": 0.21412319589684112,
+      "learning_rate": 9.948151357318228e-06,
+      "loss": 1.5575,
+      "step": 139
+    },
+    {
+      "epoch": 0.2571166207529844,
+      "grad_norm": 0.2630300060870272,
+      "learning_rate": 9.94708970277463e-06,
+      "loss": 1.8459,
+      "step": 140
+    },
+    {
+      "epoch": 0.25895316804407714,
+      "grad_norm": 0.29584228360860926,
+      "learning_rate": 9.946017346674362e-06,
+      "loss": 1.4765,
+      "step": 141
+    },
+    {
+      "epoch": 0.26078971533516987,
+      "grad_norm": 0.20420849217608372,
+      "learning_rate": 9.944934291337146e-06,
+      "loss": 1.3963,
+      "step": 142
+    },
+    {
+      "epoch": 0.26262626262626265,
+      "grad_norm": 0.2383087119690396,
+      "learning_rate": 9.943840539105853e-06,
+      "loss": 1.6948,
+      "step": 143
+    },
+    {
+      "epoch": 0.2644628099173554,
+      "grad_norm": 0.22707287878559146,
+      "learning_rate": 9.942736092346487e-06,
+      "loss": 1.5627,
+      "step": 144
+    },
+    {
+      "epoch": 0.2662993572084481,
+      "grad_norm": 0.2209791613669926,
+      "learning_rate": 9.941620953448195e-06,
+      "loss": 1.6011,
+      "step": 145
+    },
+    {
+      "epoch": 0.2681359044995409,
+      "grad_norm": 0.23620122895922513,
+      "learning_rate": 9.940495124823241e-06,
+      "loss": 1.4172,
+      "step": 146
+    },
+    {
+      "epoch": 0.2699724517906336,
+      "grad_norm": 0.4575809432111337,
+      "learning_rate": 9.939358608907026e-06,
+      "loss": 1.8045,
+      "step": 147
+    },
+    {
+      "epoch": 0.27180899908172634,
+      "grad_norm": 0.25576228816691954,
+      "learning_rate": 9.938211408158063e-06,
+      "loss": 1.5559,
+      "step": 148
+    },
+    {
+      "epoch": 0.2736455463728191,
+      "grad_norm": 0.32262207355286887,
+      "learning_rate": 9.937053525057977e-06,
+      "loss": 1.6491,
+      "step": 149
+    },
+    {
+      "epoch": 0.27548209366391185,
+      "grad_norm": 0.29602023759033497,
+      "learning_rate": 9.935884962111506e-06,
+      "loss": 1.6518,
+      "step": 150
+    },
+    {
+      "epoch": 0.2773186409550046,
+      "grad_norm": 0.24182886602369053,
+      "learning_rate": 9.934705721846487e-06,
+      "loss": 1.5457,
+      "step": 151
+    },
+    {
+      "epoch": 0.27915518824609736,
+      "grad_norm": 0.2247571699952089,
+      "learning_rate": 9.933515806813856e-06,
+      "loss": 1.481,
+      "step": 152
+    },
+    {
+      "epoch": 0.2809917355371901,
+      "grad_norm": 0.24890915769392072,
+      "learning_rate": 9.932315219587641e-06,
+      "loss": 1.618,
+      "step": 153
+    },
+    {
+      "epoch": 0.2828282828282828,
+      "grad_norm": 0.2597194625874549,
+      "learning_rate": 9.931103962764955e-06,
+      "loss": 1.5653,
+      "step": 154
+    },
+    {
+      "epoch": 0.2846648301193756,
+      "grad_norm": 0.23725030845640346,
+      "learning_rate": 9.92988203896599e-06,
+      "loss": 1.4677,
+      "step": 155
+    },
+    {
+      "epoch": 0.2865013774104683,
+      "grad_norm": 0.20619150412894088,
+      "learning_rate": 9.928649450834015e-06,
+      "loss": 1.6779,
+      "step": 156
+    },
+    {
+      "epoch": 0.28833792470156105,
+      "grad_norm": 0.23919303859135752,
+      "learning_rate": 9.927406201035368e-06,
+      "loss": 1.4417,
+      "step": 157
+    },
+    {
+      "epoch": 0.29017447199265384,
+      "grad_norm": 0.2244668514529571,
+      "learning_rate": 9.926152292259452e-06,
+      "loss": 1.7272,
+      "step": 158
+    },
+    {
+      "epoch": 0.29201101928374656,
+      "grad_norm": 0.26954841337527125,
+      "learning_rate": 9.924887727218724e-06,
+      "loss": 1.6068,
+      "step": 159
+    },
+    {
+      "epoch": 0.2938475665748393,
+      "grad_norm": 0.32951953455251004,
+      "learning_rate": 9.923612508648693e-06,
+      "loss": 1.406,
+      "step": 160
+    },
+    {
+      "epoch": 0.2956841138659321,
+      "grad_norm": 0.2698529792514822,
+      "learning_rate": 9.922326639307918e-06,
+      "loss": 1.683,
+      "step": 161
+    },
+    {
+      "epoch": 0.2975206611570248,
+      "grad_norm": 0.22420186125700636,
+      "learning_rate": 9.921030121977992e-06,
+      "loss": 1.5398,
+      "step": 162
+    },
+    {
+      "epoch": 0.29935720844811753,
+      "grad_norm": 0.24335042870850987,
+      "learning_rate": 9.919722959463545e-06,
+      "loss": 1.5752,
+      "step": 163
+    },
+    {
+      "epoch": 0.3011937557392103,
+      "grad_norm": 0.272993009874352,
+      "learning_rate": 9.918405154592234e-06,
+      "loss": 1.6791,
+      "step": 164
+    },
+    {
+      "epoch": 0.30303030303030304,
+      "grad_norm": 0.36447396005561716,
+      "learning_rate": 9.917076710214739e-06,
+      "loss": 1.8303,
+      "step": 165
+    },
+    {
+      "epoch": 0.30486685032139577,
+      "grad_norm": 0.266743073761148,
+      "learning_rate": 9.915737629204754e-06,
+      "loss": 1.652,
+      "step": 166
+    },
+    {
+      "epoch": 0.30670339761248855,
+      "grad_norm": 0.22394219745904015,
+      "learning_rate": 9.914387914458983e-06,
+      "loss": 1.5615,
+      "step": 167
+    },
+    {
+      "epoch": 0.3085399449035813,
+      "grad_norm": 0.23075889412968112,
+      "learning_rate": 9.91302756889713e-06,
+      "loss": 1.6447,
+      "step": 168
+    },
+    {
+      "epoch": 0.310376492194674,
+      "grad_norm": 0.2441975693564735,
+      "learning_rate": 9.911656595461899e-06,
+      "loss": 1.5981,
+      "step": 169
+    },
+    {
+      "epoch": 0.3122130394857668,
+      "grad_norm": 0.21377545765414097,
+      "learning_rate": 9.910274997118982e-06,
+      "loss": 1.6066,
+      "step": 170
+    },
+    {
+      "epoch": 0.3140495867768595,
+      "grad_norm": 0.21518096806340806,
+      "learning_rate": 9.908882776857057e-06,
+      "loss": 1.199,
+      "step": 171
+    },
+    {
+      "epoch": 0.31588613406795224,
+      "grad_norm": 0.22989533865542952,
+      "learning_rate": 9.907479937687779e-06,
+      "loss": 1.6019,
+      "step": 172
+    },
+    {
+      "epoch": 0.317722681359045,
+      "grad_norm": 0.24187157970795195,
+      "learning_rate": 9.906066482645774e-06,
+      "loss": 1.5453,
+      "step": 173
+    },
+    {
+      "epoch": 0.31955922865013775,
+      "grad_norm": 0.28880156295741904,
+      "learning_rate": 9.904642414788627e-06,
+      "loss": 1.6518,
+      "step": 174
+    },
+    {
+      "epoch": 0.3213957759412305,
+      "grad_norm": 0.3064989299701211,
+      "learning_rate": 9.903207737196892e-06,
+      "loss": 1.5614,
+      "step": 175
+    },
+    {
+      "epoch": 0.32323232323232326,
+      "grad_norm": 0.5501951504862674,
+      "learning_rate": 9.90176245297406e-06,
+      "loss": 1.3988,
+      "step": 176
+    },
+    {
+      "epoch": 0.325068870523416,
+      "grad_norm": 0.23086867624049656,
+      "learning_rate": 9.900306565246579e-06,
+      "loss": 1.4688,
+      "step": 177
+    },
+    {
+      "epoch": 0.3269054178145087,
+      "grad_norm": 0.24109267951104685,
+      "learning_rate": 9.898840077163824e-06,
+      "loss": 1.342,
+      "step": 178
+    },
+    {
+      "epoch": 0.3287419651056015,
+      "grad_norm": 0.221519141054226,
+      "learning_rate": 9.89736299189811e-06,
+      "loss": 1.6468,
+      "step": 179
+    },
+    {
+      "epoch": 0.3305785123966942,
+      "grad_norm": 0.2134481965910651,
+      "learning_rate": 9.89587531264467e-06,
+      "loss": 1.4762,
+      "step": 180
+    },
+    {
+      "epoch": 0.33241505968778695,
+      "grad_norm": 0.30273218459666634,
+      "learning_rate": 9.894377042621654e-06,
+      "loss": 1.2952,
+      "step": 181
+    },
+    {
+      "epoch": 0.3342516069788797,
+      "grad_norm": 0.2643249012553608,
+      "learning_rate": 9.892868185070125e-06,
+      "loss": 1.5922,
+      "step": 182
+    },
+    {
+      "epoch": 0.33608815426997246,
+      "grad_norm": 0.3017798778461224,
+      "learning_rate": 9.891348743254046e-06,
+      "loss": 1.3327,
+      "step": 183
+    },
+    {
+      "epoch": 0.3379247015610652,
+      "grad_norm": 0.198099058736144,
+      "learning_rate": 9.889818720460281e-06,
+      "loss": 1.4528,
+      "step": 184
+    },
+    {
+      "epoch": 0.3397612488521579,
+      "grad_norm": 0.2342720457991802,
+      "learning_rate": 9.888278119998573e-06,
+      "loss": 1.396,
+      "step": 185
+    },
+    {
+      "epoch": 0.3415977961432507,
+      "grad_norm": 0.30360601805904236,
+      "learning_rate": 9.886726945201556e-06,
+      "loss": 1.5982,
+      "step": 186
+    },
+    {
+      "epoch": 0.3434343434343434,
+      "grad_norm": 0.2890684354336481,
+      "learning_rate": 9.885165199424738e-06,
+      "loss": 1.3935,
+      "step": 187
+    },
+    {
+      "epoch": 0.34527089072543615,
+      "grad_norm": 0.2574557316071565,
+      "learning_rate": 9.883592886046486e-06,
+      "loss": 1.449,
+      "step": 188
+    },
+    {
+      "epoch": 0.34710743801652894,
+      "grad_norm": 0.23195985985184547,
+      "learning_rate": 9.882010008468038e-06,
+      "loss": 1.4909,
+      "step": 189
+    },
+    {
+      "epoch": 0.34894398530762166,
+      "grad_norm": 0.2539011848151687,
+      "learning_rate": 9.880416570113472e-06,
+      "loss": 1.5123,
+      "step": 190
+    },
+    {
+      "epoch": 0.3507805325987144,
+      "grad_norm": 0.26954455617431194,
+      "learning_rate": 9.878812574429722e-06,
+      "loss": 1.4445,
+      "step": 191
+    },
+    {
+      "epoch": 0.3526170798898072,
+      "grad_norm": 0.23141695311529595,
+      "learning_rate": 9.877198024886553e-06,
+      "loss": 1.9045,
+      "step": 192
+    },
+    {
+      "epoch": 0.3544536271808999,
+      "grad_norm": 0.2750943021523168,
+      "learning_rate": 9.875572924976568e-06,
+      "loss": 1.5868,
+      "step": 193
+    },
+    {
+      "epoch": 0.3562901744719926,
+      "grad_norm": 0.23421966078059409,
+      "learning_rate": 9.873937278215181e-06,
+      "loss": 1.7534,
+      "step": 194
+    },
+    {
+      "epoch": 0.3581267217630854,
+      "grad_norm": 0.24409550991932608,
+      "learning_rate": 9.87229108814063e-06,
+      "loss": 1.4753,
+      "step": 195
+    },
+    {
+      "epoch": 0.35996326905417814,
+      "grad_norm": 0.24998063066925763,
+      "learning_rate": 9.870634358313956e-06,
+      "loss": 1.6574,
+      "step": 196
+    },
+    {
+      "epoch": 0.36179981634527086,
+      "grad_norm": 0.2630317204109116,
+      "learning_rate": 9.868967092319003e-06,
+      "loss": 1.6794,
+      "step": 197
+    },
+    {
+      "epoch": 0.36363636363636365,
+      "grad_norm": 0.21473616516429722,
+      "learning_rate": 9.867289293762403e-06,
+      "loss": 1.7626,
+      "step": 198
+    },
+    {
+      "epoch": 0.3654729109274564,
+      "grad_norm": 0.3020374891635284,
+      "learning_rate": 9.865600966273576e-06,
+      "loss": 1.5234,
+      "step": 199
+    },
+    {
+      "epoch": 0.3673094582185491,
+      "grad_norm": 0.24122137539024896,
+      "learning_rate": 9.863902113504713e-06,
+      "loss": 1.5807,
+      "step": 200
+    },
+    {
+      "epoch": 0.3691460055096419,
+      "grad_norm": 0.2240345557985464,
+      "learning_rate": 9.86219273913078e-06,
+      "loss": 1.4635,
+      "step": 201
+    },
+    {
+      "epoch": 0.3709825528007346,
+      "grad_norm": 0.2561505890958098,
+      "learning_rate": 9.860472846849498e-06,
+      "loss": 1.5781,
+      "step": 202
+    },
+    {
+      "epoch": 0.37281910009182734,
+      "grad_norm": 0.2629334369467521,
+      "learning_rate": 9.858742440381343e-06,
+      "loss": 1.3698,
+      "step": 203
+    },
+    {
+      "epoch": 0.3746556473829201,
+      "grad_norm": 0.2643820816427679,
+      "learning_rate": 9.857001523469534e-06,
+      "loss": 1.6831,
+      "step": 204
+    },
+    {
+      "epoch": 0.37649219467401285,
+      "grad_norm": 0.27568924761133784,
+      "learning_rate": 9.855250099880026e-06,
+      "loss": 1.5586,
+      "step": 205
+    },
+    {
+      "epoch": 0.3783287419651056,
+      "grad_norm": 0.23562831853645116,
+      "learning_rate": 9.853488173401504e-06,
+      "loss": 1.4529,
+      "step": 206
+    },
+    {
+      "epoch": 0.38016528925619836,
+      "grad_norm": 0.24270051421435648,
+      "learning_rate": 9.851715747845372e-06,
+      "loss": 1.5449,
+      "step": 207
+    },
+    {
+      "epoch": 0.3820018365472911,
+      "grad_norm": 0.3141794855298513,
+      "learning_rate": 9.849932827045746e-06,
+      "loss": 1.6011,
+      "step": 208
+    },
+    {
+      "epoch": 0.3838383838383838,
+      "grad_norm": 0.2347451989106533,
+      "learning_rate": 9.848139414859441e-06,
+      "loss": 1.7994,
+      "step": 209
+    },
+    {
+      "epoch": 0.3856749311294766,
+      "grad_norm": 0.22998314428761488,
+      "learning_rate": 9.846335515165974e-06,
+      "loss": 1.5024,
+      "step": 210
+    },
+    {
+      "epoch": 0.3875114784205693,
+      "grad_norm": 0.2914601119925799,
+      "learning_rate": 9.844521131867546e-06,
+      "loss": 1.6718,
+      "step": 211
+    },
+    {
+      "epoch": 0.38934802571166205,
+      "grad_norm": 0.27307242607178106,
+      "learning_rate": 9.842696268889032e-06,
+      "loss": 1.6705,
+      "step": 212
+    },
+    {
+      "epoch": 0.39118457300275483,
+      "grad_norm": 0.26989044058601575,
+      "learning_rate": 9.840860930177984e-06,
+      "loss": 1.5762,
+      "step": 213
+    },
+    {
+      "epoch": 0.39302112029384756,
+      "grad_norm": 0.23544376195311703,
+      "learning_rate": 9.839015119704607e-06,
+      "loss": 1.4928,
+      "step": 214
+    },
+    {
+      "epoch": 0.3948576675849403,
+      "grad_norm": 0.40380733954206144,
+      "learning_rate": 9.837158841461767e-06,
+      "loss": 1.5587,
+      "step": 215
+    },
+    {
+      "epoch": 0.39669421487603307,
+      "grad_norm": 0.2416750029017525,
+      "learning_rate": 9.835292099464965e-06,
+      "loss": 1.4265,
+      "step": 216
+    },
+    {
+      "epoch": 0.3985307621671258,
+      "grad_norm": 0.20943162169896912,
+      "learning_rate": 9.833414897752346e-06,
+      "loss": 1.5836,
+      "step": 217
+    },
+    {
+      "epoch": 0.4003673094582185,
+      "grad_norm": 0.24319317049956413,
+      "learning_rate": 9.831527240384677e-06,
+      "loss": 1.6154,
+      "step": 218
+    },
+    {
+      "epoch": 0.4022038567493113,
+      "grad_norm": 0.2375469014345421,
+      "learning_rate": 9.829629131445342e-06,
+      "loss": 1.5652,
+      "step": 219
+    },
+    {
+      "epoch": 0.40404040404040403,
+      "grad_norm": 0.27739989413008637,
+      "learning_rate": 9.827720575040335e-06,
+      "loss": 1.5439,
+      "step": 220
+    },
+    {
+      "epoch": 0.40587695133149676,
+      "grad_norm": 0.24247147004672653,
+      "learning_rate": 9.825801575298248e-06,
+      "loss": 1.4613,
+      "step": 221
+    },
+    {
+      "epoch": 0.40771349862258954,
+      "grad_norm": 0.29413816874548104,
+      "learning_rate": 9.82387213637027e-06,
+      "loss": 1.4005,
+      "step": 222
+    },
+    {
+      "epoch": 0.40955004591368227,
+      "grad_norm": 0.21318983016138546,
+      "learning_rate": 9.821932262430164e-06,
+      "loss": 1.4747,
+      "step": 223
+    },
+    {
+      "epoch": 0.411386593204775,
+      "grad_norm": 0.24655890709082884,
+      "learning_rate": 9.819981957674273e-06,
+      "loss": 1.6599,
+      "step": 224
+    },
+    {
+      "epoch": 0.4132231404958678,
+      "grad_norm": 0.23420376177876423,
+      "learning_rate": 9.818021226321502e-06,
+      "loss": 1.5039,
+      "step": 225
+    },
+    {
+      "epoch": 0.4150596877869605,
+      "grad_norm": 0.23379966460981552,
+      "learning_rate": 9.816050072613306e-06,
+      "loss": 1.775,
+      "step": 226
+    },
+    {
+      "epoch": 0.41689623507805323,
+      "grad_norm": 0.30210714633151925,
+      "learning_rate": 9.814068500813692e-06,
+      "loss": 1.5692,
+      "step": 227
+    },
+    {
+      "epoch": 0.418732782369146,
+      "grad_norm": 0.24124025669836516,
+      "learning_rate": 9.812076515209201e-06,
+      "loss": 1.5682,
+      "step": 228
+    },
+    {
+      "epoch": 0.42056932966023874,
+      "grad_norm": 0.40694547415364124,
+      "learning_rate": 9.8100741201089e-06,
+      "loss": 1.3886,
+      "step": 229
+    },
+    {
+      "epoch": 0.42240587695133147,
+      "grad_norm": 0.5017797555556736,
+      "learning_rate": 9.808061319844376e-06,
+      "loss": 1.5096,
+      "step": 230
+    },
+    {
+      "epoch": 0.42424242424242425,
+      "grad_norm": 0.2395927998641603,
+      "learning_rate": 9.806038118769724e-06,
+      "loss": 1.6511,
+      "step": 231
+    },
+    {
+      "epoch": 0.426078971533517,
+      "grad_norm": 0.26346897129489716,
+      "learning_rate": 9.804004521261537e-06,
+      "loss": 1.4852,
+      "step": 232
+    },
+    {
+      "epoch": 0.4279155188246097,
+      "grad_norm": 0.21927054884906805,
+      "learning_rate": 9.801960531718898e-06,
+      "loss": 1.3796,
+      "step": 233
+    },
+    {
+      "epoch": 0.4297520661157025,
+      "grad_norm": 0.21216613988150154,
+      "learning_rate": 9.79990615456337e-06,
+      "loss": 1.3236,
+      "step": 234
+    },
+    {
+      "epoch": 0.4315886134067952,
+      "grad_norm": 0.2439837140444034,
+      "learning_rate": 9.797841394238987e-06,
+      "loss": 1.4752,
+      "step": 235
+    },
+    {
+      "epoch": 0.43342516069788795,
+      "grad_norm": 0.20264650772176668,
+      "learning_rate": 9.795766255212242e-06,
+      "loss": 1.4633,
+      "step": 236
+    },
+    {
+      "epoch": 0.43526170798898073,
+      "grad_norm": 0.2214142026219714,
+      "learning_rate": 9.793680741972084e-06,
+      "loss": 1.524,
+      "step": 237
+    },
+    {
+      "epoch": 0.43709825528007346,
+      "grad_norm": 0.32400463641987054,
+      "learning_rate": 9.791584859029901e-06,
+      "loss": 1.7717,
+      "step": 238
+    },
+    {
+      "epoch": 0.4389348025711662,
+      "grad_norm": 0.25353704234527624,
+      "learning_rate": 9.789478610919508e-06,
+      "loss": 1.4503,
+      "step": 239
+    },
+    {
+      "epoch": 0.44077134986225897,
+      "grad_norm": 0.28666088570706005,
+      "learning_rate": 9.787362002197147e-06,
+      "loss": 1.5374,
+      "step": 240
+    },
+    {
+      "epoch": 0.4426078971533517,
+      "grad_norm": 0.2575712788223055,
+      "learning_rate": 9.785235037441473e-06,
+      "loss": 1.3976,
+      "step": 241
+    },
+    {
+      "epoch": 0.4444444444444444,
+      "grad_norm": 0.235205219080783,
+      "learning_rate": 9.783097721253543e-06,
+      "loss": 1.6037,
+      "step": 242
+    },
+    {
+      "epoch": 0.4462809917355372,
+      "grad_norm": 0.23780080068966725,
+      "learning_rate": 9.780950058256802e-06,
+      "loss": 1.679,
+      "step": 243
+    },
+    {
+      "epoch": 0.44811753902662993,
+      "grad_norm": 0.3404150158565561,
+      "learning_rate": 9.778792053097079e-06,
+      "loss": 1.3573,
+      "step": 244
+    },
+    {
+      "epoch": 0.44995408631772266,
+      "grad_norm": 0.21082516759926104,
+      "learning_rate": 9.77662371044258e-06,
+      "loss": 1.4932,
+      "step": 245
+    },
+    {
+      "epoch": 0.45179063360881544,
+      "grad_norm": 0.24031601796602936,
+      "learning_rate": 9.774445034983864e-06,
+      "loss": 1.7397,
+      "step": 246
+    },
+    {
+      "epoch": 0.45362718089990817,
+      "grad_norm": 0.2207009467162113,
+      "learning_rate": 9.77225603143385e-06,
+      "loss": 1.585,
+      "step": 247
+    },
+    {
+      "epoch": 0.4554637281910009,
+      "grad_norm": 0.2551403718915401,
+      "learning_rate": 9.770056704527797e-06,
+      "loss": 1.4924,
+      "step": 248
+    },
+    {
+      "epoch": 0.4573002754820937,
+      "grad_norm": 0.23525171894308203,
+      "learning_rate": 9.767847059023292e-06,
+      "loss": 1.5658,
+      "step": 249
+    },
+    {
+      "epoch": 0.4591368227731864,
+      "grad_norm": 0.2340311514550259,
+      "learning_rate": 9.765627099700248e-06,
+      "loss": 1.7361,
+      "step": 250
+    },
+    {
+      "epoch": 0.46097337006427913,
+      "grad_norm": 0.3425610884720096,
+      "learning_rate": 9.763396831360884e-06,
+      "loss": 1.4723,
+      "step": 251
+    },
+    {
+      "epoch": 0.4628099173553719,
+      "grad_norm": 0.232643381531555,
+      "learning_rate": 9.761156258829723e-06,
+      "loss": 1.5543,
+      "step": 252
+    },
+    {
+      "epoch": 0.46464646464646464,
+      "grad_norm": 0.3601600310692427,
+      "learning_rate": 9.75890538695358e-06,
+      "loss": 1.4195,
+      "step": 253
+    },
+    {
+      "epoch": 0.46648301193755737,
+      "grad_norm": 0.2625087171937245,
+      "learning_rate": 9.756644220601541e-06,
+      "loss": 1.7209,
+      "step": 254
+    },
+    {
+      "epoch": 0.46831955922865015,
+      "grad_norm": 0.36091521146763844,
+      "learning_rate": 9.75437276466497e-06,
+      "loss": 1.4435,
+      "step": 255
+    },
+    {
+      "epoch": 0.4701561065197429,
+      "grad_norm": 0.22970766162190284,
+      "learning_rate": 9.752091024057485e-06,
+      "loss": 1.3894,
+      "step": 256
+    },
+    {
+      "epoch": 0.4719926538108356,
+      "grad_norm": 0.2708039374301605,
+      "learning_rate": 9.749799003714954e-06,
+      "loss": 1.4717,
+      "step": 257
+    },
+    {
+      "epoch": 0.4738292011019284,
+      "grad_norm": 0.22940138762480203,
+      "learning_rate": 9.747496708595482e-06,
+      "loss": 1.532,
+      "step": 258
+    },
+    {
+      "epoch": 0.4756657483930211,
+      "grad_norm": 0.27196638223072084,
+      "learning_rate": 9.745184143679398e-06,
+      "loss": 1.4425,
+      "step": 259
+    },
+    {
+      "epoch": 0.47750229568411384,
+      "grad_norm": 0.24883578158794614,
+      "learning_rate": 9.742861313969246e-06,
+      "loss": 1.4882,
+      "step": 260
+    },
+    {
+      "epoch": 0.4793388429752066,
+      "grad_norm": 0.24541193855388124,
+      "learning_rate": 9.74052822448978e-06,
+      "loss": 1.4851,
+      "step": 261
+    },
+    {
+      "epoch": 0.48117539026629935,
+      "grad_norm": 0.249310294245501,
+      "learning_rate": 9.738184880287946e-06,
+      "loss": 1.6463,
+      "step": 262
+    },
+    {
+      "epoch": 0.4830119375573921,
+      "grad_norm": 0.25707806827316415,
+      "learning_rate": 9.735831286432869e-06,
+      "loss": 1.6118,
+      "step": 263
+    },
+    {
+      "epoch": 0.48484848484848486,
+      "grad_norm": 0.22547510302041615,
+      "learning_rate": 9.733467448015849e-06,
+      "loss": 1.3343,
+      "step": 264
+    },
+    {
+      "epoch": 0.4866850321395776,
+      "grad_norm": 0.21415297945638267,
+      "learning_rate": 9.731093370150349e-06,
+      "loss": 1.8938,
+      "step": 265
+    },
+    {
+      "epoch": 0.4885215794306703,
+      "grad_norm": 0.25553884577553115,
+      "learning_rate": 9.728709057971979e-06,
+      "loss": 1.6681,
+      "step": 266
+    },
+    {
+      "epoch": 0.4903581267217631,
+      "grad_norm": 0.23479399192488148,
+      "learning_rate": 9.72631451663849e-06,
+      "loss": 1.3781,
+      "step": 267
+    },
+    {
+      "epoch": 0.4921946740128558,
+      "grad_norm": 0.2549932602973557,
+      "learning_rate": 9.723909751329759e-06,
+      "loss": 1.444,
+      "step": 268
+    },
+    {
+      "epoch": 0.49403122130394855,
+      "grad_norm": 0.24071196589287586,
+      "learning_rate": 9.721494767247779e-06,
+      "loss": 1.5817,
+      "step": 269
+    },
+    {
+      "epoch": 0.49586776859504134,
+      "grad_norm": 0.23040782897953827,
+      "learning_rate": 9.719069569616653e-06,
+      "loss": 1.2528,
+      "step": 270
+    },
+    {
+      "epoch": 0.49770431588613406,
+      "grad_norm": 0.2371564859647457,
+      "learning_rate": 9.71663416368257e-06,
+      "loss": 1.7053,
+      "step": 271
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "grad_norm": 0.2489215879444709,
+      "learning_rate": 9.71418855471381e-06,
+      "loss": 1.4637,
+      "step": 272
+    },
+    {
+      "epoch": 0.4995408631772268,
+      "eval_loss": 2.313441038131714,
+      "eval_runtime": 39.8034,
+      "eval_samples_per_second": 5.15,
+      "eval_steps_per_second": 0.452,
+      "step": 272
+    },
+    {
+      "epoch": 0.5013774104683195,
+      "grad_norm": 0.40359885890108993,
+      "learning_rate": 9.71173274800072e-06,
+      "loss": 1.2163,
+      "step": 273
+    },
+    {
+      "epoch": 0.5032139577594124,
+      "grad_norm": 0.19808277732817645,
+      "learning_rate": 9.709266748855704e-06,
+      "loss": 1.4049,
+      "step": 274
+    },
+    {
+      "epoch": 0.5050505050505051,
+      "grad_norm": 0.226114084447551,
+      "learning_rate": 9.70679056261322e-06,
+      "loss": 1.4663,
+      "step": 275
+    },
+    {
+      "epoch": 0.5068870523415978,
+      "grad_norm": 0.28094120861132194,
+      "learning_rate": 9.704304194629759e-06,
+      "loss": 1.553,
+      "step": 276
+    },
+    {
+      "epoch": 0.5087235996326905,
+      "grad_norm": 0.25995397574576745,
+      "learning_rate": 9.70180765028384e-06,
+      "loss": 1.6668,
+      "step": 277
+    },
+    {
+      "epoch": 0.5105601469237833,
+      "grad_norm": 0.26456909599184886,
+      "learning_rate": 9.699300934975993e-06,
+      "loss": 1.65,
+      "step": 278
+    },
+    {
+      "epoch": 0.512396694214876,
+      "grad_norm": 0.24248635440559377,
+      "learning_rate": 9.696784054128749e-06,
+      "loss": 1.3412,
+      "step": 279
+    },
+    {
+      "epoch": 0.5142332415059688,
+      "grad_norm": 0.2550690355279568,
+      "learning_rate": 9.694257013186635e-06,
+      "loss": 1.4855,
+      "step": 280
+    },
+    {
+      "epoch": 0.5160697887970616,
+      "grad_norm": 0.21051919872331962,
+      "learning_rate": 9.691719817616148e-06,
+      "loss": 1.4878,
+      "step": 281
+    },
+    {
+      "epoch": 0.5179063360881543,
+      "grad_norm": 0.2906151537123627,
+      "learning_rate": 9.689172472905759e-06,
+      "loss": 1.5423,
+      "step": 282
+    },
+    {
+      "epoch": 0.519742883379247,
+      "grad_norm": 0.24818058874303423,
+      "learning_rate": 9.686614984565888e-06,
+      "loss": 1.6553,
+      "step": 283
+    },
+    {
+      "epoch": 0.5215794306703397,
+      "grad_norm": 0.26642964980256184,
+      "learning_rate": 9.6840473581289e-06,
+      "loss": 1.5103,
+      "step": 284
+    },
+    {
+      "epoch": 0.5234159779614325,
+      "grad_norm": 0.2303123782267836,
+      "learning_rate": 9.681469599149093e-06,
+      "loss": 1.6623,
+      "step": 285
+    },
+    {
+      "epoch": 0.5252525252525253,
+      "grad_norm": 0.24975276980001815,
+      "learning_rate": 9.67888171320268e-06,
+      "loss": 1.5287,
+      "step": 286
+    },
+    {
+      "epoch": 0.527089072543618,
+      "grad_norm": 0.2839866917432431,
+      "learning_rate": 9.676283705887783e-06,
+      "loss": 1.5488,
+      "step": 287
+    },
+    {
+      "epoch": 0.5289256198347108,
+      "grad_norm": 0.3725151799153614,
+      "learning_rate": 9.673675582824416e-06,
+      "loss": 1.6329,
+      "step": 288
+    },
+    {
+      "epoch": 0.5307621671258035,
+      "grad_norm": 0.23277841474742347,
+      "learning_rate": 9.671057349654481e-06,
+      "loss": 1.6651,
+      "step": 289
+    },
+    {
+      "epoch": 0.5325987144168962,
+      "grad_norm": 0.24462057980980875,
+      "learning_rate": 9.668429012041742e-06,
+      "loss": 1.6452,
+      "step": 290
+    },
+    {
+      "epoch": 0.5344352617079889,
+      "grad_norm": 0.2801240375568796,
+      "learning_rate": 9.66579057567183e-06,
+      "loss": 1.6393,
+      "step": 291
+    },
+    {
+      "epoch": 0.5362718089990818,
+      "grad_norm": 0.22898727154751725,
+      "learning_rate": 9.663142046252213e-06,
+      "loss": 1.477,
+      "step": 292
+    },
+    {
+      "epoch": 0.5381083562901745,
+      "grad_norm": 0.27990182962352084,
+      "learning_rate": 9.660483429512198e-06,
+      "loss": 1.4522,
+      "step": 293
+    },
+    {
+      "epoch": 0.5399449035812672,
+      "grad_norm": 0.22721916937264164,
+      "learning_rate": 9.657814731202912e-06,
+      "loss": 1.6287,
+      "step": 294
+    },
+    {
+      "epoch": 0.54178145087236,
+      "grad_norm": 0.20163925656594917,
+      "learning_rate": 9.65513595709729e-06,
+      "loss": 1.404,
+      "step": 295
+    },
+    {
+      "epoch": 0.5436179981634527,
+      "grad_norm": 0.2926816198519085,
+      "learning_rate": 9.652447112990063e-06,
+      "loss": 1.3317,
+      "step": 296
+    },
+    {
+      "epoch": 0.5454545454545454,
+      "grad_norm": 0.21224236603779129,
+      "learning_rate": 9.649748204697741e-06,
+      "loss": 1.5832,
+      "step": 297
+    },
+    {
+      "epoch": 0.5472910927456383,
+      "grad_norm": 0.23696642392017095,
+      "learning_rate": 9.647039238058613e-06,
+      "loss": 1.4347,
+      "step": 298
+    },
+    {
+      "epoch": 0.549127640036731,
+      "grad_norm": 0.2540682989198533,
+      "learning_rate": 9.644320218932723e-06,
+      "loss": 1.3552,
+      "step": 299
+    },
+    {
+      "epoch": 0.5509641873278237,
+      "grad_norm": 0.3059021786701049,
+      "learning_rate": 9.641591153201856e-06,
+      "loss": 1.4477,
+      "step": 300
+    },
+    {
+      "epoch": 0.5528007346189164,
+      "grad_norm": 0.24608144306135712,
+      "learning_rate": 9.63885204676954e-06,
+      "loss": 1.4933,
+      "step": 301
+    },
+    {
+      "epoch": 0.5546372819100092,
+      "grad_norm": 0.2284951016394001,
+      "learning_rate": 9.63610290556101e-06,
+      "loss": 1.6014,
+      "step": 302
+    },
+    {
+      "epoch": 0.5564738292011019,
+      "grad_norm": 0.24446543124145687,
+      "learning_rate": 9.63334373552322e-06,
+      "loss": 1.4619,
+      "step": 303
+    },
+    {
+      "epoch": 0.5583103764921947,
+      "grad_norm": 0.2567728903743156,
+      "learning_rate": 9.63057454262481e-06,
+      "loss": 1.7054,
+      "step": 304
+    },
+    {
+      "epoch": 0.5601469237832875,
+      "grad_norm": 0.24400856152428735,
+      "learning_rate": 9.627795332856107e-06,
+      "loss": 1.5498,
+      "step": 305
+    },
+    {
+      "epoch": 0.5619834710743802,
+      "grad_norm": 0.23187407709208915,
+      "learning_rate": 9.625006112229102e-06,
+      "loss": 1.378,
+      "step": 306
+    },
+    {
+      "epoch": 0.5638200183654729,
+      "grad_norm": 0.217938745912038,
+      "learning_rate": 9.622206886777448e-06,
+      "loss": 1.4351,
+      "step": 307
+    },
+    {
+      "epoch": 0.5656565656565656,
+      "grad_norm": 0.24566673140048742,
+      "learning_rate": 9.619397662556434e-06,
+      "loss": 1.5534,
+      "step": 308
+    },
+    {
+      "epoch": 0.5674931129476584,
+      "grad_norm": 0.2682969741856791,
+      "learning_rate": 9.616578445642982e-06,
+      "loss": 1.4522,
+      "step": 309
+    },
+    {
+      "epoch": 0.5693296602387512,
+      "grad_norm": 0.23354861589018816,
+      "learning_rate": 9.613749242135627e-06,
+      "loss": 1.462,
+      "step": 310
+    },
+    {
+      "epoch": 0.5711662075298439,
+      "grad_norm": 0.22532237045597867,
+      "learning_rate": 9.61091005815451e-06,
+      "loss": 1.4351,
+      "step": 311
+    },
+    {
+      "epoch": 0.5730027548209367,
+      "grad_norm": 0.21311914562358464,
+      "learning_rate": 9.608060899841361e-06,
+      "loss": 1.7438,
+      "step": 312
+    },
+    {
+      "epoch": 0.5748393021120294,
+      "grad_norm": 0.2447872447833896,
+      "learning_rate": 9.605201773359485e-06,
+      "loss": 1.5586,
+      "step": 313
+    },
+    {
+      "epoch": 0.5766758494031221,
+      "grad_norm": 0.23045392404633464,
+      "learning_rate": 9.602332684893754e-06,
+      "loss": 1.4347,
+      "step": 314
+    },
+    {
+      "epoch": 0.5785123966942148,
+      "grad_norm": 0.23490326797451772,
+      "learning_rate": 9.599453640650585e-06,
+      "loss": 1.5357,
+      "step": 315
+    },
+    {
+      "epoch": 0.5803489439853077,
+      "grad_norm": 0.22245719768167882,
+      "learning_rate": 9.596564646857934e-06,
+      "loss": 1.5031,
+      "step": 316
+    },
+    {
+      "epoch": 0.5821854912764004,
+      "grad_norm": 0.2241576449726403,
+      "learning_rate": 9.59366570976528e-06,
+      "loss": 1.5591,
+      "step": 317
+    },
+    {
+      "epoch": 0.5840220385674931,
+      "grad_norm": 0.23221143989290613,
+      "learning_rate": 9.590756835643613e-06,
+      "loss": 1.7365,
+      "step": 318
+    },
+    {
+      "epoch": 0.5858585858585859,
+      "grad_norm": 0.22260605020813307,
+      "learning_rate": 9.587838030785413e-06,
+      "loss": 1.5891,
+      "step": 319
+    },
+    {
+      "epoch": 0.5876951331496786,
+      "grad_norm": 0.24074123539891878,
+      "learning_rate": 9.584909301504649e-06,
+      "loss": 1.6429,
+      "step": 320
+    },
+    {
+      "epoch": 0.5895316804407713,
+      "grad_norm": 0.24999236076625003,
+      "learning_rate": 9.581970654136752e-06,
+      "loss": 1.4635,
+      "step": 321
+    },
+    {
+      "epoch": 0.5913682277318641,
+      "grad_norm": 0.24138213962275842,
+      "learning_rate": 9.579022095038614e-06,
+      "loss": 1.4685,
+      "step": 322
+    },
+    {
+      "epoch": 0.5932047750229569,
+      "grad_norm": 0.23761063303866614,
+      "learning_rate": 9.576063630588563e-06,
+      "loss": 1.502,
+      "step": 323
+    },
+    {
+      "epoch": 0.5950413223140496,
+      "grad_norm": 0.23598358847125375,
+      "learning_rate": 9.573095267186361e-06,
+      "loss": 1.515,
+      "step": 324
+    },
+    {
+      "epoch": 0.5968778696051423,
+      "grad_norm": 0.22832909205335236,
+      "learning_rate": 9.570117011253173e-06,
+      "loss": 1.4807,
+      "step": 325
+    },
+    {
+      "epoch": 0.5987144168962351,
+      "grad_norm": 0.24117133297678936,
+      "learning_rate": 9.567128869231575e-06,
+      "loss": 1.5613,
+      "step": 326
+    },
+    {
+      "epoch": 0.6005509641873278,
+      "grad_norm": 0.3736566093680088,
+      "learning_rate": 9.56413084758552e-06,
+      "loss": 1.5542,
+      "step": 327
+    },
+    {
+      "epoch": 0.6023875114784206,
+      "grad_norm": 0.21663673460406355,
+      "learning_rate": 9.561122952800336e-06,
+      "loss": 1.7194,
+      "step": 328
+    },
+    {
+      "epoch": 0.6042240587695134,
+      "grad_norm": 0.2125100847818667,
+      "learning_rate": 9.55810519138271e-06,
+      "loss": 1.8111,
+      "step": 329
+    },
+    {
+      "epoch": 0.6060606060606061,
+      "grad_norm": 0.23381422950443456,
+      "learning_rate": 9.55507756986067e-06,
+      "loss": 1.461,
+      "step": 330
+    },
+    {
+      "epoch": 0.6078971533516988,
+      "grad_norm": 0.2977798664197012,
+      "learning_rate": 9.552040094783575e-06,
+      "loss": 1.5266,
+      "step": 331
+    },
+    {
+      "epoch": 0.6097337006427915,
+      "grad_norm": 0.2219906624573214,
+      "learning_rate": 9.548992772722097e-06,
+      "loss": 1.5105,
+      "step": 332
+    },
+    {
+      "epoch": 0.6115702479338843,
+      "grad_norm": 0.25219046567315495,
+      "learning_rate": 9.545935610268213e-06,
+      "loss": 1.5179,
+      "step": 333
+    },
+    {
+      "epoch": 0.6134067952249771,
+      "grad_norm": 0.22072558243113488,
+      "learning_rate": 9.542868614035182e-06,
+      "loss": 1.587,
+      "step": 334
+    },
+    {
+      "epoch": 0.6152433425160698,
+      "grad_norm": 0.291264791118564,
+      "learning_rate": 9.53979179065754e-06,
+      "loss": 1.6009,
+      "step": 335
+    },
+    {
+      "epoch": 0.6170798898071626,
+      "grad_norm": 0.27555767370579204,
+      "learning_rate": 9.536705146791076e-06,
+      "loss": 1.4902,
+      "step": 336
+    },
+    {
+      "epoch": 0.6189164370982553,
+      "grad_norm": 0.3560500138536834,
+      "learning_rate": 9.533608689112827e-06,
+      "loss": 1.4053,
+      "step": 337
+    },
+    {
+      "epoch": 0.620752984389348,
+      "grad_norm": 0.22581426937660223,
+      "learning_rate": 9.530502424321062e-06,
+      "loss": 1.3816,
+      "step": 338
+    },
+    {
+      "epoch": 0.6225895316804407,
+      "grad_norm": 0.22611206052943753,
+      "learning_rate": 9.527386359135254e-06,
+      "loss": 1.4149,
+      "step": 339
+    },
+    {
+      "epoch": 0.6244260789715336,
+      "grad_norm": 0.25279806678865613,
+      "learning_rate": 9.524260500296087e-06,
+      "loss": 1.6033,
+      "step": 340
+    },
+    {
+      "epoch": 0.6262626262626263,
+      "grad_norm": 0.27657948317697195,
+      "learning_rate": 9.521124854565425e-06,
+      "loss": 1.6497,
+      "step": 341
+    },
+    {
+      "epoch": 0.628099173553719,
+      "grad_norm": 0.27642525359962034,
+      "learning_rate": 9.517979428726306e-06,
+      "loss": 1.9425,
+      "step": 342
+    },
+    {
+      "epoch": 0.6299357208448118,
+      "grad_norm": 0.24498751269775337,
+      "learning_rate": 9.514824229582922e-06,
+      "loss": 1.5756,
+      "step": 343
+    },
+    {
+      "epoch": 0.6317722681359045,
+      "grad_norm": 0.23199154562408514,
+      "learning_rate": 9.511659263960607e-06,
+      "loss": 1.7103,
+      "step": 344
+    },
+    {
+      "epoch": 0.6336088154269972,
+      "grad_norm": 0.24499400426596973,
+      "learning_rate": 9.508484538705823e-06,
+      "loss": 1.7538,
+      "step": 345
+    },
+    {
+      "epoch": 0.63544536271809,
+      "grad_norm": 0.2507783598400131,
+      "learning_rate": 9.505300060686145e-06,
+      "loss": 1.6243,
+      "step": 346
+    },
+    {
+      "epoch": 0.6372819100091828,
+      "grad_norm": 0.3348756652505991,
+      "learning_rate": 9.50210583679024e-06,
+      "loss": 1.5188,
+      "step": 347
+    },
+    {
+      "epoch": 0.6391184573002755,
+      "grad_norm": 0.24441005383223785,
+      "learning_rate": 9.498901873927865e-06,
+      "loss": 1.4454,
+      "step": 348
+    },
+    {
+      "epoch": 0.6409550045913682,
+      "grad_norm": 0.2507000333701989,
+      "learning_rate": 9.495688179029838e-06,
+      "loss": 1.6245,
+      "step": 349
+    },
+    {
+      "epoch": 0.642791551882461,
+      "grad_norm": 0.24754540410863546,
+      "learning_rate": 9.492464759048033e-06,
+      "loss": 1.4104,
+      "step": 350
+    },
+    {
+      "epoch": 0.6446280991735537,
+      "grad_norm": 0.26737000313540454,
+      "learning_rate": 9.48923162095536e-06,
+      "loss": 1.6173,
+      "step": 351
+    },
+    {
+      "epoch": 0.6464646464646465,
+      "grad_norm": 0.2582858797490392,
+      "learning_rate": 9.48598877174575e-06,
+      "loss": 1.5501,
+      "step": 352
+    },
+    {
+      "epoch": 0.6483011937557392,
+      "grad_norm": 0.23212846839574947,
+      "learning_rate": 9.482736218434144e-06,
+      "loss": 1.5724,
+      "step": 353
+    },
+    {
+      "epoch": 0.650137741046832,
+      "grad_norm": 0.23218434605900706,
+      "learning_rate": 9.479473968056472e-06,
+      "loss": 1.4088,
+      "step": 354
+    },
+    {
+      "epoch": 0.6519742883379247,
+      "grad_norm": 0.2578729569151409,
+      "learning_rate": 9.476202027669644e-06,
+      "loss": 1.4826,
+      "step": 355
+    },
+    {
+      "epoch": 0.6538108356290174,
+      "grad_norm": 0.2154021538644954,
+      "learning_rate": 9.472920404351527e-06,
+      "loss": 1.3663,
+      "step": 356
+    },
+    {
+      "epoch": 0.6556473829201102,
+      "grad_norm": 0.27334033545305675,
+      "learning_rate": 9.469629105200937e-06,
+      "loss": 1.6778,
+      "step": 357
+    },
+    {
+      "epoch": 0.657483930211203,
+      "grad_norm": 0.29665620542669136,
+      "learning_rate": 9.466328137337623e-06,
+      "loss": 1.6483,
+      "step": 358
+    },
+    {
+      "epoch": 0.6593204775022957,
+      "grad_norm": 0.25732766746595215,
+      "learning_rate": 9.463017507902245e-06,
+      "loss": 1.6422,
+      "step": 359
+    },
+    {
+      "epoch": 0.6611570247933884,
+      "grad_norm": 0.22608595687187208,
+      "learning_rate": 9.459697224056364e-06,
+      "loss": 1.4751,
+      "step": 360
+    },
+    {
+      "epoch": 0.6629935720844812,
+      "grad_norm": 0.24483796123632973,
+      "learning_rate": 9.45636729298243e-06,
+      "loss": 1.6614,
+      "step": 361
+    },
+    {
+      "epoch": 0.6648301193755739,
+      "grad_norm": 0.21225379478527837,
+      "learning_rate": 9.453027721883751e-06,
+      "loss": 1.7302,
+      "step": 362
+    },
+    {
+      "epoch": 0.6666666666666666,
+      "grad_norm": 0.26429778829676437,
+      "learning_rate": 9.449678517984503e-06,
+      "loss": 1.7002,
+      "step": 363
+    },
+    {
+      "epoch": 0.6685032139577594,
+      "grad_norm": 0.26129846226407893,
+      "learning_rate": 9.446319688529688e-06,
+      "loss": 1.505,
+      "step": 364
+    },
+    {
+      "epoch": 0.6703397612488522,
+      "grad_norm": 0.24293627375696744,
+      "learning_rate": 9.442951240785135e-06,
+      "loss": 1.616,
+      "step": 365
+    },
+    {
+      "epoch": 0.6721763085399449,
+      "grad_norm": 0.2631927129942196,
+      "learning_rate": 9.439573182037478e-06,
+      "loss": 1.6593,
+      "step": 366
+    },
+    {
+      "epoch": 0.6740128558310376,
+      "grad_norm": 0.2512323899150732,
+      "learning_rate": 9.436185519594145e-06,
+      "loss": 1.5735,
+      "step": 367
+    },
+    {
+      "epoch": 0.6758494031221304,
+      "grad_norm": 0.5854956658746846,
+      "learning_rate": 9.432788260783333e-06,
+      "loss": 1.5307,
+      "step": 368
+    },
+    {
+      "epoch": 0.6776859504132231,
+      "grad_norm": 0.2532527127845924,
+      "learning_rate": 9.429381412954e-06,
+      "loss": 1.3514,
+      "step": 369
+    },
+    {
+      "epoch": 0.6795224977043158,
+      "grad_norm": 0.22892141489196347,
+      "learning_rate": 9.425964983475848e-06,
+      "loss": 1.5846,
+      "step": 370
+    },
+    {
+      "epoch": 0.6813590449954087,
+      "grad_norm": 0.3092853890062792,
+      "learning_rate": 9.422538979739307e-06,
+      "loss": 1.2921,
+      "step": 371
+    },
+    {
+      "epoch": 0.6831955922865014,
+      "grad_norm": 0.25717541532306365,
+      "learning_rate": 9.419103409155517e-06,
+      "loss": 1.5299,
+      "step": 372
+    },
+    {
+      "epoch": 0.6850321395775941,
+      "grad_norm": 0.2554573529209432,
+      "learning_rate": 9.415658279156312e-06,
+      "loss": 1.6284,
+      "step": 373
+    },
+    {
+      "epoch": 0.6868686868686869,
+      "grad_norm": 0.2720753683925479,
+      "learning_rate": 9.412203597194204e-06,
+      "loss": 1.4538,
+      "step": 374
+    },
+    {
+      "epoch": 0.6887052341597796,
+      "grad_norm": 0.25694738444316845,
+      "learning_rate": 9.408739370742372e-06,
+      "loss": 1.6709,
+      "step": 375
+    },
+    {
+      "epoch": 0.6905417814508723,
+      "grad_norm": 0.23142193114218948,
+      "learning_rate": 9.405265607294638e-06,
+      "loss": 1.5729,
+      "step": 376
+    },
+    {
+      "epoch": 0.6923783287419651,
+      "grad_norm": 0.6276509400617444,
+      "learning_rate": 9.401782314365458e-06,
+      "loss": 1.4751,
+      "step": 377
+    },
+    {
+      "epoch": 0.6942148760330579,
+      "grad_norm": 0.23891845253084326,
+      "learning_rate": 9.398289499489897e-06,
+      "loss": 1.7754,
+      "step": 378
+    },
+    {
+      "epoch": 0.6960514233241506,
+      "grad_norm": 0.21871931719886073,
+      "learning_rate": 9.39478717022362e-06,
+      "loss": 1.4614,
+      "step": 379
+    },
+    {
+      "epoch": 0.6978879706152433,
+      "grad_norm": 0.26099154202292374,
+      "learning_rate": 9.391275334142879e-06,
+      "loss": 1.4168,
+      "step": 380
+    },
+    {
+      "epoch": 0.699724517906336,
+      "grad_norm": 0.2354655594620819,
+      "learning_rate": 9.387753998844482e-06,
+      "loss": 1.6517,
+      "step": 381
+    },
+    {
+      "epoch": 0.7015610651974288,
+      "grad_norm": 0.39436529660636566,
+      "learning_rate": 9.384223171945793e-06,
+      "loss": 1.5878,
+      "step": 382
+    },
+    {
+      "epoch": 0.7033976124885216,
+      "grad_norm": 0.253934593084282,
+      "learning_rate": 9.380682861084703e-06,
+      "loss": 1.4456,
+      "step": 383
+    },
+    {
+      "epoch": 0.7052341597796143,
+      "grad_norm": 0.275985389911898,
+      "learning_rate": 9.377133073919622e-06,
+      "loss": 1.4548,
+      "step": 384
+    },
+    {
+      "epoch": 0.7070707070707071,
+      "grad_norm": 0.274347449615472,
+      "learning_rate": 9.37357381812946e-06,
+      "loss": 1.4328,
+      "step": 385
+    },
+    {
+      "epoch": 0.7089072543617998,
+      "grad_norm": 0.23606491033625135,
+      "learning_rate": 9.370005101413605e-06,
+      "loss": 1.418,
+      "step": 386
+    },
+    {
+      "epoch": 0.7107438016528925,
+      "grad_norm": 0.31465431130895255,
+      "learning_rate": 9.366426931491917e-06,
+      "loss": 1.5906,
+      "step": 387
+    },
+    {
+      "epoch": 0.7125803489439853,
+      "grad_norm": 0.34193996513257946,
+      "learning_rate": 9.362839316104701e-06,
+      "loss": 1.5417,
+      "step": 388
+    },
+    {
+      "epoch": 0.7144168962350781,
+      "grad_norm": 0.22556493806007524,
+      "learning_rate": 9.359242263012693e-06,
+      "loss": 1.7724,
+      "step": 389
+    },
+    {
+      "epoch": 0.7162534435261708,
+      "grad_norm": 0.2680416851368413,
+      "learning_rate": 9.355635779997052e-06,
+      "loss": 1.6457,
+      "step": 390
+    },
+    {
+      "epoch": 0.7180899908172635,
+      "grad_norm": 0.24689515414196325,
+      "learning_rate": 9.352019874859326e-06,
+      "loss": 1.568,
+      "step": 391
+    },
+    {
+      "epoch": 0.7199265381083563,
+      "grad_norm": 0.21347041125386362,
+      "learning_rate": 9.348394555421454e-06,
+      "loss": 1.7583,
+      "step": 392
+    },
+    {
+      "epoch": 0.721763085399449,
+      "grad_norm": 0.46467653443410706,
+      "learning_rate": 9.344759829525734e-06,
+      "loss": 1.5016,
+      "step": 393
+    },
+    {
+      "epoch": 0.7235996326905417,
+      "grad_norm": 0.23251022201282956,
+      "learning_rate": 9.341115705034813e-06,
+      "loss": 1.4531,
+      "step": 394
+    },
+    {
+      "epoch": 0.7254361799816346,
+      "grad_norm": 0.2635599798354954,
+      "learning_rate": 9.33746218983167e-06,
+      "loss": 1.6209,
+      "step": 395
+    },
+    {
+      "epoch": 0.7272727272727273,
+      "grad_norm": 0.274528346084071,
+      "learning_rate": 9.3337992918196e-06,
+      "loss": 1.423,
+      "step": 396
+    },
+    {
+      "epoch": 0.72910927456382,
+      "grad_norm": 0.22452326304098907,
+      "learning_rate": 9.330127018922195e-06,
+      "loss": 1.6043,
+      "step": 397
+    },
+    {
+      "epoch": 0.7309458218549127,
+      "grad_norm": 0.23441816537644192,
+      "learning_rate": 9.32644537908332e-06,
+      "loss": 1.3519,
+      "step": 398
+    },
+    {
+      "epoch": 0.7327823691460055,
+      "grad_norm": 0.23890498709588182,
+      "learning_rate": 9.32275438026711e-06,
+      "loss": 1.5404,
+      "step": 399
+    },
+    {
+      "epoch": 0.7346189164370982,
+      "grad_norm": 0.21291317553932287,
+      "learning_rate": 9.31905403045794e-06,
+      "loss": 1.5691,
+      "step": 400
+    },
+    {
+      "epoch": 0.736455463728191,
+      "grad_norm": 0.22613473470643639,
+      "learning_rate": 9.315344337660422e-06,
+      "loss": 1.4559,
+      "step": 401
+    },
+    {
+      "epoch": 0.7382920110192838,
+      "grad_norm": 0.23269103930259752,
+      "learning_rate": 9.311625309899366e-06,
+      "loss": 1.3702,
+      "step": 402
+    },
+    {
+      "epoch": 0.7401285583103765,
+      "grad_norm": 0.20796226054959077,
+      "learning_rate": 9.307896955219787e-06,
+      "loss": 1.4569,
+      "step": 403
+    },
+    {
+      "epoch": 0.7419651056014692,
+      "grad_norm": 0.23674950969933053,
+      "learning_rate": 9.304159281686867e-06,
+      "loss": 1.5614,
+      "step": 404
+    },
+    {
+      "epoch": 0.743801652892562,
+      "grad_norm": 0.2166339431037937,
+      "learning_rate": 9.300412297385954e-06,
+      "loss": 1.5903,
+      "step": 405
+    },
+    {
+      "epoch": 0.7456382001836547,
+      "grad_norm": 0.376582090077921,
+      "learning_rate": 9.296656010422532e-06,
+      "loss": 1.5696,
+      "step": 406
+    },
+    {
+      "epoch": 0.7474747474747475,
+      "grad_norm": 0.2507106267047962,
+      "learning_rate": 9.29289042892221e-06,
+      "loss": 1.4167,
+      "step": 407
+    },
+    {
+      "epoch": 0.7493112947658402,
+      "grad_norm": 0.21978547524853728,
+      "learning_rate": 9.289115561030704e-06,
+      "loss": 1.6598,
+      "step": 408
+    },
+    {
+      "epoch": 0.7493112947658402,
+      "eval_loss": 2.3061842918395996,
+      "eval_runtime": 40.5501,
+      "eval_samples_per_second": 5.055,
+      "eval_steps_per_second": 0.444,
+      "step": 408
+    },
+    {
+      "epoch": 0.751147842056933,
+      "grad_norm": 0.2335920969105023,
+      "learning_rate": 9.285331414913816e-06,
+      "loss": 1.4038,
+      "step": 409
+    },
+    {
+      "epoch": 0.7529843893480257,
+      "grad_norm": 0.28229727560433654,
+      "learning_rate": 9.281537998757421e-06,
+      "loss": 1.3303,
+      "step": 410
+    },
+    {
+      "epoch": 0.7548209366391184,
+      "grad_norm": 0.23757995428362888,
+      "learning_rate": 9.277735320767449e-06,
+      "loss": 1.3841,
+      "step": 411
+    },
+    {
+      "epoch": 0.7566574839302111,
+      "grad_norm": 0.24758854422732826,
+      "learning_rate": 9.27392338916986e-06,
+      "loss": 1.624,
+      "step": 412
+    },
+    {
+      "epoch": 0.758494031221304,
+      "grad_norm": 0.2627291719598822,
+      "learning_rate": 9.270102212210632e-06,
+      "loss": 1.7343,
+      "step": 413
+    },
+    {
+      "epoch": 0.7603305785123967,
+      "grad_norm": 0.29750352907343186,
+      "learning_rate": 9.266271798155748e-06,
+      "loss": 1.6209,
+      "step": 414
+    },
+    {
+      "epoch": 0.7621671258034894,
+      "grad_norm": 0.23822029512893117,
+      "learning_rate": 9.262432155291167e-06,
+      "loss": 1.513,
+      "step": 415
+    },
+    {
+      "epoch": 0.7640036730945822,
+      "grad_norm": 0.21093681279730364,
+      "learning_rate": 9.258583291922814e-06,
+      "loss": 1.5292,
+      "step": 416
+    },
+    {
+      "epoch": 0.7658402203856749,
+      "grad_norm": 0.26293015719040297,
+      "learning_rate": 9.254725216376562e-06,
+      "loss": 1.5138,
+      "step": 417
+    },
+    {
+      "epoch": 0.7676767676767676,
+      "grad_norm": 0.23385317706303402,
+      "learning_rate": 9.250857936998206e-06,
+      "loss": 1.3565,
+      "step": 418
+    },
+    {
+      "epoch": 0.7695133149678605,
+      "grad_norm": 0.38700660904810047,
+      "learning_rate": 9.246981462153456e-06,
+      "loss": 1.4129,
+      "step": 419
+    },
+    {
+      "epoch": 0.7713498622589532,
+      "grad_norm": 0.22885668314514052,
+      "learning_rate": 9.243095800227913e-06,
+      "loss": 1.7462,
+      "step": 420
+    },
+    {
+      "epoch": 0.7731864095500459,
+      "grad_norm": 0.21379597965346503,
+      "learning_rate": 9.239200959627048e-06,
+      "loss": 1.6085,
+      "step": 421
+    },
+    {
+      "epoch": 0.7750229568411386,
+      "grad_norm": 0.22354309327698976,
+      "learning_rate": 9.235296948776194e-06,
+      "loss": 1.6027,
+      "step": 422
+    },
+    {
+      "epoch": 0.7768595041322314,
+      "grad_norm": 0.33114539095121254,
+      "learning_rate": 9.231383776120512e-06,
+      "loss": 1.5652,
+      "step": 423
+    },
+    {
+      "epoch": 0.7786960514233241,
+      "grad_norm": 0.2628333136775673,
+      "learning_rate": 9.22746145012499e-06,
+      "loss": 1.4293,
+      "step": 424
+    },
+    {
+      "epoch": 0.7805325987144169,
+      "grad_norm": 0.2512363336874892,
+      "learning_rate": 9.223529979274411e-06,
+      "loss": 1.6437,
+      "step": 425
+    },
+    {
+      "epoch": 0.7823691460055097,
+      "grad_norm": 0.2375037995789399,
+      "learning_rate": 9.219589372073344e-06,
+      "loss": 1.6051,
+      "step": 426
+    },
+    {
+      "epoch": 0.7842056932966024,
+      "grad_norm": 0.3071445167943931,
+      "learning_rate": 9.215639637046121e-06,
+      "loss": 1.4219,
+      "step": 427
+    },
+    {
+      "epoch": 0.7860422405876951,
+      "grad_norm": 0.22189183823448244,
+      "learning_rate": 9.211680782736818e-06,
+      "loss": 1.4985,
+      "step": 428
+    },
+    {
+      "epoch": 0.7878787878787878,
+      "grad_norm": 0.25580090731799854,
+      "learning_rate": 9.207712817709237e-06,
+      "loss": 1.4033,
+      "step": 429
+    },
+    {
+      "epoch": 0.7897153351698806,
+      "grad_norm": 0.24812653746151964,
+      "learning_rate": 9.203735750546891e-06,
+      "loss": 1.3742,
+      "step": 430
+    },
+    {
+      "epoch": 0.7915518824609734,
+      "grad_norm": 0.24863294067441372,
+      "learning_rate": 9.19974958985298e-06,
+      "loss": 1.5571,
+      "step": 431
+    },
+    {
+      "epoch": 0.7933884297520661,
+      "grad_norm": 0.2836367707982348,
+      "learning_rate": 9.19575434425038e-06,
+      "loss": 1.6326,
+      "step": 432
+    },
+    {
+      "epoch": 0.7952249770431589,
+      "grad_norm": 0.22384740224875363,
+      "learning_rate": 9.191750022381613e-06,
+      "loss": 1.4628,
+      "step": 433
+    },
+    {
+      "epoch": 0.7970615243342516,
+      "grad_norm": 0.2250518915942832,
+      "learning_rate": 9.18773663290884e-06,
+      "loss": 1.5826,
+      "step": 434
+    },
+    {
+      "epoch": 0.7988980716253443,
+      "grad_norm": 0.2439126131273036,
+      "learning_rate": 9.183714184513832e-06,
+      "loss": 1.603,
+      "step": 435
+    },
+    {
+      "epoch": 0.800734618916437,
+      "grad_norm": 0.24495825317270972,
+      "learning_rate": 9.179682685897963e-06,
+      "loss": 1.469,
+      "step": 436
+    },
+    {
+      "epoch": 0.8025711662075299,
+      "grad_norm": 0.21768361761008279,
+      "learning_rate": 9.175642145782179e-06,
+      "loss": 1.4976,
+      "step": 437
+    },
+    {
+      "epoch": 0.8044077134986226,
+      "grad_norm": 0.26701765806787003,
+      "learning_rate": 9.171592572906985e-06,
+      "loss": 1.5952,
+      "step": 438
+    },
+    {
+      "epoch": 0.8062442607897153,
+      "grad_norm": 0.21065992974075412,
+      "learning_rate": 9.16753397603243e-06,
+      "loss": 1.5322,
+      "step": 439
+    },
+    {
+      "epoch": 0.8080808080808081,
+      "grad_norm": 0.27599402518484223,
+      "learning_rate": 9.16346636393808e-06,
+      "loss": 1.3606,
+      "step": 440
+    },
+    {
+      "epoch": 0.8099173553719008,
+      "grad_norm": 0.3021312730547759,
+      "learning_rate": 9.159389745423003e-06,
+      "loss": 1.584,
+      "step": 441
+    },
+    {
+      "epoch": 0.8117539026629935,
+      "grad_norm": 0.21998110932041243,
+      "learning_rate": 9.155304129305749e-06,
+      "loss": 1.4583,
+      "step": 442
+    },
+    {
+      "epoch": 0.8135904499540864,
+      "grad_norm": 0.2329768737772725,
+      "learning_rate": 9.151209524424333e-06,
+      "loss": 1.4508,
+      "step": 443
+    },
+    {
+      "epoch": 0.8154269972451791,
+      "grad_norm": 0.2578363729671407,
+      "learning_rate": 9.147105939636216e-06,
+      "loss": 1.5392,
+      "step": 444
+    },
+    {
+      "epoch": 0.8172635445362718,
+      "grad_norm": 0.2365004570955238,
+      "learning_rate": 9.142993383818284e-06,
+      "loss": 1.632,
+      "step": 445
+    },
+    {
+      "epoch": 0.8191000918273645,
+      "grad_norm": 0.21742880728132308,
+      "learning_rate": 9.138871865866824e-06,
+      "loss": 1.3645,
+      "step": 446
+    },
+    {
+      "epoch": 0.8209366391184573,
+      "grad_norm": 0.23059966917774738,
+      "learning_rate": 9.134741394697517e-06,
+      "loss": 1.3386,
+      "step": 447
+    },
+    {
+      "epoch": 0.82277318640955,
+      "grad_norm": 0.24309425578366148,
+      "learning_rate": 9.130601979245407e-06,
+      "loss": 1.38,
+      "step": 448
+    },
+    {
+      "epoch": 0.8246097337006428,
+      "grad_norm": 0.21478191767990237,
+      "learning_rate": 9.126453628464889e-06,
+      "loss": 1.76,
+      "step": 449
+    },
+    {
+      "epoch": 0.8264462809917356,
+      "grad_norm": 0.25682509893819777,
+      "learning_rate": 9.122296351329683e-06,
+      "loss": 1.4405,
+      "step": 450
+    },
+    {
+      "epoch": 0.8282828282828283,
+      "grad_norm": 0.23365435124291448,
+      "learning_rate": 9.118130156832823e-06,
+      "loss": 1.4337,
+      "step": 451
+    },
+    {
+      "epoch": 0.830119375573921,
+      "grad_norm": 0.2415984482071214,
+      "learning_rate": 9.113955053986632e-06,
+      "loss": 1.6131,
+      "step": 452
+    },
+    {
+      "epoch": 0.8319559228650137,
+      "grad_norm": 0.26943745232610666,
+      "learning_rate": 9.109771051822702e-06,
+      "loss": 1.4698,
+      "step": 453
+    },
+    {
+      "epoch": 0.8337924701561065,
+      "grad_norm": 0.2074005721654442,
+      "learning_rate": 9.105578159391876e-06,
+      "loss": 1.5938,
+      "step": 454
+    },
+    {
+      "epoch": 0.8356290174471993,
+      "grad_norm": 0.21993568441683473,
+      "learning_rate": 9.10137638576423e-06,
+      "loss": 1.4473,
+      "step": 455
+    },
+    {
+      "epoch": 0.837465564738292,
+      "grad_norm": 0.2225235136645375,
+      "learning_rate": 9.097165740029053e-06,
+      "loss": 1.7787,
+      "step": 456
+    },
+    {
+      "epoch": 0.8393021120293848,
+      "grad_norm": 0.22980927731633988,
+      "learning_rate": 9.09294623129482e-06,
+      "loss": 1.5131,
+      "step": 457
+    },
+    {
+      "epoch": 0.8411386593204775,
+      "grad_norm": 0.525766821192798,
+      "learning_rate": 9.088717868689186e-06,
+      "loss": 1.5409,
+      "step": 458
+    },
+    {
+      "epoch": 0.8429752066115702,
+      "grad_norm": 0.2263260760581893,
+      "learning_rate": 9.084480661358954e-06,
+      "loss": 1.5803,
+      "step": 459
+    },
+    {
+      "epoch": 0.8448117539026629,
+      "grad_norm": 0.24950337121155466,
+      "learning_rate": 9.080234618470063e-06,
+      "loss": 1.7144,
+      "step": 460
+    },
+    {
+      "epoch": 0.8466483011937558,
+      "grad_norm": 0.21067429427962073,
+      "learning_rate": 9.07597974920756e-06,
+      "loss": 1.662,
+      "step": 461
+    },
+    {
+      "epoch": 0.8484848484848485,
+      "grad_norm": 0.2308216794274888,
+      "learning_rate": 9.071716062775592e-06,
+      "loss": 1.5284,
+      "step": 462
+    },
+    {
+      "epoch": 0.8503213957759412,
+      "grad_norm": 0.25595362098568153,
+      "learning_rate": 9.067443568397378e-06,
+      "loss": 1.7066,
+      "step": 463
+    },
+    {
+      "epoch": 0.852157943067034,
+      "grad_norm": 0.2892000674805998,
+      "learning_rate": 9.063162275315182e-06,
+      "loss": 1.559,
+      "step": 464
+    },
+    {
+      "epoch": 0.8539944903581267,
+      "grad_norm": 0.28340515745622036,
+      "learning_rate": 9.058872192790314e-06,
+      "loss": 1.4001,
+      "step": 465
+    },
+    {
+      "epoch": 0.8558310376492194,
+      "grad_norm": 0.2294106234149869,
+      "learning_rate": 9.054573330103087e-06,
+      "loss": 1.4574,
+      "step": 466
+    },
+    {
+      "epoch": 0.8576675849403123,
+      "grad_norm": 0.24497945362812937,
+      "learning_rate": 9.05026569655281e-06,
+      "loss": 1.5943,
+      "step": 467
+    },
+    {
+      "epoch": 0.859504132231405,
+      "grad_norm": 0.253470755772231,
+      "learning_rate": 9.045949301457774e-06,
+      "loss": 1.5505,
+      "step": 468
+    },
+    {
+      "epoch": 0.8613406795224977,
+      "grad_norm": 0.2492429347432005,
+      "learning_rate": 9.041624154155208e-06,
+      "loss": 1.5801,
+      "step": 469
+    },
+    {
+      "epoch": 0.8631772268135904,
+      "grad_norm": 0.26092005188633716,
+      "learning_rate": 9.037290264001286e-06,
+      "loss": 1.6384,
+      "step": 470
+    },
+    {
+      "epoch": 0.8650137741046832,
+      "grad_norm": 0.22072784533883108,
+      "learning_rate": 9.032947640371086e-06,
+      "loss": 1.6069,
+      "step": 471
+    },
+    {
+      "epoch": 0.8668503213957759,
+      "grad_norm": 0.22398684213158268,
+      "learning_rate": 9.028596292658585e-06,
+      "loss": 1.5495,
+      "step": 472
+    },
+    {
+      "epoch": 0.8686868686868687,
+      "grad_norm": 0.2027554437403566,
+      "learning_rate": 9.02423623027663e-06,
+      "loss": 1.5387,
+      "step": 473
+    },
+    {
+      "epoch": 0.8705234159779615,
+      "grad_norm": 0.23717640601226908,
+      "learning_rate": 9.019867462656915e-06,
+      "loss": 1.5579,
+      "step": 474
+    },
+    {
+      "epoch": 0.8723599632690542,
+      "grad_norm": 0.22501657795548555,
+      "learning_rate": 9.01548999924997e-06,
+      "loss": 1.3586,
+      "step": 475
+    },
+    {
+      "epoch": 0.8741965105601469,
+      "grad_norm": 0.21644485895311025,
+      "learning_rate": 9.011103849525139e-06,
+      "loss": 1.8106,
+      "step": 476
+    },
+    {
+      "epoch": 0.8760330578512396,
+      "grad_norm": 0.45331532023795523,
+      "learning_rate": 9.006709022970547e-06,
+      "loss": 1.5949,
+      "step": 477
+    },
+    {
+      "epoch": 0.8778696051423324,
+      "grad_norm": 0.2651826534678187,
+      "learning_rate": 9.002305529093095e-06,
+      "loss": 1.1691,
+      "step": 478
+    },
+    {
+      "epoch": 0.8797061524334252,
+      "grad_norm": 0.2676840437065319,
+      "learning_rate": 8.997893377418432e-06,
+      "loss": 1.4198,
+      "step": 479
+    },
+    {
+      "epoch": 0.8815426997245179,
+      "grad_norm": 0.2308528854306592,
+      "learning_rate": 8.993472577490936e-06,
+      "loss": 1.4812,
+      "step": 480
+    },
+    {
+      "epoch": 0.8833792470156107,
+      "grad_norm": 0.20636713087022784,
+      "learning_rate": 8.98904313887369e-06,
+      "loss": 1.6178,
+      "step": 481
+    },
+    {
+      "epoch": 0.8852157943067034,
+      "grad_norm": 0.29618906487535407,
+      "learning_rate": 8.984605071148471e-06,
+      "loss": 1.5748,
+      "step": 482
+    },
+    {
+      "epoch": 0.8870523415977961,
+      "grad_norm": 0.24284044940826433,
+      "learning_rate": 8.980158383915714e-06,
+      "loss": 1.7419,
+      "step": 483
+    },
+    {
+      "epoch": 0.8888888888888888,
+      "grad_norm": 0.22881808189787375,
+      "learning_rate": 8.975703086794505e-06,
+      "loss": 1.4035,
+      "step": 484
+    },
+    {
+      "epoch": 0.8907254361799817,
+      "grad_norm": 0.5882914193304096,
+      "learning_rate": 8.971239189422555e-06,
+      "loss": 1.5501,
+      "step": 485
+    },
+    {
+      "epoch": 0.8925619834710744,
+      "grad_norm": 0.23820272367736536,
+      "learning_rate": 8.966766701456177e-06,
+      "loss": 1.5487,
+      "step": 486
+    },
+    {
+      "epoch": 0.8943985307621671,
+      "grad_norm": 0.22512062456776769,
+      "learning_rate": 8.962285632570266e-06,
+      "loss": 1.7015,
+      "step": 487
+    },
+    {
+      "epoch": 0.8962350780532599,
+      "grad_norm": 0.22468181674999985,
+      "learning_rate": 8.957795992458285e-06,
+      "loss": 1.379,
+      "step": 488
+    },
+    {
+      "epoch": 0.8980716253443526,
+      "grad_norm": 0.24683192515184557,
+      "learning_rate": 8.953297790832231e-06,
+      "loss": 1.5196,
+      "step": 489
+    },
+    {
+      "epoch": 0.8999081726354453,
+      "grad_norm": 0.24472352067207945,
+      "learning_rate": 8.948791037422629e-06,
+      "loss": 1.5634,
+      "step": 490
+    },
+    {
+      "epoch": 0.9017447199265382,
+      "grad_norm": 0.23757734063602157,
+      "learning_rate": 8.944275741978495e-06,
+      "loss": 1.6768,
+      "step": 491
+    },
+    {
+      "epoch": 0.9035812672176309,
+      "grad_norm": 0.23765942801452902,
+      "learning_rate": 8.939751914267329e-06,
+      "loss": 1.4796,
+      "step": 492
+    },
+    {
+      "epoch": 0.9054178145087236,
+      "grad_norm": 0.2493616211295045,
+      "learning_rate": 8.935219564075087e-06,
+      "loss": 1.7449,
+      "step": 493
+    },
+    {
+      "epoch": 0.9072543617998163,
+      "grad_norm": 0.21740219428376328,
+      "learning_rate": 8.93067870120616e-06,
+      "loss": 1.4374,
+      "step": 494
+    },
+    {
+      "epoch": 0.9090909090909091,
+      "grad_norm": 0.2482842265282672,
+      "learning_rate": 8.92612933548335e-06,
+      "loss": 1.7847,
+      "step": 495
+    },
+    {
+      "epoch": 0.9109274563820018,
+      "grad_norm": 0.19968002281932487,
+      "learning_rate": 8.921571476747861e-06,
+      "loss": 1.6578,
+      "step": 496
+    },
+    {
+      "epoch": 0.9127640036730946,
+      "grad_norm": 0.23718063305783535,
+      "learning_rate": 8.917005134859263e-06,
+      "loss": 1.478,
+      "step": 497
+    },
+    {
+      "epoch": 0.9146005509641874,
+      "grad_norm": 0.2472130753216968,
+      "learning_rate": 8.912430319695478e-06,
+      "loss": 1.5453,
+      "step": 498
+    },
+    {
+      "epoch": 0.9164370982552801,
+      "grad_norm": 0.24331817867045824,
+      "learning_rate": 8.907847041152757e-06,
+      "loss": 1.5475,
+      "step": 499
+    },
+    {
+      "epoch": 0.9182736455463728,
+      "grad_norm": 0.34075220788764593,
+      "learning_rate": 8.90325530914566e-06,
+      "loss": 1.7455,
+      "step": 500
+    },
+    {
+      "epoch": 0.9201101928374655,
+      "grad_norm": 0.1973440685550195,
+      "learning_rate": 8.89865513360703e-06,
+      "loss": 1.5224,
+      "step": 501
+    },
+    {
+      "epoch": 0.9219467401285583,
+      "grad_norm": 0.2392375532163106,
+      "learning_rate": 8.894046524487984e-06,
+      "loss": 1.3295,
+      "step": 502
+    },
+    {
+      "epoch": 0.9237832874196511,
+      "grad_norm": 0.2564773830917158,
+      "learning_rate": 8.889429491757872e-06,
+      "loss": 1.533,
+      "step": 503
+    },
+    {
+      "epoch": 0.9256198347107438,
+      "grad_norm": 0.2205455403328584,
+      "learning_rate": 8.884804045404272e-06,
+      "loss": 1.4521,
+      "step": 504
+    },
+    {
+      "epoch": 0.9274563820018366,
+      "grad_norm": 0.25135270284304534,
+      "learning_rate": 8.88017019543296e-06,
+      "loss": 1.4876,
+      "step": 505
+    },
+    {
+      "epoch": 0.9292929292929293,
+      "grad_norm": 0.251544235242601,
+      "learning_rate": 8.875527951867895e-06,
+      "loss": 1.3732,
+      "step": 506
+    },
+    {
+      "epoch": 0.931129476584022,
+      "grad_norm": 0.23610950027399946,
+      "learning_rate": 8.870877324751186e-06,
+      "loss": 1.3661,
+      "step": 507
+    },
+    {
+      "epoch": 0.9329660238751147,
+      "grad_norm": 0.2699351751142409,
+      "learning_rate": 8.86621832414308e-06,
+      "loss": 1.6805,
+      "step": 508
+    },
+    {
+      "epoch": 0.9348025711662076,
+      "grad_norm": 0.2719550299817604,
+      "learning_rate": 8.861550960121946e-06,
+      "loss": 1.2125,
+      "step": 509
+    },
+    {
+      "epoch": 0.9366391184573003,
+      "grad_norm": 0.23740235364217568,
+      "learning_rate": 8.856875242784228e-06,
+      "loss": 1.4639,
+      "step": 510
+    },
+    {
+      "epoch": 0.938475665748393,
+      "grad_norm": 0.2407044180789032,
+      "learning_rate": 8.852191182244456e-06,
+      "loss": 1.6759,
+      "step": 511
+    },
+    {
+      "epoch": 0.9403122130394858,
+      "grad_norm": 0.22822388370160415,
+      "learning_rate": 8.8474987886352e-06,
+      "loss": 1.5468,
+      "step": 512
+    },
+    {
+      "epoch": 0.9421487603305785,
+      "grad_norm": 0.20492274919803016,
+      "learning_rate": 8.842798072107055e-06,
+      "loss": 1.5179,
+      "step": 513
+    },
+    {
+      "epoch": 0.9439853076216712,
+      "grad_norm": 0.25012220364392496,
+      "learning_rate": 8.838089042828626e-06,
+      "loss": 1.7403,
+      "step": 514
+    },
+    {
+      "epoch": 0.945821854912764,
+      "grad_norm": 0.21419223860479567,
+      "learning_rate": 8.833371710986493e-06,
+      "loss": 1.5632,
+      "step": 515
+    },
+    {
+      "epoch": 0.9476584022038568,
+      "grad_norm": 0.2607121295111944,
+      "learning_rate": 8.828646086785203e-06,
+      "loss": 1.3563,
+      "step": 516
+    },
+    {
+      "epoch": 0.9494949494949495,
+      "grad_norm": 0.204811481952745,
+      "learning_rate": 8.823912180447237e-06,
+      "loss": 1.5761,
+      "step": 517
+    },
+    {
+      "epoch": 0.9513314967860422,
+      "grad_norm": 0.26470613517398467,
+      "learning_rate": 8.819170002212992e-06,
+      "loss": 1.7127,
+      "step": 518
+    },
+    {
+      "epoch": 0.953168044077135,
+      "grad_norm": 0.2610250808679381,
+      "learning_rate": 8.81441956234076e-06,
+      "loss": 1.5655,
+      "step": 519
+    },
+    {
+      "epoch": 0.9550045913682277,
+      "grad_norm": 0.2337315187549265,
+      "learning_rate": 8.809660871106705e-06,
+      "loss": 1.5154,
+      "step": 520
+    },
+    {
+      "epoch": 0.9568411386593205,
+      "grad_norm": 0.23170078740278124,
+      "learning_rate": 8.804893938804839e-06,
+      "loss": 1.5717,
+      "step": 521
+    },
+    {
+      "epoch": 0.9586776859504132,
+      "grad_norm": 0.22632743502454025,
+      "learning_rate": 8.800118775747003e-06,
+      "loss": 1.6218,
+      "step": 522
+    },
+    {
+      "epoch": 0.960514233241506,
+      "grad_norm": 0.2205915233922398,
+      "learning_rate": 8.795335392262841e-06,
+      "loss": 1.4909,
+      "step": 523
+    },
+    {
+      "epoch": 0.9623507805325987,
+      "grad_norm": 0.21145323033626462,
+      "learning_rate": 8.790543798699778e-06,
+      "loss": 1.5984,
+      "step": 524
+    },
+    {
+      "epoch": 0.9641873278236914,
+      "grad_norm": 0.20970398911022825,
+      "learning_rate": 8.785744005423003e-06,
+      "loss": 1.4622,
+      "step": 525
+    },
+    {
+      "epoch": 0.9660238751147842,
+      "grad_norm": 0.23298402376870314,
+      "learning_rate": 8.78093602281544e-06,
+      "loss": 1.5884,
+      "step": 526
+    },
+    {
+      "epoch": 0.967860422405877,
+      "grad_norm": 0.27324051793792004,
+      "learning_rate": 8.77611986127773e-06,
+      "loss": 1.4594,
+      "step": 527
+    },
+    {
+      "epoch": 0.9696969696969697,
+      "grad_norm": 0.2331172811203617,
+      "learning_rate": 8.771295531228204e-06,
+      "loss": 1.525,
+      "step": 528
+    },
+    {
+      "epoch": 0.9715335169880625,
+      "grad_norm": 0.31490123000969455,
+      "learning_rate": 8.766463043102864e-06,
+      "loss": 1.5453,
+      "step": 529
+    },
+    {
+      "epoch": 0.9733700642791552,
+      "grad_norm": 0.22547389438032928,
+      "learning_rate": 8.761622407355364e-06,
+      "loss": 1.6573,
+      "step": 530
+    },
+    {
+      "epoch": 0.9752066115702479,
+      "grad_norm": 0.21974629433018228,
+      "learning_rate": 8.756773634456975e-06,
+      "loss": 1.396,
+      "step": 531
+    },
+    {
+      "epoch": 0.9770431588613406,
+      "grad_norm": 0.21230467225101732,
+      "learning_rate": 8.751916734896577e-06,
+      "loss": 1.6261,
+      "step": 532
+    },
+    {
+      "epoch": 0.9788797061524335,
+      "grad_norm": 0.2645261233289859,
+      "learning_rate": 8.747051719180626e-06,
+      "loss": 1.435,
+      "step": 533
+    },
+    {
+      "epoch": 0.9807162534435262,
+      "grad_norm": 0.2234025047049364,
+      "learning_rate": 8.742178597833137e-06,
+      "loss": 1.5244,
+      "step": 534
+    },
+    {
+      "epoch": 0.9825528007346189,
+      "grad_norm": 0.2573392390616289,
+      "learning_rate": 8.737297381395657e-06,
+      "loss": 1.8973,
+      "step": 535
+    },
+    {
+      "epoch": 0.9843893480257117,
+      "grad_norm": 0.27996089327128665,
+      "learning_rate": 8.732408080427247e-06,
+      "loss": 1.5882,
+      "step": 536
+    },
+    {
+      "epoch": 0.9862258953168044,
+      "grad_norm": 0.21778812033730788,
+      "learning_rate": 8.727510705504453e-06,
+      "loss": 1.3809,
+      "step": 537
+    },
+    {
+      "epoch": 0.9880624426078971,
+      "grad_norm": 0.2504419591715746,
+      "learning_rate": 8.72260526722129e-06,
+      "loss": 1.4216,
+      "step": 538
+    },
+    {
+      "epoch": 0.98989898989899,
+      "grad_norm": 0.21877782640292506,
+      "learning_rate": 8.717691776189214e-06,
+      "loss": 1.4832,
+      "step": 539
+    },
+    {
+      "epoch": 0.9917355371900827,
+      "grad_norm": 0.2522185082572152,
+      "learning_rate": 8.7127702430371e-06,
+      "loss": 1.5983,
+      "step": 540
+    },
+    {
+      "epoch": 0.9935720844811754,
+      "grad_norm": 0.2468951810241973,
+      "learning_rate": 8.707840678411223e-06,
+      "loss": 1.3155,
+      "step": 541
+    },
+    {
+      "epoch": 0.9954086317722681,
+      "grad_norm": 0.24726883324778043,
+      "learning_rate": 8.702903092975226e-06,
+      "loss": 1.7388,
+      "step": 542
+    },
+    {
+      "epoch": 0.9972451790633609,
+      "grad_norm": 0.26412381788140465,
+      "learning_rate": 8.69795749741011e-06,
+      "loss": 1.5106,
+      "step": 543
+    },
+    {
+      "epoch": 0.9990817263544536,
+      "grad_norm": 0.2482433438633285,
+      "learning_rate": 8.693003902414194e-06,
+      "loss": 1.5944,
+      "step": 544
+    },
+    {
+      "epoch": 0.9990817263544536,
+      "eval_loss": 2.2991089820861816,
+      "eval_runtime": 40.0535,
+      "eval_samples_per_second": 5.118,
+      "eval_steps_per_second": 0.449,
+      "step": 544
+    },
+    {
+      "epoch": 1.0,
+      "grad_norm": 0.2482433438633285,
+      "learning_rate": 8.688042318703111e-06,
+      "loss": 0.7922,
+      "step": 545
+    },
+    {
+      "epoch": 1.0018365472910928,
+      "grad_norm": 0.25123655382867355,
+      "learning_rate": 8.683072757009772e-06,
+      "loss": 1.7327,
+      "step": 546
+    },
+    {
+      "epoch": 1.0036730945821855,
+      "grad_norm": 0.24537805082936553,
+      "learning_rate": 8.678095228084343e-06,
+      "loss": 1.555,
+      "step": 547
+    },
+    {
+      "epoch": 1.0055096418732783,
+      "grad_norm": 0.3081499543511565,
+      "learning_rate": 8.673109742694227e-06,
+      "loss": 1.5413,
+      "step": 548
+    },
+    {
+      "epoch": 1.007346189164371,
+      "grad_norm": 0.2592676032839899,
+      "learning_rate": 8.66811631162404e-06,
+      "loss": 1.492,
+      "step": 549
+    },
+    {
+      "epoch": 1.0091827364554637,
+      "grad_norm": 0.2904580639450211,
+      "learning_rate": 8.663114945675582e-06,
+      "loss": 1.5716,
+      "step": 550
+    },
+    {
+      "epoch": 1.0110192837465566,
+      "grad_norm": 0.21713926154530397,
+      "learning_rate": 8.65810565566782e-06,
+      "loss": 1.594,
+      "step": 551
+    },
+    {
+      "epoch": 1.0128558310376492,
+      "grad_norm": 0.2261416556272091,
+      "learning_rate": 8.653088452436866e-06,
+      "loss": 1.4634,
+      "step": 552
+    },
+    {
+      "epoch": 1.014692378328742,
+      "grad_norm": 0.22760563071654394,
+      "learning_rate": 8.648063346835943e-06,
+      "loss": 1.5002,
+      "step": 553
+    },
+    {
+      "epoch": 1.0165289256198347,
+      "grad_norm": 0.26019149703803174,
+      "learning_rate": 8.643030349735373e-06,
+      "loss": 1.6903,
+      "step": 554
+    },
+    {
+      "epoch": 1.0183654729109275,
+      "grad_norm": 0.2212436573171587,
+      "learning_rate": 8.637989472022548e-06,
+      "loss": 1.285,
+      "step": 555
+    },
+    {
+      "epoch": 1.02020202020202,
+      "grad_norm": 0.26107556496621437,
+      "learning_rate": 8.632940724601908e-06,
+      "loss": 1.19,
+      "step": 556
+    },
+    {
+      "epoch": 1.022038567493113,
+      "grad_norm": 0.2348097298637921,
+      "learning_rate": 8.627884118394913e-06,
+      "loss": 1.5094,
+      "step": 557
+    },
+    {
+      "epoch": 1.0238751147842058,
+      "grad_norm": 0.2534817343289944,
+      "learning_rate": 8.622819664340031e-06,
+      "loss": 1.6285,
+      "step": 558
+    },
+    {
+      "epoch": 1.0257116620752984,
+      "grad_norm": 1.0852928984602161,
+      "learning_rate": 8.617747373392697e-06,
+      "loss": 1.4635,
+      "step": 559
+    },
+    {
+      "epoch": 1.0275482093663912,
+      "grad_norm": 0.23192664878880379,
+      "learning_rate": 8.612667256525305e-06,
+      "loss": 1.5068,
+      "step": 560
+    },
+    {
+      "epoch": 1.0293847566574839,
+      "grad_norm": 0.2289762149123353,
+      "learning_rate": 8.607579324727175e-06,
+      "loss": 1.4366,
+      "step": 561
+    },
+    {
+      "epoch": 1.0312213039485767,
+      "grad_norm": 0.3341007679918475,
+      "learning_rate": 8.602483589004536e-06,
+      "loss": 1.4833,
+      "step": 562
+    },
+    {
+      "epoch": 1.0330578512396693,
+      "grad_norm": 0.35202654468246536,
+      "learning_rate": 8.597380060380493e-06,
+      "loss": 1.4242,
+      "step": 563
+    },
+    {
+      "epoch": 1.0348943985307621,
+      "grad_norm": 0.23511338029802462,
+      "learning_rate": 8.592268749895016e-06,
+      "loss": 1.4497,
+      "step": 564
+    },
+    {
+      "epoch": 1.036730945821855,
+      "grad_norm": 0.2645205013517766,
+      "learning_rate": 8.5871496686049e-06,
+      "loss": 1.5035,
+      "step": 565
+    },
+    {
+      "epoch": 1.0385674931129476,
+      "grad_norm": 0.2311579476869345,
+      "learning_rate": 8.582022827583758e-06,
+      "loss": 1.7116,
+      "step": 566
+    },
+    {
+      "epoch": 1.0404040404040404,
+      "grad_norm": 0.21777675033528562,
+      "learning_rate": 8.576888237921983e-06,
+      "loss": 1.6819,
+      "step": 567
+    },
+    {
+      "epoch": 1.042240587695133,
+      "grad_norm": 0.2873222375547828,
+      "learning_rate": 8.571745910726733e-06,
+      "loss": 1.5841,
+      "step": 568
+    },
+    {
+      "epoch": 1.044077134986226,
+      "grad_norm": 0.21809668347430947,
+      "learning_rate": 8.566595857121902e-06,
+      "loss": 1.4695,
+      "step": 569
+    },
+    {
+      "epoch": 1.0459136822773187,
+      "grad_norm": 1.448742350026709,
+      "learning_rate": 8.5614380882481e-06,
+      "loss": 1.5256,
+      "step": 570
+    },
+    {
+      "epoch": 1.0477502295684114,
+      "grad_norm": 0.23057516973048772,
+      "learning_rate": 8.556272615262623e-06,
+      "loss": 1.4582,
+      "step": 571
+    },
+    {
+      "epoch": 1.0495867768595042,
+      "grad_norm": 0.2830445961299178,
+      "learning_rate": 8.551099449339438e-06,
+      "loss": 1.5283,
+      "step": 572
+    },
+    {
+      "epoch": 1.0514233241505968,
+      "grad_norm": 0.24777574486235304,
+      "learning_rate": 8.545918601669147e-06,
+      "loss": 1.5377,
+      "step": 573
+    },
+    {
+      "epoch": 1.0532598714416896,
+      "grad_norm": 0.25712571630654524,
+      "learning_rate": 8.540730083458976e-06,
+      "loss": 1.396,
+      "step": 574
+    },
+    {
+      "epoch": 1.0550964187327825,
+      "grad_norm": 0.24275902794807133,
+      "learning_rate": 8.535533905932739e-06,
+      "loss": 1.4394,
+      "step": 575
+    },
+    {
+      "epoch": 1.056932966023875,
+      "grad_norm": 0.25586410636861384,
+      "learning_rate": 8.530330080330818e-06,
+      "loss": 1.497,
+      "step": 576
+    },
+    {
+      "epoch": 1.058769513314968,
+      "grad_norm": 0.2841455219574643,
+      "learning_rate": 8.525118617910144e-06,
+      "loss": 1.538,
+      "step": 577
+    },
+    {
+      "epoch": 1.0606060606060606,
+      "grad_norm": 0.2524100566649326,
+      "learning_rate": 8.519899529944166e-06,
+      "loss": 1.5387,
+      "step": 578
+    },
+    {
+      "epoch": 1.0624426078971534,
+      "grad_norm": 0.23467399537898634,
+      "learning_rate": 8.514672827722824e-06,
+      "loss": 1.3737,
+      "step": 579
+    },
+    {
+      "epoch": 1.064279155188246,
+      "grad_norm": 0.2539929102151058,
+      "learning_rate": 8.509438522552537e-06,
+      "loss": 1.6057,
+      "step": 580
+    },
+    {
+      "epoch": 1.0661157024793388,
+      "grad_norm": 0.23061637702881907,
+      "learning_rate": 8.504196625756166e-06,
+      "loss": 1.4044,
+      "step": 581
+    },
+    {
+      "epoch": 1.0679522497704317,
+      "grad_norm": 0.2587924141956031,
+      "learning_rate": 8.498947148672994e-06,
+      "loss": 1.3914,
+      "step": 582
+    },
+    {
+      "epoch": 1.0697887970615243,
+      "grad_norm": 0.24233082939060765,
+      "learning_rate": 8.493690102658703e-06,
+      "loss": 1.5213,
+      "step": 583
+    },
+    {
+      "epoch": 1.0716253443526171,
+      "grad_norm": 0.2502337234889473,
+      "learning_rate": 8.48842549908535e-06,
+      "loss": 1.3456,
+      "step": 584
+    },
+    {
+      "epoch": 1.0734618916437098,
+      "grad_norm": 0.2541968409852936,
+      "learning_rate": 8.483153349341336e-06,
+      "loss": 1.6049,
+      "step": 585
+    },
+    {
+      "epoch": 1.0752984389348026,
+      "grad_norm": 0.21627065109349963,
+      "learning_rate": 8.477873664831388e-06,
+      "loss": 1.4925,
+      "step": 586
+    },
+    {
+      "epoch": 1.0771349862258952,
+      "grad_norm": 0.22881610801325541,
+      "learning_rate": 8.472586456976534e-06,
+      "loss": 1.3223,
+      "step": 587
+    },
+    {
+      "epoch": 1.078971533516988,
+      "grad_norm": 0.24206939505346056,
+      "learning_rate": 8.467291737214078e-06,
+      "loss": 1.4918,
+      "step": 588
+    },
+    {
+      "epoch": 1.0808080808080809,
+      "grad_norm": 0.21011894651478288,
+      "learning_rate": 8.461989516997565e-06,
+      "loss": 1.3396,
+      "step": 589
+    },
+    {
+      "epoch": 1.0826446280991735,
+      "grad_norm": 0.2517596023046296,
+      "learning_rate": 8.456679807796774e-06,
+      "loss": 1.5094,
+      "step": 590
+    },
+    {
+      "epoch": 1.0844811753902663,
+      "grad_norm": 0.22719471330309043,
+      "learning_rate": 8.45136262109768e-06,
+      "loss": 1.4592,
+      "step": 591
+    },
+    {
+      "epoch": 1.086317722681359,
+      "grad_norm": 0.24930635006933696,
+      "learning_rate": 8.446037968402438e-06,
+      "loss": 1.6766,
+      "step": 592
+    },
+    {
+      "epoch": 1.0881542699724518,
+      "grad_norm": 0.21939568323560954,
+      "learning_rate": 8.440705861229344e-06,
+      "loss": 1.4538,
+      "step": 593
+    },
+    {
+      "epoch": 1.0899908172635446,
+      "grad_norm": 0.26053029521632814,
+      "learning_rate": 8.43536631111283e-06,
+      "loss": 1.3987,
+      "step": 594
+    },
+    {
+      "epoch": 1.0918273645546372,
+      "grad_norm": 0.23986894817042073,
+      "learning_rate": 8.430019329603423e-06,
+      "loss": 1.7005,
+      "step": 595
+    },
+    {
+      "epoch": 1.09366391184573,
+      "grad_norm": 0.21801456173726347,
+      "learning_rate": 8.424664928267724e-06,
+      "loss": 1.5571,
+      "step": 596
+    },
+    {
+      "epoch": 1.0955004591368227,
+      "grad_norm": 0.2893290553978988,
+      "learning_rate": 8.41930311868839e-06,
+      "loss": 1.5334,
+      "step": 597
+    },
+    {
+      "epoch": 1.0973370064279155,
+      "grad_norm": 0.24472364821129983,
+      "learning_rate": 8.4139339124641e-06,
+      "loss": 1.6033,
+      "step": 598
+    },
+    {
+      "epoch": 1.0991735537190084,
+      "grad_norm": 0.2443517137830122,
+      "learning_rate": 8.408557321209534e-06,
+      "loss": 1.5365,
+      "step": 599
+    },
+    {
+      "epoch": 1.101010101010101,
+      "grad_norm": 0.26997028267058526,
+      "learning_rate": 8.403173356555348e-06,
+      "loss": 1.5572,
+      "step": 600
+    },
+    {
+      "epoch": 1.1028466483011938,
+      "grad_norm": 0.2480886208288665,
+      "learning_rate": 8.397782030148147e-06,
+      "loss": 1.6098,
+      "step": 601
+    },
+    {
+      "epoch": 1.1046831955922864,
+      "grad_norm": 0.6782476762876417,
+      "learning_rate": 8.392383353650463e-06,
+      "loss": 1.5232,
+      "step": 602
+    },
+    {
+      "epoch": 1.1065197428833793,
+      "grad_norm": 0.2356280053432311,
+      "learning_rate": 8.386977338740724e-06,
+      "loss": 1.3312,
+      "step": 603
+    },
+    {
+      "epoch": 1.108356290174472,
+      "grad_norm": 0.24055852428031851,
+      "learning_rate": 8.381563997113235e-06,
+      "loss": 1.4306,
+      "step": 604
+    },
+    {
+      "epoch": 1.1101928374655647,
+      "grad_norm": 0.2426057612064612,
+      "learning_rate": 8.376143340478153e-06,
+      "loss": 1.6529,
+      "step": 605
+    },
+    {
+      "epoch": 1.1120293847566576,
+      "grad_norm": 0.2484194086734517,
+      "learning_rate": 8.370715380561455e-06,
+      "loss": 1.6209,
+      "step": 606
+    },
+    {
+      "epoch": 1.1138659320477502,
+      "grad_norm": 0.2091161376280446,
+      "learning_rate": 8.365280129104912e-06,
+      "loss": 1.768,
+      "step": 607
+    },
+    {
+      "epoch": 1.115702479338843,
+      "grad_norm": 0.21010090473977264,
+      "learning_rate": 8.35983759786608e-06,
+      "loss": 1.5471,
+      "step": 608
+    },
+    {
+      "epoch": 1.1175390266299357,
+      "grad_norm": 0.20654219823058445,
+      "learning_rate": 8.354387798618254e-06,
+      "loss": 1.4369,
+      "step": 609
+    },
+    {
+      "epoch": 1.1193755739210285,
+      "grad_norm": 0.21252385116315373,
+      "learning_rate": 8.348930743150453e-06,
+      "loss": 1.4925,
+      "step": 610
+    },
+    {
+      "epoch": 1.121212121212121,
+      "grad_norm": 0.23916865273973958,
+      "learning_rate": 8.34346644326739e-06,
+      "loss": 1.4318,
+      "step": 611
+    },
+    {
+      "epoch": 1.123048668503214,
+      "grad_norm": 0.2473004130028652,
+      "learning_rate": 8.337994910789457e-06,
+      "loss": 1.3704,
+      "step": 612
+    },
+    {
+      "epoch": 1.1248852157943068,
+      "grad_norm": 0.21955986794017143,
+      "learning_rate": 8.332516157552684e-06,
+      "loss": 1.6168,
+      "step": 613
+    },
+    {
+      "epoch": 1.1267217630853994,
+      "grad_norm": 0.22205609284625075,
+      "learning_rate": 8.327030195408723e-06,
+      "loss": 1.2926,
+      "step": 614
+    },
+    {
+      "epoch": 1.1285583103764922,
+      "grad_norm": 0.263864161571003,
+      "learning_rate": 8.321537036224822e-06,
+      "loss": 1.5341,
+      "step": 615
+    },
+    {
+      "epoch": 1.1303948576675849,
+      "grad_norm": 0.23516213157995472,
+      "learning_rate": 8.316036691883796e-06,
+      "loss": 1.6097,
+      "step": 616
+    },
+    {
+      "epoch": 1.1322314049586777,
+      "grad_norm": 0.24052656138833545,
+      "learning_rate": 8.310529174284004e-06,
+      "loss": 1.4662,
+      "step": 617
+    },
+    {
+      "epoch": 1.1340679522497705,
+      "grad_norm": 0.2396327813688888,
+      "learning_rate": 8.305014495339319e-06,
+      "loss": 1.5582,
+      "step": 618
+    },
+    {
+      "epoch": 1.1359044995408631,
+      "grad_norm": 0.22695869472725907,
+      "learning_rate": 8.299492666979114e-06,
+      "loss": 1.2423,
+      "step": 619
+    },
+    {
+      "epoch": 1.137741046831956,
+      "grad_norm": 0.2830556165473928,
+      "learning_rate": 8.293963701148215e-06,
+      "loss": 1.6616,
+      "step": 620
+    },
+    {
+      "epoch": 1.1395775941230486,
+      "grad_norm": 0.25128924093201527,
+      "learning_rate": 8.288427609806899e-06,
+      "loss": 1.5479,
+      "step": 621
+    },
+    {
+      "epoch": 1.1414141414141414,
+      "grad_norm": 0.23823257489910915,
+      "learning_rate": 8.282884404930852e-06,
+      "loss": 1.4531,
+      "step": 622
+    },
+    {
+      "epoch": 1.1432506887052343,
+      "grad_norm": 0.2169452673331494,
+      "learning_rate": 8.277334098511147e-06,
+      "loss": 1.4788,
+      "step": 623
+    },
+    {
+      "epoch": 1.145087235996327,
+      "grad_norm": 0.2905961317813161,
+      "learning_rate": 8.271776702554221e-06,
+      "loss": 1.5503,
+      "step": 624
+    },
+    {
+      "epoch": 1.1469237832874197,
+      "grad_norm": 0.2440714857888354,
+      "learning_rate": 8.266212229081846e-06,
+      "loss": 1.4501,
+      "step": 625
+    },
+    {
+      "epoch": 1.1487603305785123,
+      "grad_norm": 0.213213589804518,
+      "learning_rate": 8.260640690131108e-06,
+      "loss": 1.4492,
+      "step": 626
+    },
+    {
+      "epoch": 1.1505968778696052,
+      "grad_norm": 0.23437161712673651,
+      "learning_rate": 8.255062097754371e-06,
+      "loss": 1.5111,
+      "step": 627
+    },
+    {
+      "epoch": 1.1524334251606978,
+      "grad_norm": 0.20618402331394328,
+      "learning_rate": 8.249476464019259e-06,
+      "loss": 1.5325,
+      "step": 628
+    },
+    {
+      "epoch": 1.1542699724517906,
+      "grad_norm": 0.22659823180486846,
+      "learning_rate": 8.243883801008632e-06,
+      "loss": 1.4732,
+      "step": 629
+    },
+    {
+      "epoch": 1.1561065197428835,
+      "grad_norm": 0.5998677861802245,
+      "learning_rate": 8.238284120820549e-06,
+      "loss": 1.5377,
+      "step": 630
+    },
+    {
+      "epoch": 1.157943067033976,
+      "grad_norm": 0.2698674524108185,
+      "learning_rate": 8.232677435568252e-06,
+      "loss": 1.4979,
+      "step": 631
+    },
+    {
+      "epoch": 1.159779614325069,
+      "grad_norm": 0.20529816428658398,
+      "learning_rate": 8.227063757380141e-06,
+      "loss": 1.4952,
+      "step": 632
+    },
+    {
+      "epoch": 1.1616161616161615,
+      "grad_norm": 0.2273780867927969,
+      "learning_rate": 8.221443098399733e-06,
+      "loss": 1.6565,
+      "step": 633
+    },
+    {
+      "epoch": 1.1634527089072544,
+      "grad_norm": 0.24433874393165086,
+      "learning_rate": 8.215815470785655e-06,
+      "loss": 1.5764,
+      "step": 634
+    },
+    {
+      "epoch": 1.165289256198347,
+      "grad_norm": 0.2856532742091204,
+      "learning_rate": 8.210180886711603e-06,
+      "loss": 1.4408,
+      "step": 635
+    },
+    {
+      "epoch": 1.1671258034894398,
+      "grad_norm": 0.24118846977617991,
+      "learning_rate": 8.204539358366325e-06,
+      "loss": 1.601,
+      "step": 636
+    },
+    {
+      "epoch": 1.1689623507805327,
+      "grad_norm": 0.20626688664328777,
+      "learning_rate": 8.198890897953586e-06,
+      "loss": 1.8095,
+      "step": 637
+    },
+    {
+      "epoch": 1.1707988980716253,
+      "grad_norm": 0.6284004866056194,
+      "learning_rate": 8.193235517692154e-06,
+      "loss": 1.4371,
+      "step": 638
+    },
+    {
+      "epoch": 1.1726354453627181,
+      "grad_norm": 0.23853353758157897,
+      "learning_rate": 8.187573229815757e-06,
+      "loss": 1.4212,
+      "step": 639
+    },
+    {
+      "epoch": 1.1744719926538107,
+      "grad_norm": 0.2879866157971752,
+      "learning_rate": 8.181904046573075e-06,
+      "loss": 1.7247,
+      "step": 640
+    },
+    {
+      "epoch": 1.1763085399449036,
+      "grad_norm": 0.24339771945291888,
+      "learning_rate": 8.176227980227693e-06,
+      "loss": 1.4935,
+      "step": 641
+    },
+    {
+      "epoch": 1.1781450872359964,
+      "grad_norm": 0.23124975641952975,
+      "learning_rate": 8.170545043058097e-06,
+      "loss": 1.5613,
+      "step": 642
+    },
+    {
+      "epoch": 1.179981634527089,
+      "grad_norm": 0.21189387531914136,
+      "learning_rate": 8.164855247357628e-06,
+      "loss": 1.5664,
+      "step": 643
+    },
+    {
+      "epoch": 1.1818181818181819,
+      "grad_norm": 0.24171564426205538,
+      "learning_rate": 8.159158605434468e-06,
+      "loss": 1.5857,
+      "step": 644
+    },
+    {
+      "epoch": 1.1836547291092745,
+      "grad_norm": 0.5762435233520594,
+      "learning_rate": 8.153455129611605e-06,
+      "loss": 1.5551,
+      "step": 645
+    },
+    {
+      "epoch": 1.1854912764003673,
+      "grad_norm": 0.24567321845709728,
+      "learning_rate": 8.147744832226815e-06,
+      "loss": 1.6507,
+      "step": 646
+    },
+    {
+      "epoch": 1.1873278236914602,
+      "grad_norm": 0.2058397175376501,
+      "learning_rate": 8.142027725632622e-06,
+      "loss": 1.67,
+      "step": 647
+    },
+    {
+      "epoch": 1.1891643709825528,
+      "grad_norm": 0.23921899423672816,
+      "learning_rate": 8.136303822196291e-06,
+      "loss": 1.3641,
+      "step": 648
+    },
+    {
+      "epoch": 1.1910009182736456,
+      "grad_norm": 0.30231315345826854,
+      "learning_rate": 8.130573134299782e-06,
+      "loss": 1.3477,
+      "step": 649
+    },
+    {
+      "epoch": 1.1928374655647382,
+      "grad_norm": 0.22560319938066786,
+      "learning_rate": 8.12483567433973e-06,
+      "loss": 1.5749,
+      "step": 650
+    },
+    {
+      "epoch": 1.194674012855831,
+      "grad_norm": 0.23140551991013897,
+      "learning_rate": 8.119091454727427e-06,
+      "loss": 1.5127,
+      "step": 651
+    },
+    {
+      "epoch": 1.1965105601469237,
+      "grad_norm": 0.2513575348384973,
+      "learning_rate": 8.11334048788878e-06,
+      "loss": 1.4975,
+      "step": 652
+    },
+    {
+      "epoch": 1.1983471074380165,
+      "grad_norm": 0.2327532164827635,
+      "learning_rate": 8.107582786264299e-06,
+      "loss": 1.6873,
+      "step": 653
+    },
+    {
+      "epoch": 1.2001836547291092,
+      "grad_norm": 0.22482575564896123,
+      "learning_rate": 8.101818362309051e-06,
+      "loss": 1.4014,
+      "step": 654
+    },
+    {
+      "epoch": 1.202020202020202,
+      "grad_norm": 0.24529386319059354,
+      "learning_rate": 8.09604722849266e-06,
+      "loss": 1.6443,
+      "step": 655
+    },
+    {
+      "epoch": 1.2038567493112948,
+      "grad_norm": 0.22687654727578463,
+      "learning_rate": 8.09026939729925e-06,
+      "loss": 1.6704,
+      "step": 656
+    },
+    {
+      "epoch": 1.2056932966023874,
+      "grad_norm": 0.208268755246811,
+      "learning_rate": 8.084484881227449e-06,
+      "loss": 1.5679,
+      "step": 657
+    },
+    {
+      "epoch": 1.2075298438934803,
+      "grad_norm": 0.21310630774681036,
+      "learning_rate": 8.078693692790325e-06,
+      "loss": 1.4717,
+      "step": 658
+    },
+    {
+      "epoch": 1.209366391184573,
+      "grad_norm": 0.22105695777423623,
+      "learning_rate": 8.072895844515398e-06,
+      "loss": 1.6775,
+      "step": 659
+    },
+    {
+      "epoch": 1.2112029384756657,
+      "grad_norm": 0.25921274981827536,
+      "learning_rate": 8.067091348944587e-06,
+      "loss": 1.6739,
+      "step": 660
+    },
+    {
+      "epoch": 1.2130394857667586,
+      "grad_norm": 0.23273938553415982,
+      "learning_rate": 8.061280218634192e-06,
+      "loss": 1.6909,
+      "step": 661
+    },
+    {
+      "epoch": 1.2148760330578512,
+      "grad_norm": 0.28515248987807656,
+      "learning_rate": 8.055462466154862e-06,
+      "loss": 1.2906,
+      "step": 662
+    },
+    {
+      "epoch": 1.216712580348944,
+      "grad_norm": 0.22585050251167946,
+      "learning_rate": 8.049638104091575e-06,
+      "loss": 1.5408,
+      "step": 663
+    },
+    {
+      "epoch": 1.2185491276400366,
+      "grad_norm": 0.25027308334051257,
+      "learning_rate": 8.043807145043604e-06,
+      "loss": 1.4935,
+      "step": 664
+    },
+    {
+      "epoch": 1.2203856749311295,
+      "grad_norm": 0.2488600429795027,
+      "learning_rate": 8.037969601624495e-06,
+      "loss": 1.6285,
+      "step": 665
+    },
+    {
+      "epoch": 1.2222222222222223,
+      "grad_norm": 0.2326483163361331,
+      "learning_rate": 8.032125486462037e-06,
+      "loss": 1.6027,
+      "step": 666
+    },
+    {
+      "epoch": 1.224058769513315,
+      "grad_norm": 0.3031224549473356,
+      "learning_rate": 8.026274812198235e-06,
+      "loss": 1.5161,
+      "step": 667
+    },
+    {
+      "epoch": 1.2258953168044078,
+      "grad_norm": 0.2327369128693008,
+      "learning_rate": 8.020417591489279e-06,
+      "loss": 1.4811,
+      "step": 668
+    },
+    {
+      "epoch": 1.2277318640955004,
+      "grad_norm": 0.2729819241312185,
+      "learning_rate": 8.014553837005527e-06,
+      "loss": 1.4844,
+      "step": 669
+    },
+    {
+      "epoch": 1.2295684113865932,
+      "grad_norm": 0.25673382776635867,
+      "learning_rate": 8.008683561431463e-06,
+      "loss": 1.5585,
+      "step": 670
+    },
+    {
+      "epoch": 1.231404958677686,
+      "grad_norm": 0.2633879747502126,
+      "learning_rate": 8.002806777465685e-06,
+      "loss": 1.3361,
+      "step": 671
+    },
+    {
+      "epoch": 1.2332415059687787,
+      "grad_norm": 0.4185330332994026,
+      "learning_rate": 7.996923497820866e-06,
+      "loss": 1.6391,
+      "step": 672
+    },
+    {
+      "epoch": 1.2350780532598715,
+      "grad_norm": 0.22369971333997035,
+      "learning_rate": 7.99103373522373e-06,
+      "loss": 1.7274,
+      "step": 673
+    },
+    {
+      "epoch": 1.2369146005509641,
+      "grad_norm": 0.24044282161090655,
+      "learning_rate": 7.985137502415027e-06,
+      "loss": 1.4211,
+      "step": 674
+    },
+    {
+      "epoch": 1.238751147842057,
+      "grad_norm": 0.2935202034100143,
+      "learning_rate": 7.9792348121495e-06,
+      "loss": 1.2459,
+      "step": 675
+    },
+    {
+      "epoch": 1.2405876951331496,
+      "grad_norm": 0.22157832211839776,
+      "learning_rate": 7.973325677195869e-06,
+      "loss": 1.4539,
+      "step": 676
+    },
+    {
+      "epoch": 1.2424242424242424,
+      "grad_norm": 0.24668465392267197,
+      "learning_rate": 7.967410110336782e-06,
+      "loss": 1.4469,
+      "step": 677
+    },
+    {
+      "epoch": 1.244260789715335,
+      "grad_norm": 0.2555940790799855,
+      "learning_rate": 7.961488124368813e-06,
+      "loss": 1.5601,
+      "step": 678
+    },
+    {
+      "epoch": 1.2460973370064279,
+      "grad_norm": 0.23036945990648297,
+      "learning_rate": 7.955559732102414e-06,
+      "loss": 1.3647,
+      "step": 679
+    },
+    {
+      "epoch": 1.2479338842975207,
+      "grad_norm": 0.20887737266237028,
+      "learning_rate": 7.9496249463619e-06,
+      "loss": 1.4313,
+      "step": 680
+    },
+    {
+      "epoch": 1.2479338842975207,
+      "eval_loss": 2.2916746139526367,
+      "eval_runtime": 38.5791,
+      "eval_samples_per_second": 5.314,
+      "eval_steps_per_second": 0.467,
+      "step": 680
+    },
+    {
+      "epoch": 1.2497704315886133,
+      "grad_norm": 0.28511804221730047,
+      "learning_rate": 7.943683779985412e-06,
+      "loss": 1.6532,
+      "step": 681
+    },
+    {
+      "epoch": 1.2516069788797062,
+      "grad_norm": 0.28040352247728734,
+      "learning_rate": 7.937736245824898e-06,
+      "loss": 1.4731,
+      "step": 682
+    },
+    {
+      "epoch": 1.2534435261707988,
+      "grad_norm": 0.2506655959884705,
+      "learning_rate": 7.931782356746076e-06,
+      "loss": 1.4813,
+      "step": 683
+    },
+    {
+      "epoch": 1.2552800734618916,
+      "grad_norm": 0.24609807077855472,
+      "learning_rate": 7.925822125628415e-06,
+      "loss": 1.6422,
+      "step": 684
+    },
+    {
+      "epoch": 1.2571166207529845,
+      "grad_norm": 0.2679826355117991,
+      "learning_rate": 7.919855565365102e-06,
+      "loss": 1.4304,
+      "step": 685
+    },
+    {
+      "epoch": 1.258953168044077,
+      "grad_norm": 0.2136139959253996,
+      "learning_rate": 7.913882688863015e-06,
+      "loss": 1.4723,
+      "step": 686
+    },
+    {
+      "epoch": 1.26078971533517,
+      "grad_norm": 0.21181884838242626,
+      "learning_rate": 7.907903509042696e-06,
+      "loss": 1.428,
+      "step": 687
+    },
+    {
+      "epoch": 1.2626262626262625,
+      "grad_norm": 0.23531366813436308,
+      "learning_rate": 7.901918038838318e-06,
+      "loss": 1.3371,
+      "step": 688
+    },
+    {
+      "epoch": 1.2644628099173554,
+      "grad_norm": 0.24164865702276508,
+      "learning_rate": 7.895926291197667e-06,
+      "loss": 1.7756,
+      "step": 689
+    },
+    {
+      "epoch": 1.2662993572084482,
+      "grad_norm": 0.21062389569023543,
+      "learning_rate": 7.889928279082108e-06,
+      "loss": 1.3927,
+      "step": 690
+    },
+    {
+      "epoch": 1.2681359044995408,
+      "grad_norm": 0.2074000186711054,
+      "learning_rate": 7.883924015466554e-06,
+      "loss": 1.484,
+      "step": 691
+    },
+    {
+      "epoch": 1.2699724517906337,
+      "grad_norm": 0.2387562365554438,
+      "learning_rate": 7.877913513339444e-06,
+      "loss": 1.5137,
+      "step": 692
+    },
+    {
+      "epoch": 1.2718089990817263,
+      "grad_norm": 0.516662377477242,
+      "learning_rate": 7.871896785702707e-06,
+      "loss": 1.4716,
+      "step": 693
+    },
+    {
+      "epoch": 1.2736455463728191,
+      "grad_norm": 0.2397429749697421,
+      "learning_rate": 7.86587384557175e-06,
+      "loss": 1.4607,
+      "step": 694
+    },
+    {
+      "epoch": 1.275482093663912,
+      "grad_norm": 0.24982714799055714,
+      "learning_rate": 7.859844705975405e-06,
+      "loss": 1.3678,
+      "step": 695
+    },
+    {
+      "epoch": 1.2773186409550046,
+      "grad_norm": 0.24213016325923115,
+      "learning_rate": 7.853809379955926e-06,
+      "loss": 1.5956,
+      "step": 696
+    },
+    {
+      "epoch": 1.2791551882460974,
+      "grad_norm": 0.5032455281053377,
+      "learning_rate": 7.847767880568944e-06,
+      "loss": 1.5566,
+      "step": 697
+    },
+    {
+      "epoch": 1.28099173553719,
+      "grad_norm": 0.2619847914674294,
+      "learning_rate": 7.841720220883446e-06,
+      "loss": 1.4272,
+      "step": 698
+    },
+    {
+      "epoch": 1.2828282828282829,
+      "grad_norm": 0.24860484103037345,
+      "learning_rate": 7.835666413981744e-06,
+      "loss": 1.5111,
+      "step": 699
+    },
+    {
+      "epoch": 1.2846648301193757,
+      "grad_norm": 0.22131497360679758,
+      "learning_rate": 7.829606472959445e-06,
+      "loss": 1.6785,
+      "step": 700
+    },
+    {
+      "epoch": 1.2865013774104683,
+      "grad_norm": 0.22543726289551383,
+      "learning_rate": 7.823540410925434e-06,
+      "loss": 1.4734,
+      "step": 701
+    },
+    {
+      "epoch": 1.288337924701561,
+      "grad_norm": 0.2445382639920126,
+      "learning_rate": 7.81746824100183e-06,
+      "loss": 1.374,
+      "step": 702
+    },
+    {
+      "epoch": 1.2901744719926538,
+      "grad_norm": 0.22310896972898842,
+      "learning_rate": 7.811389976323963e-06,
+      "loss": 1.6159,
+      "step": 703
+    },
+    {
+      "epoch": 1.2920110192837466,
+      "grad_norm": 0.2480657407835977,
+      "learning_rate": 7.80530563004035e-06,
+      "loss": 1.6499,
+      "step": 704
+    },
+    {
+      "epoch": 1.2938475665748392,
+      "grad_norm": 0.26277048171510314,
+      "learning_rate": 7.799215215312667e-06,
+      "loss": 1.6124,
+      "step": 705
+    },
+    {
+      "epoch": 1.295684113865932,
+      "grad_norm": 0.24829226079425715,
+      "learning_rate": 7.793118745315713e-06,
+      "loss": 1.5359,
+      "step": 706
+    },
+    {
+      "epoch": 1.2975206611570247,
+      "grad_norm": 0.2792056287076263,
+      "learning_rate": 7.787016233237387e-06,
+      "loss": 1.4507,
+      "step": 707
+    },
+    {
+      "epoch": 1.2993572084481175,
+      "grad_norm": 0.23333586007805976,
+      "learning_rate": 7.780907692278657e-06,
+      "loss": 1.5978,
+      "step": 708
+    },
+    {
+      "epoch": 1.3011937557392104,
+      "grad_norm": 0.232312920030107,
+      "learning_rate": 7.774793135653537e-06,
+      "loss": 1.5415,
+      "step": 709
+    },
+    {
+      "epoch": 1.303030303030303,
+      "grad_norm": 0.3527876369018892,
+      "learning_rate": 7.768672576589046e-06,
+      "loss": 1.492,
+      "step": 710
+    },
+    {
+      "epoch": 1.3048668503213958,
+      "grad_norm": 0.22483173449652616,
+      "learning_rate": 7.7625460283252e-06,
+      "loss": 1.5673,
+      "step": 711
+    },
+    {
+      "epoch": 1.3067033976124884,
+      "grad_norm": 0.22545586469260495,
+      "learning_rate": 7.756413504114955e-06,
+      "loss": 1.4843,
+      "step": 712
+    },
+    {
+      "epoch": 1.3085399449035813,
+      "grad_norm": 0.21610719172730797,
+      "learning_rate": 7.750275017224208e-06,
+      "loss": 1.4673,
+      "step": 713
+    },
+    {
+      "epoch": 1.3103764921946741,
+      "grad_norm": 0.23308407573698572,
+      "learning_rate": 7.744130580931746e-06,
+      "loss": 1.598,
+      "step": 714
+    },
+    {
+      "epoch": 1.3122130394857667,
+      "grad_norm": 0.3081156550370704,
+      "learning_rate": 7.737980208529232e-06,
+      "loss": 1.7712,
+      "step": 715
+    },
+    {
+      "epoch": 1.3140495867768596,
+      "grad_norm": 0.2277299881607153,
+      "learning_rate": 7.731823913321162e-06,
+      "loss": 1.5439,
+      "step": 716
+    },
+    {
+      "epoch": 1.3158861340679522,
+      "grad_norm": 0.2261790457696541,
+      "learning_rate": 7.725661708624855e-06,
+      "loss": 1.4424,
+      "step": 717
+    },
+    {
+      "epoch": 1.317722681359045,
+      "grad_norm": 0.2237354785201151,
+      "learning_rate": 7.719493607770402e-06,
+      "loss": 1.3813,
+      "step": 718
+    },
+    {
+      "epoch": 1.3195592286501379,
+      "grad_norm": 0.2471817629434866,
+      "learning_rate": 7.713319624100657e-06,
+      "loss": 1.3034,
+      "step": 719
+    },
+    {
+      "epoch": 1.3213957759412305,
+      "grad_norm": 0.3035039372001864,
+      "learning_rate": 7.707139770971196e-06,
+      "loss": 1.6639,
+      "step": 720
+    },
+    {
+      "epoch": 1.3232323232323233,
+      "grad_norm": 0.2091045117588451,
+      "learning_rate": 7.700954061750295e-06,
+      "loss": 1.6283,
+      "step": 721
+    },
+    {
+      "epoch": 1.325068870523416,
+      "grad_norm": 0.21999656684817168,
+      "learning_rate": 7.69476250981889e-06,
+      "loss": 1.6883,
+      "step": 722
+    },
+    {
+      "epoch": 1.3269054178145088,
+      "grad_norm": 0.22296688905927023,
+      "learning_rate": 7.688565128570564e-06,
+      "loss": 1.2859,
+      "step": 723
+    },
+    {
+      "epoch": 1.3287419651056016,
+      "grad_norm": 0.29298559189022394,
+      "learning_rate": 7.682361931411511e-06,
+      "loss": 1.4206,
+      "step": 724
+    },
+    {
+      "epoch": 1.3305785123966942,
+      "grad_norm": 0.2372201100489932,
+      "learning_rate": 7.676152931760496e-06,
+      "loss": 1.4129,
+      "step": 725
+    },
+    {
+      "epoch": 1.3324150596877868,
+      "grad_norm": 0.24453486585164116,
+      "learning_rate": 7.66993814304885e-06,
+      "loss": 1.4764,
+      "step": 726
+    },
+    {
+      "epoch": 1.3342516069788797,
+      "grad_norm": 0.2429372306381853,
+      "learning_rate": 7.663717578720412e-06,
+      "loss": 1.439,
+      "step": 727
+    },
+    {
+      "epoch": 1.3360881542699725,
+      "grad_norm": 0.2816987421723553,
+      "learning_rate": 7.657491252231525e-06,
+      "loss": 1.3778,
+      "step": 728
+    },
+    {
+      "epoch": 1.3379247015610651,
+      "grad_norm": 0.25580047908874903,
+      "learning_rate": 7.651259177050996e-06,
+      "loss": 1.4052,
+      "step": 729
+    },
+    {
+      "epoch": 1.339761248852158,
+      "grad_norm": 0.2510332954403161,
+      "learning_rate": 7.645021366660063e-06,
+      "loss": 1.2693,
+      "step": 730
+    },
+    {
+      "epoch": 1.3415977961432506,
+      "grad_norm": 0.2538337398976697,
+      "learning_rate": 7.638777834552372e-06,
+      "loss": 1.6005,
+      "step": 731
+    },
+    {
+      "epoch": 1.3434343434343434,
+      "grad_norm": 0.21284374524917304,
+      "learning_rate": 7.632528594233948e-06,
+      "loss": 1.5806,
+      "step": 732
+    },
+    {
+      "epoch": 1.3452708907254363,
+      "grad_norm": 0.2900240672988352,
+      "learning_rate": 7.626273659223166e-06,
+      "loss": 1.3743,
+      "step": 733
+    },
+    {
+      "epoch": 1.3471074380165289,
+      "grad_norm": 0.211923591929452,
+      "learning_rate": 7.620013043050713e-06,
+      "loss": 1.4109,
+      "step": 734
+    },
+    {
+      "epoch": 1.3489439853076217,
+      "grad_norm": 0.23819471628055552,
+      "learning_rate": 7.61374675925957e-06,
+      "loss": 1.5683,
+      "step": 735
+    },
+    {
+      "epoch": 1.3507805325987143,
+      "grad_norm": 0.22267648817304916,
+      "learning_rate": 7.607474821404981e-06,
+      "loss": 1.5718,
+      "step": 736
+    },
+    {
+      "epoch": 1.3526170798898072,
+      "grad_norm": 0.20897528565945356,
+      "learning_rate": 7.601197243054411e-06,
+      "loss": 1.5803,
+      "step": 737
+    },
+    {
+      "epoch": 1.3544536271809,
+      "grad_norm": 0.23836237710000147,
+      "learning_rate": 7.59491403778754e-06,
+      "loss": 1.6094,
+      "step": 738
+    },
+    {
+      "epoch": 1.3562901744719926,
+      "grad_norm": 0.21379466003351494,
+      "learning_rate": 7.588625219196208e-06,
+      "loss": 1.6618,
+      "step": 739
+    },
+    {
+      "epoch": 1.3581267217630855,
+      "grad_norm": 0.21583132750196843,
+      "learning_rate": 7.582330800884405e-06,
+      "loss": 1.6781,
+      "step": 740
+    },
+    {
+      "epoch": 1.359963269054178,
+      "grad_norm": 0.26758972397704306,
+      "learning_rate": 7.576030796468233e-06,
+      "loss": 1.4949,
+      "step": 741
+    },
+    {
+      "epoch": 1.361799816345271,
+      "grad_norm": 0.2172026210777453,
+      "learning_rate": 7.569725219575877e-06,
+      "loss": 1.3427,
+      "step": 742
+    },
+    {
+      "epoch": 1.3636363636363638,
+      "grad_norm": 0.26283840849216944,
+      "learning_rate": 7.563414083847573e-06,
+      "loss": 1.5264,
+      "step": 743
+    },
+    {
+      "epoch": 1.3654729109274564,
+      "grad_norm": 0.2699008470427587,
+      "learning_rate": 7.557097402935592e-06,
+      "loss": 1.6242,
+      "step": 744
+    },
+    {
+      "epoch": 1.367309458218549,
+      "grad_norm": 0.22341256290864062,
+      "learning_rate": 7.5507751905041885e-06,
+      "loss": 1.5183,
+      "step": 745
+    },
+    {
+      "epoch": 1.3691460055096418,
+      "grad_norm": 0.29886287460973576,
+      "learning_rate": 7.544447460229587e-06,
+      "loss": 1.4214,
+      "step": 746
+    },
+    {
+      "epoch": 1.3709825528007347,
+      "grad_norm": 0.30173645884694444,
+      "learning_rate": 7.538114225799955e-06,
+      "loss": 1.6159,
+      "step": 747
+    },
+    {
+      "epoch": 1.3728191000918273,
+      "grad_norm": 0.236212235821713,
+      "learning_rate": 7.531775500915357e-06,
+      "loss": 1.6939,
+      "step": 748
+    },
+    {
+      "epoch": 1.3746556473829201,
+      "grad_norm": 0.27558934861916207,
+      "learning_rate": 7.525431299287737e-06,
+      "loss": 1.6312,
+      "step": 749
+    },
+    {
+      "epoch": 1.3764921946740127,
+      "grad_norm": 0.21133929879138727,
+      "learning_rate": 7.519081634640891e-06,
+      "loss": 1.6883,
+      "step": 750
+    },
+    {
+      "epoch": 1.3783287419651056,
+      "grad_norm": 0.27270482697444587,
+      "learning_rate": 7.512726520710429e-06,
+      "loss": 1.436,
+      "step": 751
+    },
+    {
+      "epoch": 1.3801652892561984,
+      "grad_norm": 0.22422109696434905,
+      "learning_rate": 7.506365971243746e-06,
+      "loss": 1.5348,
+      "step": 752
+    },
+    {
+      "epoch": 1.382001836547291,
+      "grad_norm": 0.2411464169416929,
+      "learning_rate": 7.500000000000001e-06,
+      "loss": 1.2626,
+      "step": 753
+    },
+    {
+      "epoch": 1.3838383838383839,
+      "grad_norm": 0.21994274170001296,
+      "learning_rate": 7.493628620750077e-06,
+      "loss": 1.6835,
+      "step": 754
+    },
+    {
+      "epoch": 1.3856749311294765,
+      "grad_norm": 0.22298996950590438,
+      "learning_rate": 7.4872518472765594e-06,
+      "loss": 1.5464,
+      "step": 755
+    },
+    {
+      "epoch": 1.3875114784205693,
+      "grad_norm": 0.23997347026368712,
+      "learning_rate": 7.4808696933737e-06,
+      "loss": 1.4657,
+      "step": 756
+    },
+    {
+      "epoch": 1.3893480257116622,
+      "grad_norm": 0.23630438290502187,
+      "learning_rate": 7.474482172847391e-06,
+      "loss": 1.418,
+      "step": 757
+    },
+    {
+      "epoch": 1.3911845730027548,
+      "grad_norm": 0.25966655230420865,
+      "learning_rate": 7.4680892995151264e-06,
+      "loss": 1.5673,
+      "step": 758
+    },
+    {
+      "epoch": 1.3930211202938476,
+      "grad_norm": 0.2325283451835453,
+      "learning_rate": 7.461691087205993e-06,
+      "loss": 1.4393,
+      "step": 759
+    },
+    {
+      "epoch": 1.3948576675849402,
+      "grad_norm": 0.21802842523556412,
+      "learning_rate": 7.4552875497606145e-06,
+      "loss": 1.3584,
+      "step": 760
+    },
+    {
+      "epoch": 1.396694214876033,
+      "grad_norm": 0.20229431369606604,
+      "learning_rate": 7.4488787010311425e-06,
+      "loss": 1.4294,
+      "step": 761
+    },
+    {
+      "epoch": 1.398530762167126,
+      "grad_norm": 0.2351243430924033,
+      "learning_rate": 7.442464554881213e-06,
+      "loss": 1.5712,
+      "step": 762
+    },
+    {
+      "epoch": 1.4003673094582185,
+      "grad_norm": 0.23000822536409413,
+      "learning_rate": 7.436045125185923e-06,
+      "loss": 1.6317,
+      "step": 763
+    },
+    {
+      "epoch": 1.4022038567493114,
+      "grad_norm": 0.23883309786560977,
+      "learning_rate": 7.429620425831795e-06,
+      "loss": 1.3215,
+      "step": 764
+    },
+    {
+      "epoch": 1.404040404040404,
+      "grad_norm": 0.22881088145004524,
+      "learning_rate": 7.423190470716761e-06,
+      "loss": 1.4168,
+      "step": 765
+    },
+    {
+      "epoch": 1.4058769513314968,
+      "grad_norm": 0.2834968472773536,
+      "learning_rate": 7.416755273750112e-06,
+      "loss": 1.5954,
+      "step": 766
+    },
+    {
+      "epoch": 1.4077134986225897,
+      "grad_norm": 0.2398048082352695,
+      "learning_rate": 7.4103148488524824e-06,
+      "loss": 1.6907,
+      "step": 767
+    },
+    {
+      "epoch": 1.4095500459136823,
+      "grad_norm": 0.21682770246574481,
+      "learning_rate": 7.403869209955814e-06,
+      "loss": 1.8173,
+      "step": 768
+    },
+    {
+      "epoch": 1.4113865932047749,
+      "grad_norm": 0.23796700613883842,
+      "learning_rate": 7.3974183710033334e-06,
+      "loss": 1.4551,
+      "step": 769
+    },
+    {
+      "epoch": 1.4132231404958677,
+      "grad_norm": 0.21064249534142893,
+      "learning_rate": 7.390962345949506e-06,
+      "loss": 1.273,
+      "step": 770
+    },
+    {
+      "epoch": 1.4150596877869606,
+      "grad_norm": 0.24453714591564318,
+      "learning_rate": 7.384501148760024e-06,
+      "loss": 1.6789,
+      "step": 771
+    },
+    {
+      "epoch": 1.4168962350780532,
+      "grad_norm": 0.25495278331832055,
+      "learning_rate": 7.3780347934117646e-06,
+      "loss": 1.6647,
+      "step": 772
+    },
+    {
+      "epoch": 1.418732782369146,
+      "grad_norm": 0.22716103674772303,
+      "learning_rate": 7.371563293892761e-06,
+      "loss": 1.4259,
+      "step": 773
+    },
+    {
+      "epoch": 1.4205693296602386,
+      "grad_norm": 0.2778893615716731,
+      "learning_rate": 7.365086664202183e-06,
+      "loss": 1.5771,
+      "step": 774
+    },
+    {
+      "epoch": 1.4224058769513315,
+      "grad_norm": 0.21461080054346077,
+      "learning_rate": 7.3586049183502875e-06,
+      "loss": 1.6258,
+      "step": 775
+    },
+    {
+      "epoch": 1.4242424242424243,
+      "grad_norm": 0.2376542090826269,
+      "learning_rate": 7.3521180703584025e-06,
+      "loss": 1.6032,
+      "step": 776
+    },
+    {
+      "epoch": 1.426078971533517,
+      "grad_norm": 0.2281816677205824,
+      "learning_rate": 7.345626134258897e-06,
+      "loss": 1.5994,
+      "step": 777
+    },
+    {
+      "epoch": 1.4279155188246098,
+      "grad_norm": 0.2364780239575377,
+      "learning_rate": 7.339129124095141e-06,
+      "loss": 1.5055,
+      "step": 778
+    },
+    {
+      "epoch": 1.4297520661157024,
+      "grad_norm": 0.23009999576259169,
+      "learning_rate": 7.3326270539214826e-06,
+      "loss": 1.597,
+      "step": 779
+    },
+    {
+      "epoch": 1.4315886134067952,
+      "grad_norm": 0.29716639871417605,
+      "learning_rate": 7.326119937803219e-06,
+      "loss": 1.4146,
+      "step": 780
+    },
+    {
+      "epoch": 1.433425160697888,
+      "grad_norm": 0.23733262947356001,
+      "learning_rate": 7.319607789816555e-06,
+      "loss": 1.4938,
+      "step": 781
+    },
+    {
+      "epoch": 1.4352617079889807,
+      "grad_norm": 0.261287890785371,
+      "learning_rate": 7.3130906240485886e-06,
+      "loss": 1.4872,
+      "step": 782
+    },
+    {
+      "epoch": 1.4370982552800735,
+      "grad_norm": 0.19719689520430514,
+      "learning_rate": 7.306568454597269e-06,
+      "loss": 1.4053,
+      "step": 783
+    },
+    {
+      "epoch": 1.4389348025711661,
+      "grad_norm": 0.26516505212824587,
+      "learning_rate": 7.3000412955713694e-06,
+      "loss": 1.6561,
+      "step": 784
+    },
+    {
+      "epoch": 1.440771349862259,
+      "grad_norm": 0.21033165114887953,
+      "learning_rate": 7.293509161090453e-06,
+      "loss": 1.4114,
+      "step": 785
+    },
+    {
+      "epoch": 1.4426078971533518,
+      "grad_norm": 0.23433797165794368,
+      "learning_rate": 7.286972065284854e-06,
+      "loss": 1.4791,
+      "step": 786
+    },
+    {
+      "epoch": 1.4444444444444444,
+      "grad_norm": 0.22419929718237094,
+      "learning_rate": 7.28043002229563e-06,
+      "loss": 1.6343,
+      "step": 787
+    },
+    {
+      "epoch": 1.4462809917355373,
+      "grad_norm": 0.24907933840327323,
+      "learning_rate": 7.273883046274547e-06,
+      "loss": 1.2378,
+      "step": 788
+    },
+    {
+      "epoch": 1.4481175390266299,
+      "grad_norm": 0.4238360648529547,
+      "learning_rate": 7.2673311513840395e-06,
+      "loss": 1.5069,
+      "step": 789
+    },
+    {
+      "epoch": 1.4499540863177227,
+      "grad_norm": 0.2662432650528045,
+      "learning_rate": 7.260774351797183e-06,
+      "loss": 1.7745,
+      "step": 790
+    },
+    {
+      "epoch": 1.4517906336088156,
+      "grad_norm": 0.20673042637363245,
+      "learning_rate": 7.2542126616976596e-06,
+      "loss": 1.4525,
+      "step": 791
+    },
+    {
+      "epoch": 1.4536271808999082,
+      "grad_norm": 0.21420686611771902,
+      "learning_rate": 7.247646095279738e-06,
+      "loss": 1.7167,
+      "step": 792
+    },
+    {
+      "epoch": 1.4554637281910008,
+      "grad_norm": 0.23017808194322006,
+      "learning_rate": 7.241074666748228e-06,
+      "loss": 1.4619,
+      "step": 793
+    },
+    {
+      "epoch": 1.4573002754820936,
+      "grad_norm": 0.26604136306841353,
+      "learning_rate": 7.234498390318461e-06,
+      "loss": 1.568,
+      "step": 794
+    },
+    {
+      "epoch": 1.4591368227731865,
+      "grad_norm": 0.22179140301277936,
+      "learning_rate": 7.227917280216254e-06,
+      "loss": 1.462,
+      "step": 795
+    },
+    {
+      "epoch": 1.460973370064279,
+      "grad_norm": 0.24198533262458394,
+      "learning_rate": 7.2213313506778815e-06,
+      "loss": 1.554,
+      "step": 796
+    },
+    {
+      "epoch": 1.462809917355372,
+      "grad_norm": 0.23659697045516584,
+      "learning_rate": 7.214740615950041e-06,
+      "loss": 1.3295,
+      "step": 797
+    },
+    {
+      "epoch": 1.4646464646464645,
+      "grad_norm": 0.24078632801408795,
+      "learning_rate": 7.208145090289828e-06,
+      "loss": 1.6444,
+      "step": 798
+    },
+    {
+      "epoch": 1.4664830119375574,
+      "grad_norm": 0.27618370077665483,
+      "learning_rate": 7.201544787964698e-06,
+      "loss": 1.7188,
+      "step": 799
+    },
+    {
+      "epoch": 1.4683195592286502,
+      "grad_norm": 0.2260553812482853,
+      "learning_rate": 7.194939723252442e-06,
+      "loss": 1.7874,
+      "step": 800
+    },
+    {
+      "epoch": 1.4701561065197428,
+      "grad_norm": 0.23624090344081144,
+      "learning_rate": 7.188329910441154e-06,
+      "loss": 1.5623,
+      "step": 801
+    },
+    {
+      "epoch": 1.4719926538108357,
+      "grad_norm": 0.2511532187869398,
+      "learning_rate": 7.181715363829196e-06,
+      "loss": 1.4932,
+      "step": 802
+    },
+    {
+      "epoch": 1.4738292011019283,
+      "grad_norm": 0.24894592482296926,
+      "learning_rate": 7.175096097725169e-06,
+      "loss": 1.5337,
+      "step": 803
+    },
+    {
+      "epoch": 1.4756657483930211,
+      "grad_norm": 0.2620746859322951,
+      "learning_rate": 7.168472126447891e-06,
+      "loss": 1.4622,
+      "step": 804
+    },
+    {
+      "epoch": 1.477502295684114,
+      "grad_norm": 0.23994960465192608,
+      "learning_rate": 7.161843464326349e-06,
+      "loss": 1.6129,
+      "step": 805
+    },
+    {
+      "epoch": 1.4793388429752066,
+      "grad_norm": 0.21387650493153448,
+      "learning_rate": 7.155210125699683e-06,
+      "loss": 1.5073,
+      "step": 806
+    },
+    {
+      "epoch": 1.4811753902662994,
+      "grad_norm": 0.22723238722818195,
+      "learning_rate": 7.148572124917148e-06,
+      "loss": 1.4857,
+      "step": 807
+    },
+    {
+      "epoch": 1.483011937557392,
+      "grad_norm": 0.21390061150757966,
+      "learning_rate": 7.141929476338083e-06,
+      "loss": 1.6107,
+      "step": 808
+    },
+    {
+      "epoch": 1.4848484848484849,
+      "grad_norm": 0.26926066183837966,
+      "learning_rate": 7.135282194331881e-06,
+      "loss": 1.5157,
+      "step": 809
+    },
+    {
+      "epoch": 1.4866850321395777,
+      "grad_norm": 0.2150831797481532,
+      "learning_rate": 7.128630293277959e-06,
+      "loss": 1.5721,
+      "step": 810
+    },
+    {
+      "epoch": 1.4885215794306703,
+      "grad_norm": 0.25449702533158935,
+      "learning_rate": 7.121973787565727e-06,
+      "loss": 1.3162,
+      "step": 811
+    },
+    {
+      "epoch": 1.4903581267217632,
+      "grad_norm": 0.2922128124425705,
+      "learning_rate": 7.1153126915945535e-06,
+      "loss": 1.4407,
+      "step": 812
+    },
+    {
+      "epoch": 1.4921946740128558,
+      "grad_norm": 0.2384193264591213,
+      "learning_rate": 7.1086470197737405e-06,
+      "loss": 1.4986,
+      "step": 813
+    },
+    {
+      "epoch": 1.4940312213039486,
+      "grad_norm": 0.25025181781875105,
+      "learning_rate": 7.10197678652248e-06,
+      "loss": 1.6087,
+      "step": 814
+    },
+    {
+      "epoch": 1.4958677685950414,
+      "grad_norm": 0.27273771091987126,
+      "learning_rate": 7.095302006269842e-06,
+      "loss": 1.4817,
+      "step": 815
+    },
+    {
+      "epoch": 1.497704315886134,
+      "grad_norm": 0.21638483381394144,
+      "learning_rate": 7.0886226934547265e-06,
+      "loss": 1.4827,
+      "step": 816
+    },
+    {
+      "epoch": 1.497704315886134,
+      "eval_loss": 2.289696216583252,
+      "eval_runtime": 39.2753,
+      "eval_samples_per_second": 5.22,
+      "eval_steps_per_second": 0.458,
+      "step": 816
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 2176,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 4,
+  "save_steps": 272,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 707317501132800.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}
diff --git a/checkpoint-816/training_args.bin b/checkpoint-816/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1c89872f76294700d651f52629596dab54835031
--- /dev/null
+++ b/checkpoint-816/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b66afbb22c27fefe6b63f9f74c2fd602fa1f166c83cc37801706b6aea4e033c
+size 8632
diff --git a/checkpoint-816/zero_to_fp32.py b/checkpoint-816/zero_to_fp32.py
new file mode 100644
index 0000000000000000000000000000000000000000..e69ecd9acb5a235ffbf927091051106d902b3d39
--- /dev/null
+++ b/checkpoint-816/zero_to_fp32.py
@@ -0,0 +1,674 @@
+#!/usr/bin/env python
+
+# Copyright (c) Microsoft Corporation.
+# SPDX-License-Identifier: Apache-2.0
+
+# DeepSpeed Team
+
+# This script extracts fp32 consolidated weights from a zero 1, 2 and 3 DeepSpeed checkpoints. It gets
+# copied into the top level checkpoint dir, so the user can easily do the conversion at any point in
+# the future. Once extracted, the weights don't require DeepSpeed and can be used in any
+# application.
+#
+# example:
+#   python zero_to_fp32.py . output_dir/
+#   or
+#   python zero_to_fp32.py . output_dir/ --safe_serialization
+
+import argparse
+import torch
+import glob
+import math
+import os
+import re
+import json
+from tqdm import tqdm
+from collections import OrderedDict
+from dataclasses import dataclass
+
+# while this script doesn't use deepspeed to recover data, since the checkpoints are pickled with
+# DeepSpeed data structures it has to be available in the current python environment.
+from deepspeed.utils import logger
+from deepspeed.checkpoint.constants import (DS_VERSION, OPTIMIZER_STATE_DICT, SINGLE_PARTITION_OF_FP32_GROUPS,
+                                            FP32_FLAT_GROUPS, ZERO_STAGE, PARTITION_COUNT, PARAM_SHAPES, BUFFER_NAMES,
+                                            FROZEN_PARAM_SHAPES, FROZEN_PARAM_FRAGMENTS)
+
+
+@dataclass
+class zero_model_state:
+    buffers: dict()
+    param_shapes: dict()
+    shared_params: list
+    ds_version: int
+    frozen_param_shapes: dict()
+    frozen_param_fragments: dict()
+
+
+debug = 0
+
+# load to cpu
+device = torch.device('cpu')
+
+
+def atoi(text):
+    return int(text) if text.isdigit() else text
+
+
+def natural_keys(text):
+    '''
+    alist.sort(key=natural_keys) sorts in human order
+    http://nedbatchelder.com/blog/200712/human_sorting.html
+    (See Toothy's implementation in the comments)
+    '''
+    return [atoi(c) for c in re.split(r'(\d+)', text)]
+
+
+def get_model_state_file(checkpoint_dir, zero_stage):
+    if not os.path.isdir(checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{checkpoint_dir}' doesn't exist")
+
+    # there should be only one file
+    if zero_stage <= 2:
+        file = os.path.join(checkpoint_dir, "mp_rank_00_model_states.pt")
+    elif zero_stage == 3:
+        file = os.path.join(checkpoint_dir, "zero_pp_rank_0_mp_rank_00_model_states.pt")
+
+    if not os.path.exists(file):
+        raise FileNotFoundError(f"can't find model states file at '{file}'")
+
+    return file
+
+
+def get_checkpoint_files(checkpoint_dir, glob_pattern):
+    # XXX: need to test that this simple glob rule works for multi-node setup too
+    ckpt_files = sorted(glob.glob(os.path.join(checkpoint_dir, glob_pattern)), key=natural_keys)
+
+    if len(ckpt_files) == 0:
+        raise FileNotFoundError(f"can't find {glob_pattern} files in directory '{checkpoint_dir}'")
+
+    return ckpt_files
+
+
+def get_optim_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_optim_states.pt")
+
+
+def get_model_state_files(checkpoint_dir):
+    return get_checkpoint_files(checkpoint_dir, "*_model_states.pt")
+
+
+def parse_model_states(files):
+    zero_model_states = []
+    for file in files:
+        state_dict = torch.load(file, map_location=device)
+
+        if BUFFER_NAMES not in state_dict:
+            raise ValueError(f"{file} is not a model state checkpoint")
+        buffer_names = state_dict[BUFFER_NAMES]
+        if debug:
+            print("Found buffers:", buffer_names)
+
+        # recover just the buffers while restoring them to fp32 if they were saved in fp16
+        buffers = {k: v.float() for k, v in state_dict["module"].items() if k in buffer_names}
+        param_shapes = state_dict[PARAM_SHAPES]
+
+        # collect parameters that are included in param_shapes
+        param_names = []
+        for s in param_shapes:
+            for name in s.keys():
+                param_names.append(name)
+
+        # update with frozen parameters
+        frozen_param_shapes = state_dict.get(FROZEN_PARAM_SHAPES, None)
+        if frozen_param_shapes is not None:
+            if debug:
+                print(f"Found frozen_param_shapes: {frozen_param_shapes}")
+            param_names += list(frozen_param_shapes.keys())
+
+        # handle shared params
+        shared_params = [[k, v] for k, v in state_dict["shared_params"].items()]
+
+        ds_version = state_dict.get(DS_VERSION, None)
+
+        frozen_param_fragments = state_dict.get(FROZEN_PARAM_FRAGMENTS, None)
+
+        z_model_state = zero_model_state(buffers=buffers,
+                                         param_shapes=param_shapes,
+                                         shared_params=shared_params,
+                                         ds_version=ds_version,
+                                         frozen_param_shapes=frozen_param_shapes,
+                                         frozen_param_fragments=frozen_param_fragments)
+        zero_model_states.append(z_model_state)
+
+    return zero_model_states
+
+
+def parse_optim_states(files, ds_checkpoint_dir):
+    total_files = len(files)
+    state_dicts = []
+    for f in files:
+        state_dict = torch.load(f, map_location=device)
+        # immediately discard the potentially huge 2 optimizer states as we only care for fp32 master weights
+        # and also handle the case where it was already removed by another helper script
+        state_dict["optimizer_state_dict"].pop("optimizer_state_dict", None)
+        state_dicts.append(state_dict)
+
+    if not ZERO_STAGE in state_dicts[0][OPTIMIZER_STATE_DICT]:
+        raise ValueError(f"{files[0]} is not a zero checkpoint")
+    zero_stage = state_dicts[0][OPTIMIZER_STATE_DICT][ZERO_STAGE]
+    world_size = state_dicts[0][OPTIMIZER_STATE_DICT][PARTITION_COUNT]
+
+    # For ZeRO-2 each param group can have different partition_count as data parallelism for expert
+    # parameters can be different from data parallelism for non-expert parameters. So we can just
+    # use the max of the partition_count to get the dp world_size.
+
+    if type(world_size) is list:
+        world_size = max(world_size)
+
+    if world_size != total_files:
+        raise ValueError(
+            f"Expected {world_size} of '*_optim_states.pt' under '{ds_checkpoint_dir}' but found {total_files} files. "
+            "Possibly due to an overwrite of an old checkpoint, or a checkpoint didn't get saved by one or more processes."
+        )
+
+    # the groups are named differently in each stage
+    if zero_stage <= 2:
+        fp32_groups_key = SINGLE_PARTITION_OF_FP32_GROUPS
+    elif zero_stage == 3:
+        fp32_groups_key = FP32_FLAT_GROUPS
+    else:
+        raise ValueError(f"unknown zero stage {zero_stage}")
+
+    if zero_stage <= 2:
+        fp32_flat_groups = [state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key] for i in range(len(state_dicts))]
+    elif zero_stage == 3:
+        # if there is more than one param group, there will be multiple flattened tensors - one
+        # flattened tensor per group - for simplicity merge them into a single tensor
+        #
+        # XXX: could make the script more memory efficient for when there are multiple groups - it
+        # will require matching the sub-lists of param_shapes for each param group flattened tensor
+
+        fp32_flat_groups = [
+            torch.cat(state_dicts[i][OPTIMIZER_STATE_DICT][fp32_groups_key], 0) for i in range(len(state_dicts))
+        ]
+
+    return zero_stage, world_size, fp32_flat_groups
+
+
+def _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters):
+    """
+    Returns fp32 state_dict reconstructed from ds checkpoint
+
+    Args:
+        - ``ds_checkpoint_dir``: path to the deepspeed checkpoint folder (where the optimizer files are)
+
+    """
+    print(f"Processing zero checkpoint '{ds_checkpoint_dir}'")
+
+    optim_files = get_optim_files(ds_checkpoint_dir)
+    zero_stage, world_size, fp32_flat_groups = parse_optim_states(optim_files, ds_checkpoint_dir)
+    print(f"Detected checkpoint of type zero stage {zero_stage}, world_size: {world_size}")
+
+    model_files = get_model_state_files(ds_checkpoint_dir)
+
+    zero_model_states = parse_model_states(model_files)
+    print(f'Parsing checkpoint created by deepspeed=={zero_model_states[0].ds_version}')
+
+    if zero_stage <= 2:
+        return _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+    elif zero_stage == 3:
+        return _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                                          exclude_frozen_parameters)
+
+
+def _zero2_merge_frozen_params(state_dict, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+    frozen_param_fragments = zero_model_states[0].frozen_param_fragments
+
+    if debug:
+        num_elem = sum(s.numel() for s in frozen_param_shapes.values())
+        print(f'rank 0: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in frozen_param_fragments.values()])
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        state_dict[name] = frozen_param_fragments[name]
+
+        if debug:
+            print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _has_callable(obj, fn):
+    attr = getattr(obj, fn, None)
+    return callable(attr)
+
+
+def _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+
+    # Reconstruction protocol:
+    #
+    # XXX: document this
+
+    if debug:
+        for i in range(world_size):
+            for j in range(len(fp32_flat_groups[0])):
+                print(f"{FP32_FLAT_GROUPS}[{i}][{j}].shape={fp32_flat_groups[i][j].shape}")
+
+    # XXX: memory usage doubles here (zero2)
+    num_param_groups = len(fp32_flat_groups[0])
+    merged_single_partition_of_fp32_groups = []
+    for i in range(num_param_groups):
+        merged_partitions = [sd[i] for sd in fp32_flat_groups]
+        full_single_fp32_vector = torch.cat(merged_partitions, 0)
+        merged_single_partition_of_fp32_groups.append(full_single_fp32_vector)
+    avail_numel = sum(
+        [full_single_fp32_vector.numel() for full_single_fp32_vector in merged_single_partition_of_fp32_groups])
+
+    if debug:
+        wanted_params = sum([len(shapes) for shapes in param_shapes])
+        wanted_numel = sum([sum(shape.numel() for shape in shapes.values()) for shapes in param_shapes])
+        # not asserting if there is a mismatch due to possible padding
+        print(f"Have {avail_numel} numels to process.")
+        print(f"Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    total_numel = 0
+    total_params = 0
+    for shapes, full_single_fp32_vector in zip(param_shapes, merged_single_partition_of_fp32_groups):
+        offset = 0
+        avail_numel = full_single_fp32_vector.numel()
+        for name, shape in shapes.items():
+
+            unpartitioned_numel = shape.numel() if _has_callable(shape, 'numel') else math.prod(shape)
+            total_numel += unpartitioned_numel
+            total_params += 1
+
+            if debug:
+                print(f"{name} full shape: {shape} unpartitioned numel {unpartitioned_numel} ")
+            state_dict[name] = full_single_fp32_vector.narrow(0, offset, unpartitioned_numel).view(shape)
+            offset += unpartitioned_numel
+
+        # Z2 started to align to 2*world_size to improve nccl performance. Therefore both offset and
+        # avail_numel can differ by anywhere between 0..2*world_size. Due to two unrelated complex
+        # paddings performed in the code it's almost impossible to predict the exact numbers w/o the
+        # live optimizer object, so we are checking that the numbers are within the right range
+        align_to = 2 * world_size
+
+        def zero2_align(x):
+            return align_to * math.ceil(x / align_to)
+
+        if debug:
+            print(f"original offset={offset}, avail_numel={avail_numel}")
+
+        offset = zero2_align(offset)
+        avail_numel = zero2_align(avail_numel)
+
+        if debug:
+            print(f"aligned  offset={offset}, avail_numel={avail_numel}")
+
+        # Sanity check
+        if offset != avail_numel:
+            raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero2_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero2_merge_frozen_params(state_dict, zero_model_states)
+
+    _zero2_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def zero3_partitioned_param_info(unpartitioned_numel, world_size):
+    remainder = unpartitioned_numel % world_size
+    padding_numel = (world_size - remainder) if remainder else 0
+    partitioned_numel = math.ceil(unpartitioned_numel / world_size)
+    return partitioned_numel, padding_numel
+
+
+def _zero3_merge_frozen_params(state_dict, world_size, zero_model_states):
+    if zero_model_states[0].frozen_param_shapes is None or len(zero_model_states[0].frozen_param_shapes) == 0:
+        return
+
+    if debug:
+        for i in range(world_size):
+            num_elem = sum(s.numel() for s in zero_model_states[i].frozen_param_fragments.values())
+            print(f'rank {i}: {FROZEN_PARAM_SHAPES}.numel = {num_elem}')
+
+        frozen_param_shapes = zero_model_states[0].frozen_param_shapes
+        wanted_params = len(frozen_param_shapes)
+        wanted_numel = sum(s.numel() for s in frozen_param_shapes.values())
+        avail_numel = sum([p.numel() for p in zero_model_states[0].frozen_param_fragments.values()]) * world_size
+        print(f'Frozen params: Have {avail_numel} numels to process.')
+        print(f'Frozen params: Need {wanted_numel} numels in {wanted_params} params')
+
+    total_params = 0
+    total_numel = 0
+    for name, shape in zero_model_states[0].frozen_param_shapes.items():
+        total_params += 1
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+
+        param_frags = tuple(model_state.frozen_param_fragments[name] for model_state in zero_model_states)
+        state_dict[name] = torch.cat(param_frags, 0).narrow(0, 0, unpartitioned_numel).view(shape)
+
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Frozen params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+    print(f"Reconstructed Frozen fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states):
+    param_shapes = zero_model_states[0].param_shapes
+    avail_numel = fp32_flat_groups[0].numel() * world_size
+    # Reconstruction protocol: For zero3 we need to zip the partitions together at boundary of each
+    # param, re-consolidating each param, while dealing with padding if any
+
+    # merge list of dicts, preserving order
+    param_shapes = {k: v for d in param_shapes for k, v in d.items()}
+
+    if debug:
+        for i in range(world_size):
+            print(f"{FP32_FLAT_GROUPS}[{i}].shape={fp32_flat_groups[i].shape}")
+
+        wanted_params = len(param_shapes)
+        wanted_numel = sum(shape.numel() for shape in param_shapes.values())
+        # not asserting if there is a mismatch due to possible padding
+        avail_numel = fp32_flat_groups[0].numel() * world_size
+        print(f"Trainable params: Have {avail_numel} numels to process.")
+        print(f"Trainable params: Need {wanted_numel} numels in {wanted_params} params.")
+
+    # params
+    # XXX: for huge models that can't fit into the host's RAM we will have to recode this to support
+    # out-of-core computing solution
+    offset = 0
+    total_numel = 0
+    total_params = 0
+    for name, shape in tqdm(param_shapes.items(), desc='Gathering Sharded Weights'):
+        unpartitioned_numel = shape.numel()
+        total_numel += unpartitioned_numel
+        total_params += 1
+        partitioned_numel, partitioned_padding_numel = zero3_partitioned_param_info(unpartitioned_numel, world_size)
+
+        if debug:
+            print(
+                f"Trainable params: {total_params} {name} full shape: {shape} partition0 numel={partitioned_numel} partitioned_padding_numel={partitioned_padding_numel}"
+            )
+
+        # XXX: memory usage doubles here
+        state_dict[name] = torch.cat(
+            tuple(fp32_flat_groups[i].narrow(0, offset, partitioned_numel) for i in range(world_size)),
+            0).narrow(0, 0, unpartitioned_numel).view(shape)
+        offset += partitioned_numel
+
+    offset *= world_size
+
+    # Sanity check
+    if offset != avail_numel:
+        raise ValueError(f"consumed {offset} numels out of {avail_numel} - something is wrong")
+
+    print(f"Reconstructed Trainable fp32 state dict with {total_params} params {total_numel} elements")
+
+
+def _get_fp32_state_dict_from_zero3_checkpoint(world_size, fp32_flat_groups, zero_model_states,
+                                               exclude_frozen_parameters):
+    state_dict = OrderedDict()
+
+    # buffers
+    buffers = zero_model_states[0].buffers
+    state_dict.update(buffers)
+    if debug:
+        print(f"added {len(buffers)} buffers")
+
+    if not exclude_frozen_parameters:
+        _zero3_merge_frozen_params(state_dict, world_size, zero_model_states)
+
+    _zero3_merge_trainable_params(state_dict, world_size, fp32_flat_groups, zero_model_states)
+
+    # recover shared parameters
+    for pair in zero_model_states[0].shared_params:
+        if pair[1] in state_dict:
+            state_dict[pair[0]] = state_dict[pair[1]]
+
+    return state_dict
+
+
+def get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag=None, exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated state_dict that can be loaded with
+    ``load_state_dict()`` and used for training without DeepSpeed or shared with others, for example
+    via a model hub.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in 'latest' file. e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+
+    Returns:
+        - pytorch ``state_dict``
+
+    Note: this approach may not work if your application doesn't have sufficient free CPU memory and
+    you may need to use the offline approach using the ``zero_to_fp32.py`` script that is saved with
+    the checkpoint.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import get_fp32_state_dict_from_zero_checkpoint
+        # do the training and checkpoint saving
+        state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir) # already on cpu
+        model = model.cpu() # move to cpu
+        model.load_state_dict(state_dict)
+        # submit to model hub or save the model to share with others
+
+    In this example the ``model`` will no longer be usable in the deepspeed context of the same
+    application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    If you want it all done for you, use ``load_state_dict_from_zero_checkpoint`` instead.
+
+    """
+    if tag is None:
+        latest_path = os.path.join(checkpoint_dir, 'latest')
+        if os.path.isfile(latest_path):
+            with open(latest_path, 'r') as fd:
+                tag = fd.read().strip()
+        else:
+            raise ValueError(f"Unable to find 'latest' file at {latest_path}")
+
+    ds_checkpoint_dir = os.path.join(checkpoint_dir, tag)
+
+    if not os.path.isdir(ds_checkpoint_dir):
+        raise FileNotFoundError(f"Directory '{ds_checkpoint_dir}' doesn't exist")
+
+    return _get_fp32_state_dict_from_zero_checkpoint(ds_checkpoint_dir, exclude_frozen_parameters)
+
+
+def convert_zero_checkpoint_to_fp32_state_dict(checkpoint_dir,
+                                               output_dir,
+                                               max_shard_size="5GB",
+                                               safe_serialization=False,
+                                               tag=None,
+                                               exclude_frozen_parameters=False):
+    """
+    Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict`` file that can be
+    loaded with ``torch.load(file)`` + ``load_state_dict()`` and used for training without DeepSpeed.
+
+    Args:
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``output_dir``: directory to the pytorch fp32 state_dict output files
+        - ``max_shard_size``: the maximum size for a checkpoint before being sharded, default value is 5GB
+        - ``safe_serialization``:  whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+        - ``exclude_frozen_parameters``: exclude frozen parameters
+    """
+    # Dependency pre-check
+    if safe_serialization:
+        try:
+            from safetensors.torch import save_file
+        except ImportError:
+            print('If you want to use `safe_serialization`, please `pip install safetensors`')
+            raise
+    if max_shard_size is not None:
+        try:
+            from huggingface_hub import split_torch_state_dict_into_shards
+        except ImportError:
+            print('If you want to use `max_shard_size`, please `pip install huggingface_hub`')
+            raise
+
+    # Convert zero checkpoint to state_dict
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag, exclude_frozen_parameters)
+
+    # Shard the model if it is too big.
+    weights_name = "model.safetensors" if safe_serialization else "pytorch_model.bin"
+    if max_shard_size is not None:
+        filename_pattern = weights_name.replace(".bin", "{suffix}.bin").replace(".safetensors", "{suffix}.safetensors")
+        state_dict_split = split_torch_state_dict_into_shards(state_dict,
+                                                              filename_pattern=filename_pattern,
+                                                              max_shard_size=max_shard_size)
+    else:
+        from collections import namedtuple
+        StateDictSplit = namedtuple("StateDictSplit", ["is_sharded", "filename_to_tensors"])
+        state_dict_split = StateDictSplit(is_sharded=False,
+                                          filename_to_tensors={weights_name: list(state_dict.keys())})
+
+    # Save the model
+    filename_to_tensors = state_dict_split.filename_to_tensors.items()
+    for shard_file, tensors in tqdm(filename_to_tensors, desc="Saving checkpoint shards"):
+        shard = {tensor: state_dict[tensor].contiguous() for tensor in tensors}
+        output_path = os.path.join(output_dir, shard_file)
+        if safe_serialization:
+            save_file(shard, output_path, metadata={"format": "pt"})
+        else:
+            torch.save(shard, output_path)
+
+    # Save index if sharded
+    if state_dict_split.is_sharded:
+        index = {
+            "metadata": state_dict_split.metadata,
+            "weight_map": state_dict_split.tensor_to_filename,
+        }
+        save_index_file = "model.safetensors.index.json" if safe_serialization else "pytorch_model.bin.index.json"
+        save_index_file = os.path.join(output_dir, save_index_file)
+        with open(save_index_file, "w", encoding="utf-8") as f:
+            content = json.dumps(index, indent=2, sort_keys=True) + "\n"
+            f.write(content)
+
+
+def load_state_dict_from_zero_checkpoint(model, checkpoint_dir, tag=None):
+    """
+    1. Put the provided model to cpu
+    2. Convert ZeRO 2 or 3 checkpoint into a single fp32 consolidated ``state_dict``
+    3. Load it into the provided model
+
+    Args:
+        - ``model``: the model object to update
+        - ``checkpoint_dir``: path to the desired checkpoint folder. (one that contains the tag-folder, like ``global_step14``)
+        - ``tag``: checkpoint tag used as a unique identifier for checkpoint. If not provided will attempt to load tag in the file named ``latest`` in the checkpoint folder, e.g., ``global_step14``
+
+    Returns:
+        - ``model`: modified model
+
+    Make sure you have plenty of CPU memory available before you call this function. If you don't
+    have enough use the ``zero_to_fp32.py`` utility to do the conversion. You will find it
+    conveniently placed for you in the checkpoint folder.
+
+    A typical usage might be ::
+
+        from deepspeed.utils.zero_to_fp32 import load_state_dict_from_zero_checkpoint
+        model = load_state_dict_from_zero_checkpoint(trainer.model, checkpoint_dir)
+        # submit to model hub or save the model to share with others
+
+    Note, that once this was run, the ``model`` will no longer be usable in the deepspeed context
+    of the same application. i.e. you will need to re-initialize the deepspeed engine, since
+    ``model.load_state_dict(state_dict)`` will remove all the deepspeed magic from it.
+
+    """
+    logger.info(f"Extracting fp32 weights")
+    state_dict = get_fp32_state_dict_from_zero_checkpoint(checkpoint_dir, tag)
+
+    logger.info(f"Overwriting model with fp32 weights")
+    model = model.cpu()
+    model.load_state_dict(state_dict, strict=False)
+
+    return model
+
+
+if __name__ == "__main__":
+    parser = argparse.ArgumentParser()
+    parser.add_argument("checkpoint_dir",
+                        type=str,
+                        help="path to the desired checkpoint folder, e.g., path/checkpoint-12")
+    parser.add_argument("output_dir",
+                        type=str,
+                        help="directory to the pytorch fp32 state_dict output files"
+                        "(e.g. path/checkpoint-12-output/)")
+    parser.add_argument(
+        "--max_shard_size",
+        type=str,
+        default="5GB",
+        help="The maximum size for a checkpoint before being sharded. Checkpoints shard will then be each of size"
+        "lower than this size. If expressed as a string, needs to be digits followed by a unit (like `5MB`"
+        "We default it to 5GB in order for models to be able to run easily on free-tier google colab instances"
+        "without CPU OOM issues.")
+    parser.add_argument(
+        "--safe_serialization",
+        default=False,
+        action='store_true',
+        help="Whether to save the model using `safetensors` or the traditional PyTorch way (that uses `pickle`).")
+    parser.add_argument("-t",
+                        "--tag",
+                        type=str,
+                        default=None,
+                        help="checkpoint tag used as a unique identifier for checkpoint. e.g., global_step1")
+    parser.add_argument("--exclude_frozen_parameters", action='store_true', help="exclude frozen parameters")
+    parser.add_argument("-d", "--debug", action='store_true', help="enable debug")
+    args = parser.parse_args()
+
+    debug = args.debug
+
+    convert_zero_checkpoint_to_fp32_state_dict(args.checkpoint_dir,
+                                               args.output_dir,
+                                               max_shard_size=args.max_shard_size,
+                                               safe_serialization=args.safe_serialization,
+                                               tag=args.tag,
+                                               exclude_frozen_parameters=args.exclude_frozen_parameters)
diff --git a/config.json b/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..eb6c88dc1a12f34ff3e2fa266cee8ea5706882f7
--- /dev/null
+++ b/config.json
@@ -0,0 +1,27 @@
+{
+  "_attn_implementation_autoset": true,
+  "architectures": [
+    "MistralForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 5120,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 1024000,
+  "model_type": "mistral",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 40,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 1000000.0,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.51.3",
+  "use_cache": false,
+  "vocab_size": 131072
+}
diff --git a/special_tokens_map.json b/special_tokens_map.json
new file mode 100644
index 0000000000000000000000000000000000000000..547986c0f0567961dd9ff48218defed8e4d5aa59
--- /dev/null
+++ b/special_tokens_map.json
@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}
diff --git a/tokenizer.json b/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..cff17babe3bd564f7a3005727b02f44432e0facf
--- /dev/null
+++ b/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee57bd3271d8c200a06df40f9d7c94f8bb8f085b5cfb2d40907a794560df2ec3
+size 17078342
diff --git a/tokenizer_config.json b/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..0f13a1776083b5998049a3aad730d95f5e74f8cd
--- /dev/null
+++ b/tokenizer_config.json
@@ -0,0 +1,8016 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "<SPECIAL_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "5": {
+      "content": "[AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "[/AVAILABLE_TOOLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "[TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "8": {
+      "content": "[/TOOL_RESULTS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "9": {
+      "content": "[TOOL_CALLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "10": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "11": {
+      "content": "[PREFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "12": {
+      "content": "[MIDDLE]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "13": {
+      "content": "[SUFFIX]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "14": {
+      "content": "<SPECIAL_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "15": {
+      "content": "<SPECIAL_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "16": {
+      "content": "<SPECIAL_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "17": {
+      "content": "<SPECIAL_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "18": {
+      "content": "<SPECIAL_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "19": {
+      "content": "<SPECIAL_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "20": {
+      "content": "<SPECIAL_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "21": {
+      "content": "<SPECIAL_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "22": {
+      "content": "<SPECIAL_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "23": {
+      "content": "<SPECIAL_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "24": {
+      "content": "<SPECIAL_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "25": {
+      "content": "<SPECIAL_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "26": {
+      "content": "<SPECIAL_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "27": {
+      "content": "<SPECIAL_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "28": {
+      "content": "<SPECIAL_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "29": {
+      "content": "<SPECIAL_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "30": {
+      "content": "<SPECIAL_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "31": {
+      "content": "<SPECIAL_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32": {
+      "content": "<SPECIAL_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "33": {
+      "content": "<SPECIAL_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "34": {
+      "content": "<SPECIAL_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "35": {
+      "content": "<SPECIAL_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "36": {
+      "content": "<SPECIAL_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "37": {
+      "content": "<SPECIAL_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "38": {
+      "content": "<SPECIAL_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "39": {
+      "content": "<SPECIAL_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "40": {
+      "content": "<SPECIAL_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "41": {
+      "content": "<SPECIAL_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "42": {
+      "content": "<SPECIAL_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "43": {
+      "content": "<SPECIAL_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "44": {
+      "content": "<SPECIAL_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "45": {
+      "content": "<SPECIAL_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "46": {
+      "content": "<SPECIAL_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "47": {
+      "content": "<SPECIAL_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "48": {
+      "content": "<SPECIAL_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49": {
+      "content": "<SPECIAL_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50": {
+      "content": "<SPECIAL_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "51": {
+      "content": "<SPECIAL_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "52": {
+      "content": "<SPECIAL_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "53": {
+      "content": "<SPECIAL_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "54": {
+      "content": "<SPECIAL_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "55": {
+      "content": "<SPECIAL_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "56": {
+      "content": "<SPECIAL_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "57": {
+      "content": "<SPECIAL_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "58": {
+      "content": "<SPECIAL_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "59": {
+      "content": "<SPECIAL_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "60": {
+      "content": "<SPECIAL_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "61": {
+      "content": "<SPECIAL_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "62": {
+      "content": "<SPECIAL_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "63": {
+      "content": "<SPECIAL_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "64": {
+      "content": "<SPECIAL_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "65": {
+      "content": "<SPECIAL_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "66": {
+      "content": "<SPECIAL_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "67": {
+      "content": "<SPECIAL_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "68": {
+      "content": "<SPECIAL_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "69": {
+      "content": "<SPECIAL_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "70": {
+      "content": "<SPECIAL_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "71": {
+      "content": "<SPECIAL_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "72": {
+      "content": "<SPECIAL_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "73": {
+      "content": "<SPECIAL_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "74": {
+      "content": "<SPECIAL_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "75": {
+      "content": "<SPECIAL_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "76": {
+      "content": "<SPECIAL_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "77": {
+      "content": "<SPECIAL_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "78": {
+      "content": "<SPECIAL_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "79": {
+      "content": "<SPECIAL_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "80": {
+      "content": "<SPECIAL_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "81": {
+      "content": "<SPECIAL_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "82": {
+      "content": "<SPECIAL_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "83": {
+      "content": "<SPECIAL_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "84": {
+      "content": "<SPECIAL_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "85": {
+      "content": "<SPECIAL_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "86": {
+      "content": "<SPECIAL_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "87": {
+      "content": "<SPECIAL_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "88": {
+      "content": "<SPECIAL_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "89": {
+      "content": "<SPECIAL_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "90": {
+      "content": "<SPECIAL_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "91": {
+      "content": "<SPECIAL_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "92": {
+      "content": "<SPECIAL_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "93": {
+      "content": "<SPECIAL_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "94": {
+      "content": "<SPECIAL_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "95": {
+      "content": "<SPECIAL_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "96": {
+      "content": "<SPECIAL_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "97": {
+      "content": "<SPECIAL_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "98": {
+      "content": "<SPECIAL_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "99": {
+      "content": "<SPECIAL_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "<SPECIAL_100>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "<SPECIAL_101>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "<SPECIAL_102>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "<SPECIAL_103>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "104": {
+      "content": "<SPECIAL_104>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "105": {
+      "content": "<SPECIAL_105>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "106": {
+      "content": "<SPECIAL_106>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "107": {
+      "content": "<SPECIAL_107>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "108": {
+      "content": "<SPECIAL_108>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "109": {
+      "content": "<SPECIAL_109>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "110": {
+      "content": "<SPECIAL_110>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "111": {
+      "content": "<SPECIAL_111>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "112": {
+      "content": "<SPECIAL_112>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "113": {
+      "content": "<SPECIAL_113>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "114": {
+      "content": "<SPECIAL_114>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "115": {
+      "content": "<SPECIAL_115>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "116": {
+      "content": "<SPECIAL_116>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "117": {
+      "content": "<SPECIAL_117>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "118": {
+      "content": "<SPECIAL_118>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "119": {
+      "content": "<SPECIAL_119>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "120": {
+      "content": "<SPECIAL_120>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "121": {
+      "content": "<SPECIAL_121>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "122": {
+      "content": "<SPECIAL_122>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "123": {
+      "content": "<SPECIAL_123>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "124": {
+      "content": "<SPECIAL_124>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "125": {
+      "content": "<SPECIAL_125>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "126": {
+      "content": "<SPECIAL_126>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "127": {
+      "content": "<SPECIAL_127>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128": {
+      "content": "<SPECIAL_128>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "129": {
+      "content": "<SPECIAL_129>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "130": {
+      "content": "<SPECIAL_130>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "131": {
+      "content": "<SPECIAL_131>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "132": {
+      "content": "<SPECIAL_132>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "133": {
+      "content": "<SPECIAL_133>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "134": {
+      "content": "<SPECIAL_134>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "135": {
+      "content": "<SPECIAL_135>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "136": {
+      "content": "<SPECIAL_136>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "137": {
+      "content": "<SPECIAL_137>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "138": {
+      "content": "<SPECIAL_138>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "139": {
+      "content": "<SPECIAL_139>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "140": {
+      "content": "<SPECIAL_140>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "141": {
+      "content": "<SPECIAL_141>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "142": {
+      "content": "<SPECIAL_142>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "143": {
+      "content": "<SPECIAL_143>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144": {
+      "content": "<SPECIAL_144>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145": {
+      "content": "<SPECIAL_145>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "146": {
+      "content": "<SPECIAL_146>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "147": {
+      "content": "<SPECIAL_147>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "148": {
+      "content": "<SPECIAL_148>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "149": {
+      "content": "<SPECIAL_149>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "150": {
+      "content": "<SPECIAL_150>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151": {
+      "content": "<SPECIAL_151>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "152": {
+      "content": "<SPECIAL_152>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "153": {
+      "content": "<SPECIAL_153>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "154": {
+      "content": "<SPECIAL_154>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "155": {
+      "content": "<SPECIAL_155>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "156": {
+      "content": "<SPECIAL_156>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "157": {
+      "content": "<SPECIAL_157>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "158": {
+      "content": "<SPECIAL_158>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "159": {
+      "content": "<SPECIAL_159>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "160": {
+      "content": "<SPECIAL_160>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "161": {
+      "content": "<SPECIAL_161>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "162": {
+      "content": "<SPECIAL_162>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "163": {
+      "content": "<SPECIAL_163>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "164": {
+      "content": "<SPECIAL_164>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "165": {
+      "content": "<SPECIAL_165>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "166": {
+      "content": "<SPECIAL_166>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "167": {
+      "content": "<SPECIAL_167>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "168": {
+      "content": "<SPECIAL_168>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "169": {
+      "content": "<SPECIAL_169>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "170": {
+      "content": "<SPECIAL_170>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "171": {
+      "content": "<SPECIAL_171>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "172": {
+      "content": "<SPECIAL_172>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "173": {
+      "content": "<SPECIAL_173>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "174": {
+      "content": "<SPECIAL_174>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "175": {
+      "content": "<SPECIAL_175>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "176": {
+      "content": "<SPECIAL_176>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "177": {
+      "content": "<SPECIAL_177>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "178": {
+      "content": "<SPECIAL_178>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "179": {
+      "content": "<SPECIAL_179>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "180": {
+      "content": "<SPECIAL_180>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "181": {
+      "content": "<SPECIAL_181>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "182": {
+      "content": "<SPECIAL_182>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "183": {
+      "content": "<SPECIAL_183>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "184": {
+      "content": "<SPECIAL_184>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "185": {
+      "content": "<SPECIAL_185>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "186": {
+      "content": "<SPECIAL_186>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "187": {
+      "content": "<SPECIAL_187>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "188": {
+      "content": "<SPECIAL_188>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "189": {
+      "content": "<SPECIAL_189>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "190": {
+      "content": "<SPECIAL_190>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "191": {
+      "content": "<SPECIAL_191>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "192": {
+      "content": "<SPECIAL_192>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "193": {
+      "content": "<SPECIAL_193>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "194": {
+      "content": "<SPECIAL_194>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "195": {
+      "content": "<SPECIAL_195>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "196": {
+      "content": "<SPECIAL_196>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "197": {
+      "content": "<SPECIAL_197>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "198": {
+      "content": "<SPECIAL_198>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "199": {
+      "content": "<SPECIAL_199>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "200": {
+      "content": "<SPECIAL_200>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "201": {
+      "content": "<SPECIAL_201>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "202": {
+      "content": "<SPECIAL_202>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "203": {
+      "content": "<SPECIAL_203>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "204": {
+      "content": "<SPECIAL_204>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "205": {
+      "content": "<SPECIAL_205>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "206": {
+      "content": "<SPECIAL_206>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "207": {
+      "content": "<SPECIAL_207>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "208": {
+      "content": "<SPECIAL_208>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "209": {
+      "content": "<SPECIAL_209>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "210": {
+      "content": "<SPECIAL_210>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "211": {
+      "content": "<SPECIAL_211>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "212": {
+      "content": "<SPECIAL_212>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "213": {
+      "content": "<SPECIAL_213>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "214": {
+      "content": "<SPECIAL_214>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "215": {
+      "content": "<SPECIAL_215>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "216": {
+      "content": "<SPECIAL_216>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "217": {
+      "content": "<SPECIAL_217>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "218": {
+      "content": "<SPECIAL_218>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "219": {
+      "content": "<SPECIAL_219>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "220": {
+      "content": "<SPECIAL_220>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "221": {
+      "content": "<SPECIAL_221>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "222": {
+      "content": "<SPECIAL_222>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "223": {
+      "content": "<SPECIAL_223>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "224": {
+      "content": "<SPECIAL_224>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "225": {
+      "content": "<SPECIAL_225>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "226": {
+      "content": "<SPECIAL_226>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "227": {
+      "content": "<SPECIAL_227>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "228": {
+      "content": "<SPECIAL_228>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "229": {
+      "content": "<SPECIAL_229>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "230": {
+      "content": "<SPECIAL_230>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "231": {
+      "content": "<SPECIAL_231>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "232": {
+      "content": "<SPECIAL_232>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "233": {
+      "content": "<SPECIAL_233>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "234": {
+      "content": "<SPECIAL_234>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "235": {
+      "content": "<SPECIAL_235>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "236": {
+      "content": "<SPECIAL_236>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "237": {
+      "content": "<SPECIAL_237>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "238": {
+      "content": "<SPECIAL_238>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "239": {
+      "content": "<SPECIAL_239>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "240": {
+      "content": "<SPECIAL_240>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "241": {
+      "content": "<SPECIAL_241>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "242": {
+      "content": "<SPECIAL_242>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "243": {
+      "content": "<SPECIAL_243>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "244": {
+      "content": "<SPECIAL_244>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "245": {
+      "content": "<SPECIAL_245>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "246": {
+      "content": "<SPECIAL_246>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "247": {
+      "content": "<SPECIAL_247>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248": {
+      "content": "<SPECIAL_248>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "249": {
+      "content": "<SPECIAL_249>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "250": {
+      "content": "<SPECIAL_250>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "251": {
+      "content": "<SPECIAL_251>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "252": {
+      "content": "<SPECIAL_252>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "253": {
+      "content": "<SPECIAL_253>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "254": {
+      "content": "<SPECIAL_254>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255": {
+      "content": "<SPECIAL_255>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256": {
+      "content": "<SPECIAL_256>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "257": {
+      "content": "<SPECIAL_257>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "258": {
+      "content": "<SPECIAL_258>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "259": {
+      "content": "<SPECIAL_259>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "260": {
+      "content": "<SPECIAL_260>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "261": {
+      "content": "<SPECIAL_261>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "262": {
+      "content": "<SPECIAL_262>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "263": {
+      "content": "<SPECIAL_263>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "264": {
+      "content": "<SPECIAL_264>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "265": {
+      "content": "<SPECIAL_265>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "266": {
+      "content": "<SPECIAL_266>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "267": {
+      "content": "<SPECIAL_267>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "268": {
+      "content": "<SPECIAL_268>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "269": {
+      "content": "<SPECIAL_269>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "270": {
+      "content": "<SPECIAL_270>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "271": {
+      "content": "<SPECIAL_271>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "272": {
+      "content": "<SPECIAL_272>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "273": {
+      "content": "<SPECIAL_273>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "274": {
+      "content": "<SPECIAL_274>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "275": {
+      "content": "<SPECIAL_275>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "276": {
+      "content": "<SPECIAL_276>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "277": {
+      "content": "<SPECIAL_277>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "278": {
+      "content": "<SPECIAL_278>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "279": {
+      "content": "<SPECIAL_279>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "280": {
+      "content": "<SPECIAL_280>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "281": {
+      "content": "<SPECIAL_281>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "282": {
+      "content": "<SPECIAL_282>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "283": {
+      "content": "<SPECIAL_283>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "284": {
+      "content": "<SPECIAL_284>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "285": {
+      "content": "<SPECIAL_285>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "286": {
+      "content": "<SPECIAL_286>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "287": {
+      "content": "<SPECIAL_287>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "288": {
+      "content": "<SPECIAL_288>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "289": {
+      "content": "<SPECIAL_289>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "290": {
+      "content": "<SPECIAL_290>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "291": {
+      "content": "<SPECIAL_291>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "292": {
+      "content": "<SPECIAL_292>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "293": {
+      "content": "<SPECIAL_293>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "294": {
+      "content": "<SPECIAL_294>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "295": {
+      "content": "<SPECIAL_295>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "296": {
+      "content": "<SPECIAL_296>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "297": {
+      "content": "<SPECIAL_297>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "298": {
+      "content": "<SPECIAL_298>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "299": {
+      "content": "<SPECIAL_299>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "300": {
+      "content": "<SPECIAL_300>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "301": {
+      "content": "<SPECIAL_301>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "302": {
+      "content": "<SPECIAL_302>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "303": {
+      "content": "<SPECIAL_303>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "304": {
+      "content": "<SPECIAL_304>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "305": {
+      "content": "<SPECIAL_305>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "306": {
+      "content": "<SPECIAL_306>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "307": {
+      "content": "<SPECIAL_307>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "308": {
+      "content": "<SPECIAL_308>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "309": {
+      "content": "<SPECIAL_309>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "310": {
+      "content": "<SPECIAL_310>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "311": {
+      "content": "<SPECIAL_311>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "312": {
+      "content": "<SPECIAL_312>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "313": {
+      "content": "<SPECIAL_313>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "314": {
+      "content": "<SPECIAL_314>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "315": {
+      "content": "<SPECIAL_315>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "316": {
+      "content": "<SPECIAL_316>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "317": {
+      "content": "<SPECIAL_317>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "318": {
+      "content": "<SPECIAL_318>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "319": {
+      "content": "<SPECIAL_319>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "320": {
+      "content": "<SPECIAL_320>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "321": {
+      "content": "<SPECIAL_321>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "322": {
+      "content": "<SPECIAL_322>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "323": {
+      "content": "<SPECIAL_323>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "324": {
+      "content": "<SPECIAL_324>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "325": {
+      "content": "<SPECIAL_325>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "326": {
+      "content": "<SPECIAL_326>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "327": {
+      "content": "<SPECIAL_327>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "328": {
+      "content": "<SPECIAL_328>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "329": {
+      "content": "<SPECIAL_329>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "330": {
+      "content": "<SPECIAL_330>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "331": {
+      "content": "<SPECIAL_331>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "332": {
+      "content": "<SPECIAL_332>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "333": {
+      "content": "<SPECIAL_333>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "334": {
+      "content": "<SPECIAL_334>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "335": {
+      "content": "<SPECIAL_335>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "336": {
+      "content": "<SPECIAL_336>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "337": {
+      "content": "<SPECIAL_337>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "338": {
+      "content": "<SPECIAL_338>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "339": {
+      "content": "<SPECIAL_339>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "340": {
+      "content": "<SPECIAL_340>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "341": {
+      "content": "<SPECIAL_341>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "342": {
+      "content": "<SPECIAL_342>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "343": {
+      "content": "<SPECIAL_343>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "344": {
+      "content": "<SPECIAL_344>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "345": {
+      "content": "<SPECIAL_345>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "346": {
+      "content": "<SPECIAL_346>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "347": {
+      "content": "<SPECIAL_347>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "348": {
+      "content": "<SPECIAL_348>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "349": {
+      "content": "<SPECIAL_349>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "350": {
+      "content": "<SPECIAL_350>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "351": {
+      "content": "<SPECIAL_351>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "352": {
+      "content": "<SPECIAL_352>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "353": {
+      "content": "<SPECIAL_353>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "354": {
+      "content": "<SPECIAL_354>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "355": {
+      "content": "<SPECIAL_355>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "356": {
+      "content": "<SPECIAL_356>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "357": {
+      "content": "<SPECIAL_357>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "358": {
+      "content": "<SPECIAL_358>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "359": {
+      "content": "<SPECIAL_359>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "360": {
+      "content": "<SPECIAL_360>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "361": {
+      "content": "<SPECIAL_361>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "362": {
+      "content": "<SPECIAL_362>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "363": {
+      "content": "<SPECIAL_363>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "364": {
+      "content": "<SPECIAL_364>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "365": {
+      "content": "<SPECIAL_365>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "366": {
+      "content": "<SPECIAL_366>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "367": {
+      "content": "<SPECIAL_367>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "368": {
+      "content": "<SPECIAL_368>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "369": {
+      "content": "<SPECIAL_369>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "370": {
+      "content": "<SPECIAL_370>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "371": {
+      "content": "<SPECIAL_371>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "372": {
+      "content": "<SPECIAL_372>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "373": {
+      "content": "<SPECIAL_373>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "374": {
+      "content": "<SPECIAL_374>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "375": {
+      "content": "<SPECIAL_375>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "376": {
+      "content": "<SPECIAL_376>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "377": {
+      "content": "<SPECIAL_377>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "378": {
+      "content": "<SPECIAL_378>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "379": {
+      "content": "<SPECIAL_379>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "380": {
+      "content": "<SPECIAL_380>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "381": {
+      "content": "<SPECIAL_381>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "382": {
+      "content": "<SPECIAL_382>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "383": {
+      "content": "<SPECIAL_383>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "384": {
+      "content": "<SPECIAL_384>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "385": {
+      "content": "<SPECIAL_385>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "386": {
+      "content": "<SPECIAL_386>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "387": {
+      "content": "<SPECIAL_387>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "388": {
+      "content": "<SPECIAL_388>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "389": {
+      "content": "<SPECIAL_389>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "390": {
+      "content": "<SPECIAL_390>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "391": {
+      "content": "<SPECIAL_391>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "392": {
+      "content": "<SPECIAL_392>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "393": {
+      "content": "<SPECIAL_393>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "394": {
+      "content": "<SPECIAL_394>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "395": {
+      "content": "<SPECIAL_395>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "396": {
+      "content": "<SPECIAL_396>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "397": {
+      "content": "<SPECIAL_397>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "398": {
+      "content": "<SPECIAL_398>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "399": {
+      "content": "<SPECIAL_399>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "400": {
+      "content": "<SPECIAL_400>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "401": {
+      "content": "<SPECIAL_401>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "402": {
+      "content": "<SPECIAL_402>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "403": {
+      "content": "<SPECIAL_403>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "404": {
+      "content": "<SPECIAL_404>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "405": {
+      "content": "<SPECIAL_405>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "406": {
+      "content": "<SPECIAL_406>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "407": {
+      "content": "<SPECIAL_407>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "408": {
+      "content": "<SPECIAL_408>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "409": {
+      "content": "<SPECIAL_409>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "410": {
+      "content": "<SPECIAL_410>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "411": {
+      "content": "<SPECIAL_411>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "412": {
+      "content": "<SPECIAL_412>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "413": {
+      "content": "<SPECIAL_413>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "414": {
+      "content": "<SPECIAL_414>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "415": {
+      "content": "<SPECIAL_415>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "416": {
+      "content": "<SPECIAL_416>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "417": {
+      "content": "<SPECIAL_417>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "418": {
+      "content": "<SPECIAL_418>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "419": {
+      "content": "<SPECIAL_419>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "420": {
+      "content": "<SPECIAL_420>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "421": {
+      "content": "<SPECIAL_421>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "422": {
+      "content": "<SPECIAL_422>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "423": {
+      "content": "<SPECIAL_423>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "424": {
+      "content": "<SPECIAL_424>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "425": {
+      "content": "<SPECIAL_425>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "426": {
+      "content": "<SPECIAL_426>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "427": {
+      "content": "<SPECIAL_427>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "428": {
+      "content": "<SPECIAL_428>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "429": {
+      "content": "<SPECIAL_429>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "430": {
+      "content": "<SPECIAL_430>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "431": {
+      "content": "<SPECIAL_431>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "432": {
+      "content": "<SPECIAL_432>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "433": {
+      "content": "<SPECIAL_433>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "434": {
+      "content": "<SPECIAL_434>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "435": {
+      "content": "<SPECIAL_435>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "436": {
+      "content": "<SPECIAL_436>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "437": {
+      "content": "<SPECIAL_437>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "438": {
+      "content": "<SPECIAL_438>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "439": {
+      "content": "<SPECIAL_439>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "440": {
+      "content": "<SPECIAL_440>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "441": {
+      "content": "<SPECIAL_441>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "442": {
+      "content": "<SPECIAL_442>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "443": {
+      "content": "<SPECIAL_443>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "444": {
+      "content": "<SPECIAL_444>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "445": {
+      "content": "<SPECIAL_445>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "446": {
+      "content": "<SPECIAL_446>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "447": {
+      "content": "<SPECIAL_447>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "448": {
+      "content": "<SPECIAL_448>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "449": {
+      "content": "<SPECIAL_449>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "450": {
+      "content": "<SPECIAL_450>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "451": {
+      "content": "<SPECIAL_451>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "452": {
+      "content": "<SPECIAL_452>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "453": {
+      "content": "<SPECIAL_453>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "454": {
+      "content": "<SPECIAL_454>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "455": {
+      "content": "<SPECIAL_455>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "456": {
+      "content": "<SPECIAL_456>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "457": {
+      "content": "<SPECIAL_457>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "458": {
+      "content": "<SPECIAL_458>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "459": {
+      "content": "<SPECIAL_459>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "460": {
+      "content": "<SPECIAL_460>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "461": {
+      "content": "<SPECIAL_461>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "462": {
+      "content": "<SPECIAL_462>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "463": {
+      "content": "<SPECIAL_463>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "464": {
+      "content": "<SPECIAL_464>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "465": {
+      "content": "<SPECIAL_465>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "466": {
+      "content": "<SPECIAL_466>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "467": {
+      "content": "<SPECIAL_467>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "468": {
+      "content": "<SPECIAL_468>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "469": {
+      "content": "<SPECIAL_469>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "470": {
+      "content": "<SPECIAL_470>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "471": {
+      "content": "<SPECIAL_471>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "472": {
+      "content": "<SPECIAL_472>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "473": {
+      "content": "<SPECIAL_473>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "474": {
+      "content": "<SPECIAL_474>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "475": {
+      "content": "<SPECIAL_475>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "476": {
+      "content": "<SPECIAL_476>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "477": {
+      "content": "<SPECIAL_477>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "478": {
+      "content": "<SPECIAL_478>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "479": {
+      "content": "<SPECIAL_479>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "480": {
+      "content": "<SPECIAL_480>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "481": {
+      "content": "<SPECIAL_481>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "482": {
+      "content": "<SPECIAL_482>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "483": {
+      "content": "<SPECIAL_483>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "484": {
+      "content": "<SPECIAL_484>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "485": {
+      "content": "<SPECIAL_485>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "486": {
+      "content": "<SPECIAL_486>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "487": {
+      "content": "<SPECIAL_487>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "488": {
+      "content": "<SPECIAL_488>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "489": {
+      "content": "<SPECIAL_489>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "490": {
+      "content": "<SPECIAL_490>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "491": {
+      "content": "<SPECIAL_491>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "492": {
+      "content": "<SPECIAL_492>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "493": {
+      "content": "<SPECIAL_493>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "494": {
+      "content": "<SPECIAL_494>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "495": {
+      "content": "<SPECIAL_495>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "496": {
+      "content": "<SPECIAL_496>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "497": {
+      "content": "<SPECIAL_497>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "498": {
+      "content": "<SPECIAL_498>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "499": {
+      "content": "<SPECIAL_499>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "500": {
+      "content": "<SPECIAL_500>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "501": {
+      "content": "<SPECIAL_501>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "502": {
+      "content": "<SPECIAL_502>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "503": {
+      "content": "<SPECIAL_503>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "504": {
+      "content": "<SPECIAL_504>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "505": {
+      "content": "<SPECIAL_505>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "506": {
+      "content": "<SPECIAL_506>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "507": {
+      "content": "<SPECIAL_507>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "508": {
+      "content": "<SPECIAL_508>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "509": {
+      "content": "<SPECIAL_509>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "510": {
+      "content": "<SPECIAL_510>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "511": {
+      "content": "<SPECIAL_511>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "512": {
+      "content": "<SPECIAL_512>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "513": {
+      "content": "<SPECIAL_513>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "514": {
+      "content": "<SPECIAL_514>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "515": {
+      "content": "<SPECIAL_515>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "516": {
+      "content": "<SPECIAL_516>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "517": {
+      "content": "<SPECIAL_517>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "518": {
+      "content": "<SPECIAL_518>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "519": {
+      "content": "<SPECIAL_519>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "520": {
+      "content": "<SPECIAL_520>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "521": {
+      "content": "<SPECIAL_521>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "522": {
+      "content": "<SPECIAL_522>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "523": {
+      "content": "<SPECIAL_523>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "524": {
+      "content": "<SPECIAL_524>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "525": {
+      "content": "<SPECIAL_525>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "526": {
+      "content": "<SPECIAL_526>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "527": {
+      "content": "<SPECIAL_527>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "528": {
+      "content": "<SPECIAL_528>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "529": {
+      "content": "<SPECIAL_529>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "530": {
+      "content": "<SPECIAL_530>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "531": {
+      "content": "<SPECIAL_531>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "532": {
+      "content": "<SPECIAL_532>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "533": {
+      "content": "<SPECIAL_533>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "534": {
+      "content": "<SPECIAL_534>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "535": {
+      "content": "<SPECIAL_535>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "536": {
+      "content": "<SPECIAL_536>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "537": {
+      "content": "<SPECIAL_537>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "538": {
+      "content": "<SPECIAL_538>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "539": {
+      "content": "<SPECIAL_539>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "540": {
+      "content": "<SPECIAL_540>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "541": {
+      "content": "<SPECIAL_541>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "542": {
+      "content": "<SPECIAL_542>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "543": {
+      "content": "<SPECIAL_543>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "544": {
+      "content": "<SPECIAL_544>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "545": {
+      "content": "<SPECIAL_545>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "546": {
+      "content": "<SPECIAL_546>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "547": {
+      "content": "<SPECIAL_547>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "548": {
+      "content": "<SPECIAL_548>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "549": {
+      "content": "<SPECIAL_549>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "550": {
+      "content": "<SPECIAL_550>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "551": {
+      "content": "<SPECIAL_551>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "552": {
+      "content": "<SPECIAL_552>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "553": {
+      "content": "<SPECIAL_553>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "554": {
+      "content": "<SPECIAL_554>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "555": {
+      "content": "<SPECIAL_555>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "556": {
+      "content": "<SPECIAL_556>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "557": {
+      "content": "<SPECIAL_557>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "558": {
+      "content": "<SPECIAL_558>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "559": {
+      "content": "<SPECIAL_559>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "560": {
+      "content": "<SPECIAL_560>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "561": {
+      "content": "<SPECIAL_561>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "562": {
+      "content": "<SPECIAL_562>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "563": {
+      "content": "<SPECIAL_563>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "564": {
+      "content": "<SPECIAL_564>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "565": {
+      "content": "<SPECIAL_565>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "566": {
+      "content": "<SPECIAL_566>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "567": {
+      "content": "<SPECIAL_567>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "568": {
+      "content": "<SPECIAL_568>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "569": {
+      "content": "<SPECIAL_569>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "570": {
+      "content": "<SPECIAL_570>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "571": {
+      "content": "<SPECIAL_571>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "572": {
+      "content": "<SPECIAL_572>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "573": {
+      "content": "<SPECIAL_573>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "574": {
+      "content": "<SPECIAL_574>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "575": {
+      "content": "<SPECIAL_575>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "576": {
+      "content": "<SPECIAL_576>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "577": {
+      "content": "<SPECIAL_577>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "578": {
+      "content": "<SPECIAL_578>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "579": {
+      "content": "<SPECIAL_579>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "580": {
+      "content": "<SPECIAL_580>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "581": {
+      "content": "<SPECIAL_581>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "582": {
+      "content": "<SPECIAL_582>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "583": {
+      "content": "<SPECIAL_583>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "584": {
+      "content": "<SPECIAL_584>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "585": {
+      "content": "<SPECIAL_585>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "586": {
+      "content": "<SPECIAL_586>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "587": {
+      "content": "<SPECIAL_587>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "588": {
+      "content": "<SPECIAL_588>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "589": {
+      "content": "<SPECIAL_589>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "590": {
+      "content": "<SPECIAL_590>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "591": {
+      "content": "<SPECIAL_591>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "592": {
+      "content": "<SPECIAL_592>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "593": {
+      "content": "<SPECIAL_593>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "594": {
+      "content": "<SPECIAL_594>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "595": {
+      "content": "<SPECIAL_595>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "596": {
+      "content": "<SPECIAL_596>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "597": {
+      "content": "<SPECIAL_597>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "598": {
+      "content": "<SPECIAL_598>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "599": {
+      "content": "<SPECIAL_599>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "600": {
+      "content": "<SPECIAL_600>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "601": {
+      "content": "<SPECIAL_601>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "602": {
+      "content": "<SPECIAL_602>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "603": {
+      "content": "<SPECIAL_603>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "604": {
+      "content": "<SPECIAL_604>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "605": {
+      "content": "<SPECIAL_605>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "606": {
+      "content": "<SPECIAL_606>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "607": {
+      "content": "<SPECIAL_607>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "608": {
+      "content": "<SPECIAL_608>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "609": {
+      "content": "<SPECIAL_609>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "610": {
+      "content": "<SPECIAL_610>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "611": {
+      "content": "<SPECIAL_611>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "612": {
+      "content": "<SPECIAL_612>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "613": {
+      "content": "<SPECIAL_613>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "614": {
+      "content": "<SPECIAL_614>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "615": {
+      "content": "<SPECIAL_615>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "616": {
+      "content": "<SPECIAL_616>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "617": {
+      "content": "<SPECIAL_617>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "618": {
+      "content": "<SPECIAL_618>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "619": {
+      "content": "<SPECIAL_619>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "620": {
+      "content": "<SPECIAL_620>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "621": {
+      "content": "<SPECIAL_621>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "622": {
+      "content": "<SPECIAL_622>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "623": {
+      "content": "<SPECIAL_623>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "624": {
+      "content": "<SPECIAL_624>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "625": {
+      "content": "<SPECIAL_625>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "626": {
+      "content": "<SPECIAL_626>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "627": {
+      "content": "<SPECIAL_627>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "628": {
+      "content": "<SPECIAL_628>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "629": {
+      "content": "<SPECIAL_629>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "630": {
+      "content": "<SPECIAL_630>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "631": {
+      "content": "<SPECIAL_631>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "632": {
+      "content": "<SPECIAL_632>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "633": {
+      "content": "<SPECIAL_633>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "634": {
+      "content": "<SPECIAL_634>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "635": {
+      "content": "<SPECIAL_635>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "636": {
+      "content": "<SPECIAL_636>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "637": {
+      "content": "<SPECIAL_637>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "638": {
+      "content": "<SPECIAL_638>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "639": {
+      "content": "<SPECIAL_639>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "640": {
+      "content": "<SPECIAL_640>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "641": {
+      "content": "<SPECIAL_641>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "642": {
+      "content": "<SPECIAL_642>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "643": {
+      "content": "<SPECIAL_643>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "644": {
+      "content": "<SPECIAL_644>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "645": {
+      "content": "<SPECIAL_645>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "646": {
+      "content": "<SPECIAL_646>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "647": {
+      "content": "<SPECIAL_647>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "648": {
+      "content": "<SPECIAL_648>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "649": {
+      "content": "<SPECIAL_649>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "650": {
+      "content": "<SPECIAL_650>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "651": {
+      "content": "<SPECIAL_651>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "652": {
+      "content": "<SPECIAL_652>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "653": {
+      "content": "<SPECIAL_653>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "654": {
+      "content": "<SPECIAL_654>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "655": {
+      "content": "<SPECIAL_655>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "656": {
+      "content": "<SPECIAL_656>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "657": {
+      "content": "<SPECIAL_657>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "658": {
+      "content": "<SPECIAL_658>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "659": {
+      "content": "<SPECIAL_659>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "660": {
+      "content": "<SPECIAL_660>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "661": {
+      "content": "<SPECIAL_661>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "662": {
+      "content": "<SPECIAL_662>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "663": {
+      "content": "<SPECIAL_663>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "664": {
+      "content": "<SPECIAL_664>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "665": {
+      "content": "<SPECIAL_665>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "666": {
+      "content": "<SPECIAL_666>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "667": {
+      "content": "<SPECIAL_667>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "668": {
+      "content": "<SPECIAL_668>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "669": {
+      "content": "<SPECIAL_669>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "670": {
+      "content": "<SPECIAL_670>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "671": {
+      "content": "<SPECIAL_671>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "672": {
+      "content": "<SPECIAL_672>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "673": {
+      "content": "<SPECIAL_673>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "674": {
+      "content": "<SPECIAL_674>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "675": {
+      "content": "<SPECIAL_675>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "676": {
+      "content": "<SPECIAL_676>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "677": {
+      "content": "<SPECIAL_677>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "678": {
+      "content": "<SPECIAL_678>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "679": {
+      "content": "<SPECIAL_679>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "680": {
+      "content": "<SPECIAL_680>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "681": {
+      "content": "<SPECIAL_681>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "682": {
+      "content": "<SPECIAL_682>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "683": {
+      "content": "<SPECIAL_683>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "684": {
+      "content": "<SPECIAL_684>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "685": {
+      "content": "<SPECIAL_685>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "686": {
+      "content": "<SPECIAL_686>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "687": {
+      "content": "<SPECIAL_687>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "688": {
+      "content": "<SPECIAL_688>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "689": {
+      "content": "<SPECIAL_689>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "690": {
+      "content": "<SPECIAL_690>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "691": {
+      "content": "<SPECIAL_691>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "692": {
+      "content": "<SPECIAL_692>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "693": {
+      "content": "<SPECIAL_693>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "694": {
+      "content": "<SPECIAL_694>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "695": {
+      "content": "<SPECIAL_695>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "696": {
+      "content": "<SPECIAL_696>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "697": {
+      "content": "<SPECIAL_697>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "698": {
+      "content": "<SPECIAL_698>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "699": {
+      "content": "<SPECIAL_699>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "700": {
+      "content": "<SPECIAL_700>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "701": {
+      "content": "<SPECIAL_701>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "702": {
+      "content": "<SPECIAL_702>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "703": {
+      "content": "<SPECIAL_703>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "704": {
+      "content": "<SPECIAL_704>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "705": {
+      "content": "<SPECIAL_705>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "706": {
+      "content": "<SPECIAL_706>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "707": {
+      "content": "<SPECIAL_707>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "708": {
+      "content": "<SPECIAL_708>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "709": {
+      "content": "<SPECIAL_709>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "710": {
+      "content": "<SPECIAL_710>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "711": {
+      "content": "<SPECIAL_711>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "712": {
+      "content": "<SPECIAL_712>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "713": {
+      "content": "<SPECIAL_713>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "714": {
+      "content": "<SPECIAL_714>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "715": {
+      "content": "<SPECIAL_715>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "716": {
+      "content": "<SPECIAL_716>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "717": {
+      "content": "<SPECIAL_717>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "718": {
+      "content": "<SPECIAL_718>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "719": {
+      "content": "<SPECIAL_719>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "720": {
+      "content": "<SPECIAL_720>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "721": {
+      "content": "<SPECIAL_721>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "722": {
+      "content": "<SPECIAL_722>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "723": {
+      "content": "<SPECIAL_723>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "724": {
+      "content": "<SPECIAL_724>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "725": {
+      "content": "<SPECIAL_725>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "726": {
+      "content": "<SPECIAL_726>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "727": {
+      "content": "<SPECIAL_727>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "728": {
+      "content": "<SPECIAL_728>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "729": {
+      "content": "<SPECIAL_729>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "730": {
+      "content": "<SPECIAL_730>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "731": {
+      "content": "<SPECIAL_731>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "732": {
+      "content": "<SPECIAL_732>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "733": {
+      "content": "<SPECIAL_733>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "734": {
+      "content": "<SPECIAL_734>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "735": {
+      "content": "<SPECIAL_735>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "736": {
+      "content": "<SPECIAL_736>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "737": {
+      "content": "<SPECIAL_737>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "738": {
+      "content": "<SPECIAL_738>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "739": {
+      "content": "<SPECIAL_739>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "740": {
+      "content": "<SPECIAL_740>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "741": {
+      "content": "<SPECIAL_741>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "742": {
+      "content": "<SPECIAL_742>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "743": {
+      "content": "<SPECIAL_743>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "744": {
+      "content": "<SPECIAL_744>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "745": {
+      "content": "<SPECIAL_745>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "746": {
+      "content": "<SPECIAL_746>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "747": {
+      "content": "<SPECIAL_747>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "748": {
+      "content": "<SPECIAL_748>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "749": {
+      "content": "<SPECIAL_749>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "750": {
+      "content": "<SPECIAL_750>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "751": {
+      "content": "<SPECIAL_751>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "752": {
+      "content": "<SPECIAL_752>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "753": {
+      "content": "<SPECIAL_753>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "754": {
+      "content": "<SPECIAL_754>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "755": {
+      "content": "<SPECIAL_755>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "756": {
+      "content": "<SPECIAL_756>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "757": {
+      "content": "<SPECIAL_757>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "758": {
+      "content": "<SPECIAL_758>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "759": {
+      "content": "<SPECIAL_759>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "760": {
+      "content": "<SPECIAL_760>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "761": {
+      "content": "<SPECIAL_761>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "762": {
+      "content": "<SPECIAL_762>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "763": {
+      "content": "<SPECIAL_763>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "764": {
+      "content": "<SPECIAL_764>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "765": {
+      "content": "<SPECIAL_765>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "766": {
+      "content": "<SPECIAL_766>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "767": {
+      "content": "<SPECIAL_767>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "768": {
+      "content": "<SPECIAL_768>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "769": {
+      "content": "<SPECIAL_769>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "770": {
+      "content": "<SPECIAL_770>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "771": {
+      "content": "<SPECIAL_771>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "772": {
+      "content": "<SPECIAL_772>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "773": {
+      "content": "<SPECIAL_773>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "774": {
+      "content": "<SPECIAL_774>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "775": {
+      "content": "<SPECIAL_775>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "776": {
+      "content": "<SPECIAL_776>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "777": {
+      "content": "<SPECIAL_777>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "778": {
+      "content": "<SPECIAL_778>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "779": {
+      "content": "<SPECIAL_779>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "780": {
+      "content": "<SPECIAL_780>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "781": {
+      "content": "<SPECIAL_781>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "782": {
+      "content": "<SPECIAL_782>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "783": {
+      "content": "<SPECIAL_783>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "784": {
+      "content": "<SPECIAL_784>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "785": {
+      "content": "<SPECIAL_785>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "786": {
+      "content": "<SPECIAL_786>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "787": {
+      "content": "<SPECIAL_787>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "788": {
+      "content": "<SPECIAL_788>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "789": {
+      "content": "<SPECIAL_789>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "790": {
+      "content": "<SPECIAL_790>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "791": {
+      "content": "<SPECIAL_791>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "792": {
+      "content": "<SPECIAL_792>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "793": {
+      "content": "<SPECIAL_793>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "794": {
+      "content": "<SPECIAL_794>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "795": {
+      "content": "<SPECIAL_795>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "796": {
+      "content": "<SPECIAL_796>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "797": {
+      "content": "<SPECIAL_797>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "798": {
+      "content": "<SPECIAL_798>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "799": {
+      "content": "<SPECIAL_799>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "800": {
+      "content": "<SPECIAL_800>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "801": {
+      "content": "<SPECIAL_801>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "802": {
+      "content": "<SPECIAL_802>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "803": {
+      "content": "<SPECIAL_803>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "804": {
+      "content": "<SPECIAL_804>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "805": {
+      "content": "<SPECIAL_805>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "806": {
+      "content": "<SPECIAL_806>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "807": {
+      "content": "<SPECIAL_807>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "808": {
+      "content": "<SPECIAL_808>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "809": {
+      "content": "<SPECIAL_809>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "810": {
+      "content": "<SPECIAL_810>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "811": {
+      "content": "<SPECIAL_811>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "812": {
+      "content": "<SPECIAL_812>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "813": {
+      "content": "<SPECIAL_813>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "814": {
+      "content": "<SPECIAL_814>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "815": {
+      "content": "<SPECIAL_815>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "816": {
+      "content": "<SPECIAL_816>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "817": {
+      "content": "<SPECIAL_817>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "818": {
+      "content": "<SPECIAL_818>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "819": {
+      "content": "<SPECIAL_819>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "820": {
+      "content": "<SPECIAL_820>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "821": {
+      "content": "<SPECIAL_821>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "822": {
+      "content": "<SPECIAL_822>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "823": {
+      "content": "<SPECIAL_823>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "824": {
+      "content": "<SPECIAL_824>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "825": {
+      "content": "<SPECIAL_825>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "826": {
+      "content": "<SPECIAL_826>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "827": {
+      "content": "<SPECIAL_827>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "828": {
+      "content": "<SPECIAL_828>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "829": {
+      "content": "<SPECIAL_829>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "830": {
+      "content": "<SPECIAL_830>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "831": {
+      "content": "<SPECIAL_831>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "832": {
+      "content": "<SPECIAL_832>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "833": {
+      "content": "<SPECIAL_833>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "834": {
+      "content": "<SPECIAL_834>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "835": {
+      "content": "<SPECIAL_835>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "836": {
+      "content": "<SPECIAL_836>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "837": {
+      "content": "<SPECIAL_837>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "838": {
+      "content": "<SPECIAL_838>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "839": {
+      "content": "<SPECIAL_839>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "840": {
+      "content": "<SPECIAL_840>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "841": {
+      "content": "<SPECIAL_841>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "842": {
+      "content": "<SPECIAL_842>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "843": {
+      "content": "<SPECIAL_843>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "844": {
+      "content": "<SPECIAL_844>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "845": {
+      "content": "<SPECIAL_845>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "846": {
+      "content": "<SPECIAL_846>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "847": {
+      "content": "<SPECIAL_847>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "848": {
+      "content": "<SPECIAL_848>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "849": {
+      "content": "<SPECIAL_849>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "850": {
+      "content": "<SPECIAL_850>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "851": {
+      "content": "<SPECIAL_851>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "852": {
+      "content": "<SPECIAL_852>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "853": {
+      "content": "<SPECIAL_853>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "854": {
+      "content": "<SPECIAL_854>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "855": {
+      "content": "<SPECIAL_855>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "856": {
+      "content": "<SPECIAL_856>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "857": {
+      "content": "<SPECIAL_857>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "858": {
+      "content": "<SPECIAL_858>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "859": {
+      "content": "<SPECIAL_859>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "860": {
+      "content": "<SPECIAL_860>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "861": {
+      "content": "<SPECIAL_861>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "862": {
+      "content": "<SPECIAL_862>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "863": {
+      "content": "<SPECIAL_863>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "864": {
+      "content": "<SPECIAL_864>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "865": {
+      "content": "<SPECIAL_865>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "866": {
+      "content": "<SPECIAL_866>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "867": {
+      "content": "<SPECIAL_867>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "868": {
+      "content": "<SPECIAL_868>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "869": {
+      "content": "<SPECIAL_869>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "870": {
+      "content": "<SPECIAL_870>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "871": {
+      "content": "<SPECIAL_871>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "872": {
+      "content": "<SPECIAL_872>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "873": {
+      "content": "<SPECIAL_873>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "874": {
+      "content": "<SPECIAL_874>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "875": {
+      "content": "<SPECIAL_875>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "876": {
+      "content": "<SPECIAL_876>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "877": {
+      "content": "<SPECIAL_877>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "878": {
+      "content": "<SPECIAL_878>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "879": {
+      "content": "<SPECIAL_879>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "880": {
+      "content": "<SPECIAL_880>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "881": {
+      "content": "<SPECIAL_881>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "882": {
+      "content": "<SPECIAL_882>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "883": {
+      "content": "<SPECIAL_883>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "884": {
+      "content": "<SPECIAL_884>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "885": {
+      "content": "<SPECIAL_885>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "886": {
+      "content": "<SPECIAL_886>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "887": {
+      "content": "<SPECIAL_887>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "888": {
+      "content": "<SPECIAL_888>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "889": {
+      "content": "<SPECIAL_889>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "890": {
+      "content": "<SPECIAL_890>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "891": {
+      "content": "<SPECIAL_891>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "892": {
+      "content": "<SPECIAL_892>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "893": {
+      "content": "<SPECIAL_893>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "894": {
+      "content": "<SPECIAL_894>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "895": {
+      "content": "<SPECIAL_895>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "896": {
+      "content": "<SPECIAL_896>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "897": {
+      "content": "<SPECIAL_897>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "898": {
+      "content": "<SPECIAL_898>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "899": {
+      "content": "<SPECIAL_899>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "900": {
+      "content": "<SPECIAL_900>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "901": {
+      "content": "<SPECIAL_901>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "902": {
+      "content": "<SPECIAL_902>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "903": {
+      "content": "<SPECIAL_903>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "904": {
+      "content": "<SPECIAL_904>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "905": {
+      "content": "<SPECIAL_905>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "906": {
+      "content": "<SPECIAL_906>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "907": {
+      "content": "<SPECIAL_907>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "908": {
+      "content": "<SPECIAL_908>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "909": {
+      "content": "<SPECIAL_909>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "910": {
+      "content": "<SPECIAL_910>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "911": {
+      "content": "<SPECIAL_911>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "912": {
+      "content": "<SPECIAL_912>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "913": {
+      "content": "<SPECIAL_913>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "914": {
+      "content": "<SPECIAL_914>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "915": {
+      "content": "<SPECIAL_915>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "916": {
+      "content": "<SPECIAL_916>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "917": {
+      "content": "<SPECIAL_917>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "918": {
+      "content": "<SPECIAL_918>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "919": {
+      "content": "<SPECIAL_919>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "920": {
+      "content": "<SPECIAL_920>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "921": {
+      "content": "<SPECIAL_921>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "922": {
+      "content": "<SPECIAL_922>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "923": {
+      "content": "<SPECIAL_923>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "924": {
+      "content": "<SPECIAL_924>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "925": {
+      "content": "<SPECIAL_925>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "926": {
+      "content": "<SPECIAL_926>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "927": {
+      "content": "<SPECIAL_927>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "928": {
+      "content": "<SPECIAL_928>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "929": {
+      "content": "<SPECIAL_929>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "930": {
+      "content": "<SPECIAL_930>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "931": {
+      "content": "<SPECIAL_931>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "932": {
+      "content": "<SPECIAL_932>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "933": {
+      "content": "<SPECIAL_933>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "934": {
+      "content": "<SPECIAL_934>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "935": {
+      "content": "<SPECIAL_935>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "936": {
+      "content": "<SPECIAL_936>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "937": {
+      "content": "<SPECIAL_937>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "938": {
+      "content": "<SPECIAL_938>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "939": {
+      "content": "<SPECIAL_939>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "940": {
+      "content": "<SPECIAL_940>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "941": {
+      "content": "<SPECIAL_941>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "942": {
+      "content": "<SPECIAL_942>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "943": {
+      "content": "<SPECIAL_943>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "944": {
+      "content": "<SPECIAL_944>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "945": {
+      "content": "<SPECIAL_945>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "946": {
+      "content": "<SPECIAL_946>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "947": {
+      "content": "<SPECIAL_947>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "948": {
+      "content": "<SPECIAL_948>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "949": {
+      "content": "<SPECIAL_949>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "950": {
+      "content": "<SPECIAL_950>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "951": {
+      "content": "<SPECIAL_951>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "952": {
+      "content": "<SPECIAL_952>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "953": {
+      "content": "<SPECIAL_953>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "954": {
+      "content": "<SPECIAL_954>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "955": {
+      "content": "<SPECIAL_955>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "956": {
+      "content": "<SPECIAL_956>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "957": {
+      "content": "<SPECIAL_957>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "958": {
+      "content": "<SPECIAL_958>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "959": {
+      "content": "<SPECIAL_959>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "960": {
+      "content": "<SPECIAL_960>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "961": {
+      "content": "<SPECIAL_961>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "962": {
+      "content": "<SPECIAL_962>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "963": {
+      "content": "<SPECIAL_963>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "964": {
+      "content": "<SPECIAL_964>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "965": {
+      "content": "<SPECIAL_965>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "966": {
+      "content": "<SPECIAL_966>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "967": {
+      "content": "<SPECIAL_967>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "968": {
+      "content": "<SPECIAL_968>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "969": {
+      "content": "<SPECIAL_969>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "970": {
+      "content": "<SPECIAL_970>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "971": {
+      "content": "<SPECIAL_971>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "972": {
+      "content": "<SPECIAL_972>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "973": {
+      "content": "<SPECIAL_973>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "974": {
+      "content": "<SPECIAL_974>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "975": {
+      "content": "<SPECIAL_975>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "976": {
+      "content": "<SPECIAL_976>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "977": {
+      "content": "<SPECIAL_977>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "978": {
+      "content": "<SPECIAL_978>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "979": {
+      "content": "<SPECIAL_979>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "980": {
+      "content": "<SPECIAL_980>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "981": {
+      "content": "<SPECIAL_981>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "982": {
+      "content": "<SPECIAL_982>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "983": {
+      "content": "<SPECIAL_983>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "984": {
+      "content": "<SPECIAL_984>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "985": {
+      "content": "<SPECIAL_985>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "986": {
+      "content": "<SPECIAL_986>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "987": {
+      "content": "<SPECIAL_987>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "988": {
+      "content": "<SPECIAL_988>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "989": {
+      "content": "<SPECIAL_989>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "990": {
+      "content": "<SPECIAL_990>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "991": {
+      "content": "<SPECIAL_991>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "992": {
+      "content": "<SPECIAL_992>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "993": {
+      "content": "<SPECIAL_993>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "994": {
+      "content": "<SPECIAL_994>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "995": {
+      "content": "<SPECIAL_995>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "996": {
+      "content": "<SPECIAL_996>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "997": {
+      "content": "<SPECIAL_997>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "998": {
+      "content": "<SPECIAL_998>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "999": {
+      "content": "<SPECIAL_999>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "extra_special_tokens": {},
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "tokenizer_class": "PreTrainedTokenizer",
+  "unk_token": "<unk>"
+}