Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+experiments/en-hr/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/en-hr/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/en-hr/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -text

experiments/en-hr/README.md

@@ -0,0 +1,59 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: transformers
+model_name: en-hr
+tags:
+- generated_from_trainer
+- unsloth
+- sft
+- trl
+licence: license
+---
+
+# Model Card for en-hr
+
+This model is a fine-tuned version of [unsloth/meta-llama-3.1-8b-instruct-bnb-4bit](https://huggingface.co/unsloth/meta-llama-3.1-8b-instruct-bnb-4bit).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="None", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+ 
+
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.22.2
+- Transformers: 4.56.0
+- Pytorch: 2.8.0+cu129
+- Datasets: 4.3.0
+- Tokenizers: 0.22.0
+
+## Citations
+
+
+
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

experiments/en-hr/adapter/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/en-hr/adapter/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/en-hr/adapter/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ebb02019287163af13f8f36449f907330a42897aa8cc8a1993692dd25c3a4fe
+size 83945296

experiments/en-hr/adapter/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/en-hr/adapter/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/en-hr/adapter/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/en-hr/adapter/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "left",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/en-hr/checkpoint-500/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/en-hr/checkpoint-500/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/en-hr/checkpoint-500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e84ffe3242cc0bc7f3a2bb0ee56b8f8a85e412a401b6bf6eca09ac1b2d5ec12a
+size 83945296

experiments/en-hr/checkpoint-500/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/en-hr/checkpoint-500/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8aa1da0d5beb9b86889c7dd4af99e43ad17a1e3ab9932fa608dd1e2c06894c38
+size 43123429

experiments/en-hr/checkpoint-500/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6d8fafcd1ee268414be5acf0366296af5b03d60871978712eac1979cb42d65
+size 14645

experiments/en-hr/checkpoint-500/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f58070f27ecc1447cda3df381e75b78a82815c8dd68eab34fe5e56c98549f266
+size 1465

experiments/en-hr/checkpoint-500/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/en-hr/checkpoint-500/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/en-hr/checkpoint-500/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/en-hr/checkpoint-500/trainer_state.json

@@ -0,0 +1,734 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 3.1645569620253164,
+  "eval_steps": 500,
+  "global_step": 500,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03164556962025317,
+      "grad_norm": 8.633589744567871,
+      "learning_rate": 0.0002,
+      "loss": 2.8037,
+      "step": 5
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 2.2176594734191895,
+      "learning_rate": 0.00019872773536895675,
+      "loss": 0.9131,
+      "step": 10
+    },
+    {
+      "epoch": 0.0949367088607595,
+      "grad_norm": 1.8736966848373413,
+      "learning_rate": 0.00019745547073791352,
+      "loss": 0.6928,
+      "step": 15
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 1.140359878540039,
+      "learning_rate": 0.00019618320610687023,
+      "loss": 0.551,
+      "step": 20
+    },
+    {
+      "epoch": 0.15822784810126583,
+      "grad_norm": 0.9033111333847046,
+      "learning_rate": 0.00019491094147582698,
+      "loss": 0.4932,
+      "step": 25
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 1.0288461446762085,
+      "learning_rate": 0.00019363867684478372,
+      "loss": 0.4595,
+      "step": 30
+    },
+    {
+      "epoch": 0.22151898734177214,
+      "grad_norm": 1.06450355052948,
+      "learning_rate": 0.00019236641221374049,
+      "loss": 0.5573,
+      "step": 35
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 0.9156201481819153,
+      "learning_rate": 0.00019109414758269723,
+      "loss": 0.5257,
+      "step": 40
+    },
+    {
+      "epoch": 0.2848101265822785,
+      "grad_norm": 0.8665907382965088,
+      "learning_rate": 0.00018982188295165394,
+      "loss": 0.555,
+      "step": 45
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 0.7511389255523682,
+      "learning_rate": 0.00018854961832061068,
+      "loss": 0.5271,
+      "step": 50
+    },
+    {
+      "epoch": 0.34810126582278483,
+      "grad_norm": 0.7315279841423035,
+      "learning_rate": 0.00018727735368956745,
+      "loss": 0.5404,
+      "step": 55
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 0.8015694618225098,
+      "learning_rate": 0.0001860050890585242,
+      "loss": 0.5004,
+      "step": 60
+    },
+    {
+      "epoch": 0.41139240506329117,
+      "grad_norm": 0.7726429104804993,
+      "learning_rate": 0.00018473282442748093,
+      "loss": 0.5182,
+      "step": 65
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 0.8248880505561829,
+      "learning_rate": 0.00018346055979643765,
+      "loss": 0.4591,
+      "step": 70
+    },
+    {
+      "epoch": 0.47468354430379744,
+      "grad_norm": 0.7304039001464844,
+      "learning_rate": 0.00018218829516539442,
+      "loss": 0.4691,
+      "step": 75
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 0.6727501153945923,
+      "learning_rate": 0.00018091603053435116,
+      "loss": 0.4806,
+      "step": 80
+    },
+    {
+      "epoch": 0.5379746835443038,
+      "grad_norm": 0.7586938738822937,
+      "learning_rate": 0.0001796437659033079,
+      "loss": 0.478,
+      "step": 85
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.8255019187927246,
+      "learning_rate": 0.00017837150127226464,
+      "loss": 0.5501,
+      "step": 90
+    },
+    {
+      "epoch": 0.6012658227848101,
+      "grad_norm": 0.8590326309204102,
+      "learning_rate": 0.00017709923664122138,
+      "loss": 0.4585,
+      "step": 95
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 0.7202553153038025,
+      "learning_rate": 0.00017582697201017812,
+      "loss": 0.4975,
+      "step": 100
+    },
+    {
+      "epoch": 0.6645569620253164,
+      "grad_norm": 1.2743698358535767,
+      "learning_rate": 0.00017455470737913486,
+      "loss": 0.5709,
+      "step": 105
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.790630042552948,
+      "learning_rate": 0.00017328244274809163,
+      "loss": 0.4912,
+      "step": 110
+    },
+    {
+      "epoch": 0.7278481012658228,
+      "grad_norm": 0.9008660912513733,
+      "learning_rate": 0.00017201017811704835,
+      "loss": 0.5643,
+      "step": 115
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.6998384594917297,
+      "learning_rate": 0.0001707379134860051,
+      "loss": 0.4931,
+      "step": 120
+    },
+    {
+      "epoch": 0.7911392405063291,
+      "grad_norm": 0.8974913358688354,
+      "learning_rate": 0.00016946564885496183,
+      "loss": 0.4461,
+      "step": 125
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.8803034424781799,
+      "learning_rate": 0.0001681933842239186,
+      "loss": 0.5381,
+      "step": 130
+    },
+    {
+      "epoch": 0.8544303797468354,
+      "grad_norm": 0.7390441298484802,
+      "learning_rate": 0.00016692111959287534,
+      "loss": 0.4997,
+      "step": 135
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.9009511470794678,
+      "learning_rate": 0.00016564885496183205,
+      "loss": 0.4744,
+      "step": 140
+    },
+    {
+      "epoch": 0.9177215189873418,
+      "grad_norm": 0.7336710691452026,
+      "learning_rate": 0.0001643765903307888,
+      "loss": 0.4805,
+      "step": 145
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.6651920080184937,
+      "learning_rate": 0.00016310432569974556,
+      "loss": 0.4534,
+      "step": 150
+    },
+    {
+      "epoch": 0.9810126582278481,
+      "grad_norm": 1.0618934631347656,
+      "learning_rate": 0.0001618320610687023,
+      "loss": 0.4919,
+      "step": 155
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.49792593717575073,
+      "learning_rate": 0.00016055979643765905,
+      "loss": 0.4014,
+      "step": 160
+    },
+    {
+      "epoch": 1.0443037974683544,
+      "grad_norm": 0.8175292015075684,
+      "learning_rate": 0.0001592875318066158,
+      "loss": 0.4179,
+      "step": 165
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.6501911282539368,
+      "learning_rate": 0.00015801526717557253,
+      "loss": 0.369,
+      "step": 170
+    },
+    {
+      "epoch": 1.1075949367088607,
+      "grad_norm": 0.7288970351219177,
+      "learning_rate": 0.00015674300254452927,
+      "loss": 0.3421,
+      "step": 175
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.7625704407691956,
+      "learning_rate": 0.000155470737913486,
+      "loss": 0.4222,
+      "step": 180
+    },
+    {
+      "epoch": 1.1708860759493671,
+      "grad_norm": 0.6345648169517517,
+      "learning_rate": 0.00015419847328244275,
+      "loss": 0.3806,
+      "step": 185
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.6399903893470764,
+      "learning_rate": 0.0001529262086513995,
+      "loss": 0.374,
+      "step": 190
+    },
+    {
+      "epoch": 1.2341772151898733,
+      "grad_norm": 0.7712934613227844,
+      "learning_rate": 0.00015165394402035624,
+      "loss": 0.3721,
+      "step": 195
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7349191904067993,
+      "learning_rate": 0.00015038167938931298,
+      "loss": 0.3782,
+      "step": 200
+    },
+    {
+      "epoch": 1.2974683544303798,
+      "grad_norm": 0.9972257614135742,
+      "learning_rate": 0.00014910941475826972,
+      "loss": 0.3959,
+      "step": 205
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 0.7999849319458008,
+      "learning_rate": 0.0001478371501272265,
+      "loss": 0.3912,
+      "step": 210
+    },
+    {
+      "epoch": 1.360759493670886,
+      "grad_norm": 0.7882068157196045,
+      "learning_rate": 0.0001465648854961832,
+      "loss": 0.359,
+      "step": 215
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.8832948207855225,
+      "learning_rate": 0.00014529262086513994,
+      "loss": 0.3807,
+      "step": 220
+    },
+    {
+      "epoch": 1.4240506329113924,
+      "grad_norm": 0.6134157180786133,
+      "learning_rate": 0.0001440203562340967,
+      "loss": 0.4103,
+      "step": 225
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.912650465965271,
+      "learning_rate": 0.00014274809160305345,
+      "loss": 0.3868,
+      "step": 230
+    },
+    {
+      "epoch": 1.4873417721518987,
+      "grad_norm": 1.2680710554122925,
+      "learning_rate": 0.0001414758269720102,
+      "loss": 0.3993,
+      "step": 235
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 0.8676391243934631,
+      "learning_rate": 0.0001402035623409669,
+      "loss": 0.3707,
+      "step": 240
+    },
+    {
+      "epoch": 1.5506329113924051,
+      "grad_norm": 0.808569073677063,
+      "learning_rate": 0.00013893129770992368,
+      "loss": 0.3708,
+      "step": 245
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 0.7392472624778748,
+      "learning_rate": 0.00013765903307888042,
+      "loss": 0.4033,
+      "step": 250
+    },
+    {
+      "epoch": 1.6139240506329116,
+      "grad_norm": 0.9047561287879944,
+      "learning_rate": 0.00013638676844783716,
+      "loss": 0.3991,
+      "step": 255
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.7823458909988403,
+      "learning_rate": 0.0001351145038167939,
+      "loss": 0.3675,
+      "step": 260
+    },
+    {
+      "epoch": 1.6772151898734178,
+      "grad_norm": 0.8162348866462708,
+      "learning_rate": 0.00013384223918575064,
+      "loss": 0.3443,
+      "step": 265
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.9522086977958679,
+      "learning_rate": 0.00013256997455470738,
+      "loss": 0.4377,
+      "step": 270
+    },
+    {
+      "epoch": 1.740506329113924,
+      "grad_norm": 0.665181040763855,
+      "learning_rate": 0.00013129770992366413,
+      "loss": 0.3574,
+      "step": 275
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 0.9565332531929016,
+      "learning_rate": 0.00013002544529262087,
+      "loss": 0.4191,
+      "step": 280
+    },
+    {
+      "epoch": 1.8037974683544302,
+      "grad_norm": 1.1064597368240356,
+      "learning_rate": 0.0001287531806615776,
+      "loss": 0.41,
+      "step": 285
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 0.7252824902534485,
+      "learning_rate": 0.00012748091603053435,
+      "loss": 0.3772,
+      "step": 290
+    },
+    {
+      "epoch": 1.8670886075949367,
+      "grad_norm": 0.877967119216919,
+      "learning_rate": 0.0001262086513994911,
+      "loss": 0.36,
+      "step": 295
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 0.7453832030296326,
+      "learning_rate": 0.00012493638676844783,
+      "loss": 0.4038,
+      "step": 300
+    },
+    {
+      "epoch": 1.9303797468354431,
+      "grad_norm": 0.7737745046615601,
+      "learning_rate": 0.0001236641221374046,
+      "loss": 0.3759,
+      "step": 305
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.834141194820404,
+      "learning_rate": 0.00012239185750636134,
+      "loss": 0.3563,
+      "step": 310
+    },
+    {
+      "epoch": 1.9936708860759493,
+      "grad_norm": 0.7207242250442505,
+      "learning_rate": 0.00012111959287531807,
+      "loss": 0.3833,
+      "step": 315
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.6740375757217407,
+      "learning_rate": 0.00011984732824427483,
+      "loss": 0.2884,
+      "step": 320
+    },
+    {
+      "epoch": 2.0569620253164556,
+      "grad_norm": 1.6249363422393799,
+      "learning_rate": 0.00011857506361323157,
+      "loss": 0.258,
+      "step": 325
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.970698893070221,
+      "learning_rate": 0.0001173027989821883,
+      "loss": 0.2651,
+      "step": 330
+    },
+    {
+      "epoch": 2.1202531645569622,
+      "grad_norm": 0.7959200143814087,
+      "learning_rate": 0.00011603053435114504,
+      "loss": 0.2391,
+      "step": 335
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 1.0868202447891235,
+      "learning_rate": 0.00011475826972010179,
+      "loss": 0.2302,
+      "step": 340
+    },
+    {
+      "epoch": 2.1835443037974684,
+      "grad_norm": 1.1783322095870972,
+      "learning_rate": 0.00011348600508905853,
+      "loss": 0.236,
+      "step": 345
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 0.9198023676872253,
+      "learning_rate": 0.00011221374045801527,
+      "loss": 0.2503,
+      "step": 350
+    },
+    {
+      "epoch": 2.2468354430379747,
+      "grad_norm": 1.0101510286331177,
+      "learning_rate": 0.000110941475826972,
+      "loss": 0.2542,
+      "step": 355
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.9058020710945129,
+      "learning_rate": 0.00010966921119592877,
+      "loss": 0.2235,
+      "step": 360
+    },
+    {
+      "epoch": 2.310126582278481,
+      "grad_norm": 1.0000735521316528,
+      "learning_rate": 0.0001083969465648855,
+      "loss": 0.2475,
+      "step": 365
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.824941873550415,
+      "learning_rate": 0.00010712468193384224,
+      "loss": 0.2443,
+      "step": 370
+    },
+    {
+      "epoch": 2.3734177215189876,
+      "grad_norm": 1.0715147256851196,
+      "learning_rate": 0.00010585241730279898,
+      "loss": 0.2549,
+      "step": 375
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 1.1317178010940552,
+      "learning_rate": 0.00010458015267175574,
+      "loss": 0.274,
+      "step": 380
+    },
+    {
+      "epoch": 2.4367088607594938,
+      "grad_norm": 0.9162061810493469,
+      "learning_rate": 0.00010330788804071248,
+      "loss": 0.2644,
+      "step": 385
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 0.8676306009292603,
+      "learning_rate": 0.00010203562340966922,
+      "loss": 0.2668,
+      "step": 390
+    },
+    {
+      "epoch": 2.5,
+      "grad_norm": 0.8871727585792542,
+      "learning_rate": 0.00010076335877862595,
+      "loss": 0.2625,
+      "step": 395
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 0.800001323223114,
+      "learning_rate": 9.94910941475827e-05,
+      "loss": 0.2628,
+      "step": 400
+    },
+    {
+      "epoch": 2.5632911392405062,
+      "grad_norm": 1.035553216934204,
+      "learning_rate": 9.821882951653944e-05,
+      "loss": 0.2651,
+      "step": 405
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 1.2588839530944824,
+      "learning_rate": 9.694656488549618e-05,
+      "loss": 0.2758,
+      "step": 410
+    },
+    {
+      "epoch": 2.6265822784810124,
+      "grad_norm": 0.7838737964630127,
+      "learning_rate": 9.567430025445293e-05,
+      "loss": 0.2563,
+      "step": 415
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.862562358379364,
+      "learning_rate": 9.440203562340968e-05,
+      "loss": 0.2573,
+      "step": 420
+    },
+    {
+      "epoch": 2.689873417721519,
+      "grad_norm": 0.9090970754623413,
+      "learning_rate": 9.312977099236642e-05,
+      "loss": 0.2624,
+      "step": 425
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 0.9972439408302307,
+      "learning_rate": 9.185750636132316e-05,
+      "loss": 0.2586,
+      "step": 430
+    },
+    {
+      "epoch": 2.7531645569620253,
+      "grad_norm": 1.023733139038086,
+      "learning_rate": 9.05852417302799e-05,
+      "loss": 0.248,
+      "step": 435
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 0.9622347950935364,
+      "learning_rate": 8.931297709923665e-05,
+      "loss": 0.2552,
+      "step": 440
+    },
+    {
+      "epoch": 2.8164556962025316,
+      "grad_norm": 1.0281400680541992,
+      "learning_rate": 8.804071246819339e-05,
+      "loss": 0.2471,
+      "step": 445
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 1.0144472122192383,
+      "learning_rate": 8.676844783715013e-05,
+      "loss": 0.251,
+      "step": 450
+    },
+    {
+      "epoch": 2.879746835443038,
+      "grad_norm": 1.0020065307617188,
+      "learning_rate": 8.549618320610687e-05,
+      "loss": 0.2621,
+      "step": 455
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 0.8894968032836914,
+      "learning_rate": 8.422391857506363e-05,
+      "loss": 0.2518,
+      "step": 460
+    },
+    {
+      "epoch": 2.9430379746835444,
+      "grad_norm": 0.9407539367675781,
+      "learning_rate": 8.295165394402035e-05,
+      "loss": 0.2857,
+      "step": 465
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 0.8730989098548889,
+      "learning_rate": 8.167938931297711e-05,
+      "loss": 0.2666,
+      "step": 470
+    },
+    {
+      "epoch": 3.0063291139240507,
+      "grad_norm": 0.9915937185287476,
+      "learning_rate": 8.040712468193385e-05,
+      "loss": 0.2389,
+      "step": 475
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 0.8623847961425781,
+      "learning_rate": 7.913486005089059e-05,
+      "loss": 0.1507,
+      "step": 480
+    },
+    {
+      "epoch": 3.069620253164557,
+      "grad_norm": 1.3474798202514648,
+      "learning_rate": 7.786259541984733e-05,
+      "loss": 0.1444,
+      "step": 485
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 0.8760435581207275,
+      "learning_rate": 7.659033078880407e-05,
+      "loss": 0.1543,
+      "step": 490
+    },
+    {
+      "epoch": 3.132911392405063,
+      "grad_norm": 1.0294660329818726,
+      "learning_rate": 7.531806615776081e-05,
+      "loss": 0.1418,
+      "step": 495
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 1.1107193231582642,
+      "learning_rate": 7.404580152671756e-05,
+      "loss": 0.1477,
+      "step": 500
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 790,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 4.381286263389389e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/en-hr/checkpoint-500/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a48ae421ab023b3fdb5557bbc63ed3b90ba7d85e26c595b34738c0fc0ebe5a96
+size 6289

experiments/en-hr/checkpoint-790/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/en-hr/checkpoint-790/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/en-hr/checkpoint-790/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ebb02019287163af13f8f36449f907330a42897aa8cc8a1993692dd25c3a4fe
+size 83945296

experiments/en-hr/checkpoint-790/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/en-hr/checkpoint-790/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73f08e8ae8c71ac58ad6ba22beb8b939c11264e27e1e865ddf11bfeb4efdb33a
+size 43123429

experiments/en-hr/checkpoint-790/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89645f9f6a2a8823b334e0748e4f5ea683a27b3d02632f0a241397db55d82fad
+size 14645

experiments/en-hr/checkpoint-790/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:35051bf7f4f2e2be5c96ec74ea328521409c95bd45c583cbfff0b643a5cb5e1d
+size 1465

experiments/en-hr/checkpoint-790/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/en-hr/checkpoint-790/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/en-hr/checkpoint-790/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/en-hr/checkpoint-790/trainer_state.json

@@ -0,0 +1,1140 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 5.0,
+  "eval_steps": 500,
+  "global_step": 790,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03164556962025317,
+      "grad_norm": 8.633589744567871,
+      "learning_rate": 0.0002,
+      "loss": 2.8037,
+      "step": 5
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 2.2176594734191895,
+      "learning_rate": 0.00019872773536895675,
+      "loss": 0.9131,
+      "step": 10
+    },
+    {
+      "epoch": 0.0949367088607595,
+      "grad_norm": 1.8736966848373413,
+      "learning_rate": 0.00019745547073791352,
+      "loss": 0.6928,
+      "step": 15
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 1.140359878540039,
+      "learning_rate": 0.00019618320610687023,
+      "loss": 0.551,
+      "step": 20
+    },
+    {
+      "epoch": 0.15822784810126583,
+      "grad_norm": 0.9033111333847046,
+      "learning_rate": 0.00019491094147582698,
+      "loss": 0.4932,
+      "step": 25
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 1.0288461446762085,
+      "learning_rate": 0.00019363867684478372,
+      "loss": 0.4595,
+      "step": 30
+    },
+    {
+      "epoch": 0.22151898734177214,
+      "grad_norm": 1.06450355052948,
+      "learning_rate": 0.00019236641221374049,
+      "loss": 0.5573,
+      "step": 35
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 0.9156201481819153,
+      "learning_rate": 0.00019109414758269723,
+      "loss": 0.5257,
+      "step": 40
+    },
+    {
+      "epoch": 0.2848101265822785,
+      "grad_norm": 0.8665907382965088,
+      "learning_rate": 0.00018982188295165394,
+      "loss": 0.555,
+      "step": 45
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 0.7511389255523682,
+      "learning_rate": 0.00018854961832061068,
+      "loss": 0.5271,
+      "step": 50
+    },
+    {
+      "epoch": 0.34810126582278483,
+      "grad_norm": 0.7315279841423035,
+      "learning_rate": 0.00018727735368956745,
+      "loss": 0.5404,
+      "step": 55
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 0.8015694618225098,
+      "learning_rate": 0.0001860050890585242,
+      "loss": 0.5004,
+      "step": 60
+    },
+    {
+      "epoch": 0.41139240506329117,
+      "grad_norm": 0.7726429104804993,
+      "learning_rate": 0.00018473282442748093,
+      "loss": 0.5182,
+      "step": 65
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 0.8248880505561829,
+      "learning_rate": 0.00018346055979643765,
+      "loss": 0.4591,
+      "step": 70
+    },
+    {
+      "epoch": 0.47468354430379744,
+      "grad_norm": 0.7304039001464844,
+      "learning_rate": 0.00018218829516539442,
+      "loss": 0.4691,
+      "step": 75
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 0.6727501153945923,
+      "learning_rate": 0.00018091603053435116,
+      "loss": 0.4806,
+      "step": 80
+    },
+    {
+      "epoch": 0.5379746835443038,
+      "grad_norm": 0.7586938738822937,
+      "learning_rate": 0.0001796437659033079,
+      "loss": 0.478,
+      "step": 85
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.8255019187927246,
+      "learning_rate": 0.00017837150127226464,
+      "loss": 0.5501,
+      "step": 90
+    },
+    {
+      "epoch": 0.6012658227848101,
+      "grad_norm": 0.8590326309204102,
+      "learning_rate": 0.00017709923664122138,
+      "loss": 0.4585,
+      "step": 95
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 0.7202553153038025,
+      "learning_rate": 0.00017582697201017812,
+      "loss": 0.4975,
+      "step": 100
+    },
+    {
+      "epoch": 0.6645569620253164,
+      "grad_norm": 1.2743698358535767,
+      "learning_rate": 0.00017455470737913486,
+      "loss": 0.5709,
+      "step": 105
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.790630042552948,
+      "learning_rate": 0.00017328244274809163,
+      "loss": 0.4912,
+      "step": 110
+    },
+    {
+      "epoch": 0.7278481012658228,
+      "grad_norm": 0.9008660912513733,
+      "learning_rate": 0.00017201017811704835,
+      "loss": 0.5643,
+      "step": 115
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.6998384594917297,
+      "learning_rate": 0.0001707379134860051,
+      "loss": 0.4931,
+      "step": 120
+    },
+    {
+      "epoch": 0.7911392405063291,
+      "grad_norm": 0.8974913358688354,
+      "learning_rate": 0.00016946564885496183,
+      "loss": 0.4461,
+      "step": 125
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.8803034424781799,
+      "learning_rate": 0.0001681933842239186,
+      "loss": 0.5381,
+      "step": 130
+    },
+    {
+      "epoch": 0.8544303797468354,
+      "grad_norm": 0.7390441298484802,
+      "learning_rate": 0.00016692111959287534,
+      "loss": 0.4997,
+      "step": 135
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.9009511470794678,
+      "learning_rate": 0.00016564885496183205,
+      "loss": 0.4744,
+      "step": 140
+    },
+    {
+      "epoch": 0.9177215189873418,
+      "grad_norm": 0.7336710691452026,
+      "learning_rate": 0.0001643765903307888,
+      "loss": 0.4805,
+      "step": 145
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.6651920080184937,
+      "learning_rate": 0.00016310432569974556,
+      "loss": 0.4534,
+      "step": 150
+    },
+    {
+      "epoch": 0.9810126582278481,
+      "grad_norm": 1.0618934631347656,
+      "learning_rate": 0.0001618320610687023,
+      "loss": 0.4919,
+      "step": 155
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.49792593717575073,
+      "learning_rate": 0.00016055979643765905,
+      "loss": 0.4014,
+      "step": 160
+    },
+    {
+      "epoch": 1.0443037974683544,
+      "grad_norm": 0.8175292015075684,
+      "learning_rate": 0.0001592875318066158,
+      "loss": 0.4179,
+      "step": 165
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.6501911282539368,
+      "learning_rate": 0.00015801526717557253,
+      "loss": 0.369,
+      "step": 170
+    },
+    {
+      "epoch": 1.1075949367088607,
+      "grad_norm": 0.7288970351219177,
+      "learning_rate": 0.00015674300254452927,
+      "loss": 0.3421,
+      "step": 175
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.7625704407691956,
+      "learning_rate": 0.000155470737913486,
+      "loss": 0.4222,
+      "step": 180
+    },
+    {
+      "epoch": 1.1708860759493671,
+      "grad_norm": 0.6345648169517517,
+      "learning_rate": 0.00015419847328244275,
+      "loss": 0.3806,
+      "step": 185
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.6399903893470764,
+      "learning_rate": 0.0001529262086513995,
+      "loss": 0.374,
+      "step": 190
+    },
+    {
+      "epoch": 1.2341772151898733,
+      "grad_norm": 0.7712934613227844,
+      "learning_rate": 0.00015165394402035624,
+      "loss": 0.3721,
+      "step": 195
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7349191904067993,
+      "learning_rate": 0.00015038167938931298,
+      "loss": 0.3782,
+      "step": 200
+    },
+    {
+      "epoch": 1.2974683544303798,
+      "grad_norm": 0.9972257614135742,
+      "learning_rate": 0.00014910941475826972,
+      "loss": 0.3959,
+      "step": 205
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 0.7999849319458008,
+      "learning_rate": 0.0001478371501272265,
+      "loss": 0.3912,
+      "step": 210
+    },
+    {
+      "epoch": 1.360759493670886,
+      "grad_norm": 0.7882068157196045,
+      "learning_rate": 0.0001465648854961832,
+      "loss": 0.359,
+      "step": 215
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.8832948207855225,
+      "learning_rate": 0.00014529262086513994,
+      "loss": 0.3807,
+      "step": 220
+    },
+    {
+      "epoch": 1.4240506329113924,
+      "grad_norm": 0.6134157180786133,
+      "learning_rate": 0.0001440203562340967,
+      "loss": 0.4103,
+      "step": 225
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.912650465965271,
+      "learning_rate": 0.00014274809160305345,
+      "loss": 0.3868,
+      "step": 230
+    },
+    {
+      "epoch": 1.4873417721518987,
+      "grad_norm": 1.2680710554122925,
+      "learning_rate": 0.0001414758269720102,
+      "loss": 0.3993,
+      "step": 235
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 0.8676391243934631,
+      "learning_rate": 0.0001402035623409669,
+      "loss": 0.3707,
+      "step": 240
+    },
+    {
+      "epoch": 1.5506329113924051,
+      "grad_norm": 0.808569073677063,
+      "learning_rate": 0.00013893129770992368,
+      "loss": 0.3708,
+      "step": 245
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 0.7392472624778748,
+      "learning_rate": 0.00013765903307888042,
+      "loss": 0.4033,
+      "step": 250
+    },
+    {
+      "epoch": 1.6139240506329116,
+      "grad_norm": 0.9047561287879944,
+      "learning_rate": 0.00013638676844783716,
+      "loss": 0.3991,
+      "step": 255
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.7823458909988403,
+      "learning_rate": 0.0001351145038167939,
+      "loss": 0.3675,
+      "step": 260
+    },
+    {
+      "epoch": 1.6772151898734178,
+      "grad_norm": 0.8162348866462708,
+      "learning_rate": 0.00013384223918575064,
+      "loss": 0.3443,
+      "step": 265
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.9522086977958679,
+      "learning_rate": 0.00013256997455470738,
+      "loss": 0.4377,
+      "step": 270
+    },
+    {
+      "epoch": 1.740506329113924,
+      "grad_norm": 0.665181040763855,
+      "learning_rate": 0.00013129770992366413,
+      "loss": 0.3574,
+      "step": 275
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 0.9565332531929016,
+      "learning_rate": 0.00013002544529262087,
+      "loss": 0.4191,
+      "step": 280
+    },
+    {
+      "epoch": 1.8037974683544302,
+      "grad_norm": 1.1064597368240356,
+      "learning_rate": 0.0001287531806615776,
+      "loss": 0.41,
+      "step": 285
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 0.7252824902534485,
+      "learning_rate": 0.00012748091603053435,
+      "loss": 0.3772,
+      "step": 290
+    },
+    {
+      "epoch": 1.8670886075949367,
+      "grad_norm": 0.877967119216919,
+      "learning_rate": 0.0001262086513994911,
+      "loss": 0.36,
+      "step": 295
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 0.7453832030296326,
+      "learning_rate": 0.00012493638676844783,
+      "loss": 0.4038,
+      "step": 300
+    },
+    {
+      "epoch": 1.9303797468354431,
+      "grad_norm": 0.7737745046615601,
+      "learning_rate": 0.0001236641221374046,
+      "loss": 0.3759,
+      "step": 305
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.834141194820404,
+      "learning_rate": 0.00012239185750636134,
+      "loss": 0.3563,
+      "step": 310
+    },
+    {
+      "epoch": 1.9936708860759493,
+      "grad_norm": 0.7207242250442505,
+      "learning_rate": 0.00012111959287531807,
+      "loss": 0.3833,
+      "step": 315
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.6740375757217407,
+      "learning_rate": 0.00011984732824427483,
+      "loss": 0.2884,
+      "step": 320
+    },
+    {
+      "epoch": 2.0569620253164556,
+      "grad_norm": 1.6249363422393799,
+      "learning_rate": 0.00011857506361323157,
+      "loss": 0.258,
+      "step": 325
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.970698893070221,
+      "learning_rate": 0.0001173027989821883,
+      "loss": 0.2651,
+      "step": 330
+    },
+    {
+      "epoch": 2.1202531645569622,
+      "grad_norm": 0.7959200143814087,
+      "learning_rate": 0.00011603053435114504,
+      "loss": 0.2391,
+      "step": 335
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 1.0868202447891235,
+      "learning_rate": 0.00011475826972010179,
+      "loss": 0.2302,
+      "step": 340
+    },
+    {
+      "epoch": 2.1835443037974684,
+      "grad_norm": 1.1783322095870972,
+      "learning_rate": 0.00011348600508905853,
+      "loss": 0.236,
+      "step": 345
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 0.9198023676872253,
+      "learning_rate": 0.00011221374045801527,
+      "loss": 0.2503,
+      "step": 350
+    },
+    {
+      "epoch": 2.2468354430379747,
+      "grad_norm": 1.0101510286331177,
+      "learning_rate": 0.000110941475826972,
+      "loss": 0.2542,
+      "step": 355
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.9058020710945129,
+      "learning_rate": 0.00010966921119592877,
+      "loss": 0.2235,
+      "step": 360
+    },
+    {
+      "epoch": 2.310126582278481,
+      "grad_norm": 1.0000735521316528,
+      "learning_rate": 0.0001083969465648855,
+      "loss": 0.2475,
+      "step": 365
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.824941873550415,
+      "learning_rate": 0.00010712468193384224,
+      "loss": 0.2443,
+      "step": 370
+    },
+    {
+      "epoch": 2.3734177215189876,
+      "grad_norm": 1.0715147256851196,
+      "learning_rate": 0.00010585241730279898,
+      "loss": 0.2549,
+      "step": 375
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 1.1317178010940552,
+      "learning_rate": 0.00010458015267175574,
+      "loss": 0.274,
+      "step": 380
+    },
+    {
+      "epoch": 2.4367088607594938,
+      "grad_norm": 0.9162061810493469,
+      "learning_rate": 0.00010330788804071248,
+      "loss": 0.2644,
+      "step": 385
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 0.8676306009292603,
+      "learning_rate": 0.00010203562340966922,
+      "loss": 0.2668,
+      "step": 390
+    },
+    {
+      "epoch": 2.5,
+      "grad_norm": 0.8871727585792542,
+      "learning_rate": 0.00010076335877862595,
+      "loss": 0.2625,
+      "step": 395
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 0.800001323223114,
+      "learning_rate": 9.94910941475827e-05,
+      "loss": 0.2628,
+      "step": 400
+    },
+    {
+      "epoch": 2.5632911392405062,
+      "grad_norm": 1.035553216934204,
+      "learning_rate": 9.821882951653944e-05,
+      "loss": 0.2651,
+      "step": 405
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 1.2588839530944824,
+      "learning_rate": 9.694656488549618e-05,
+      "loss": 0.2758,
+      "step": 410
+    },
+    {
+      "epoch": 2.6265822784810124,
+      "grad_norm": 0.7838737964630127,
+      "learning_rate": 9.567430025445293e-05,
+      "loss": 0.2563,
+      "step": 415
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.862562358379364,
+      "learning_rate": 9.440203562340968e-05,
+      "loss": 0.2573,
+      "step": 420
+    },
+    {
+      "epoch": 2.689873417721519,
+      "grad_norm": 0.9090970754623413,
+      "learning_rate": 9.312977099236642e-05,
+      "loss": 0.2624,
+      "step": 425
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 0.9972439408302307,
+      "learning_rate": 9.185750636132316e-05,
+      "loss": 0.2586,
+      "step": 430
+    },
+    {
+      "epoch": 2.7531645569620253,
+      "grad_norm": 1.023733139038086,
+      "learning_rate": 9.05852417302799e-05,
+      "loss": 0.248,
+      "step": 435
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 0.9622347950935364,
+      "learning_rate": 8.931297709923665e-05,
+      "loss": 0.2552,
+      "step": 440
+    },
+    {
+      "epoch": 2.8164556962025316,
+      "grad_norm": 1.0281400680541992,
+      "learning_rate": 8.804071246819339e-05,
+      "loss": 0.2471,
+      "step": 445
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 1.0144472122192383,
+      "learning_rate": 8.676844783715013e-05,
+      "loss": 0.251,
+      "step": 450
+    },
+    {
+      "epoch": 2.879746835443038,
+      "grad_norm": 1.0020065307617188,
+      "learning_rate": 8.549618320610687e-05,
+      "loss": 0.2621,
+      "step": 455
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 0.8894968032836914,
+      "learning_rate": 8.422391857506363e-05,
+      "loss": 0.2518,
+      "step": 460
+    },
+    {
+      "epoch": 2.9430379746835444,
+      "grad_norm": 0.9407539367675781,
+      "learning_rate": 8.295165394402035e-05,
+      "loss": 0.2857,
+      "step": 465
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 0.8730989098548889,
+      "learning_rate": 8.167938931297711e-05,
+      "loss": 0.2666,
+      "step": 470
+    },
+    {
+      "epoch": 3.0063291139240507,
+      "grad_norm": 0.9915937185287476,
+      "learning_rate": 8.040712468193385e-05,
+      "loss": 0.2389,
+      "step": 475
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 0.8623847961425781,
+      "learning_rate": 7.913486005089059e-05,
+      "loss": 0.1507,
+      "step": 480
+    },
+    {
+      "epoch": 3.069620253164557,
+      "grad_norm": 1.3474798202514648,
+      "learning_rate": 7.786259541984733e-05,
+      "loss": 0.1444,
+      "step": 485
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 0.8760435581207275,
+      "learning_rate": 7.659033078880407e-05,
+      "loss": 0.1543,
+      "step": 490
+    },
+    {
+      "epoch": 3.132911392405063,
+      "grad_norm": 1.0294660329818726,
+      "learning_rate": 7.531806615776081e-05,
+      "loss": 0.1418,
+      "step": 495
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 1.1107193231582642,
+      "learning_rate": 7.404580152671756e-05,
+      "loss": 0.1477,
+      "step": 500
+    },
+    {
+      "epoch": 3.1962025316455698,
+      "grad_norm": 0.8871766924858093,
+      "learning_rate": 7.27735368956743e-05,
+      "loss": 0.1453,
+      "step": 505
+    },
+    {
+      "epoch": 3.2278481012658227,
+      "grad_norm": 0.8436539769172668,
+      "learning_rate": 7.150127226463105e-05,
+      "loss": 0.1394,
+      "step": 510
+    },
+    {
+      "epoch": 3.259493670886076,
+      "grad_norm": 1.0295658111572266,
+      "learning_rate": 7.022900763358778e-05,
+      "loss": 0.1499,
+      "step": 515
+    },
+    {
+      "epoch": 3.291139240506329,
+      "grad_norm": 0.8685408234596252,
+      "learning_rate": 6.895674300254454e-05,
+      "loss": 0.1533,
+      "step": 520
+    },
+    {
+      "epoch": 3.3227848101265822,
+      "grad_norm": 1.1160097122192383,
+      "learning_rate": 6.768447837150128e-05,
+      "loss": 0.1549,
+      "step": 525
+    },
+    {
+      "epoch": 3.3544303797468356,
+      "grad_norm": 1.175316572189331,
+      "learning_rate": 6.641221374045802e-05,
+      "loss": 0.1485,
+      "step": 530
+    },
+    {
+      "epoch": 3.3860759493670884,
+      "grad_norm": 1.0799860954284668,
+      "learning_rate": 6.513994910941476e-05,
+      "loss": 0.1486,
+      "step": 535
+    },
+    {
+      "epoch": 3.4177215189873418,
+      "grad_norm": 1.26885187625885,
+      "learning_rate": 6.38676844783715e-05,
+      "loss": 0.1497,
+      "step": 540
+    },
+    {
+      "epoch": 3.449367088607595,
+      "grad_norm": 1.0354342460632324,
+      "learning_rate": 6.259541984732826e-05,
+      "loss": 0.1471,
+      "step": 545
+    },
+    {
+      "epoch": 3.481012658227848,
+      "grad_norm": 0.9845972657203674,
+      "learning_rate": 6.132315521628498e-05,
+      "loss": 0.1473,
+      "step": 550
+    },
+    {
+      "epoch": 3.5126582278481013,
+      "grad_norm": 0.983199417591095,
+      "learning_rate": 6.005089058524174e-05,
+      "loss": 0.1468,
+      "step": 555
+    },
+    {
+      "epoch": 3.5443037974683547,
+      "grad_norm": 1.1902103424072266,
+      "learning_rate": 5.877862595419847e-05,
+      "loss": 0.1567,
+      "step": 560
+    },
+    {
+      "epoch": 3.5759493670886076,
+      "grad_norm": 1.0060570240020752,
+      "learning_rate": 5.750636132315522e-05,
+      "loss": 0.1526,
+      "step": 565
+    },
+    {
+      "epoch": 3.607594936708861,
+      "grad_norm": 1.0281188488006592,
+      "learning_rate": 5.6234096692111956e-05,
+      "loss": 0.1414,
+      "step": 570
+    },
+    {
+      "epoch": 3.6392405063291138,
+      "grad_norm": 1.1555219888687134,
+      "learning_rate": 5.496183206106871e-05,
+      "loss": 0.1581,
+      "step": 575
+    },
+    {
+      "epoch": 3.670886075949367,
+      "grad_norm": 0.9327497482299805,
+      "learning_rate": 5.3689567430025446e-05,
+      "loss": 0.1568,
+      "step": 580
+    },
+    {
+      "epoch": 3.7025316455696204,
+      "grad_norm": 0.9867926239967346,
+      "learning_rate": 5.2417302798982194e-05,
+      "loss": 0.1529,
+      "step": 585
+    },
+    {
+      "epoch": 3.7341772151898733,
+      "grad_norm": 1.0565980672836304,
+      "learning_rate": 5.114503816793893e-05,
+      "loss": 0.1496,
+      "step": 590
+    },
+    {
+      "epoch": 3.7658227848101267,
+      "grad_norm": 0.9019814133644104,
+      "learning_rate": 4.9872773536895677e-05,
+      "loss": 0.1455,
+      "step": 595
+    },
+    {
+      "epoch": 3.7974683544303796,
+      "grad_norm": 1.061144232749939,
+      "learning_rate": 4.860050890585242e-05,
+      "loss": 0.1573,
+      "step": 600
+    },
+    {
+      "epoch": 3.829113924050633,
+      "grad_norm": 0.7622185349464417,
+      "learning_rate": 4.7328244274809166e-05,
+      "loss": 0.1448,
+      "step": 605
+    },
+    {
+      "epoch": 3.8607594936708862,
+      "grad_norm": 1.0320713520050049,
+      "learning_rate": 4.605597964376591e-05,
+      "loss": 0.1505,
+      "step": 610
+    },
+    {
+      "epoch": 3.892405063291139,
+      "grad_norm": 1.0786187648773193,
+      "learning_rate": 4.478371501272265e-05,
+      "loss": 0.1575,
+      "step": 615
+    },
+    {
+      "epoch": 3.9240506329113924,
+      "grad_norm": 0.8925222158432007,
+      "learning_rate": 4.351145038167939e-05,
+      "loss": 0.1493,
+      "step": 620
+    },
+    {
+      "epoch": 3.9556962025316453,
+      "grad_norm": 1.0546342134475708,
+      "learning_rate": 4.223918575063613e-05,
+      "loss": 0.1477,
+      "step": 625
+    },
+    {
+      "epoch": 3.9873417721518987,
+      "grad_norm": 1.0593990087509155,
+      "learning_rate": 4.096692111959288e-05,
+      "loss": 0.1496,
+      "step": 630
+    },
+    {
+      "epoch": 4.018987341772152,
+      "grad_norm": 0.44095051288604736,
+      "learning_rate": 3.969465648854962e-05,
+      "loss": 0.12,
+      "step": 635
+    },
+    {
+      "epoch": 4.050632911392405,
+      "grad_norm": 0.5279709696769714,
+      "learning_rate": 3.842239185750636e-05,
+      "loss": 0.0924,
+      "step": 640
+    },
+    {
+      "epoch": 4.082278481012658,
+      "grad_norm": 1.160754919052124,
+      "learning_rate": 3.7150127226463104e-05,
+      "loss": 0.0976,
+      "step": 645
+    },
+    {
+      "epoch": 4.113924050632911,
+      "grad_norm": 0.985950231552124,
+      "learning_rate": 3.5877862595419845e-05,
+      "loss": 0.0974,
+      "step": 650
+    },
+    {
+      "epoch": 4.1455696202531644,
+      "grad_norm": 1.1326498985290527,
+      "learning_rate": 3.4605597964376594e-05,
+      "loss": 0.0941,
+      "step": 655
+    },
+    {
+      "epoch": 4.177215189873418,
+      "grad_norm": 0.9554588794708252,
+      "learning_rate": 3.3333333333333335e-05,
+      "loss": 0.0921,
+      "step": 660
+    },
+    {
+      "epoch": 4.208860759493671,
+      "grad_norm": 0.6619102358818054,
+      "learning_rate": 3.2061068702290076e-05,
+      "loss": 0.0959,
+      "step": 665
+    },
+    {
+      "epoch": 4.2405063291139244,
+      "grad_norm": 0.6385964751243591,
+      "learning_rate": 3.078880407124682e-05,
+      "loss": 0.0951,
+      "step": 670
+    },
+    {
+      "epoch": 4.272151898734177,
+      "grad_norm": 0.9383646845817566,
+      "learning_rate": 2.9516539440203562e-05,
+      "loss": 0.0994,
+      "step": 675
+    },
+    {
+      "epoch": 4.30379746835443,
+      "grad_norm": 0.7180215716362,
+      "learning_rate": 2.824427480916031e-05,
+      "loss": 0.0951,
+      "step": 680
+    },
+    {
+      "epoch": 4.3354430379746836,
+      "grad_norm": 0.7822996973991394,
+      "learning_rate": 2.6972010178117052e-05,
+      "loss": 0.0943,
+      "step": 685
+    },
+    {
+      "epoch": 4.367088607594937,
+      "grad_norm": 1.308005928993225,
+      "learning_rate": 2.5699745547073793e-05,
+      "loss": 0.1002,
+      "step": 690
+    },
+    {
+      "epoch": 4.39873417721519,
+      "grad_norm": 0.6679030060768127,
+      "learning_rate": 2.4427480916030535e-05,
+      "loss": 0.0976,
+      "step": 695
+    },
+    {
+      "epoch": 4.430379746835443,
+      "grad_norm": 0.6158177852630615,
+      "learning_rate": 2.3155216284987276e-05,
+      "loss": 0.0928,
+      "step": 700
+    },
+    {
+      "epoch": 4.462025316455696,
+      "grad_norm": 0.7272059917449951,
+      "learning_rate": 2.1882951653944024e-05,
+      "loss": 0.0975,
+      "step": 705
+    },
+    {
+      "epoch": 4.493670886075949,
+      "grad_norm": 0.5800970792770386,
+      "learning_rate": 2.0610687022900766e-05,
+      "loss": 0.0965,
+      "step": 710
+    },
+    {
+      "epoch": 4.525316455696203,
+      "grad_norm": 0.7109256982803345,
+      "learning_rate": 1.9338422391857507e-05,
+      "loss": 0.096,
+      "step": 715
+    },
+    {
+      "epoch": 4.556962025316456,
+      "grad_norm": 0.8918435573577881,
+      "learning_rate": 1.8066157760814252e-05,
+      "loss": 0.0953,
+      "step": 720
+    },
+    {
+      "epoch": 4.588607594936709,
+      "grad_norm": 0.7997652888298035,
+      "learning_rate": 1.6793893129770993e-05,
+      "loss": 0.0973,
+      "step": 725
+    },
+    {
+      "epoch": 4.620253164556962,
+      "grad_norm": 0.6311637163162231,
+      "learning_rate": 1.5521628498727735e-05,
+      "loss": 0.0936,
+      "step": 730
+    },
+    {
+      "epoch": 4.651898734177215,
+      "grad_norm": 1.0592689514160156,
+      "learning_rate": 1.424936386768448e-05,
+      "loss": 0.0982,
+      "step": 735
+    },
+    {
+      "epoch": 4.6835443037974684,
+      "grad_norm": 0.7635562419891357,
+      "learning_rate": 1.2977099236641221e-05,
+      "loss": 0.0968,
+      "step": 740
+    },
+    {
+      "epoch": 4.715189873417722,
+      "grad_norm": 0.7648958563804626,
+      "learning_rate": 1.1704834605597966e-05,
+      "loss": 0.0928,
+      "step": 745
+    },
+    {
+      "epoch": 4.746835443037975,
+      "grad_norm": 0.5734853148460388,
+      "learning_rate": 1.0432569974554709e-05,
+      "loss": 0.0986,
+      "step": 750
+    },
+    {
+      "epoch": 4.7784810126582276,
+      "grad_norm": 0.52640700340271,
+      "learning_rate": 9.16030534351145e-06,
+      "loss": 0.0918,
+      "step": 755
+    },
+    {
+      "epoch": 4.810126582278481,
+      "grad_norm": 0.8626542091369629,
+      "learning_rate": 7.888040712468193e-06,
+      "loss": 0.0943,
+      "step": 760
+    },
+    {
+      "epoch": 4.841772151898734,
+      "grad_norm": 0.6101086139678955,
+      "learning_rate": 6.615776081424936e-06,
+      "loss": 0.0966,
+      "step": 765
+    },
+    {
+      "epoch": 4.8734177215189876,
+      "grad_norm": 0.6603073477745056,
+      "learning_rate": 5.343511450381679e-06,
+      "loss": 0.0947,
+      "step": 770
+    },
+    {
+      "epoch": 4.905063291139241,
+      "grad_norm": 0.6523921489715576,
+      "learning_rate": 4.0712468193384225e-06,
+      "loss": 0.0953,
+      "step": 775
+    },
+    {
+      "epoch": 4.936708860759493,
+      "grad_norm": 0.759199857711792,
+      "learning_rate": 2.7989821882951656e-06,
+      "loss": 0.0961,
+      "step": 780
+    },
+    {
+      "epoch": 4.968354430379747,
+      "grad_norm": 0.7331640720367432,
+      "learning_rate": 1.5267175572519084e-06,
+      "loss": 0.0971,
+      "step": 785
+    },
+    {
+      "epoch": 5.0,
+      "grad_norm": 0.9952906966209412,
+      "learning_rate": 2.544529262086514e-07,
+      "loss": 0.0967,
+      "step": 790
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 790,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 6.918842353360896e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/en-hr/checkpoint-790/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a48ae421ab023b3fdb5557bbc63ed3b90ba7d85e26c595b34738c0fc0ebe5a96
+size 6289

experiments/en-hr/metrics.json

@@ -0,0 +1,12 @@
+{
+    "en": {
+        "precision": 0.7651,
+        "recall": 0.7671,
+        "f1": 0.7661
+    },
+    "hr": {
+        "precision": 0.6701,
+        "recall": 0.671,
+        "f1": 0.6706
+    }
+}

experiments/en-hr/preds_en.csv

@@ -0,0 +1,539 @@
+input,gold,pred
+I waited for 10-15 minutes for service ordered a beer & was never served again .,"{service general, service, negative}","{service general, service, negative}"
+The ambiance was a peaceful and relaxing break amongst all the kids running around in Downtown Disney .,"{ambience general, ambiance, positive}","{ambience general, ambiance, positive}"
+hidden little jem,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+I went there with a friend from out of town ... and we were both very impressed !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+It has great sushi and even better service .,"{service general, service, positive};{food quality, sushi, positive}","{service general, service, positive};{food quality, sushi, positive}"
+"All their menu items are a hit , and they serve mimosas .","{food quality, menu items, positive}","{drinks quality, mimosas, positive};{food quality, menu items, positive}"
+– ... and the best summertime deck experience -- they will even bring you a blanket if you get cold in the Seattle evening weather .,"{ambience general, deck, positive};{service general, null, positive}","{ambience general, deck experience, positive}"
+You Ca n't Go Wrong Here .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+I think I have probably tried each item on their menu at least once it is all excellent .,"{food quality, menu, positive}","{food quality, menu, positive}"
+Green tea creme brulee gets better each time I have it .,"{food quality, Green tea creme brulee, positive}","{food quality, Green tea creme brulee, positive}"
+not too fine thought that you feel uncomfortable and have to dress up .,"{ambience general, null, positive}","{restaurant miscellaneous, null, negative}"
+Atmosphere was nice .,"{ambience general, Atmosphere, positive}","{ambience general, Atmosphere, positive}"
+absolutely fabulous ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+AVOID THE PLACE,"{restaurant general, PLACE, negative}","{restaurant general, PLACE, negative}"
+"To be honest , I 've had better frozen pizza .","{food quality, pizza, negative}","{food quality, frozen pizza, negative}"
+The service was exceptional - sometime there was a feeling that we were served by the army of friendly waiters .,"{service general, waiters, positive};{service general, service, positive}","{service general, service, positive}"
+And they packaged everything nicely so it did n't spill .,"{service general, null, positive}","{food style_options, null, positive}"
+VERY GOOD !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The food is sinful .,"{food quality, food, positive}","{food quality, food, positive}"
+"To start off , approximately 8-10 oz of orange juice will cost you $ 3 .","{drinks prices, orange juice, negative}","{drinks prices, orange juice, negative};{drinks style_options, orange juice, negative}"
+good sake selection .,"{drinks style_options, sake selection, positive}","{drinks style_options, sake selection, positive}"
+"While I could have done without the youth who shared the evening with us , our wonderful server and food made the experience a very positive one .","{service general, server, positive};{restaurant miscellaneous, null, positive};{food quality, food, positive}","{service general, server, positive};{food quality, food, positive};{restaurant miscellaneous, youth, negative}"
+What a find !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Mioposto has a very creative & delicious pizza menu .,"{food style_options, pizza menu, positive};{food quality, pizza menu, positive}","{food style_options, pizza menu, positive};{food quality, pizza menu, positive}"
+"On a recent trip , our waiter was extremely dismissive , while no less than three staff members waited hand-and-foot on a pair of Japanese girls seated nearby .","{service general, waiter, negative}","{service general, waiter, negative};{service general, staff, positive}"
+"i would normally not finish the brocolli when i order these kinds of food but for the first time , every piece was as eventful as the first one ... the scallops and prawns was so fresh and nicely cooked .","{food quality, scallops, positive};{food quality, prawns, positive};{food quality, brocolli, positive}","{food quality, scallops and prawns, positive};{food quality, brocolli, positive}"
+It is n't the cheapest sushi but has been worth it every time .,"{food quality, sushi, positive};{food prices, sushi, neutral}","{food quality, sushi, positive};{food prices, sushi, negative}"
+You never feel icky and stuffed after you eat there .,"{food quality, null, positive}","{restaurant general, null, positive}"
+"As part of a small party of four , our food was dropped off without comment ;","{service general, null, negative}","{service general, null, negative}"
+I hope one day Scooner or Later returns to what it once was .,"{restaurant general, Scooner or Later, negative}","{restaurant general, Scooner or Later, negative}"
+"First off , the food came fast and all together : ) i like that ... i hate the pretentiousness of things coming in one after the other .","{service general, null, positive}","{service general, null, positive}"
+The food was great !,"{food quality, food, positive}","{food quality, food, positive}"
+"If there is a line very day of the week for the entire time a place is open , you know it is great .","{restaurant general, place, positive}","{restaurant miscellaneous, place, positive}"
+The most pleasant surprise was the check that did not exceed my expectations as it always happens in most of the places .,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+"At best , the food was good and definately overpriced .","{food quality, food, positive};{food prices, food, negative}","{food quality, food, negative};{food prices, food, negative}"
+The outside patio area has an abbreviated menu .,"{food style_options, menu, neutral}","{food style_options, menu, neutral}"
+Best Indian food in L.A .,"{food quality, Indian food, positive}","{food quality, Indian food, positive}"
+Cut to the chase - this is amazing !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"The food is not what it once was ( potions have seriously seen downsizing ) prices have gone up , and the service is the worst I have experienced anywhere ( including mainland Europe ) .","{food style_options, potions, negative};{service general, service, negative};{food quality, food, negative};{food prices, food, negative}","{food prices, potions, negative};{service general, service, negative};{food quality, food, negative}"
+Lebanese Food ! Yum !,"{food quality, Lebanese Food, positive}","{food quality, Lebanese Food, positive}"
+the brocollis were so fresh and tasty .,"{food quality, brocollis, positive}","{food quality, brocollis, positive}"
+And they give good quantity for the price .,"{food style_options, null, positive}","{food style_options, quantity, positive};{food prices, quantity, positive}"
+Very Disappointing,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Seattle 's BEST Winelist,"{drinks style_options, Winelist, positive}","{drinks style_options, Winelist, positive}"
+– I ca n't say enough about this place .,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+– i have been eating at this place for over 8 years now and i have never had one bad meal .,"{food quality, meal, positive}","{food quality, meal, positive}"
+I went home & looked them up online again where I discovered there is a link for a give away that doesn 't work so emailed the restaurant about the non existent service & deceptive link .,"{restaurant miscellaneous, restaurant, negative}","{restaurant miscellaneous, null, negative}"
+Fancy pieces of exotic fish on a $ 100 dollar plate and NOT ONE was eatable .,"{food quality, exotic fish, negative};{food style_options, exotic fish, negative};{food prices, plate, negative}","{food quality, plate, negative};{food style_options, plate, negative};{food style_options, fish, positive}"
+"I had yummy lamb korma , saag paneer , samosas , naan , etc .","{food quality, naan, positive};{food quality, lamb korma, positive};{food quality, saag paneer, positive};{food quality, samosas, positive}","{food quality, lamb korma, positive};{food quality, naan, positive};{food quality, samosas, positive};{food quality, saag paneer, positive}"
+Serves really good sushi .,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"As usual the omikase did n't disappoint in freshness , although it scored low on creativity and selection .","{food style_options, omikase, negative};{food quality, omikase, positive}","{food quality, omikase, positive};{food style_options, omikase, negative};{food style_options, omikase, negative}"
+"Rice is too dry , tuna was n't so fresh either .","{food quality, tuna, negative};{food quality, Rice, negative}","{food quality, Rice, negative};{food quality, tuna, negative}"
+Their crab eggs benedict is addicting .,"{food quality, crab eggs benedict, positive}","{food quality, crab eggs benedict, positive}"
+Save room for scrumptious desserts .,"{food quality, desserts, positive}","{food quality, desserts, positive}"
+Our server was very professional and friendly .,"{service general, server, positive}","{service general, server, positive}"
+I went here on a recommendation and will surely return time and time again .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The food was all good but it was way too mild .,"{food quality, food, negative};{food quality, food, positive}","{food quality, food, negative}"
+– My husband and I love eating at Mioposto Café .,"{restaurant general, Mioposto Café, positive}","{restaurant general, Mioposto Café, positive}"
+– This was great dining experience .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The staff was really friendly .,"{service general, staff, positive}","{service general, staff, positive}"
+We easily spent more than $ 40 per person ( not including alcohol ) and were still hungry .,"{restaurant prices, null, negative};{food style_options, null, negative}","{food prices, null, negative};{food quality, null, negative}"
+This is right up there with places in Tokyo as far as the freshness is concerned .,"{food quality, null, positive}","{food quality, null, positive}"
+Groovy music made the dinner casual .,"{ambience general, music, positive}","{ambience general, music, positive}"
+"After one member of our party had been bumped repeatedly by a waitress , a polite request that he not be bumped sent the waitress into an abusive rant .","{service general, waitress, negative}","{service general, waitress, negative}"
+– Ray 's ( suprisingly ) has the city 's BEST & most diverse wine list .,"{drinks style_options, wine list, positive}","{drinks style_options, wine list, positive}"
+I probably wouldn 't go back though 'cuz I do n't know if it 's worth it .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"The chips and salsa are so yummy , and the prices are fabulous .","{food quality, chips and salsa, positive};{restaurant prices, null, positive}","{restaurant prices, null, positive};{food quality, chips and salsa, positive}"
+"The sommelier is fantastic , down-to-earth , & extremely knowlegable .","{service general, sommelier, positive}","{service general, sommelier, positive}"
+big thick pepperoni,"{food style_options, pepperoni, positive}","{food quality, pepperoni, positive}"
+It is not worth going at all and spend your money there ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Insultingly Overpriced,"{restaurant prices, null, negative}","{restaurant prices, null, negative}"
+Indoor ambience was modern .,"{ambience general, Indoor ambience, positive}","{ambience general, Indoor ambience, positive}"
+DONOT GO !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Untill this happens , my advice is to STAY AWAY .","{restaurant general, null, negative}","{restaurant general, null, negative}"
+Oh I forgot to mention that they do n't have bread service .,"{service general, null, negative}","{service general, null, negative}"
+They are not greasy or anything .,"{food quality, null, positive}","{food quality, null, positive}"
+"The music is great , no night better or worse , the bar tenders are generous with the pouring , and the lighthearted atmosphere will lifts you spirits .","{ambience general, atmosphere, positive};{ambience general, music, positive};{drinks style_options, bar tenders, positive}","{ambience general, atmosphere, positive};{drinks style_options, bar tenders, positive};{ambience general, music, positive}"
+"Nice ambience , but highly overrated place .","{ambience general, ambience, positive};{restaurant general, place, negative}","{ambience general, ambience, positive};{restaurant general, place, negative}"
+The sushi here is delicious !,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"Dinners have always been excellent , in terms of food quality .","{food quality, Dinners, positive}","{food quality, Dinners, positive}"
+Their apps are all delicious .,"{food quality, apps, positive}","{food quality, apps, positive}"
+Blue Ribbon lives up to it 's fantastic reputation .,"{restaurant general, Blue Ribbon, positive}","{restaurant general, Blue Ribbon, positive}"
+I felt ackward and next time went to the casino bathroom .,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+– I decided to eat at Stack because of their price fixed pre-show dinner .,"{food prices, price fixed pre-show dinner, neutral}","{restaurant prices, Stack, positive}"
+– I took my parents here for their anniversary-very very disappointed ! ! !,"{restaurant general, null, negative}","{restaurant miscellaneous, null, negative}"
+Unbeatable sushi !,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"To start things off , our lovely server Brooke was quickly on hand to take my drink order .","{service general, Brooke, positive}","{service general, server Brooke, positive}"
+Every time `` 0-sixtynine `` is called the bartender buys everyone drinks !,"{service general, bartender, positive}","{service general, bartender, positive}"
+"Endless fun , awesome music , great staff ! ! !","{restaurant general, null, positive};{ambience general, music, positive};{service general, staff, positive}","{ambience general, music, positive};{service general, staff, positive};{restaurant general, null, positive}"
+Fair menu selection .,"{food style_options, menu selection, neutral}","{food style_options, menu selection, neutral}"
+Two rascally kids were seated near us for the first part of our dinner ... they were replaced by a delightful preteen who pretended to gag every time seafood was mentioned at her table .,"{restaurant miscellaneous, null, negative}","{service general, null, positive}"
+I rejected it because in the process of attempting to fix the eggs they broke something else in the dish and I was too frustrated to continue .,"{food quality, dish, negative}","{food quality, dish, negative}"
+had many dishes but the BEST was the lobster 3 ways .,"{food quality, lobster 3 ways, positive}","{food quality, lobster 3 ways, positive}"
+"The appetizer was interesting , but the Creme Brulee was very savory and delicious .","{food quality, Creme Brulee, positive};{food quality, appetizer, positive}","{food quality, Creme Brulee, positive};{food quality, appetizer, positive}"
+The decor was beautiful and unique .,"{ambience general, decor, positive}","{ambience general, decor, positive}"
+"It 's fresh , welcoming , delicious , and relaxing .","{food quality, null, positive};{ambience general, null, positive}","{ambience general, null, positive};{food quality, null, positive}"
+Addicting !,"{restaurant general, null, positive}","{food quality, null, positive}"
+"Even the chickpeas , which I normally find too dry , were good .","{food quality, chickpeas, positive}","{food quality, chickpeas, positive}"
+This place rocks ! !,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+"That 's a huge compliment , especially in the fickled restaurant business , ... enough already !","{restaurant general, null, positive}","{restaurant general, null, positive}"
+After sitting there with my empty glass for over 20 minutes I left .,"{service general, null, negative}","{service general, null, negative}"
+Be sure to try the oyster roll .,"{food quality, oyster roll, positive}","{food quality, oyster roll, positive}"
+I 'm astonished that this restaurant is categorized as $ $ $ rather than $ $ $ $ .,"{restaurant prices, restaurant, negative}","{restaurant prices, restaurant, negative}"
+It was decent but nothing exceptional .,"{food quality, null, neutral}","{food quality, null, neutral}"
+"Service was kind of slow , our waitress took forever to give us our check even though it was n't that busy .","{service general, Service, negative};{service general, waitress, negative}","{service general, waitress, negative};{service general, Service, negative}"
+"– Great drinks , corn beef hash , coffee , B Fast burritos , Gluten Free menu .","{food quality, B Fast burritos, positive};{food style_options, menu, positive};{drinks quality, drinks, positive};{food quality, corn beef hash, positive};{drinks quality, coffee, positive}","{food quality, corn beef hash, positive};{food style_options, Gluten Free menu, positive};{drinks quality, drinks, positive};{food style_options, Fast burritos, positive};{drinks quality, coffee, positive}"
+The lunch menu is an awesome deal !,"{food prices, lunch menu, positive}","{food prices, lunch menu, positive}"
+"Took forever to get our order taken , water refills were too much to ask for and the only time she was fast was when we asked for our bill when we could get her attention .","{service general, null, negative}","{service general, null, negative}"
+The waiter was a bit unfriendly and the feel of the restaurant was crowded .,"{service general, waiter, negative};{ambience general, feel, negative}","{service general, waiter, negative};{ambience general, restaurant, negative}"
+– I recently had the pleasure of dining as this delightful restaurant on 2nd street and wow what a great evening we had .,"{restaurant general, restaurant, positive}","{restaurant general, restaurant on 2nd street, positive}"
+"The specialty here is decadent pancakes , but I 've been back now four times , and I 've been wowed every time .","{food quality, pancakes, positive}","{food quality, pancakes, positive}"
+– Pretty cheap for sit down Mexican AND downtown .,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant prices, null, positive}"
+"The appetizer of oysters , lobster , crab ( small size ) made a perfect entre for my wife .","{food quality, appetizer of oysters , lobster , crab ( small size ), positive}","{food quality, appetizer of oysters, lobster, crab ( small size ), positive}"
+I just found out that you can have the place to yourself on nights and weekends for a private party - ca n't wait to celebrate my next birthday there .,"{restaurant miscellaneous, place, positive}","{restaurant miscellaneous, place, positive}"
+"– As with most restaurants in Seattle , Mioposto 's service was bad and the food was overpriced .","{service general, service, negative};{food prices, food, negative}","{service general, service, negative};{food prices, food, negative};{food quality, food, negative}"
+You can easily hear him though so it was a pleasant sound and not overbearing .,"{ambience general, null, positive}","{service general, null, positive}"
+Just go there and see for yourself .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+It 's a great little place with tons of potential to be a neighborhood joint if the service were n't so impersonal and corporate-like .,"{restaurant general, place, positive};{service general, service, negative}","{restaurant general, place, positive};{service general, service, negative}"
+"Brunch at Murphy 's is to die for , my specialty ... egg white omelet , the food is always freshly prepared .","{food quality, egg white omelet, positive};{food quality, Brunch, positive};{food quality, food, positive}","{food quality, egg white omelet, positive};{food quality, food, positive}"
+Mama Mia – I live in the neighborhood and feel lucky to live by such a great pizza place .,"{restaurant general, pizza place, positive}","{restaurant general, pizza place, positive}"
+– tucked away over by the Beverly Center .,"{location general, null, neutral}","{location general, null, neutral}"
+The staff is pretty friendly .,"{service general, staff, positive}","{service general, staff, positive}"
+And the service was simply spendid - quite a delight .,"{service general, service, positive}","{service general, service, positive}"
+Ok ... – Maybe I went in on someone 's bad day ...,"{restaurant general, null, negative}","{service general, null, negative}"
+"I 've had the Jellyfish , Horse Mackerel , Blue Fin Tuna and the Sake Ikura roll among others , and they were all good .","{food quality, Horse Mackerel, positive};{food quality, Jellyfish, positive};{food quality, Blue Fin Tuna, positive};{food quality, Sake Ikura roll, positive}","{food quality, null, positive};{food quality, Blue Fin Tuna, positive};{food quality, Horse Mackerel, positive};{food quality, Sake Ikura roll, positive};{food quality, Jellyfish, positive}"
+WHAT ELSE CAN YOU SAY NICE PEOPLE AMAZING FOOD WOW,"{food quality, FOOD, positive};{service general, PEOPLE, positive}","{restaurant general, null, positive};{service general, people, positive};{food quality, FOOD, positive}"
+Always good .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+My mouth felt very dry afterwards and I had that signature ? MSG ? taste lingering in my throat after I left the restaurant .,"{food quality, null, negative}","{food quality, null, negative}"
+"Oh yeah ... the view was good , too .","{location general, view, positive}","{location general, view, positive}"
+"The manager continually interrupted with `` Is there anything else I can do for you ? `` , a strange comment because she had hardly listened , let alone responded to our expression of disappointment at our experience .","{service general, manager, negative}","{service general, manager, negative}"
+The service ranges from mediocre to offensive .,"{service general, service, negative}","{service general, service, negative}"
+Fresh ingrediants and super tasty .,"{food quality, null, positive};{food quality, ingrediants, positive}","{food quality, ingrediants, positive}"
+the ambiance of the restaurant was nice and good for fine dinning .,"{ambience general, ambiance, positive}","{ambience general, ambiance of the restaurant, positive}"
+And the upstairs is a great place to hang out .,"{ambience general, upstairs, positive}","{ambience general, upstairs, positive}"
+– Not bad .,"{restaurant general, null, neutral}","{restaurant general, null, neutral}"
+I had the Kafta plate and it was perfect .,"{food quality, Kafta plate, positive}","{food quality, Kafta plate, positive}"
+– This place is famous for their breakfast .,"{food quality, breakfast, positive}","{restaurant miscellaneous, place, neutral}"
+Waited 35 minutes for a table for 8 which was ok for such a big crowd .,"{service general, null, neutral}","{service general, null, neutral}"
+The entire staff was extremely accomodating and tended to my every need .,"{service general, staff, positive}","{service general, staff, positive}"
+"There was a really nice vibe about the place ... good music , atmosphere and happy looking people .","{ambience general, atmosphere, positive};{ambience general, vibe, positive};{restaurant miscellaneous, people, positive};{ambience general, music, positive}","{ambience general, atmosphere, positive};{ambience general, music, positive};{restaurant miscellaneous, place, positive}"
+Try the Chef 's Choice for sushi as the smoked yellowtail was incredible and the rolls were also tasty .,"{food quality, rolls, positive};{food quality, smoked yellowtail, positive}","{food quality, rolls, positive};{food quality, smoked yellowtail, positive};{food quality, Chef's Choice, positive}"
+"The sushi is as fresh as it comes ? you 'd think ocean was in their backyard , no joke !","{food quality, sushi, positive}","{food quality, sushi, positive}"
+"food was fine , with a some little-tastier-than-normal salsa .","{food quality, salsa, positive};{food quality, food, positive}","{food quality, salsa, positive};{food quality, food, positive}"
+"For the finicky sushi eater and those who have sampled the best NYC has to offer , the fish is the freshest and the service is superb .","{food quality, fish, positive};{service general, service, positive}","{food quality, fish, positive};{service general, service, positive}"
+Old Reliable,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+One of the best Sushi place in town .,"{restaurant general, Sushi place, positive}","{food quality, Sushi, positive}"
+"Food wise , its ok but a bit pricey for what you get considering the restaurant is n't a fancy place .","{food quality, Food, neutral};{ambience general, restaurant, neutral};{restaurant prices, restaurant, negative}","{food prices, null, negative};{food quality, null, neutral}"
+"– Love their pizza , especially the mushroom pizza .","{food quality, pizza, positive};{food quality, mushroom pizza, positive}","{food quality, mushroom pizza, positive};{food quality, pizza, positive}"
+They came in their own nifty take out box and with some homemade frosting ; very light and not-too-sweet .,"{food quality, null, positive}","{food quality, frosting, positive};{food style_options, null, positive}"
+Enjoyed the food,"{food quality, food, positive}","{food quality, food, positive}"
+I 've been to this restaurant over a dozen times with no complaints to date .,"{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+"Prefer to order it and pick it up though because I do n't like the servers , one young woman in particular .","{service general, young woman, negative};{service general, servers, negative}","{service general, servers, negative}"
+awesome find,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"It was n't the freshest seafood ever , but the taste and presentation was OK .","{food quality, seafood, neutral};{food style_options, seafood, neutral}","{food quality, seafood, neutral}"
+"However , the value and service are both severely lacking .","{restaurant prices, null, negative};{service general, service, negative}","{restaurant prices, null, negative};{service general, service, negative}"
+In Grammercy/Union Square/East Village this is my neighbors and my favorite spot .,"{restaurant general, spot, positive}","{restaurant general, null, positive}"
+"The side of potatoes is to die for , as is the labne ( yogurt dip ) .","{food quality, labne ( yogurt dip ), positive};{food quality, side of potatoes, positive}","{food quality, labne ( yogurt dip ), positive};{food quality, side of potatoes, positive}"
+AMAZING .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"What a tastly , flaky treat !","{food quality, null, positive}","{food quality, null, positive}"
+"Great food , better Margaritas !","{drinks quality, Margaritas, positive};{food quality, food, positive}","{drinks quality, Margaritas, positive};{food quality, food, positive}"
+The service is really attentive and charming .,"{service general, service, positive}","{service general, service, positive}"
+"Most importantly , we were so excited about the food after seeing the very creative menu .","{food style_options, menu, positive}","{food style_options, menu, positive}"
+A cozy spot for 2,"{ambience general, spot, positive}","{ambience general, spot, positive}"
+"The best thing is , the prices are also quite reasonable .","{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+"She promised to speak to the waitress who had flown off in a rage , but we could hardly take her promise seriously , seeing as she hadn 't bothered to get the waitresses name .","{service general, null, negative}","{service general, null, negative}"
+The chana masala ( garbanzo beans ) are also excellent .,"{food quality, chana masala ( garbanzo beans ), positive}","{food quality, chana masala ( garbanzo beans ), positive}"
+"This establishment really made a marked decline after ( and this is recurring story ) the airing of FOOD TELEVISIONS `` DINERS , DRIVE-INS , AND DIVES `` hosted by Guy Fieri , in which Schooner or Later was subject of .","{restaurant general, establishment, negative}","{restaurant miscellaneous, Schooner or Later, negative}"
+I love Dungeness crabs and at Ray 's you can get them served in about 6 different ways !,"{food style_options, Dungeness crabs, positive}","{food style_options, Dungeness crabs, positive}"
+Food was good and appetizing .,"{food quality, Food, positive}","{food quality, Food, positive}"
+It was absolutely amazing .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+This is a great place to get a delicious meal .,"{food quality, meal, positive}","{food quality, meal, positive}"
+"plus , i am allergic to rice , and the waitstaff was unbelievably accomodating -- did n't even bat an eye !","{service general, waitstaff, positive}","{service general, waitstaff, positive}"
+– I was highly disappointed in the food at Pagoda .,"{food quality, food, negative}","{food quality, food, negative}"
+Overpriced,"{restaurant prices, null, negative}","{food prices, null, negative}"
+This is sad for what once was one of the best places you could ever eat .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Once you 're inside , the real experience begins .","{restaurant general, null, positive}","{restaurant general, null, positive}"
+and the waiter suggested a perfect sake ! !,"{drinks quality, sake, positive}","{drinks quality, sake, positive}"
+The owner is belligerent to guests that have a complaint .,"{service general, owner, negative}","{service general, owner, negative}"
+"Everything you want and more , very fresh .","{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive}"
+My friend enjoyed the grilled Alaskan King Salmon with delectable creamed Washington russet potatoes and crisp green beans .,"{food quality, green beans, positive};{food quality, creamed Washington russet potatoes, positive};{food quality, grilled Alaskan King Salmon, positive}","{food quality, grilled Alaskan King Salmon, positive};{food quality, creamed Washington russet potatoes, positive};{food quality, green beans, positive}"
+"The food was very good , filet mignon was probably the best I 've ever try .","{food quality, filet mignon, positive};{food quality, food, positive}","{food quality, filet mignon, positive};{food quality, food, positive}"
+"– Mercedes restaurant is so tasty , the service is undeniably awesome !","{food quality, null, positive};{service general, service, positive}","{restaurant general, Mercedes restaurant, positive};{service general, service, positive}"
+I can highly recommend their various saag and paneer and korma .,"{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, saag, positive};{food quality, paneer and korma, positive}"
+The food is great and they make a mean bloody mary .,"{drinks quality, bloody mary, positive};{food quality, food, positive}","{drinks quality, bloody mary, positive};{food quality, food, positive}"
+Nice food but no spice !,"{food quality, food, negative};{food quality, food, positive}","{food quality, food, positive}"
+Another plus is the open feel of the restaurant with glass walls on all sides .,"{ambience general, feel, positive}","{ambience general, open feel, positive}"
+Yum !,"{food quality, null, positive}","{food quality, null, positive}"
+"The bathroom itself is very small with two toilets and only one sink , the girl was staying totally on the way hanging out paper towels from the dispenser .","{restaurant miscellaneous, bathroom, negative}","{ambience general, bathroom, negative}"
+Love the enchiladas and chicken soup - and be sure to check out their specials .,"{food quality, enchiladas, positive};{food quality, chicken soup, positive};{food quality, specials, positive}","{food quality, chicken soup, positive};{food quality, enchiladas, positive};{food style_options, specials, positive}"
+The food is simply unforgettable !,"{food quality, food, positive}","{food quality, food, positive}"
+Management should really take notice and train their waitstaff and teach them some proper manners .,"{service general, waitstaff, negative}","{service general, waitstaff, negative}"
+The staff are friendly and the decor was ethic and colorful .,"{ambience general, decor, positive};{service general, staff, positive}","{ambience general, decor, positive};{service general, staff, positive}"
+The best Chuwam Mushi I have ever had .,"{food quality, Chuwam Mushi, positive}","{food quality, Chuwam Mushi, positive}"
+"Portions was just enough for me , but may not be for a big eater .","{food style_options, Portions, neutral}","{food style_options, Portions, neutral}"
+Try the Pizza Ensalata !,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza Ensalata, positive}"
+Still I would recommend this place .,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+"– The sushi here is perfectly good , but for $ 5 a piece , either the slices of fish should be larger , or there should be no pretense that this is a moderately priced restaurant ( even for NYC ) .","{food prices, sushi, negative};{food style_options, sushi, negative};{food quality, sushi, positive};{restaurant prices, restaurant, negative}","{food prices, null, negative};{food quality, sushi, positive};{food style_options, sushi, negative}"
+You are bound to have a very charming time .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"We have since returned and also had a great experience , sampling more small plates and a variety of the beer ( cold and good ) .","{drinks quality, beer, positive};{restaurant general, null, positive}","{drinks quality, beer, positive};{food quality, small plates, positive};{service general, null, positive}"
+Best Sushi in town .,"{food quality, Sushi, positive}","{food quality, Sushi, positive}"
+the staff was very nice and courteous and obviously chinese .,"{service general, staff, positive}","{service general, staff, positive}"
+"We ordered a selection of the small plates , and the shoe string onions , goat cheese pizza , grilled asparagus and fried brie with fruit were all very good .","{food quality, grilled asparagus, positive};{food quality, shoe string onions, positive};{food quality, goat cheese pizza, positive};{food quality, fried brie with fruit, positive}","{food quality, fried brie with fruit, positive};{food quality, grilled asparagus, positive};{food quality, goat cheese pizza, positive};{food quality, shoe string onions, positive};{food quality, small plates, positive}"
+Nice job !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Though , one thing I realized later on was that the restaurant either used MSG or a meat tenderizer on the steak .","{food quality, steak, negative}","{food quality, steak, negative}"
+Great selection of sakes .,"{drinks style_options, selection of sakes, positive}","{drinks style_options, selection of sakes, positive}"
+Kudos to these guys .,"{restaurant general, null, positive}","{restaurant general, guys, positive}"
+Unless you are just stopping in for a few drinks I wouldn 't recommend going here .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Great bottle of wine .,"{drinks quality, bottle of wine, positive}","{drinks quality, bottle of wine, positive}"
+The open sesame combo plate is a bargain for the heap of food given .,"{food style_options, open sesame combo plate, positive};{food prices, open sesame combo plate, positive}","{food prices, open sesame combo plate, positive};{food style_options, open sesame combo plate, positive}"
+WAY OVER-RATED ! ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Worth the wait,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Doesn 't get any better than that .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+best honey walnyt prawns that we have every tasted .,"{food quality, honey walnyt prawns, positive}","{food quality, honey walnyt prawns, positive}"
+They have been featured on the food network and they deserve it .,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+I love the warm & cosy environment .,"{ambience general, environment, positive}","{ambience general, environment, positive}"
+Snotty Attitude,"{service general, null, negative}","{service general, Attitude, negative}"
+"The atmosphere is aspiring , and the decor is festive and amazing ...","{ambience general, decor, positive};{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive};{ambience general, decor, positive}"
+"Their specialty rolls are impressive , though I ca n't remember what we had .","{food quality, specialty rolls, positive}","{food quality, specialty rolls, positive}"
+– I loved the pumpkin ravioli and the goat cheese gnocchi ( 5 big ones to a plate instead of 20 or so little gnocchis ) and my sister loved her filet mignon on top of spinach and mashed potatoes .,"{food quality, filet mignon on top of spinach and mashed potatoes, positive};{food quality, pumpkin ravioli, positive};{food quality, goat cheese gnocchi, positive};{food style_options, goat cheese gnocchi, positive}","{food quality, pumpkin ravioli, positive};{food style_options, goat cheese gnocchi, positive};{food quality, filet mignon on top of spinach and mashed potatoes, positive}"
+Not the biggest portions but adequate .,"{food style_options, portions, neutral}","{food style_options, portions, neutral}"
+"Go with some friends , wait the half hour or so with a cup of joe , and enjoy more than your average breakfast .","{restaurant general, null, positive};{food quality, breakfast, positive}","{restaurant general, null, positive}"
+great service .,"{service general, service, positive}","{service general, service, positive}"
+We were then charged for their most expensive sake ( $ 20 + per serving ) when we in fact drank a sake of less than half that price .,"{service general, null, negative}","{drinks prices, sake, negative};{service general, null, negative}"
+Delicious,"{food quality, null, positive}","{food quality, null, positive}"
+The chicken curry and chicken tikka masala are my favorite meat dishes .,"{food quality, chicken curry, positive};{food quality, chicken tikka masala, positive}","{food quality, chicken curry, positive};{food quality, chicken tikka masala, positive}"
+"best restaurant in the world , great decor , great customer service , friendly manager","{ambience general, decor, positive};{service general, manager, positive};{service general, customer service, positive};{restaurant general, restaurant, positive}","{ambience general, decor, positive};{restaurant general, restaurant, positive};{service general, manager, positive};{service general, customer service, positive}"
+Drinks were good .,"{drinks quality, Drinks, positive}","{drinks quality, Drinks, positive}"
+"The presentation of the food was an added bonus , it looked just as great as it tasted !","{food quality, food, positive};{food style_options, food, positive}","{food style_options, presentation of the food, positive}"
+"Even then , the order was not correct and we were still waiting for a couple items .","{service general, null, negative}","{service general, null, negative}"
+– We were treated very rudely here one time for breakfast .,"{service general, null, negative}","{service general, null, negative}"
+"Great food , spectacular location , and friendly service keep us coming back year after year .","{service general, service, positive};{food quality, food, positive};{location general, location, positive}","{location general, location, positive};{service general, service, positive};{food quality, food, positive}"
+WOW ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Save yourself the waste of time & DO NOT visit .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Food was good and cheap .,"{food quality, Food, positive};{food prices, Food, positive}","{food quality, Food, positive};{food prices, Food, positive}"
+Mmm ... good !,"{restaurant general, null, positive}","{food quality, null, positive}"
+Its great if you spent the day there and did n't want to drive to eat .,"{location general, null, positive}","{restaurant miscellaneous, null, positive}"
+Great value sushi with high quality & nice setting .,"{ambience general, setting, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{ambience general, setting, positive};{food quality, sushi, positive};{food prices, sushi, positive}"
+"It was so much though that I could barely finish but I did , since it was delicious .","{food style_options, null, neutral};{food quality, null, positive}","{food style_options, null, neutral};{food quality, null, positive}"
+I love this restaurant,"{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Not recommanded ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+We stood there for 10 minutes while employees walked back and forth ignoring us .,"{service general, employees, negative}","{service general, employees, negative}"
+My g/f and I both agreed the food was very mediocre especially considering the price .,"{food quality, food, negative};{food prices, food, negative}","{food quality, food, negative};{food prices, food, negative}"
+"– The food is here is incredible , though the quality is inconsistent during lunch .","{food quality, food, positive};{food quality, lunch, negative}","{food quality, food, negative};{food quality, food, positive}"
+I have not a bad thing to say about this place .,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+"the only problem is you really have to warm up the pizza before it 's edible , even when you order ahead .","{food quality, pizza, negative}","{food quality, pizza, negative}"
+– This is my `` must bring out of town guests to `` restaurant and they always enjoy and rave about it .,"{restaurant general, restaurant, positive}","{restaurant miscellaneous, restaurant, positive}"
+I had the kafta plate and I enjoyed it .,"{food quality, kafta plate, positive}","{food quality, kafta plate, positive}"
+It was clear he didn ’ t really care .,"{service general, null, negative}","{service general, null, negative}"
+The Caesar salad I ordered had so much lemon I could n't eat it .,"{food quality, Caesar salad, negative}","{food quality, Caesar salad, negative}"
+"Our server continued to be attentive throughout the night , but I did remain puzzled by one issue : Who thinks that Ray 's is an appropriate place to take young children for dinner ?","{service general, server, positive}","{restaurant miscellaneous, Ray's, negative};{service general, server, positive}"
+"Good Food , Great Service , Average Prices ( For the Strip )","{service general, Service, positive};{food quality, Food, positive};{restaurant prices, null, neutral}","{restaurant prices, null, neutral};{service general, Service, positive};{food quality, Food, positive}"
+6pm on a Sat before a Broadway play and we were quickly seated and served .,"{service general, null, positive}","{service general, null, positive}"
+They pay such detail to everything from miso soup to complex rolls .,"{food quality, rolls, positive};{food quality, miso soup, positive}","{food quality, miso soup, positive};{food quality, rolls, positive}"
+$ 6 with tip .,"{restaurant prices, null, positive}","{service general, null, neutral}"
+The atmosphere was great .,"{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive}"
+"In other words , if they aren 't making $ $ off of you then you do n't rate high on their 'service scale ' .","{service general, service, negative}","{service general, service scale, negative}"
+– I really enjoyed my meal here .,"{food quality, meal, positive}","{food quality, meal, positive}"
+"The music playing was very hip , 20-30 something pop music , but the subwoofer to the sound system was located under my seat , which became annoying midway through dinner .","{ambience general, subwoofer to the sound system, negative};{ambience general, music, positive}","{ambience general, music, positive};{ambience general, subwoofer, negative}"
+Holy Hummus !,"{food quality, Hummus, positive}","{food quality, Hummus, positive}"
+"For my entr & eacute ; e , I completely enjoyed the seared Alaskan sea scallops complemented by chard , artichoke hearts , fennel , and pecorino toscano .","{food quality, seared Alaskan sea scallops, positive};{food style_options, seared Alaskan sea scallops, positive}","{food quality, seared Alaskan sea scallops, positive}"
+"The decor is rustic , traditional Japanese .","{ambience general, decor, neutral}","{ambience general, decor, positive}"
+"Not only can the selection be innovative , but there 's a nice balance of traditional sushi as well .","{food style_options, selection, positive};{food style_options, sushi, positive}","{food style_options, selection, positive};{food quality, traditional sushi, positive}"
+You are likely to be disappointed .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"The food is great , the bartenders go that extra mile .","{service general, bartenders, positive};{food quality, food, positive}","{service general, bartenders, positive};{food quality, food, positive}"
+The restaurant offers an extensive wine list and an ambiance you wo n't forget !,"{drinks style_options, wine list, positive};{ambience general, ambiance, positive}","{drinks style_options, wine list, positive};{ambience general, ambiance, positive}"
+"The naan was some of the best I 've had and I really enjoyed the bhartha , not too tomatoey .","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, bhartha, positive};{food quality, naan, positive}"
+To the owners of Open Sesame ... Bravo ... I ca n't wait to come back to dine at your restaurant !,"{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}"
+"the fish was fresh , though it was cut very thin .","{food style_options, fish, negative};{food quality, fish, positive}","{food quality, fish, positive};{food style_options, fish, negative}"
+Been there lots since and its always a good time .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+My favortie pizza joint in Seattle,"{restaurant general, pizza joint, positive}","{restaurant general, pizza joint, positive}"
+i highly recommend this place to all that want to try indain food for the first time .,"{food quality, indain food, positive}","{restaurant miscellaneous, place, positive}"
+Overrated,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Worst Service I Ever Had,"{service general, Service, positive}","{service general, Service, negative}"
+As it turns out the owner was seated right next to us and when he came over to check on our problems was very dismissive and offered a token 20 % discount on our bill .,"{service general, owner, negative}","{service general, owner, negative}"
+I went there with some friends one night to play bingo and watch the sox game and it was a blast !,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+COMPLETELY OVER RATED !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"– Eggs , pancakes , potatoes , fresh fruit and yogurt -- everything they serve is delicious .","{food quality, Eggs, positive};{food quality, yogurt, positive};{food quality, null, positive};{food quality, fresh fruit, positive};{food quality, potatoes, positive};{food quality, pancakes, positive}","{food quality, null, positive}"
+– Ray 's is THE place to go for high quality seafood dinners .,"{food quality, seafood dinners, positive}","{restaurant general, Ray's, positive}"
+I also really enjoy the simplicity of the decor and intimate feeling of a small restaurant .,"{ambience general, decor, positive};{ambience general, feeling, positive}","{ambience general, decor, positive};{ambience general, restaurant, positive}"
+We 're going back . : D,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+I should have thought to bring it up but never expected the food to be that mild .,"{food quality, food, negative}","{food quality, food, negative}"
+"When I walked in , I was taken aback by their incredible wood decor .","{ambience general, wood decor, positive}","{ambience general, wood decor, positive}"
+It 's a tiny place so if you get there before 8pm on a weekend ( Thurs ? Sun ) you will find it easier to get a table or a seat at the sushi bar .,"{restaurant miscellaneous, place, neutral}","{restaurant miscellaneous, place, neutral}"
+Best Neighborhood Standby .,"{restaurant general, Standby, positive}","{restaurant general, null, positive}"
+I 'd go back there in a heartbeat .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"It 's *very * reasonably priced , esp for the quality of the food .","{food prices, food, positive}","{food prices, food, positive};{food quality, food, positive}"
+"plenty of food , trust me .","{food style_options, food, positive}","{food style_options, food, positive}"
+It 's the perfect spot for a romantic date for 2 or a secret rendezvous !,"{ambience general, spot, positive};{restaurant miscellaneous, spot, positive}","{ambience general, spot, positive}"
+Also have great margaritas !,"{drinks quality, margaritas, positive}","{drinks quality, margaritas, positive}"
+It 's unpretentious and underground .,"{ambience general, null, positive}","{ambience general, null, neutral}"
+The place is the next best thing to my Moms cooking .,"{food quality, null, positive}","{food quality, place, positive}"
+"The best place for a leisure Sunday breakfast amidst yachts , then take a stroll through the nearby Farmer 's Market .","{restaurant miscellaneous, place, positive}","{restaurant miscellaneous, place, positive}"
+"If you can , come to this place by boat and make it a whole evening .","{restaurant miscellaneous, place, positive}","{restaurant miscellaneous, place, positive}"
+for desert we had the mango ginger creme brulee ... oh la la yummy ! ! !,"{food quality, mango ginger creme brulee, positive}","{food quality, mango ginger creme brulee, positive}"
+"Its worth the wait , especially since they 'll give you a call when the table is ready .","{restaurant general, null, positive}","{service general, null, positive}"
+They have a wide variety of fish and they even list which oceans they come from ; Atlantic or Pacific .,"{food style_options, fish, positive}","{food style_options, null, positive}"
+Well I guess it 's hard to be seated when one is invisible to the staff .,"{service general, staff, negative}","{service general, staff, negative}"
+Great open and friendly ambience .,"{ambience general, ambience, positive}","{ambience general, ambience, positive}"
+A brief conversation with the manager at the end of the meal was the greatest disappointment -- to say we had been `` blown off `` would be an understatement .,"{service general, manager, negative}","{service general, manager, negative}"
+"Ray 's is something of a Seattle institution , but given its gorgeous Sound views , I had suspected that the accolades were more due to the scenery than to the food and service .","{location general, Sound views, positive}","{restaurant miscellaneous, Ray's, neutral};{location general, Sound views, positive}"
+I swore never to return for a warm beer and mediocre meal .,"{drinks quality, beer, negative};{food quality, meal, negative}","{drinks quality, beer, negative};{food quality, meal, negative}"
+"If it 's nice outside , request for a table in the balcony .","{ambience general, balcony, positive}","{ambience general, balcony, positive}"
+Great food with an awesome atmosphere !,"{ambience general, atmosphere, positive};{food quality, food, positive}","{ambience general, atmosphere, positive};{food quality, food, positive}"
+I ended the meal with the unusual dessert of a port and chocolate tasting ... yummy !,"{food quality, dessert of a port and chocolate tasting, positive}","{food quality, port and chocolate tasting, positive}"
+I got the shellfish and shrimp appetizer and it was alright .,"{food quality, shellfish and shrimp appetizer, neutral}","{food quality, shellfish and shrimp appetizer, neutral}"
+The pizza ’ s are thin crust and the menu offers very creative combinations and toppings .,"{food style_options, menu, positive};{food style_options, pizza ’ s, positive}","{food style_options, pizza ’ s, positive};{food style_options, menu, positive}"
+It 's a great place to enjoy food and meet friends .,"{restaurant miscellaneous, place, positive};{food quality, food, positive}","{restaurant miscellaneous, place, positive}"
+"The service was excellent , the coffee was good even by starbucks standards and the food was outstanding .","{service general, service, positive};{food quality, food, positive};{drinks quality, coffee, positive}","{service general, service, positive};{food quality, food, positive};{drinks quality, coffee, positive}"
+This is the place to relax and enjoy the finest quality food the industry can offer .,"{ambience general, place, positive};{food quality, food, positive}","{food quality, food, positive};{ambience general, place, positive}"
+I would go back for the wine experience alone .,"{drinks quality, wine, positive}","{drinks quality, wine experience, positive}"
+The best calamari in Seattle !,"{food quality, calamari, positive}","{food quality, calamari, positive}"
+The presentation of Snooze is excellent and it is one of those places that you feel more sophisticated just for being there ; but peel back the layers and you have an overpriced IHOP with a high brow menu .,"{food style_options, menu, negative};{restaurant prices, Snooze, negative};{ambience general, Snooze, positive}","{ambience general, presentation, positive};{restaurant prices, Snooze, negative};{food style_options, menu, positive}"
+"I complained to the manager , but he was not even apologetic .","{service general, manager, negative}","{service general, manager, negative}"
+Much more than just a great view !,"{location general, view, positive}","{location general, view, positive}"
+The atmosphere was just okay .,"{ambience general, atmosphere, neutral}","{ambience general, atmosphere, neutral}"
+Once seated it took about 30 minutes to finally get the meal .,"{service general, null, negative}","{service general, null, negative}"
+"– In a age of incremental cost cutting in restaurants , its nice to see a place that bucks that trend , and just plain delivers high quality food and good service , period .","{service general, service, positive};{food quality, food, positive}","{restaurant prices, place, positive};{service general, service, positive};{food quality, food, positive}"
+I liked the atmosphere very much but the food was not worth the price .,"{ambience general, atmosphere, positive};{food quality, food, negative};{food prices, food, negative}","{ambience general, atmosphere, positive};{food quality, food, negative};{food prices, food, negative}"
+"It 's located in a strip mall near the Beverly Center , not the greatest location , but the food keeps me coming back for more .","{location general, location, neutral};{food quality, food, positive}","{location general, location, negative};{food quality, food, positive}"
+"On my meal I had to send back my eggs for a simple request of breaking the yokes before cooking , and would have had to send them back again if I hadn 't rejected the meal all together .","{food quality, meal, negative};{food quality, eggs, negative}","{food quality, meal, negative};{service general, null, negative}"
+The band was very good and the service was attentive .,"{service general, service, positive};{ambience general, band, positive}","{ambience general, band, positive};{service general, service, positive}"
+"– How to describe the best sushi in NYC : hmmmm , delicious , amazing , fantastic , suculent , perfect , nah , all of the above .","{food quality, sushi, positive}","{food quality, sushi, positive}"
+"– Schooner or Later 's charming location along the marina in Long Beach and average food does not , unfortunately , compensate for its very poor customer service .","{location general, location along the marina in Long Beach, positive};{service general, customer service, negative};{food quality, food, neutral}","{service general, customer service, negative};{location general, location, positive};{food quality, food, neutral}"
+"We were seated right away , the table was private and nice .","{ambience general, table, positive}","{ambience general, table, positive};{service general, null, positive}"
+"good sake , good food – i honestly do n't know much about japanese food at all .","{drinks quality, sake, positive};{food quality, food, positive}","{drinks quality, sake, positive};{food quality, food, positive}"
+Bring your cell phone cause you may have to wait to get into the best sushi restaurant in the world : BLUE RIBBON SUSHI .,"{restaurant general, BLUE RIBBON SUSHI, positive}","{restaurant general, BLUE RIBBON SUSHI, positive}"
+"In the end our check came to $ 27 for 4 small pancakes , a breakfast burrito , an orange juice and an iced tea ( I had water ) .","{food prices, breakfast burrito, negative};{drinks prices, iced tea, negative};{food style_options, pancakes, negative};{drinks prices, orange juice, negative};{food prices, pancakes, negative}","{food prices, check, negative};{food prices, iced tea, negative};{food prices, orange juice, negative};{food prices, breakfast burrito, negative};{food prices, 4 small pancakes, negative}"
+Good food !,"{food quality, food, positive}","{food quality, food, positive}"
+"The catering is out of this world , and Raouls chicken vegetable soup rocks my world ! ! !","{food quality, Raouls chicken vegetable soup, positive};{food quality, catering, positive}","{food quality, chicken vegetable soup, positive};{service general, catering, positive}"
+I should have just asked for the check when I saw that ; but their menu was so unique that I continued .,"{food style_options, menu, positive}","{food style_options, menu, positive}"
+Great Breakfast,"{food quality, Breakfast, positive}","{food quality, Breakfast, positive}"
+Seabass on lobster risotto was the best .,"{food quality, Seabass on lobster risotto, positive}","{food quality, Seabass on lobster risotto, positive}"
+– The atmosphere is great for any special occasion you might want to celebrate .,"{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive}"
+"Great seasonal fish and seafood , with a classy waterfront setting .","{food quality, seasonal fish, positive};{ambience general, waterfront setting, positive};{food quality, seafood, positive}","{food quality, seasonal fish and seafood, positive};{ambience general, waterfront setting, positive}"
+The pizza ’ s are not huge and the crust is thin ... keep that in mind when you ’ re ordering .,"{food style_options, pizza ’ s, neutral};{food style_options, crust, neutral}","{food style_options, pizza ’ s, neutral}"
+The only positive thing about Mioposto is the nice location .,"{location general, location, positive}","{location general, location, positive}"
+I appreciate their delivery too .,"{service general, delivery, positive}","{service general, delivery, positive}"
+Very disappointed .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+The pizza is delicious and the salads are fantastic .,"{food quality, pizza, positive};{food quality, salads, positive}","{food quality, pizza, positive};{food quality, salads, positive}"
+Freshest sushi – I love this restaurant .,"{food quality, sushi, positive};{restaurant general, restaurant, positive}","{food quality, sushi, positive}"
+The steak was done to my exact liking ( medium rare ) and was nice and juicy .,"{food quality, steak, positive}","{food quality, steak, positive}"
+"Seriously , you ca n't go wrong , if it is unpretentious local fun you seek .","{ambience general, null, positive}","{restaurant general, null, positive}"
+The owners are great fun and the beer selection is worth staying for .,"{drinks style_options, beer selection, positive};{service general, owners, positive}","{drinks style_options, beer selection, positive};{service general, owners, positive}"
+Great draft and bottle selection and the pizza rocks .,"{food quality, pizza, positive};{drinks style_options, draft and bottle selection, positive}","{drinks style_options, draft and bottle selection, positive};{food quality, pizza, positive}"
+"I guarantee you wo n't be disappointed , there 's also valet parking .","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{restaurant general, null, positive};{service general, null, positive}"
+Late night dinning with exeptional food .,"{food quality, food, positive}","{food quality, food, positive};{restaurant miscellaneous, null, positive}"
+"The portions are big though , so do not order too much .","{food style_options, portions, neutral}","{food style_options, portions, neutral}"
+Service was decent .,"{service general, Service, neutral}","{service general, Service, neutral}"
+Absolutely delicious .,"{food quality, null, positive}","{food quality, null, positive}"
+"Oh , and the cheese fries are awesome !","{food quality, cheese fries, positive}","{food quality, cheese fries, positive}"
+Everyone that sat in the back outside agreed that it was the worst service we had ever received .,"{service general, service, negative}","{service general, service, negative}"
+I may not be a sushi guru but I can tell you that the food here is just okay and that there is not much else to it .,"{food quality, food, negative}","{food quality, food, neutral}"
+"Excellent food , nice ambience , fairly expensive","{ambience general, ambience, positive};{restaurant prices, null, negative};{food quality, food, positive}","{restaurant prices, null, negative};{ambience general, ambience, positive};{food quality, food, positive}"
+"Melt in your mouth nigiri and sashmi , and very tasty rolls too .","{food quality, rolls, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}","{food quality, rolls, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}"
+Finally a meal that you will remember for a long time !,"{food quality, meal, positive}","{food quality, meal, positive}"
+"Best food , phenominal service","{service general, service, positive};{food quality, food, positive}","{service general, service, positive};{food quality, food, positive}"
+I recommend it for a night when you want to splurge ! ( it was a bit expensive ),"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}"
+"While this diner had reasonably good food , the restaurant staff seemed completely indifferent to our presence , and this attitude was reflected in the lack of service .","{service general, restaurant staff, negative};{food quality, food, positive}","{service general, restaurant staff, negative};{food quality, food, positive};{service general, service, negative}"
+No Comparison,"{restaurant general, null, positive}","{restaurant general, null, neutral}"
+"so about the prawns , they were fresh and had a slight crispiness about the batter ... soooo good ... the walnuts were cut in smaller pieces and very crunchy and tasty .","{food quality, batter, positive};{food quality, prawns, positive};{food quality, walnuts, positive}","{food quality, prawns, positive};{food quality, walnuts, positive}"
+I am so happy to have a wonderful Italian restaurant in my neighborhood .,"{restaurant general, Italian restaurant, positive}","{restaurant general, Italian restaurant, positive}"
+We waited for an hour to be seated .,"{service general, null, negative}","{service general, null, negative}"
+"We put in our order and although we ordered 4 appetizers , the food did n't arrive until 45 minutes later ... WITH OUR MAIN COURSE .","{service general, null, negative}","{service general, null, negative}"
+I can not wait to go back again this coming weekend !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"If you 're interested in good tasting ( without the fish taste or smell ) , large portions and creative sushi dishes this is your place ...","{food quality, null, positive};{food style_options, sushi dishes, positive};{food style_options, portions, positive}","{food style_options, portions, positive};{food quality, sushi dishes, positive};{food quality, null, positive}"
+A perfect place to take out of town guests any time of the year .,"{restaurant general, place, positive}","{restaurant miscellaneous, place, positive}"
+"I had a taste of all three items on her plate , and they were superb .","{food quality, plate, positive}","{food quality, items on her plate, positive}"
+Good for late night dining ( last minute planning ) without reservations .,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+i am never disappointed with there food .,"{food quality, food, positive}","{food quality, food, positive}"
+– By far the best bar in the east village ...,"{restaurant general, bar, positive}","{drinks quality, bar, positive}"
+It 's a great place to people watch .,"{restaurant miscellaneous, place, positive}","{ambience general, place, positive}"
+"Space was limited , but the food made up for it .","{restaurant miscellaneous, Space, negative};{food quality, food, positive}","{ambience general, Space, negative};{food quality, food, positive}"
+The scallops are apparently cooked in a black olive butter which really makes them unique ( not to mention tasty ) .,"{food quality, scallops, positive};{food style_options, scallops, positive}","{food quality, scallops, positive};{food style_options, scallops, positive}"
+This place is charming and relaxing .,"{ambience general, place, positive}","{ambience general, place, positive}"
+not chewy at all .,"{food quality, null, positive}","{food quality, null, positive}"
+We were only in Seattle for one night and I 'm so glad we picked Rays for dinner !,"{restaurant general, Rays, positive}","{restaurant general, Rays, positive}"
+"– I will never forget the amazing meal , service , and ambiance I experience at this restaurant .","{ambience general, ambiance, positive};{food quality, meal, positive};{service general, service, positive}","{ambience general, ambiance, positive};{service general, service, positive};{food quality, meal, positive}"
+Amazing Spanish Mackeral special appetizer and perfect box sushi ( that eel with avodcao -- um um um ) .,"{food quality, box sushi, positive};{food quality, Spanish Mackeral special appetizer, positive};{food quality, eel with avodcao, positive}","{food quality, box sushi, positive};{food quality, Spanish Mackeral special appetizer, positive};{food quality, eel with avodcao, positive}"
+"On weekends , you might have to wait for couple hours .","{service general, null, neutral}","{service general, null, negative}"
+– The food was not great & the waiters were rude .,"{food quality, food, negative};{service general, waiters, negative}","{food quality, food, negative};{service general, waiters, negative}"
+"The 9 oz steak came next and it tasted great , at least initially .","{food quality, 9 oz steak, positive}","{food quality, 9 oz steak, positive}"
+When I got there I sat up stairs where the atmosphere was cozy & the service was horrible !,"{ambience general, atmosphere, positive};{service general, service, negative}","{service general, service, negative};{ambience general, atmosphere, positive}"
+"The wine list is incredible and extensive and diverse , the food is all incredible and the staff was all very nice , good at their jobs and cultured .","{drinks style_options, wine list, positive};{service general, staff, positive};{food quality, food, positive}","{service general, staff, positive};{drinks style_options, wine list, positive};{food quality, food, positive}"
+– IT CANT GET ANY BETTER ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Sunday afternoons there is a band playing and it is lots of fun .,"{ambience general, band, positive}","{ambience general, band, positive}"
+"Everything , and I mean everything on the menu is delectable .","{food quality, menu, positive}","{food quality, menu, positive}"
+"I know many people have their favorite types of pizza and pizza places , but Mioposto 's pizza lacks quality and good taste .","{food quality, pizza, negative}","{food quality, pizza, negative}"
+"There is only one place on the east coast that has it all , plus a lot more .","{restaurant general, place, positive}","{restaurant general, place, positive}"
+Always a winner .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The prior reviews said Kid friendly ... give me a break with two young children that is light years .,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+The pizza ’ s are light and scrumptious .,"{food quality, pizza ’ s, positive}","{food quality, pizza ’ s, positive}"
+"Check out the art on the walls , very colorful !","{ambience general, art on the walls, positive}","{ambience general, art on the walls, positive}"
+Mediocre food,"{food quality, food, neutral}","{food quality, food, negative}"
+I will never return again .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+We had a very hard time getting the waitress ' attention and finally had to get up and go inside to speak to a manager .,"{service general, waitress, negative}","{service general, waitress, negative}"
+Never too crowded and always great service .,"{restaurant miscellaneous, null, positive};{service general, service, positive}","{restaurant miscellaneous, null, positive};{service general, service, positive}"
+you are with a hot date and he /she has an urge for sushi ... then this might be the place .,"{food quality, sushi, positive}","{restaurant miscellaneous, place, positive}"
+"Can get busy on Fridays for a table but once seated , the service is so efficient you can be in and out of there quickly .","{service general, service, positive}","{service general, service, positive}"
+"It ? s served with either a peppercorn sauce or red wine reduction , though both were indistinguishable in taste .","{food quality, red wine reduction, neutral};{food quality, peppercorn sauce, neutral}","{food quality, red wine reduction, negative};{food quality, peppercorn sauce, negative}"
+The nicest waiters in town .,"{service general, waiters, positive}","{service general, waiters, positive}"
+The service was courteous and attentive .,"{service general, service, positive}","{service general, service, positive}"
+As of writing this I just tried their give away a link again & it still doesn 't work .,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+any further needs we may have had could not have been met since no one stopped by the table .,"{service general, null, negative}","{service general, null, negative}"
+"Good Sushi , High Price","{food quality, Sushi, positive};{food prices, Sushi, negative}","{food quality, Sushi, positive};{food prices, Sushi, negative}"
+But the servers were extremely attentive and very friendly .,"{service general, servers, positive}","{service general, servers, positive}"
+"I have been to this place , folks and it is BAD .","{restaurant general, place, negative}","{restaurant general, place, negative}"
+great service,"{service general, service, positive}","{service general, service, positive}"
+It was like dining at a completely different restaurant .,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+Two thumbs up !,"{food quality, null, positive}","{restaurant general, null, positive}"
+Imagine my happy surprise upon finding that the views are only the third-best thing about Ray 's !,"{location general, views, positive}","{location general, views, positive}"
+"Hands down , the best tuna I have ever had .","{food quality, tuna, positive}","{food quality, tuna, positive}"
+"If you 're going to see Danny Gans or just staying at the Mirage , do n't miss this one .","{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+great lunch spot,"{restaurant general, lunch spot, positive}","{restaurant general, lunch spot, positive}"
+I love breakfast here .,"{food quality, breakfast, positive}","{food quality, breakfast, positive}"
+The sashimi was the freshest and most tender I have ever tasted .,"{food quality, sashimi, positive}","{food quality, sashimi, positive}"
+You won ’ t be disappointed by their menu .,"{food style_options, menu, positive}","{food quality, menu, positive}"
+"Many people talk about the great pizza and poor service , so it ca n't just be the rantings of a few dissatisfied customers .","{food quality, pizza, positive};{service general, service, negative}","{service general, service, negative};{food quality, pizza, positive}"
+I will not go back .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+my service was stellar !,"{service general, service, positive}","{service general, service, positive}"
+we are for sure coming back to this restaurant .,"{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Will definitely be back .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Maybe it is good for that one night once in a blue moon when the chefs decide to use fish that 's half-way decent .,"{food quality, fish, negative}","{food quality, chefs, positive};{food quality, fish, positive}"
+"– I 've been to Open Sesame only once , but I 'm still reeling from the experience ! !","{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, negative}"
+The pancakes were certainly inventive but $ 8.50 for 3 - 6 `` pancakes ( one of them was more like 5 `` ) in the pancake flight ( sample of 3 different pancakes ) is well over-priced .,"{food prices, pancakes, negative};{food style_options, pancakes, positive}","{food style_options, pancake flight ( sample of 3 different pancakes ), negative};{food prices, pancake flight ( sample of 3 different pancakes ), negative};{food quality, pancakes, positive}"
+"HOWEVER , one Sunday afternoon my husband and I did go ( although with my loud protests ) and were pleasantly surprised .","{restaurant general, null, positive}","{restaurant general, null, positive}"
+Well worth it,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Caution - its real food for people who love the best .,"{food quality, food, positive}","{food quality, food, positive}"
+I have a but here - there was a bathroom attendant in the restroom which was odd .,"{restaurant miscellaneous, restroom, negative}","{ambience general, bathroom attendant, negative}"
+The best dish are the honwy walnut prawns -- just outstanding .,"{food quality, honwy walnut prawns, positive}","{food quality, honwy walnut prawns, positive}"
+The pancakes should be larger ( at least 8 `` ) to justify the expense even with the unique offerings .,"{food style_options, pancakes, negative}","{food style_options, pancakes, negative};{food quality, offerings, positive};{food prices, pancakes, negative}"
+– My first time to dine at this restaurant was with my son and it was absolutely horrible !,"{restaurant general, restaurant, negative}","{restaurant general, restaurant, negative}"
+Excellent,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Parking is reasonably good , they have their own lot and you can park in the park nearby .","{restaurant miscellaneous, null, positive}","{parking general, null, positive};{parking general, lot, positive}"
+Caesar salad was superb .,"{food quality, Caesar salad, positive}","{food quality, Caesar salad, positive}"
+"– I do n't understand how I was a stranger to this place for so long ... the fajita salad , the colorado , the fajitas - EVERYTHING is delicious .","{food quality, colorado, positive};{food quality, fajitas, positive};{food quality, fajita salad, positive}","{food quality, fajitas, positive};{food quality, colorado, positive};{food quality, fajita salad, positive};{restaurant general, place, positive}"
+best chinese food i have tasted in a long time,"{food quality, chinese food, positive}","{food quality, chinese food, positive}"
+The price was right too .,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+Delicious ... !,"{food quality, null, positive}","{food quality, null, positive}"
+We put out name down and although there were open tables we were told that it 'd be a 30 minute wait .,"{service general, null, negative}","{service general, null, negative}"
+"The coffe is very good , too .","{drinks quality, coffe, positive}","{drinks quality, coffe, positive}"
+We waited over 30 minutes for our drinks and over 1 1 /2 hours for our food .,"{service general, null, negative}","{service general, null, negative}"
+The servers behind the counter are always friendly and helpful .,"{service general, servers behind the counter, positive}","{service general, servers, positive}"
+"Our waiter was non-existent and after our food finally arrived over an hour after we ordered , we were not given any water or utensils .","{service general, waiter, negative}","{service general, waiter, negative};{service general, null, negative};{service general, null, negative}"
+– This place is unbelievably over-rated .,"{restaurant general, place, negative}","{restaurant general, place, negative}"
+Very poor customer service .,"{service general, customer service, negative}","{service general, customer service, negative}"
+We ’ re can ’ t say enough about their delicious gourmet pizza ’ s !,"{food quality, pizza ’ s, positive}","{food quality, gourmet pizza ’ s, positive}"
+"Furthermore , while the fish is unquestionably fresh , rolls tend to be inexplicably bland .","{food quality, rolls, negative};{food quality, fish, positive}","{food quality, rolls, negative};{food quality, fish, positive}"
+The only drawback is the crowded seating and the slow service .,"{restaurant miscellaneous, seating, negative};{service general, service, negative}","{ambience general, seating, negative};{service general, service, negative}"
+"Not alot of smoking places left in New York , but I have found my favorite smoking balconey in the city .","{restaurant miscellaneous, balconey, positive}","{restaurant miscellaneous, balconey, positive}"
+We shared the family platter and I especially enjoyed the black cod in sake kasu .,"{food quality, black cod in sake kasu, positive}","{food quality, black cod in sake kasu, positive};{food style_options, family platter, positive}"
+"But the space is small and lovely , and the service is helpful .","{service general, service, positive};{ambience general, space, positive}","{ambience general, space, positive};{service general, service, positive}"
+It was worth the wait .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+yummy .,"{food quality, null, positive}","{food quality, null, positive}"
+Delectable,"{food quality, null, positive}","{food quality, null, positive}"
+- Mediocre Service / Quality,"{service general, Service, neutral}","{service general, Service, negative};{food quality, null, negative}"
+"– This is one of my top lunch spots , huge portions , fast service and amazing margaritas ! !","{drinks quality, margaritas, positive};{restaurant general, null, positive};{food style_options, portions, positive};{service general, service, positive}","{food style_options, portions, positive};{drinks quality, margaritas, positive};{service general, service, positive}"
+Best Crab Cakes in Town,"{food quality, Crab Cakes, positive}","{food quality, Crab Cakes, positive}"
+"Everything I 've had here is good , taco salads , burritos , enchiladas i love this place .","{food quality, null, positive};{food quality, taco salads, positive};{restaurant general, place, positive};{food quality, burritos, positive};{food quality, enchiladas, positive}","{restaurant general, place, positive};{food quality, taco salads, positive};{food quality, burritos, positive};{food quality, enchiladas, positive}"
+"Great Pizza , Poor Service","{service general, Service, negative};{food quality, Pizza, positive}","{food quality, Pizza, positive};{service general, Service, negative}"
+splendid,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+My best friend had the chicken shawarma and she STILL raves about it being the best anywhere !,"{food quality, chicken shawarma, positive}","{food quality, chicken shawarma, positive}"
+Chintzy portions,"{food style_options, portions, negative}","{food style_options, portions, negative}"
+Good eats .,"{food quality, eats, positive}","{food quality, eats, positive}"
+"Normally , places ask how hot you want it , but they did n't .","{service general, null, negative}","{service general, null, negative}"
+"I 've always found the wait staff and , if you sit at the bar , the cooks very friendly .","{service general, cooks, positive}","{service general, wait staff, positive};{service general, cooks, positive}"
+Nothing on the menu is less than amazing .,"{food quality, menu, positive}","{food quality, menu, positive}"
+"My party of two was feeling particularly ambitious , and we splurged on the Shilshole Sampler ... a beautiful assortment of enormous white gulf prawns , smoked albacore tuna , Ray 's fantastic manila clams seasoned with dill , scallops in a tasty soy dressing , and a tiny pile of Dungeness crab atop a sublime butter sauce .","{food style_options, white gulf prawns, positive};{food quality, butter sauce, positive};{food quality, soy dressing, positive};{food style_options, Shilshole Sampler, positive};{food quality, manila clams, positive}","{food quality, Shilshole Sampler, positive};{food style_options, Shilshole Sampler, positive};{food prices, Shilshole Sampler, negative};{food quality, scallops in a tasty soy dressing, positive};{food quality, white gulf prawns, positive};{food quality, Dungeness crab, positive};{food quality, smoked albacore tuna, positive};{food quality, manila clams seasoned with dill, positive}"
+"I was frankly shocked when I read the bad reviews - this place is fantastic ; it has not let us down in any way , and we 've eaten here more than 10 times .","{restaurant general, place, positive}","{restaurant general, place, positive}"
+"Your a sushi fan , you love expertly cut fish , great sake , a killer SOHO location , and of course : Salmon , Tuna , Fluke , Yellow Tail , Cod , Mackeral , Jellyfish , Sea Urchin , Shrimp , Lobster , Sea Bream , Trout , Milk Fish , Blue Fin Tuna , Eel , Crab , Sardine , Monk Fish , Roe , Scallop , Oysters , and a varity of Toro .","{food quality, sushi, positive};{food style_options, fish, positive};{location general, SOHO location, positive};{food style_options, Toro, positive};{drinks quality, sake, positive}","{food quality, null, positive};{location general, location, positive};{drinks quality, sake, positive};{food style_options, null, positive}"
+The service is fantastic at this fun place .,"{restaurant general, place, positive};{service general, service, positive}","{service general, service, positive};{ambience general, place, positive}"
+"Also , there was only one bathroom stall- probably need more for such big crowds .","{restaurant miscellaneous, bathroom stall, negative}","{ambience general, bathroom stall, negative}"
+We left without ever getting service .,"{service general, service, negative}","{service general, service, negative}"
+I liked it .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– I highly recommend Mioposto .,"{restaurant general, Mioposto, positive}","{restaurant general, Mioposto, positive}"
+"The food is fantastic , authentic , delicious and very , very affordable .","{food quality, food, positive};{food prices, food, positive}","{food quality, food, positive};{food prices, food, positive}"
+I have eaten here three times and have found the quality and variety of the fish to be excellent .,"{food style_options, fish, positive};{food quality, fish, positive}","{food quality, fish, positive};{food style_options, variety of the fish, positive}"
+"But she is very friendly with certain people , making it even more annoying .","{service general, null, negative}","{service general, null, negative}"
+The regular menu here is slightly above average that is not worth the snotty attitude that you receive .,"{food quality, regular menu, neutral};{service general, null, negative}","{food quality, regular menu, neutral};{service general, null, negative}"
+"Also , they serve THE best hummus in America , with a drizzle of fragrant olive oil ( which , I believe is the traditional way ) !","{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive};{food style_options, hummus, positive};{food quality, olive oil, positive}"
+great beer,"{drinks quality, beer, positive}","{drinks quality, beer, positive}"
+Seafood Plus,"{food quality, Seafood, positive}","{restaurant general, Seafood Plus, positive}"
+"it is sad there is not many people who frequent eating at places like these that look pricey because they are at the hotel ... but they are definitely one you dont want to miss , esp if your in downtown san jose .","{restaurant general, null, positive}","{restaurant general, null, positive}"
+"They serve it in a tall , skinny hour-glass shaped glass to disguise the fact that you a getting a small juice at the price of a half gallon in a supermarket .","{drinks style_options, juice, negative};{drinks prices, juice, negative}","{drinks style_options, glass, negative};{drinks prices, null, negative}"
+"The food was ok , but the service was so poor that the food was cold buy the time everyone in my party was served .","{service general, service, negative};{food quality, food, neutral}","{service general, service, negative};{food quality, food, negative}"
+great meal – the fish on the omikase platter was absolutely decadent -- there was none of the stringiness that sometimes accompanies fair sushi -- this fish was perfect ! ! ! !,"{food quality, fish on the omikase platter, positive};{food quality, meal, positive}","{food quality, fish on the omikase platter, positive};{food quality, meal, positive}"
+"Drinks are suberb , and I feel like I am in a Third World country when I walk in the door .","{drinks quality, Drinks, positive};{ambience general, null, positive}","{drinks quality, Drinks, positive};{ambience general, null, positive}"
+Open & Cool Place with the Best Pizza and Coffee,"{food quality, Pizza, positive};{ambience general, Place, positive};{drinks quality, Coffee, positive}","{ambience general, Place, positive};{food quality, Pizza, positive};{drinks quality, Coffee, positive}"
+Green Tea creme brulee is a must !,"{food quality, Green Tea creme brulee, positive}","{food quality, Green Tea creme brulee, positive}"
+I found a new home and just moved with a long lease .,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+"They aren 't the most talkative , but everytime I 've been there they have been very busy , which probably accounts for the lack of conversation .","{service general, null, neutral}","{service general, null, neutral}"
+"The pizza itself is not exactly the best I 've had EVER , but still pretty good .","{food quality, pizza, positive}","{food quality, pizza, positive}"
+"We did have the same waiter the second time , so maybe the service is spotty and our luck is good .","{service general, waiter, positive}","{service general, waiter, positive};{service general, service, negative}"
+– Thats a big statement considering I 've been pulling crab traps and making the cakes myself since I was about seven - but something about these little devils gets better every time .,"{food quality, cakes, positive}","{food quality, crab cakes, positive}"
+Fabulous Italian Food !,"{food quality, Italian Food, positive}","{food quality, Italian Food, positive}"
+"However , this place is a gem , and I wo n't stop going back .","{restaurant general, place, positive}","{restaurant general, place, positive}"
+"it gets really busy , so get there on the early side so you can grab a seat , if you do have to wait , its not bad because the service is quick !","{service general, service, positive}","{service general, service, positive};{ambience general, null, neutral}"
+"The dinner only took us about an hour and the prices were alright for the strip , almost $ 50 /pp after tax and tip ( about average ) .","{restaurant prices, null, neutral}","{restaurant prices, null, neutral};{service general, null, positive}"
+The onion rings are great !,"{food quality, onion rings, positive}","{food quality, onion rings, positive}"
+If you 're in the area you shouldn 't be disappointed .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Great financial district mexican spot .,"{restaurant general, mexican spot, positive}","{restaurant general, mexican spot, positive}"
+The house special roll is really good .,"{food quality, house special roll, positive}","{food quality, house special roll, positive}"
+The waiters are very experienced and helpful with pairing your drink choice to your food tastes or vice versa .,"{service general, waiters, positive}","{service general, waiters, positive}"
+Perfection .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Poor customer service / poor pizza .,"{food quality, pizza, negative};{service general, customer service, negative}","{service general, customer service, negative};{food quality, pizza, negative}"
+"Overall , I would go back and eat at the restaurant again .","{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Server made several sake suggestions which were very good .,"{drinks quality, sake, positive};{service general, Server, positive}","{drinks quality, sake suggestions, positive}"
+My only negative comment is that I wish the pieces were a little bigger .,"{food style_options, pieces, negative}","{food style_options, pieces, negative}"
+"I picked the asparagus , which turned out to be incredible and perfectly prepared .","{food quality, asparagus, positive}","{food quality, asparagus, positive}"
+What may be interesting to most is the worst sevice /attitude comes from the owners of this establishment .,"{service general, owners, negative}","{service general, service /attitude, negative}"
+The only drawback is that this place is really expensive and the portions are on the small side .,"{restaurant prices, place, negative};{food style_options, portions, negative}","{restaurant prices, place, negative};{food style_options, portions, negative}"
+"Terrible service , food ok , pricey","{restaurant prices, null, negative};{service general, service, negative};{food quality, food, neutral}","{service general, service, negative};{food quality, food, neutral};{food prices, food, negative}"
+Although the service could be improved considering the money you put in .,"{service general, service, negative}","{service general, service, negative}"
+"You routinely see Indian families and friends dining there , which is always a good sign .","{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+"If I want to stand in line on Sunday for an hour to get average brunch food , then I would put Murphy 's at the top of the list .","{food quality, brunch food, neutral};{service general, null, negative}","{restaurant general, Murphy's, negative};{food quality, brunch food, negative}"
+For the amount of food we got the prices should have been lower .,"{food prices, food, negative}","{restaurant prices, null, negative}"
+"Always busy , but they are good at seating you promptly and have quick service .","{service general, service, positive};{service general, null, positive}","{service general, service, positive};{ambience general, null, neutral}"
+The wine list is wonderful and the food reminds me of my recent trip to Italy .,"{drinks style_options, wine list, positive}","{drinks style_options, wine list, positive};{food quality, food, positive}"
+"the food was great , the margaritas too but the waitress was too busy being nice to her other larger party than to take better care of my friend and me .","{drinks quality, margaritas, positive};{service general, waitress, negative};{food quality, food, positive}","{service general, waitress, negative};{drinks quality, margaritas, positive};{food quality, food, positive}"
+"I ca n't saybenough good things about this restaurant , and I ca n't wait for my next several visits .","{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Love it every time,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"We are locals , and get the feeling the only way this place survives with such average food is because most customers are probably one-time customer tourists .","{food quality, food, negative}","{restaurant miscellaneous, place, negative};{food quality, food, negative}"
+Also love their caeser salad .,"{food quality, caeser salad, positive}","{food quality, caeser salad, positive}"
+She doesn 't make you feel welcome and treats you like an annoyance .,"{service general, null, negative}","{service general, null, negative}"
+It 's just the right size for the menu .,"{restaurant miscellaneous, null, positive}","{restaurant general, null, positive}"
+"The food is fantastic , and the waiting staff has been perfect every single time we 've been there .","{food quality, food, positive};{service general, waiting staff, positive}","{service general, waiting staff, positive};{food quality, food, positive}"
+The desert was the perfect ending to an almost perfect dinner .,"{food quality, desert, positive};{food quality, dinner, positive}","{food quality, desert, positive}"
+"I have been here , spent tons of money on a chef special dinner and it was a major dissappointment .","{food prices, chef special dinner, negative};{food quality, chef special dinner, negative}","{food quality, chef special dinner, negative};{restaurant prices, null, negative}"
+I FOUND A NEW HOME ON SECOND AVENUE ! ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"– Had to wait thirty minutes to get in the door on a tuesday morning , but it was so worth it .","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive}"
+"– It is sad to see a place that was once `` THE `` place to meet and eat for Bfast or Lunch , now be the place that is a big `` DONT BOTHER . ``","{restaurant general, place, negative}","{restaurant general, place, negative}"
+"The lemon chicken tasted like sticky sweet donuts and the honey walnut prawns , the few they actually give you ... were not good .","{food quality, honey walnut prawns, negative};{food style_options, honey walnut prawns, negative};{food quality, lemon chicken, negative}","{food quality, honey walnut prawns, negative};{food quality, lemon chicken, negative}"
+"It was romantic - and even nice even with my sister , reminded me of Italy , and had artwork and music that kept up the feeling of being in a Mediterrean villa .","{ambience general, artwork, positive};{ambience general, null, positive};{ambience general, music, positive}","{ambience general, null, positive};{ambience general, music, positive};{ambience general, artwork, positive}"
+The sushi was excellent and the wait staff was quick .,"{service general, wait staff, positive};{food quality, sushi, positive}","{service general, wait staff, positive};{food quality, sushi, positive}"
+"In fact , many want to return a second time during their visit .","{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Best Mexican place for lunch in the financial district .,"{restaurant general, Mexican place, positive}","{restaurant general, Mexican place, positive}"
+i love this place !,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+the atmosphere is great .,"{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive}"
+Perfect on a cold day .,"{food quality, null, positive}","{restaurant general, null, positive}"