Upload folder using huggingface_hub

.gitattributes

@@ -52,3 +52,7 @@ experiments/en-pt/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -t
 experiments/de-zh/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 experiments/de-zh/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 experiments/de-zh/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/de-en-pt/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/de-en-pt/checkpoint-1000/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/de-en-pt/checkpoint-1185/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/de-en-pt/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text

experiments/de-en-pt/README.md

@@ -0,0 +1,59 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: transformers
+model_name: de-en-pt
+tags:
+- generated_from_trainer
+- unsloth
+- sft
+- trl
+licence: license
+---
+
+# Model Card for de-en-pt
+
+This model is a fine-tuned version of [unsloth/meta-llama-3.1-8b-instruct-bnb-4bit](https://huggingface.co/unsloth/meta-llama-3.1-8b-instruct-bnb-4bit).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="None", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+ 
+
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.22.2
+- Transformers: 4.56.0
+- Pytorch: 2.8.0+cu129
+- Datasets: 4.3.0
+- Tokenizers: 0.22.0
+
+## Citations
+
+
+
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

experiments/de-en-pt/adapter/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/de-en-pt/adapter/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/de-en-pt/adapter/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3657de91dc2f72e94c5387f18f835d5d86c38aed3e153dffd9209823fb712e1
+size 83945296

experiments/de-en-pt/adapter/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/de-en-pt/adapter/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/de-en-pt/adapter/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/de-en-pt/adapter/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "left",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/de-en-pt/checkpoint-1000/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/de-en-pt/checkpoint-1000/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/de-en-pt/checkpoint-1000/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fec55dba94e02a053588fde70f7fca4c3e32e06fb9bbc5a4081ce5cdb0460187
+size 83945296

experiments/de-en-pt/checkpoint-1000/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/de-en-pt/checkpoint-1000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd879fb8fba78d14d06b9820460dbbc763ad0eae9722d6b46b750ea1319aa600
+size 43123429

experiments/de-en-pt/checkpoint-1000/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d4df901cd4b29f06b39a302b2e14c63bbe00721ba69b250b243cb0e0edeef11e
+size 14645

experiments/de-en-pt/checkpoint-1000/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d8caa70b905d7ef50d82e97de1f8d0171eb7385ba11f39eb2e6ce977d2a42ec6
+size 1465

experiments/de-en-pt/checkpoint-1000/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/de-en-pt/checkpoint-1000/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/de-en-pt/checkpoint-1000/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/de-en-pt/checkpoint-1000/trainer_state.json

@@ -0,0 +1,1434 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 4.219409282700422,
+  "eval_steps": 500,
+  "global_step": 1000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.02109704641350211,
+      "grad_norm": 7.303770542144775,
+      "learning_rate": 0.0002,
+      "loss": 2.7397,
+      "step": 5
+    },
+    {
+      "epoch": 0.04219409282700422,
+      "grad_norm": 1.8467751741409302,
+      "learning_rate": 0.00019915325994919561,
+      "loss": 0.8472,
+      "step": 10
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 1.7855145931243896,
+      "learning_rate": 0.0001983065198983912,
+      "loss": 0.5618,
+      "step": 15
+    },
+    {
+      "epoch": 0.08438818565400844,
+      "grad_norm": 1.1616630554199219,
+      "learning_rate": 0.0001974597798475868,
+      "loss": 0.4699,
+      "step": 20
+    },
+    {
+      "epoch": 0.10548523206751055,
+      "grad_norm": 0.6415855884552002,
+      "learning_rate": 0.0001966130397967824,
+      "loss": 0.4624,
+      "step": 25
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 1.1393471956253052,
+      "learning_rate": 0.000195766299745978,
+      "loss": 0.5064,
+      "step": 30
+    },
+    {
+      "epoch": 0.14767932489451477,
+      "grad_norm": 0.7702832818031311,
+      "learning_rate": 0.00019491955969517358,
+      "loss": 0.5226,
+      "step": 35
+    },
+    {
+      "epoch": 0.16877637130801687,
+      "grad_norm": 0.7905811071395874,
+      "learning_rate": 0.0001940728196443692,
+      "loss": 0.5235,
+      "step": 40
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 0.8080295920372009,
+      "learning_rate": 0.00019322607959356477,
+      "loss": 0.4923,
+      "step": 45
+    },
+    {
+      "epoch": 0.2109704641350211,
+      "grad_norm": 0.7102531790733337,
+      "learning_rate": 0.00019237933954276037,
+      "loss": 0.4861,
+      "step": 50
+    },
+    {
+      "epoch": 0.2320675105485232,
+      "grad_norm": 0.6320513486862183,
+      "learning_rate": 0.00019153259949195598,
+      "loss": 0.4758,
+      "step": 55
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 0.5483996272087097,
+      "learning_rate": 0.00019068585944115158,
+      "loss": 0.4846,
+      "step": 60
+    },
+    {
+      "epoch": 0.2742616033755274,
+      "grad_norm": 0.5805549621582031,
+      "learning_rate": 0.0001898391193903472,
+      "loss": 0.4207,
+      "step": 65
+    },
+    {
+      "epoch": 0.29535864978902954,
+      "grad_norm": 0.6124007701873779,
+      "learning_rate": 0.00018899237933954276,
+      "loss": 0.4838,
+      "step": 70
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 0.6392915844917297,
+      "learning_rate": 0.00018814563928873837,
+      "loss": 0.4557,
+      "step": 75
+    },
+    {
+      "epoch": 0.33755274261603374,
+      "grad_norm": 0.6733785271644592,
+      "learning_rate": 0.00018729889923793395,
+      "loss": 0.4884,
+      "step": 80
+    },
+    {
+      "epoch": 0.35864978902953587,
+      "grad_norm": 0.6744979023933411,
+      "learning_rate": 0.00018645215918712955,
+      "loss": 0.4421,
+      "step": 85
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 0.647033154964447,
+      "learning_rate": 0.00018560541913632516,
+      "loss": 0.4404,
+      "step": 90
+    },
+    {
+      "epoch": 0.4008438818565401,
+      "grad_norm": 0.6323936581611633,
+      "learning_rate": 0.00018475867908552076,
+      "loss": 0.4299,
+      "step": 95
+    },
+    {
+      "epoch": 0.4219409282700422,
+      "grad_norm": 0.6895705461502075,
+      "learning_rate": 0.00018391193903471634,
+      "loss": 0.4567,
+      "step": 100
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 1.326171636581421,
+      "learning_rate": 0.00018306519898391194,
+      "loss": 0.4587,
+      "step": 105
+    },
+    {
+      "epoch": 0.4641350210970464,
+      "grad_norm": 0.7596874833106995,
+      "learning_rate": 0.00018221845893310755,
+      "loss": 0.4527,
+      "step": 110
+    },
+    {
+      "epoch": 0.48523206751054854,
+      "grad_norm": 0.5594536066055298,
+      "learning_rate": 0.00018137171888230313,
+      "loss": 0.4433,
+      "step": 115
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 0.5562201142311096,
+      "learning_rate": 0.00018052497883149876,
+      "loss": 0.4655,
+      "step": 120
+    },
+    {
+      "epoch": 0.5274261603375527,
+      "grad_norm": 0.5696616172790527,
+      "learning_rate": 0.00017967823878069434,
+      "loss": 0.4169,
+      "step": 125
+    },
+    {
+      "epoch": 0.5485232067510548,
+      "grad_norm": 0.872970700263977,
+      "learning_rate": 0.00017883149872988994,
+      "loss": 0.4587,
+      "step": 130
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.8332061171531677,
+      "learning_rate": 0.00017798475867908552,
+      "loss": 0.4137,
+      "step": 135
+    },
+    {
+      "epoch": 0.5907172995780591,
+      "grad_norm": 0.6869994401931763,
+      "learning_rate": 0.00017713801862828112,
+      "loss": 0.4625,
+      "step": 140
+    },
+    {
+      "epoch": 0.6118143459915611,
+      "grad_norm": 0.7138175368309021,
+      "learning_rate": 0.0001762912785774767,
+      "loss": 0.4137,
+      "step": 145
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 0.6982415914535522,
+      "learning_rate": 0.00017544453852667233,
+      "loss": 0.4773,
+      "step": 150
+    },
+    {
+      "epoch": 0.6540084388185654,
+      "grad_norm": 0.6468168497085571,
+      "learning_rate": 0.0001745977984758679,
+      "loss": 0.461,
+      "step": 155
+    },
+    {
+      "epoch": 0.6751054852320675,
+      "grad_norm": 0.5886504054069519,
+      "learning_rate": 0.00017375105842506352,
+      "loss": 0.4304,
+      "step": 160
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.6864741444587708,
+      "learning_rate": 0.00017290431837425912,
+      "loss": 0.4319,
+      "step": 165
+    },
+    {
+      "epoch": 0.7172995780590717,
+      "grad_norm": 0.6106663942337036,
+      "learning_rate": 0.0001720575783234547,
+      "loss": 0.4794,
+      "step": 170
+    },
+    {
+      "epoch": 0.7383966244725738,
+      "grad_norm": 0.6986768245697021,
+      "learning_rate": 0.0001712108382726503,
+      "loss": 0.4533,
+      "step": 175
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.6781573295593262,
+      "learning_rate": 0.00017036409822184588,
+      "loss": 0.4825,
+      "step": 180
+    },
+    {
+      "epoch": 0.7805907172995781,
+      "grad_norm": 0.5864121913909912,
+      "learning_rate": 0.00016951735817104151,
+      "loss": 0.4052,
+      "step": 185
+    },
+    {
+      "epoch": 0.8016877637130801,
+      "grad_norm": 0.5869038701057434,
+      "learning_rate": 0.0001686706181202371,
+      "loss": 0.4117,
+      "step": 190
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.6497222781181335,
+      "learning_rate": 0.0001678238780694327,
+      "loss": 0.4596,
+      "step": 195
+    },
+    {
+      "epoch": 0.8438818565400844,
+      "grad_norm": 0.6619230508804321,
+      "learning_rate": 0.00016697713801862828,
+      "loss": 0.4731,
+      "step": 200
+    },
+    {
+      "epoch": 0.8649789029535865,
+      "grad_norm": 0.6095796227455139,
+      "learning_rate": 0.00016613039796782388,
+      "loss": 0.4409,
+      "step": 205
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.6402797698974609,
+      "learning_rate": 0.00016528365791701949,
+      "loss": 0.4306,
+      "step": 210
+    },
+    {
+      "epoch": 0.9071729957805907,
+      "grad_norm": 0.644440233707428,
+      "learning_rate": 0.0001644369178662151,
+      "loss": 0.4417,
+      "step": 215
+    },
+    {
+      "epoch": 0.9282700421940928,
+      "grad_norm": 0.5990755558013916,
+      "learning_rate": 0.0001635901778154107,
+      "loss": 0.4449,
+      "step": 220
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.7246052026748657,
+      "learning_rate": 0.00016274343776460627,
+      "loss": 0.4132,
+      "step": 225
+    },
+    {
+      "epoch": 0.9704641350210971,
+      "grad_norm": 0.7127440571784973,
+      "learning_rate": 0.00016189669771380188,
+      "loss": 0.43,
+      "step": 230
+    },
+    {
+      "epoch": 0.9915611814345991,
+      "grad_norm": 0.5102093815803528,
+      "learning_rate": 0.00016104995766299746,
+      "loss": 0.3763,
+      "step": 235
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.5558840036392212,
+      "learning_rate": 0.00016020321761219306,
+      "loss": 0.3735,
+      "step": 240
+    },
+    {
+      "epoch": 1.0337552742616034,
+      "grad_norm": 0.7372997403144836,
+      "learning_rate": 0.00015935647756138864,
+      "loss": 0.3678,
+      "step": 245
+    },
+    {
+      "epoch": 1.0548523206751055,
+      "grad_norm": 0.6645821332931519,
+      "learning_rate": 0.00015850973751058427,
+      "loss": 0.3348,
+      "step": 250
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.6483216881752014,
+      "learning_rate": 0.00015766299745977985,
+      "loss": 0.3497,
+      "step": 255
+    },
+    {
+      "epoch": 1.0970464135021096,
+      "grad_norm": 0.7461686134338379,
+      "learning_rate": 0.00015681625740897545,
+      "loss": 0.3396,
+      "step": 260
+    },
+    {
+      "epoch": 1.1181434599156117,
+      "grad_norm": 0.7183260917663574,
+      "learning_rate": 0.00015596951735817106,
+      "loss": 0.3331,
+      "step": 265
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.6482828855514526,
+      "learning_rate": 0.00015512277730736664,
+      "loss": 0.3349,
+      "step": 270
+    },
+    {
+      "epoch": 1.160337552742616,
+      "grad_norm": 0.7357110977172852,
+      "learning_rate": 0.00015427603725656224,
+      "loss": 0.3392,
+      "step": 275
+    },
+    {
+      "epoch": 1.1814345991561181,
+      "grad_norm": 0.8033156991004944,
+      "learning_rate": 0.00015342929720575785,
+      "loss": 0.3081,
+      "step": 280
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.8261159658432007,
+      "learning_rate": 0.00015258255715495345,
+      "loss": 0.3289,
+      "step": 285
+    },
+    {
+      "epoch": 1.2236286919831223,
+      "grad_norm": 0.9544351100921631,
+      "learning_rate": 0.00015173581710414903,
+      "loss": 0.3338,
+      "step": 290
+    },
+    {
+      "epoch": 1.2447257383966246,
+      "grad_norm": 0.7345326542854309,
+      "learning_rate": 0.00015088907705334463,
+      "loss": 0.3224,
+      "step": 295
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7424091100692749,
+      "learning_rate": 0.0001500423370025402,
+      "loss": 0.2973,
+      "step": 300
+    },
+    {
+      "epoch": 1.2869198312236287,
+      "grad_norm": 1.0532294511795044,
+      "learning_rate": 0.00014919559695173582,
+      "loss": 0.3243,
+      "step": 305
+    },
+    {
+      "epoch": 1.3080168776371308,
+      "grad_norm": 0.673413097858429,
+      "learning_rate": 0.00014834885690093142,
+      "loss": 0.2981,
+      "step": 310
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 0.7296124696731567,
+      "learning_rate": 0.00014750211685012703,
+      "loss": 0.3273,
+      "step": 315
+    },
+    {
+      "epoch": 1.350210970464135,
+      "grad_norm": 0.7868983149528503,
+      "learning_rate": 0.00014665537679932263,
+      "loss": 0.3315,
+      "step": 320
+    },
+    {
+      "epoch": 1.371308016877637,
+      "grad_norm": 0.618905246257782,
+      "learning_rate": 0.0001458086367485182,
+      "loss": 0.3187,
+      "step": 325
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.7611832618713379,
+      "learning_rate": 0.0001449618966977138,
+      "loss": 0.3273,
+      "step": 330
+    },
+    {
+      "epoch": 1.4135021097046414,
+      "grad_norm": 0.7445492148399353,
+      "learning_rate": 0.0001441151566469094,
+      "loss": 0.3148,
+      "step": 335
+    },
+    {
+      "epoch": 1.4345991561181435,
+      "grad_norm": 0.7893179059028625,
+      "learning_rate": 0.000143268416596105,
+      "loss": 0.3096,
+      "step": 340
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.7259252071380615,
+      "learning_rate": 0.0001424216765453006,
+      "loss": 0.314,
+      "step": 345
+    },
+    {
+      "epoch": 1.4767932489451476,
+      "grad_norm": 0.9332309365272522,
+      "learning_rate": 0.0001415749364944962,
+      "loss": 0.3132,
+      "step": 350
+    },
+    {
+      "epoch": 1.49789029535865,
+      "grad_norm": 0.8386842012405396,
+      "learning_rate": 0.00014072819644369178,
+      "loss": 0.3573,
+      "step": 355
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 0.8299745917320251,
+      "learning_rate": 0.0001398814563928874,
+      "loss": 0.3414,
+      "step": 360
+    },
+    {
+      "epoch": 1.540084388185654,
+      "grad_norm": 0.8027970194816589,
+      "learning_rate": 0.000139034716342083,
+      "loss": 0.301,
+      "step": 365
+    },
+    {
+      "epoch": 1.5611814345991561,
+      "grad_norm": 0.8260971307754517,
+      "learning_rate": 0.00013818797629127857,
+      "loss": 0.3056,
+      "step": 370
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 0.7211348414421082,
+      "learning_rate": 0.0001373412362404742,
+      "loss": 0.3247,
+      "step": 375
+    },
+    {
+      "epoch": 1.6033755274261603,
+      "grad_norm": 0.7652252316474915,
+      "learning_rate": 0.00013649449618966978,
+      "loss": 0.2997,
+      "step": 380
+    },
+    {
+      "epoch": 1.6244725738396624,
+      "grad_norm": 0.8082212805747986,
+      "learning_rate": 0.00013564775613886539,
+      "loss": 0.3311,
+      "step": 385
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.6903911828994751,
+      "learning_rate": 0.00013480101608806096,
+      "loss": 0.3316,
+      "step": 390
+    },
+    {
+      "epoch": 1.6666666666666665,
+      "grad_norm": 0.8441250920295715,
+      "learning_rate": 0.00013395427603725657,
+      "loss": 0.2987,
+      "step": 395
+    },
+    {
+      "epoch": 1.6877637130801688,
+      "grad_norm": 0.6455714106559753,
+      "learning_rate": 0.00013310753598645215,
+      "loss": 0.3235,
+      "step": 400
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.6983484625816345,
+      "learning_rate": 0.00013226079593564775,
+      "loss": 0.3207,
+      "step": 405
+    },
+    {
+      "epoch": 1.729957805907173,
+      "grad_norm": 0.7476673126220703,
+      "learning_rate": 0.00013141405588484336,
+      "loss": 0.322,
+      "step": 410
+    },
+    {
+      "epoch": 1.7510548523206753,
+      "grad_norm": 0.7899746894836426,
+      "learning_rate": 0.00013056731583403896,
+      "loss": 0.2969,
+      "step": 415
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 0.7910045385360718,
+      "learning_rate": 0.00012972057578323457,
+      "loss": 0.3327,
+      "step": 420
+    },
+    {
+      "epoch": 1.7932489451476794,
+      "grad_norm": 0.6791032552719116,
+      "learning_rate": 0.00012887383573243014,
+      "loss": 0.3109,
+      "step": 425
+    },
+    {
+      "epoch": 1.8143459915611815,
+      "grad_norm": 0.7799623012542725,
+      "learning_rate": 0.00012802709568162575,
+      "loss": 0.3081,
+      "step": 430
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 0.7135102152824402,
+      "learning_rate": 0.00012718035563082133,
+      "loss": 0.2824,
+      "step": 435
+    },
+    {
+      "epoch": 1.8565400843881856,
+      "grad_norm": 0.732537567615509,
+      "learning_rate": 0.00012633361558001696,
+      "loss": 0.3364,
+      "step": 440
+    },
+    {
+      "epoch": 1.8776371308016877,
+      "grad_norm": 0.7259167432785034,
+      "learning_rate": 0.00012548687552921254,
+      "loss": 0.326,
+      "step": 445
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 0.828127920627594,
+      "learning_rate": 0.00012464013547840814,
+      "loss": 0.31,
+      "step": 450
+    },
+    {
+      "epoch": 1.9198312236286919,
+      "grad_norm": 0.8551115393638611,
+      "learning_rate": 0.00012379339542760372,
+      "loss": 0.2991,
+      "step": 455
+    },
+    {
+      "epoch": 1.9409282700421941,
+      "grad_norm": 0.8755710124969482,
+      "learning_rate": 0.00012294665537679932,
+      "loss": 0.2978,
+      "step": 460
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.7943766713142395,
+      "learning_rate": 0.00012209991532599493,
+      "loss": 0.2796,
+      "step": 465
+    },
+    {
+      "epoch": 1.9831223628691983,
+      "grad_norm": 0.709699273109436,
+      "learning_rate": 0.0001212531752751905,
+      "loss": 0.3171,
+      "step": 470
+    },
+    {
+      "epoch": 2.0042194092827006,
+      "grad_norm": 0.5481745004653931,
+      "learning_rate": 0.00012040643522438612,
+      "loss": 0.2664,
+      "step": 475
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.8539430499076843,
+      "learning_rate": 0.00011955969517358172,
+      "loss": 0.2146,
+      "step": 480
+    },
+    {
+      "epoch": 2.0464135021097047,
+      "grad_norm": 0.8904210329055786,
+      "learning_rate": 0.00011871295512277731,
+      "loss": 0.1905,
+      "step": 485
+    },
+    {
+      "epoch": 2.067510548523207,
+      "grad_norm": 1.2182245254516602,
+      "learning_rate": 0.00011786621507197291,
+      "loss": 0.1874,
+      "step": 490
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.6917277574539185,
+      "learning_rate": 0.0001170194750211685,
+      "loss": 0.201,
+      "step": 495
+    },
+    {
+      "epoch": 2.109704641350211,
+      "grad_norm": 0.8633620738983154,
+      "learning_rate": 0.0001161727349703641,
+      "loss": 0.1902,
+      "step": 500
+    },
+    {
+      "epoch": 2.130801687763713,
+      "grad_norm": 0.7604339122772217,
+      "learning_rate": 0.00011532599491955971,
+      "loss": 0.1833,
+      "step": 505
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 0.8772925734519958,
+      "learning_rate": 0.0001144792548687553,
+      "loss": 0.1816,
+      "step": 510
+    },
+    {
+      "epoch": 2.172995780590717,
+      "grad_norm": 0.7404392957687378,
+      "learning_rate": 0.0001136325148179509,
+      "loss": 0.1777,
+      "step": 515
+    },
+    {
+      "epoch": 2.1940928270042193,
+      "grad_norm": 0.709751546382904,
+      "learning_rate": 0.00011278577476714649,
+      "loss": 0.1912,
+      "step": 520
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 1.1144224405288696,
+      "learning_rate": 0.00011193903471634208,
+      "loss": 0.1904,
+      "step": 525
+    },
+    {
+      "epoch": 2.2362869198312234,
+      "grad_norm": 1.018391728401184,
+      "learning_rate": 0.00011109229466553768,
+      "loss": 0.1801,
+      "step": 530
+    },
+    {
+      "epoch": 2.257383966244726,
+      "grad_norm": 0.8928098678588867,
+      "learning_rate": 0.00011024555461473329,
+      "loss": 0.1887,
+      "step": 535
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.8657038807868958,
+      "learning_rate": 0.00010939881456392888,
+      "loss": 0.1919,
+      "step": 540
+    },
+    {
+      "epoch": 2.29957805907173,
+      "grad_norm": 0.981024980545044,
+      "learning_rate": 0.00010855207451312448,
+      "loss": 0.1834,
+      "step": 545
+    },
+    {
+      "epoch": 2.320675105485232,
+      "grad_norm": 0.9774715304374695,
+      "learning_rate": 0.00010770533446232008,
+      "loss": 0.1916,
+      "step": 550
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.8846821784973145,
+      "learning_rate": 0.00010685859441151567,
+      "loss": 0.1932,
+      "step": 555
+    },
+    {
+      "epoch": 2.3628691983122363,
+      "grad_norm": 0.884130597114563,
+      "learning_rate": 0.00010601185436071126,
+      "loss": 0.1833,
+      "step": 560
+    },
+    {
+      "epoch": 2.3839662447257384,
+      "grad_norm": 0.9202504754066467,
+      "learning_rate": 0.00010516511430990685,
+      "loss": 0.1947,
+      "step": 565
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 0.8119796514511108,
+      "learning_rate": 0.00010431837425910247,
+      "loss": 0.1938,
+      "step": 570
+    },
+    {
+      "epoch": 2.4261603375527425,
+      "grad_norm": 0.9764719605445862,
+      "learning_rate": 0.00010347163420829806,
+      "loss": 0.1936,
+      "step": 575
+    },
+    {
+      "epoch": 2.4472573839662446,
+      "grad_norm": 0.833234965801239,
+      "learning_rate": 0.00010262489415749365,
+      "loss": 0.1876,
+      "step": 580
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 1.131765604019165,
+      "learning_rate": 0.00010177815410668926,
+      "loss": 0.1955,
+      "step": 585
+    },
+    {
+      "epoch": 2.489451476793249,
+      "grad_norm": 0.8004549145698547,
+      "learning_rate": 0.00010093141405588485,
+      "loss": 0.1873,
+      "step": 590
+    },
+    {
+      "epoch": 2.510548523206751,
+      "grad_norm": 0.8315241932868958,
+      "learning_rate": 0.00010008467400508044,
+      "loss": 0.1843,
+      "step": 595
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 0.8431430459022522,
+      "learning_rate": 9.923793395427604e-05,
+      "loss": 0.1942,
+      "step": 600
+    },
+    {
+      "epoch": 2.5527426160337554,
+      "grad_norm": 0.8936229944229126,
+      "learning_rate": 9.839119390347164e-05,
+      "loss": 0.1918,
+      "step": 605
+    },
+    {
+      "epoch": 2.5738396624472575,
+      "grad_norm": 0.9152116775512695,
+      "learning_rate": 9.754445385266724e-05,
+      "loss": 0.1994,
+      "step": 610
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 0.7673624157905579,
+      "learning_rate": 9.669771380186283e-05,
+      "loss": 0.1862,
+      "step": 615
+    },
+    {
+      "epoch": 2.6160337552742616,
+      "grad_norm": 0.7213599681854248,
+      "learning_rate": 9.585097375105842e-05,
+      "loss": 0.183,
+      "step": 620
+    },
+    {
+      "epoch": 2.6371308016877637,
+      "grad_norm": 0.9323659539222717,
+      "learning_rate": 9.500423370025403e-05,
+      "loss": 0.1892,
+      "step": 625
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.7224115133285522,
+      "learning_rate": 9.415749364944962e-05,
+      "loss": 0.1906,
+      "step": 630
+    },
+    {
+      "epoch": 2.679324894514768,
+      "grad_norm": 1.0357307195663452,
+      "learning_rate": 9.331075359864522e-05,
+      "loss": 0.1913,
+      "step": 635
+    },
+    {
+      "epoch": 2.70042194092827,
+      "grad_norm": 0.8100070357322693,
+      "learning_rate": 9.246401354784083e-05,
+      "loss": 0.1851,
+      "step": 640
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 1.022112250328064,
+      "learning_rate": 9.161727349703642e-05,
+      "loss": 0.1977,
+      "step": 645
+    },
+    {
+      "epoch": 2.742616033755274,
+      "grad_norm": 0.8289423584938049,
+      "learning_rate": 9.077053344623201e-05,
+      "loss": 0.1968,
+      "step": 650
+    },
+    {
+      "epoch": 2.7637130801687766,
+      "grad_norm": 1.2581491470336914,
+      "learning_rate": 8.992379339542762e-05,
+      "loss": 0.1897,
+      "step": 655
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 0.846420407295227,
+      "learning_rate": 8.907705334462321e-05,
+      "loss": 0.1923,
+      "step": 660
+    },
+    {
+      "epoch": 2.8059071729957807,
+      "grad_norm": 0.9414570331573486,
+      "learning_rate": 8.82303132938188e-05,
+      "loss": 0.1787,
+      "step": 665
+    },
+    {
+      "epoch": 2.827004219409283,
+      "grad_norm": 1.0424678325653076,
+      "learning_rate": 8.738357324301439e-05,
+      "loss": 0.1874,
+      "step": 670
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 1.056854248046875,
+      "learning_rate": 8.653683319221e-05,
+      "loss": 0.1963,
+      "step": 675
+    },
+    {
+      "epoch": 2.869198312236287,
+      "grad_norm": 0.8551703095436096,
+      "learning_rate": 8.569009314140559e-05,
+      "loss": 0.1925,
+      "step": 680
+    },
+    {
+      "epoch": 2.890295358649789,
+      "grad_norm": 0.8861784338951111,
+      "learning_rate": 8.484335309060119e-05,
+      "loss": 0.1851,
+      "step": 685
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 1.051079273223877,
+      "learning_rate": 8.39966130397968e-05,
+      "loss": 0.1849,
+      "step": 690
+    },
+    {
+      "epoch": 2.932489451476793,
+      "grad_norm": 0.9021926522254944,
+      "learning_rate": 8.314987298899239e-05,
+      "loss": 0.1883,
+      "step": 695
+    },
+    {
+      "epoch": 2.9535864978902953,
+      "grad_norm": 1.1243478059768677,
+      "learning_rate": 8.230313293818798e-05,
+      "loss": 0.1928,
+      "step": 700
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 0.776346743106842,
+      "learning_rate": 8.145639288738358e-05,
+      "loss": 0.1778,
+      "step": 705
+    },
+    {
+      "epoch": 2.9957805907173,
+      "grad_norm": 0.7797594666481018,
+      "learning_rate": 8.060965283657918e-05,
+      "loss": 0.1807,
+      "step": 710
+    },
+    {
+      "epoch": 3.0168776371308015,
+      "grad_norm": 0.6612173914909363,
+      "learning_rate": 7.976291278577477e-05,
+      "loss": 0.1313,
+      "step": 715
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 0.507293701171875,
+      "learning_rate": 7.891617273497037e-05,
+      "loss": 0.1105,
+      "step": 720
+    },
+    {
+      "epoch": 3.059071729957806,
+      "grad_norm": 1.3071284294128418,
+      "learning_rate": 7.806943268416596e-05,
+      "loss": 0.1106,
+      "step": 725
+    },
+    {
+      "epoch": 3.080168776371308,
+      "grad_norm": 1.0598982572555542,
+      "learning_rate": 7.722269263336155e-05,
+      "loss": 0.1105,
+      "step": 730
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 0.7552915215492249,
+      "learning_rate": 7.637595258255716e-05,
+      "loss": 0.1174,
+      "step": 735
+    },
+    {
+      "epoch": 3.1223628691983123,
+      "grad_norm": 0.6637086868286133,
+      "learning_rate": 7.552921253175276e-05,
+      "loss": 0.1123,
+      "step": 740
+    },
+    {
+      "epoch": 3.1434599156118144,
+      "grad_norm": 0.6471919417381287,
+      "learning_rate": 7.468247248094836e-05,
+      "loss": 0.1179,
+      "step": 745
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 0.6427778005599976,
+      "learning_rate": 7.383573243014395e-05,
+      "loss": 0.111,
+      "step": 750
+    },
+    {
+      "epoch": 3.1856540084388185,
+      "grad_norm": 0.8144406080245972,
+      "learning_rate": 7.298899237933955e-05,
+      "loss": 0.1172,
+      "step": 755
+    },
+    {
+      "epoch": 3.2067510548523206,
+      "grad_norm": 0.557647705078125,
+      "learning_rate": 7.214225232853514e-05,
+      "loss": 0.1128,
+      "step": 760
+    },
+    {
+      "epoch": 3.2278481012658227,
+      "grad_norm": 0.8724661469459534,
+      "learning_rate": 7.129551227773073e-05,
+      "loss": 0.1198,
+      "step": 765
+    },
+    {
+      "epoch": 3.2489451476793247,
+      "grad_norm": 0.8053642511367798,
+      "learning_rate": 7.044877222692634e-05,
+      "loss": 0.1183,
+      "step": 770
+    },
+    {
+      "epoch": 3.270042194092827,
+      "grad_norm": 1.0730928182601929,
+      "learning_rate": 6.960203217612193e-05,
+      "loss": 0.1157,
+      "step": 775
+    },
+    {
+      "epoch": 3.291139240506329,
+      "grad_norm": 0.8512837886810303,
+      "learning_rate": 6.875529212531752e-05,
+      "loss": 0.117,
+      "step": 780
+    },
+    {
+      "epoch": 3.3122362869198314,
+      "grad_norm": 0.6452792882919312,
+      "learning_rate": 6.790855207451313e-05,
+      "loss": 0.1203,
+      "step": 785
+    },
+    {
+      "epoch": 3.3333333333333335,
+      "grad_norm": 1.0139598846435547,
+      "learning_rate": 6.706181202370873e-05,
+      "loss": 0.1191,
+      "step": 790
+    },
+    {
+      "epoch": 3.3544303797468356,
+      "grad_norm": 0.8049492239952087,
+      "learning_rate": 6.621507197290432e-05,
+      "loss": 0.1195,
+      "step": 795
+    },
+    {
+      "epoch": 3.3755274261603376,
+      "grad_norm": 0.7811105251312256,
+      "learning_rate": 6.536833192209993e-05,
+      "loss": 0.1155,
+      "step": 800
+    },
+    {
+      "epoch": 3.3966244725738397,
+      "grad_norm": 0.7017205357551575,
+      "learning_rate": 6.452159187129552e-05,
+      "loss": 0.1142,
+      "step": 805
+    },
+    {
+      "epoch": 3.4177215189873418,
+      "grad_norm": 0.8031386137008667,
+      "learning_rate": 6.367485182049111e-05,
+      "loss": 0.1172,
+      "step": 810
+    },
+    {
+      "epoch": 3.438818565400844,
+      "grad_norm": 0.9530389904975891,
+      "learning_rate": 6.28281117696867e-05,
+      "loss": 0.1156,
+      "step": 815
+    },
+    {
+      "epoch": 3.459915611814346,
+      "grad_norm": 0.681145966053009,
+      "learning_rate": 6.198137171888231e-05,
+      "loss": 0.1116,
+      "step": 820
+    },
+    {
+      "epoch": 3.481012658227848,
+      "grad_norm": 0.7290719151496887,
+      "learning_rate": 6.11346316680779e-05,
+      "loss": 0.1145,
+      "step": 825
+    },
+    {
+      "epoch": 3.50210970464135,
+      "grad_norm": 0.8378763794898987,
+      "learning_rate": 6.0287891617273496e-05,
+      "loss": 0.1167,
+      "step": 830
+    },
+    {
+      "epoch": 3.523206751054852,
+      "grad_norm": 0.7045923471450806,
+      "learning_rate": 5.94411515664691e-05,
+      "loss": 0.1131,
+      "step": 835
+    },
+    {
+      "epoch": 3.5443037974683547,
+      "grad_norm": 0.6490755081176758,
+      "learning_rate": 5.859441151566469e-05,
+      "loss": 0.1082,
+      "step": 840
+    },
+    {
+      "epoch": 3.5654008438818563,
+      "grad_norm": 0.7876132726669312,
+      "learning_rate": 5.7747671464860284e-05,
+      "loss": 0.1199,
+      "step": 845
+    },
+    {
+      "epoch": 3.586497890295359,
+      "grad_norm": 0.7024048566818237,
+      "learning_rate": 5.690093141405589e-05,
+      "loss": 0.1211,
+      "step": 850
+    },
+    {
+      "epoch": 3.607594936708861,
+      "grad_norm": 0.6573346853256226,
+      "learning_rate": 5.605419136325149e-05,
+      "loss": 0.1124,
+      "step": 855
+    },
+    {
+      "epoch": 3.628691983122363,
+      "grad_norm": 0.6605643033981323,
+      "learning_rate": 5.520745131244708e-05,
+      "loss": 0.1145,
+      "step": 860
+    },
+    {
+      "epoch": 3.649789029535865,
+      "grad_norm": 0.9532989859580994,
+      "learning_rate": 5.436071126164268e-05,
+      "loss": 0.1175,
+      "step": 865
+    },
+    {
+      "epoch": 3.670886075949367,
+      "grad_norm": 0.8012579083442688,
+      "learning_rate": 5.3513971210838275e-05,
+      "loss": 0.1084,
+      "step": 870
+    },
+    {
+      "epoch": 3.691983122362869,
+      "grad_norm": 0.6036604642868042,
+      "learning_rate": 5.266723116003387e-05,
+      "loss": 0.1195,
+      "step": 875
+    },
+    {
+      "epoch": 3.7130801687763713,
+      "grad_norm": 0.8136915564537048,
+      "learning_rate": 5.182049110922948e-05,
+      "loss": 0.117,
+      "step": 880
+    },
+    {
+      "epoch": 3.7341772151898733,
+      "grad_norm": 0.7303801774978638,
+      "learning_rate": 5.097375105842507e-05,
+      "loss": 0.12,
+      "step": 885
+    },
+    {
+      "epoch": 3.7552742616033754,
+      "grad_norm": 0.6088728904724121,
+      "learning_rate": 5.012701100762066e-05,
+      "loss": 0.123,
+      "step": 890
+    },
+    {
+      "epoch": 3.7763713080168775,
+      "grad_norm": 0.7355825901031494,
+      "learning_rate": 4.928027095681626e-05,
+      "loss": 0.1122,
+      "step": 895
+    },
+    {
+      "epoch": 3.7974683544303796,
+      "grad_norm": 0.7765938639640808,
+      "learning_rate": 4.8433530906011857e-05,
+      "loss": 0.1184,
+      "step": 900
+    },
+    {
+      "epoch": 3.818565400843882,
+      "grad_norm": 0.7499243021011353,
+      "learning_rate": 4.7586790855207455e-05,
+      "loss": 0.1179,
+      "step": 905
+    },
+    {
+      "epoch": 3.8396624472573837,
+      "grad_norm": 0.6993740200996399,
+      "learning_rate": 4.674005080440305e-05,
+      "loss": 0.1189,
+      "step": 910
+    },
+    {
+      "epoch": 3.8607594936708862,
+      "grad_norm": 0.9036173820495605,
+      "learning_rate": 4.5893310753598644e-05,
+      "loss": 0.1147,
+      "step": 915
+    },
+    {
+      "epoch": 3.8818565400843883,
+      "grad_norm": 0.8140806555747986,
+      "learning_rate": 4.504657070279424e-05,
+      "loss": 0.1218,
+      "step": 920
+    },
+    {
+      "epoch": 3.9029535864978904,
+      "grad_norm": 0.7361952662467957,
+      "learning_rate": 4.419983065198984e-05,
+      "loss": 0.1183,
+      "step": 925
+    },
+    {
+      "epoch": 3.9240506329113924,
+      "grad_norm": 0.8502449989318848,
+      "learning_rate": 4.335309060118544e-05,
+      "loss": 0.1109,
+      "step": 930
+    },
+    {
+      "epoch": 3.9451476793248945,
+      "grad_norm": 0.8034221529960632,
+      "learning_rate": 4.250635055038104e-05,
+      "loss": 0.1192,
+      "step": 935
+    },
+    {
+      "epoch": 3.9662447257383966,
+      "grad_norm": 0.6105166673660278,
+      "learning_rate": 4.1659610499576635e-05,
+      "loss": 0.116,
+      "step": 940
+    },
+    {
+      "epoch": 3.9873417721518987,
+      "grad_norm": 1.0857540369033813,
+      "learning_rate": 4.0812870448772226e-05,
+      "loss": 0.1154,
+      "step": 945
+    },
+    {
+      "epoch": 4.008438818565401,
+      "grad_norm": 0.33604809641838074,
+      "learning_rate": 3.9966130397967824e-05,
+      "loss": 0.1024,
+      "step": 950
+    },
+    {
+      "epoch": 4.029535864978903,
+      "grad_norm": 0.5442842841148376,
+      "learning_rate": 3.911939034716342e-05,
+      "loss": 0.0858,
+      "step": 955
+    },
+    {
+      "epoch": 4.050632911392405,
+      "grad_norm": 0.5701608061790466,
+      "learning_rate": 3.827265029635902e-05,
+      "loss": 0.0892,
+      "step": 960
+    },
+    {
+      "epoch": 4.071729957805907,
+      "grad_norm": 0.3957703709602356,
+      "learning_rate": 3.742591024555462e-05,
+      "loss": 0.0877,
+      "step": 965
+    },
+    {
+      "epoch": 4.0928270042194095,
+      "grad_norm": 0.371354877948761,
+      "learning_rate": 3.657917019475021e-05,
+      "loss": 0.0865,
+      "step": 970
+    },
+    {
+      "epoch": 4.113924050632911,
+      "grad_norm": 0.5058160424232483,
+      "learning_rate": 3.573243014394581e-05,
+      "loss": 0.0882,
+      "step": 975
+    },
+    {
+      "epoch": 4.135021097046414,
+      "grad_norm": 0.49639376997947693,
+      "learning_rate": 3.488569009314141e-05,
+      "loss": 0.088,
+      "step": 980
+    },
+    {
+      "epoch": 4.156118143459915,
+      "grad_norm": 0.5311477184295654,
+      "learning_rate": 3.4038950042337004e-05,
+      "loss": 0.0894,
+      "step": 985
+    },
+    {
+      "epoch": 4.177215189873418,
+      "grad_norm": 0.4310266673564911,
+      "learning_rate": 3.31922099915326e-05,
+      "loss": 0.0853,
+      "step": 990
+    },
+    {
+      "epoch": 4.198312236286919,
+      "grad_norm": 0.4377863109111786,
+      "learning_rate": 3.2345469940728194e-05,
+      "loss": 0.0895,
+      "step": 995
+    },
+    {
+      "epoch": 4.219409282700422,
+      "grad_norm": 0.4411632716655731,
+      "learning_rate": 3.149872988992379e-05,
+      "loss": 0.0858,
+      "step": 1000
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 1185,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 8.679617583412838e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/de-en-pt/checkpoint-1000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90ab3a9fa29389fcc75044c7a844775cffa8e2fb7bf0776e9fe9b32a837e2a1c
+size 6289

experiments/de-en-pt/checkpoint-1185/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/de-en-pt/checkpoint-1185/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/de-en-pt/checkpoint-1185/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3657de91dc2f72e94c5387f18f835d5d86c38aed3e153dffd9209823fb712e1
+size 83945296

experiments/de-en-pt/checkpoint-1185/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/de-en-pt/checkpoint-1185/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:09a128d4182a891c8c482bedfe4588569657b19d6899781922e26b00ce8c603d
+size 43123429

experiments/de-en-pt/checkpoint-1185/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:addde64272e1895b3e62f8f1535312fd1abda0fb6b309a418f0b6c905b830c6a
+size 14645

experiments/de-en-pt/checkpoint-1185/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:536a5b31febcbda77e3e913e12dcbcd10ebd104290f4bc52ce97482f12465286
+size 1465

experiments/de-en-pt/checkpoint-1185/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/de-en-pt/checkpoint-1185/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/de-en-pt/checkpoint-1185/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/de-en-pt/checkpoint-1185/trainer_state.json

@@ -0,0 +1,1693 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 5.0,
+  "eval_steps": 500,
+  "global_step": 1185,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.02109704641350211,
+      "grad_norm": 7.303770542144775,
+      "learning_rate": 0.0002,
+      "loss": 2.7397,
+      "step": 5
+    },
+    {
+      "epoch": 0.04219409282700422,
+      "grad_norm": 1.8467751741409302,
+      "learning_rate": 0.00019915325994919561,
+      "loss": 0.8472,
+      "step": 10
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 1.7855145931243896,
+      "learning_rate": 0.0001983065198983912,
+      "loss": 0.5618,
+      "step": 15
+    },
+    {
+      "epoch": 0.08438818565400844,
+      "grad_norm": 1.1616630554199219,
+      "learning_rate": 0.0001974597798475868,
+      "loss": 0.4699,
+      "step": 20
+    },
+    {
+      "epoch": 0.10548523206751055,
+      "grad_norm": 0.6415855884552002,
+      "learning_rate": 0.0001966130397967824,
+      "loss": 0.4624,
+      "step": 25
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 1.1393471956253052,
+      "learning_rate": 0.000195766299745978,
+      "loss": 0.5064,
+      "step": 30
+    },
+    {
+      "epoch": 0.14767932489451477,
+      "grad_norm": 0.7702832818031311,
+      "learning_rate": 0.00019491955969517358,
+      "loss": 0.5226,
+      "step": 35
+    },
+    {
+      "epoch": 0.16877637130801687,
+      "grad_norm": 0.7905811071395874,
+      "learning_rate": 0.0001940728196443692,
+      "loss": 0.5235,
+      "step": 40
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 0.8080295920372009,
+      "learning_rate": 0.00019322607959356477,
+      "loss": 0.4923,
+      "step": 45
+    },
+    {
+      "epoch": 0.2109704641350211,
+      "grad_norm": 0.7102531790733337,
+      "learning_rate": 0.00019237933954276037,
+      "loss": 0.4861,
+      "step": 50
+    },
+    {
+      "epoch": 0.2320675105485232,
+      "grad_norm": 0.6320513486862183,
+      "learning_rate": 0.00019153259949195598,
+      "loss": 0.4758,
+      "step": 55
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 0.5483996272087097,
+      "learning_rate": 0.00019068585944115158,
+      "loss": 0.4846,
+      "step": 60
+    },
+    {
+      "epoch": 0.2742616033755274,
+      "grad_norm": 0.5805549621582031,
+      "learning_rate": 0.0001898391193903472,
+      "loss": 0.4207,
+      "step": 65
+    },
+    {
+      "epoch": 0.29535864978902954,
+      "grad_norm": 0.6124007701873779,
+      "learning_rate": 0.00018899237933954276,
+      "loss": 0.4838,
+      "step": 70
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 0.6392915844917297,
+      "learning_rate": 0.00018814563928873837,
+      "loss": 0.4557,
+      "step": 75
+    },
+    {
+      "epoch": 0.33755274261603374,
+      "grad_norm": 0.6733785271644592,
+      "learning_rate": 0.00018729889923793395,
+      "loss": 0.4884,
+      "step": 80
+    },
+    {
+      "epoch": 0.35864978902953587,
+      "grad_norm": 0.6744979023933411,
+      "learning_rate": 0.00018645215918712955,
+      "loss": 0.4421,
+      "step": 85
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 0.647033154964447,
+      "learning_rate": 0.00018560541913632516,
+      "loss": 0.4404,
+      "step": 90
+    },
+    {
+      "epoch": 0.4008438818565401,
+      "grad_norm": 0.6323936581611633,
+      "learning_rate": 0.00018475867908552076,
+      "loss": 0.4299,
+      "step": 95
+    },
+    {
+      "epoch": 0.4219409282700422,
+      "grad_norm": 0.6895705461502075,
+      "learning_rate": 0.00018391193903471634,
+      "loss": 0.4567,
+      "step": 100
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 1.326171636581421,
+      "learning_rate": 0.00018306519898391194,
+      "loss": 0.4587,
+      "step": 105
+    },
+    {
+      "epoch": 0.4641350210970464,
+      "grad_norm": 0.7596874833106995,
+      "learning_rate": 0.00018221845893310755,
+      "loss": 0.4527,
+      "step": 110
+    },
+    {
+      "epoch": 0.48523206751054854,
+      "grad_norm": 0.5594536066055298,
+      "learning_rate": 0.00018137171888230313,
+      "loss": 0.4433,
+      "step": 115
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 0.5562201142311096,
+      "learning_rate": 0.00018052497883149876,
+      "loss": 0.4655,
+      "step": 120
+    },
+    {
+      "epoch": 0.5274261603375527,
+      "grad_norm": 0.5696616172790527,
+      "learning_rate": 0.00017967823878069434,
+      "loss": 0.4169,
+      "step": 125
+    },
+    {
+      "epoch": 0.5485232067510548,
+      "grad_norm": 0.872970700263977,
+      "learning_rate": 0.00017883149872988994,
+      "loss": 0.4587,
+      "step": 130
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.8332061171531677,
+      "learning_rate": 0.00017798475867908552,
+      "loss": 0.4137,
+      "step": 135
+    },
+    {
+      "epoch": 0.5907172995780591,
+      "grad_norm": 0.6869994401931763,
+      "learning_rate": 0.00017713801862828112,
+      "loss": 0.4625,
+      "step": 140
+    },
+    {
+      "epoch": 0.6118143459915611,
+      "grad_norm": 0.7138175368309021,
+      "learning_rate": 0.0001762912785774767,
+      "loss": 0.4137,
+      "step": 145
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 0.6982415914535522,
+      "learning_rate": 0.00017544453852667233,
+      "loss": 0.4773,
+      "step": 150
+    },
+    {
+      "epoch": 0.6540084388185654,
+      "grad_norm": 0.6468168497085571,
+      "learning_rate": 0.0001745977984758679,
+      "loss": 0.461,
+      "step": 155
+    },
+    {
+      "epoch": 0.6751054852320675,
+      "grad_norm": 0.5886504054069519,
+      "learning_rate": 0.00017375105842506352,
+      "loss": 0.4304,
+      "step": 160
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.6864741444587708,
+      "learning_rate": 0.00017290431837425912,
+      "loss": 0.4319,
+      "step": 165
+    },
+    {
+      "epoch": 0.7172995780590717,
+      "grad_norm": 0.6106663942337036,
+      "learning_rate": 0.0001720575783234547,
+      "loss": 0.4794,
+      "step": 170
+    },
+    {
+      "epoch": 0.7383966244725738,
+      "grad_norm": 0.6986768245697021,
+      "learning_rate": 0.0001712108382726503,
+      "loss": 0.4533,
+      "step": 175
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.6781573295593262,
+      "learning_rate": 0.00017036409822184588,
+      "loss": 0.4825,
+      "step": 180
+    },
+    {
+      "epoch": 0.7805907172995781,
+      "grad_norm": 0.5864121913909912,
+      "learning_rate": 0.00016951735817104151,
+      "loss": 0.4052,
+      "step": 185
+    },
+    {
+      "epoch": 0.8016877637130801,
+      "grad_norm": 0.5869038701057434,
+      "learning_rate": 0.0001686706181202371,
+      "loss": 0.4117,
+      "step": 190
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.6497222781181335,
+      "learning_rate": 0.0001678238780694327,
+      "loss": 0.4596,
+      "step": 195
+    },
+    {
+      "epoch": 0.8438818565400844,
+      "grad_norm": 0.6619230508804321,
+      "learning_rate": 0.00016697713801862828,
+      "loss": 0.4731,
+      "step": 200
+    },
+    {
+      "epoch": 0.8649789029535865,
+      "grad_norm": 0.6095796227455139,
+      "learning_rate": 0.00016613039796782388,
+      "loss": 0.4409,
+      "step": 205
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.6402797698974609,
+      "learning_rate": 0.00016528365791701949,
+      "loss": 0.4306,
+      "step": 210
+    },
+    {
+      "epoch": 0.9071729957805907,
+      "grad_norm": 0.644440233707428,
+      "learning_rate": 0.0001644369178662151,
+      "loss": 0.4417,
+      "step": 215
+    },
+    {
+      "epoch": 0.9282700421940928,
+      "grad_norm": 0.5990755558013916,
+      "learning_rate": 0.0001635901778154107,
+      "loss": 0.4449,
+      "step": 220
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.7246052026748657,
+      "learning_rate": 0.00016274343776460627,
+      "loss": 0.4132,
+      "step": 225
+    },
+    {
+      "epoch": 0.9704641350210971,
+      "grad_norm": 0.7127440571784973,
+      "learning_rate": 0.00016189669771380188,
+      "loss": 0.43,
+      "step": 230
+    },
+    {
+      "epoch": 0.9915611814345991,
+      "grad_norm": 0.5102093815803528,
+      "learning_rate": 0.00016104995766299746,
+      "loss": 0.3763,
+      "step": 235
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.5558840036392212,
+      "learning_rate": 0.00016020321761219306,
+      "loss": 0.3735,
+      "step": 240
+    },
+    {
+      "epoch": 1.0337552742616034,
+      "grad_norm": 0.7372997403144836,
+      "learning_rate": 0.00015935647756138864,
+      "loss": 0.3678,
+      "step": 245
+    },
+    {
+      "epoch": 1.0548523206751055,
+      "grad_norm": 0.6645821332931519,
+      "learning_rate": 0.00015850973751058427,
+      "loss": 0.3348,
+      "step": 250
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.6483216881752014,
+      "learning_rate": 0.00015766299745977985,
+      "loss": 0.3497,
+      "step": 255
+    },
+    {
+      "epoch": 1.0970464135021096,
+      "grad_norm": 0.7461686134338379,
+      "learning_rate": 0.00015681625740897545,
+      "loss": 0.3396,
+      "step": 260
+    },
+    {
+      "epoch": 1.1181434599156117,
+      "grad_norm": 0.7183260917663574,
+      "learning_rate": 0.00015596951735817106,
+      "loss": 0.3331,
+      "step": 265
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.6482828855514526,
+      "learning_rate": 0.00015512277730736664,
+      "loss": 0.3349,
+      "step": 270
+    },
+    {
+      "epoch": 1.160337552742616,
+      "grad_norm": 0.7357110977172852,
+      "learning_rate": 0.00015427603725656224,
+      "loss": 0.3392,
+      "step": 275
+    },
+    {
+      "epoch": 1.1814345991561181,
+      "grad_norm": 0.8033156991004944,
+      "learning_rate": 0.00015342929720575785,
+      "loss": 0.3081,
+      "step": 280
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.8261159658432007,
+      "learning_rate": 0.00015258255715495345,
+      "loss": 0.3289,
+      "step": 285
+    },
+    {
+      "epoch": 1.2236286919831223,
+      "grad_norm": 0.9544351100921631,
+      "learning_rate": 0.00015173581710414903,
+      "loss": 0.3338,
+      "step": 290
+    },
+    {
+      "epoch": 1.2447257383966246,
+      "grad_norm": 0.7345326542854309,
+      "learning_rate": 0.00015088907705334463,
+      "loss": 0.3224,
+      "step": 295
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7424091100692749,
+      "learning_rate": 0.0001500423370025402,
+      "loss": 0.2973,
+      "step": 300
+    },
+    {
+      "epoch": 1.2869198312236287,
+      "grad_norm": 1.0532294511795044,
+      "learning_rate": 0.00014919559695173582,
+      "loss": 0.3243,
+      "step": 305
+    },
+    {
+      "epoch": 1.3080168776371308,
+      "grad_norm": 0.673413097858429,
+      "learning_rate": 0.00014834885690093142,
+      "loss": 0.2981,
+      "step": 310
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 0.7296124696731567,
+      "learning_rate": 0.00014750211685012703,
+      "loss": 0.3273,
+      "step": 315
+    },
+    {
+      "epoch": 1.350210970464135,
+      "grad_norm": 0.7868983149528503,
+      "learning_rate": 0.00014665537679932263,
+      "loss": 0.3315,
+      "step": 320
+    },
+    {
+      "epoch": 1.371308016877637,
+      "grad_norm": 0.618905246257782,
+      "learning_rate": 0.0001458086367485182,
+      "loss": 0.3187,
+      "step": 325
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.7611832618713379,
+      "learning_rate": 0.0001449618966977138,
+      "loss": 0.3273,
+      "step": 330
+    },
+    {
+      "epoch": 1.4135021097046414,
+      "grad_norm": 0.7445492148399353,
+      "learning_rate": 0.0001441151566469094,
+      "loss": 0.3148,
+      "step": 335
+    },
+    {
+      "epoch": 1.4345991561181435,
+      "grad_norm": 0.7893179059028625,
+      "learning_rate": 0.000143268416596105,
+      "loss": 0.3096,
+      "step": 340
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.7259252071380615,
+      "learning_rate": 0.0001424216765453006,
+      "loss": 0.314,
+      "step": 345
+    },
+    {
+      "epoch": 1.4767932489451476,
+      "grad_norm": 0.9332309365272522,
+      "learning_rate": 0.0001415749364944962,
+      "loss": 0.3132,
+      "step": 350
+    },
+    {
+      "epoch": 1.49789029535865,
+      "grad_norm": 0.8386842012405396,
+      "learning_rate": 0.00014072819644369178,
+      "loss": 0.3573,
+      "step": 355
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 0.8299745917320251,
+      "learning_rate": 0.0001398814563928874,
+      "loss": 0.3414,
+      "step": 360
+    },
+    {
+      "epoch": 1.540084388185654,
+      "grad_norm": 0.8027970194816589,
+      "learning_rate": 0.000139034716342083,
+      "loss": 0.301,
+      "step": 365
+    },
+    {
+      "epoch": 1.5611814345991561,
+      "grad_norm": 0.8260971307754517,
+      "learning_rate": 0.00013818797629127857,
+      "loss": 0.3056,
+      "step": 370
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 0.7211348414421082,
+      "learning_rate": 0.0001373412362404742,
+      "loss": 0.3247,
+      "step": 375
+    },
+    {
+      "epoch": 1.6033755274261603,
+      "grad_norm": 0.7652252316474915,
+      "learning_rate": 0.00013649449618966978,
+      "loss": 0.2997,
+      "step": 380
+    },
+    {
+      "epoch": 1.6244725738396624,
+      "grad_norm": 0.8082212805747986,
+      "learning_rate": 0.00013564775613886539,
+      "loss": 0.3311,
+      "step": 385
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.6903911828994751,
+      "learning_rate": 0.00013480101608806096,
+      "loss": 0.3316,
+      "step": 390
+    },
+    {
+      "epoch": 1.6666666666666665,
+      "grad_norm": 0.8441250920295715,
+      "learning_rate": 0.00013395427603725657,
+      "loss": 0.2987,
+      "step": 395
+    },
+    {
+      "epoch": 1.6877637130801688,
+      "grad_norm": 0.6455714106559753,
+      "learning_rate": 0.00013310753598645215,
+      "loss": 0.3235,
+      "step": 400
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.6983484625816345,
+      "learning_rate": 0.00013226079593564775,
+      "loss": 0.3207,
+      "step": 405
+    },
+    {
+      "epoch": 1.729957805907173,
+      "grad_norm": 0.7476673126220703,
+      "learning_rate": 0.00013141405588484336,
+      "loss": 0.322,
+      "step": 410
+    },
+    {
+      "epoch": 1.7510548523206753,
+      "grad_norm": 0.7899746894836426,
+      "learning_rate": 0.00013056731583403896,
+      "loss": 0.2969,
+      "step": 415
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 0.7910045385360718,
+      "learning_rate": 0.00012972057578323457,
+      "loss": 0.3327,
+      "step": 420
+    },
+    {
+      "epoch": 1.7932489451476794,
+      "grad_norm": 0.6791032552719116,
+      "learning_rate": 0.00012887383573243014,
+      "loss": 0.3109,
+      "step": 425
+    },
+    {
+      "epoch": 1.8143459915611815,
+      "grad_norm": 0.7799623012542725,
+      "learning_rate": 0.00012802709568162575,
+      "loss": 0.3081,
+      "step": 430
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 0.7135102152824402,
+      "learning_rate": 0.00012718035563082133,
+      "loss": 0.2824,
+      "step": 435
+    },
+    {
+      "epoch": 1.8565400843881856,
+      "grad_norm": 0.732537567615509,
+      "learning_rate": 0.00012633361558001696,
+      "loss": 0.3364,
+      "step": 440
+    },
+    {
+      "epoch": 1.8776371308016877,
+      "grad_norm": 0.7259167432785034,
+      "learning_rate": 0.00012548687552921254,
+      "loss": 0.326,
+      "step": 445
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 0.828127920627594,
+      "learning_rate": 0.00012464013547840814,
+      "loss": 0.31,
+      "step": 450
+    },
+    {
+      "epoch": 1.9198312236286919,
+      "grad_norm": 0.8551115393638611,
+      "learning_rate": 0.00012379339542760372,
+      "loss": 0.2991,
+      "step": 455
+    },
+    {
+      "epoch": 1.9409282700421941,
+      "grad_norm": 0.8755710124969482,
+      "learning_rate": 0.00012294665537679932,
+      "loss": 0.2978,
+      "step": 460
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.7943766713142395,
+      "learning_rate": 0.00012209991532599493,
+      "loss": 0.2796,
+      "step": 465
+    },
+    {
+      "epoch": 1.9831223628691983,
+      "grad_norm": 0.709699273109436,
+      "learning_rate": 0.0001212531752751905,
+      "loss": 0.3171,
+      "step": 470
+    },
+    {
+      "epoch": 2.0042194092827006,
+      "grad_norm": 0.5481745004653931,
+      "learning_rate": 0.00012040643522438612,
+      "loss": 0.2664,
+      "step": 475
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.8539430499076843,
+      "learning_rate": 0.00011955969517358172,
+      "loss": 0.2146,
+      "step": 480
+    },
+    {
+      "epoch": 2.0464135021097047,
+      "grad_norm": 0.8904210329055786,
+      "learning_rate": 0.00011871295512277731,
+      "loss": 0.1905,
+      "step": 485
+    },
+    {
+      "epoch": 2.067510548523207,
+      "grad_norm": 1.2182245254516602,
+      "learning_rate": 0.00011786621507197291,
+      "loss": 0.1874,
+      "step": 490
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.6917277574539185,
+      "learning_rate": 0.0001170194750211685,
+      "loss": 0.201,
+      "step": 495
+    },
+    {
+      "epoch": 2.109704641350211,
+      "grad_norm": 0.8633620738983154,
+      "learning_rate": 0.0001161727349703641,
+      "loss": 0.1902,
+      "step": 500
+    },
+    {
+      "epoch": 2.130801687763713,
+      "grad_norm": 0.7604339122772217,
+      "learning_rate": 0.00011532599491955971,
+      "loss": 0.1833,
+      "step": 505
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 0.8772925734519958,
+      "learning_rate": 0.0001144792548687553,
+      "loss": 0.1816,
+      "step": 510
+    },
+    {
+      "epoch": 2.172995780590717,
+      "grad_norm": 0.7404392957687378,
+      "learning_rate": 0.0001136325148179509,
+      "loss": 0.1777,
+      "step": 515
+    },
+    {
+      "epoch": 2.1940928270042193,
+      "grad_norm": 0.709751546382904,
+      "learning_rate": 0.00011278577476714649,
+      "loss": 0.1912,
+      "step": 520
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 1.1144224405288696,
+      "learning_rate": 0.00011193903471634208,
+      "loss": 0.1904,
+      "step": 525
+    },
+    {
+      "epoch": 2.2362869198312234,
+      "grad_norm": 1.018391728401184,
+      "learning_rate": 0.00011109229466553768,
+      "loss": 0.1801,
+      "step": 530
+    },
+    {
+      "epoch": 2.257383966244726,
+      "grad_norm": 0.8928098678588867,
+      "learning_rate": 0.00011024555461473329,
+      "loss": 0.1887,
+      "step": 535
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.8657038807868958,
+      "learning_rate": 0.00010939881456392888,
+      "loss": 0.1919,
+      "step": 540
+    },
+    {
+      "epoch": 2.29957805907173,
+      "grad_norm": 0.981024980545044,
+      "learning_rate": 0.00010855207451312448,
+      "loss": 0.1834,
+      "step": 545
+    },
+    {
+      "epoch": 2.320675105485232,
+      "grad_norm": 0.9774715304374695,
+      "learning_rate": 0.00010770533446232008,
+      "loss": 0.1916,
+      "step": 550
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.8846821784973145,
+      "learning_rate": 0.00010685859441151567,
+      "loss": 0.1932,
+      "step": 555
+    },
+    {
+      "epoch": 2.3628691983122363,
+      "grad_norm": 0.884130597114563,
+      "learning_rate": 0.00010601185436071126,
+      "loss": 0.1833,
+      "step": 560
+    },
+    {
+      "epoch": 2.3839662447257384,
+      "grad_norm": 0.9202504754066467,
+      "learning_rate": 0.00010516511430990685,
+      "loss": 0.1947,
+      "step": 565
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 0.8119796514511108,
+      "learning_rate": 0.00010431837425910247,
+      "loss": 0.1938,
+      "step": 570
+    },
+    {
+      "epoch": 2.4261603375527425,
+      "grad_norm": 0.9764719605445862,
+      "learning_rate": 0.00010347163420829806,
+      "loss": 0.1936,
+      "step": 575
+    },
+    {
+      "epoch": 2.4472573839662446,
+      "grad_norm": 0.833234965801239,
+      "learning_rate": 0.00010262489415749365,
+      "loss": 0.1876,
+      "step": 580
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 1.131765604019165,
+      "learning_rate": 0.00010177815410668926,
+      "loss": 0.1955,
+      "step": 585
+    },
+    {
+      "epoch": 2.489451476793249,
+      "grad_norm": 0.8004549145698547,
+      "learning_rate": 0.00010093141405588485,
+      "loss": 0.1873,
+      "step": 590
+    },
+    {
+      "epoch": 2.510548523206751,
+      "grad_norm": 0.8315241932868958,
+      "learning_rate": 0.00010008467400508044,
+      "loss": 0.1843,
+      "step": 595
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 0.8431430459022522,
+      "learning_rate": 9.923793395427604e-05,
+      "loss": 0.1942,
+      "step": 600
+    },
+    {
+      "epoch": 2.5527426160337554,
+      "grad_norm": 0.8936229944229126,
+      "learning_rate": 9.839119390347164e-05,
+      "loss": 0.1918,
+      "step": 605
+    },
+    {
+      "epoch": 2.5738396624472575,
+      "grad_norm": 0.9152116775512695,
+      "learning_rate": 9.754445385266724e-05,
+      "loss": 0.1994,
+      "step": 610
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 0.7673624157905579,
+      "learning_rate": 9.669771380186283e-05,
+      "loss": 0.1862,
+      "step": 615
+    },
+    {
+      "epoch": 2.6160337552742616,
+      "grad_norm": 0.7213599681854248,
+      "learning_rate": 9.585097375105842e-05,
+      "loss": 0.183,
+      "step": 620
+    },
+    {
+      "epoch": 2.6371308016877637,
+      "grad_norm": 0.9323659539222717,
+      "learning_rate": 9.500423370025403e-05,
+      "loss": 0.1892,
+      "step": 625
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.7224115133285522,
+      "learning_rate": 9.415749364944962e-05,
+      "loss": 0.1906,
+      "step": 630
+    },
+    {
+      "epoch": 2.679324894514768,
+      "grad_norm": 1.0357307195663452,
+      "learning_rate": 9.331075359864522e-05,
+      "loss": 0.1913,
+      "step": 635
+    },
+    {
+      "epoch": 2.70042194092827,
+      "grad_norm": 0.8100070357322693,
+      "learning_rate": 9.246401354784083e-05,
+      "loss": 0.1851,
+      "step": 640
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 1.022112250328064,
+      "learning_rate": 9.161727349703642e-05,
+      "loss": 0.1977,
+      "step": 645
+    },
+    {
+      "epoch": 2.742616033755274,
+      "grad_norm": 0.8289423584938049,
+      "learning_rate": 9.077053344623201e-05,
+      "loss": 0.1968,
+      "step": 650
+    },
+    {
+      "epoch": 2.7637130801687766,
+      "grad_norm": 1.2581491470336914,
+      "learning_rate": 8.992379339542762e-05,
+      "loss": 0.1897,
+      "step": 655
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 0.846420407295227,
+      "learning_rate": 8.907705334462321e-05,
+      "loss": 0.1923,
+      "step": 660
+    },
+    {
+      "epoch": 2.8059071729957807,
+      "grad_norm": 0.9414570331573486,
+      "learning_rate": 8.82303132938188e-05,
+      "loss": 0.1787,
+      "step": 665
+    },
+    {
+      "epoch": 2.827004219409283,
+      "grad_norm": 1.0424678325653076,
+      "learning_rate": 8.738357324301439e-05,
+      "loss": 0.1874,
+      "step": 670
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 1.056854248046875,
+      "learning_rate": 8.653683319221e-05,
+      "loss": 0.1963,
+      "step": 675
+    },
+    {
+      "epoch": 2.869198312236287,
+      "grad_norm": 0.8551703095436096,
+      "learning_rate": 8.569009314140559e-05,
+      "loss": 0.1925,
+      "step": 680
+    },
+    {
+      "epoch": 2.890295358649789,
+      "grad_norm": 0.8861784338951111,
+      "learning_rate": 8.484335309060119e-05,
+      "loss": 0.1851,
+      "step": 685
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 1.051079273223877,
+      "learning_rate": 8.39966130397968e-05,
+      "loss": 0.1849,
+      "step": 690
+    },
+    {
+      "epoch": 2.932489451476793,
+      "grad_norm": 0.9021926522254944,
+      "learning_rate": 8.314987298899239e-05,
+      "loss": 0.1883,
+      "step": 695
+    },
+    {
+      "epoch": 2.9535864978902953,
+      "grad_norm": 1.1243478059768677,
+      "learning_rate": 8.230313293818798e-05,
+      "loss": 0.1928,
+      "step": 700
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 0.776346743106842,
+      "learning_rate": 8.145639288738358e-05,
+      "loss": 0.1778,
+      "step": 705
+    },
+    {
+      "epoch": 2.9957805907173,
+      "grad_norm": 0.7797594666481018,
+      "learning_rate": 8.060965283657918e-05,
+      "loss": 0.1807,
+      "step": 710
+    },
+    {
+      "epoch": 3.0168776371308015,
+      "grad_norm": 0.6612173914909363,
+      "learning_rate": 7.976291278577477e-05,
+      "loss": 0.1313,
+      "step": 715
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 0.507293701171875,
+      "learning_rate": 7.891617273497037e-05,
+      "loss": 0.1105,
+      "step": 720
+    },
+    {
+      "epoch": 3.059071729957806,
+      "grad_norm": 1.3071284294128418,
+      "learning_rate": 7.806943268416596e-05,
+      "loss": 0.1106,
+      "step": 725
+    },
+    {
+      "epoch": 3.080168776371308,
+      "grad_norm": 1.0598982572555542,
+      "learning_rate": 7.722269263336155e-05,
+      "loss": 0.1105,
+      "step": 730
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 0.7552915215492249,
+      "learning_rate": 7.637595258255716e-05,
+      "loss": 0.1174,
+      "step": 735
+    },
+    {
+      "epoch": 3.1223628691983123,
+      "grad_norm": 0.6637086868286133,
+      "learning_rate": 7.552921253175276e-05,
+      "loss": 0.1123,
+      "step": 740
+    },
+    {
+      "epoch": 3.1434599156118144,
+      "grad_norm": 0.6471919417381287,
+      "learning_rate": 7.468247248094836e-05,
+      "loss": 0.1179,
+      "step": 745
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 0.6427778005599976,
+      "learning_rate": 7.383573243014395e-05,
+      "loss": 0.111,
+      "step": 750
+    },
+    {
+      "epoch": 3.1856540084388185,
+      "grad_norm": 0.8144406080245972,
+      "learning_rate": 7.298899237933955e-05,
+      "loss": 0.1172,
+      "step": 755
+    },
+    {
+      "epoch": 3.2067510548523206,
+      "grad_norm": 0.557647705078125,
+      "learning_rate": 7.214225232853514e-05,
+      "loss": 0.1128,
+      "step": 760
+    },
+    {
+      "epoch": 3.2278481012658227,
+      "grad_norm": 0.8724661469459534,
+      "learning_rate": 7.129551227773073e-05,
+      "loss": 0.1198,
+      "step": 765
+    },
+    {
+      "epoch": 3.2489451476793247,
+      "grad_norm": 0.8053642511367798,
+      "learning_rate": 7.044877222692634e-05,
+      "loss": 0.1183,
+      "step": 770
+    },
+    {
+      "epoch": 3.270042194092827,
+      "grad_norm": 1.0730928182601929,
+      "learning_rate": 6.960203217612193e-05,
+      "loss": 0.1157,
+      "step": 775
+    },
+    {
+      "epoch": 3.291139240506329,
+      "grad_norm": 0.8512837886810303,
+      "learning_rate": 6.875529212531752e-05,
+      "loss": 0.117,
+      "step": 780
+    },
+    {
+      "epoch": 3.3122362869198314,
+      "grad_norm": 0.6452792882919312,
+      "learning_rate": 6.790855207451313e-05,
+      "loss": 0.1203,
+      "step": 785
+    },
+    {
+      "epoch": 3.3333333333333335,
+      "grad_norm": 1.0139598846435547,
+      "learning_rate": 6.706181202370873e-05,
+      "loss": 0.1191,
+      "step": 790
+    },
+    {
+      "epoch": 3.3544303797468356,
+      "grad_norm": 0.8049492239952087,
+      "learning_rate": 6.621507197290432e-05,
+      "loss": 0.1195,
+      "step": 795
+    },
+    {
+      "epoch": 3.3755274261603376,
+      "grad_norm": 0.7811105251312256,
+      "learning_rate": 6.536833192209993e-05,
+      "loss": 0.1155,
+      "step": 800
+    },
+    {
+      "epoch": 3.3966244725738397,
+      "grad_norm": 0.7017205357551575,
+      "learning_rate": 6.452159187129552e-05,
+      "loss": 0.1142,
+      "step": 805
+    },
+    {
+      "epoch": 3.4177215189873418,
+      "grad_norm": 0.8031386137008667,
+      "learning_rate": 6.367485182049111e-05,
+      "loss": 0.1172,
+      "step": 810
+    },
+    {
+      "epoch": 3.438818565400844,
+      "grad_norm": 0.9530389904975891,
+      "learning_rate": 6.28281117696867e-05,
+      "loss": 0.1156,
+      "step": 815
+    },
+    {
+      "epoch": 3.459915611814346,
+      "grad_norm": 0.681145966053009,
+      "learning_rate": 6.198137171888231e-05,
+      "loss": 0.1116,
+      "step": 820
+    },
+    {
+      "epoch": 3.481012658227848,
+      "grad_norm": 0.7290719151496887,
+      "learning_rate": 6.11346316680779e-05,
+      "loss": 0.1145,
+      "step": 825
+    },
+    {
+      "epoch": 3.50210970464135,
+      "grad_norm": 0.8378763794898987,
+      "learning_rate": 6.0287891617273496e-05,
+      "loss": 0.1167,
+      "step": 830
+    },
+    {
+      "epoch": 3.523206751054852,
+      "grad_norm": 0.7045923471450806,
+      "learning_rate": 5.94411515664691e-05,
+      "loss": 0.1131,
+      "step": 835
+    },
+    {
+      "epoch": 3.5443037974683547,
+      "grad_norm": 0.6490755081176758,
+      "learning_rate": 5.859441151566469e-05,
+      "loss": 0.1082,
+      "step": 840
+    },
+    {
+      "epoch": 3.5654008438818563,
+      "grad_norm": 0.7876132726669312,
+      "learning_rate": 5.7747671464860284e-05,
+      "loss": 0.1199,
+      "step": 845
+    },
+    {
+      "epoch": 3.586497890295359,
+      "grad_norm": 0.7024048566818237,
+      "learning_rate": 5.690093141405589e-05,
+      "loss": 0.1211,
+      "step": 850
+    },
+    {
+      "epoch": 3.607594936708861,
+      "grad_norm": 0.6573346853256226,
+      "learning_rate": 5.605419136325149e-05,
+      "loss": 0.1124,
+      "step": 855
+    },
+    {
+      "epoch": 3.628691983122363,
+      "grad_norm": 0.6605643033981323,
+      "learning_rate": 5.520745131244708e-05,
+      "loss": 0.1145,
+      "step": 860
+    },
+    {
+      "epoch": 3.649789029535865,
+      "grad_norm": 0.9532989859580994,
+      "learning_rate": 5.436071126164268e-05,
+      "loss": 0.1175,
+      "step": 865
+    },
+    {
+      "epoch": 3.670886075949367,
+      "grad_norm": 0.8012579083442688,
+      "learning_rate": 5.3513971210838275e-05,
+      "loss": 0.1084,
+      "step": 870
+    },
+    {
+      "epoch": 3.691983122362869,
+      "grad_norm": 0.6036604642868042,
+      "learning_rate": 5.266723116003387e-05,
+      "loss": 0.1195,
+      "step": 875
+    },
+    {
+      "epoch": 3.7130801687763713,
+      "grad_norm": 0.8136915564537048,
+      "learning_rate": 5.182049110922948e-05,
+      "loss": 0.117,
+      "step": 880
+    },
+    {
+      "epoch": 3.7341772151898733,
+      "grad_norm": 0.7303801774978638,
+      "learning_rate": 5.097375105842507e-05,
+      "loss": 0.12,
+      "step": 885
+    },
+    {
+      "epoch": 3.7552742616033754,
+      "grad_norm": 0.6088728904724121,
+      "learning_rate": 5.012701100762066e-05,
+      "loss": 0.123,
+      "step": 890
+    },
+    {
+      "epoch": 3.7763713080168775,
+      "grad_norm": 0.7355825901031494,
+      "learning_rate": 4.928027095681626e-05,
+      "loss": 0.1122,
+      "step": 895
+    },
+    {
+      "epoch": 3.7974683544303796,
+      "grad_norm": 0.7765938639640808,
+      "learning_rate": 4.8433530906011857e-05,
+      "loss": 0.1184,
+      "step": 900
+    },
+    {
+      "epoch": 3.818565400843882,
+      "grad_norm": 0.7499243021011353,
+      "learning_rate": 4.7586790855207455e-05,
+      "loss": 0.1179,
+      "step": 905
+    },
+    {
+      "epoch": 3.8396624472573837,
+      "grad_norm": 0.6993740200996399,
+      "learning_rate": 4.674005080440305e-05,
+      "loss": 0.1189,
+      "step": 910
+    },
+    {
+      "epoch": 3.8607594936708862,
+      "grad_norm": 0.9036173820495605,
+      "learning_rate": 4.5893310753598644e-05,
+      "loss": 0.1147,
+      "step": 915
+    },
+    {
+      "epoch": 3.8818565400843883,
+      "grad_norm": 0.8140806555747986,
+      "learning_rate": 4.504657070279424e-05,
+      "loss": 0.1218,
+      "step": 920
+    },
+    {
+      "epoch": 3.9029535864978904,
+      "grad_norm": 0.7361952662467957,
+      "learning_rate": 4.419983065198984e-05,
+      "loss": 0.1183,
+      "step": 925
+    },
+    {
+      "epoch": 3.9240506329113924,
+      "grad_norm": 0.8502449989318848,
+      "learning_rate": 4.335309060118544e-05,
+      "loss": 0.1109,
+      "step": 930
+    },
+    {
+      "epoch": 3.9451476793248945,
+      "grad_norm": 0.8034221529960632,
+      "learning_rate": 4.250635055038104e-05,
+      "loss": 0.1192,
+      "step": 935
+    },
+    {
+      "epoch": 3.9662447257383966,
+      "grad_norm": 0.6105166673660278,
+      "learning_rate": 4.1659610499576635e-05,
+      "loss": 0.116,
+      "step": 940
+    },
+    {
+      "epoch": 3.9873417721518987,
+      "grad_norm": 1.0857540369033813,
+      "learning_rate": 4.0812870448772226e-05,
+      "loss": 0.1154,
+      "step": 945
+    },
+    {
+      "epoch": 4.008438818565401,
+      "grad_norm": 0.33604809641838074,
+      "learning_rate": 3.9966130397967824e-05,
+      "loss": 0.1024,
+      "step": 950
+    },
+    {
+      "epoch": 4.029535864978903,
+      "grad_norm": 0.5442842841148376,
+      "learning_rate": 3.911939034716342e-05,
+      "loss": 0.0858,
+      "step": 955
+    },
+    {
+      "epoch": 4.050632911392405,
+      "grad_norm": 0.5701608061790466,
+      "learning_rate": 3.827265029635902e-05,
+      "loss": 0.0892,
+      "step": 960
+    },
+    {
+      "epoch": 4.071729957805907,
+      "grad_norm": 0.3957703709602356,
+      "learning_rate": 3.742591024555462e-05,
+      "loss": 0.0877,
+      "step": 965
+    },
+    {
+      "epoch": 4.0928270042194095,
+      "grad_norm": 0.371354877948761,
+      "learning_rate": 3.657917019475021e-05,
+      "loss": 0.0865,
+      "step": 970
+    },
+    {
+      "epoch": 4.113924050632911,
+      "grad_norm": 0.5058160424232483,
+      "learning_rate": 3.573243014394581e-05,
+      "loss": 0.0882,
+      "step": 975
+    },
+    {
+      "epoch": 4.135021097046414,
+      "grad_norm": 0.49639376997947693,
+      "learning_rate": 3.488569009314141e-05,
+      "loss": 0.088,
+      "step": 980
+    },
+    {
+      "epoch": 4.156118143459915,
+      "grad_norm": 0.5311477184295654,
+      "learning_rate": 3.4038950042337004e-05,
+      "loss": 0.0894,
+      "step": 985
+    },
+    {
+      "epoch": 4.177215189873418,
+      "grad_norm": 0.4310266673564911,
+      "learning_rate": 3.31922099915326e-05,
+      "loss": 0.0853,
+      "step": 990
+    },
+    {
+      "epoch": 4.198312236286919,
+      "grad_norm": 0.4377863109111786,
+      "learning_rate": 3.2345469940728194e-05,
+      "loss": 0.0895,
+      "step": 995
+    },
+    {
+      "epoch": 4.219409282700422,
+      "grad_norm": 0.4411632716655731,
+      "learning_rate": 3.149872988992379e-05,
+      "loss": 0.0858,
+      "step": 1000
+    },
+    {
+      "epoch": 4.2405063291139244,
+      "grad_norm": 0.4312892258167267,
+      "learning_rate": 3.06519898391194e-05,
+      "loss": 0.0865,
+      "step": 1005
+    },
+    {
+      "epoch": 4.261603375527426,
+      "grad_norm": 0.48249074816703796,
+      "learning_rate": 2.9805249788314988e-05,
+      "loss": 0.0885,
+      "step": 1010
+    },
+    {
+      "epoch": 4.282700421940929,
+      "grad_norm": 0.4281006455421448,
+      "learning_rate": 2.8958509737510586e-05,
+      "loss": 0.0877,
+      "step": 1015
+    },
+    {
+      "epoch": 4.30379746835443,
+      "grad_norm": 0.44332534074783325,
+      "learning_rate": 2.8111769686706184e-05,
+      "loss": 0.0867,
+      "step": 1020
+    },
+    {
+      "epoch": 4.324894514767933,
+      "grad_norm": 0.6484013199806213,
+      "learning_rate": 2.726502963590178e-05,
+      "loss": 0.0852,
+      "step": 1025
+    },
+    {
+      "epoch": 4.345991561181434,
+      "grad_norm": 0.6490495800971985,
+      "learning_rate": 2.6418289585097377e-05,
+      "loss": 0.0864,
+      "step": 1030
+    },
+    {
+      "epoch": 4.367088607594937,
+      "grad_norm": 0.39228200912475586,
+      "learning_rate": 2.5571549534292972e-05,
+      "loss": 0.0865,
+      "step": 1035
+    },
+    {
+      "epoch": 4.3881856540084385,
+      "grad_norm": 0.35557374358177185,
+      "learning_rate": 2.472480948348857e-05,
+      "loss": 0.0882,
+      "step": 1040
+    },
+    {
+      "epoch": 4.409282700421941,
+      "grad_norm": 0.42169108986854553,
+      "learning_rate": 2.3878069432684165e-05,
+      "loss": 0.0887,
+      "step": 1045
+    },
+    {
+      "epoch": 4.430379746835443,
+      "grad_norm": 0.5252233743667603,
+      "learning_rate": 2.3031329381879763e-05,
+      "loss": 0.0895,
+      "step": 1050
+    },
+    {
+      "epoch": 4.451476793248945,
+      "grad_norm": 0.570933997631073,
+      "learning_rate": 2.218458933107536e-05,
+      "loss": 0.0883,
+      "step": 1055
+    },
+    {
+      "epoch": 4.472573839662447,
+      "grad_norm": 0.3964381217956543,
+      "learning_rate": 2.133784928027096e-05,
+      "loss": 0.0891,
+      "step": 1060
+    },
+    {
+      "epoch": 4.493670886075949,
+      "grad_norm": 0.4536195397377014,
+      "learning_rate": 2.0491109229466554e-05,
+      "loss": 0.088,
+      "step": 1065
+    },
+    {
+      "epoch": 4.514767932489452,
+      "grad_norm": 0.5152313709259033,
+      "learning_rate": 1.964436917866215e-05,
+      "loss": 0.087,
+      "step": 1070
+    },
+    {
+      "epoch": 4.5358649789029535,
+      "grad_norm": 0.5284417271614075,
+      "learning_rate": 1.879762912785775e-05,
+      "loss": 0.0883,
+      "step": 1075
+    },
+    {
+      "epoch": 4.556962025316456,
+      "grad_norm": 0.4852566123008728,
+      "learning_rate": 1.7950889077053345e-05,
+      "loss": 0.0886,
+      "step": 1080
+    },
+    {
+      "epoch": 4.578059071729958,
+      "grad_norm": 0.583495020866394,
+      "learning_rate": 1.7104149026248943e-05,
+      "loss": 0.0875,
+      "step": 1085
+    },
+    {
+      "epoch": 4.59915611814346,
+      "grad_norm": 0.7808001041412354,
+      "learning_rate": 1.6257408975444538e-05,
+      "loss": 0.0907,
+      "step": 1090
+    },
+    {
+      "epoch": 4.620253164556962,
+      "grad_norm": 0.5401718020439148,
+      "learning_rate": 1.5410668924640136e-05,
+      "loss": 0.0875,
+      "step": 1095
+    },
+    {
+      "epoch": 4.641350210970464,
+      "grad_norm": 0.9466884732246399,
+      "learning_rate": 1.4563928873835734e-05,
+      "loss": 0.0886,
+      "step": 1100
+    },
+    {
+      "epoch": 4.662447257383966,
+      "grad_norm": 0.29860377311706543,
+      "learning_rate": 1.3717188823031329e-05,
+      "loss": 0.086,
+      "step": 1105
+    },
+    {
+      "epoch": 4.6835443037974684,
+      "grad_norm": 0.6763022541999817,
+      "learning_rate": 1.2870448772226925e-05,
+      "loss": 0.0897,
+      "step": 1110
+    },
+    {
+      "epoch": 4.70464135021097,
+      "grad_norm": 0.483489453792572,
+      "learning_rate": 1.2023708721422523e-05,
+      "loss": 0.0875,
+      "step": 1115
+    },
+    {
+      "epoch": 4.725738396624473,
+      "grad_norm": 0.4364100396633148,
+      "learning_rate": 1.1176968670618121e-05,
+      "loss": 0.0899,
+      "step": 1120
+    },
+    {
+      "epoch": 4.746835443037975,
+      "grad_norm": 0.420934796333313,
+      "learning_rate": 1.0330228619813718e-05,
+      "loss": 0.0954,
+      "step": 1125
+    },
+    {
+      "epoch": 4.767932489451477,
+      "grad_norm": 0.45841994881629944,
+      "learning_rate": 9.483488569009314e-06,
+      "loss": 0.0926,
+      "step": 1130
+    },
+    {
+      "epoch": 4.789029535864979,
+      "grad_norm": 0.38524097204208374,
+      "learning_rate": 8.63674851820491e-06,
+      "loss": 0.0871,
+      "step": 1135
+    },
+    {
+      "epoch": 4.810126582278481,
+      "grad_norm": 0.483544260263443,
+      "learning_rate": 7.790008467400509e-06,
+      "loss": 0.0886,
+      "step": 1140
+    },
+    {
+      "epoch": 4.831223628691983,
+      "grad_norm": 0.34914860129356384,
+      "learning_rate": 6.943268416596105e-06,
+      "loss": 0.0868,
+      "step": 1145
+    },
+    {
+      "epoch": 4.852320675105485,
+      "grad_norm": 0.4578697979450226,
+      "learning_rate": 6.0965283657917025e-06,
+      "loss": 0.0856,
+      "step": 1150
+    },
+    {
+      "epoch": 4.8734177215189876,
+      "grad_norm": 0.6923444867134094,
+      "learning_rate": 5.2497883149873e-06,
+      "loss": 0.0916,
+      "step": 1155
+    },
+    {
+      "epoch": 4.894514767932489,
+      "grad_norm": 0.45712846517562866,
+      "learning_rate": 4.403048264182896e-06,
+      "loss": 0.0873,
+      "step": 1160
+    },
+    {
+      "epoch": 4.915611814345992,
+      "grad_norm": 0.4599502980709076,
+      "learning_rate": 3.556308213378493e-06,
+      "loss": 0.0879,
+      "step": 1165
+    },
+    {
+      "epoch": 4.936708860759493,
+      "grad_norm": 0.488707035779953,
+      "learning_rate": 2.70956816257409e-06,
+      "loss": 0.0897,
+      "step": 1170
+    },
+    {
+      "epoch": 4.957805907172996,
+      "grad_norm": 0.431192547082901,
+      "learning_rate": 1.8628281117696868e-06,
+      "loss": 0.09,
+      "step": 1175
+    },
+    {
+      "epoch": 4.978902953586498,
+      "grad_norm": 0.4152582883834839,
+      "learning_rate": 1.0160880609652836e-06,
+      "loss": 0.0881,
+      "step": 1180
+    },
+    {
+      "epoch": 5.0,
+      "grad_norm": 0.6306803226470947,
+      "learning_rate": 1.6934801016088062e-07,
+      "loss": 0.0901,
+      "step": 1185
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 1185,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 1.0283098572693504e+17,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/de-en-pt/checkpoint-1185/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90ab3a9fa29389fcc75044c7a844775cffa8e2fb7bf0776e9fe9b32a837e2a1c
+size 6289

experiments/de-en-pt/checkpoint-500/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/de-en-pt/checkpoint-500/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/de-en-pt/checkpoint-500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec3e066b63933c3c5f799734b3866b1f2bf34d59e9915f2ef3dd488d315ca536
+size 83945296

experiments/de-en-pt/checkpoint-500/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/de-en-pt/checkpoint-500/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aeecaa51bd6e141fed4a15928356e87c64f30e64d81df6ac363762f1287d7105
+size 43123429

experiments/de-en-pt/checkpoint-500/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:82fe079a144d175f53fe32dd3be242c84edc439a7486d4331c2d82ed5ceabdb7
+size 14645

experiments/de-en-pt/checkpoint-500/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e89078bc60a6a3c2a7afc4e1158511b7c082ba88748adc4456b022f3c364fc03
+size 1465

experiments/de-en-pt/checkpoint-500/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/de-en-pt/checkpoint-500/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/de-en-pt/checkpoint-500/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/de-en-pt/checkpoint-500/trainer_state.json

@@ -0,0 +1,734 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 2.109704641350211,
+  "eval_steps": 500,
+  "global_step": 500,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.02109704641350211,
+      "grad_norm": 7.303770542144775,
+      "learning_rate": 0.0002,
+      "loss": 2.7397,
+      "step": 5
+    },
+    {
+      "epoch": 0.04219409282700422,
+      "grad_norm": 1.8467751741409302,
+      "learning_rate": 0.00019915325994919561,
+      "loss": 0.8472,
+      "step": 10
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 1.7855145931243896,
+      "learning_rate": 0.0001983065198983912,
+      "loss": 0.5618,
+      "step": 15
+    },
+    {
+      "epoch": 0.08438818565400844,
+      "grad_norm": 1.1616630554199219,
+      "learning_rate": 0.0001974597798475868,
+      "loss": 0.4699,
+      "step": 20
+    },
+    {
+      "epoch": 0.10548523206751055,
+      "grad_norm": 0.6415855884552002,
+      "learning_rate": 0.0001966130397967824,
+      "loss": 0.4624,
+      "step": 25
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 1.1393471956253052,
+      "learning_rate": 0.000195766299745978,
+      "loss": 0.5064,
+      "step": 30
+    },
+    {
+      "epoch": 0.14767932489451477,
+      "grad_norm": 0.7702832818031311,
+      "learning_rate": 0.00019491955969517358,
+      "loss": 0.5226,
+      "step": 35
+    },
+    {
+      "epoch": 0.16877637130801687,
+      "grad_norm": 0.7905811071395874,
+      "learning_rate": 0.0001940728196443692,
+      "loss": 0.5235,
+      "step": 40
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 0.8080295920372009,
+      "learning_rate": 0.00019322607959356477,
+      "loss": 0.4923,
+      "step": 45
+    },
+    {
+      "epoch": 0.2109704641350211,
+      "grad_norm": 0.7102531790733337,
+      "learning_rate": 0.00019237933954276037,
+      "loss": 0.4861,
+      "step": 50
+    },
+    {
+      "epoch": 0.2320675105485232,
+      "grad_norm": 0.6320513486862183,
+      "learning_rate": 0.00019153259949195598,
+      "loss": 0.4758,
+      "step": 55
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 0.5483996272087097,
+      "learning_rate": 0.00019068585944115158,
+      "loss": 0.4846,
+      "step": 60
+    },
+    {
+      "epoch": 0.2742616033755274,
+      "grad_norm": 0.5805549621582031,
+      "learning_rate": 0.0001898391193903472,
+      "loss": 0.4207,
+      "step": 65
+    },
+    {
+      "epoch": 0.29535864978902954,
+      "grad_norm": 0.6124007701873779,
+      "learning_rate": 0.00018899237933954276,
+      "loss": 0.4838,
+      "step": 70
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 0.6392915844917297,
+      "learning_rate": 0.00018814563928873837,
+      "loss": 0.4557,
+      "step": 75
+    },
+    {
+      "epoch": 0.33755274261603374,
+      "grad_norm": 0.6733785271644592,
+      "learning_rate": 0.00018729889923793395,
+      "loss": 0.4884,
+      "step": 80
+    },
+    {
+      "epoch": 0.35864978902953587,
+      "grad_norm": 0.6744979023933411,
+      "learning_rate": 0.00018645215918712955,
+      "loss": 0.4421,
+      "step": 85
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 0.647033154964447,
+      "learning_rate": 0.00018560541913632516,
+      "loss": 0.4404,
+      "step": 90
+    },
+    {
+      "epoch": 0.4008438818565401,
+      "grad_norm": 0.6323936581611633,
+      "learning_rate": 0.00018475867908552076,
+      "loss": 0.4299,
+      "step": 95
+    },
+    {
+      "epoch": 0.4219409282700422,
+      "grad_norm": 0.6895705461502075,
+      "learning_rate": 0.00018391193903471634,
+      "loss": 0.4567,
+      "step": 100
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 1.326171636581421,
+      "learning_rate": 0.00018306519898391194,
+      "loss": 0.4587,
+      "step": 105
+    },
+    {
+      "epoch": 0.4641350210970464,
+      "grad_norm": 0.7596874833106995,
+      "learning_rate": 0.00018221845893310755,
+      "loss": 0.4527,
+      "step": 110
+    },
+    {
+      "epoch": 0.48523206751054854,
+      "grad_norm": 0.5594536066055298,
+      "learning_rate": 0.00018137171888230313,
+      "loss": 0.4433,
+      "step": 115
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 0.5562201142311096,
+      "learning_rate": 0.00018052497883149876,
+      "loss": 0.4655,
+      "step": 120
+    },
+    {
+      "epoch": 0.5274261603375527,
+      "grad_norm": 0.5696616172790527,
+      "learning_rate": 0.00017967823878069434,
+      "loss": 0.4169,
+      "step": 125
+    },
+    {
+      "epoch": 0.5485232067510548,
+      "grad_norm": 0.872970700263977,
+      "learning_rate": 0.00017883149872988994,
+      "loss": 0.4587,
+      "step": 130
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.8332061171531677,
+      "learning_rate": 0.00017798475867908552,
+      "loss": 0.4137,
+      "step": 135
+    },
+    {
+      "epoch": 0.5907172995780591,
+      "grad_norm": 0.6869994401931763,
+      "learning_rate": 0.00017713801862828112,
+      "loss": 0.4625,
+      "step": 140
+    },
+    {
+      "epoch": 0.6118143459915611,
+      "grad_norm": 0.7138175368309021,
+      "learning_rate": 0.0001762912785774767,
+      "loss": 0.4137,
+      "step": 145
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 0.6982415914535522,
+      "learning_rate": 0.00017544453852667233,
+      "loss": 0.4773,
+      "step": 150
+    },
+    {
+      "epoch": 0.6540084388185654,
+      "grad_norm": 0.6468168497085571,
+      "learning_rate": 0.0001745977984758679,
+      "loss": 0.461,
+      "step": 155
+    },
+    {
+      "epoch": 0.6751054852320675,
+      "grad_norm": 0.5886504054069519,
+      "learning_rate": 0.00017375105842506352,
+      "loss": 0.4304,
+      "step": 160
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.6864741444587708,
+      "learning_rate": 0.00017290431837425912,
+      "loss": 0.4319,
+      "step": 165
+    },
+    {
+      "epoch": 0.7172995780590717,
+      "grad_norm": 0.6106663942337036,
+      "learning_rate": 0.0001720575783234547,
+      "loss": 0.4794,
+      "step": 170
+    },
+    {
+      "epoch": 0.7383966244725738,
+      "grad_norm": 0.6986768245697021,
+      "learning_rate": 0.0001712108382726503,
+      "loss": 0.4533,
+      "step": 175
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.6781573295593262,
+      "learning_rate": 0.00017036409822184588,
+      "loss": 0.4825,
+      "step": 180
+    },
+    {
+      "epoch": 0.7805907172995781,
+      "grad_norm": 0.5864121913909912,
+      "learning_rate": 0.00016951735817104151,
+      "loss": 0.4052,
+      "step": 185
+    },
+    {
+      "epoch": 0.8016877637130801,
+      "grad_norm": 0.5869038701057434,
+      "learning_rate": 0.0001686706181202371,
+      "loss": 0.4117,
+      "step": 190
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.6497222781181335,
+      "learning_rate": 0.0001678238780694327,
+      "loss": 0.4596,
+      "step": 195
+    },
+    {
+      "epoch": 0.8438818565400844,
+      "grad_norm": 0.6619230508804321,
+      "learning_rate": 0.00016697713801862828,
+      "loss": 0.4731,
+      "step": 200
+    },
+    {
+      "epoch": 0.8649789029535865,
+      "grad_norm": 0.6095796227455139,
+      "learning_rate": 0.00016613039796782388,
+      "loss": 0.4409,
+      "step": 205
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.6402797698974609,
+      "learning_rate": 0.00016528365791701949,
+      "loss": 0.4306,
+      "step": 210
+    },
+    {
+      "epoch": 0.9071729957805907,
+      "grad_norm": 0.644440233707428,
+      "learning_rate": 0.0001644369178662151,
+      "loss": 0.4417,
+      "step": 215
+    },
+    {
+      "epoch": 0.9282700421940928,
+      "grad_norm": 0.5990755558013916,
+      "learning_rate": 0.0001635901778154107,
+      "loss": 0.4449,
+      "step": 220
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.7246052026748657,
+      "learning_rate": 0.00016274343776460627,
+      "loss": 0.4132,
+      "step": 225
+    },
+    {
+      "epoch": 0.9704641350210971,
+      "grad_norm": 0.7127440571784973,
+      "learning_rate": 0.00016189669771380188,
+      "loss": 0.43,
+      "step": 230
+    },
+    {
+      "epoch": 0.9915611814345991,
+      "grad_norm": 0.5102093815803528,
+      "learning_rate": 0.00016104995766299746,
+      "loss": 0.3763,
+      "step": 235
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.5558840036392212,
+      "learning_rate": 0.00016020321761219306,
+      "loss": 0.3735,
+      "step": 240
+    },
+    {
+      "epoch": 1.0337552742616034,
+      "grad_norm": 0.7372997403144836,
+      "learning_rate": 0.00015935647756138864,
+      "loss": 0.3678,
+      "step": 245
+    },
+    {
+      "epoch": 1.0548523206751055,
+      "grad_norm": 0.6645821332931519,
+      "learning_rate": 0.00015850973751058427,
+      "loss": 0.3348,
+      "step": 250
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.6483216881752014,
+      "learning_rate": 0.00015766299745977985,
+      "loss": 0.3497,
+      "step": 255
+    },
+    {
+      "epoch": 1.0970464135021096,
+      "grad_norm": 0.7461686134338379,
+      "learning_rate": 0.00015681625740897545,
+      "loss": 0.3396,
+      "step": 260
+    },
+    {
+      "epoch": 1.1181434599156117,
+      "grad_norm": 0.7183260917663574,
+      "learning_rate": 0.00015596951735817106,
+      "loss": 0.3331,
+      "step": 265
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.6482828855514526,
+      "learning_rate": 0.00015512277730736664,
+      "loss": 0.3349,
+      "step": 270
+    },
+    {
+      "epoch": 1.160337552742616,
+      "grad_norm": 0.7357110977172852,
+      "learning_rate": 0.00015427603725656224,
+      "loss": 0.3392,
+      "step": 275
+    },
+    {
+      "epoch": 1.1814345991561181,
+      "grad_norm": 0.8033156991004944,
+      "learning_rate": 0.00015342929720575785,
+      "loss": 0.3081,
+      "step": 280
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.8261159658432007,
+      "learning_rate": 0.00015258255715495345,
+      "loss": 0.3289,
+      "step": 285
+    },
+    {
+      "epoch": 1.2236286919831223,
+      "grad_norm": 0.9544351100921631,
+      "learning_rate": 0.00015173581710414903,
+      "loss": 0.3338,
+      "step": 290
+    },
+    {
+      "epoch": 1.2447257383966246,
+      "grad_norm": 0.7345326542854309,
+      "learning_rate": 0.00015088907705334463,
+      "loss": 0.3224,
+      "step": 295
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7424091100692749,
+      "learning_rate": 0.0001500423370025402,
+      "loss": 0.2973,
+      "step": 300
+    },
+    {
+      "epoch": 1.2869198312236287,
+      "grad_norm": 1.0532294511795044,
+      "learning_rate": 0.00014919559695173582,
+      "loss": 0.3243,
+      "step": 305
+    },
+    {
+      "epoch": 1.3080168776371308,
+      "grad_norm": 0.673413097858429,
+      "learning_rate": 0.00014834885690093142,
+      "loss": 0.2981,
+      "step": 310
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 0.7296124696731567,
+      "learning_rate": 0.00014750211685012703,
+      "loss": 0.3273,
+      "step": 315
+    },
+    {
+      "epoch": 1.350210970464135,
+      "grad_norm": 0.7868983149528503,
+      "learning_rate": 0.00014665537679932263,
+      "loss": 0.3315,
+      "step": 320
+    },
+    {
+      "epoch": 1.371308016877637,
+      "grad_norm": 0.618905246257782,
+      "learning_rate": 0.0001458086367485182,
+      "loss": 0.3187,
+      "step": 325
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.7611832618713379,
+      "learning_rate": 0.0001449618966977138,
+      "loss": 0.3273,
+      "step": 330
+    },
+    {
+      "epoch": 1.4135021097046414,
+      "grad_norm": 0.7445492148399353,
+      "learning_rate": 0.0001441151566469094,
+      "loss": 0.3148,
+      "step": 335
+    },
+    {
+      "epoch": 1.4345991561181435,
+      "grad_norm": 0.7893179059028625,
+      "learning_rate": 0.000143268416596105,
+      "loss": 0.3096,
+      "step": 340
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.7259252071380615,
+      "learning_rate": 0.0001424216765453006,
+      "loss": 0.314,
+      "step": 345
+    },
+    {
+      "epoch": 1.4767932489451476,
+      "grad_norm": 0.9332309365272522,
+      "learning_rate": 0.0001415749364944962,
+      "loss": 0.3132,
+      "step": 350
+    },
+    {
+      "epoch": 1.49789029535865,
+      "grad_norm": 0.8386842012405396,
+      "learning_rate": 0.00014072819644369178,
+      "loss": 0.3573,
+      "step": 355
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 0.8299745917320251,
+      "learning_rate": 0.0001398814563928874,
+      "loss": 0.3414,
+      "step": 360
+    },
+    {
+      "epoch": 1.540084388185654,
+      "grad_norm": 0.8027970194816589,
+      "learning_rate": 0.000139034716342083,
+      "loss": 0.301,
+      "step": 365
+    },
+    {
+      "epoch": 1.5611814345991561,
+      "grad_norm": 0.8260971307754517,
+      "learning_rate": 0.00013818797629127857,
+      "loss": 0.3056,
+      "step": 370
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 0.7211348414421082,
+      "learning_rate": 0.0001373412362404742,
+      "loss": 0.3247,
+      "step": 375
+    },
+    {
+      "epoch": 1.6033755274261603,
+      "grad_norm": 0.7652252316474915,
+      "learning_rate": 0.00013649449618966978,
+      "loss": 0.2997,
+      "step": 380
+    },
+    {
+      "epoch": 1.6244725738396624,
+      "grad_norm": 0.8082212805747986,
+      "learning_rate": 0.00013564775613886539,
+      "loss": 0.3311,
+      "step": 385
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.6903911828994751,
+      "learning_rate": 0.00013480101608806096,
+      "loss": 0.3316,
+      "step": 390
+    },
+    {
+      "epoch": 1.6666666666666665,
+      "grad_norm": 0.8441250920295715,
+      "learning_rate": 0.00013395427603725657,
+      "loss": 0.2987,
+      "step": 395
+    },
+    {
+      "epoch": 1.6877637130801688,
+      "grad_norm": 0.6455714106559753,
+      "learning_rate": 0.00013310753598645215,
+      "loss": 0.3235,
+      "step": 400
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.6983484625816345,
+      "learning_rate": 0.00013226079593564775,
+      "loss": 0.3207,
+      "step": 405
+    },
+    {
+      "epoch": 1.729957805907173,
+      "grad_norm": 0.7476673126220703,
+      "learning_rate": 0.00013141405588484336,
+      "loss": 0.322,
+      "step": 410
+    },
+    {
+      "epoch": 1.7510548523206753,
+      "grad_norm": 0.7899746894836426,
+      "learning_rate": 0.00013056731583403896,
+      "loss": 0.2969,
+      "step": 415
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 0.7910045385360718,
+      "learning_rate": 0.00012972057578323457,
+      "loss": 0.3327,
+      "step": 420
+    },
+    {
+      "epoch": 1.7932489451476794,
+      "grad_norm": 0.6791032552719116,
+      "learning_rate": 0.00012887383573243014,
+      "loss": 0.3109,
+      "step": 425
+    },
+    {
+      "epoch": 1.8143459915611815,
+      "grad_norm": 0.7799623012542725,
+      "learning_rate": 0.00012802709568162575,
+      "loss": 0.3081,
+      "step": 430
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 0.7135102152824402,
+      "learning_rate": 0.00012718035563082133,
+      "loss": 0.2824,
+      "step": 435
+    },
+    {
+      "epoch": 1.8565400843881856,
+      "grad_norm": 0.732537567615509,
+      "learning_rate": 0.00012633361558001696,
+      "loss": 0.3364,
+      "step": 440
+    },
+    {
+      "epoch": 1.8776371308016877,
+      "grad_norm": 0.7259167432785034,
+      "learning_rate": 0.00012548687552921254,
+      "loss": 0.326,
+      "step": 445
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 0.828127920627594,
+      "learning_rate": 0.00012464013547840814,
+      "loss": 0.31,
+      "step": 450
+    },
+    {
+      "epoch": 1.9198312236286919,
+      "grad_norm": 0.8551115393638611,
+      "learning_rate": 0.00012379339542760372,
+      "loss": 0.2991,
+      "step": 455
+    },
+    {
+      "epoch": 1.9409282700421941,
+      "grad_norm": 0.8755710124969482,
+      "learning_rate": 0.00012294665537679932,
+      "loss": 0.2978,
+      "step": 460
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.7943766713142395,
+      "learning_rate": 0.00012209991532599493,
+      "loss": 0.2796,
+      "step": 465
+    },
+    {
+      "epoch": 1.9831223628691983,
+      "grad_norm": 0.709699273109436,
+      "learning_rate": 0.0001212531752751905,
+      "loss": 0.3171,
+      "step": 470
+    },
+    {
+      "epoch": 2.0042194092827006,
+      "grad_norm": 0.5481745004653931,
+      "learning_rate": 0.00012040643522438612,
+      "loss": 0.2664,
+      "step": 475
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.8539430499076843,
+      "learning_rate": 0.00011955969517358172,
+      "loss": 0.2146,
+      "step": 480
+    },
+    {
+      "epoch": 2.0464135021097047,
+      "grad_norm": 0.8904210329055786,
+      "learning_rate": 0.00011871295512277731,
+      "loss": 0.1905,
+      "step": 485
+    },
+    {
+      "epoch": 2.067510548523207,
+      "grad_norm": 1.2182245254516602,
+      "learning_rate": 0.00011786621507197291,
+      "loss": 0.1874,
+      "step": 490
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.6917277574539185,
+      "learning_rate": 0.0001170194750211685,
+      "loss": 0.201,
+      "step": 495
+    },
+    {
+      "epoch": 2.109704641350211,
+      "grad_norm": 0.8633620738983154,
+      "learning_rate": 0.0001161727349703641,
+      "loss": 0.1902,
+      "step": 500
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 1185,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 4.344082748153856e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/de-en-pt/checkpoint-500/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90ab3a9fa29389fcc75044c7a844775cffa8e2fb7bf0776e9fe9b32a837e2a1c
+size 6289

experiments/de-en-pt/metrics.json

@@ -0,0 +1,42 @@
+{
+    "zh": {
+        "precision": 0.5764,
+        "recall": 0.5636,
+        "f1": 0.5699
+    },
+    "de": {
+        "precision": 0.7261,
+        "recall": 0.7327,
+        "f1": 0.7294
+    },
+    "en": {
+        "precision": 0.7487,
+        "recall": 0.7645,
+        "f1": 0.7565
+    },
+    "pt": {
+        "precision": 0.6943,
+        "recall": 0.6862,
+        "f1": 0.6902
+    },
+    "hr": {
+        "precision": 0.6389,
+        "recall": 0.6281,
+        "f1": 0.6334
+    },
+    "sk": {
+        "precision": 0.643,
+        "recall": 0.638,
+        "f1": 0.6405
+    },
+    "sw": {
+        "precision": 0.4715,
+        "recall": 0.4525,
+        "f1": 0.4618
+    },
+    "vi": {
+        "precision": 0.6463,
+        "recall": 0.6328,
+        "f1": 0.6395
+    }
+}

experiments/de-en-pt/preds_en.csv

@@ -0,0 +1,539 @@
+input,gold,pred
+I waited for 10-15 minutes for service ordered a beer & was never served again .,"{service general, service, negative}","{service general, service, negative}"
+The ambiance was a peaceful and relaxing break amongst all the kids running around in Downtown Disney .,"{ambience general, ambiance, positive}","{ambience general, ambiance, positive}"
+hidden little jem,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+I went there with a friend from out of town ... and we were both very impressed !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+It has great sushi and even better service .,"{service general, service, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{service general, service, positive}"
+"All their menu items are a hit , and they serve mimosas .","{food quality, menu items, positive}","{drinks quality, mimosas, positive};{food quality, menu items, positive}"
+– ... and the best summertime deck experience -- they will even bring you a blanket if you get cold in the Seattle evening weather .,"{ambience general, deck, positive};{service general, null, positive}","{ambience general, deck, positive}"
+You Ca n't Go Wrong Here .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+I think I have probably tried each item on their menu at least once it is all excellent .,"{food quality, menu, positive}","{food quality, menu, positive}"
+Green tea creme brulee gets better each time I have it .,"{food quality, Green tea creme brulee, positive}","{food quality, green tea creme brulee, positive}"
+not too fine thought that you feel uncomfortable and have to dress up .,"{ambience general, null, positive}","{ambience general, null, negative}"
+Atmosphere was nice .,"{ambience general, Atmosphere, positive}","{ambience general, Atmosphere, positive}"
+absolutely fabulous ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+AVOID THE PLACE,"{restaurant general, PLACE, negative}","{restaurant general, PLACE, negative}"
+"To be honest , I 've had better frozen pizza .","{food quality, pizza, negative}","{food quality, frozen pizza, negative}"
+The service was exceptional - sometime there was a feeling that we were served by the army of friendly waiters .,"{service general, waiters, positive};{service general, service, positive}","{service general, waiters, positive};{service general, service, positive}"
+And they packaged everything nicely so it did n't spill .,"{service general, null, positive}","{food style_options, null, positive}"
+VERY GOOD !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The food is sinful .,"{food quality, food, positive}","{food quality, food, positive}"
+"To start off , approximately 8-10 oz of orange juice will cost you $ 3 .","{drinks prices, orange juice, negative}","{drinks prices, orange juice, negative};{drinks style_options, orange juice, negative}"
+good sake selection .,"{drinks style_options, sake selection, positive}","{drinks style_options, sake selection, positive}"
+"While I could have done without the youth who shared the evening with us , our wonderful server and food made the experience a very positive one .","{service general, server, positive};{restaurant miscellaneous, null, positive};{food quality, food, positive}","{service general, server, positive};{food quality, food, positive};{restaurant miscellaneous, youth, negative}"
+What a find !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Mioposto has a very creative & delicious pizza menu .,"{food style_options, pizza menu, positive};{food quality, pizza menu, positive}","{food style_options, pizza menu, positive};{food quality, pizza, positive}"
+"On a recent trip , our waiter was extremely dismissive , while no less than three staff members waited hand-and-foot on a pair of Japanese girls seated nearby .","{service general, waiter, negative}","{service general, waiter, negative};{service general, staff members, positive}"
+"i would normally not finish the brocolli when i order these kinds of food but for the first time , every piece was as eventful as the first one ... the scallops and prawns was so fresh and nicely cooked .","{food quality, scallops, positive};{food quality, prawns, positive};{food quality, brocolli, positive}","{food quality, scallops and prawns, positive};{food quality, brocolli, positive}"
+It is n't the cheapest sushi but has been worth it every time .,"{food quality, sushi, positive};{food prices, sushi, neutral}","{food prices, sushi, negative};{food quality, sushi, positive}"
+You never feel icky and stuffed after you eat there .,"{food quality, null, positive}","{restaurant general, null, positive}"
+"As part of a small party of four , our food was dropped off without comment ;","{service general, null, negative}","{service general, null, negative}"
+I hope one day Scooner or Later returns to what it once was .,"{restaurant general, Scooner or Later, negative}","{restaurant general, Scooner or Later, negative}"
+"First off , the food came fast and all together : ) i like that ... i hate the pretentiousness of things coming in one after the other .","{service general, null, positive}","{food quality, null, positive};{food style_options, null, positive}"
+The food was great !,"{food quality, food, positive}","{food quality, food, positive}"
+"If there is a line very day of the week for the entire time a place is open , you know it is great .","{restaurant general, place, positive}","{restaurant miscellaneous, place, positive}"
+The most pleasant surprise was the check that did not exceed my expectations as it always happens in most of the places .,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+"At best , the food was good and definately overpriced .","{food quality, food, positive};{food prices, food, negative}","{food quality, food, negative};{food prices, food, negative}"
+The outside patio area has an abbreviated menu .,"{food style_options, menu, neutral}","{food style_options, menu, neutral}"
+Best Indian food in L.A .,"{food quality, Indian food, positive}","{food quality, Indian food, positive}"
+Cut to the chase - this is amazing !,"{restaurant general, null, positive}","{food quality, null, positive}"
+"The food is not what it once was ( potions have seriously seen downsizing ) prices have gone up , and the service is the worst I have experienced anywhere ( including mainland Europe ) .","{food style_options, potions, negative};{service general, service, negative};{food quality, food, negative};{food prices, food, negative}","{food quality, potions, negative};{food style_options, potions, negative};{restaurant prices, null, negative};{service general, service, negative}"
+Lebanese Food ! Yum !,"{food quality, Lebanese Food, positive}","{food quality, Lebanese Food, positive}"
+the brocollis were so fresh and tasty .,"{food quality, brocollis, positive}","{food quality, brocollis, positive}"
+And they give good quantity for the price .,"{food style_options, null, positive}","{food style_options, quantity, positive};{food prices, quantity, positive}"
+Very Disappointing,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Seattle 's BEST Winelist,"{drinks style_options, Winelist, positive}","{drinks style_options, Winelist, positive}"
+– I ca n't say enough about this place .,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+– i have been eating at this place for over 8 years now and i have never had one bad meal .,"{food quality, meal, positive}","{food quality, meal, positive}"
+I went home & looked them up online again where I discovered there is a link for a give away that doesn 't work so emailed the restaurant about the non existent service & deceptive link .,"{restaurant miscellaneous, restaurant, negative}","{service general, service, negative};{restaurant miscellaneous, restaurant, negative}"
+Fancy pieces of exotic fish on a $ 100 dollar plate and NOT ONE was eatable .,"{food quality, exotic fish, negative};{food style_options, exotic fish, negative};{food prices, plate, negative}","{food quality, pieces of exotic fish, negative};{food prices, plate, negative}"
+"I had yummy lamb korma , saag paneer , samosas , naan , etc .","{food quality, naan, positive};{food quality, lamb korma, positive};{food quality, saag paneer, positive};{food quality, samosas, positive}","{food quality, lamb korma, positive};{food quality, samosas, positive};{food quality, naan, positive};{food quality, saag paneer, positive}"
+Serves really good sushi .,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"As usual the omikase did n't disappoint in freshness , although it scored low on creativity and selection .","{food style_options, omikase, negative};{food quality, omikase, positive}","{food quality, omikase, positive};{food style_options, omikase, negative}"
+"Rice is too dry , tuna was n't so fresh either .","{food quality, tuna, negative};{food quality, Rice, negative}","{food quality, Rice, negative};{food quality, tuna, negative}"
+Their crab eggs benedict is addicting .,"{food quality, crab eggs benedict, positive}","{food quality, crab eggs benedict, positive}"
+Save room for scrumptious desserts .,"{food quality, desserts, positive}","{food quality, desserts, positive}"
+Our server was very professional and friendly .,"{service general, server, positive}","{service general, server, positive}"
+I went here on a recommendation and will surely return time and time again .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The food was all good but it was way too mild .,"{food quality, food, negative};{food quality, food, positive}","{food quality, food, negative}"
+– My husband and I love eating at Mioposto Café .,"{restaurant general, Mioposto Café, positive}","{restaurant general, Mioposto Café, positive}"
+– This was great dining experience .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The staff was really friendly .,"{service general, staff, positive}","{service general, staff, positive}"
+We easily spent more than $ 40 per person ( not including alcohol ) and were still hungry .,"{restaurant prices, null, negative};{food style_options, null, negative}","{food prices, null, negative};{food quality, null, negative}"
+This is right up there with places in Tokyo as far as the freshness is concerned .,"{food quality, null, positive}","{food quality, null, positive}"
+Groovy music made the dinner casual .,"{ambience general, music, positive}","{ambience general, music, positive}"
+"After one member of our party had been bumped repeatedly by a waitress , a polite request that he not be bumped sent the waitress into an abusive rant .","{service general, waitress, negative}","{service general, waitress, negative}"
+– Ray 's ( suprisingly ) has the city 's BEST & most diverse wine list .,"{drinks style_options, wine list, positive}","{drinks style_options, wine list, positive};{drinks style_options, wine list, diverse}"
+I probably wouldn 't go back though 'cuz I do n't know if it 's worth it .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"The chips and salsa are so yummy , and the prices are fabulous .","{food quality, chips and salsa, positive};{restaurant prices, null, positive}","{restaurant prices, null, positive};{food quality, chips and salsa, positive}"
+"The sommelier is fantastic , down-to-earth , & extremely knowlegable .","{service general, sommelier, positive}","{service general, sommelier, positive}"
+big thick pepperoni,"{food style_options, pepperoni, positive}","{food quality, pepperoni, positive}"
+It is not worth going at all and spend your money there ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Insultingly Overpriced,"{restaurant prices, null, negative}","{food prices, null, negative}"
+Indoor ambience was modern .,"{ambience general, Indoor ambience, positive}","{ambience general, Indoor ambience, positive}"
+DONOT GO !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Untill this happens , my advice is to STAY AWAY .","{restaurant general, null, negative}","{restaurant general, null, negative}"
+Oh I forgot to mention that they do n't have bread service .,"{service general, null, negative}","{service general, null, negative}"
+They are not greasy or anything .,"{food quality, null, positive}","{food quality, null, positive}"
+"The music is great , no night better or worse , the bar tenders are generous with the pouring , and the lighthearted atmosphere will lifts you spirits .","{ambience general, atmosphere, positive};{ambience general, music, positive};{drinks style_options, bar tenders, positive}","{ambience general, atmosphere, positive};{drinks style_options, bar tenders, positive};{ambience general, music, positive}"
+"Nice ambience , but highly overrated place .","{ambience general, ambience, positive};{restaurant general, place, negative}","{restaurant general, place, negative};{ambience general, ambience, positive}"
+The sushi here is delicious !,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"Dinners have always been excellent , in terms of food quality .","{food quality, Dinners, positive}","{food quality, Dinners, positive}"
+Their apps are all delicious .,"{food quality, apps, positive}","{food quality, apps, positive}"
+Blue Ribbon lives up to it 's fantastic reputation .,"{restaurant general, Blue Ribbon, positive}","{restaurant general, Blue Ribbon, positive}"
+I felt ackward and next time went to the casino bathroom .,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+– I decided to eat at Stack because of their price fixed pre-show dinner .,"{food prices, price fixed pre-show dinner, neutral}","{restaurant prices, Stack, positive}"
+– I took my parents here for their anniversary-very very disappointed ! ! !,"{restaurant general, null, negative}","{restaurant miscellaneous, null, negative}"
+Unbeatable sushi !,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"To start things off , our lovely server Brooke was quickly on hand to take my drink order .","{service general, Brooke, positive}","{service general, Brooke, positive}"
+Every time `` 0-sixtynine `` is called the bartender buys everyone drinks !,"{service general, bartender, positive}","{service general, bartender, positive}"
+"Endless fun , awesome music , great staff ! ! !","{restaurant general, null, positive};{ambience general, music, positive};{service general, staff, positive}","{ambience general, music, positive};{restaurant general, null, positive};{service general, staff, positive}"
+Fair menu selection .,"{food style_options, menu selection, neutral}","{food style_options, menu selection, neutral}"
+Two rascally kids were seated near us for the first part of our dinner ... they were replaced by a delightful preteen who pretended to gag every time seafood was mentioned at her table .,"{restaurant miscellaneous, null, negative}","{service general, kids, negative};{service general, preteen, positive}"
+I rejected it because in the process of attempting to fix the eggs they broke something else in the dish and I was too frustrated to continue .,"{food quality, dish, negative}","{food quality, dish, negative}"
+had many dishes but the BEST was the lobster 3 ways .,"{food quality, lobster 3 ways, positive}","{food quality, lobster 3 ways, positive};{food style_options, dishes, positive}"
+"The appetizer was interesting , but the Creme Brulee was very savory and delicious .","{food quality, Creme Brulee, positive};{food quality, appetizer, positive}","{food quality, Creme Brulee, positive};{food quality, appetizer, positive}"
+The decor was beautiful and unique .,"{ambience general, decor, positive}","{ambience general, decor, positive}"
+"It 's fresh , welcoming , delicious , and relaxing .","{food quality, null, positive};{ambience general, null, positive}","{ambience general, null, positive};{food quality, null, positive}"
+Addicting !,"{restaurant general, null, positive}","{food quality, null, positive}"
+"Even the chickpeas , which I normally find too dry , were good .","{food quality, chickpeas, positive}","{food quality, chickpeas, positive}"
+This place rocks ! !,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+"That 's a huge compliment , especially in the fickled restaurant business , ... enough already !","{restaurant general, null, positive}","{restaurant general, null, positive}"
+After sitting there with my empty glass for over 20 minutes I left .,"{service general, null, negative}","{service general, null, negative}"
+Be sure to try the oyster roll .,"{food quality, oyster roll, positive}","{food quality, oyster roll, positive}"
+I 'm astonished that this restaurant is categorized as $ $ $ rather than $ $ $ $ .,"{restaurant prices, restaurant, negative}","{restaurant prices, restaurant, negative}"
+It was decent but nothing exceptional .,"{food quality, null, neutral}","{food quality, null, neutral}"
+"Service was kind of slow , our waitress took forever to give us our check even though it was n't that busy .","{service general, Service, negative};{service general, waitress, negative}","{service general, waitress, negative};{service general, Service, negative}"
+"– Great drinks , corn beef hash , coffee , B Fast burritos , Gluten Free menu .","{food quality, B Fast burritos, positive};{food style_options, menu, positive};{drinks quality, drinks, positive};{food quality, corn beef hash, positive};{drinks quality, coffee, positive}","{food quality, Gluten Free menu, positive};{drinks quality, drinks, positive};{food quality, B Fast burritos, positive};{food quality, corn beef hash, positive};{drinks quality, coffee, positive}"
+The lunch menu is an awesome deal !,"{food prices, lunch menu, positive}","{food prices, lunch menu, positive}"
+"Took forever to get our order taken , water refills were too much to ask for and the only time she was fast was when we asked for our bill when we could get her attention .","{service general, null, negative}","{service general, null, negative}"
+The waiter was a bit unfriendly and the feel of the restaurant was crowded .,"{service general, waiter, negative};{ambience general, feel, negative}","{ambience general, restaurant, negative};{service general, waiter, negative}"
+– I recently had the pleasure of dining as this delightful restaurant on 2nd street and wow what a great evening we had .,"{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+"The specialty here is decadent pancakes , but I 've been back now four times , and I 've been wowed every time .","{food quality, pancakes, positive}","{food quality, pancakes, positive}"
+– Pretty cheap for sit down Mexican AND downtown .,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant prices, null, positive};{restaurant general, null, positive}"
+"The appetizer of oysters , lobster , crab ( small size ) made a perfect entre for my wife .","{food quality, appetizer of oysters , lobster , crab ( small size ), positive}","{food quality, oysters, lobster, crab ( small size ), positive}"
+I just found out that you can have the place to yourself on nights and weekends for a private party - ca n't wait to celebrate my next birthday there .,"{restaurant miscellaneous, place, positive}","{restaurant miscellaneous, place, positive}"
+"– As with most restaurants in Seattle , Mioposto 's service was bad and the food was overpriced .","{service general, service, negative};{food prices, food, negative}","{service general, service, negative};{food prices, food, negative}"
+You can easily hear him though so it was a pleasant sound and not overbearing .,"{ambience general, null, positive}","{ambience general, sound, positive}"
+Just go there and see for yourself .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+It 's a great little place with tons of potential to be a neighborhood joint if the service were n't so impersonal and corporate-like .,"{restaurant general, place, positive};{service general, service, negative}","{restaurant general, place, positive};{service general, service, negative}"
+"Brunch at Murphy 's is to die for , my specialty ... egg white omelet , the food is always freshly prepared .","{food quality, egg white omelet, positive};{food quality, Brunch, positive};{food quality, food, positive}","{food quality, egg white omelet, positive};{food quality, food, positive}"
+Mama Mia – I live in the neighborhood and feel lucky to live by such a great pizza place .,"{restaurant general, pizza place, positive}","{food quality, pizza, positive}"
+– tucked away over by the Beverly Center .,"{location general, null, neutral}","{restaurant miscellaneous, null, neutral}"
+The staff is pretty friendly .,"{service general, staff, positive}","{service general, staff, positive}"
+And the service was simply spendid - quite a delight .,"{service general, service, positive}","{service general, service, positive}"
+Ok ... – Maybe I went in on someone 's bad day ...,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"I 've had the Jellyfish , Horse Mackerel , Blue Fin Tuna and the Sake Ikura roll among others , and they were all good .","{food quality, Horse Mackerel, positive};{food quality, Jellyfish, positive};{food quality, Blue Fin Tuna, positive};{food quality, Sake Ikura roll, positive}","{food quality, Blue Fin Tuna, positive};{food quality, Horse Mackerel, positive};{food quality, Sake Ikura roll, positive};{food quality, Jellyfish, positive}"
+WHAT ELSE CAN YOU SAY NICE PEOPLE AMAZING FOOD WOW,"{food quality, FOOD, positive};{service general, PEOPLE, positive}","{service general, PEOPLE, positive};{food quality, FOOD, positive}"
+Always good .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+My mouth felt very dry afterwards and I had that signature ? MSG ? taste lingering in my throat after I left the restaurant .,"{food quality, null, negative}","{food quality, null, negative}"
+"Oh yeah ... the view was good , too .","{location general, view, positive}","{location general, view, positive}"
+"The manager continually interrupted with `` Is there anything else I can do for you ? `` , a strange comment because she had hardly listened , let alone responded to our expression of disappointment at our experience .","{service general, manager, negative}","{service general, manager, negative}"
+The service ranges from mediocre to offensive .,"{service general, service, negative}","{service general, service, negative}"
+Fresh ingrediants and super tasty .,"{food quality, null, positive};{food quality, ingrediants, positive}","{food quality, ingrediants, positive}"
+the ambiance of the restaurant was nice and good for fine dinning .,"{ambience general, ambiance, positive}","{ambience general, ambiance, positive}"
+And the upstairs is a great place to hang out .,"{ambience general, upstairs, positive}","{ambience general, upstairs, positive}"
+– Not bad .,"{restaurant general, null, neutral}","{restaurant general, null, neutral}"
+I had the Kafta plate and it was perfect .,"{food quality, Kafta plate, positive}","{food quality, Kafta plate, positive}"
+– This place is famous for their breakfast .,"{food quality, breakfast, positive}","{restaurant miscellaneous, place, positive}"
+Waited 35 minutes for a table for 8 which was ok for such a big crowd .,"{service general, null, neutral}","{service general, null, neutral}"
+The entire staff was extremely accomodating and tended to my every need .,"{service general, staff, positive}","{service general, staff, positive}"
+"There was a really nice vibe about the place ... good music , atmosphere and happy looking people .","{ambience general, atmosphere, positive};{ambience general, vibe, positive};{restaurant miscellaneous, people, positive};{ambience general, music, positive}","{ambience general, atmosphere, positive};{ambience general, music, positive};{ambience general, vibe, positive}"
+Try the Chef 's Choice for sushi as the smoked yellowtail was incredible and the rolls were also tasty .,"{food quality, rolls, positive};{food quality, smoked yellowtail, positive}","{food quality, rolls, positive};{food quality, smoked yellowtail, positive}"
+"The sushi is as fresh as it comes ? you 'd think ocean was in their backyard , no joke !","{food quality, sushi, positive}","{food quality, sushi, positive}"
+"food was fine , with a some little-tastier-than-normal salsa .","{food quality, salsa, positive};{food quality, food, positive}","{food quality, salsa, positive};{food quality, food, positive}"
+"For the finicky sushi eater and those who have sampled the best NYC has to offer , the fish is the freshest and the service is superb .","{food quality, fish, positive};{service general, service, positive}","{food quality, fish, positive};{service general, service, positive}"
+Old Reliable,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+One of the best Sushi place in town .,"{restaurant general, Sushi place, positive}","{food quality, Sushi, positive}"
+"Food wise , its ok but a bit pricey for what you get considering the restaurant is n't a fancy place .","{food quality, Food, neutral};{ambience general, restaurant, neutral};{restaurant prices, restaurant, negative}","{restaurant prices, restaurant, negative};{food quality, Food, negative};{food prices, Food, negative}"
+"– Love their pizza , especially the mushroom pizza .","{food quality, pizza, positive};{food quality, mushroom pizza, positive}","{food quality, pizza, positive};{food quality, mushroom pizza, positive}"
+They came in their own nifty take out box and with some homemade frosting ; very light and not-too-sweet .,"{food quality, null, positive}","{food style_options, null, positive};{food quality, null, positive}"
+Enjoyed the food,"{food quality, food, positive}","{food quality, food, positive}"
+I 've been to this restaurant over a dozen times with no complaints to date .,"{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+"Prefer to order it and pick it up though because I do n't like the servers , one young woman in particular .","{service general, young woman, negative};{service general, servers, negative}","{service general, servers, negative}"
+awesome find,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"It was n't the freshest seafood ever , but the taste and presentation was OK .","{food quality, seafood, neutral};{food style_options, seafood, neutral}","{food quality, seafood, negative};{food style_options, seafood, neutral}"
+"However , the value and service are both severely lacking .","{restaurant prices, null, negative};{service general, service, negative}","{restaurant prices, null, negative};{service general, service, negative}"
+In Grammercy/Union Square/East Village this is my neighbors and my favorite spot .,"{restaurant general, spot, positive}","{restaurant general, spot, positive}"
+"The side of potatoes is to die for , as is the labne ( yogurt dip ) .","{food quality, labne ( yogurt dip ), positive};{food quality, side of potatoes, positive}","{food quality, labne ( yogurt dip ), positive};{food quality, side of potatoes, positive}"
+AMAZING .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"What a tastly , flaky treat !","{food quality, null, positive}","{food quality, null, positive}"
+"Great food , better Margaritas !","{drinks quality, Margaritas, positive};{food quality, food, positive}","{drinks quality, Margaritas, positive};{food quality, food, positive}"
+The service is really attentive and charming .,"{service general, service, positive}","{service general, service, positive}"
+"Most importantly , we were so excited about the food after seeing the very creative menu .","{food style_options, menu, positive}","{food style_options, menu, positive}"
+A cozy spot for 2,"{ambience general, spot, positive}","{ambience general, spot, positive}"
+"The best thing is , the prices are also quite reasonable .","{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+"She promised to speak to the waitress who had flown off in a rage , but we could hardly take her promise seriously , seeing as she hadn 't bothered to get the waitresses name .","{service general, null, negative}","{service general, null, negative}"
+The chana masala ( garbanzo beans ) are also excellent .,"{food quality, chana masala ( garbanzo beans ), positive}","{food quality, chana masala ( garbanzo beans ), positive}"
+"This establishment really made a marked decline after ( and this is recurring story ) the airing of FOOD TELEVISIONS `` DINERS , DRIVE-INS , AND DIVES `` hosted by Guy Fieri , in which Schooner or Later was subject of .","{restaurant general, establishment, negative}","{restaurant general, Schooner or Later, negative}"
+I love Dungeness crabs and at Ray 's you can get them served in about 6 different ways !,"{food style_options, Dungeness crabs, positive}","{food style_options, Dungeness crabs, positive}"
+Food was good and appetizing .,"{food quality, Food, positive}","{food quality, Food, positive}"
+It was absolutely amazing .,"{restaurant general, null, positive}","{food quality, null, positive}"
+This is a great place to get a delicious meal .,"{food quality, meal, positive}","{food quality, meal, positive}"
+"plus , i am allergic to rice , and the waitstaff was unbelievably accomodating -- did n't even bat an eye !","{service general, waitstaff, positive}","{service general, waitstaff, positive}"
+– I was highly disappointed in the food at Pagoda .,"{food quality, food, negative}","{food quality, food, negative}"
+Overpriced,"{restaurant prices, null, negative}","{restaurant prices, null, negative}"
+This is sad for what once was one of the best places you could ever eat .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Once you 're inside , the real experience begins .","{restaurant general, null, positive}","{ambience general, null, positive}"
+and the waiter suggested a perfect sake ! !,"{drinks quality, sake, positive}","{drinks quality, sake, positive}"
+The owner is belligerent to guests that have a complaint .,"{service general, owner, negative}","{service general, owner, negative}"
+"Everything you want and more , very fresh .","{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive};{food style_options, null, positive}"
+My friend enjoyed the grilled Alaskan King Salmon with delectable creamed Washington russet potatoes and crisp green beans .,"{food quality, green beans, positive};{food quality, creamed Washington russet potatoes, positive};{food quality, grilled Alaskan King Salmon, positive}","{food quality, grilled Alaskan King Salmon with delectable creamed Washington russet potatoes and crisp green beans, positive}"
+"The food was very good , filet mignon was probably the best I 've ever try .","{food quality, filet mignon, positive};{food quality, food, positive}","{food quality, filet mignon, positive};{food quality, food, positive}"
+"– Mercedes restaurant is so tasty , the service is undeniably awesome !","{food quality, null, positive};{service general, service, positive}","{restaurant general, Mercedes restaurant, positive};{service general, service, positive}"
+I can highly recommend their various saag and paneer and korma .,"{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, saag and paneer and korma, positive}"
+The food is great and they make a mean bloody mary .,"{drinks quality, bloody mary, positive};{food quality, food, positive}","{drinks quality, bloody mary, positive};{food quality, food, positive}"
+Nice food but no spice !,"{food quality, food, negative};{food quality, food, positive}","{food quality, food, negative};{food quality, food, positive}"
+Another plus is the open feel of the restaurant with glass walls on all sides .,"{ambience general, feel, positive}","{ambience general, restaurant, positive}"
+Yum !,"{food quality, null, positive}","{food quality, null, positive}"
+"The bathroom itself is very small with two toilets and only one sink , the girl was staying totally on the way hanging out paper towels from the dispenser .","{restaurant miscellaneous, bathroom, negative}","{ambience general, bathroom, negative}"
+Love the enchiladas and chicken soup - and be sure to check out their specials .,"{food quality, enchiladas, positive};{food quality, chicken soup, positive};{food quality, specials, positive}","{food quality, chicken soup, positive};{food quality, enchiladas, positive};{food style_options, specials, positive}"
+The food is simply unforgettable !,"{food quality, food, positive}","{food quality, food, positive}"
+Management should really take notice and train their waitstaff and teach them some proper manners .,"{service general, waitstaff, negative}","{service general, waitstaff, negative}"
+The staff are friendly and the decor was ethic and colorful .,"{ambience general, decor, positive};{service general, staff, positive}","{ambience general, decor, positive};{service general, staff, positive}"
+The best Chuwam Mushi I have ever had .,"{food quality, Chuwam Mushi, positive}","{food quality, Chuwam Mushi, positive}"
+"Portions was just enough for me , but may not be for a big eater .","{food style_options, Portions, neutral}","{food style_options, Portions, neutral}"
+Try the Pizza Ensalata !,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza Ensalata, positive}"
+Still I would recommend this place .,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+"– The sushi here is perfectly good , but for $ 5 a piece , either the slices of fish should be larger , or there should be no pretense that this is a moderately priced restaurant ( even for NYC ) .","{food prices, sushi, negative};{food style_options, sushi, negative};{food quality, sushi, positive};{restaurant prices, restaurant, negative}","{food quality, sushi, neutral};{food prices, sushi, negative}"
+You are bound to have a very charming time .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"We have since returned and also had a great experience , sampling more small plates and a variety of the beer ( cold and good ) .","{drinks quality, beer, positive};{restaurant general, null, positive}","{food quality, small plates, positive};{drinks quality, beer, positive}"
+Best Sushi in town .,"{food quality, Sushi, positive}","{food quality, Sushi, positive}"
+the staff was very nice and courteous and obviously chinese .,"{service general, staff, positive}","{service general, staff, positive}"
+"We ordered a selection of the small plates , and the shoe string onions , goat cheese pizza , grilled asparagus and fried brie with fruit were all very good .","{food quality, grilled asparagus, positive};{food quality, shoe string onions, positive};{food quality, goat cheese pizza, positive};{food quality, fried brie with fruit, positive}","{food quality, fried brie with fruit, positive};{food quality, grilled asparagus, positive};{food quality, shoe string onions, positive};{food quality, goat cheese pizza, positive}"
+Nice job !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Though , one thing I realized later on was that the restaurant either used MSG or a meat tenderizer on the steak .","{food quality, steak, negative}","{food quality, steak, negative}"
+Great selection of sakes .,"{drinks style_options, selection of sakes, positive}","{drinks style_options, sakes, positive}"
+Kudos to these guys .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Unless you are just stopping in for a few drinks I wouldn 't recommend going here .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Great bottle of wine .,"{drinks quality, bottle of wine, positive}","{drinks quality, bottle of wine, positive}"
+The open sesame combo plate is a bargain for the heap of food given .,"{food style_options, open sesame combo plate, positive};{food prices, open sesame combo plate, positive}","{food prices, open sesame combo plate, positive};{food style_options, open sesame combo plate, positive}"
+WAY OVER-RATED ! ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Worth the wait,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Doesn 't get any better than that .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+best honey walnyt prawns that we have every tasted .,"{food quality, honey walnyt prawns, positive}","{food quality, honey walnyt prawns, positive}"
+They have been featured on the food network and they deserve it .,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+I love the warm & cosy environment .,"{ambience general, environment, positive}","{ambience general, environment, positive}"
+Snotty Attitude,"{service general, null, negative}","{service general, Attitude, negative}"
+"The atmosphere is aspiring , and the decor is festive and amazing ...","{ambience general, decor, positive};{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive};{ambience general, decor, positive}"
+"Their specialty rolls are impressive , though I ca n't remember what we had .","{food quality, specialty rolls, positive}","{food style_options, specialty rolls, positive}"
+– I loved the pumpkin ravioli and the goat cheese gnocchi ( 5 big ones to a plate instead of 20 or so little gnocchis ) and my sister loved her filet mignon on top of spinach and mashed potatoes .,"{food quality, filet mignon on top of spinach and mashed potatoes, positive};{food quality, pumpkin ravioli, positive};{food quality, goat cheese gnocchi, positive};{food style_options, goat cheese gnocchi, positive}","{food quality, pumpkin ravioli, positive};{food style_options, goat cheese gnocchi, positive};{food quality, goat cheese gnocchi, positive};{food quality, filet mignon on top of spinach and mashed potatoes, positive}"
+Not the biggest portions but adequate .,"{food style_options, portions, neutral}","{food style_options, portions, neutral}"
+"Go with some friends , wait the half hour or so with a cup of joe , and enjoy more than your average breakfast .","{restaurant general, null, positive};{food quality, breakfast, positive}","{restaurant miscellaneous, null, positive}"
+great service .,"{service general, service, positive}","{service general, service, positive}"
+We were then charged for their most expensive sake ( $ 20 + per serving ) when we in fact drank a sake of less than half that price .,"{service general, null, negative}","{drinks prices, sake, negative};{service general, null, negative}"
+Delicious,"{food quality, null, positive}","{food quality, null, positive}"
+The chicken curry and chicken tikka masala are my favorite meat dishes .,"{food quality, chicken curry, positive};{food quality, chicken tikka masala, positive}","{food quality, chicken curry, positive};{food quality, chicken tikka masala, positive}"
+"best restaurant in the world , great decor , great customer service , friendly manager","{ambience general, decor, positive};{service general, manager, positive};{service general, customer service, positive};{restaurant general, restaurant, positive}","{ambience general, decor, positive};{restaurant general, restaurant, positive};{service general, customer service, positive};{service general, manager, positive}"
+Drinks were good .,"{drinks quality, Drinks, positive}","{drinks quality, Drinks, positive}"
+"The presentation of the food was an added bonus , it looked just as great as it tasted !","{food quality, food, positive};{food style_options, food, positive}","{food style_options, food, positive}"
+"Even then , the order was not correct and we were still waiting for a couple items .","{service general, null, negative}","{service general, null, negative}"
+– We were treated very rudely here one time for breakfast .,"{service general, null, negative}","{service general, null, negative}"
+"Great food , spectacular location , and friendly service keep us coming back year after year .","{service general, service, positive};{food quality, food, positive};{location general, location, positive}","{service general, service, positive};{location general, location, positive};{food quality, food, positive}"
+WOW ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Save yourself the waste of time & DO NOT visit .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Food was good and cheap .,"{food quality, Food, positive};{food prices, Food, positive}","{food quality, Food, positive};{food prices, Food, positive}"
+Mmm ... good !,"{restaurant general, null, positive}","{food quality, null, positive}"
+Its great if you spent the day there and did n't want to drive to eat .,"{location general, null, positive}","{restaurant miscellaneous, null, positive}"
+Great value sushi with high quality & nice setting .,"{ambience general, setting, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{ambience general, setting, positive};{food quality, sushi, positive};{food prices, sushi, positive}"
+"It was so much though that I could barely finish but I did , since it was delicious .","{food style_options, null, neutral};{food quality, null, positive}","{food quality, null, positive};{food style_options, null, negative}"
+I love this restaurant,"{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Not recommanded ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+We stood there for 10 minutes while employees walked back and forth ignoring us .,"{service general, employees, negative}","{service general, employees, negative}"
+My g/f and I both agreed the food was very mediocre especially considering the price .,"{food quality, food, negative};{food prices, food, negative}","{food quality, food, negative};{food prices, food, negative}"
+"– The food is here is incredible , though the quality is inconsistent during lunch .","{food quality, food, positive};{food quality, lunch, negative}","{food quality, food, negative};{food quality, food, positive}"
+I have not a bad thing to say about this place .,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+"the only problem is you really have to warm up the pizza before it 's edible , even when you order ahead .","{food quality, pizza, negative}","{food quality, pizza, negative}"
+– This is my `` must bring out of town guests to `` restaurant and they always enjoy and rave about it .,"{restaurant general, restaurant, positive}","{restaurant miscellaneous, restaurant, positive}"
+I had the kafta plate and I enjoyed it .,"{food quality, kafta plate, positive}","{food quality, kafta plate, positive}"
+It was clear he didn ’ t really care .,"{service general, null, negative}","{service general, null, negative}"
+The Caesar salad I ordered had so much lemon I could n't eat it .,"{food quality, Caesar salad, negative}","{food quality, Caesar salad, negative}"
+"Our server continued to be attentive throughout the night , but I did remain puzzled by one issue : Who thinks that Ray 's is an appropriate place to take young children for dinner ?","{service general, server, positive}","{restaurant miscellaneous, Ray's, negative};{service general, server, positive}"
+"Good Food , Great Service , Average Prices ( For the Strip )","{service general, Service, positive};{food quality, Food, positive};{restaurant prices, null, neutral}","{restaurant prices, null, neutral};{service general, Service, positive};{food quality, Food, positive}"
+6pm on a Sat before a Broadway play and we were quickly seated and served .,"{service general, null, positive}","{service general, null, positive}"
+They pay such detail to everything from miso soup to complex rolls .,"{food quality, rolls, positive};{food quality, miso soup, positive}","{food quality, miso soup, positive};{food quality, rolls, positive}"
+$ 6 with tip .,"{restaurant prices, null, positive}","{restaurant prices, null, neutral}"
+The atmosphere was great .,"{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive}"
+"In other words , if they aren 't making $ $ off of you then you do n't rate high on their 'service scale ' .","{service general, service, negative}","{service general, service, negative}"
+– I really enjoyed my meal here .,"{food quality, meal, positive}","{food quality, meal, positive}"
+"The music playing was very hip , 20-30 something pop music , but the subwoofer to the sound system was located under my seat , which became annoying midway through dinner .","{ambience general, subwoofer to the sound system, negative};{ambience general, music, positive}","{ambience general, music, positive};{ambience general, subwoofer, negative}"
+Holy Hummus !,"{food quality, Hummus, positive}","{food quality, Hummus, positive}"
+"For my entr & eacute ; e , I completely enjoyed the seared Alaskan sea scallops complemented by chard , artichoke hearts , fennel , and pecorino toscano .","{food quality, seared Alaskan sea scallops, positive};{food style_options, seared Alaskan sea scallops, positive}","{food quality, seared Alaskan sea scallops complemented by chard, artichoke hearts, fennel, and pecorino toscano, positive}"
+"The decor is rustic , traditional Japanese .","{ambience general, decor, neutral}","{ambience general, decor, positive}"
+"Not only can the selection be innovative , but there 's a nice balance of traditional sushi as well .","{food style_options, selection, positive};{food style_options, sushi, positive}","{food style_options, selection, positive};{food quality, sushi, positive}"
+You are likely to be disappointed .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"The food is great , the bartenders go that extra mile .","{service general, bartenders, positive};{food quality, food, positive}","{service general, bartenders, positive};{food quality, food, positive}"
+The restaurant offers an extensive wine list and an ambiance you wo n't forget !,"{drinks style_options, wine list, positive};{ambience general, ambiance, positive}","{drinks style_options, wine list, positive};{ambience general, ambiance, positive}"
+"The naan was some of the best I 've had and I really enjoyed the bhartha , not too tomatoey .","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, naan, positive};{food quality, bhartha, positive}"
+To the owners of Open Sesame ... Bravo ... I ca n't wait to come back to dine at your restaurant !,"{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}"
+"the fish was fresh , though it was cut very thin .","{food style_options, fish, negative};{food quality, fish, positive}","{food quality, fish, positive};{food style_options, fish, negative}"
+Been there lots since and its always a good time .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+My favortie pizza joint in Seattle,"{restaurant general, pizza joint, positive}","{restaurant general, pizza joint, positive}"
+i highly recommend this place to all that want to try indain food for the first time .,"{food quality, indain food, positive}","{restaurant general, place, positive}"
+Overrated,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Worst Service I Ever Had,"{service general, Service, positive}","{service general, Service, negative}"
+As it turns out the owner was seated right next to us and when he came over to check on our problems was very dismissive and offered a token 20 % discount on our bill .,"{service general, owner, negative}","{service general, owner, negative}"
+I went there with some friends one night to play bingo and watch the sox game and it was a blast !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+COMPLETELY OVER RATED !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"– Eggs , pancakes , potatoes , fresh fruit and yogurt -- everything they serve is delicious .","{food quality, Eggs, positive};{food quality, yogurt, positive};{food quality, null, positive};{food quality, fresh fruit, positive};{food quality, potatoes, positive};{food quality, pancakes, positive}","{food quality, null, positive};{food style_options, null, positive}"
+– Ray 's is THE place to go for high quality seafood dinners .,"{food quality, seafood dinners, positive}","{food quality, seafood dinners, positive}"
+I also really enjoy the simplicity of the decor and intimate feeling of a small restaurant .,"{ambience general, decor, positive};{ambience general, feeling, positive}","{ambience general, decor, positive};{ambience general, restaurant, positive}"
+We 're going back . : D,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+I should have thought to bring it up but never expected the food to be that mild .,"{food quality, food, negative}","{food quality, food, negative}"
+"When I walked in , I was taken aback by their incredible wood decor .","{ambience general, wood decor, positive}","{ambience general, wood decor, positive}"
+It 's a tiny place so if you get there before 8pm on a weekend ( Thurs ? Sun ) you will find it easier to get a table or a seat at the sushi bar .,"{restaurant miscellaneous, place, neutral}","{restaurant miscellaneous, place, positive}"
+Best Neighborhood Standby .,"{restaurant general, Standby, positive}","{restaurant general, null, positive}"
+I 'd go back there in a heartbeat .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"It 's *very * reasonably priced , esp for the quality of the food .","{food prices, food, positive}","{food prices, null, positive};{food quality, food, positive}"
+"plenty of food , trust me .","{food style_options, food, positive}","{food style_options, food, positive}"
+It 's the perfect spot for a romantic date for 2 or a secret rendezvous !,"{ambience general, spot, positive};{restaurant miscellaneous, spot, positive}","{restaurant miscellaneous, spot, positive}"
+Also have great margaritas !,"{drinks quality, margaritas, positive}","{drinks quality, margaritas, positive}"
+It 's unpretentious and underground .,"{ambience general, null, positive}","{ambience general, null, positive}"
+The place is the next best thing to my Moms cooking .,"{food quality, null, positive}","{food quality, place, positive}"
+"The best place for a leisure Sunday breakfast amidst yachts , then take a stroll through the nearby Farmer 's Market .","{restaurant miscellaneous, place, positive}","{location general, null, positive}"
+"If you can , come to this place by boat and make it a whole evening .","{restaurant miscellaneous, place, positive}","{restaurant miscellaneous, place, positive}"
+for desert we had the mango ginger creme brulee ... oh la la yummy ! ! !,"{food quality, mango ginger creme brulee, positive}","{food quality, mango ginger creme brulee, positive}"
+"Its worth the wait , especially since they 'll give you a call when the table is ready .","{restaurant general, null, positive}","{service general, null, positive}"
+They have a wide variety of fish and they even list which oceans they come from ; Atlantic or Pacific .,"{food style_options, fish, positive}","{food style_options, null, positive}"
+Well I guess it 's hard to be seated when one is invisible to the staff .,"{service general, staff, negative}","{service general, staff, negative}"
+Great open and friendly ambience .,"{ambience general, ambience, positive}","{ambience general, ambience, positive}"
+A brief conversation with the manager at the end of the meal was the greatest disappointment -- to say we had been `` blown off `` would be an understatement .,"{service general, manager, negative}","{service general, manager, negative}"
+"Ray 's is something of a Seattle institution , but given its gorgeous Sound views , I had suspected that the accolades were more due to the scenery than to the food and service .","{location general, Sound views, positive}","{location general, Ray's, positive};{food quality, food, negative};{service general, service, negative}"
+I swore never to return for a warm beer and mediocre meal .,"{drinks quality, beer, negative};{food quality, meal, negative}","{drinks quality, beer, negative};{food quality, meal, negative}"
+"If it 's nice outside , request for a table in the balcony .","{ambience general, balcony, positive}","{ambience general, balcony, positive}"
+Great food with an awesome atmosphere !,"{ambience general, atmosphere, positive};{food quality, food, positive}","{ambience general, atmosphere, positive};{food quality, food, positive}"
+I ended the meal with the unusual dessert of a port and chocolate tasting ... yummy !,"{food quality, dessert of a port and chocolate tasting, positive}","{food quality, port and chocolate tasting, positive}"
+I got the shellfish and shrimp appetizer and it was alright .,"{food quality, shellfish and shrimp appetizer, neutral}","{food quality, shellfish and shrimp appetizer, neutral}"
+The pizza ’ s are thin crust and the menu offers very creative combinations and toppings .,"{food style_options, menu, positive};{food style_options, pizza ’ s, positive}","{food style_options, pizza ’ s, positive};{food style_options, crust, positive};{food style_options, menu, positive};{food style_options, toppings, positive}"
+It 's a great place to enjoy food and meet friends .,"{restaurant miscellaneous, place, positive};{food quality, food, positive}","{restaurant miscellaneous, place, positive}"
+"The service was excellent , the coffee was good even by starbucks standards and the food was outstanding .","{service general, service, positive};{food quality, food, positive};{drinks quality, coffee, positive}","{service general, service, positive};{food quality, food, positive};{drinks quality, coffee, positive}"
+This is the place to relax and enjoy the finest quality food the industry can offer .,"{ambience general, place, positive};{food quality, food, positive}","{ambience general, place, positive};{food quality, food, positive}"
+I would go back for the wine experience alone .,"{drinks quality, wine, positive}","{drinks quality, wine experience, positive}"
+The best calamari in Seattle !,"{food quality, calamari, positive}","{food quality, calamari, positive}"
+The presentation of Snooze is excellent and it is one of those places that you feel more sophisticated just for being there ; but peel back the layers and you have an overpriced IHOP with a high brow menu .,"{food style_options, menu, negative};{restaurant prices, Snooze, negative};{ambience general, Snooze, positive}","{ambience general, presentation, positive};{restaurant prices, Snooze, negative};{food style_options, menu, negative}"
+"I complained to the manager , but he was not even apologetic .","{service general, manager, negative}","{service general, manager, negative}"
+Much more than just a great view !,"{location general, view, positive}","{restaurant general, null, positive}"
+The atmosphere was just okay .,"{ambience general, atmosphere, neutral}","{ambience general, atmosphere, neutral}"
+Once seated it took about 30 minutes to finally get the meal .,"{service general, null, negative}","{service general, null, negative}"
+"– In a age of incremental cost cutting in restaurants , its nice to see a place that bucks that trend , and just plain delivers high quality food and good service , period .","{service general, service, positive};{food quality, food, positive}","{restaurant prices, place, positive};{service general, service, positive};{food quality, food, positive}"
+I liked the atmosphere very much but the food was not worth the price .,"{ambience general, atmosphere, positive};{food quality, food, negative};{food prices, food, negative}","{ambience general, atmosphere, positive};{food quality, food, negative};{food prices, food, negative}"
+"It 's located in a strip mall near the Beverly Center , not the greatest location , but the food keeps me coming back for more .","{location general, location, neutral};{food quality, food, positive}","{food quality, food, positive};{location general, location, negative}"
+"On my meal I had to send back my eggs for a simple request of breaking the yokes before cooking , and would have had to send them back again if I hadn 't rejected the meal all together .","{food quality, meal, negative};{food quality, eggs, negative}","{food quality, eggs, negative}"
+The band was very good and the service was attentive .,"{service general, service, positive};{ambience general, band, positive}","{ambience general, band, positive};{service general, service, positive}"
+"– How to describe the best sushi in NYC : hmmmm , delicious , amazing , fantastic , suculent , perfect , nah , all of the above .","{food quality, sushi, positive}","{food quality, sushi, positive}"
+"– Schooner or Later 's charming location along the marina in Long Beach and average food does not , unfortunately , compensate for its very poor customer service .","{location general, location along the marina in Long Beach, positive};{service general, customer service, negative};{food quality, food, neutral}","{location general, location, positive};{food quality, food, neutral};{service general, customer service, negative}"
+"We were seated right away , the table was private and nice .","{ambience general, table, positive}","{ambience general, table, positive};{service general, null, positive}"
+"good sake , good food – i honestly do n't know much about japanese food at all .","{drinks quality, sake, positive};{food quality, food, positive}","{food quality, food, positive};{drinks quality, sake, positive}"
+Bring your cell phone cause you may have to wait to get into the best sushi restaurant in the world : BLUE RIBBON SUSHI .,"{restaurant general, BLUE RIBBON SUSHI, positive}","{restaurant miscellaneous, BLUE RIBBON SUSHI, positive}"
+"In the end our check came to $ 27 for 4 small pancakes , a breakfast burrito , an orange juice and an iced tea ( I had water ) .","{food prices, breakfast burrito, negative};{drinks prices, iced tea, negative};{food style_options, pancakes, negative};{drinks prices, orange juice, negative};{food prices, pancakes, negative}","{food prices, null, negative};{food style_options, pancakes, negative};{food style_options, breakfast burrito, negative}"
+Good food !,"{food quality, food, positive}","{food quality, food, positive}"
+"The catering is out of this world , and Raouls chicken vegetable soup rocks my world ! ! !","{food quality, Raouls chicken vegetable soup, positive};{food quality, catering, positive}","{food quality, chicken vegetable soup, positive};{food quality, catering, positive}"
+I should have just asked for the check when I saw that ; but their menu was so unique that I continued .,"{food style_options, menu, positive}","{food style_options, menu, positive}"
+Great Breakfast,"{food quality, Breakfast, positive}","{food quality, Breakfast, positive}"
+Seabass on lobster risotto was the best .,"{food quality, Seabass on lobster risotto, positive}","{food quality, Seabass on lobster risotto, positive}"
+– The atmosphere is great for any special occasion you might want to celebrate .,"{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive}"
+"Great seasonal fish and seafood , with a classy waterfront setting .","{food quality, seasonal fish, positive};{ambience general, waterfront setting, positive};{food quality, seafood, positive}","{location general, waterfront setting, positive};{food quality, seafood, positive};{food quality, fish, positive}"
+The pizza ’ s are not huge and the crust is thin ... keep that in mind when you ’ re ordering .,"{food style_options, pizza ’ s, neutral};{food style_options, crust, neutral}","{food style_options, pizza ’ s, neutral}"
+The only positive thing about Mioposto is the nice location .,"{location general, location, positive}","{location general, location, positive}"
+I appreciate their delivery too .,"{service general, delivery, positive}","{service general, delivery, positive}"
+Very disappointed .,"{restaurant general, null, negative}","{food quality, null, negative}"
+The pizza is delicious and the salads are fantastic .,"{food quality, pizza, positive};{food quality, salads, positive}","{food quality, pizza, positive};{food quality, salads, positive}"
+Freshest sushi – I love this restaurant .,"{food quality, sushi, positive};{restaurant general, restaurant, positive}","{food quality, sushi, positive};{restaurant general, restaurant, positive}"
+The steak was done to my exact liking ( medium rare ) and was nice and juicy .,"{food quality, steak, positive}","{food quality, steak, positive}"
+"Seriously , you ca n't go wrong , if it is unpretentious local fun you seek .","{ambience general, null, positive}","{restaurant general, null, positive}"
+The owners are great fun and the beer selection is worth staying for .,"{drinks style_options, beer selection, positive};{service general, owners, positive}","{drinks style_options, beer selection, positive};{ambience general, owners, positive}"
+Great draft and bottle selection and the pizza rocks .,"{food quality, pizza, positive};{drinks style_options, draft and bottle selection, positive}","{drinks style_options, draft selection, positive};{drinks style_options, bottle selection, positive};{food quality, pizza, positive}"
+"I guarantee you wo n't be disappointed , there 's also valet parking .","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, null, positive}"
+Late night dinning with exeptional food .,"{food quality, food, positive}","{food quality, food, positive};{restaurant miscellaneous, dinning, positive}"
+"The portions are big though , so do not order too much .","{food style_options, portions, neutral}","{food style_options, portions, positive}"
+Service was decent .,"{service general, Service, neutral}","{service general, Service, neutral}"
+Absolutely delicious .,"{food quality, null, positive}","{food quality, null, positive}"
+"Oh , and the cheese fries are awesome !","{food quality, cheese fries, positive}","{food quality, cheese fries, positive}"
+Everyone that sat in the back outside agreed that it was the worst service we had ever received .,"{service general, service, negative}","{service general, service, negative}"
+I may not be a sushi guru but I can tell you that the food here is just okay and that there is not much else to it .,"{food quality, food, negative}","{food quality, food, negative}"
+"Excellent food , nice ambience , fairly expensive","{ambience general, ambience, positive};{restaurant prices, null, negative};{food quality, food, positive}","{food quality, food, positive};{ambience general, ambience, positive};{food prices, food, negative}"
+"Melt in your mouth nigiri and sashmi , and very tasty rolls too .","{food quality, rolls, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}","{food quality, rolls, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}"
+Finally a meal that you will remember for a long time !,"{food quality, meal, positive}","{food quality, meal, positive}"
+"Best food , phenominal service","{service general, service, positive};{food quality, food, positive}","{service general, service, positive};{food quality, food, positive}"
+I recommend it for a night when you want to splurge ! ( it was a bit expensive ),"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}"
+"While this diner had reasonably good food , the restaurant staff seemed completely indifferent to our presence , and this attitude was reflected in the lack of service .","{service general, restaurant staff, negative};{food quality, food, positive}","{service general, restaurant staff, negative};{service general, service, negative};{food quality, food, positive}"
+No Comparison,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"so about the prawns , they were fresh and had a slight crispiness about the batter ... soooo good ... the walnuts were cut in smaller pieces and very crunchy and tasty .","{food quality, batter, positive};{food quality, prawns, positive};{food quality, walnuts, positive}","{food quality, walnuts, positive};{food quality, prawns, positive}"
+I am so happy to have a wonderful Italian restaurant in my neighborhood .,"{restaurant general, Italian restaurant, positive}","{restaurant general, Italian restaurant, positive}"
+We waited for an hour to be seated .,"{service general, null, negative}","{service general, null, negative}"
+"We put in our order and although we ordered 4 appetizers , the food did n't arrive until 45 minutes later ... WITH OUR MAIN COURSE .","{service general, null, negative}","{service general, null, negative}"
+I can not wait to go back again this coming weekend !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"If you 're interested in good tasting ( without the fish taste or smell ) , large portions and creative sushi dishes this is your place ...","{food quality, null, positive};{food style_options, sushi dishes, positive};{food style_options, portions, positive}","{food style_options, sushi dishes, positive};{food quality, sushi dishes, positive};{food style_options, portions, positive}"
+A perfect place to take out of town guests any time of the year .,"{restaurant general, place, positive}","{restaurant miscellaneous, place, positive}"
+"I had a taste of all three items on her plate , and they were superb .","{food quality, plate, positive}","{food quality, null, positive}"
+Good for late night dining ( last minute planning ) without reservations .,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+i am never disappointed with there food .,"{food quality, food, positive}","{food quality, food, positive}"
+– By far the best bar in the east village ...,"{restaurant general, bar, positive}","{drinks quality, bar, positive}"
+It 's a great place to people watch .,"{restaurant miscellaneous, place, positive}","{ambience general, place, positive}"
+"Space was limited , but the food made up for it .","{restaurant miscellaneous, Space, negative};{food quality, food, positive}","{food quality, food, positive};{ambience general, Space, negative}"
+The scallops are apparently cooked in a black olive butter which really makes them unique ( not to mention tasty ) .,"{food quality, scallops, positive};{food style_options, scallops, positive}","{food quality, scallops, positive};{food style_options, scallops, positive}"
+This place is charming and relaxing .,"{ambience general, place, positive}","{ambience general, place, positive}"
+not chewy at all .,"{food quality, null, positive}","{food quality, null, positive}"
+We were only in Seattle for one night and I 'm so glad we picked Rays for dinner !,"{restaurant general, Rays, positive}","{restaurant general, Rays, positive}"
+"– I will never forget the amazing meal , service , and ambiance I experience at this restaurant .","{ambience general, ambiance, positive};{food quality, meal, positive};{service general, service, positive}","{ambience general, ambiance, positive};{service general, service, positive};{food quality, meal, positive}"
+Amazing Spanish Mackeral special appetizer and perfect box sushi ( that eel with avodcao -- um um um ) .,"{food quality, box sushi, positive};{food quality, Spanish Mackeral special appetizer, positive};{food quality, eel with avodcao, positive}","{food quality, Spanish Mackeral special appetizer, positive};{food quality, box sushi, positive};{food quality, eel with avodcao, positive}"
+"On weekends , you might have to wait for couple hours .","{service general, null, neutral}","{service general, null, negative}"
+– The food was not great & the waiters were rude .,"{food quality, food, negative};{service general, waiters, negative}","{service general, waiters, negative};{food quality, food, negative}"
+"The 9 oz steak came next and it tasted great , at least initially .","{food quality, 9 oz steak, positive}","{food quality, steak, positive}"
+When I got there I sat up stairs where the atmosphere was cozy & the service was horrible !,"{ambience general, atmosphere, positive};{service general, service, negative}","{ambience general, atmosphere, positive};{service general, service, negative}"
+"The wine list is incredible and extensive and diverse , the food is all incredible and the staff was all very nice , good at their jobs and cultured .","{drinks style_options, wine list, positive};{service general, staff, positive};{food quality, food, positive}","{drinks style_options, wine list, positive};{service general, staff, positive};{food quality, food, positive}"
+– IT CANT GET ANY BETTER ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Sunday afternoons there is a band playing and it is lots of fun .,"{ambience general, band, positive}","{ambience general, band, positive}"
+"Everything , and I mean everything on the menu is delectable .","{food quality, menu, positive}","{food quality, menu, positive}"
+"I know many people have their favorite types of pizza and pizza places , but Mioposto 's pizza lacks quality and good taste .","{food quality, pizza, negative}","{food quality, pizza, negative}"
+"There is only one place on the east coast that has it all , plus a lot more .","{restaurant general, place, positive}","{restaurant general, place, positive}"
+Always a winner .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+The prior reviews said Kid friendly ... give me a break with two young children that is light years .,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+The pizza ’ s are light and scrumptious .,"{food quality, pizza ’ s, positive}","{food quality, pizza ’ s, positive}"
+"Check out the art on the walls , very colorful !","{ambience general, art on the walls, positive}","{ambience general, art on the walls, positive}"
+Mediocre food,"{food quality, food, neutral}","{food quality, food, neutral}"
+I will never return again .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+We had a very hard time getting the waitress ' attention and finally had to get up and go inside to speak to a manager .,"{service general, waitress, negative}","{service general, waitress, negative}"
+Never too crowded and always great service .,"{restaurant miscellaneous, null, positive};{service general, service, positive}","{service general, service, positive};{restaurant miscellaneous, null, positive}"
+you are with a hot date and he /she has an urge for sushi ... then this might be the place .,"{food quality, sushi, positive}","{restaurant miscellaneous, place, positive}"
+"Can get busy on Fridays for a table but once seated , the service is so efficient you can be in and out of there quickly .","{service general, service, positive}","{service general, service, positive};{restaurant miscellaneous, null, neutral}"
+"It ? s served with either a peppercorn sauce or red wine reduction , though both were indistinguishable in taste .","{food quality, red wine reduction, neutral};{food quality, peppercorn sauce, neutral}","{food quality, peppercorn sauce or red wine reduction, negative}"
+The nicest waiters in town .,"{service general, waiters, positive}","{service general, waiters, positive}"
+The service was courteous and attentive .,"{service general, service, positive}","{service general, service, positive}"
+As of writing this I just tried their give away a link again & it still doesn 't work .,"{restaurant miscellaneous, null, negative}","{service general, null, negative}"
+any further needs we may have had could not have been met since no one stopped by the table .,"{service general, null, negative}","{service general, null, negative}"
+"Good Sushi , High Price","{food quality, Sushi, positive};{food prices, Sushi, negative}","{food quality, Sushi, positive};{food prices, Sushi, negative}"
+But the servers were extremely attentive and very friendly .,"{service general, servers, positive}","{service general, servers, positive}"
+"I have been to this place , folks and it is BAD .","{restaurant general, place, negative}","{restaurant general, place, negative}"
+great service,"{service general, service, positive}","{service general, service, positive}"
+It was like dining at a completely different restaurant .,"{restaurant general, null, positive}","{restaurant miscellaneous, restaurant, negative}"
+Two thumbs up !,"{food quality, null, positive}","{restaurant general, null, positive}"
+Imagine my happy surprise upon finding that the views are only the third-best thing about Ray 's !,"{location general, views, positive}","{restaurant general, Ray's, positive}"
+"Hands down , the best tuna I have ever had .","{food quality, tuna, positive}","{food quality, tuna, positive}"
+"If you 're going to see Danny Gans or just staying at the Mirage , do n't miss this one .","{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+great lunch spot,"{restaurant general, lunch spot, positive}","{restaurant general, lunch spot, positive}"
+I love breakfast here .,"{food quality, breakfast, positive}","{food quality, breakfast, positive}"
+The sashimi was the freshest and most tender I have ever tasted .,"{food quality, sashimi, positive}","{food quality, sashimi, positive}"
+You won ’ t be disappointed by their menu .,"{food style_options, menu, positive}","{food style_options, menu, positive}"
+"Many people talk about the great pizza and poor service , so it ca n't just be the rantings of a few dissatisfied customers .","{food quality, pizza, positive};{service general, service, negative}","{service general, service, negative};{food quality, pizza, positive}"
+I will not go back .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+my service was stellar !,"{service general, service, positive}","{service general, service, positive}"
+we are for sure coming back to this restaurant .,"{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Will definitely be back .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Maybe it is good for that one night once in a blue moon when the chefs decide to use fish that 's half-way decent .,"{food quality, fish, negative}","{food quality, chefs, negative};{food quality, fish, negative}"
+"– I 've been to Open Sesame only once , but I 'm still reeling from the experience ! !","{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, negative}"
+The pancakes were certainly inventive but $ 8.50 for 3 - 6 `` pancakes ( one of them was more like 5 `` ) in the pancake flight ( sample of 3 different pancakes ) is well over-priced .,"{food prices, pancakes, negative};{food style_options, pancakes, positive}","{food style_options, pancakes, negative};{food prices, pancakes, negative};{food quality, pancakes, positive}"
+"HOWEVER , one Sunday afternoon my husband and I did go ( although with my loud protests ) and were pleasantly surprised .","{restaurant general, null, positive}","{restaurant general, null, positive}"
+Well worth it,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Caution - its real food for people who love the best .,"{food quality, food, positive}","{food quality, food, positive}"
+I have a but here - there was a bathroom attendant in the restroom which was odd .,"{restaurant miscellaneous, restroom, negative}","{ambience general, bathroom attendant, negative}"
+The best dish are the honwy walnut prawns -- just outstanding .,"{food quality, honwy walnut prawns, positive}","{food quality, honwy walnut prawns, positive}"
+The pancakes should be larger ( at least 8 `` ) to justify the expense even with the unique offerings .,"{food style_options, pancakes, negative}","{food style_options, pancakes, negative};{food prices, pancakes, negative}"
+– My first time to dine at this restaurant was with my son and it was absolutely horrible !,"{restaurant general, restaurant, negative}","{restaurant general, restaurant, negative}"
+Excellent,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Parking is reasonably good , they have their own lot and you can park in the park nearby .","{restaurant miscellaneous, null, positive}","{parking general, lot, positive};{parking general, park, positive}"
+Caesar salad was superb .,"{food quality, Caesar salad, positive}","{food quality, Caesar salad, positive}"
+"– I do n't understand how I was a stranger to this place for so long ... the fajita salad , the colorado , the fajitas - EVERYTHING is delicious .","{food quality, colorado, positive};{food quality, fajitas, positive};{food quality, fajita salad, positive}","{food quality, null, positive};{food quality, fajitas, positive};{food quality, fajita salad, positive};{food quality, colorado, positive}"
+best chinese food i have tasted in a long time,"{food quality, chinese food, positive}","{food quality, chinese food, positive}"
+The price was right too .,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+Delicious ... !,"{food quality, null, positive}","{food quality, null, positive}"
+We put out name down and although there were open tables we were told that it 'd be a 30 minute wait .,"{service general, null, negative}","{service general, null, negative}"
+"The coffe is very good , too .","{drinks quality, coffe, positive}","{drinks quality, coffe, positive}"
+We waited over 30 minutes for our drinks and over 1 1 /2 hours for our food .,"{service general, null, negative}","{service general, null, negative}"
+The servers behind the counter are always friendly and helpful .,"{service general, servers behind the counter, positive}","{service general, servers, positive}"
+"Our waiter was non-existent and after our food finally arrived over an hour after we ordered , we were not given any water or utensils .","{service general, waiter, negative}","{service general, waiter, negative}"
+– This place is unbelievably over-rated .,"{restaurant general, place, negative}","{restaurant general, place, negative}"
+Very poor customer service .,"{service general, customer service, negative}","{service general, customer service, negative}"
+We ’ re can ’ t say enough about their delicious gourmet pizza ’ s !,"{food quality, pizza ’ s, positive}","{food quality, gourmet pizza ’ s, positive}"
+"Furthermore , while the fish is unquestionably fresh , rolls tend to be inexplicably bland .","{food quality, rolls, negative};{food quality, fish, positive}","{food quality, rolls, negative};{food quality, fish, positive}"
+The only drawback is the crowded seating and the slow service .,"{restaurant miscellaneous, seating, negative};{service general, service, negative}","{ambience general, seating, negative};{service general, service, negative}"
+"Not alot of smoking places left in New York , but I have found my favorite smoking balconey in the city .","{restaurant miscellaneous, balconey, positive}","{restaurant miscellaneous, smoking balconey, positive}"
+We shared the family platter and I especially enjoyed the black cod in sake kasu .,"{food quality, black cod in sake kasu, positive}","{food quality, black cod in sake kasu, positive};{food style_options, family platter, positive}"
+"But the space is small and lovely , and the service is helpful .","{service general, service, positive};{ambience general, space, positive}","{ambience general, space, positive};{service general, service, positive}"
+It was worth the wait .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+yummy .,"{food quality, null, positive}","{food quality, null, positive}"
+Delectable,"{food quality, null, positive}","{food quality, null, positive}"
+- Mediocre Service / Quality,"{service general, Service, neutral}","{service general, Service, negative};{food quality, Quality, negative}"
+"– This is one of my top lunch spots , huge portions , fast service and amazing margaritas ! !","{drinks quality, margaritas, positive};{restaurant general, null, positive};{food style_options, portions, positive};{service general, service, positive}","{drinks quality, margaritas, positive};{service general, service, positive};{food style_options, portions, positive}"
+Best Crab Cakes in Town,"{food quality, Crab Cakes, positive}","{food quality, Crab Cakes, positive}"
+"Everything I 've had here is good , taco salads , burritos , enchiladas i love this place .","{food quality, null, positive};{food quality, taco salads, positive};{restaurant general, place, positive};{food quality, burritos, positive};{food quality, enchiladas, positive}","{food quality, null, positive};{food quality, burritos, positive};{food quality, enchiladas, positive};{food quality, taco salads, positive}"
+"Great Pizza , Poor Service","{service general, Service, negative};{food quality, Pizza, positive}","{service general, Service, negative};{food quality, Pizza, positive}"
+splendid,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+My best friend had the chicken shawarma and she STILL raves about it being the best anywhere !,"{food quality, chicken shawarma, positive}","{food quality, chicken shawarma, positive}"
+Chintzy portions,"{food style_options, portions, negative}","{food style_options, portions, negative}"
+Good eats .,"{food quality, eats, positive}","{food quality, eats, positive}"
+"Normally , places ask how hot you want it , but they did n't .","{service general, null, negative}","{service general, null, negative}"
+"I 've always found the wait staff and , if you sit at the bar , the cooks very friendly .","{service general, cooks, positive}","{service general, wait staff, positive};{service general, cooks, positive}"
+Nothing on the menu is less than amazing .,"{food quality, menu, positive}","{food quality, menu, positive}"
+"My party of two was feeling particularly ambitious , and we splurged on the Shilshole Sampler ... a beautiful assortment of enormous white gulf prawns , smoked albacore tuna , Ray 's fantastic manila clams seasoned with dill , scallops in a tasty soy dressing , and a tiny pile of Dungeness crab atop a sublime butter sauce .","{food style_options, white gulf prawns, positive};{food quality, butter sauce, positive};{food quality, soy dressing, positive};{food style_options, Shilshole Sampler, positive};{food quality, manila clams, positive}","{food style_options, Shilshole Sampler, positive};{food quality, butter sauce, positive};{food quality, manila clams seasoned with dill, positive};{food quality, scallops in a tasty soy dressing, positive};{food style_options, white gulf prawns, positive};{food style_options, smoked albacore tuna, positive};{food style_options, Dungeness crab, positive}"
+"I was frankly shocked when I read the bad reviews - this place is fantastic ; it has not let us down in any way , and we 've eaten here more than 10 times .","{restaurant general, place, positive}","{restaurant general, place, positive}"
+"Your a sushi fan , you love expertly cut fish , great sake , a killer SOHO location , and of course : Salmon , Tuna , Fluke , Yellow Tail , Cod , Mackeral , Jellyfish , Sea Urchin , Shrimp , Lobster , Sea Bream , Trout , Milk Fish , Blue Fin Tuna , Eel , Crab , Sardine , Monk Fish , Roe , Scallop , Oysters , and a varity of Toro .","{food quality, sushi, positive};{food style_options, fish, positive};{location general, SOHO location, positive};{food style_options, Toro, positive};{drinks quality, sake, positive}","{food quality, expertly cut fish, positive};{drinks quality, sake, positive};{location general, SOHO location, positive};{food quality, Salmon, positive};{food quality, Tuna, positive};{food quality, Fluke, positive};{food quality, Yellow Tail, positive};{food quality, Cod, positive};{food quality, Mackeral, positive};{food quality, Jellyfish, positive};{food quality, Sea Urchin, positive};{food quality, Shrimp, positive};{food quality, Lobster, positive};{food quality, Sea Bream, positive"
+The service is fantastic at this fun place .,"{restaurant general, place, positive};{service general, service, positive}","{ambience general, place, positive};{service general, service, positive}"
+"Also , there was only one bathroom stall- probably need more for such big crowds .","{restaurant miscellaneous, bathroom stall, negative}","{ambience general, bathroom stall, negative}"
+We left without ever getting service .,"{service general, service, negative}","{service general, service, negative}"
+I liked it .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– I highly recommend Mioposto .,"{restaurant general, Mioposto, positive}","{restaurant general, Mioposto, positive}"
+"The food is fantastic , authentic , delicious and very , very affordable .","{food quality, food, positive};{food prices, food, positive}","{food quality, food, positive};{food prices, food, positive}"
+I have eaten here three times and have found the quality and variety of the fish to be excellent .,"{food style_options, fish, positive};{food quality, fish, positive}","{food quality, fish, positive};{food style_options, fish, positive}"
+"But she is very friendly with certain people , making it even more annoying .","{service general, null, negative}","{service general, null, negative}"
+The regular menu here is slightly above average that is not worth the snotty attitude that you receive .,"{food quality, regular menu, neutral};{service general, null, negative}","{food quality, regular menu, negative};{service general, null, negative}"
+"Also , they serve THE best hummus in America , with a drizzle of fragrant olive oil ( which , I believe is the traditional way ) !","{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive};{food style_options, hummus, positive};{food quality, olive oil, positive}"
+great beer,"{drinks quality, beer, positive}","{drinks quality, beer, positive}"
+Seafood Plus,"{food quality, Seafood, positive}","{restaurant general, Seafood Plus, positive}"
+"it is sad there is not many people who frequent eating at places like these that look pricey because they are at the hotel ... but they are definitely one you dont want to miss , esp if your in downtown san jose .","{restaurant general, null, positive}","{restaurant general, null, positive};{restaurant prices, null, negative}"
+"They serve it in a tall , skinny hour-glass shaped glass to disguise the fact that you a getting a small juice at the price of a half gallon in a supermarket .","{drinks style_options, juice, negative};{drinks prices, juice, negative}","{drinks style_options, null, negative};{drinks prices, null, negative}"
+"The food was ok , but the service was so poor that the food was cold buy the time everyone in my party was served .","{service general, service, negative};{food quality, food, neutral}","{service general, service, negative};{food quality, food, negative}"
+great meal – the fish on the omikase platter was absolutely decadent -- there was none of the stringiness that sometimes accompanies fair sushi -- this fish was perfect ! ! ! !,"{food quality, fish on the omikase platter, positive};{food quality, meal, positive}","{food quality, omikase platter, positive};{food quality, fish, positive};{food quality, meal, positive}"
+"Drinks are suberb , and I feel like I am in a Third World country when I walk in the door .","{drinks quality, Drinks, positive};{ambience general, null, positive}","{drinks quality, Drinks, positive};{ambience general, null, positive}"
+Open & Cool Place with the Best Pizza and Coffee,"{food quality, Pizza, positive};{ambience general, Place, positive};{drinks quality, Coffee, positive}","{food quality, Pizza, positive};{ambience general, Place, positive};{drinks quality, Coffee, positive}"
+Green Tea creme brulee is a must !,"{food quality, Green Tea creme brulee, positive}","{food quality, Green Tea creme brulee, positive}"
+I found a new home and just moved with a long lease .,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+"They aren 't the most talkative , but everytime I 've been there they have been very busy , which probably accounts for the lack of conversation .","{service general, null, neutral}","{service general, null, neutral}"
+"The pizza itself is not exactly the best I 've had EVER , but still pretty good .","{food quality, pizza, positive}","{food quality, pizza, positive}"
+"We did have the same waiter the second time , so maybe the service is spotty and our luck is good .","{service general, waiter, positive}","{service general, waiter, negative}"
+– Thats a big statement considering I 've been pulling crab traps and making the cakes myself since I was about seven - but something about these little devils gets better every time .,"{food quality, cakes, positive}","{food quality, crab traps, positive}"
+Fabulous Italian Food !,"{food quality, Italian Food, positive}","{food quality, Italian Food, positive}"
+"However , this place is a gem , and I wo n't stop going back .","{restaurant general, place, positive}","{restaurant general, place, positive}"
+"it gets really busy , so get there on the early side so you can grab a seat , if you do have to wait , its not bad because the service is quick !","{service general, service, positive}","{service general, service, positive};{restaurant miscellaneous, null, neutral};{ambience general, null, neutral}"
+"The dinner only took us about an hour and the prices were alright for the strip , almost $ 50 /pp after tax and tip ( about average ) .","{restaurant prices, null, neutral}","{restaurant prices, null, neutral};{restaurant general, null, positive}"
+The onion rings are great !,"{food quality, onion rings, positive}","{food quality, onion rings, positive}"
+If you 're in the area you shouldn 't be disappointed .,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+– Great financial district mexican spot .,"{restaurant general, mexican spot, positive}","{restaurant general, mexican spot, positive}"
+The house special roll is really good .,"{food quality, house special roll, positive}","{food quality, house special roll, positive}"
+The waiters are very experienced and helpful with pairing your drink choice to your food tastes or vice versa .,"{service general, waiters, positive}","{service general, waiters, positive}"
+Perfection .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Poor customer service / poor pizza .,"{food quality, pizza, negative};{service general, customer service, negative}","{service general, customer service, negative};{food quality, pizza, negative}"
+"Overall , I would go back and eat at the restaurant again .","{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Server made several sake suggestions which were very good .,"{drinks quality, sake, positive};{service general, Server, positive}","{drinks quality, sake suggestions, positive}"
+My only negative comment is that I wish the pieces were a little bigger .,"{food style_options, pieces, negative}","{food style_options, pieces, negative}"
+"I picked the asparagus , which turned out to be incredible and perfectly prepared .","{food quality, asparagus, positive}","{food quality, asparagus, positive}"
+What may be interesting to most is the worst sevice /attitude comes from the owners of this establishment .,"{service general, owners, negative}","{service general, sevice, negative};{service general, owners, negative}"
+The only drawback is that this place is really expensive and the portions are on the small side .,"{restaurant prices, place, negative};{food style_options, portions, negative}","{food prices, portions, negative};{food style_options, portions, negative}"
+"Terrible service , food ok , pricey","{restaurant prices, null, negative};{service general, service, negative};{food quality, food, neutral}","{restaurant prices, null, negative};{service general, service, negative};{food quality, food, neutral}"
+Although the service could be improved considering the money you put in .,"{service general, service, negative}","{restaurant prices, null, negative};{service general, service, negative}"
+"You routinely see Indian families and friends dining there , which is always a good sign .","{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+"If I want to stand in line on Sunday for an hour to get average brunch food , then I would put Murphy 's at the top of the list .","{food quality, brunch food, neutral};{service general, null, negative}","{food quality, brunch food, neutral};{restaurant miscellaneous, null, negative}"
+For the amount of food we got the prices should have been lower .,"{food prices, food, negative}","{restaurant prices, null, negative};{food style_options, food, negative}"
+"Always busy , but they are good at seating you promptly and have quick service .","{service general, service, positive};{service general, null, positive}","{service general, service, positive};{ambience general, null, neutral}"
+The wine list is wonderful and the food reminds me of my recent trip to Italy .,"{drinks style_options, wine list, positive}","{drinks style_options, wine list, positive};{food quality, food, positive}"
+"the food was great , the margaritas too but the waitress was too busy being nice to her other larger party than to take better care of my friend and me .","{drinks quality, margaritas, positive};{service general, waitress, negative};{food quality, food, positive}","{service general, waitress, negative};{drinks quality, margaritas, positive};{food quality, food, positive}"
+"I ca n't saybenough good things about this restaurant , and I ca n't wait for my next several visits .","{restaurant general, restaurant, positive}","{restaurant general, restaurant, positive}"
+Love it every time,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"We are locals , and get the feeling the only way this place survives with such average food is because most customers are probably one-time customer tourists .","{food quality, food, negative}","{restaurant miscellaneous, place, negative};{food quality, food, negative}"
+Also love their caeser salad .,"{food quality, caeser salad, positive}","{food quality, caeser salad, positive}"
+She doesn 't make you feel welcome and treats you like an annoyance .,"{service general, null, negative}","{service general, null, negative}"
+It 's just the right size for the menu .,"{restaurant miscellaneous, null, positive}","{food style_options, null, positive}"
+"The food is fantastic , and the waiting staff has been perfect every single time we 've been there .","{food quality, food, positive};{service general, waiting staff, positive}","{service general, waiting staff, positive};{food quality, food, positive}"
+The desert was the perfect ending to an almost perfect dinner .,"{food quality, desert, positive};{food quality, dinner, positive}","{food quality, desert, positive}"
+"I have been here , spent tons of money on a chef special dinner and it was a major dissappointment .","{food prices, chef special dinner, negative};{food quality, chef special dinner, negative}","{food quality, chef special dinner, negative};{food prices, chef special dinner, negative}"
+I FOUND A NEW HOME ON SECOND AVENUE ! ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"– Had to wait thirty minutes to get in the door on a tuesday morning , but it was so worth it .","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative};{restaurant general, null, positive}"
+"– It is sad to see a place that was once `` THE `` place to meet and eat for Bfast or Lunch , now be the place that is a big `` DONT BOTHER . ``","{restaurant general, place, negative}","{restaurant general, place, negative}"
+"The lemon chicken tasted like sticky sweet donuts and the honey walnut prawns , the few they actually give you ... were not good .","{food quality, honey walnut prawns, negative};{food style_options, honey walnut prawns, negative};{food quality, lemon chicken, negative}","{food quality, lemon chicken, negative};{food quality, honey walnut prawns, negative}"
+"It was romantic - and even nice even with my sister , reminded me of Italy , and had artwork and music that kept up the feeling of being in a Mediterrean villa .","{ambience general, artwork, positive};{ambience general, null, positive};{ambience general, music, positive}","{ambience general, null, positive};{location general, null, positive}"
+The sushi was excellent and the wait staff was quick .,"{service general, wait staff, positive};{food quality, sushi, positive}","{service general, wait staff, positive};{food quality, sushi, positive}"
+"In fact , many want to return a second time during their visit .","{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Best Mexican place for lunch in the financial district .,"{restaurant general, Mexican place, positive}","{restaurant miscellaneous, Mexican place, positive}"
+i love this place !,"{restaurant general, place, positive}","{restaurant general, place, positive}"
+the atmosphere is great .,"{ambience general, atmosphere, positive}","{ambience general, atmosphere, positive}"
+Perfect on a cold day .,"{food quality, null, positive}","{restaurant miscellaneous, null, positive}"

experiments/de-en-pt/preds_hr.csv

@@ -0,0 +1,545 @@
+input,gold,pred
+Čekao sam 10-15 minuta da usluga naručim pivo i nikad više nisam poslužen.,"{service general, usluga, negative}","{service general, usluga, negative}"
+ambijent bio je miran i opuštajući odmor među svom djecom koja su trčala uokolo u centru Disneya.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive}"
+skriveni mali jem,"{restaurant general, null, positive}","{food quality, jem, positive}"
+Otišao sam tamo s prijateljem iz drugog grada ... i oboje smo bili impresionirani!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Ima odličan sushi i još bolji usluga.,"{service general, usluga, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{service general, usluga, positive}"
+"Sve njihove stavke jelovnika su hit, a poslužuju mimoze.","{food quality, stavke jelovnika, positive}","{food quality, stavke jelovnika, positive};{food style_options, stavke jelovnika, positive}"
+– ... i najbolje ljetno paluba iskustvo -- čak će vam donijeti i deku ako vam bude hladno na večernjem vremenu u Seattleu.,"{ambience general, paluba, positive};{service general, null, positive}","{ambience general, ljetno paluba, positive}"
+– Nakon 12 godina u Seattleu Ray's smatra se mjestom kojem se uvijek vraćamo.,"{restaurant general, Ray's, positive}","{restaurant general, Ray's, positive}"
+Ovdje ne možete pogriješiti.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Mislim da sam vjerojatno probao svaku stavku na njihovom jelovniku barem jednom, sve je izvrsno.","{food quality, jelovniku, positive}","{food quality, stavku, positive}"
+– feferoni stvarno debelo narezano -- Njam .,"{food style_options, feferoni, positive}","{food quality, feferoni, negative}"
+Creme brulee od zelenog čaja postaje bolji svaki put kad ga popijem.,"{food quality, Creme brulee od zelenog čaja, positive}","{drinks quality, Creme brulee od zelenog čaja, positive}"
+nije baš fina misao da se osjećaš nelagodno i da se moraš dotjerati.,"{ambience general, null, positive}","{service general, null, negative}"
+Atmosfera bilo je lijepo.,"{ambience general, Atmosfera, positive}","{ambience general, Atmosfera, positive}"
+apsolutno nevjerojatno! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+IZBJEGAVAJ MJESTO,"{restaurant general, MJESTO, negative}","{restaurant general, MJESTO, negative}"
+"Da budem iskren, bolje mi je bilo smrznuto pizza.","{food quality, pizza, negative}","{food quality, pizza, negative}"
+usluga je bila izuzetna - ponekad je postojao osjećaj da nas poslužuje vojska ljubaznih konobara.,"{service general, konobara, positive};{service general, usluga, positive}","{service general, usluga, positive};{service general, konobari, positive}"
+I sve su lijepo zapakirali da se nije prosulo .,"{service general, null, positive}","{food style_options, null, positive}"
+JAKO DOBRO!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+hrana je grešna.,"{food quality, hrana, positive}","{food quality, hrana, negative}"
+"Za početak, otprilike 8-10 oz sok od naranče koštat će vas 3 USD.","{drinks prices, sok od naranče, negative}","{drinks prices, sok od naranče, negative}"
+dobro izbor sakea .,"{drinks style_options, izbor sakea, positive}","{drinks quality, sakea, positive}"
+"Iako sam mogao i bez mladih koji su s nama podijelili večer, naše divno poslužitelj i hrana učinilo je iskustvo vrlo pozitivnim.","{restaurant miscellaneous, null, positive};{service general, poslužitelj, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{service general, poslužitelj, positive}"
+Kakav nalaz!,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+– Mioposto ima vrlo kreativan i ukusan pizza meni .,"{food style_options, pizza meni, positive};{food quality, pizza meni, positive}","{food style_options, pizza meni, positive};{food quality, pizza, positive}"
+"Na nedavnom putovanju, naš konobar bio je krajnje omalovažavajući, dok su ni manje ni više nego tri člana osoblja čekala dvije japanske djevojke koje su sjedile u blizini.","{service general, konobar, negative}","{service general, konobar, negative};{service general, osoblja, negative}"
+"inače ne bih dovršio brokoli kad naručim ovakvu hranu, ali po prvi put, svaki komad je bio pun događaja kao i prvi ... Jakobove kapice i kozice bili su tako svježe i lijepo kuhano.","{food quality, Jakobove kapice, positive};{food quality, brokoli, positive};{food quality, kozice, positive}","{food quality, Jakobove kapice, positive};{food quality, kozice, positive};{food style_options, brokoli, negative}"
+"Nije najjeftiniji sushi, ali se svaki put isplatio.","{food quality, sushi, positive};{food prices, sushi, neutral}","{food prices, sushi, negative};{food quality, sushi, positive}"
+Nikada se ne osjećate mrzovoljno i nabijeno nakon što tamo jedete.,"{food quality, null, positive}","{restaurant general, null, positive}"
+"Kao dio male četveročlane zabave, naša hrana je dostavljena bez komentara;","{service general, null, negative}","{food quality, hrana, neutral}"
+Nadam se da će se jednog dana Scooner ili kasnije vratiti ono što je nekad bilo.,"{restaurant general, Scooner ili kasnije, negative}","{restaurant general, Scooner, negative}"
+"Kao prvo, hrana je stigla brzo i sve zajedno :) sviđa mi se to... mrzim pretencioznost stvari koje dolaze jedna za drugom.","{service general, null, positive}","{food quality, hrana, positive};{service general, null, positive}"
+hrana je bila izvrsna!,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+"Ako postoji red na isti dan u tjednu cijelo vrijeme dok je mjesto otvoreno, znate da je to sjajno.","{restaurant general, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+Najugodnije iznenađenje bio je ček koji nije premašio moja očekivanja kako to uvijek biva u većini mjesta.,"{restaurant prices, null, positive}","{restaurant miscellaneous, ček, positive}"
+"U najboljem slučaju, hrana je bila dobra i definitivno precijenjena.","{food quality, hrana, positive};{food prices, hrana, negative}","{food quality, hrana, negative};{food style_options, hrana, negative}"
+Vanjska terasa ima skraćeni izbornik .,"{food style_options, izbornik, neutral}","{ambience general, Vanjska terasa, negative}"
+Najbolje indijska hrana u L.A.,"{food quality, indijska hrana, positive}","{food quality, indijska hrana, positive}"
+Prijeđite na stvar - ovo je nevjerojatno!,"{restaurant general, null, positive}","{restaurant miscellaneous, null, negative}"
+"hrana nije ono što je nekada bila ( napitci došlo je do ozbiljnog smanjenja) cijene su porasle, a usluga je najgora stvar koju sam igdje doživio (uključujući kopnenu Europu).","{service general, usluga, negative};{food style_options, napitci, negative};{food quality, hrana, negative};{food prices, hrana, negative}","{food quality, hrana, negative};{drinks quality, napitci, negative};{prices, cijene, negative};{service general, usluga, negative}"
+Libanonska hrana ! Njam!,"{food quality, Libanonska hrana, positive}","{food quality, Libanonska hrana, positive}"
+brokoli bili su tako svježi i ukusni.,"{food quality, brokoli, positive}","{food quality, brokoli, positive}"
+I daju dobru količinu za cijenu.,"{food style_options, null, positive}","{food prices, null, positive};{food quality, null, positive}"
+Vrlo razočaravajuće,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+NAJBOLJE u Seattleu Popis vina,"{drinks style_options, Popis vina, positive}","{drinks quality, vina, positive}"
+– Ne mogu reći dovoljno o ovome mjesto .,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+– jedem na ovom mjestu već više od 8 godina i nikad nisam pojeo niti jedan loš obrok .,"{food quality, obrok, positive}","{food quality, obrok, positive}"
+Otišao sam kući i ponovno ih potražio na mreži gdje sam otkrio da postoji poveznica za darivanje koja ne radi pa sam poslala e-poruku restoranu o nepostojećoj usluzi i obmanjujućoj vezi.,"{restaurant miscellaneous, restoranu, negative}","{service general, null, negative}"
+Otmjeni komadi egzotične ribe na 100 dolara tanjur i NI JEDAN se nije mogao jesti.,"{food quality, egzotične ribe, negative};{food style_options, egzotične ribe, negative};{food prices, tanjur, negative}","{food quality, egzotične ribe, negative};{food prices, tanjur, negative}"
+"Imao sam ukusno janjeća korma , saag paneer , samose , naan itd.","{food quality, samose, positive};{food quality, naan, positive};{food quality, janjeća korma, positive};{food quality, saag paneer, positive}","{food quality, janjeća korma, positive};{food quality, saag paneer, positive};{food quality, samose, positive};{food quality, naan, positive}"
+Poslužuje jako dobro sushi.,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"Kao i obično, omikase nije razočarao u svježini, iako je dobio niske ocjene za kreativnost i odabir.","{food style_options, omikase, negative};{food quality, omikase, positive}","{food quality, omikase, positive};{food style_options, omikase, negative}"
+"Riža je presuha, tuna nije bila ni tako svježa.","{food quality, Riža, negative};{food quality, tuna, negative}","{food quality, presuha, negative};{food quality, tuna, negative}"
+Njihovo rakova jaja benedict stvara ovisnost.,"{food quality, rakova jaja benedict, positive}","{food quality, rakova jaja benedict, positive}"
+Sačuvajte mjesta za ukusne deserti .,"{food quality, deserti, positive}","{food quality, deserti, positive}"
+Naš poslužitelj bio je vrlo profesionalan i ljubazan.,"{service general, poslužitelj, positive}","{service general, poslužitelj, positive}"
+Otišao sam ovdje na preporuku i sigurno ću se vraćati uvijek iznova.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"hrana je bila dobra, ali je bila previše blaga.","{food quality, hrana, positive};{food quality, hrana, negative}","{food quality, hrana, negative}"
+– Moj suprug i ja volimo jesti u Mioposto Café .,"{restaurant general, Mioposto Café, positive}","{restaurant general, Mioposto Café, positive}"
+– Ovo je bilo sjajno iskustvo objedovanja.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Osoblje  bilo je stvarno ljubazno.,"{service general, null, positive}","{service general, Osoblje, positive}"
+Lako smo potrošili više od 40 dolara po osobi (ne uključujući alkohol) i još uvijek smo bili gladni.,"{restaurant prices, null, negative};{food style_options, null, negative}","{food prices, null, negative};{food quality, null, negative}"
+Ovo je ravno među mjestima u Tokiju što se tiče svježine.,"{food quality, null, positive}","{food quality, null, positive}"
+Groovy glazba učinio je večeru ležernom.,"{ambience general, glazba, positive}","{ambience general, glazba, positive}"
+"Nakon što je jednog člana naše stranke više puta udarila konobarica, ljubazan zahtjev da ne bude udaren doveo je konobaricu do uvredljivog brbljanja.","{service general, konobarica, negative}","{service general, konobarica, negative}"
+– Ray's (iznenađujuće) ima NAJBOLJE i najraznolikije u gradu vinska karta.,"{drinks style_options, vinska karta, positive}","{drinks style_options, vinska karta, positive};{drinks quality, vinska karta, positive}"
+Vjerojatno se ipak ne bih vratio jer ne znam je li to vrijedno toga.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"čips i salsa su tako ukusni, a cijene su fantastične.","{restaurant prices, null, positive};{food quality, čips i salsa, positive}","{food prices, null, positive};{food quality, chips i salsa, positive}"
+"sommelier je fantastičan, prizeman i izuzetno obrazovan.","{service general, sommelier, positive}","{service general, sommelier, positive}"
+velika gusta feferoni,"{food style_options, feferoni, positive}","{food quality, feferoni, positive}"
+Ne isplati se uopće ići i trošiti novac tamo! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Uvredljivo precijenjen,"{restaurant prices, null, negative}","{restaurant prices, null, negative}"
+Unutrašnji ambijent je bio moderan.,"{ambience general, Unutrašnji ambijent, positive}","{ambience general, Unutrašnji ambijent, positive}"
+NE IDITE!,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Dok se to ne dogodi, moj savjet je da se DRŽITE DALJE.","{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Oh, zaboravio sam spomenuti da oni nemaju uslugu kruha.","{service general, null, negative}","{service general, uslugu kruha, negative}"
+Nisu masni ni ništa.,"{food quality, null, positive}","{food quality, null, positive}"
+"glazba je sjajna, nijedna noć nije bolja ni gora, barske nježnosti su velikodušne s točenjem, a lagana atmosfera podići će vam raspoloženje.","{ambience general, atmosfera, positive};{drinks style_options, barske nježnosti, positive};{ambience general, glazba, positive}","{ambience general, atmosfera, positive};{drinks quality, nježnosti, positive};{music quality, glazba, positive};{restaurant general, null, positive}"
+"Lijepo ambijent, ali jako precijenjeno mjesto.","{restaurant general, mjesto, negative};{ambience general, ambijent, positive}","{restaurant miscellaneous, mjesto, negative};{ambience general, ambijent, positive}"
+sushi ovdje je izvrstan!,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+– Izuzetno mi je drago izvijestiti da je moja večera u Ray's Boathouse prošlog petka u potpunosti nadmašila moja očekivanja.,"{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}"
+"Večere uvijek su bile izvrsne, u smislu kvalitete hrane.","{food quality, Večere, positive}","{food quality, Večere, positive}"
+Sve njihove aplikacije su ukusne.,"{food quality, aplikacije, positive}","{food quality, aplikacije, positive}"
+Blue Ribbon opravdava svoju fantastičnu reputaciju.,"{restaurant general, Blue Ribbon, positive}","{restaurant miscellaneous, Blue Ribbon, positive}"
+Osjećao sam se neugodno i sljedeći put sam otišao u toalet u kasinu.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+– Odlučio sam jesti u Stacku zbog njihove fiksna cijena večere prije nastupa .,"{food prices, fiksna cijena večere prije nastupa, neutral}","{restaurant prices, Stack, positive}"
+– Odveo sam svoje roditelje ovamo za njihovu godišnjicu – jako jako razočaran! ! !,"{restaurant general, null, negative}","{restaurant miscellaneous, null, negative}"
+Nepobjedivo sushi!,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"Za početak, naš ljupki poslužitelj Brooke brzo je bio spreman preuzeti moju narudžbu pića.","{service general, Brooke, positive}","{service general, Brooke, positive}"
+Svaki put kad se pozove `` 0-sixtynine `` barmen svima kupi piće!,"{service general, barmen, positive}","{service general, barmen, positive}"
+"Beskrajna zabava, super glazba, sjajno osoblje! ! !","{restaurant general, null, positive};{service general, osoblje, positive};{ambience general, glazba, positive}","{ambience general, zabava, positive};{service general, osoblje, positive};{ambience general, glazba, positive}"
+Sajam odabir jelovnika .,"{food style_options, odabir jelovnika, neutral}","{food quality, jelovnika, positive}"
+Dva klinca bezobraznika sjedila su blizu nas u prvom dijelu naše večere... zamijenila ih je ljupka predtinejdžerka koja se pretvarala da guši svaki put kad bi se spomenuli morski plodovi za njezinim stolom.,"{restaurant miscellaneous, null, negative}","{service general, predtinejdžerka, positive}"
+Odbio sam to jer su u procesu pokušaja popravka jaja razbili nešto drugo u posudi i bio sam previše frustriran da nastavim.,"{food quality, posudi, negative}","{food quality, jaja, negative}"
+"imao je mnogo jela, ali NAJBOLJE je bilo jastog na 3 načina.","{food quality, jastog na 3 načina, positive}","{food quality, jastog, positive};{food style_options, jela, positive}"
+"predjelo bilo je zanimljivo, ali Creme Brulee bilo je vrlo ukusno i ukusno.","{food quality, Creme Brulee, positive};{food quality, predjelo, positive}","{food quality, Creme Brulee, positive};{food quality, predjelo, neutral}"
+dekor je bio lijep i jedinstven.,"{ambience general, dekor, positive}","{ambience general, dekor, positive}"
+"Svjež je, gostoljubiv, ukusan i opuštajući.","{food quality, null, positive};{ambience general, null, positive}","{food quality, null, positive};{ambience general, null, positive}"
+Stvara ovisnost!,"{restaurant general, null, positive}","{drugs style_options, null, negative}"
+"Čak je i slanutak, koji inače smatram presuhim, bio dobar.","{food quality, slanutak, positive}","{food quality, slanutak, positive}"
+Ovo mjesto je super! !,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"To je veliki kompliment, pogotovo u nestalnom restoranskom poslu,... dosta je već!","{restaurant general, null, positive}","{restaurant miscellaneous, restoranskom, positive}"
+"Nakon što sam sjedio s praznom čašom više od 20 minuta, otišao sam.","{service general, null, negative}","{service general, null, negative}"
+Obavezno probajte rolada od kamenica .,"{food quality, rolada od kamenica, positive}","{food quality, rolada od kamenica, positive}"
+Začuđen sam da je ovaj restoran kategoriziran kao $ $ $ umjesto kao $ $ $ $.,"{restaurant prices, restoran, negative}","{restaurant prices, restoran, negative}"
+"Bilo je pristojno, ali ništa posebno.","{food quality, null, neutral}","{restaurant general, null, neutral}"
+"Usluga je bila malo spora, našoj konobarici je trebala čitava vječnost da nam da ček iako nije bilo toliko zauzeto.","{service general, konobarici, negative};{service general, Usluga, negative}","{service general, usluga, negative}"
+"– Odlično pića , hašiš od kukuruzne govedine , kava , B Brzi burritos , Bez glutena jelovnik .","{food quality, hašiš od kukuruzne govedine, positive};{drinks quality, pića, positive};{food style_options, jelovnik, positive};{drinks quality, kava, positive};{food quality, B Brzi burritos, positive}","{drinks quality, pića, positive};{food quality, hašiš od kukuruzne govedine, positive};{food quality, B Brzi burritos, positive};{food style_options, Bez glutena jelovnik, positive};{drinks quality, kava, positive}"
+meni za ručak je sjajna ponuda!,"{food prices, meni za ručak, positive}","{food quality, ponuda, positive}"
+"Zauvijek je trajalo da preuzmemo našu narudžbu, nadopunjavanje vode bilo je previše za tražiti, a jedini put kad je bila brza bilo je kad smo tražili naš račun kada smo mogli privući njezinu pozornost.","{service general, null, negative}","{service general, null, negative}"
+konobar je bio malo neprijateljski raspoložen i osjećaj u restoranu je bio prepun.,"{ambience general, osjećaj, negative};{service general, konobar, negative}","{service general, konobar, negative};{ambience general, osjećaj, negative}"
+– Nedavno sam imao zadovoljstvo večerati u ovom divnom restoranu u 2. ulici i vau kakvu smo sjajnu večer proveli.,"{restaurant general, restoranu, positive}","{restaurant general, restoranu, positive}"
+"Specijalitet je ovdje dekadentan palačinke, ali vratio sam se već četiri puta i svaki put sam bio zadivljen.","{food quality, palačinke, positive}","{food quality, dekadentan palačinke, positive}"
+– Prilično jeftino za meksičko sjedište I centar grada.,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant prices, meksičko sjedište, positive}"
+"predjelo od kamenica, jastoga, rakova (male veličine) bilo je savršeno predjelo za moju ženu.","{food quality, predjelo od kamenica, jastoga, rakova (male veličine, positive}","{food quality, predjelo od kamenica, jastoga, rakova, positive}"
+Upravo sam saznao da možete imati mjesto samo za sebe noću i vikendom za privatnu zabavu - jedva čekam da tamo proslavim moj sljedeći rođendan.,"{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, null, positive}"
+"– Kao i kod većine restorana u Seattleu, Mioposto usluga je bio loš, a hrana precijenjena.","{service general, usluga, negative};{food prices, hrana, negative}","{service general, usluga, negative};{food quality, hrana, negative}"
+"Možete ga lako čuti, pa je to bio ugodan zvuk, a ne prenaglašen.","{ambience general, null, positive}","{ambience general, zvuk, positive}"
+Samo idite tamo i uvjerite se sami.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+To je sjajno malo mjesto s tonama potencijala da bude mjesto u susjedstvu da usluga nije tako bezlična i korporativna.,"{restaurant general, mjesto, positive};{service general, usluga, negative}","{restaurant miscellaneous, mjesto, positive}"
+"Brunch kod Murphyja je za umrijeti, moj specijalitet ... omlet od bjelanjaka , hrana uvijek je svježe pripremljena.","{food quality, omlet od bjelanjaka, positive};{food quality, Brunch, positive};{food quality, hrana, positive}","{food quality, omlet od bjelanjaka, positive};{food quality, Brunch, positive}"
+Mama Mia – Živim u susjedstvu i osjećam se sretnom što živim pored tako sjajne pizzerija .,"{restaurant general, pizzerija, positive}","{restaurant general, pizzerija, positive}"
+– ušuškan pokraj Beverly Centera.,"{location general, null, neutral}","{restaurant miscellaneous, null, negative}"
+osoblje je prilično ljubazno.,"{service general, osoblje, positive}","{service general, osoblje, positive}"
+A usluga je jednostavno bila potrošena - pravi užitak.,"{service general, usluga, positive}","{service general, usluga, positive}"
+Ok ... – Možda sam ušao na nečiji loš dan ...,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Uzeo sam Meduza, Skuš, Plava perajna tuna i Sake Ikura rolada među ostalima, i svi su bili dobri.","{food quality, Plava perajna tuna, positive};{food quality, Sake Ikura rolada, positive};{food quality, Skuš, positive};{food quality, Meduza, positive}","{food quality, Meduza, Skuš, Plava perajna tuna, Sake Ikura rolada, positive}"
+ŠTO JOŠ MOŽETE REĆI LIJEPO LJUDI NEVJEROJATNO HRANA WOW,"{food quality, HRANA, positive};{service general, LJUDI, positive}","{food quality, HRANA, positive};{restaurant general, null, positive};{service general, LJUDI, positive}"
+Uvijek dobro.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Nakon toga su mi se usta jako osušila i imala sam taj potpis? MSG ? okus koji mi ostaje u grlu nakon što sam napustio restoran.,"{food quality, null, negative}","{food quality, null, negative}"
+O da ... pogled je također bio dobar.,"{location general, pogled, positive}","{restaurant general, null, positive}"
+"upravitelj je stalno prekidao s `` Mogu li još nešto učiniti za vas? ``, čudan komentar jer jedva da je slušala, a kamoli odgovorila na naš izraz razočaranja našim iskustvom.","{service general, upravitelj, negative}","{service general, upravitelj, negative}"
+servis kreće se od osrednjeg do uvredljivog.,"{service general, servis, negative}","{service general, servis, negative}"
+Svježe sastojci i super ukusno.,"{food quality, sastojci, positive};{food quality, null, positive}","{food quality, sastojci, positive}"
+ambijent restorana bio je lijep i dobar za finu večeru.,"{ambience general, ambijent, positive}","{ambience general, ambijent restorana, positive};{restaurant general, restorana, positive}"
+A gore je odlično mjesto za druženje.,"{ambience general, gore, positive}","{restaurant miscellaneous, mjesto, positive}"
+– Nije loše.,"{restaurant general, null, neutral}","{restaurant general, null, neutral}"
+Imao sam kafta tanjur i bio je savršen.,"{food quality, kafta tanjur, positive}","{food quality, kafta tanjur, positive}"
+– Ovo je mjesto poznato po doručak .,"{food quality, doručak, positive}","{restaurant miscellaneous, mjesto, neutral}"
+Čekali smo 35 minuta na stol za 8 što je bilo u redu za tako veliku gužvu.,"{service general, null, neutral}","{service general, null, neutral}"
+Cjelokupno osoblje bilo je izuzetno susretljivo i zadovoljilo je svaku moju potrebu.,"{service general, osoblje, positive}","{service general, osoblje, positive}"
+"Mjesto je bilo jako lijepo vibra ... dobro glazba , atmosfera i sretnog izgleda ljudi .","{ambience general, vibra, positive};{ambience general, atmosfera, positive};{restaurant miscellaneous, ljudi, positive};{ambience general, glazba, positive}","{ambience general, glazba, positive};{ambience general, atmosfera, positive};{ambience general, izgleda ljudi, positive};{ambience general, Mjesto, positive}"
+"Isprobajte Chefov izbor za sushi jer je dimljeni žuti rep bio nevjerojatan, a rolice također su bile ukusne.","{food quality, Chefov izbor za sushi, positive};{food quality, rolice, positive};{food quality, dimljeni žuti rep, positive}","{food quality, rolice, positive};{food quality, dimljeni žuti rep, positive}"
+"sushi je svjež kao što dolazi? pomislili biste da je ocean u njihovom dvorištu, bez šale!","{food quality, sushi, positive}","{food quality, sushi, positive}"
+"hrana je bila u redu, s malo-ukusnijom-od-normalnog salsa .","{food quality, salsa, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{food quality, salsa, negative}"
+"Za izbirljive ljubitelje sushija i one koji su kušali najbolje što NYC može ponuditi, riba je najsvježija, a usluga vrhunska.","{service general, usluga, positive};{food quality, riba, positive}","{food quality, riba, positive};{service general, usluga, positive}"
+Stari Pouzdan,"{restaurant general, null, positive}","{restaurant general, Stari Pouzdan, positive}"
+Jedan od najboljih Sushi mjesto u gradu.,"{restaurant general, Sushi mjesto, positive}","{food quality, Sushi, positive}"
+"Hrana što se tiče hrane, u redu je, ali malo skupo za ono što dobijete s obzirom da restoran nije otmjeno mjesto.","{food quality, Hrana, neutral};{restaurant prices, restoran, negative};{ambience general, restoran, neutral}","{food quality, Hrana, neutral};{food prices, Hrana, negative}"
+"– Volim njihovu pizzu, posebno pizzu s gljivama.","{food quality, pizza, positive};{food quality, pizzu s gljivama, positive}","{food quality, pizzu, positive};{food quality, pizzu s gljivama, positive}"
+Došli su u vlastitoj otmjenoj kutiji za van i s domaćom glazurom; vrlo lagano i ne preslatko.,"{food quality, null, positive}","{food quality, glazurom, positive};{food style_options, glazurom, positive}"
+Uživao sam u hrana,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+Bio sam u ovom restoranu više od desetak puta bez pritužbi do danas.,"{restaurant general, restoranu, positive}","{restaurant general, restoranu, positive}"
+"Radije ga naručim i pokupi jer mi se ne sviđaju poslužitelji, posebno jedna mlada žena.","{service general, mlada žena, negative};{service general, poslužitelji, negative}","{service general, poslužitelji, negative};{service general, žena, negative}"
+strašan nalaz,"{restaurant general, null, positive}","{restaurant general, nalaz, negative}"
+"Nije bio najsvježiji plodovi mora ikada, ali okus i prezentacija bili su u redu.","{food quality, plodovi mora, neutral};{food style_options, plodovi mora, neutral}","{food quality, plodovi mora, negative};{food style_options, plodovi mora, positive}"
+"Međutim, vrijednost i usluga jako nedostaju.","{service general, usluga, negative};{restaurant prices, null, negative}","{restaurant general, null, negative};{service general, usluga, negative}"
+U Grammercy/Union Square/East Village ovo su moji susjedi i moj favorit mjesto .,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"strana krumpira je za umrijeti, kao i labne (umak od jogurta).","{food quality, strana krumpira, positive};{food quality, labne (umak od jogurta, positive}","{food quality, labne (umak od jogurta, negative};{food quality, krumpira, negative}"
+NEVJEROJATNO .,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+"Kakva ukusna, pahuljičasta poslastica!","{food quality, null, positive}","{food quality, poslastica, positive}"
+"Odlično hrana, bolje Margarite!","{drinks quality, Margarite, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{food quality, Margarite, positive}"
+usluga je stvarno pažljiva i šarmantna.,"{service general, usluga, positive}","{service general, usluga, positive}"
+"Što je najvažnije, bili smo toliko uzbuđeni zbog hrane nakon što smo vidjeli vrlo kreativan jelovnik.","{food style_options, jelovnik, positive}","{food style_options, jelovnik, positive};{food quality, hrana, positive}"
+Udoban mjesto za 2,"{ambience general, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+Najbolja stvar je što su cijene također prilično razumne.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+"Obećala je da će razgovarati s konobaricom koja je odletjela u bijesu, ali teško da smo njezino obećanje mogli shvatiti ozbiljno, budući da se nije potrudila saznati ime konobarice.","{service general, null, negative}","{service general, null, negative}"
+chana masala (garbanzo grah) također je izvrstan.,"{food quality, chana masala (garbanzo grah, positive}","{food quality, chana masala (garbanzo grah, positive}"
+"Ovo ustanova je doista značajno opalo nakon (a to se ponavlja) emitiranja FOOD TELEVISIONS `` DINERS , DRIVE-INS AND DIVES `` čiji je domaćin bio Guy Fieri , u kojem je Schooner or Later bio predmet .","{restaurant general, ustanova, negative}","{restaurant miscellaneous, Schooner or Later, positive}"
+Volim Dungeness rakove i kod Raya ih možete poslužiti na otprilike 6 različitih načina!,"{food style_options, Dungeness rakove, positive}","{food style_options, Dungeness rakove, positive}"
+Hrana je bila dobra i ukusna.,"{food quality, Hrana, positive}","{food quality, Hrana, positive}"
+Bilo je apsolutno nevjerojatno.,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+Ovo je odlično mjesto za ukusan obrok .,"{food quality, obrok, positive}","{food quality, obrok, positive}"
+"plus, ja sam alergičan na rižu, a konobar je bio nevjerojatno susretljiv -- nisam ni trepnuo okom!","{service general, konobar, positive}","{service general, konobar, negative}"
+– Jako sam se razočarao hranom u Pagodi.,"{food quality, hranom, negative}","{food quality, hranom, negative}"
+Precijenjen,"{restaurant prices, null, negative}","{restaurant general, null, negative}"
+Ovo je tužno zbog onoga što je nekoć bilo jedno od najboljih mjesta na kojima ste ikada mogli jesti.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Kada uđete unutra, počinje pravo iskustvo.","{restaurant general, null, positive}","{ambience general, null, positive}"
+a konobar je predložio savršen sake ! !,"{drinks quality, sake, positive}","{drinks quality, sake, positive}"
+vlasnik je ratoboran prema gostima koji imaju pritužbu.,"{service general, vlasnik, negative}","{service general, vlasnik, negative}"
+"Sve što želite i još više, vrlo svježe.","{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive};{food style_options, null, positive}"
+Moj prijatelj je uživao u Aljaski kraljevski losos na žaru s ukusnim Washington russet krumpir u kremi i hrskavim zeleni grah .,"{food quality, zeleni grah, positive};{food quality, Aljaski kraljevski losos na žaru, positive};{food quality, Washington russet krumpir u kremi, positive}","{food quality, Aljaski kraljevski losos na žaru s ukusnim Washington russet krumpir u kremi i hrskavim zeleni grah, positive}"
+"hrana je bila vrlo dobra, file mignon je vjerojatno najbolja koju sam ikada probao.","{food quality, hrana, positive};{food quality, file mignon, positive}","{food quality, hrana, positive};{food quality, file mignon, positive}"
+"– Mercedesov restoran je tako ukusan, usluga je nedvojbeno sjajna!","{service general, usluga, positive};{food quality, null, positive}","{restaurant general, Mercedesov restoran, positive};{service general, usluga, positive}"
+Mogu toplo preporučiti njihove različite saag i paneer i korma .,"{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, saag, positive};{food quality, paneer i korma, positive}"
+hrana je sjajna i zli su Krvava Mary.,"{drinks quality, Krvava Mary, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{drinks quality, Krvava Mary, positive}"
+"Fino hrana, ali bez začina!","{food quality, hrana, positive};{food quality, hrana, negative}","{food quality, hrana, negative};{food quality, hrana, positive}"
+Još jedan plus je otvoren osjećaj restorana sa staklenim zidovima sa svih strana.,"{ambience general, osjećaj, positive}","{ambience general, osjećaj restorana sa staklenim zidovima, positive}"
+Njam!,"{food quality, null, positive}","{food quality, null, positive}"
+"Sama kupaonica je vrlo mala s dva WC-a i samo jednim umivaonikom, djevojka je ostala potpuno usput vješajući papirnate ručnike iz automata.","{restaurant miscellaneous, kupaonica, negative}","{ambience general, kupaonica, negative}"
+Volite enchiladas i pileća juha - i svakako pogledajte njihove specijaliteti .,"{food quality, enchiladas, positive};{food quality, pileća juha, positive};{food quality, specijaliteti, positive}","{food quality, enchiladas, positive};{food quality, pileća juha, positive};{food style_options, specijaliteti, positive}"
+hrana je jednostavno nezaboravna!,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+Menadžment bi stvarno trebao obratiti pozornost i trenirati svoje konobarstvo i naučiti ih nekim pravilnim manirima.,"{service general, konobarstvo, negative}","{service general, konobarstvo, negative}"
+"osoblje je ljubazno, a dekor je bio etičan i šaren.","{ambience general, dekor, positive};{service general, osoblje, positive}","{ambience general, dekor, positive};{service general, osoblje, positive}"
+Najbolji Chuwam Mushi koji sam ikada imao.,"{food quality, Chuwam Mushi, positive}","{food quality, Chuwam Mushi, positive}"
+"Porcije bilo je sasvim dovoljno za mene, ali možda nije za nekog ko jede puno.","{food style_options, Porcije, neutral}","{food style_options, Porcije, neutral}"
+Probajte Pizza Ensalata!,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza Ensalata, positive}"
+Ipak bih preporučio ovo mjesto.,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"– sushi ovdje je savršeno dobar, ali za 5 dolara po komadu, ili bi kriške ribe trebale biti veće ili se ne bi trebalo pretvarati da je ovo restoran umjerene cijene (čak i za NYC) .","{food prices, sushi, negative};{food style_options, sushi, negative};{food quality, sushi, positive};{restaurant prices, restoran, negative}","{food quality, sushi, positive};{food prices, sushi, negative}"
+Sigurno ćete se provesti vrlo šarmantno.,"{restaurant general, null, positive}","{ambience general, null, positive}"
+"Od tada smo se vratili i također smo imali sjajno iskustvo, kušajući više malih tanjura i raznovrsno pivo (hladno i dobro).","{restaurant general, null, positive};{drinks quality, pivo, positive}","{food quality, pivo, positive};{food quality, tanjura, positive}"
+Najbolji Sushi u gradu.,"{food quality, Sushi, positive}","{food quality, Sushi, positive}"
+osoblje bilo je vrlo lijepo i ljubazno i očito kinesko.,"{service general, osoblje, positive}","{service general, osoblje, positive}"
+"Naručili smo izbor malih tanjura, a luk na cipelama, pizza s kozjim sirom, šparoge na žaru i prženi brie s voćem svi su bili vrlo dobri.","{food quality, luk na cipelama, positive};{food quality, šparoge na žaru, positive};{food quality, pizza s kozjim sirom, positive};{food quality, prženi brie s voćem, positive}","{food quality, pizza s kozjim sirom, positive};{food quality, šparoge na žaru, positive};{food quality, prženi brie s voćem, positive};{food quality, luk na cipelama, positive}"
+Dobar posao!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Ipak, jedna stvar koju sam kasnije shvatio je da je restoran ili koristio MSG ili uređaj za omekšavanje mesa na odrezak.","{food quality, odrezak, negative}","{food quality, odrezak, negative}"
+Sjajno izbor sakea .,"{drinks style_options, izbor sakea, positive}","{drinks style_options, sakea, positive}"
+Svaka čast ovim momcima.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Osim ako ne svraćate samo na nekoliko pića, ne bih preporučio da idete ovamo.","{restaurant general, null, negative}","{restaurant general, null, negative}"
+Sjajno boca vina .,"{drinks quality, boca vina, positive}","{drinks quality, vina, positive}"
+otvoreni kombinirani tanjur sa sezamom je povoljna cijena za hrpu hrane koja se daje.,"{food style_options, otvoreni kombinirani tanjur sa sezamom, positive};{food prices, otvoreni kombinirani tanjur sa sezamom, positive}","{food prices, kombinirani tanjur sa sezamom, positive};{food style_options, kombinirani tanjur sa sezamom, positive};{food quality, kombinirani tanjur sa sezamom, positive}"
+PUNO PRECIJENJENO! ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Isplatilo se čekati,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+Ne može biti bolje od toga.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+najbolje kozice od meda koje smo svi probali.,"{food quality, kozice od meda, positive}","{food quality, kozice od meda, positive}"
+Prikazani su na mreži hrane i to zaslužuju.,"{restaurant miscellaneous, null, positive}","{food style_options, hrane, positive}"
+Volim toplo i ugodno okruženje .,"{ambience general, okruženje, positive}","{ambience general, okruženje, positive}"
+Šmrkavi stav,"{service general, null, negative}","{ambience general, stav, negative}"
+"atmosfera je ambiciozna, a dekor je svečana i nevjerojatna ...","{ambience general, dekor, positive};{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive};{ambience general, dekor, positive}"
+"Njihove specijalne rolice su impresivne, iako se ne sjećam što smo imali.","{food quality, specijalne rolice, positive}","{food quality, specijalne rolice, positive}"
+– Volio sam raviole od bundeve i njoke od kozjeg sira (5 velikih na tanjur umjesto 20-ak malih njoka) i moja sestra ju je obožavala filet mignon na vrh špinata i pire krumpir .,"{food quality, raviole od bundeve, positive};{food quality, filet mignon na vrh špinata i pire krumpir, positive};{food quality, njoke od kozjeg sira, positive};{food style_options, njoke od kozjeg sira, positive}","{food quality, njoke od kozjeg sira, positive};{food style_options, raviole od bundeve, negative};{food quality, filet mignon na vrh špinata i pire krumpir, positive}"
+"Nije najveći porcije, ali primjeren.","{food style_options, porcije, neutral}","{food style_options, porcije, neutral}"
+"Idite s prijateljima, pričekajte pola sata uz šalicu joea i uživajte više od svog prosjeka doručak.","{restaurant general, null, positive};{food quality, doručak, positive}","{restaurant miscellaneous, null, positive}"
+super usluga .,"{service general, usluga, positive}","{service general, usluga, positive}"
+"Tada nam je naplaćen njihov najskuplji sake (20 dolara + po porciji), dok smo zapravo pili sake manji od pola te cijene.","{service general, null, negative}","{drinks prices, sake, negative};{drinks style_options, sake, negative}"
+ukusno,"{food quality, null, positive}","{food quality, null, positive}"
+pileći curry i pileća tikka masala su moja omiljena jela od mesa.,"{food quality, pileći curry, positive};{food quality, pileća tikka masala, positive}","{food quality, pileći curry i pileća tikka masala, positive}"
+"najbolji restoran na svijetu, odličan dekor, odličan služba za korisnike, prijateljski upravitelj","{restaurant general, restoran, positive};{ambience general, dekor, positive};{service general, služba za korisnike, positive};{service general, upravitelj, positive}","{restaurant general, restoran, positive};{service general, služba za korisnike, positive};{ambience general, dekor, positive};{service general, upravitelj, positive}"
+pića su bila dobra.,"{drinks quality, pića, positive}","{drinks quality, pića, positive}"
+"Prezentacija hrane bila je dodatni bonus, izgledala je jednako dobro kao i okusa!","{food style_options, hrane, positive};{food quality, hrane, positive}","{food style_options, Prezentacija hrane, positive}"
+Čak ni tada narudžba nije bila točna i još smo čekali par stvari.,"{service general, null, negative}","{service general, null, negative}"
+– Ovdje su nas jednom vrlo grubo ponijeli za doručkom.,"{service general, null, negative}","{service general, null, negative}"
+"Sjajna hrana, spektakularna lokacija i ljubazna usluga tjeraju nas da se vraćamo iz godine u godinu.","{location general, lokacija, positive};{service general, usluga, positive};{food quality, hrana, positive}","{service general, usluga, positive};{location general, lokacija, positive};{food quality, hrana, positive}"
+WOW ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Uštedite sebi gubljenje vremena i NEMOJTE posjećivati .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Hrana je bila dobra i jeftina.,"{food quality, Hrana, positive};{food prices, Hrana, positive}","{food quality, Hrana, positive};{food prices, Hrana, positive}"
+Mmm ... dobro !,"{restaurant general, null, positive}","{food quality, null, positive}"
+Super je ako ste tamo proveli dan i niste se htjeli voziti da biste jeli.,"{location general, null, positive}","{restaurant miscellaneous, null, positive}"
+"Sve u svemu, moram reći da Ray's Boathouse zaslužuje svoju titulu institucije u Seattleu.","{restaurant general, Ray's Boathouse, positive}","{restaurant miscellaneous, Ray's Boathouse, positive}"
+Izvrsna vrijednost sushi uz visoku kvalitetu i lijepo okruženje.,"{ambience general, okruženje, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{ambience general, okruženje, positive};{food quality, sushi, positive};{food prices, sushi, positive}"
+"Bilo je toliko puno da sam jedva uspio pojesti, ali jesam jer je bilo ukusno.","{food style_options, null, neutral};{food quality, null, positive}","{food quality, null, positive};{food style_options, null, negative}"
+Sviđa mi se ovo restoran,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}"
+Nije preporučljivo! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Stajali smo tamo 10 minuta dok su zaposlenici hodali naprijed-natrag ignorirajući nas.,"{service general, zaposlenici, negative}","{service general, zaposlenici, negative}"
+"Moj g/ž i ja smo se složili da je hrana vrlo osrednja, posebno s obzirom na cijenu.","{food quality, hrana, negative};{food prices, hrana, negative}","{food quality, hrana, negative};{food prices, hrana, negative}"
+"– hrana ovdje je nevjerojatna, iako je kvaliteta nedosljedna tijekom ručka .","{food quality, ručka, negative};{food quality, hrana, positive}","{food quality, hrana, negative};{food quality, hrana, positive}"
+Nemam ništa loše za reći o ovome mjesto.,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"jedini problem je što stvarno morate zagrijati pizzu prije nego što postane jestiva, čak i kada naručite unaprijed.","{food quality, pizzu, negative}","{food quality, pizza, negative}"
+– Ovo je moj `` koji moram dovesti goste iz grada u `` restoran i uvijek uživaju i oduševljeni su njime.,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}"
+Imao sam tanjur za kaftu i uživao sam u njemu.,"{food quality, tanjur za kaftu, positive}","{food quality, tanjur za kaftu, positive}"
+Bilo je jasno da mu nije stalo.,"{service general, null, negative}","{service general, null, negative}"
+Cezar salata koju sam naručio imala je toliko limuna da je nisam mogla pojesti.,"{food quality, Cezar salata, negative}","{food quality, Cezar salata, negative}"
+"Naš poslužitelj je nastavio biti pažljiv tijekom cijele noći, ali ostao sam zbunjen jednim pitanjem: Tko misli da je Ray's prikladno mjesto za odvođenje male djece na večeru?","{service general, poslužitelj, positive};{restaurant miscellaneous, Ray's, neutral}","{service general, poslužitelj, positive}"
+"Dobro Hrana, Odlično Usluga, Prosječne cijene (Za Strip)","{food quality, Hrana, positive};{restaurant prices, null, neutral};{service general, Usluga, positive}","{food quality, Hrana, positive};{restaurant prices, null, neutral};{service general, Usluga, positive}"
+18:00 u subotu prije predstave na Broadwayu i brzo smo sjeli i bili posluženi.,"{service general, null, positive}","{service general, null, positive}"
+"Oni posvećuju toliko detalja svemu, od miso juha do složenih peciva.","{food quality, miso juha, positive};{food quality, peciva, positive}","{food quality, miso juha, positive};{food quality, peciva, positive}"
+6 dolara s napojnicom.,"{restaurant prices, null, positive}","{drinks prices, napojnicom, negative}"
+atmosfera je bila sjajna.,"{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive}"
+"Drugim riječima, ako oni 'ne zarađuju $ $ na vama, onda nemate visoku ocjenu na njihovoj 'usluga ljestvici'.","{service general, usluga, negative}","{restaurant prices, null, negative}"
+– Stvarno sam uživao u obroku ovdje.,"{food quality, obroku, positive}","{food quality, obroku, positive}"
+"glazba svirala je vrlo moderno, 20-30 nešto pop glazba, ali subwoofer za zvučni sustav nalazio se ispod mog sjedala, što je postalo iritantno usred večere.","{ambience general, subwoofer za zvučni sustav, negative};{ambience general, glazba, positive}","{ambience general, zvučni sustav, negative};{ambience general, glazba, negative}"
+Sveto Humus!,"{food quality, Humus, positive}","{food quality, Humus, positive}"
+"Za moj ulaz & eacute ; e, potpuno sam uživao u prženim aljaškim morskim kapicama upotpunjenim blitvom, srcima artičoke, komoračem i pecorinom toscanom.","{food quality, prženim aljaškim morskim kapicama, positive};{food style_options, prženim aljaškim morskim kapicama, positive}","{food quality, prženim aljaškim morskim kapicama upotpunjenim blitvom, srcima artičoke, komoračem i pecorinom toscanom, positive}"
+"dekor je rustikalni, tradicionalni japanski.","{ambience general, dekor, neutral}","{ambience general, dekor, positive}"
+"Ne samo da izbor može biti inovativan, već postoji i lijepa ravnoteža tradicionalnog sushija.","{food style_options, sushija, positive};{food style_options, izbor, positive}","{food style_options, izbor, positive};{food quality, sushija, positive}"
+Vjerojatno ćete biti razočarani.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"hrana je sjajna, barmeni idu dalje.","{service general, barmeni, positive};{food quality, hrana, positive}","{service general, barmeni, positive};{food quality, hrana, positive}"
+Restoran nudi opsežnu vinska karta i ambijent koji nećete zaboraviti!,"{drinks style_options, vinska karta, positive};{ambience general, ambijent, positive}","{ambience general, ambijent, positive};{drinks style_options, vinska karta, positive}"
+"naan je bio jedan od najboljih koje sam jeo i stvarno sam uživao u bhartha, ne previše rajčici.","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, naan, positive};{food quality, bhartha, positive}"
+Vlasnicima Open Sesame ... Bravo ... Jedva čekam vratiti se na ručak u vaš restoran!,"{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}"
+"riba je bila svježa, iako je bila izrezana vrlo tanko.","{food style_options, riba, negative};{food quality, riba, positive}","{food quality, riba, negative};{food quality, riba, positive}"
+Bio sam tamo puno otad i uvijek se dobro provedem.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Moj favorit pizzerija u Seattleu,"{restaurant general, pizzerija, positive}","{restaurant general, pizzerija, positive}"
+toplo preporučujem ovo mjesto svima koji žele probati indain hrana po prvi put.,"{food quality, indain hrana, positive}","{food quality, indain hrana, positive}"
+Precijenjeno,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Najgori usluga koji sam ikada imao,"{service general, usluga, positive}","{service general, usluga, negative}"
+"Ispostavilo se da je vlasnik sjedio tik do nas i kada je došao provjeriti naše probleme, bio je vrlo omalovažavajući i ponudio simboličnih 20% popusta na naš račun.","{service general, vlasnik, negative}","{service general, vlasnik, negative}"
+Otišao sam tamo s nekim prijateljima jedne večeri igrati bingo i gledati utakmicu soxa i bilo je fantastično!,"{restaurant general, null, positive}","{ambience general, null, positive}"
+POTPUNO PRECIJENJENO!,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"– jaja , palačinke , krumpir , svježe voće i jogurt -- sve što poslužuju je ukusno.","{food quality, palačinke, positive};{food quality, jaja, positive};{food quality, krumpir, positive};{food quality, null, positive};{food quality, jogurt, positive};{food quality, svježe voće, positive}","{food quality, palačinke, positive};{food quality, krumpir, positive};{food quality, jogurt, positive};{food quality, svježe voće, positive}"
+– Ray's je mjesto za visoku kvalitetu večere s plodovima mora.,"{food quality, večere s plodovima mora, positive}","{food quality, večere s plodovima mora, positive}"
+Također stvarno uživam u jednostavnosti dekor i intimnosti osjećaj malog restorana.,"{ambience general, dekor, positive};{ambience general, osjećaj, positive}","{ambience general, dekor, positive};{ambience general, restorana, positive}"
+Vraćamo se nazad. :D,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+"Trebao sam to spomenuti, ali nisam očekivao da će hrana biti tako blaga.","{food quality, hrana, negative}","{food quality, hrana, negative}"
+"Kad sam ušao, bio sam zatečen njihovim nevjerojatnim drveni dekor.","{ambience general, drveni dekor, positive}","{ambience general, drveni dekor, positive}"
+"Maleno je mjesto, pa ako stignete prije 20 sati vikendom (četvrtak? nedjelja), lakše ćete pronaći stol ili mjesto u sushi baru.","{restaurant miscellaneous, mjesto, neutral}","{restaurant miscellaneous, Maleno, positive}"
+Najbolje susjedstvo Standby .,"{restaurant general, Standby, positive}","{restaurant miscellaneous, Standby, positive}"
+Vratio bih se tamo u tren oka.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Ima *vrlo * razumnu cijenu, posebno zbog kvalitete hrane.","{food prices, hrane, positive}","{food quality, hrane, positive};{food prices, hrane, positive}"
+"dosta hrane, vjeruj mi.","{food style_options, hrane, positive}","{food style_options, hrane, positive}"
+To je savršeno mjesto za romantični sastanak u dvoje ili tajni sastanak!,"{ambience general, mjesto, positive};{restaurant miscellaneous, mjesto, positive}","{ambience general, mjesto, positive}"
+Također imajte odlične margarite!,"{drinks quality, margarite, positive}","{food quality, margarite, positive}"
+Nepretenciozno je i podzemno.,"{ambience general, null, positive}","{ambience general, null, positive}"
+Mjesto je sljedeća najbolja stvar u kuhanju moje mame.,"{food quality, null, positive}","{restaurant general, Mjesto, positive}"
+"Najbolje mjesto za opušteni nedjeljni doručak usred jahti, zatim prošećite obližnjom Farmer's Market.","{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+"Ako možete, dođite do ovog mjesta brodom i provedite cijelu večer.","{restaurant miscellaneous, mjesta, positive}","{restaurant miscellaneous, mjesta, positive}"
+za desert smo imali mango đumbir creme brulee ... oh la la yummy ! ! !,"{food quality, mango đumbir creme brulee, positive}","{food quality, mango đumbir creme brulee, positive}"
+"Isplati se čekati, pogotovo jer će vas nazvati kad stol bude spreman.","{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+Imaju veliki izbor riba i čak navode iz kojih oceana dolaze; Atlantik ili Pacifik.,"{food style_options, riba, positive}","{food style_options, riba, positive}"
+Pa pretpostavljam da je teško sjediti kad si nevidljiv za osoblje.,"{service general, osoblje, negative}","{service general, osoblje, negative}"
+Izvrsno otvoren i prijateljski raspoložen ambijent.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive};{restaurant miscellaneous, otvoren, positive}"
+Kratak razgovor s upraviteljem na kraju obroka bio je najveće razočarenje - bilo bi malo reći da smo ``oduševljeni``.,"{service general, upraviteljem, negative}","{service general, upravitelj, negative}"
+"Ray's je nešto poput ustanove u Seattleu, ali s obzirom na njegov prekrasan zvučni pogled, sumnjao sam da su pohvale više zbog krajolika nego zbog hrane i usluge.","{location general, zvučni pogled, positive}","{location general, pogled, positive};{restaurant miscellaneous, Ray's, positive}"
+Zakleo sam se da se nikad više neću vraćati po toplo pivo i osrednje jelo.,"{food quality, jelo, negative};{drinks quality, pivo, negative}","{drinks quality, pivo, negative};{food quality, jelo, negative}"
+"Ako je vani lijepo, zatražite stol na balkon .","{ambience general, balkon, positive}","{ambience general, balkon, positive}"
+Sjajna hrana sa sjajnom atmosferom!,"{ambience general, atmosferom, positive};{food quality, hrana, positive}","{ambience general, atmosferom, positive};{food quality, hrana, positive}"
+Završio sam obrok s neobičnim desert s okusom porta i čokolade ... ukusno!,"{food quality, desert s okusom porta i čokolade, positive}","{food quality, desert s okusom porta i čokolade, positive}"
+Dobio sam predjelo od školjki i škampa i bilo je u redu.,"{food quality, predjelo od školjki i škampa, neutral}","{food quality, predjelo od školjki i škampa, positive}"
+"pizze su tanke kore, a jelovnik nudi vrlo kreativne kombinacije i nadjeve.","{food style_options, pizze, positive};{food style_options, jelovnik, positive}","{food quality, kore, positive};{food style_options, jelovnik, positive}"
+To je sjajno mjesto za uživanje hrana i upoznavanje prijatelja.,"{restaurant miscellaneous, mjesto, positive};{food quality, hrana, positive}","{restaurant miscellaneous, mjesto, positive};{food quality, hrana, positive}"
+"usluga je bila izvrsna, kava je bila dobra čak i prema standardima Starbucksa, a hrana je bila izvanredna.","{service general, usluga, positive};{food quality, hrana, positive};{drinks quality, kava, positive}","{food quality, kava, positive};{food quality, hrana, positive};{service general, usluga, positive}"
+Ovo je mjesto za opuštanje i uživanje u najboljoj kvaliteti hrana koju industrija može ponuditi.,"{ambience general, mjesto, positive};{food quality, hrana, positive}","{food quality, hrana, positive}"
+Vratio bih se samo zbog vina iskustva.,"{drinks quality, vina, positive}","{drinks quality, vina, positive}"
+Najbolji lignje u Seattleu!,"{food quality, lignje, positive}","{food quality, lignje, positive}"
+Prezentacija Snooze je izvrsna i jedno je od onih mjesta na kojima se osjećate sofisticiranije samo zato što ste tamo; ali skinite slojeve i dobit ćete precijenjeni IHOP s visokim čelom izbornik .,"{restaurant prices, Snooze, negative};{food style_options, izbornik, negative};{ambience general, Snooze, positive}","{food quality, Snooze, negative};{food style_options, Snooze, negative};{ambience general, Snooze, negative}"
+"Žalio sam se upravitelju, ali on se nije ni ispričao.","{service general, upravitelju, negative}","{service general, upravitelju, negative}"
+Mnogo više od samog sjajnog pogled!,"{location general, pogled, positive}","{location general, pogled, positive}"
+Atmosfera  je bila sasvim u redu.,"{ambience general, null, neutral}","{ambience general, Atmosfera, neutral}"
+Nakon sjedenja trebalo je oko 30 minuta da konačno dobijemo obrok.,"{service general, null, negative}","{service general, null, negative}"
+"– U doba povećanja troškova u restoranima, lijepo je vidjeti mjesto koje se protivi tom trendu i jednostavno pruža visoku kvalitetu hrana i dobru usluga, točka.","{service general, usluga, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{restaurant prices, mjesto, positive};{service general, usluga, positive}"
+"Jako mi se svidjela atmosfera, ali hrana nije bila vrijedna te cijene.","{ambience general, atmosfera, positive};{food quality, hrana, negative};{food prices, hrana, negative}","{food quality, hrana, negative};{restaurant prices, null, negative};{ambience general, atmosfera, positive}"
+"Nalazi se u trgovačkom centru u blizini Beverly Centera, nije najbolji lokacija, ali hrana me tjera da se vraćam po još.","{location general, lokacija, neutral};{food quality, hrana, positive}","{food quality, hrana, positive};{location general, lokacija, negative}"
+"Na svom obroku morao sam vratiti svoja jaja zbog jednostavnog zahtjeva da razbijem jarmove prije kuhanja, i morao bih ih ponovno poslati da nisam odbio obrok svi zajedno .","{food quality, obroku, negative};{food quality, jaja, negative}","{food style_options, jaja, negative}"
+"bend je bio vrlo dobar, a usluga je bila pažljiva.","{ambience general, bend, positive};{service general, usluga, positive}","{service general, usluga, positive};{food quality, bend, positive}"
+"– Kako opisati najbolji sushi u New Yorku: hmmmm, ukusan, nevjerojatan, fantastičan, sočan, savršen, ne, sve gore navedeno.","{food quality, sushi, positive}","{food quality, sushi, positive}"
+– Šarmantan lokacija uz marinu u Long Beachu i prosječan hrana Schoonera ili Latera nažalost ne nadoknađuju njegovu vrlo lošu korisnička služba.,"{service general, korisnička služba, negative};{food quality, hrana, neutral};{location general, lokacija uz marinu u Long Beachu, positive}","{service general, korisnička služba, negative};{food quality, hrana, neutral};{location general, lokacija, positive}"
+"Odmah smo sjeli, stol je bio privatan i lijep.","{ambience general, stol, positive}","{ambience general, stol, positive}"
+"dobro sake, dobro hrana – iskreno, uopće ne znam puno o japanskoj hrani.","{drinks quality, sake, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{drinks quality, sake, positive}"
+Ponesite svoj mobitel jer ćete možda morati čekati da uđete u najbolji sushi restoran na svijetu: BLUE RIBBON SUSHI .,"{restaurant general, BLUE RIBBON SUSHI, positive}","{restaurant general, BLUE RIBBON SUSHI, positive}"
+"Na kraju je naš ček iznosio 27 dolara za 4 male palačinke, burrito za doručak, sok od naranče i ledeni čaj (imao sam vodu).","{food style_options, palačinke, negative};{food prices, burrito za doručak, negative};{drinks prices, sok od naranče, negative};{food prices, palačinke, negative};{drinks prices, ledeni čaj, negative}","{food prices, burrito za doručak, negative};{food prices, palačinke, negative};{drinks prices, ledeni čaj, negative};{drinks prices, sok od naranče, negative}"
+Dobro hrana!,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+"catering nije na ovom svijetu, a Raouls pileća juha od povrća ljulja moj svijet! ! !","{food quality, Raouls pileća juha od povrća, positive};{food quality, catering, positive}","{food quality, pileća juha od povrća, positive};{food quality, catering, negative}"
+Trebao sam samo tražiti ček kad sam to vidio; ali njihov jelovnik bio je toliko jedinstven da sam nastavio .,"{food style_options, jelovnik, positive}","{food style_options, jelovnik, positive}"
+Sjajno doručak,"{food quality, doručak, positive}","{food quality, doručak, positive}"
+brancin na rižotu od jastoga bio je najbolji.,"{food quality, brancin na rižotu od jastoga, positive}","{food quality, brancin na rižotu od jastoga, positive}"
+– Atmosfera  izvrsna je za svaku posebnu prigodu koju želite proslaviti.,"{ambience general, null, positive}","{ambience general, Atmosfera, positive}"
+"Sjajno sezonska riba i plodovi mora, s otmjenom okruženje uz obalu .","{food quality, sezonska riba, positive};{food quality, plodovi mora, positive};{ambience general, okruženje uz obalu, positive}","{food quality, riba i plodovi mora, positive};{location general, okruženje uz obalu, positive}"
+"pizze nisu velike, a kora je tanka ... imajte to na umu kada naručujete.","{food style_options, pizze, neutral};{food style_options, kora, neutral}","{food style_options, pizze, negative};{food quality, kora, negative}"
+Jedina pozitivna stvar kod Mioposta je lijepa lokacija.,"{location general, lokacija, positive}","{location general, lokacija, positive}"
+Cijenim i njihovu dostavu.,"{service general, dostavu, positive}","{service general, null, positive}"
+Jako razočaran.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"pizza je ukusna, a salate su fantastične.","{food quality, pizza, positive};{food quality, salate, positive}","{food quality, pizza, positive};{food quality, salate, positive}"
+Najsvježije sushi – volim ovo restoran .,"{restaurant general, restoran, positive};{food quality, sushi, positive}","{food quality, sushi, positive}"
+odrezak je pečen baš po mojim željama (srednje pečen) i bio je lijep i sočan.,"{food quality, odrezak, positive}","{food quality, odrezak, positive};{food style_options, odrezak, positive}"
+"Ozbiljno, nećete pogriješiti ako tražite nepretencioznu lokalnu zabavu.","{ambience general, null, positive}","{restaurant miscellaneous, null, positive}"
+"vlasnici su super zabavni, a izbor piva vrijedi ostati.","{service general, vlasnici, positive};{drinks style_options, izbor piva, positive}","{drinks style_options, izbor piva, positive};{service general, vlasnici, positive}"
+Sjajno točeno i izbor boca i pizza kamenje.,"{food quality, pizza, positive};{drinks style_options, točeno i izbor boca, positive}","{drinks style_options, boca, positive};{food quality, pizza kamenje, positive}"
+"Jamčim da se nećete razočarati, tu je i usluga parkiranja.","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, usluga parkiranja, positive}"
+Kasnovečernja večera s izuzetnim hrana .,"{food quality, hrana, positive}","{food quality, hrana, positive};{restaurant miscellaneous, null, positive}"
+"porcije su ipak velike, pa nemojte naručivati previše.","{food style_options, porcije, neutral}","{food style_options, porcije, positive}"
+Definitivno ima jedan od najboljih jukebox koje sam vidio u dugo vremena.,"{ambience general, jukebox, positive}","{ambience general, jukebox, positive}"
+Usluga bila je pristojna.,"{service general, Usluga, neutral}","{service general, Usluga, positive}"
+Apsolutno ukusno.,"{food quality, null, positive}","{food quality, null, positive}"
+"Oh, i krumpirići sa sirom su sjajni!","{food quality, krumpirići sa sirom, positive}","{food quality, krumpirići sa sirom, positive}"
+Svi koji su sjedili straga vani složili su se da je to najgora usluga koju smo ikada dobili.,"{service general, usluga, negative}","{service general, usluga, negative}"
+"Možda nisam guru za sushi, ali mogu vam reći da je hrana ovdje sasvim u redu i da nema puno više od toga.","{food quality, hrana, negative}","{food quality, hrana, positive}"
+"Izvrsno hrana, lijepo ambijent, prilično skupo","{restaurant prices, null, negative};{ambience general, ambijent, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{ambience general, ambijent, positive};{food prices, hrana, negative}"
+"Tope se u ustima nigiri i sashmi , a i vrlo ukusni kiflice.","{food quality, kiflice, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}","{food quality, kiflice, positive};{food quality, nigiri i sashmi, positive}"
+Napokon obrok koji ćete dugo pamtiti!,"{food quality, obrok, positive}","{food quality, obrok, positive}"
+"Najbolje hrana, fenomenalno usluga","{service general, usluga, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{service general, usluga, positive}"
+Preporučam ga za noć kada se želite razbacivati! (bilo je malo skupo),"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant miscellaneous, null, positive}"
+"Iako je ova zalogajnica imala relativno dobru hranu, osoblje restorana se činilo potpuno ravnodušnim prema našoj prisutnosti, a takav se stav odrazio na nedostatak usluge.","{food quality, hranu, positive};{service general, osoblje restorana, negative}","{service general, osoblje, negative};{food quality, hranu, positive}"
+Bez usporedbe,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"pa što se tiče kozice, bile su svježe i imale su laganu hrskavost u odnosu na tijesto ... takooo dobro ... orasi su narezani na manje komade i vrlo su hrskavi i ukusni.","{food quality, kozice, positive};{food quality, orasi, positive};{food quality, tijesto, positive}","{food quality, kozice, positive};{food quality, orasi, positive}"
+Tako sam sretan što imam prekrasan talijanski restoran u svom susjedstvu.,"{restaurant general, talijanski restoran, positive}","{restaurant general, talijanski restoran, positive}"
+Čekali smo sat vremena da sjednemo.,"{service general, null, negative}","{service general, null, negative}"
+"Naručili smo i iako smo naručili 4 predjela, hrana je stigla tek 45 minuta kasnije... UZ NAŠE GLAVNO JELO.","{service general, null, negative}","{service general, null, negative}"
+Jedva čekam da se ponovno vratim nadolazeći vikend!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Ako ste zainteresirani za dobar okus (bez okusa i mirisa ribe), velika porcije i kreativna sushi jela ovo je vaše mjesto...","{food quality, null, positive};{food style_options, porcije, positive};{food style_options, sushi jela, positive}","{food quality, jela, positive};{food quality, okus, positive};{food style_options, porcije, positive};{food style_options, sushi jela, positive}"
+Savršeno mjesto za izvođenje gostiju iz grada u bilo koje doba godine.,"{restaurant general, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+Probao sam sva tri artikla na njoj tanjur i bili su izvrsni.,"{food quality, tanjur, positive}","{food quality, artikla na njoj tanjur, positive}"
+Dobro za večeru kasno u noć (planiranje u zadnji čas) bez rezervacije.,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+tamo nikad nisam razočaran hrana.,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+– Daleko najbolji bar u East Villageu ...,"{restaurant general, bar, positive}","{restaurant general, bar, positive}"
+To je sjajno mjesto za gledanje ljudi.,"{restaurant miscellaneous, mjesto, positive}","{ambience general, mjesto, positive}"
+"Prostor je bio ograničen, ali hrana je to nadoknadila.","{food quality, hrana, positive};{restaurant miscellaneous, Prostor, negative}","{food quality, hrana, positive};{ambience general, Prostor, negative}"
+Jakobove kapice se očito kuhaju na crnom maslinovom maslacu što ih zaista čini jedinstvenima (da ne spominjemo ukusnima).,"{food quality, Jakobove kapice, positive};{food style_options, Jakobove kapice, positive}","{food quality, Jakobove kapice, positive}"
+Ovo mjesto je šarmantno i opuštajuće.,"{ambience general, mjesto, positive}","{ambience general, mjesto, positive}"
+uopće nije za žvakanje.,"{food quality, null, positive}","{food quality, null, negative}"
+Bili smo u Seattleu samo jednu noć i tako mi je drago što smo odabrali Rays za večeru!,"{restaurant general, Rays, positive}","{restaurant general, Rays, positive}"
+"– Nikada neću zaboraviti nevjerojatan obrok, usluga i ambijent koji doživljavam u ovom restoranu.","{service general, usluga, positive};{ambience general, ambijent, positive};{food quality, obrok, positive}","{service general, usluga, positive};{food quality, obrok, positive};{ambience general, ambijent, positive}"
+Sjajno posebno predjelo od španjolske skuše i savršeno sushi u kutiji (to jegulja s avodcaom -- um um um ) .,"{food quality, sushi u kutiji, positive};{food quality, posebno predjelo od španjolske skuše, positive};{food quality, jegulja s avodcaom, positive}","{food quality, kutija (to jegulja s avodcaom, positive};{food quality, sushi, positive};{food quality, posebno predjelo od španjolske skuše, positive}"
+Vikendom ćete možda morati čekati nekoliko sati.,"{service general, null, neutral}","{service general, null, negative}"
+"– hrana nije bila sjajna, a konobari su bili nepristojni.","{service general, konobari, negative};{food quality, hrana, negative}","{food quality, hrana, negative};{service general, konobari, negative}"
+"9 oz odrezak je došao sljedeći i imao je odličan okus, barem u početku.","{food quality, 9 oz odrezak, positive}","{food quality, 9 oz odrezak, positive}"
+"Kad sam stigao tamo, sjeo sam uz stepenice gdje je atmosfera bila ugodna, a usluga užasna!","{service general, usluga, negative};{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive};{service general, usluga, negative}"
+"vinska karta je nevjerojatna, opsežna i raznolika, hrana je nevjerojatna, a osoblje je sve bilo jako lijepo, dobro u svom poslu i kulturno.","{service general, osoblje, positive};{drinks style_options, vinska karta, positive};{food quality, hrana, positive}","{food quality, vinska karta, positive};{food style_options, vinska karta, positive};{food quality, hrana, positive};{service general, osoblje, positive}"
+– NE MOŽE BITI BOLJE! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Nedjeljom poslijepodne svira bend i jako je zabavno.,"{ambience general, bend, positive}","{ambience general, bend, positive}"
+"Sve, a mislim sve na izborniku je preslatko.","{food quality, izborniku, positive}","{food quality, izborniku, negative}"
+"Znam da mnogi ljudi imaju svoje omiljene vrste pizza i pizza mjesta, ali Mioposto pizza nema kvalitetu i dobar okus.","{food quality, pizza, negative}","{food quality, pizza, negative}"
+"Postoji samo jedno mjesto na istočnoj obali koje ima sve, plus puno više.","{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+Uvijek pobjednik.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Prethodne recenzije su rekle da su prilagođene djeci ... dajte mi odmor s dvoje male djece što je svjetlosna godina.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+pizze su lagane i ukusne.,"{food quality, pizze, positive}","{food quality, pizze, positive};{food style_options, pizze, positive}"
+"Pogledajte umjetnost na zidovima, vrlo šarena!","{ambience general, umjetnost na zidovima, positive}","{ambience general, umjetnost na zidovima, positive}"
+Osrednji hrana,"{food quality, hrana, neutral}","{food quality, hrana, neutral}"
+Nikad se više neću vratiti.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Bilo nam je vrlo teško privući pozornost konobarice i konačno smo morali ustati i ući unutra razgovarati s upraviteljem.,"{service general, konobarice, negative}","{service general, konobarice, negative}"
+Nikad prevelika gužva i uvijek odlično usluga .,"{service general, usluga, positive};{restaurant miscellaneous, null, positive}","{service general, usluga, positive};{restaurant miscellaneous, null, positive}"
+ti si na vrućem spoju i on/ona ima potrebu za sushi ... onda bi ovo moglo biti pravo mjesto.,"{food quality, sushi, positive}","{restaurant miscellaneous, ti, positive}"
+"– Ne mogu vjerovati Murphy's postoji više od 25 godina, nevjerojatno.","{restaurant miscellaneous, Murphy's, positive}","{restaurant general, Murphy's, positive}"
+"Možete biti zauzeti petkom za stolom, ali kada sjednete, usluga je toliko učinkovita da možete brzo ući i izaći.","{service general, usluga, positive}","{service general, usluga, positive}"
+"to? poslužuju se ili s umak od papra ili redukcija crnog vina, iako se oba nisu mogla razlikovati po okusu.","{food quality, redukcija crnog vina, neutral};{food quality, umak od papra, neutral}","{food quality, null, negative};{food quality, redukcija crnog vina, negative};{food quality, umak od papra, negative}"
+Najljepši konobari u gradu.,"{service general, konobari, positive}","{service general, konobari, positive}"
+usluga bila je ljubazna i pažljiva.,"{service general, usluga, positive}","{service general, usluga, positive}"
+"Dok sam ovo pisao, upravo sam ponovno pokušao dati link i još uvijek ne radi.","{restaurant miscellaneous, null, negative}","{service general, null, negative}"
+sve daljnje potrebe koje smo možda imali nisu mogle biti zadovoljene jer nitko nije stao pokraj stola.,"{service general, null, negative}","{service general, null, negative}"
+"Dobar Sushi, visoka cijena","{food quality, Sushi, positive};{food prices, Sushi, negative}","{food quality, Sushi, positive};{food prices, Sushi, negative}"
+Ali poslužitelji bili su iznimno pažljivi i vrlo prijateljski raspoloženi.,"{service general, poslužitelji, positive}","{service general, poslužitelji, positive}"
+"Bio sam na ovom mjesto, ljudi, i LOŠE je.","{restaurant general, mjesto, negative}","{restaurant general, mjesto, negative}"
+odlično usluga,"{service general, usluga, positive}","{service general, usluga, positive}"
+Bilo je to kao da jedete u potpuno drugom restoranu.,"{restaurant general, null, positive}","{restaurant miscellaneous, restoranu, negative}"
+Dva palca gore!,"{food quality, null, positive}","{restaurant general, null, negative}"
+Zamislite moje sretno iznenađenje kada sam otkrio da su pogledi tek treća najbolja stvar kod Rayovih!,"{restaurant general, Rayovih, positive};{location general, pogledi, positive}","{restaurant general, Rayovih, positive}"
+"Ruku na srce, najbolji tuna koji sam ikada jeo.","{food quality, tuna, positive}","{food quality, tuna, positive}"
+"Ako idete vidjeti Dannyja Gansa ili samo odsjesti u Mirageu, ne propustite ovo.","{restaurant general, null, positive}","{restaurant general, null, positive}"
+odlično mjesto za ručak,"{restaurant general, mjesto za ručak, positive}","{restaurant general, mjesto, positive}"
+Volim doručak ovdje.,"{food quality, doručak, positive}","{food quality, doručak, positive}"
+sashimi bio je najsvježiji i najnježniji koji sam ikada probao.,"{food quality, sashimi, positive}","{food quality, sashimi, positive}"
+Njihov jelovnik neće vas razočarati.,"{food style_options, jelovnik, positive}","{food style_options, jelovnik, positive}"
+"Mnogi ljudi govore o odličnoj pizza i lošoj usluga, tako da to ne mogu biti samo vrijeđanja nekoliko nezadovoljnih kupaca.","{food quality, pizza, positive};{service general, usluga, negative}","{service general, usluga, negative};{food quality, pizza, positive}"
+Neću se vratiti .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+moja usluga bila je sjajna!,"{service general, usluga, positive}","{service general, usluga, positive}"
+sigurno se vraćamo u ovaj restoran .,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}"
+Sigurno će se vratiti.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Možda je dobro za onu jednu noć jednom za plavog mjeseca kada kuhari odluče upotrijebiti riba to je napola pristojno.,"{food quality, riba, negative}","{restaurant prices, null, negative}"
+"– Bio sam na Open Sesame samo jednom, ali još uvijek se vrtim od iskustva! !","{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}"
+"palačinke su svakako bile inventivne, ali 8,50 $ za 3 - 6 `` palačinke (jedna od njih je bila više kao 5 ``) u letu palačinki (uzorak od 3 različite palačinke) je dobro precijenjen.","{food style_options, palačinke, positive};{food prices, palačinke, negative}","{food prices, palačinke, negative};{food style_options, palačinke, positive};{food style_options, palačinki, positive}"
+"MEĐUTIM, jednog nedjeljnog poslijepodneva suprug i ja smo ipak otišli (iako uz moje glasno negodovanje) i bili smo ugodno iznenađeni.","{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+Itekako vrijedno toga,"{restaurant general, null, positive}","{restaurant general, Itekako, positive}"
+Oprez - stvarna je hrana za ljude koji vole najbolje.,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+"Imam, ali ovdje - u toaletu zahod je bila kupaonica, što je bilo čudno.","{restaurant miscellaneous, zahod, negative}","{ambience general, zahod, negative}"
+Najbolje jelo su honwy kozice od oraha - jednostavno izvanredne.,"{food quality, honwy kozice od oraha, positive}","{food quality, honwy kozice od oraha, positive}"
+palačinke trebaju biti veće (najmanje 8 ``) kako bi opravdale trošak čak i uz jedinstvene ponude.,"{food style_options, palačinke, negative}","{food style_options, palačinke, negative};{food prices, palačinke, negative}"
+– Prvi put sam večerao u ovom restoranu sa svojim sinom i bilo je apsolutno užasno!,"{restaurant general, restoranu, negative}","{restaurant general, restoranu, negative}"
+Izvrsno,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Parking je relativno dobar, imaju svoje parkiralište i možete parkirati u obližnjem parku.","{restaurant miscellaneous, null, positive}","{parking general, Parking, positive}"
+Cezar salata bila je izvrsna.,"{food quality, Cezar salata, positive}","{food quality, Cezar salata, positive}"
+"– Ne razumijem kako sam tako dugo bio stranac na ovom mjestu ... the fajita salata , the colorado , the fajitas - SVE je ukusno .","{food quality, colorado, positive};{food quality, fajita salata, positive};{food quality, fajitas, positive}","{food quality, fajita salata, positive};{food quality, colorado, positive};{food quality, fajitas, positive}"
+najbolje kineska hrana koje sam probao u dugo vremena,"{food quality, kineska hrana, positive}","{food quality, kineska hrana, positive}"
+Cijena je također bila odgovarajuća.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+Ukusno...!,"{food quality, null, positive}","{food quality, null, positive}"
+Stavili smo ime i iako je bilo otvorenih stolova rečeno nam je da će biti potrebno čekati 30 minuta.,"{service general, null, negative}","{service general, null, negative}"
+kava je također vrlo dobra.,"{drinks quality, kava, positive}","{drinks quality, kava, positive}"
+"Na piće smo čekali više od 30 minuta, a na hranu više od 1 i 2 sata.","{service general, null, negative}","{service general, null, negative}"
+poslužitelji iza pulta uvijek su ljubazni i uslužni.,"{service general, poslužitelji iza pulta, positive}","{service general, poslužitelji iza pulta, positive}"
+"Naš konobar nije postojao i nakon što je naša hrana konačno stigla više od sat vremena nakon što smo naručili, nismo dobili vodu ni posuđe.","{service general, konobar, negative}","{service general, konobar, negative};{service general, naručili, negative}"
+– Ovo mjesto je nevjerojatno precijenjeno.,"{restaurant general, mjesto, negative}","{restaurant general, mjesto, negative}"
+Vrlo loše služba za korisnike .,"{service general, služba za korisnike, negative}","{service general, služba, negative}"
+Ne možemo reći dovoljno o njihovim ukusnim gurmanima pizze!,"{food quality, pizze, positive}","{food quality, gurmanima pizze, positive}"
+"Nadalje, dok je riba nedvojbeno svježa, rolice obično su neobjašnjivo bljutave.","{food quality, rolice, negative};{food quality, riba, positive}","{food quality, rolice, negative};{food quality, riba, positive}"
+Jedina mana je gužva sjedenje i sporost usluga.,"{service general, usluga, negative};{restaurant miscellaneous, sjedenje, negative}","{service general, usluga, negative};{ambience general, sjedenje, negative}"
+"Nije ostalo puno mjesta za pušenje u New Yorku, ali pronašao sam svoju omiljenu pušaču balkon u gradu.","{restaurant miscellaneous, balkon, positive}","{restaurant miscellaneous, pušača balkon, positive}"
+"Podijelili smo obiteljski pladanj, a ja sam posebno uživao u crni bakalar u sake kasu .","{food quality, crni bakalar u sake kasu, positive}","{food quality, crni bakalar u sake kasu, positive};{food style_options, obiteljski pladanj, positive}"
+"Ali prostor je malen i lijep, a usluga je korisna.","{ambience general, prostor, positive};{service general, usluga, positive}","{service general, usluga, positive};{ambience general, prostor, negative}"
+Vrijedilo je čekati.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+ukusan .,"{food quality, null, positive}","{restaurant general, ukusan, negative}"
+Sladak,"{food quality, null, positive}","{food quality, Sladak, positive}"
+- Osrednji Usluga / Kvaliteta,"{service general, Usluga, neutral}","{service general, Usluga, neutral}"
+"– Ovo je jedno od mojih najboljih mjesta za ručak, ogromno porcije, brzo usluga i nevjerojatno margarite! !","{service general, usluga, positive};{drinks quality, margarite, positive};{restaurant general, null, positive};{food style_options, porcije, positive}","{food quality, margarite, positive};{food style_options, porcije, positive};{service general, usluga, positive}"
+Najbolji kolači od rakova u gradu,"{food quality, kolači od rakova, positive}","{food quality, kolači od rakova, positive}"
+"Sve što sam ovdje jeo je dobro, taco salate, burritos, enchilade volim ovo mjesto.","{food quality, taco salate, positive};{food quality, null, positive};{restaurant general, mjesto, positive};{food quality, burritos, positive};{food quality, enchilade, positive}","{food quality, enchilade, positive};{food quality, taco salate, positive};{food quality, burritos, positive};{restaurant general, ovo mjesto, positive}"
+"Odlično Pizza, Loše Usluga","{food quality, Pizza, positive};{service general, Usluga, negative}","{service general, Usluga, negative};{food quality, Pizza, positive}"
+sjajan,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Moja najbolja prijateljica jela pileća shawarma i JOŠ UVIJEK oduševljeno govori o tome da je najbolja posvuda!,"{food quality, pileća shawarma, positive}","{food quality, pileća shawarma, positive}"
+Chintzy porcije,"{food style_options, porcije, negative}","{food style_options, porcije, negative}"
+Dobro jede .,"{food quality, jede, positive}","{food quality, jede, positive}"
+"Obično vas na mjestima pitaju koliko vruće želite, ali nisu.","{service general, null, negative}","{service general, null, negative}"
+"Uvijek sam smatrao da je osoblje konobara i, ako sjedite za šankom, kuhari vrlo ljubazni.","{service general, kuhari, positive}","{service general, kuhari, positive};{service general, osoblje konobara, positive}"
+Ništa na izborniku nije manje nego nevjerojatno.,"{food quality, izborniku, positive}","{food quality, null, negative}"
+"Moja grupa od dvoje bila je posebno ambiciozna i razbacili smo se Shilshole Sampler ... prekrasnim izborom golemih bijelih zaljevskih kozica, dimljene bijele tune, Rayeve fantastične manila školjke začinjeno koprom, jakobovim kapicama u ukusnom sojinom preljevu i malenom hrpicom Dungeness rakova na vrhu uzvišenog umak od maslaca .","{food quality, umak od maslaca, positive};{food style_options, Shilshole Sampler, positive};{food style_options, bijelih zaljevskih kozica, positive};{food quality, manila školjke, positive};{food quality, sojinom preljevu, positive}","{food quality, manila školjke začinjeno koprom, positive};{food quality, Dungeness rakova na vrhu uzvišenog umak od maslaca, positive};{food quality, Shilshole Sampler, positive};{food quality, dimljene bijele tune, positive};{food quality, bijelih zaljevskih kozica, positive}"
+"Bio sam iskreno šokiran kada sam pročitao loše kritike - ovo mjesto je fantastično; nije nas iznevjerio ni na koji način, a jeli smo ovdje više od 10 puta.","{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"Vaš obožavatelj sushi, volite stručno rezanu ribu, sjajnu sake, ubojitu SOHO lokacija i naravno: losos, tuna, metilj, žuti rep, bakalar, Skuša, žele riba, morski jež, škampi, jastog, orada, pastrva, mliječna riba, Tuna plave peraje, jegulja, rakovi, sardine, grdobine, ikra, jakobove kapice, kamenice i razne vrste Toro.","{food quality, sushi, positive};{location general, SOHO lokacija, positive};{food style_options, Toro, positive};{drinks quality, sake, positive};{food style_options, ribu, positive}","{food quality, losos, positive};{food quality, sake, positive};{location general, SOHO lokacija, positive};{food quality, stručno rezanu ribu, positive};{food style_options, sushi, positive}"
+usluga je fantastična na ovom zabavnom mjestu .,"{restaurant general, mjestu, positive};{service general, usluga, positive}","{service general, usluga, positive};{ambience general, zabavnom mjestu, positive}"
+"Također, bio je samo jedan kupaonska kabina - vjerojatno treba više za tako velike gužve.","{restaurant miscellaneous, kupaonska kabina, negative}","{ambience general, kupaonska kabina, negative}"
+Otišli smo a da uopće nismo dobili usluga .,"{service general, usluga, negative}","{service general, usluga, negative}"
+Svidjelo mi se .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Toplo preporučujem Mioposto .,"{restaurant general, Mioposto, positive}","{restaurant general, Mioposto, positive}"
+"hrana je fantastična, autentična, ukusna i vrlo, vrlo pristupačna.","{food quality, hrana, positive};{food prices, hrana, positive}","{food quality, hrana, positive};{food prices, hrana, positive}"
+Ovdje sam jeo tri puta i utvrdio sam da su kvaliteta i raznolikost ribe izvrsni.,"{food quality, ribe, positive};{food style_options, ribe, positive}","{food quality, ribe, positive};{food style_options, ribe, positive}"
+"Ali ona je vrlo prijateljski nastrojena s nekim ljudima, što to čini još iritantnijim.","{service general, null, negative}","{service general, null, negative}"
+obični jelovnik ovdje je malo iznad prosjeka što nije vrijedno šmrkavog stava koji imate.,"{food quality, obični jelovnik, neutral};{service general, null, negative}","{food quality, jelovnik, positive};{food quality, stava, negative}"
+"Također, poslužuju NAJBOLJE hummus u Americi, uz kapljicu mirisnog maslinovog ulja (što je, vjerujem, tradicionalan način)!","{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive}"
+odlično pivo,"{drinks quality, pivo, positive}","{drinks quality, pivo, positive}"
+Plodovi mora Plus,"{food quality, Plodovi mora, positive}","{food quality, Plodovi, positive}"
+"tužno je što nema puno ljudi koji često jedu na ovakvim mjestima koja izgledaju skupo jer su u hotelu ... ali su definitivno ona koja ne želite propustiti, pogotovo ako ste u centru San Josea.","{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}"
+"Poslužuju ga u visokoj, tankoj čaši u obliku pješčanog sata kako bi prikrili činjenicu da u supermarketu dobivate mali sok po cijeni od pola galona.","{drinks style_options, sok, negative};{drinks prices, sok, negative}","{drinks style_options, null, negative}"
+"hrana je bila u redu, ali usluga je bila toliko loša da je hrana bila hladna, što je omogućilo da svi u mojoj grupi budu posluženi.","{service general, usluga, negative};{food quality, hrana, neutral}","{service general, usluga, negative};{food quality, hrana, negative}"
+odlično obrok – riba na pladnju s omikaseom bilo je apsolutno dekadentno -- nije bilo ništa od žilavosti koja ponekad prati pošteni sushi -- ova je riba bila savršena! ! ! !,"{food quality, riba na pladnju s omikaseom, positive};{food quality, obrok, positive}","{food quality, riba na pladnju s omikaseom, positive};{food quality, obrok, positive}"
+Pića su izvrsna i osjećam se kao da sam u zemlji Trećeg svijeta kad uđem na vrata.,"{drinks quality, Pića, positive};{ambience general, null, positive}","{drinks quality, Pića, positive};{restaurant general, null, positive}"
+Otvori i ohladi mjesto s najboljim pizza i kava,"{ambience general, mjesto, positive};{food quality, pizza, positive};{drinks quality, kava, positive}","{food quality, pizza, positive};{drinks quality, kava, positive}"
+Creme brulee od zelenog čaja je obavezan!,"{food quality, Creme brulee od zelenog čaja, positive}","{food quality, Creme brulee od zelenog čaja, positive}"
+Našao sam novi dom i upravo sam se preselio s dugotrajnim najmom.,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+"Nisu najpričljiviji, ali svaki put kad sam bio tamo bili su jako zaposleni, što je vjerojatno razlog za nedostatak razgovora.","{service general, null, neutral}","{service general, null, negative}"
+"Sama pizza nije baš najbolja koju sam IKAD jeo, ali je ipak prilično dobra.","{food quality, pizza, positive}","{food quality, pizza, positive}"
+"Imali smo isto konobar drugi put, pa je možda usluga manjkava i naša sreća.","{service general, konobar, positive}","{service general, konobar, negative}"
+– To je velika izjava s obzirom na to da izvlačim zamke za rakove i izrađujem kolače sam od svoje sedme godine - ali nešto u vezi s ovim malim vragovima svaki put postaje bolje.,"{food quality, kolače, positive}","{food quality, kolače, positive}"
+Sjajno talijanska hrana!,"{food quality, talijanska hrana, positive}","{food quality, talijanska hrana, positive}"
+"Međutim, ovo mjesto je dragulj i neću se prestati vraćati.","{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"postaje jako prometno, stoga dođite ranije kako biste mogli zgrabiti mjesto, ako morate čekati, nije loše jer usluga je brza!","{service general, usluga, positive}","{service general, usluga, positive};{restaurant miscellaneous, postaje, positive}"
+"Za večeru nam je trebalo samo oko sat vremena, a cijene su bile u redu za strip, gotovo 50 dolara po osobi nakon poreza i napojnice (otprilike prosjek).","{restaurant prices, null, neutral}","{restaurant prices, null, positive};{service general, null, positive}"
+kolutiće luka su odlični!,"{food quality, kolutiće luka, positive}","{food quality, kolutiće luka, positive}"
+"Ako ste u blizini, ne biste trebali biti razočarani.","{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+– Velika financijska četvrt meksičko mjesto .,"{restaurant general, meksičko mjesto, positive}","{restaurant general, meksičko mjesto, positive}"
+posebna rola za kuću je stvarno dobra.,"{food quality, posebna rola za kuću, positive}","{food quality, rola za kuću, positive}"
+konobari vrlo su iskusni i od pomoći pri uparivanju vašeg izbora pića s vašim ukusom hrane ili obrnuto.,"{service general, konobari, positive}","{service general, konobari, positive}"
+Savršenstvo .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Loše služba za korisnike / loše pizza .,"{food quality, pizza, negative};{service general, služba za korisnike, negative}","{service general, služba, negative};{food quality, pizza, negative}"
+"Sve u svemu, vratio bih se i ponovno jeo u restoranu.","{restaurant general, restoranu, positive}","{restaurant general, restoranu, positive}"
+Poslužitelj dao je nekoliko sake prijedloga koji su bili vrlo dobri.,"{drinks quality, sake, positive};{service general, Poslužitelj, positive}","{drinks quality, sake prijedloga, positive}"
+Moj jedini negativan komentar je da bih volio da su komadi malo veći.,"{food style_options, komadi, negative}","{food style_options, komadi, negative}"
+Ubrao sam šparoge koje su se pokazale nevjerojatno i savršeno pripremljene.,"{food quality, šparoge, positive}","{food quality, šparoge, positive}"
+Ono što bi većini moglo biti zanimljivo je da najgora usluga/stav dolazi od vlasnika ovog objekta.,"{service general, vlasnika, negative}","{service general, usluga, negative};{service general, stav, negative}"
+"Jedina mana je što je ovo mjesto stvarno skupo, a porcije su male.","{restaurant prices, mjesto, negative};{food style_options, porcije, negative}","{food prices, mana, negative};{food style_options, porcije, negative}"
+"Užasno usluga, hrana ok, skupo","{service general, usluga, negative};{restaurant prices, null, negative};{food quality, hrana, neutral}","{restaurant prices, null, negative};{service general, usluga, negative};{food quality, hrana, neutral}"
+Iako bi se usluga mogla poboljšati s obzirom na novac koji ste uložili.,"{service general, usluga, negative}","{service general, usluga, negative}"
+"Redovito vidite indijske obitelji i prijatelje kako tamo ručaju, što je uvijek dobar znak.","{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+"Ako želim stajati u redu u nedjelju sat vremena kako bih dobio prosječnu hranu hrana za užinu, onda bih stavio Murphy's na vrh popisa.","{service general, null, negative};{food quality, hrana za užinu, neutral}","{food quality, hranu, negative};{restaurant miscellaneous, Murphy's, negative}"
+Za količinu hrane koju smo dobili cijene su trebale biti niže.,"{food prices, hrane, negative}","{food prices, hrane, negative};{food style_options, hrane, negative}"
+"Uvijek zauzeti, ali su dobri u tome da vas brzo smjeste i imaju brzu uslugu.","{service general, uslugu, positive};{service general, null, positive}","{service general, uslugu, positive}"
+"vinska karta je prekrasna, a hrana me podsjeća na moje nedavno putovanje u Italiju.","{drinks style_options, vinska karta, positive}","{food quality, hrana, positive};{drinks style_options, vinska karta, positive}"
+"hrana je bila odlična, margarite također, ali konobarica je bila previše zauzeta ljubaznošću prema svojoj drugoj većoj grupi nego da bi se bolje brinula o mojoj prijateljici i meni.","{drinks quality, margarite, positive};{service general, konobarica, negative};{food quality, hrana, positive}","{service general, konobarica, negative};{food quality, hrana, positive};{food quality, margarite, positive}"
+Ne mogu reći dovoljno dobrih stvari o ovom restoran i jedva čekam sljedećih nekoliko posjeta.,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}"
+Volim svaki put,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Mi smo mještani i imamo osjećaj da je jedini način na koji ovo mjesto preživljava s takvim prosjekom hrana taj što su većina gostiju vjerojatno samo jednokratni gosti.,"{food quality, hrana, negative}","{restaurant miscellaneous, mjesto, negative};{food quality, hrana, negative}"
+Također volim njihovu cezer salata .,"{food quality, cezer salata, positive}","{food quality, cezer salata, positive}"
+Ne čini da se osjećate dobrodošli i tretira vas kao gnjavatora.,"{service general, null, negative}","{service general, null, negative}"
+Upravo je prave veličine za jelovnik.,"{restaurant miscellaneous, null, positive}","{food style_options, jelovnik, positive}"
+"hrana je fantastična, a osoblje bilo je savršeno svaki put kad smo bili tamo.","{service general, osoblje, positive};{food quality, hrana, positive}","{service general, osoblje, positive};{food quality, hrana, positive}"
+pustinja bio je savršen završetak gotovo savršene večere.,"{food quality, večere, positive};{food quality, pustinja, positive}","{restaurant general, pustinja, positive}"
+"Bio sam ovdje, potrošio sam hrpu novca na posebnu večeru kuhara i bilo je to veliko razočaranje.","{food prices, posebnu večeru kuhara, negative};{food quality, posebnu večeru kuhara, negative}","{food quality, posebnu večeru kuhara, negative};{food prices, posebnu večeru kuhara, negative}"
+PRONAŠAO SAM NOVI DOM NA DRUGOJ AVENIJI! ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, DOM, positive}"
+"– Morao sam čekati trideset minuta da uđem na vrata u utorak ujutro, ali bilo je vrijedno toga.","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive}"
+"– Tužno je vidjeti mjesto koje je nekoć bilo `` ONO `` mjesto za sastajanje i jelo za post ili ručak, a sada budi mjesto koje je veliko `` NE SMIRAJ SE . ``","{restaurant general, mjesto, negative}","{restaurant general, mjesto, negative}"
+"piletina s limunom imala je okus poput ljepljivih slatkih krafni, a kozice s medom i orahom, ono malo što vam zapravo daju... nije bilo dobro.","{food quality, piletina s limunom, negative};{food quality, kozice s medom i orahom, negative};{food style_options, kozice s medom i orahom, negative}","{food quality, kozice s medom i orahom, negative};{food quality, piletina s limunom, negative}"
+"Bilo je romantično - pa čak i lijepo čak i s mojom sestrom, podsjetilo me na Italiju i imalo je umjetničko djelo i glazbu koje su održavale osjećaj da se nalazim u mediteranskoj vili.","{ambience general, null, positive};{ambience general, glazbu, positive};{ambience general, umjetničko djelo, positive}","{ambience general, null, positive};{ambience general, glazbu, positive};{ambience general, umjetničko djelo, positive}"
+"sushi je bio odličan, a posluga je bila brza.","{service general, posluga, positive};{food quality, sushi, positive}","{service general, posluga, positive};{food quality, sushi, positive}"
+"Zapravo, mnogi se žele vratiti i drugi put tijekom svog posjeta.","{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Najbolje meksičko mjesto za ručak u financijskoj četvrti.,"{restaurant general, meksičko mjesto, positive}","{food quality, meksičko mjesto za ručak, positive}"
+volim ovo mjesto!,"{restaurant general, mjesto, positive}","{restaurant general, ovo mjesto, positive}"
+atmosfera je sjajna.,"{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive}"
+Savršen za hladan dan.,"{food quality, null, positive}","{restaurant miscellaneous, null, positive}"