Upload folder using huggingface_hub

.gitattributes

@@ -81,3 +81,6 @@ experiments/pt-sw/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -t
 experiments/pt-vi/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 experiments/pt-vi/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 experiments/pt-vi/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/hr-sk/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/hr-sk/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/hr-sk/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -text

experiments/hr-sk/README.md

@@ -0,0 +1,59 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: transformers
+model_name: hr-sk
+tags:
+- generated_from_trainer
+- unsloth
+- sft
+- trl
+licence: license
+---
+
+# Model Card for hr-sk
+
+This model is a fine-tuned version of [unsloth/meta-llama-3.1-8b-instruct-bnb-4bit](https://huggingface.co/unsloth/meta-llama-3.1-8b-instruct-bnb-4bit).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="None", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+ 
+
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.22.2
+- Transformers: 4.56.2
+- Pytorch: 2.10.0
+- Datasets: 4.3.0
+- Tokenizers: 0.22.0
+
+## Citations
+
+
+
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

experiments/hr-sk/adapter/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/hr-sk/adapter/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/hr-sk/adapter/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b7a146294771ab942951e81319a7d678eb3c6b78bbdd5d66b6cde35af1aa7e8a
+size 83945296

experiments/hr-sk/adapter/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/hr-sk/adapter/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/hr-sk/adapter/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/hr-sk/adapter/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "left",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/hr-sk/checkpoint-500/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/hr-sk/checkpoint-500/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/hr-sk/checkpoint-500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d874878ee6091ecfbb64b22e65d4d2d3df998849f241e43d384bbbe99ad0f373
+size 83945296

experiments/hr-sk/checkpoint-500/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/hr-sk/checkpoint-500/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b23afd4de4bbbf29777b2c7f91291f41e6af56cd4579820565f1a8f1a2f45249
+size 43123429

experiments/hr-sk/checkpoint-500/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6d8fafcd1ee268414be5acf0366296af5b03d60871978712eac1979cb42d65
+size 14645

experiments/hr-sk/checkpoint-500/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f58070f27ecc1447cda3df381e75b78a82815c8dd68eab34fe5e56c98549f266
+size 1465

experiments/hr-sk/checkpoint-500/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/hr-sk/checkpoint-500/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/hr-sk/checkpoint-500/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/hr-sk/checkpoint-500/trainer_state.json

@@ -0,0 +1,734 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 3.1645569620253164,
+  "eval_steps": 500,
+  "global_step": 500,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03164556962025317,
+      "grad_norm": 8.32556438446045,
+      "learning_rate": 0.0002,
+      "loss": 2.8396,
+      "step": 5
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 4.339047431945801,
+      "learning_rate": 0.00019872773536895675,
+      "loss": 0.9967,
+      "step": 10
+    },
+    {
+      "epoch": 0.0949367088607595,
+      "grad_norm": 1.8047831058502197,
+      "learning_rate": 0.00019745547073791352,
+      "loss": 0.696,
+      "step": 15
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 1.1957786083221436,
+      "learning_rate": 0.00019618320610687023,
+      "loss": 0.6575,
+      "step": 20
+    },
+    {
+      "epoch": 0.15822784810126583,
+      "grad_norm": 1.3067082166671753,
+      "learning_rate": 0.00019491094147582698,
+      "loss": 0.6879,
+      "step": 25
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 1.458857774734497,
+      "learning_rate": 0.00019363867684478372,
+      "loss": 0.6175,
+      "step": 30
+    },
+    {
+      "epoch": 0.22151898734177214,
+      "grad_norm": 1.1596320867538452,
+      "learning_rate": 0.00019236641221374049,
+      "loss": 0.6186,
+      "step": 35
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 1.1433714628219604,
+      "learning_rate": 0.00019109414758269723,
+      "loss": 0.5384,
+      "step": 40
+    },
+    {
+      "epoch": 0.2848101265822785,
+      "grad_norm": 1.2154544591903687,
+      "learning_rate": 0.00018982188295165394,
+      "loss": 0.5393,
+      "step": 45
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 1.1254453659057617,
+      "learning_rate": 0.00018854961832061068,
+      "loss": 0.6114,
+      "step": 50
+    },
+    {
+      "epoch": 0.34810126582278483,
+      "grad_norm": 1.1341413259506226,
+      "learning_rate": 0.00018727735368956745,
+      "loss": 0.5744,
+      "step": 55
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 1.0697686672210693,
+      "learning_rate": 0.0001860050890585242,
+      "loss": 0.6301,
+      "step": 60
+    },
+    {
+      "epoch": 0.41139240506329117,
+      "grad_norm": 1.116376280784607,
+      "learning_rate": 0.00018473282442748093,
+      "loss": 0.5423,
+      "step": 65
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 1.9131135940551758,
+      "learning_rate": 0.00018346055979643765,
+      "loss": 0.586,
+      "step": 70
+    },
+    {
+      "epoch": 0.47468354430379744,
+      "grad_norm": 1.1271770000457764,
+      "learning_rate": 0.00018218829516539442,
+      "loss": 0.5793,
+      "step": 75
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 1.0603110790252686,
+      "learning_rate": 0.00018091603053435116,
+      "loss": 0.5806,
+      "step": 80
+    },
+    {
+      "epoch": 0.5379746835443038,
+      "grad_norm": 1.2276663780212402,
+      "learning_rate": 0.0001796437659033079,
+      "loss": 0.544,
+      "step": 85
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.9570387601852417,
+      "learning_rate": 0.00017837150127226464,
+      "loss": 0.5557,
+      "step": 90
+    },
+    {
+      "epoch": 0.6012658227848101,
+      "grad_norm": 0.8000441193580627,
+      "learning_rate": 0.00017709923664122138,
+      "loss": 0.486,
+      "step": 95
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 1.835436463356018,
+      "learning_rate": 0.00017582697201017812,
+      "loss": 0.6063,
+      "step": 100
+    },
+    {
+      "epoch": 0.6645569620253164,
+      "grad_norm": 0.9403336644172668,
+      "learning_rate": 0.00017455470737913486,
+      "loss": 0.5618,
+      "step": 105
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.9277241826057434,
+      "learning_rate": 0.00017328244274809163,
+      "loss": 0.555,
+      "step": 110
+    },
+    {
+      "epoch": 0.7278481012658228,
+      "grad_norm": 0.8973642587661743,
+      "learning_rate": 0.00017201017811704835,
+      "loss": 0.5361,
+      "step": 115
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.911058247089386,
+      "learning_rate": 0.0001707379134860051,
+      "loss": 0.5372,
+      "step": 120
+    },
+    {
+      "epoch": 0.7911392405063291,
+      "grad_norm": 1.1374117136001587,
+      "learning_rate": 0.00016946564885496183,
+      "loss": 0.5083,
+      "step": 125
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.8928428888320923,
+      "learning_rate": 0.0001681933842239186,
+      "loss": 0.4999,
+      "step": 130
+    },
+    {
+      "epoch": 0.8544303797468354,
+      "grad_norm": 0.9310257434844971,
+      "learning_rate": 0.00016692111959287534,
+      "loss": 0.5129,
+      "step": 135
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.9463359117507935,
+      "learning_rate": 0.00016564885496183205,
+      "loss": 0.4905,
+      "step": 140
+    },
+    {
+      "epoch": 0.9177215189873418,
+      "grad_norm": 0.980999767780304,
+      "learning_rate": 0.0001643765903307888,
+      "loss": 0.5582,
+      "step": 145
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.9762192964553833,
+      "learning_rate": 0.00016310432569974556,
+      "loss": 0.5519,
+      "step": 150
+    },
+    {
+      "epoch": 0.9810126582278481,
+      "grad_norm": 0.8615793585777283,
+      "learning_rate": 0.0001618320610687023,
+      "loss": 0.5423,
+      "step": 155
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.6834261417388916,
+      "learning_rate": 0.00016055979643765905,
+      "loss": 0.528,
+      "step": 160
+    },
+    {
+      "epoch": 1.0443037974683544,
+      "grad_norm": 0.764999270439148,
+      "learning_rate": 0.0001592875318066158,
+      "loss": 0.3868,
+      "step": 165
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.7723885178565979,
+      "learning_rate": 0.00015801526717557253,
+      "loss": 0.4264,
+      "step": 170
+    },
+    {
+      "epoch": 1.1075949367088607,
+      "grad_norm": 0.9795113205909729,
+      "learning_rate": 0.00015674300254452927,
+      "loss": 0.4178,
+      "step": 175
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.8282197713851929,
+      "learning_rate": 0.000155470737913486,
+      "loss": 0.3941,
+      "step": 180
+    },
+    {
+      "epoch": 1.1708860759493671,
+      "grad_norm": 0.9483677744865417,
+      "learning_rate": 0.00015419847328244275,
+      "loss": 0.4169,
+      "step": 185
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.9333426356315613,
+      "learning_rate": 0.0001529262086513995,
+      "loss": 0.4433,
+      "step": 190
+    },
+    {
+      "epoch": 1.2341772151898733,
+      "grad_norm": 1.0099432468414307,
+      "learning_rate": 0.00015165394402035624,
+      "loss": 0.4186,
+      "step": 195
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7976335883140564,
+      "learning_rate": 0.00015038167938931298,
+      "loss": 0.3709,
+      "step": 200
+    },
+    {
+      "epoch": 1.2974683544303798,
+      "grad_norm": 0.8201557993888855,
+      "learning_rate": 0.00014910941475826972,
+      "loss": 0.4266,
+      "step": 205
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 1.5948097705841064,
+      "learning_rate": 0.0001478371501272265,
+      "loss": 0.4162,
+      "step": 210
+    },
+    {
+      "epoch": 1.360759493670886,
+      "grad_norm": 0.9284299612045288,
+      "learning_rate": 0.0001465648854961832,
+      "loss": 0.374,
+      "step": 215
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.882803738117218,
+      "learning_rate": 0.00014529262086513994,
+      "loss": 0.4317,
+      "step": 220
+    },
+    {
+      "epoch": 1.4240506329113924,
+      "grad_norm": 0.9879310727119446,
+      "learning_rate": 0.0001440203562340967,
+      "loss": 0.3957,
+      "step": 225
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.9921488165855408,
+      "learning_rate": 0.00014274809160305345,
+      "loss": 0.4249,
+      "step": 230
+    },
+    {
+      "epoch": 1.4873417721518987,
+      "grad_norm": 1.2630486488342285,
+      "learning_rate": 0.0001414758269720102,
+      "loss": 0.3936,
+      "step": 235
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 1.2342113256454468,
+      "learning_rate": 0.0001402035623409669,
+      "loss": 0.4275,
+      "step": 240
+    },
+    {
+      "epoch": 1.5506329113924051,
+      "grad_norm": 0.9430296421051025,
+      "learning_rate": 0.00013893129770992368,
+      "loss": 0.4226,
+      "step": 245
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 1.3600997924804688,
+      "learning_rate": 0.00013765903307888042,
+      "loss": 0.4359,
+      "step": 250
+    },
+    {
+      "epoch": 1.6139240506329116,
+      "grad_norm": 0.8744933009147644,
+      "learning_rate": 0.00013638676844783716,
+      "loss": 0.4198,
+      "step": 255
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.9405940771102905,
+      "learning_rate": 0.0001351145038167939,
+      "loss": 0.4001,
+      "step": 260
+    },
+    {
+      "epoch": 1.6772151898734178,
+      "grad_norm": 0.8729792833328247,
+      "learning_rate": 0.00013384223918575064,
+      "loss": 0.4215,
+      "step": 265
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.9679851531982422,
+      "learning_rate": 0.00013256997455470738,
+      "loss": 0.3684,
+      "step": 270
+    },
+    {
+      "epoch": 1.740506329113924,
+      "grad_norm": 0.9041249752044678,
+      "learning_rate": 0.00013129770992366413,
+      "loss": 0.3666,
+      "step": 275
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 1.0651932954788208,
+      "learning_rate": 0.00013002544529262087,
+      "loss": 0.3988,
+      "step": 280
+    },
+    {
+      "epoch": 1.8037974683544302,
+      "grad_norm": 1.200931429862976,
+      "learning_rate": 0.0001287531806615776,
+      "loss": 0.4279,
+      "step": 285
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 1.000989556312561,
+      "learning_rate": 0.00012748091603053435,
+      "loss": 0.433,
+      "step": 290
+    },
+    {
+      "epoch": 1.8670886075949367,
+      "grad_norm": 1.0178704261779785,
+      "learning_rate": 0.0001262086513994911,
+      "loss": 0.4008,
+      "step": 295
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 1.0279607772827148,
+      "learning_rate": 0.00012493638676844783,
+      "loss": 0.3774,
+      "step": 300
+    },
+    {
+      "epoch": 1.9303797468354431,
+      "grad_norm": 0.9084330201148987,
+      "learning_rate": 0.0001236641221374046,
+      "loss": 0.406,
+      "step": 305
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.8824640512466431,
+      "learning_rate": 0.00012239185750636134,
+      "loss": 0.4273,
+      "step": 310
+    },
+    {
+      "epoch": 1.9936708860759493,
+      "grad_norm": 1.372707724571228,
+      "learning_rate": 0.00012111959287531807,
+      "loss": 0.3944,
+      "step": 315
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.7385953068733215,
+      "learning_rate": 0.00011984732824427483,
+      "loss": 0.3265,
+      "step": 320
+    },
+    {
+      "epoch": 2.0569620253164556,
+      "grad_norm": 1.3800175189971924,
+      "learning_rate": 0.00011857506361323157,
+      "loss": 0.2617,
+      "step": 325
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.8772674798965454,
+      "learning_rate": 0.0001173027989821883,
+      "loss": 0.272,
+      "step": 330
+    },
+    {
+      "epoch": 2.1202531645569622,
+      "grad_norm": 0.8183962106704712,
+      "learning_rate": 0.00011603053435114504,
+      "loss": 0.2442,
+      "step": 335
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 1.0238982439041138,
+      "learning_rate": 0.00011475826972010179,
+      "loss": 0.2724,
+      "step": 340
+    },
+    {
+      "epoch": 2.1835443037974684,
+      "grad_norm": 1.0221502780914307,
+      "learning_rate": 0.00011348600508905853,
+      "loss": 0.3001,
+      "step": 345
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 0.8871440291404724,
+      "learning_rate": 0.00011221374045801527,
+      "loss": 0.2727,
+      "step": 350
+    },
+    {
+      "epoch": 2.2468354430379747,
+      "grad_norm": 0.960236668586731,
+      "learning_rate": 0.000110941475826972,
+      "loss": 0.2651,
+      "step": 355
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.9270543456077576,
+      "learning_rate": 0.00010966921119592877,
+      "loss": 0.2534,
+      "step": 360
+    },
+    {
+      "epoch": 2.310126582278481,
+      "grad_norm": 1.150570034980774,
+      "learning_rate": 0.0001083969465648855,
+      "loss": 0.2687,
+      "step": 365
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.889858603477478,
+      "learning_rate": 0.00010712468193384224,
+      "loss": 0.2639,
+      "step": 370
+    },
+    {
+      "epoch": 2.3734177215189876,
+      "grad_norm": 0.9829533696174622,
+      "learning_rate": 0.00010585241730279898,
+      "loss": 0.2709,
+      "step": 375
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 1.482006549835205,
+      "learning_rate": 0.00010458015267175574,
+      "loss": 0.2998,
+      "step": 380
+    },
+    {
+      "epoch": 2.4367088607594938,
+      "grad_norm": 1.1532208919525146,
+      "learning_rate": 0.00010330788804071248,
+      "loss": 0.2663,
+      "step": 385
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 0.8587226271629333,
+      "learning_rate": 0.00010203562340966922,
+      "loss": 0.263,
+      "step": 390
+    },
+    {
+      "epoch": 2.5,
+      "grad_norm": 0.9111952185630798,
+      "learning_rate": 0.00010076335877862595,
+      "loss": 0.2735,
+      "step": 395
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 0.9616707563400269,
+      "learning_rate": 9.94910941475827e-05,
+      "loss": 0.2647,
+      "step": 400
+    },
+    {
+      "epoch": 2.5632911392405062,
+      "grad_norm": 1.133192777633667,
+      "learning_rate": 9.821882951653944e-05,
+      "loss": 0.2646,
+      "step": 405
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 1.2275214195251465,
+      "learning_rate": 9.694656488549618e-05,
+      "loss": 0.2672,
+      "step": 410
+    },
+    {
+      "epoch": 2.6265822784810124,
+      "grad_norm": 1.1493219137191772,
+      "learning_rate": 9.567430025445293e-05,
+      "loss": 0.2759,
+      "step": 415
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.8626896739006042,
+      "learning_rate": 9.440203562340968e-05,
+      "loss": 0.2643,
+      "step": 420
+    },
+    {
+      "epoch": 2.689873417721519,
+      "grad_norm": 1.2467924356460571,
+      "learning_rate": 9.312977099236642e-05,
+      "loss": 0.2773,
+      "step": 425
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 1.0049347877502441,
+      "learning_rate": 9.185750636132316e-05,
+      "loss": 0.279,
+      "step": 430
+    },
+    {
+      "epoch": 2.7531645569620253,
+      "grad_norm": 0.9384709596633911,
+      "learning_rate": 9.05852417302799e-05,
+      "loss": 0.2506,
+      "step": 435
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 1.1841737031936646,
+      "learning_rate": 8.931297709923665e-05,
+      "loss": 0.2839,
+      "step": 440
+    },
+    {
+      "epoch": 2.8164556962025316,
+      "grad_norm": 1.0706425905227661,
+      "learning_rate": 8.804071246819339e-05,
+      "loss": 0.2791,
+      "step": 445
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 0.9941563606262207,
+      "learning_rate": 8.676844783715013e-05,
+      "loss": 0.2875,
+      "step": 450
+    },
+    {
+      "epoch": 2.879746835443038,
+      "grad_norm": 1.0086358785629272,
+      "learning_rate": 8.549618320610687e-05,
+      "loss": 0.2966,
+      "step": 455
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 1.1530709266662598,
+      "learning_rate": 8.422391857506363e-05,
+      "loss": 0.2872,
+      "step": 460
+    },
+    {
+      "epoch": 2.9430379746835444,
+      "grad_norm": 1.8472609519958496,
+      "learning_rate": 8.295165394402035e-05,
+      "loss": 0.2702,
+      "step": 465
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 1.3067833185195923,
+      "learning_rate": 8.167938931297711e-05,
+      "loss": 0.2687,
+      "step": 470
+    },
+    {
+      "epoch": 3.0063291139240507,
+      "grad_norm": 0.8619422316551208,
+      "learning_rate": 8.040712468193385e-05,
+      "loss": 0.2533,
+      "step": 475
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 1.14690363407135,
+      "learning_rate": 7.913486005089059e-05,
+      "loss": 0.1712,
+      "step": 480
+    },
+    {
+      "epoch": 3.069620253164557,
+      "grad_norm": 1.6324301958084106,
+      "learning_rate": 7.786259541984733e-05,
+      "loss": 0.1714,
+      "step": 485
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 1.2055376768112183,
+      "learning_rate": 7.659033078880407e-05,
+      "loss": 0.1628,
+      "step": 490
+    },
+    {
+      "epoch": 3.132911392405063,
+      "grad_norm": 1.2004039287567139,
+      "learning_rate": 7.531806615776081e-05,
+      "loss": 0.1634,
+      "step": 495
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 1.1392419338226318,
+      "learning_rate": 7.404580152671756e-05,
+      "loss": 0.1551,
+      "step": 500
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 790,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 4.619336380659302e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/hr-sk/checkpoint-500/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0af774678c41577ae1213b87da9e937d742c151c9721e256188358b6e4dc7bf9
+size 6289

experiments/hr-sk/checkpoint-790/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/hr-sk/checkpoint-790/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/hr-sk/checkpoint-790/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b7a146294771ab942951e81319a7d678eb3c6b78bbdd5d66b6cde35af1aa7e8a
+size 83945296

experiments/hr-sk/checkpoint-790/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/hr-sk/checkpoint-790/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6bbd9f10acb0897e1371b7cf0036d0a8a0d0a91af7856e275733da9558b9cfc
+size 43123429

experiments/hr-sk/checkpoint-790/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89645f9f6a2a8823b334e0748e4f5ea683a27b3d02632f0a241397db55d82fad
+size 14645

experiments/hr-sk/checkpoint-790/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:35051bf7f4f2e2be5c96ec74ea328521409c95bd45c583cbfff0b643a5cb5e1d
+size 1465

experiments/hr-sk/checkpoint-790/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/hr-sk/checkpoint-790/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/hr-sk/checkpoint-790/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/hr-sk/checkpoint-790/trainer_state.json

@@ -0,0 +1,1140 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 5.0,
+  "eval_steps": 500,
+  "global_step": 790,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03164556962025317,
+      "grad_norm": 8.32556438446045,
+      "learning_rate": 0.0002,
+      "loss": 2.8396,
+      "step": 5
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 4.339047431945801,
+      "learning_rate": 0.00019872773536895675,
+      "loss": 0.9967,
+      "step": 10
+    },
+    {
+      "epoch": 0.0949367088607595,
+      "grad_norm": 1.8047831058502197,
+      "learning_rate": 0.00019745547073791352,
+      "loss": 0.696,
+      "step": 15
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 1.1957786083221436,
+      "learning_rate": 0.00019618320610687023,
+      "loss": 0.6575,
+      "step": 20
+    },
+    {
+      "epoch": 0.15822784810126583,
+      "grad_norm": 1.3067082166671753,
+      "learning_rate": 0.00019491094147582698,
+      "loss": 0.6879,
+      "step": 25
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 1.458857774734497,
+      "learning_rate": 0.00019363867684478372,
+      "loss": 0.6175,
+      "step": 30
+    },
+    {
+      "epoch": 0.22151898734177214,
+      "grad_norm": 1.1596320867538452,
+      "learning_rate": 0.00019236641221374049,
+      "loss": 0.6186,
+      "step": 35
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 1.1433714628219604,
+      "learning_rate": 0.00019109414758269723,
+      "loss": 0.5384,
+      "step": 40
+    },
+    {
+      "epoch": 0.2848101265822785,
+      "grad_norm": 1.2154544591903687,
+      "learning_rate": 0.00018982188295165394,
+      "loss": 0.5393,
+      "step": 45
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 1.1254453659057617,
+      "learning_rate": 0.00018854961832061068,
+      "loss": 0.6114,
+      "step": 50
+    },
+    {
+      "epoch": 0.34810126582278483,
+      "grad_norm": 1.1341413259506226,
+      "learning_rate": 0.00018727735368956745,
+      "loss": 0.5744,
+      "step": 55
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 1.0697686672210693,
+      "learning_rate": 0.0001860050890585242,
+      "loss": 0.6301,
+      "step": 60
+    },
+    {
+      "epoch": 0.41139240506329117,
+      "grad_norm": 1.116376280784607,
+      "learning_rate": 0.00018473282442748093,
+      "loss": 0.5423,
+      "step": 65
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 1.9131135940551758,
+      "learning_rate": 0.00018346055979643765,
+      "loss": 0.586,
+      "step": 70
+    },
+    {
+      "epoch": 0.47468354430379744,
+      "grad_norm": 1.1271770000457764,
+      "learning_rate": 0.00018218829516539442,
+      "loss": 0.5793,
+      "step": 75
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 1.0603110790252686,
+      "learning_rate": 0.00018091603053435116,
+      "loss": 0.5806,
+      "step": 80
+    },
+    {
+      "epoch": 0.5379746835443038,
+      "grad_norm": 1.2276663780212402,
+      "learning_rate": 0.0001796437659033079,
+      "loss": 0.544,
+      "step": 85
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.9570387601852417,
+      "learning_rate": 0.00017837150127226464,
+      "loss": 0.5557,
+      "step": 90
+    },
+    {
+      "epoch": 0.6012658227848101,
+      "grad_norm": 0.8000441193580627,
+      "learning_rate": 0.00017709923664122138,
+      "loss": 0.486,
+      "step": 95
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 1.835436463356018,
+      "learning_rate": 0.00017582697201017812,
+      "loss": 0.6063,
+      "step": 100
+    },
+    {
+      "epoch": 0.6645569620253164,
+      "grad_norm": 0.9403336644172668,
+      "learning_rate": 0.00017455470737913486,
+      "loss": 0.5618,
+      "step": 105
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.9277241826057434,
+      "learning_rate": 0.00017328244274809163,
+      "loss": 0.555,
+      "step": 110
+    },
+    {
+      "epoch": 0.7278481012658228,
+      "grad_norm": 0.8973642587661743,
+      "learning_rate": 0.00017201017811704835,
+      "loss": 0.5361,
+      "step": 115
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.911058247089386,
+      "learning_rate": 0.0001707379134860051,
+      "loss": 0.5372,
+      "step": 120
+    },
+    {
+      "epoch": 0.7911392405063291,
+      "grad_norm": 1.1374117136001587,
+      "learning_rate": 0.00016946564885496183,
+      "loss": 0.5083,
+      "step": 125
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.8928428888320923,
+      "learning_rate": 0.0001681933842239186,
+      "loss": 0.4999,
+      "step": 130
+    },
+    {
+      "epoch": 0.8544303797468354,
+      "grad_norm": 0.9310257434844971,
+      "learning_rate": 0.00016692111959287534,
+      "loss": 0.5129,
+      "step": 135
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.9463359117507935,
+      "learning_rate": 0.00016564885496183205,
+      "loss": 0.4905,
+      "step": 140
+    },
+    {
+      "epoch": 0.9177215189873418,
+      "grad_norm": 0.980999767780304,
+      "learning_rate": 0.0001643765903307888,
+      "loss": 0.5582,
+      "step": 145
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.9762192964553833,
+      "learning_rate": 0.00016310432569974556,
+      "loss": 0.5519,
+      "step": 150
+    },
+    {
+      "epoch": 0.9810126582278481,
+      "grad_norm": 0.8615793585777283,
+      "learning_rate": 0.0001618320610687023,
+      "loss": 0.5423,
+      "step": 155
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.6834261417388916,
+      "learning_rate": 0.00016055979643765905,
+      "loss": 0.528,
+      "step": 160
+    },
+    {
+      "epoch": 1.0443037974683544,
+      "grad_norm": 0.764999270439148,
+      "learning_rate": 0.0001592875318066158,
+      "loss": 0.3868,
+      "step": 165
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.7723885178565979,
+      "learning_rate": 0.00015801526717557253,
+      "loss": 0.4264,
+      "step": 170
+    },
+    {
+      "epoch": 1.1075949367088607,
+      "grad_norm": 0.9795113205909729,
+      "learning_rate": 0.00015674300254452927,
+      "loss": 0.4178,
+      "step": 175
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.8282197713851929,
+      "learning_rate": 0.000155470737913486,
+      "loss": 0.3941,
+      "step": 180
+    },
+    {
+      "epoch": 1.1708860759493671,
+      "grad_norm": 0.9483677744865417,
+      "learning_rate": 0.00015419847328244275,
+      "loss": 0.4169,
+      "step": 185
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.9333426356315613,
+      "learning_rate": 0.0001529262086513995,
+      "loss": 0.4433,
+      "step": 190
+    },
+    {
+      "epoch": 1.2341772151898733,
+      "grad_norm": 1.0099432468414307,
+      "learning_rate": 0.00015165394402035624,
+      "loss": 0.4186,
+      "step": 195
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7976335883140564,
+      "learning_rate": 0.00015038167938931298,
+      "loss": 0.3709,
+      "step": 200
+    },
+    {
+      "epoch": 1.2974683544303798,
+      "grad_norm": 0.8201557993888855,
+      "learning_rate": 0.00014910941475826972,
+      "loss": 0.4266,
+      "step": 205
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 1.5948097705841064,
+      "learning_rate": 0.0001478371501272265,
+      "loss": 0.4162,
+      "step": 210
+    },
+    {
+      "epoch": 1.360759493670886,
+      "grad_norm": 0.9284299612045288,
+      "learning_rate": 0.0001465648854961832,
+      "loss": 0.374,
+      "step": 215
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.882803738117218,
+      "learning_rate": 0.00014529262086513994,
+      "loss": 0.4317,
+      "step": 220
+    },
+    {
+      "epoch": 1.4240506329113924,
+      "grad_norm": 0.9879310727119446,
+      "learning_rate": 0.0001440203562340967,
+      "loss": 0.3957,
+      "step": 225
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.9921488165855408,
+      "learning_rate": 0.00014274809160305345,
+      "loss": 0.4249,
+      "step": 230
+    },
+    {
+      "epoch": 1.4873417721518987,
+      "grad_norm": 1.2630486488342285,
+      "learning_rate": 0.0001414758269720102,
+      "loss": 0.3936,
+      "step": 235
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 1.2342113256454468,
+      "learning_rate": 0.0001402035623409669,
+      "loss": 0.4275,
+      "step": 240
+    },
+    {
+      "epoch": 1.5506329113924051,
+      "grad_norm": 0.9430296421051025,
+      "learning_rate": 0.00013893129770992368,
+      "loss": 0.4226,
+      "step": 245
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 1.3600997924804688,
+      "learning_rate": 0.00013765903307888042,
+      "loss": 0.4359,
+      "step": 250
+    },
+    {
+      "epoch": 1.6139240506329116,
+      "grad_norm": 0.8744933009147644,
+      "learning_rate": 0.00013638676844783716,
+      "loss": 0.4198,
+      "step": 255
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.9405940771102905,
+      "learning_rate": 0.0001351145038167939,
+      "loss": 0.4001,
+      "step": 260
+    },
+    {
+      "epoch": 1.6772151898734178,
+      "grad_norm": 0.8729792833328247,
+      "learning_rate": 0.00013384223918575064,
+      "loss": 0.4215,
+      "step": 265
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.9679851531982422,
+      "learning_rate": 0.00013256997455470738,
+      "loss": 0.3684,
+      "step": 270
+    },
+    {
+      "epoch": 1.740506329113924,
+      "grad_norm": 0.9041249752044678,
+      "learning_rate": 0.00013129770992366413,
+      "loss": 0.3666,
+      "step": 275
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 1.0651932954788208,
+      "learning_rate": 0.00013002544529262087,
+      "loss": 0.3988,
+      "step": 280
+    },
+    {
+      "epoch": 1.8037974683544302,
+      "grad_norm": 1.200931429862976,
+      "learning_rate": 0.0001287531806615776,
+      "loss": 0.4279,
+      "step": 285
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 1.000989556312561,
+      "learning_rate": 0.00012748091603053435,
+      "loss": 0.433,
+      "step": 290
+    },
+    {
+      "epoch": 1.8670886075949367,
+      "grad_norm": 1.0178704261779785,
+      "learning_rate": 0.0001262086513994911,
+      "loss": 0.4008,
+      "step": 295
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 1.0279607772827148,
+      "learning_rate": 0.00012493638676844783,
+      "loss": 0.3774,
+      "step": 300
+    },
+    {
+      "epoch": 1.9303797468354431,
+      "grad_norm": 0.9084330201148987,
+      "learning_rate": 0.0001236641221374046,
+      "loss": 0.406,
+      "step": 305
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.8824640512466431,
+      "learning_rate": 0.00012239185750636134,
+      "loss": 0.4273,
+      "step": 310
+    },
+    {
+      "epoch": 1.9936708860759493,
+      "grad_norm": 1.372707724571228,
+      "learning_rate": 0.00012111959287531807,
+      "loss": 0.3944,
+      "step": 315
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.7385953068733215,
+      "learning_rate": 0.00011984732824427483,
+      "loss": 0.3265,
+      "step": 320
+    },
+    {
+      "epoch": 2.0569620253164556,
+      "grad_norm": 1.3800175189971924,
+      "learning_rate": 0.00011857506361323157,
+      "loss": 0.2617,
+      "step": 325
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.8772674798965454,
+      "learning_rate": 0.0001173027989821883,
+      "loss": 0.272,
+      "step": 330
+    },
+    {
+      "epoch": 2.1202531645569622,
+      "grad_norm": 0.8183962106704712,
+      "learning_rate": 0.00011603053435114504,
+      "loss": 0.2442,
+      "step": 335
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 1.0238982439041138,
+      "learning_rate": 0.00011475826972010179,
+      "loss": 0.2724,
+      "step": 340
+    },
+    {
+      "epoch": 2.1835443037974684,
+      "grad_norm": 1.0221502780914307,
+      "learning_rate": 0.00011348600508905853,
+      "loss": 0.3001,
+      "step": 345
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 0.8871440291404724,
+      "learning_rate": 0.00011221374045801527,
+      "loss": 0.2727,
+      "step": 350
+    },
+    {
+      "epoch": 2.2468354430379747,
+      "grad_norm": 0.960236668586731,
+      "learning_rate": 0.000110941475826972,
+      "loss": 0.2651,
+      "step": 355
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.9270543456077576,
+      "learning_rate": 0.00010966921119592877,
+      "loss": 0.2534,
+      "step": 360
+    },
+    {
+      "epoch": 2.310126582278481,
+      "grad_norm": 1.150570034980774,
+      "learning_rate": 0.0001083969465648855,
+      "loss": 0.2687,
+      "step": 365
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.889858603477478,
+      "learning_rate": 0.00010712468193384224,
+      "loss": 0.2639,
+      "step": 370
+    },
+    {
+      "epoch": 2.3734177215189876,
+      "grad_norm": 0.9829533696174622,
+      "learning_rate": 0.00010585241730279898,
+      "loss": 0.2709,
+      "step": 375
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 1.482006549835205,
+      "learning_rate": 0.00010458015267175574,
+      "loss": 0.2998,
+      "step": 380
+    },
+    {
+      "epoch": 2.4367088607594938,
+      "grad_norm": 1.1532208919525146,
+      "learning_rate": 0.00010330788804071248,
+      "loss": 0.2663,
+      "step": 385
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 0.8587226271629333,
+      "learning_rate": 0.00010203562340966922,
+      "loss": 0.263,
+      "step": 390
+    },
+    {
+      "epoch": 2.5,
+      "grad_norm": 0.9111952185630798,
+      "learning_rate": 0.00010076335877862595,
+      "loss": 0.2735,
+      "step": 395
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 0.9616707563400269,
+      "learning_rate": 9.94910941475827e-05,
+      "loss": 0.2647,
+      "step": 400
+    },
+    {
+      "epoch": 2.5632911392405062,
+      "grad_norm": 1.133192777633667,
+      "learning_rate": 9.821882951653944e-05,
+      "loss": 0.2646,
+      "step": 405
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 1.2275214195251465,
+      "learning_rate": 9.694656488549618e-05,
+      "loss": 0.2672,
+      "step": 410
+    },
+    {
+      "epoch": 2.6265822784810124,
+      "grad_norm": 1.1493219137191772,
+      "learning_rate": 9.567430025445293e-05,
+      "loss": 0.2759,
+      "step": 415
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.8626896739006042,
+      "learning_rate": 9.440203562340968e-05,
+      "loss": 0.2643,
+      "step": 420
+    },
+    {
+      "epoch": 2.689873417721519,
+      "grad_norm": 1.2467924356460571,
+      "learning_rate": 9.312977099236642e-05,
+      "loss": 0.2773,
+      "step": 425
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 1.0049347877502441,
+      "learning_rate": 9.185750636132316e-05,
+      "loss": 0.279,
+      "step": 430
+    },
+    {
+      "epoch": 2.7531645569620253,
+      "grad_norm": 0.9384709596633911,
+      "learning_rate": 9.05852417302799e-05,
+      "loss": 0.2506,
+      "step": 435
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 1.1841737031936646,
+      "learning_rate": 8.931297709923665e-05,
+      "loss": 0.2839,
+      "step": 440
+    },
+    {
+      "epoch": 2.8164556962025316,
+      "grad_norm": 1.0706425905227661,
+      "learning_rate": 8.804071246819339e-05,
+      "loss": 0.2791,
+      "step": 445
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 0.9941563606262207,
+      "learning_rate": 8.676844783715013e-05,
+      "loss": 0.2875,
+      "step": 450
+    },
+    {
+      "epoch": 2.879746835443038,
+      "grad_norm": 1.0086358785629272,
+      "learning_rate": 8.549618320610687e-05,
+      "loss": 0.2966,
+      "step": 455
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 1.1530709266662598,
+      "learning_rate": 8.422391857506363e-05,
+      "loss": 0.2872,
+      "step": 460
+    },
+    {
+      "epoch": 2.9430379746835444,
+      "grad_norm": 1.8472609519958496,
+      "learning_rate": 8.295165394402035e-05,
+      "loss": 0.2702,
+      "step": 465
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 1.3067833185195923,
+      "learning_rate": 8.167938931297711e-05,
+      "loss": 0.2687,
+      "step": 470
+    },
+    {
+      "epoch": 3.0063291139240507,
+      "grad_norm": 0.8619422316551208,
+      "learning_rate": 8.040712468193385e-05,
+      "loss": 0.2533,
+      "step": 475
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 1.14690363407135,
+      "learning_rate": 7.913486005089059e-05,
+      "loss": 0.1712,
+      "step": 480
+    },
+    {
+      "epoch": 3.069620253164557,
+      "grad_norm": 1.6324301958084106,
+      "learning_rate": 7.786259541984733e-05,
+      "loss": 0.1714,
+      "step": 485
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 1.2055376768112183,
+      "learning_rate": 7.659033078880407e-05,
+      "loss": 0.1628,
+      "step": 490
+    },
+    {
+      "epoch": 3.132911392405063,
+      "grad_norm": 1.2004039287567139,
+      "learning_rate": 7.531806615776081e-05,
+      "loss": 0.1634,
+      "step": 495
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 1.1392419338226318,
+      "learning_rate": 7.404580152671756e-05,
+      "loss": 0.1551,
+      "step": 500
+    },
+    {
+      "epoch": 3.1962025316455698,
+      "grad_norm": 0.9046140313148499,
+      "learning_rate": 7.27735368956743e-05,
+      "loss": 0.1561,
+      "step": 505
+    },
+    {
+      "epoch": 3.2278481012658227,
+      "grad_norm": 0.9947652816772461,
+      "learning_rate": 7.150127226463105e-05,
+      "loss": 0.1573,
+      "step": 510
+    },
+    {
+      "epoch": 3.259493670886076,
+      "grad_norm": 1.4119527339935303,
+      "learning_rate": 7.022900763358778e-05,
+      "loss": 0.1663,
+      "step": 515
+    },
+    {
+      "epoch": 3.291139240506329,
+      "grad_norm": 1.0569303035736084,
+      "learning_rate": 6.895674300254454e-05,
+      "loss": 0.1511,
+      "step": 520
+    },
+    {
+      "epoch": 3.3227848101265822,
+      "grad_norm": 1.3024840354919434,
+      "learning_rate": 6.768447837150128e-05,
+      "loss": 0.1722,
+      "step": 525
+    },
+    {
+      "epoch": 3.3544303797468356,
+      "grad_norm": 0.9816167950630188,
+      "learning_rate": 6.641221374045802e-05,
+      "loss": 0.1661,
+      "step": 530
+    },
+    {
+      "epoch": 3.3860759493670884,
+      "grad_norm": 1.2426139116287231,
+      "learning_rate": 6.513994910941476e-05,
+      "loss": 0.1668,
+      "step": 535
+    },
+    {
+      "epoch": 3.4177215189873418,
+      "grad_norm": 0.8965455889701843,
+      "learning_rate": 6.38676844783715e-05,
+      "loss": 0.1583,
+      "step": 540
+    },
+    {
+      "epoch": 3.449367088607595,
+      "grad_norm": 1.261871099472046,
+      "learning_rate": 6.259541984732826e-05,
+      "loss": 0.164,
+      "step": 545
+    },
+    {
+      "epoch": 3.481012658227848,
+      "grad_norm": 1.176588773727417,
+      "learning_rate": 6.132315521628498e-05,
+      "loss": 0.1622,
+      "step": 550
+    },
+    {
+      "epoch": 3.5126582278481013,
+      "grad_norm": 1.008577823638916,
+      "learning_rate": 6.005089058524174e-05,
+      "loss": 0.164,
+      "step": 555
+    },
+    {
+      "epoch": 3.5443037974683547,
+      "grad_norm": 1.137161135673523,
+      "learning_rate": 5.877862595419847e-05,
+      "loss": 0.1653,
+      "step": 560
+    },
+    {
+      "epoch": 3.5759493670886076,
+      "grad_norm": 0.9781959056854248,
+      "learning_rate": 5.750636132315522e-05,
+      "loss": 0.1556,
+      "step": 565
+    },
+    {
+      "epoch": 3.607594936708861,
+      "grad_norm": 0.9639568328857422,
+      "learning_rate": 5.6234096692111956e-05,
+      "loss": 0.1673,
+      "step": 570
+    },
+    {
+      "epoch": 3.6392405063291138,
+      "grad_norm": 1.0949690341949463,
+      "learning_rate": 5.496183206106871e-05,
+      "loss": 0.1745,
+      "step": 575
+    },
+    {
+      "epoch": 3.670886075949367,
+      "grad_norm": 1.0953764915466309,
+      "learning_rate": 5.3689567430025446e-05,
+      "loss": 0.166,
+      "step": 580
+    },
+    {
+      "epoch": 3.7025316455696204,
+      "grad_norm": 1.0483691692352295,
+      "learning_rate": 5.2417302798982194e-05,
+      "loss": 0.161,
+      "step": 585
+    },
+    {
+      "epoch": 3.7341772151898733,
+      "grad_norm": 1.100563883781433,
+      "learning_rate": 5.114503816793893e-05,
+      "loss": 0.1631,
+      "step": 590
+    },
+    {
+      "epoch": 3.7658227848101267,
+      "grad_norm": 1.0196837186813354,
+      "learning_rate": 4.9872773536895677e-05,
+      "loss": 0.1754,
+      "step": 595
+    },
+    {
+      "epoch": 3.7974683544303796,
+      "grad_norm": 0.97309809923172,
+      "learning_rate": 4.860050890585242e-05,
+      "loss": 0.1594,
+      "step": 600
+    },
+    {
+      "epoch": 3.829113924050633,
+      "grad_norm": 0.8981137871742249,
+      "learning_rate": 4.7328244274809166e-05,
+      "loss": 0.1655,
+      "step": 605
+    },
+    {
+      "epoch": 3.8607594936708862,
+      "grad_norm": 1.1848680973052979,
+      "learning_rate": 4.605597964376591e-05,
+      "loss": 0.1711,
+      "step": 610
+    },
+    {
+      "epoch": 3.892405063291139,
+      "grad_norm": 1.4552581310272217,
+      "learning_rate": 4.478371501272265e-05,
+      "loss": 0.1533,
+      "step": 615
+    },
+    {
+      "epoch": 3.9240506329113924,
+      "grad_norm": 0.865252673625946,
+      "learning_rate": 4.351145038167939e-05,
+      "loss": 0.1498,
+      "step": 620
+    },
+    {
+      "epoch": 3.9556962025316453,
+      "grad_norm": 1.0925447940826416,
+      "learning_rate": 4.223918575063613e-05,
+      "loss": 0.1655,
+      "step": 625
+    },
+    {
+      "epoch": 3.9873417721518987,
+      "grad_norm": 1.2463428974151611,
+      "learning_rate": 4.096692111959288e-05,
+      "loss": 0.1644,
+      "step": 630
+    },
+    {
+      "epoch": 4.018987341772152,
+      "grad_norm": 0.5411891937255859,
+      "learning_rate": 3.969465648854962e-05,
+      "loss": 0.1284,
+      "step": 635
+    },
+    {
+      "epoch": 4.050632911392405,
+      "grad_norm": 0.6401993632316589,
+      "learning_rate": 3.842239185750636e-05,
+      "loss": 0.099,
+      "step": 640
+    },
+    {
+      "epoch": 4.082278481012658,
+      "grad_norm": 1.0925720930099487,
+      "learning_rate": 3.7150127226463104e-05,
+      "loss": 0.1041,
+      "step": 645
+    },
+    {
+      "epoch": 4.113924050632911,
+      "grad_norm": 0.8982082009315491,
+      "learning_rate": 3.5877862595419845e-05,
+      "loss": 0.0966,
+      "step": 650
+    },
+    {
+      "epoch": 4.1455696202531644,
+      "grad_norm": 0.9223958253860474,
+      "learning_rate": 3.4605597964376594e-05,
+      "loss": 0.0987,
+      "step": 655
+    },
+    {
+      "epoch": 4.177215189873418,
+      "grad_norm": 1.2166099548339844,
+      "learning_rate": 3.3333333333333335e-05,
+      "loss": 0.1005,
+      "step": 660
+    },
+    {
+      "epoch": 4.208860759493671,
+      "grad_norm": 0.7334603071212769,
+      "learning_rate": 3.2061068702290076e-05,
+      "loss": 0.0994,
+      "step": 665
+    },
+    {
+      "epoch": 4.2405063291139244,
+      "grad_norm": 0.6357023119926453,
+      "learning_rate": 3.078880407124682e-05,
+      "loss": 0.0928,
+      "step": 670
+    },
+    {
+      "epoch": 4.272151898734177,
+      "grad_norm": 0.7984826564788818,
+      "learning_rate": 2.9516539440203562e-05,
+      "loss": 0.0949,
+      "step": 675
+    },
+    {
+      "epoch": 4.30379746835443,
+      "grad_norm": 0.8327127695083618,
+      "learning_rate": 2.824427480916031e-05,
+      "loss": 0.0959,
+      "step": 680
+    },
+    {
+      "epoch": 4.3354430379746836,
+      "grad_norm": 0.831471860408783,
+      "learning_rate": 2.6972010178117052e-05,
+      "loss": 0.1059,
+      "step": 685
+    },
+    {
+      "epoch": 4.367088607594937,
+      "grad_norm": 0.7829914689064026,
+      "learning_rate": 2.5699745547073793e-05,
+      "loss": 0.1025,
+      "step": 690
+    },
+    {
+      "epoch": 4.39873417721519,
+      "grad_norm": 0.9395941495895386,
+      "learning_rate": 2.4427480916030535e-05,
+      "loss": 0.1028,
+      "step": 695
+    },
+    {
+      "epoch": 4.430379746835443,
+      "grad_norm": 1.1621861457824707,
+      "learning_rate": 2.3155216284987276e-05,
+      "loss": 0.1086,
+      "step": 700
+    },
+    {
+      "epoch": 4.462025316455696,
+      "grad_norm": 1.013010025024414,
+      "learning_rate": 2.1882951653944024e-05,
+      "loss": 0.1011,
+      "step": 705
+    },
+    {
+      "epoch": 4.493670886075949,
+      "grad_norm": 0.8167689442634583,
+      "learning_rate": 2.0610687022900766e-05,
+      "loss": 0.1022,
+      "step": 710
+    },
+    {
+      "epoch": 4.525316455696203,
+      "grad_norm": 0.6559643149375916,
+      "learning_rate": 1.9338422391857507e-05,
+      "loss": 0.0997,
+      "step": 715
+    },
+    {
+      "epoch": 4.556962025316456,
+      "grad_norm": 0.8875255584716797,
+      "learning_rate": 1.8066157760814252e-05,
+      "loss": 0.1018,
+      "step": 720
+    },
+    {
+      "epoch": 4.588607594936709,
+      "grad_norm": 0.7616258859634399,
+      "learning_rate": 1.6793893129770993e-05,
+      "loss": 0.1019,
+      "step": 725
+    },
+    {
+      "epoch": 4.620253164556962,
+      "grad_norm": 0.7673054933547974,
+      "learning_rate": 1.5521628498727735e-05,
+      "loss": 0.1052,
+      "step": 730
+    },
+    {
+      "epoch": 4.651898734177215,
+      "grad_norm": 0.735145092010498,
+      "learning_rate": 1.424936386768448e-05,
+      "loss": 0.108,
+      "step": 735
+    },
+    {
+      "epoch": 4.6835443037974684,
+      "grad_norm": 0.6623585820198059,
+      "learning_rate": 1.2977099236641221e-05,
+      "loss": 0.1002,
+      "step": 740
+    },
+    {
+      "epoch": 4.715189873417722,
+      "grad_norm": 0.9835277795791626,
+      "learning_rate": 1.1704834605597966e-05,
+      "loss": 0.1067,
+      "step": 745
+    },
+    {
+      "epoch": 4.746835443037975,
+      "grad_norm": 0.6404012441635132,
+      "learning_rate": 1.0432569974554709e-05,
+      "loss": 0.0989,
+      "step": 750
+    },
+    {
+      "epoch": 4.7784810126582276,
+      "grad_norm": 0.8677298426628113,
+      "learning_rate": 9.16030534351145e-06,
+      "loss": 0.1063,
+      "step": 755
+    },
+    {
+      "epoch": 4.810126582278481,
+      "grad_norm": 0.6618124842643738,
+      "learning_rate": 7.888040712468193e-06,
+      "loss": 0.1002,
+      "step": 760
+    },
+    {
+      "epoch": 4.841772151898734,
+      "grad_norm": 0.8289826512336731,
+      "learning_rate": 6.615776081424936e-06,
+      "loss": 0.1016,
+      "step": 765
+    },
+    {
+      "epoch": 4.8734177215189876,
+      "grad_norm": 0.8138179183006287,
+      "learning_rate": 5.343511450381679e-06,
+      "loss": 0.0985,
+      "step": 770
+    },
+    {
+      "epoch": 4.905063291139241,
+      "grad_norm": 0.7760260701179504,
+      "learning_rate": 4.0712468193384225e-06,
+      "loss": 0.0972,
+      "step": 775
+    },
+    {
+      "epoch": 4.936708860759493,
+      "grad_norm": 0.9268924593925476,
+      "learning_rate": 2.7989821882951656e-06,
+      "loss": 0.1039,
+      "step": 780
+    },
+    {
+      "epoch": 4.968354430379747,
+      "grad_norm": 0.8348525166511536,
+      "learning_rate": 1.5267175572519084e-06,
+      "loss": 0.0981,
+      "step": 785
+    },
+    {
+      "epoch": 5.0,
+      "grad_norm": 0.630344808101654,
+      "learning_rate": 2.544529262086514e-07,
+      "loss": 0.0946,
+      "step": 790
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 790,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 7.297176680828928e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/hr-sk/checkpoint-790/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0af774678c41577ae1213b87da9e937d742c151c9721e256188358b6e4dc7bf9
+size 6289

experiments/hr-sk/metrics.json

@@ -0,0 +1,12 @@
+{
+    "hr": {
+        "precision": 0.6878,
+        "recall": 0.6762,
+        "f1": 0.682
+    },
+    "sk": {
+        "precision": 0.6967,
+        "recall": 0.6849,
+        "f1": 0.6907
+    }
+}

experiments/hr-sk/preds_hr.csv

@@ -0,0 +1,545 @@
+input,gold,pred
+Čekao sam 10-15 minuta da usluga naručim pivo i nikad više nisam poslužen.,"{service general, usluga, negative}","{service general, usluga, negative}"
+ambijent bio je miran i opuštajući odmor među svom djecom koja su trčala uokolo u centru Disneya.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive}"
+skriveni mali jem,"{restaurant general, null, positive}","{restaurant general, jem, positive}"
+Otišao sam tamo s prijateljem iz drugog grada ... i oboje smo bili impresionirani!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Ima odličan sushi i još bolji usluga.,"{service general, usluga, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{service general, usluga, positive}"
+"Sve njihove stavke jelovnika su hit, a poslužuju mimoze.","{food quality, stavke jelovnika, positive}","{food quality, stavke jelovnika, positive};{service general, null, positive}"
+– ... i najbolje ljetno paluba iskustvo -- čak će vam donijeti i deku ako vam bude hladno na večernjem vremenu u Seattleu.,"{ambience general, paluba, positive};{service general, null, positive}","{ambience general, ljetno paluba, positive}"
+– Nakon 12 godina u Seattleu Ray's smatra se mjestom kojem se uvijek vraćamo.,"{restaurant general, Ray's, positive}","{restaurant general, Ray's, positive}"
+Ovdje ne možete pogriješiti.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Mislim da sam vjerojatno probao svaku stavku na njihovom jelovniku barem jednom, sve je izvrsno.","{food quality, jelovniku, positive}","{food quality, jelovniku, positive}"
+– feferoni stvarno debelo narezano -- Njam .,"{food style_options, feferoni, positive}","{food quality, feferoni, negative};{food style_options, feferoni, negative}"
+Creme brulee od zelenog čaja postaje bolji svaki put kad ga popijem.,"{food quality, Creme brulee od zelenog čaja, positive}","{food quality, Creme brulee od zelenog čaja, positive}"
+nije baš fina misao da se osjećaš nelagodno i da se moraš dotjerati.,"{ambience general, null, positive}","{restaurant miscellaneous, null, negative}"
+Atmosfera bilo je lijepo.,"{ambience general, Atmosfera, positive}","{ambience general, Atmosfera, positive}"
+apsolutno nevjerojatno! ! !,"{restaurant general, null, positive}","{food quality, null, positive}"
+IZBJEGAVAJ MJESTO,"{restaurant general, MJESTO, negative}","{restaurant general, MJESTO, negative}"
+"Da budem iskren, bolje mi je bilo smrznuto pizza.","{food quality, pizza, negative}","{food quality, pizza, negative}"
+usluga je bila izuzetna - ponekad je postojao osjećaj da nas poslužuje vojska ljubaznih konobara.,"{service general, konobara, positive};{service general, usluga, positive}","{service general, usluga, positive}"
+I sve su lijepo zapakirali da se nije prosulo .,"{service general, null, positive}","{food style_options, null, positive}"
+JAKO DOBRO!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+hrana je grešna.,"{food quality, hrana, positive}","{food quality, hrana, negative}"
+"Za početak, otprilike 8-10 oz sok od naranče koštat će vas 3 USD.","{drinks prices, sok od naranče, negative}","{drinks style_options, sok od naranče, negative}"
+dobro izbor sakea .,"{drinks style_options, izbor sakea, positive}","{drinks style_options, izbor sakea, positive}"
+"Iako sam mogao i bez mladih koji su s nama podijelili večer, naše divno poslužitelj i hrana učinilo je iskustvo vrlo pozitivnim.","{restaurant miscellaneous, null, positive};{service general, poslužitelj, positive};{food quality, hrana, positive}","{service general, poslužitelj, positive};{food quality, hrana, positive}"
+Kakav nalaz!,"{restaurant general, null, positive}","{food quality, null, positive}"
+– Mioposto ima vrlo kreativan i ukusan pizza meni .,"{food style_options, pizza meni, positive};{food quality, pizza meni, positive}","{food style_options, pizza meni, positive};{food quality, pizza meni, positive}"
+"Na nedavnom putovanju, naš konobar bio je krajnje omalovažavajući, dok su ni manje ni više nego tri člana osoblja čekala dvije japanske djevojke koje su sjedile u blizini.","{service general, konobar, negative}","{service general, konobar, negative};{service general, osoblje, negative}"
+"inače ne bih dovršio brokoli kad naručim ovakvu hranu, ali po prvi put, svaki komad je bio pun događaja kao i prvi ... Jakobove kapice i kozice bili su tako svježe i lijepo kuhano.","{food quality, Jakobove kapice, positive};{food quality, brokoli, positive};{food quality, kozice, positive}","{food quality, Jakobove kapice i kozice, positive};{food quality, brokoli, negative}"
+"Nije najjeftiniji sushi, ali se svaki put isplatio.","{food quality, sushi, positive};{food prices, sushi, neutral}","{food quality, sushi, positive};{food prices, sushi, negative}"
+Nikada se ne osjećate mrzovoljno i nabijeno nakon što tamo jedete.,"{food quality, null, positive}","{restaurant miscellaneous, null, positive}"
+"Kao dio male četveročlane zabave, naša hrana je dostavljena bez komentara;","{service general, null, negative}","{food quality, hrana, neutral}"
+Nadam se da će se jednog dana Scooner ili kasnije vratiti ono što je nekad bilo.,"{restaurant general, Scooner ili kasnije, negative}","{restaurant general, Scooner, negative}"
+"Kao prvo, hrana je stigla brzo i sve zajedno :) sviđa mi se to... mrzim pretencioznost stvari koje dolaze jedna za drugom.","{service general, null, positive}","{food style_options, hrana, positive};{service general, null, positive}"
+hrana je bila izvrsna!,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+"Ako postoji red na isti dan u tjednu cijelo vrijeme dok je mjesto otvoreno, znate da je to sjajno.","{restaurant general, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+Najugodnije iznenađenje bio je ček koji nije premašio moja očekivanja kako to uvijek biva u većini mjesta.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+"U najboljem slučaju, hrana je bila dobra i definitivno precijenjena.","{food quality, hrana, positive};{food prices, hrana, negative}","{food quality, hrana, negative};{food prices, hrana, negative}"
+Vanjska terasa ima skraćeni izbornik .,"{food style_options, izbornik, neutral}","{ambience general, Vanjska terasa, negative}"
+Najbolje indijska hrana u L.A.,"{food quality, indijska hrana, positive}","{food quality, indijska hrana, positive}"
+Prijeđite na stvar - ovo je nevjerojatno!,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+"hrana nije ono što je nekada bila ( napitci došlo je do ozbiljnog smanjenja) cijene su porasle, a usluga je najgora stvar koju sam igdje doživio (uključujući kopnenu Europu).","{service general, usluga, negative};{food style_options, napitci, negative};{food quality, hrana, negative};{food prices, hrana, negative}","{drinks prices, napitci, negative};{service general, usluga, negative};{food quality, hrana, negative};{food prices, hrana, negative}"
+Libanonska hrana ! Njam!,"{food quality, Libanonska hrana, positive}","{food quality, Libanonska hrana, positive}"
+brokoli bili su tako svježi i ukusni.,"{food quality, brokoli, positive}","{food quality, brokoli, positive}"
+I daju dobru količinu za cijenu.,"{food style_options, null, positive}","{food style_options, null, positive}"
+Vrlo razočaravajuće,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+NAJBOLJE u Seattleu Popis vina,"{drinks style_options, Popis vina, positive}","{drinks style_options, Popis vina, positive}"
+– Ne mogu reći dovoljno o ovome mjesto .,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+– jedem na ovom mjestu već više od 8 godina i nikad nisam pojeo niti jedan loš obrok .,"{food quality, obrok, positive}","{food quality, obrok, positive}"
+Otišao sam kući i ponovno ih potražio na mreži gdje sam otkrio da postoji poveznica za darivanje koja ne radi pa sam poslala e-poruku restoranu o nepostojećoj usluzi i obmanjujućoj vezi.,"{restaurant miscellaneous, restoranu, negative}","{service general, usluzi, negative};{restaurant miscellaneous, restoranu, negative}"
+Otmjeni komadi egzotične ribe na 100 dolara tanjur i NI JEDAN se nije mogao jesti.,"{food quality, egzotične ribe, negative};{food style_options, egzotične ribe, negative};{food prices, tanjur, negative}","{food quality, egzotične ribe, negative};{food prices, egzotične ribe, negative}"
+"Imao sam ukusno janjeća korma , saag paneer , samose , naan itd.","{food quality, samose, positive};{food quality, naan, positive};{food quality, janjeća korma, positive};{food quality, saag paneer, positive}","{food quality, janjeća korma, positive};{food quality, saag paneer, positive};{food quality, samose, positive};{food quality, naan, positive}"
+Poslužuje jako dobro sushi.,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"Kao i obično, omikase nije razočarao u svježini, iako je dobio niske ocjene za kreativnost i odabir.","{food style_options, omikase, negative};{food quality, omikase, positive}","{food quality, omikase, positive};{food style_options, omikase, negative};{food style_options, odabir, negative}"
+"Riža je presuha, tuna nije bila ni tako svježa.","{food quality, Riža, negative};{food quality, tuna, negative}","{food quality, tuna, negative};{food quality, Riža, negative}"
+Njihovo rakova jaja benedict stvara ovisnost.,"{food quality, rakova jaja benedict, positive}","{food quality, rakova jaja benedict, positive}"
+Sačuvajte mjesta za ukusne deserti .,"{food quality, deserti, positive}","{food quality, deserti, positive}"
+Naš poslužitelj bio je vrlo profesionalan i ljubazan.,"{service general, poslužitelj, positive}","{service general, poslužitelj, positive}"
+Otišao sam ovdje na preporuku i sigurno ću se vraćati uvijek iznova.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"hrana je bila dobra, ali je bila previše blaga.","{food quality, hrana, positive};{food quality, hrana, negative}","{food quality, hrana, negative};{food quality, hrana, positive}"
+– Moj suprug i ja volimo jesti u Mioposto Café .,"{restaurant general, Mioposto Café, positive}","{restaurant general, Mioposto Café, positive}"
+– Ovo je bilo sjajno iskustvo objedovanja.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Osoblje  bilo je stvarno ljubazno.,"{service general, null, positive}","{service general, Osoblje, positive}"
+Lako smo potrošili više od 40 dolara po osobi (ne uključujući alkohol) i još uvijek smo bili gladni.,"{restaurant prices, null, negative};{food style_options, null, negative}","{food prices, null, negative};{food quality, null, negative}"
+Ovo je ravno među mjestima u Tokiju što se tiče svježine.,"{food quality, null, positive}","{food quality, null, positive}"
+Groovy glazba učinio je večeru ležernom.,"{ambience general, glazba, positive}","{ambience general, glazba, positive}"
+"Nakon što je jednog člana naše stranke više puta udarila konobarica, ljubazan zahtjev da ne bude udaren doveo je konobaricu do uvredljivog brbljanja.","{service general, konobarica, negative}","{service general, konobarica, negative}"
+– Ray's (iznenađujuće) ima NAJBOLJE i najraznolikije u gradu vinska karta.,"{drinks style_options, vinska karta, positive}","{drinks style_options, vinska karta, positive};{drinks quality, vinska karta, positive}"
+Vjerojatno se ipak ne bih vratio jer ne znam je li to vrijedno toga.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"čips i salsa su tako ukusni, a cijene su fantastične.","{restaurant prices, null, positive};{food quality, čips i salsa, positive}","{restaurant prices, null, positive};{food quality, čips, positive};{food quality, salsa, positive}"
+"sommelier je fantastičan, prizeman i izuzetno obrazovan.","{service general, sommelier, positive}","{service general, sommelelier, positive}"
+velika gusta feferoni,"{food style_options, feferoni, positive}","{food quality, feferoni, negative}"
+Ne isplati se uopće ići i trošiti novac tamo! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Uvredljivo precijenjen,"{restaurant prices, null, negative}","{restaurant prices, null, negative}"
+Unutrašnji ambijent je bio moderan.,"{ambience general, Unutrašnji ambijent, positive}","{ambience general, Unutrašnji ambijent, positive}"
+NE IDITE!,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Dok se to ne dogodi, moj savjet je da se DRŽITE DALJE.","{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Oh, zaboravio sam spomenuti da oni nemaju uslugu kruha.","{service general, null, negative}","{service general, uslugu kruha, negative}"
+Nisu masni ni ništa.,"{food quality, null, positive}","{food quality, null, positive}"
+"glazba je sjajna, nijedna noć nije bolja ni gora, barske nježnosti su velikodušne s točenjem, a lagana atmosfera podići će vam raspoloženje.","{ambience general, atmosfera, positive};{drinks style_options, barske nježnosti, positive};{ambience general, glazba, positive}","{ambience general, lagana, positive};{ambience general, atmosfera, positive};{service general, barske nježnosti, positive};{ambience general, glazba, positive}"
+"Lijepo ambijent, ali jako precijenjeno mjesto.","{restaurant general, mjesto, negative};{ambience general, ambijent, positive}","{ambience general, ambijent, positive};{restaurant prices, mjesto, negative}"
+sushi ovdje je izvrstan!,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+– Izuzetno mi je drago izvijestiti da je moja večera u Ray's Boathouse prošlog petka u potpunosti nadmašila moja očekivanja.,"{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}"
+"Večere uvijek su bile izvrsne, u smislu kvalitete hrane.","{food quality, Večere, positive}","{food quality, hrane, positive}"
+Sve njihove aplikacije su ukusne.,"{food quality, aplikacije, positive}","{food quality, aplikacije, positive}"
+Blue Ribbon opravdava svoju fantastičnu reputaciju.,"{restaurant general, Blue Ribbon, positive}","{restaurant general, Blue Ribbon, positive}"
+Osjećao sam se neugodno i sljedeći put sam otišao u toalet u kasinu.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+– Odlučio sam jesti u Stacku zbog njihove fiksna cijena večere prije nastupa .,"{food prices, fiksna cijena večere prije nastupa, neutral}","{food prices, fiksna cijena večere, positive}"
+– Odveo sam svoje roditelje ovamo za njihovu godišnjicu – jako jako razočaran! ! !,"{restaurant general, null, negative}","{restaurant miscellaneous, null, negative}"
+Nepobjedivo sushi!,"{food quality, sushi, positive}","{food quality, sushi, positive}"
+"Za početak, naš ljupki poslužitelj Brooke brzo je bio spreman preuzeti moju narudžbu pića.","{service general, Brooke, positive}","{service general, poslužitelj Brooke, positive}"
+Svaki put kad se pozove `` 0-sixtynine `` barmen svima kupi piće!,"{service general, barmen, positive}","{service general, barmen, positive}"
+"Beskrajna zabava, super glazba, sjajno osoblje! ! !","{restaurant general, null, positive};{service general, osoblje, positive};{ambience general, glazba, positive}","{ambience general, glazba, positive};{restaurant general, null, positive};{service general, osoblje, positive}"
+Sajam odabir jelovnika .,"{food style_options, odabir jelovnika, neutral}","{food style_options, odabir jelovnika, positive}"
+Dva klinca bezobraznika sjedila su blizu nas u prvom dijelu naše večere... zamijenila ih je ljupka predtinejdžerka koja se pretvarala da guši svaki put kad bi se spomenuli morski plodovi za njezinim stolom.,"{restaurant miscellaneous, null, negative}","{service general, predtinejdžerka, negative}"
+Odbio sam to jer su u procesu pokušaja popravka jaja razbili nešto drugo u posudi i bio sam previše frustriran da nastavim.,"{food quality, posudi, negative}","{service general, null, negative}"
+"imao je mnogo jela, ali NAJBOLJE je bilo jastog na 3 načina.","{food quality, jastog na 3 načina, positive}","{food quality, jastog na 3 načina, positive};{food style_options, jela, positive}"
+"predjelo bilo je zanimljivo, ali Creme Brulee bilo je vrlo ukusno i ukusno.","{food quality, Creme Brulee, positive};{food quality, predjelo, positive}","{food quality, predjelo, neutral};{food quality, Creme Brulee, positive}"
+dekor je bio lijep i jedinstven.,"{ambience general, dekor, positive}","{ambience general, dekor, positive}"
+"Svjež je, gostoljubiv, ukusan i opuštajući.","{food quality, null, positive};{ambience general, null, positive}","{food quality, null, positive}"
+Stvara ovisnost!,"{restaurant general, null, positive}","{drugs quality, null, negative}"
+"Čak je i slanutak, koji inače smatram presuhim, bio dobar.","{food quality, slanutak, positive}","{food quality, slanutak, positive}"
+Ovo mjesto je super! !,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"To je veliki kompliment, pogotovo u nestalnom restoranskom poslu,... dosta je već!","{restaurant general, null, positive}","{restaurant general, restoranskom poslu, positive}"
+"Nakon što sam sjedio s praznom čašom više od 20 minuta, otišao sam.","{service general, null, negative}","{service general, null, negative}"
+Obavezno probajte rolada od kamenica .,"{food quality, rolada od kamenica, positive}","{food quality, rolada od kamenica, positive}"
+Začuđen sam da je ovaj restoran kategoriziran kao $ $ $ umjesto kao $ $ $ $.,"{restaurant prices, restoran, negative}","{restaurant prices, restoran, negative}"
+"Bilo je pristojno, ali ništa posebno.","{food quality, null, neutral}","{food quality, null, neutral}"
+"Usluga je bila malo spora, našoj konobarici je trebala čitava vječnost da nam da ček iako nije bilo toliko zauzeto.","{service general, konobarici, negative};{service general, Usluga, negative}","{service general, Usluga, negative};{service general, konobarici, negative}"
+"– Odlično pića , hašiš od kukuruzne govedine , kava , B Brzi burritos , Bez glutena jelovnik .","{food quality, hašiš od kukuruzne govedine, positive};{drinks quality, pića, positive};{food style_options, jelovnik, positive};{drinks quality, kava, positive};{food quality, B Brzi burritos, positive}","{food style_options, Bez glutena jelovnik, positive};{drinks quality, pića, positive};{food quality, hašiš od kukuruzne govedine, positive};{drinks quality, kava, positive};{food quality, Brzi burritos, positive}"
+meni za ručak je sjajna ponuda!,"{food prices, meni za ručak, positive}","{food style_options, meni za ručak, positive}"
+"Zauvijek je trajalo da preuzmemo našu narudžbu, nadopunjavanje vode bilo je previše za tražiti, a jedini put kad je bila brza bilo je kad smo tražili naš račun kada smo mogli privući njezinu pozornost.","{service general, null, negative}","{service general, null, negative};{drinks style_options, vode, negative};{service general, null, positive}"
+konobar je bio malo neprijateljski raspoložen i osjećaj u restoranu je bio prepun.,"{ambience general, osjećaj, negative};{service general, konobar, negative}","{service general, konobar, negative};{ambience general, restoran, negative}"
+– Nedavno sam imao zadovoljstvo večerati u ovom divnom restoranu u 2. ulici i vau kakvu smo sjajnu večer proveli.,"{restaurant general, restoranu, positive}","{restaurant general, restoranu u 2. ulici, positive}"
+"Specijalitet je ovdje dekadentan palačinke, ali vratio sam se već četiri puta i svaki put sam bio zadivljen.","{food quality, palačinke, positive}","{food quality, palačinke, positive}"
+– Prilično jeftino za meksičko sjedište I centar grada.,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant prices, meksičko sjedište I centar grada, positive}"
+"predjelo od kamenica, jastoga, rakova (male veličine) bilo je savršeno predjelo za moju ženu.","{food quality, predjelo od kamenica, jastoga, rakova (male veličine, positive}","{food quality, predjelo od kamenica, jastoga, rakova, positive}"
+Upravo sam saznao da možete imati mjesto samo za sebe noću i vikendom za privatnu zabavu - jedva čekam da tamo proslavim moj sljedeći rođendan.,"{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, null, positive}"
+"– Kao i kod većine restorana u Seattleu, Mioposto usluga je bio loš, a hrana precijenjena.","{service general, usluga, negative};{food prices, hrana, negative}","{service general, usluga, negative};{food prices, hrana, negative}"
+"Možete ga lako čuti, pa je to bio ugodan zvuk, a ne prenaglašen.","{ambience general, null, positive}","{ambience general, null, positive}"
+Samo idite tamo i uvjerite se sami.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+To je sjajno malo mjesto s tonama potencijala da bude mjesto u susjedstvu da usluga nije tako bezlična i korporativna.,"{restaurant general, mjesto, positive};{service general, usluga, negative}","{service general, usluga, negative};{ambience general, mjesto, positive}"
+"Brunch kod Murphyja je za umrijeti, moj specijalitet ... omlet od bjelanjaka , hrana uvijek je svježe pripremljena.","{food quality, omlet od bjelanjaka, positive};{food quality, Brunch, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{food quality, omlet od bjelanjaka, positive};{restaurant general, Brunch kod Murphyja, positive}"
+Mama Mia – Živim u susjedstvu i osjećam se sretnom što živim pored tako sjajne pizzerija .,"{restaurant general, pizzerija, positive}","{restaurant general, pizzerija, positive}"
+– ušuškan pokraj Beverly Centera.,"{location general, null, neutral}","{restaurant miscellaneous, null, neutral}"
+osoblje je prilično ljubazno.,"{service general, osoblje, positive}","{service general, osoblje, positive}"
+A usluga je jednostavno bila potrošena - pravi užitak.,"{service general, usluga, positive}","{service general, usluga, positive}"
+Ok ... – Možda sam ušao na nečiji loš dan ...,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Uzeo sam Meduza, Skuš, Plava perajna tuna i Sake Ikura rolada među ostalima, i svi su bili dobri.","{food quality, Plava perajna tuna, positive};{food quality, Sake Ikura rolada, positive};{food quality, Skuš, positive};{food quality, Meduza, positive}","{food quality, Meduza, Skuš, Plava perajna tuna, Sake Ikura rolada, positive}"
+ŠTO JOŠ MOŽETE REĆI LIJEPO LJUDI NEVJEROJATNO HRANA WOW,"{food quality, HRANA, positive};{service general, LJUDI, positive}","{food quality, HRANA, positive};{service general, LIJEPO LJUDI, positive}"
+Uvijek dobro.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Nakon toga su mi se usta jako osušila i imala sam taj potpis? MSG ? okus koji mi ostaje u grlu nakon što sam napustio restoran.,"{food quality, null, negative}","{food quality, null, negative}"
+O da ... pogled je također bio dobar.,"{location general, pogled, positive}","{food quality, null, positive};{location general, pogled, positive}"
+"upravitelj je stalno prekidao s `` Mogu li još nešto učiniti za vas? ``, čudan komentar jer jedva da je slušala, a kamoli odgovorila na naš izraz razočaranja našim iskustvom.","{service general, upravitelj, negative}","{service general, upravitelj, negative}"
+servis kreće se od osrednjeg do uvredljivog.,"{service general, servis, negative}","{service general, servis, negative}"
+Svježe sastojci i super ukusno.,"{food quality, sastojci, positive};{food quality, null, positive}","{food quality, sastojci, positive};{food quality, null, positive}"
+ambijent restorana bio je lijep i dobar za finu večeru.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive}"
+A gore je odlično mjesto za druženje.,"{ambience general, gore, positive}","{ambience general, mjesto, positive}"
+– Nije loše.,"{restaurant general, null, neutral}","{restaurant general, null, neutral}"
+Imao sam kafta tanjur i bio je savršen.,"{food quality, kafta tanjur, positive}","{food quality, kafta tanjur, positive}"
+– Ovo je mjesto poznato po doručak .,"{food quality, doručak, positive}","{food quality, doručak, positive}"
+Čekali smo 35 minuta na stol za 8 što je bilo u redu za tako veliku gužvu.,"{service general, null, neutral}","{service general, null, neutral}"
+Cjelokupno osoblje bilo je izuzetno susretljivo i zadovoljilo je svaku moju potrebu.,"{service general, osoblje, positive}","{service general, osoblje, positive}"
+"Mjesto je bilo jako lijepo vibra ... dobro glazba , atmosfera i sretnog izgleda ljudi .","{ambience general, vibra, positive};{ambience general, atmosfera, positive};{restaurant miscellaneous, ljudi, positive};{ambience general, glazba, positive}","{ambience general, sretnog izgleda ljudi, positive};{ambience general, atmosfera, positive};{ambience general, glazba, positive}"
+"Isprobajte Chefov izbor za sushi jer je dimljeni žuti rep bio nevjerojatan, a rolice također su bile ukusne.","{food quality, Chefov izbor za sushi, positive};{food quality, rolice, positive};{food quality, dimljeni žuti rep, positive}","{food quality, rolice, positive};{food quality, izbor za sushi, positive};{food quality, dimljeni žuti rep, positive}"
+"sushi je svjež kao što dolazi? pomislili biste da je ocean u njihovom dvorištu, bez šale!","{food quality, sushi, positive}","{food quality, sushi, positive}"
+"hrana je bila u redu, s malo-ukusnijom-od-normalnog salsa .","{food quality, salsa, positive};{food quality, hrana, positive}","{food quality, salsa, negative};{food quality, hrana, negative}"
+"Za izbirljive ljubitelje sushija i one koji su kušali najbolje što NYC može ponuditi, riba je najsvježija, a usluga vrhunska.","{service general, usluga, positive};{food quality, riba, positive}","{service general, usluga, positive};{food quality, sushija, positive};{food quality, riba, positive}"
+Stari Pouzdan,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Jedan od najboljih Sushi mjesto u gradu.,"{restaurant general, Sushi mjesto, positive}","{food quality, Sushi, positive}"
+"Hrana što se tiče hrane, u redu je, ali malo skupo za ono što dobijete s obzirom da restoran nije otmjeno mjesto.","{food quality, Hrana, neutral};{restaurant prices, restoran, negative};{ambience general, restoran, neutral}","{ambience general, restoran, neutral};{food quality, Hrana, neutral};{food prices, Hrana, negative}"
+"– Volim njihovu pizzu, posebno pizzu s gljivama.","{food quality, pizza, positive};{food quality, pizzu s gljivama, positive}","{food quality, pizzu, s gljivama, positive}"
+Došli su u vlastitoj otmjenoj kutiji za van i s domaćom glazurom; vrlo lagano i ne preslatko.,"{food quality, null, positive}","{food quality, glazurom, positive};{food style_options, glazurom, positive}"
+Uživao sam u hrana,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+Bio sam u ovom restoranu više od desetak puta bez pritužbi do danas.,"{restaurant general, restoranu, positive}","{restaurant general, restoranu, positive}"
+"Radije ga naručim i pokupi jer mi se ne sviđaju poslužitelji, posebno jedna mlada žena.","{service general, mlada žena, negative};{service general, poslužitelji, negative}","{service general, poslužitelji, negative}"
+strašan nalaz,"{restaurant general, null, positive}","{restaurant general, nalaz, negative}"
+"Nije bio najsvježiji plodovi mora ikada, ali okus i prezentacija bili su u redu.","{food quality, plodovi mora, neutral};{food style_options, plodovi mora, neutral}","{food quality, plodovi mora, neutral};{food style_options, plodovi mora, neutral}"
+"Međutim, vrijednost i usluga jako nedostaju.","{service general, usluga, negative};{restaurant prices, null, negative}","{service general, usluga, negative};{restaurant prices, null, negative}"
+U Grammercy/Union Square/East Village ovo su moji susjedi i moj favorit mjesto .,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"strana krumpira je za umrijeti, kao i labne (umak od jogurta).","{food quality, strana krumpira, positive};{food quality, labne (umak od jogurta, positive}","{food quality, strana krumpira, negative};{food quality, labne (umak od jogurta, negative}"
+NEVJEROJATNO .,"{restaurant general, null, positive}","{food quality, null, positive}"
+"Kakva ukusna, pahuljičasta poslastica!","{food quality, null, positive}","{food quality, poslastica, positive}"
+"Odlično hrana, bolje Margarite!","{drinks quality, Margarite, positive};{food quality, hrana, positive}","{drinks quality, Margarite, positive};{food quality, hrana, positive}"
+usluga je stvarno pažljiva i šarmantna.,"{service general, usluga, positive}","{service general, usluga, positive}"
+"Što je najvažnije, bili smo toliko uzbuđeni zbog hrane nakon što smo vidjeli vrlo kreativan jelovnik.","{food style_options, jelovnik, positive}","{food style_options, jelovnik, positive}"
+Udoban mjesto za 2,"{ambience general, mjesto, positive}","{ambience general, mjesto, positive}"
+Najbolja stvar je što su cijene također prilično razumne.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+"Obećala je da će razgovarati s konobaricom koja je odletjela u bijesu, ali teško da smo njezino obećanje mogli shvatiti ozbiljno, budući da se nije potrudila saznati ime konobarice.","{service general, null, negative}","{service general, null, negative}"
+chana masala (garbanzo grah) također je izvrstan.,"{food quality, chana masala (garbanzo grah, positive}","{food quality, chana masala (garbanzo, positive}"
+"Ovo ustanova je doista značajno opalo nakon (a to se ponavlja) emitiranja FOOD TELEVISIONS `` DINERS , DRIVE-INS AND DIVES `` čiji je domaćin bio Guy Fieri , u kojem je Schooner or Later bio predmet .","{restaurant general, ustanova, negative}","{restaurant miscellaneous, Schooner or Later, negative}"
+Volim Dungeness rakove i kod Raya ih možete poslužiti na otprilike 6 različitih načina!,"{food style_options, Dungeness rakove, positive}","{food style_options, Dungeness rakove, positive}"
+Hrana je bila dobra i ukusna.,"{food quality, Hrana, positive}","{food quality, Hrana, positive}"
+Bilo je apsolutno nevjerojatno.,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+Ovo je odlično mjesto za ukusan obrok .,"{food quality, obrok, positive}","{food quality, obrok, positive}"
+"plus, ja sam alergičan na rižu, a konobar je bio nevjerojatno susretljiv -- nisam ni trepnuo okom!","{service general, konobar, positive}","{service general, konobar, positive}"
+– Jako sam se razočarao hranom u Pagodi.,"{food quality, hranom, negative}","{food quality, hranom, negative}"
+Precijenjen,"{restaurant prices, null, negative}","{restaurant prices, null, negative}"
+Ovo je tužno zbog onoga što je nekoć bilo jedno od najboljih mjesta na kojima ste ikada mogli jesti.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"Kada uđete unutra, počinje pravo iskustvo.","{restaurant general, null, positive}","{ambience general, null, positive}"
+a konobar je predložio savršen sake ! !,"{drinks quality, sake, positive}","{drinks quality, sake, positive};{service general, konobar, positive}"
+vlasnik je ratoboran prema gostima koji imaju pritužbu.,"{service general, vlasnik, negative}","{service general, vlasnik, negative}"
+"Sve što želite i još više, vrlo svježe.","{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive}"
+Moj prijatelj je uživao u Aljaski kraljevski losos na žaru s ukusnim Washington russet krumpir u kremi i hrskavim zeleni grah .,"{food quality, zeleni grah, positive};{food quality, Aljaski kraljevski losos na žaru, positive};{food quality, Washington russet krumpir u kremi, positive}","{food quality, Aljaski kraljevski losos na žaru, positive};{food quality, Washington russet krumpir u kremi, positive};{food quality, zeleni grah, positive}"
+"hrana je bila vrlo dobra, file mignon je vjerojatno najbolja koju sam ikada probao.","{food quality, hrana, positive};{food quality, file mignon, positive}","{food quality, file mignon, positive};{food quality, hrana, positive}"
+"– Mercedesov restoran je tako ukusan, usluga je nedvojbeno sjajna!","{service general, usluga, positive};{food quality, null, positive}","{service general, usluga, positive};{food quality, Mercedesov restoran, positive}"
+Mogu toplo preporučiti njihove različite saag i paneer i korma .,"{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, saag, positive};{food quality, paneer i korma, positive}"
+hrana je sjajna i zli su Krvava Mary.,"{drinks quality, Krvava Mary, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{restaurant general, Krvava Mary, negative}"
+"Fino hrana, ali bez začina!","{food quality, hrana, positive};{food quality, hrana, negative}","{food quality, hrana, negative}"
+Još jedan plus je otvoren osjećaj restorana sa staklenim zidovima sa svih strana.,"{ambience general, osjećaj, positive}","{ambience general, restorana sa staklenim zidovima, positive}"
+Njam!,"{food quality, null, positive}","{restaurant general, null, negative}"
+"Sama kupaonica je vrlo mala s dva WC-a i samo jednim umivaonikom, djevojka je ostala potpuno usput vješajući papirnate ručnike iz automata.","{restaurant miscellaneous, kupaonica, negative}","{ambience general, kupaonica, negative}"
+Volite enchiladas i pileća juha - i svakako pogledajte njihove specijaliteti .,"{food quality, enchiladas, positive};{food quality, pileća juha, positive};{food quality, specijaliteti, positive}","{food quality, pileća juha, positive};{food quality, enchiladas, positive};{food quality, specijaliteti, positive}"
+hrana je jednostavno nezaboravna!,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+Menadžment bi stvarno trebao obratiti pozornost i trenirati svoje konobarstvo i naučiti ih nekim pravilnim manirima.,"{service general, konobarstvo, negative}","{service general, konobarstvo, negative}"
+"osoblje je ljubazno, a dekor je bio etičan i šaren.","{ambience general, dekor, positive};{service general, osoblje, positive}","{ambience general, dekor, positive};{service general, osoblje, positive}"
+Najbolji Chuwam Mushi koji sam ikada imao.,"{food quality, Chuwam Mushi, positive}","{food quality, Chuwam Mushi, positive}"
+"Porcije bilo je sasvim dovoljno za mene, ali možda nije za nekog ko jede puno.","{food style_options, Porcije, neutral}","{food style_options, Porcije, neutral}"
+Probajte Pizza Ensalata!,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza Ensalata, positive}"
+Ipak bih preporučio ovo mjesto.,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"– sushi ovdje je savršeno dobar, ali za 5 dolara po komadu, ili bi kriške ribe trebale biti veće ili se ne bi trebalo pretvarati da je ovo restoran umjerene cijene (čak i za NYC) .","{food prices, sushi, negative};{food style_options, sushi, negative};{food quality, sushi, positive};{restaurant prices, restoran, negative}","{food prices, null, negative};{food quality, sushi, positive}"
+Sigurno ćete se provesti vrlo šarmantno.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Od tada smo se vratili i također smo imali sjajno iskustvo, kušajući više malih tanjura i raznovrsno pivo (hladno i dobro).","{restaurant general, null, positive};{drinks quality, pivo, positive}","{food quality, pivo (hladno, positive};{food style_options, tanjura, positive};{restaurant general, null, positive}"
+Najbolji Sushi u gradu.,"{food quality, Sushi, positive}","{food quality, Sushi, positive}"
+osoblje bilo je vrlo lijepo i ljubazno i očito kinesko.,"{service general, osoblje, positive}","{service general, osoblje, positive}"
+"Naručili smo izbor malih tanjura, a luk na cipelama, pizza s kozjim sirom, šparoge na žaru i prženi brie s voćem svi su bili vrlo dobri.","{food quality, luk na cipelama, positive};{food quality, šparoge na žaru, positive};{food quality, pizza s kozjim sirom, positive};{food quality, prženi brie s voćem, positive}","{food quality, pizza s kozjim sirom, positive};{food quality, šparoge na žaru, positive};{food quality, prženi brie s voćem, positive};{food quality, izbor malih tanjura, positive};{food quality, luk na cipelama, positive}"
+Dobar posao!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Ipak, jedna stvar koju sam kasnije shvatio je da je restoran ili koristio MSG ili uređaj za omekšavanje mesa na odrezak.","{food quality, odrezak, negative}","{food quality, odrezak, negative}"
+Sjajno izbor sakea .,"{drinks style_options, izbor sakea, positive}","{drinks style_options, izbor sakea, positive}"
+Svaka čast ovim momcima.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Osim ako ne svraćate samo na nekoliko pića, ne bih preporučio da idete ovamo.","{restaurant general, null, negative}","{restaurant general, null, negative}"
+Sjajno boca vina .,"{drinks quality, boca vina, positive}","{drinks quality, boca vina, positive}"
+otvoreni kombinirani tanjur sa sezamom je povoljna cijena za hrpu hrane koja se daje.,"{food style_options, otvoreni kombinirani tanjur sa sezamom, positive};{food prices, otvoreni kombinirani tanjur sa sezamom, positive}","{food prices, otvoreni kombinirani tanjur sa sezamom, positive};{food style_options, otvoreni kombinirani tanjur sa sezamom, positive};{food quality, otvoreni kombinirani tanjur sa sezamom, positive}"
+PUNO PRECIJENJENO! ! ! !,"{restaurant general, null, negative}","{food style_options, null, negative}"
+Isplatilo se čekati,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Ne može biti bolje od toga.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+najbolje kozice od meda koje smo svi probali.,"{food quality, kozice od meda, positive}","{food quality, kozice od meda, positive}"
+Prikazani su na mreži hrane i to zaslužuju.,"{restaurant miscellaneous, null, positive}","{food quality, hrane, positive}"
+Volim toplo i ugodno okruženje .,"{ambience general, okruženje, positive}","{ambience general, okruženje, positive}"
+Šmrkavi stav,"{service general, null, negative}","{restaurant general, null, negative}"
+"atmosfera je ambiciozna, a dekor je svečana i nevjerojatna ...","{ambience general, dekor, positive};{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive};{ambience general, dekor, positive}"
+"Njihove specijalne rolice su impresivne, iako se ne sjećam što smo imali.","{food quality, specijalne rolice, positive}","{food quality, specijalne rolice, positive}"
+– Volio sam raviole od bundeve i njoke od kozjeg sira (5 velikih na tanjur umjesto 20-ak malih njoka) i moja sestra ju je obožavala filet mignon na vrh špinata i pire krumpir .,"{food quality, raviole od bundeve, positive};{food quality, filet mignon na vrh špinata i pire krumpir, positive};{food quality, njoke od kozjeg sira, positive};{food style_options, njoke od kozjeg sira, positive}","{food style_options, raviole od bundeve i njoke od kozjeg sira, positive};{food quality, filet mignon na vrh špinata i pire krumpir, positive}"
+"Nije najveći porcije, ali primjeren.","{food style_options, porcije, neutral}","{food style_options, null, neutral}"
+"Idite s prijateljima, pričekajte pola sata uz šalicu joea i uživajte više od svog prosjeka doručak.","{restaurant general, null, positive};{food quality, doručak, positive}","{restaurant miscellaneous, joea, positive};{food quality, doručak, positive}"
+super usluga .,"{service general, usluga, positive}","{service general, usluga, positive}"
+"Tada nam je naplaćen njihov najskuplji sake (20 dolara + po porciji), dok smo zapravo pili sake manji od pola te cijene.","{service general, null, negative}","{drinks prices, sake, negative};{drinks quality, sake, negative}"
+ukusno,"{food quality, null, positive}","{food quality, null, positive}"
+pileći curry i pileća tikka masala su moja omiljena jela od mesa.,"{food quality, pileći curry, positive};{food quality, pileća tikka masala, positive}","{food quality, pileći curry, positive};{food quality, pileća tikka masala, positive}"
+"najbolji restoran na svijetu, odličan dekor, odličan služba za korisnike, prijateljski upravitelj","{restaurant general, restoran, positive};{ambience general, dekor, positive};{service general, služba za korisnike, positive};{service general, upravitelj, positive}","{ambience general, dekor, positive};{restaurant general, null, positive};{service general, služba za korisnike, positive};{service general, upravitelj, positive}"
+pića su bila dobra.,"{drinks quality, pića, positive}","{drinks quality, pića, positive}"
+"Prezentacija hrane bila je dodatni bonus, izgledala je jednako dobro kao i okusa!","{food style_options, hrane, positive};{food quality, hrane, positive}","{food style_options, Prezentacija hrane, positive}"
+Čak ni tada narudžba nije bila točna i još smo čekali par stvari.,"{service general, null, negative}","{service general, null, negative}"
+– Ovdje su nas jednom vrlo grubo ponijeli za doručkom.,"{service general, null, negative}","{service general, null, negative}"
+"Sjajna hrana, spektakularna lokacija i ljubazna usluga tjeraju nas da se vraćamo iz godine u godinu.","{location general, lokacija, positive};{service general, usluga, positive};{food quality, hrana, positive}","{service general, usluga, positive};{location general, lokacija, positive};{food quality, hrana, positive}"
+WOW ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Uštedite sebi gubljenje vremena i NEMOJTE posjećivati .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Hrana je bila dobra i jeftina.,"{food quality, Hrana, positive};{food prices, Hrana, positive}","{food quality, Hrana, positive};{food prices, Hrana, positive}"
+Mmm ... dobro !,"{restaurant general, null, positive}","{food quality, null, positive}"
+Super je ako ste tamo proveli dan i niste se htjeli voziti da biste jeli.,"{location general, null, positive}","{restaurant miscellaneous, null, positive}"
+"Sve u svemu, moram reći da Ray's Boathouse zaslužuje svoju titulu institucije u Seattleu.","{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}"
+Izvrsna vrijednost sushi uz visoku kvalitetu i lijepo okruženje.,"{ambience general, okruženje, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{ambience general, okruženje, positive};{food quality, sushi, positive};{food prices, sushi, positive}"
+"Bilo je toliko puno da sam jedva uspio pojesti, ali jesam jer je bilo ukusno.","{food style_options, null, neutral};{food quality, null, positive}","{food quality, null, positive};{food style_options, null, negative}"
+Sviđa mi se ovo restoran,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}"
+Nije preporučljivo! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Stajali smo tamo 10 minuta dok su zaposlenici hodali naprijed-natrag ignorirajući nas.,"{service general, zaposlenici, negative}","{service general, zaposlenici, negative}"
+"Moj g/ž i ja smo se složili da je hrana vrlo osrednja, posebno s obzirom na cijenu.","{food quality, hrana, negative};{food prices, hrana, negative}","{food quality, hrana, negative};{food prices, hrana, negative}"
+"– hrana ovdje je nevjerojatna, iako je kvaliteta nedosljedna tijekom ručka .","{food quality, ručka, negative};{food quality, hrana, positive}","{food quality, hrana, negative};{food quality, hrana, positive}"
+Nemam ništa loše za reći o ovome mjesto.,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"jedini problem je što stvarno morate zagrijati pizzu prije nego što postane jestiva, čak i kada naručite unaprijed.","{food quality, pizzu, negative}","{food quality, pizza, negative}"
+– Ovo je moj `` koji moram dovesti goste iz grada u `` restoran i uvijek uživaju i oduševljeni su njime.,"{restaurant general, restoran, positive}","{restaurant general, `` restoran, positive}"
+Imao sam tanjur za kaftu i uživao sam u njemu.,"{food quality, tanjur za kaftu, positive}","{food quality, tanjur za kaftu, positive}"
+Bilo je jasno da mu nije stalo.,"{service general, null, negative}","{service general, null, negative}"
+Cezar salata koju sam naručio imala je toliko limuna da je nisam mogla pojesti.,"{food quality, Cezar salata, negative}","{food quality, Cezar salata, negative}"
+"Naš poslužitelj je nastavio biti pažljiv tijekom cijele noći, ali ostao sam zbunjen jednim pitanjem: Tko misli da je Ray's prikladno mjesto za odvođenje male djece na večeru?","{service general, poslužitelj, positive};{restaurant miscellaneous, Ray's, neutral}","{service general, poslužitelj, positive};{restaurant miscellaneous, Ray's, negative}"
+"Dobro Hrana, Odlično Usluga, Prosječne cijene (Za Strip)","{food quality, Hrana, positive};{restaurant prices, null, neutral};{service general, Usluga, positive}","{service general, Usluga, positive};{restaurant prices, null, neutral};{food quality, Hrana, positive}"
+18:00 u subotu prije predstave na Broadwayu i brzo smo sjeli i bili posluženi.,"{service general, null, positive}","{service general, null, positive}"
+"Oni posvećuju toliko detalja svemu, od miso juha do složenih peciva.","{food quality, miso juha, positive};{food quality, peciva, positive}","{food style_options, miso juha, positive};{food style_options, peciva, positive}"
+6 dolara s napojnicom.,"{restaurant prices, null, positive}","{food prices, null, negative}"
+atmosfera je bila sjajna.,"{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive}"
+"Drugim riječima, ako oni 'ne zarađuju $ $ na vama, onda nemate visoku ocjenu na njihovoj 'usluga ljestvici'.","{service general, usluga, negative}","{service general, usluga, negative}"
+– Stvarno sam uživao u obroku ovdje.,"{food quality, obroku, positive}","{food quality, obroku, positive}"
+"glazba svirala je vrlo moderno, 20-30 nešto pop glazba, ali subwoofer za zvučni sustav nalazio se ispod mog sjedala, što je postalo iritantno usred večere.","{ambience general, subwoofer za zvučni sustav, negative};{ambience general, glazba, positive}","{ambience general, glazba, negative};{ambience general, zvučni sustav, negative}"
+Sveto Humus!,"{food quality, Humus, positive}","{food quality, Humus, positive}"
+"Za moj ulaz & eacute ; e, potpuno sam uživao u prženim aljaškim morskim kapicama upotpunjenim blitvom, srcima artičoke, komoračem i pecorinom toscanom.","{food quality, prženim aljaškim morskim kapicama, positive};{food style_options, prženim aljaškim morskim kapicama, positive}","{food quality, prženim aljaškim morskim kapicama upotpunjenim blitvom, srcima artičoke, komoračem i pecorinom toscanom, positive}"
+"dekor je rustikalni, tradicionalni japanski.","{ambience general, dekor, neutral}","{ambience general, dekor, positive}"
+"Ne samo da izbor može biti inovativan, već postoji i lijepa ravnoteža tradicionalnog sushija.","{food style_options, sushija, positive};{food style_options, izbor, positive}","{food style_options, izbor, positive};{food quality, sushija, positive}"
+Vjerojatno ćete biti razočarani.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"hrana je sjajna, barmeni idu dalje.","{service general, barmeni, positive};{food quality, hrana, positive}","{drinks quality, barmeni, positive};{food quality, hrana, positive}"
+Restoran nudi opsežnu vinska karta i ambijent koji nećete zaboraviti!,"{drinks style_options, vinska karta, positive};{ambience general, ambijent, positive}","{ambience general, ambijent, positive};{drinks style_options, vinska karta, positive}"
+"naan je bio jedan od najboljih koje sam jeo i stvarno sam uživao u bhartha, ne previše rajčici.","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, bhartha, positive};{food quality, naan, positive}"
+Vlasnicima Open Sesame ... Bravo ... Jedva čekam vratiti se na ručak u vaš restoran!,"{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}"
+"riba je bila svježa, iako je bila izrezana vrlo tanko.","{food style_options, riba, negative};{food quality, riba, positive}","{food quality, riba, positive}"
+Bio sam tamo puno otad i uvijek se dobro provedem.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Moj favorit pizzerija u Seattleu,"{restaurant general, pizzerija, positive}","{restaurant general, pizzerija, positive}"
+toplo preporučujem ovo mjesto svima koji žele probati indain hrana po prvi put.,"{food quality, indain hrana, positive}","{food quality, indain hrana, positive}"
+Precijenjeno,"{restaurant general, null, negative}","{restaurant prices, null, negative}"
+Najgori usluga koji sam ikada imao,"{service general, usluga, positive}","{service general, usluga, negative}"
+"Ispostavilo se da je vlasnik sjedio tik do nas i kada je došao provjeriti naše probleme, bio je vrlo omalovažavajući i ponudio simboličnih 20% popusta na naš račun.","{service general, vlasnik, negative}","{service general, null, negative}"
+Otišao sam tamo s nekim prijateljima jedne večeri igrati bingo i gledati utakmicu soxa i bilo je fantastično!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+POTPUNO PRECIJENJENO!,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"– jaja , palačinke , krumpir , svježe voće i jogurt -- sve što poslužuju je ukusno.","{food quality, palačinke, positive};{food quality, jaja, positive};{food quality, krumpir, positive};{food quality, null, positive};{food quality, jogurt, positive};{food quality, svježe voće, positive}","{food quality, jaja, positive};{food quality, palačinke, positive};{food quality, krumpir, positive};{food quality, svježe voće, positive};{food quality, jogurt, positive}"
+– Ray's je mjesto za visoku kvalitetu večere s plodovima mora.,"{food quality, večere s plodovima mora, positive}","{food quality, večere s plodovima mora, positive}"
+Također stvarno uživam u jednostavnosti dekor i intimnosti osjećaj malog restorana.,"{ambience general, dekor, positive};{ambience general, osjećaj, positive}","{ambience general, dekor, positive};{ambience general, osjećaj, positive}"
+Vraćamo se nazad. :D,"{restaurant general, null, positive}","{restaurant general, null, negative}"
+"Trebao sam to spomenuti, ali nisam očekivao da će hrana biti tako blaga.","{food quality, hrana, negative}","{food quality, hrana, negative}"
+"Kad sam ušao, bio sam zatečen njihovim nevjerojatnim drveni dekor.","{ambience general, drveni dekor, positive}","{ambience general, drveni dekor, positive}"
+"Maleno je mjesto, pa ako stignete prije 20 sati vikendom (četvrtak? nedjelja), lakše ćete pronaći stol ili mjesto u sushi baru.","{restaurant miscellaneous, mjesto, neutral}","{restaurant miscellaneous, mjesto, positive}"
+Najbolje susjedstvo Standby .,"{restaurant general, Standby, positive}","{restaurant general, Standby, positive}"
+Vratio bih se tamo u tren oka.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Ima *vrlo * razumnu cijenu, posebno zbog kvalitete hrane.","{food prices, hrane, positive}","{food quality, hrane, positive};{food prices, hrane, positive}"
+"dosta hrane, vjeruj mi.","{food style_options, hrane, positive}","{food style_options, hrane, positive}"
+To je savršeno mjesto za romantični sastanak u dvoje ili tajni sastanak!,"{ambience general, mjesto, positive};{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+Također imajte odlične margarite!,"{drinks quality, margarite, positive}","{drinks quality, margarite, positive}"
+Nepretenciozno je i podzemno.,"{ambience general, null, positive}","{ambience general, null, positive}"
+Mjesto je sljedeća najbolja stvar u kuhanju moje mame.,"{food quality, null, positive}","{restaurant general, Mjesto, positive}"
+"Najbolje mjesto za opušteni nedjeljni doručak usred jahti, zatim prošećite obližnjom Farmer's Market.","{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+"Ako možete, dođite do ovog mjesta brodom i provedite cijelu večer.","{restaurant miscellaneous, mjesta, positive}","{restaurant miscellaneous, mjesta, positive}"
+za desert smo imali mango đumbir creme brulee ... oh la la yummy ! ! !,"{food quality, mango đumbir creme brulee, positive}","{food quality, desert, positive};{food quality, mango đumbir creme brulee, positive}"
+"Isplati se čekati, pogotovo jer će vas nazvati kad stol bude spreman.","{restaurant general, null, positive}","{service general, null, positive}"
+Imaju veliki izbor riba i čak navode iz kojih oceana dolaze; Atlantik ili Pacifik.,"{food style_options, riba, positive}","{food style_options, riba, positive}"
+Pa pretpostavljam da je teško sjediti kad si nevidljiv za osoblje.,"{service general, osoblje, negative}","{service general, osoblje, negative}"
+Izvrsno otvoren i prijateljski raspoložen ambijent.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive}"
+Kratak razgovor s upraviteljem na kraju obroka bio je najveće razočarenje - bilo bi malo reći da smo ``oduševljeni``.,"{service general, upraviteljem, negative}","{service general, upraviteljem, negative}"
+"Ray's je nešto poput ustanove u Seattleu, ali s obzirom na njegov prekrasan zvučni pogled, sumnjao sam da su pohvale više zbog krajolika nego zbog hrane i usluge.","{location general, zvučni pogled, positive}","{location general, zvučni pogled, positive};{restaurant general, Ray's, neutral}"
+Zakleo sam se da se nikad više neću vraćati po toplo pivo i osrednje jelo.,"{food quality, jelo, negative};{drinks quality, pivo, negative}","{drinks quality, toplo pivo, negative};{food quality, jelo, negative}"
+"Ako je vani lijepo, zatražite stol na balkon .","{ambience general, balkon, positive}","{location general, null, positive}"
+Sjajna hrana sa sjajnom atmosferom!,"{ambience general, atmosferom, positive};{food quality, hrana, positive}","{ambience general, atmosferom, positive};{food quality, hrana, positive}"
+Završio sam obrok s neobičnim desert s okusom porta i čokolade ... ukusno!,"{food quality, desert s okusom porta i čokolade, positive}","{food quality, desert s okusom porta i čokolade, positive}"
+Dobio sam predjelo od školjki i škampa i bilo je u redu.,"{food quality, predjelo od školjki i škampa, neutral}","{food quality, predjelo od školjki i škampa, neutral}"
+"pizze su tanke kore, a jelovnik nudi vrlo kreativne kombinacije i nadjeve.","{food style_options, pizze, positive};{food style_options, jelovnik, positive}","{food style_options, pizze, positive};{food style_options, jelovnik, positive}"
+To je sjajno mjesto za uživanje hrana i upoznavanje prijatelja.,"{restaurant miscellaneous, mjesto, positive};{food quality, hrana, positive}","{restaurant miscellaneous, mjesto, positive}"
+"usluga je bila izvrsna, kava je bila dobra čak i prema standardima Starbucksa, a hrana je bila izvanredna.","{service general, usluga, positive};{food quality, hrana, positive};{drinks quality, kava, positive}","{service general, usluga, positive};{food quality, hrana, positive};{drinks quality, kava, positive}"
+Ovo je mjesto za opuštanje i uživanje u najboljoj kvaliteti hrana koju industrija može ponuditi.,"{ambience general, mjesto, positive};{food quality, hrana, positive}","{food quality, hrana, positive}"
+Vratio bih se samo zbog vina iskustva.,"{drinks quality, vina, positive}","{drinks quality, vina iskustva, positive}"
+Najbolji lignje u Seattleu!,"{food quality, lignje, positive}","{food quality, lignje, positive}"
+Prezentacija Snooze je izvrsna i jedno je od onih mjesta na kojima se osjećate sofisticiranije samo zato što ste tamo; ali skinite slojeve i dobit ćete precijenjeni IHOP s visokim čelom izbornik .,"{restaurant prices, Snooze, negative};{food style_options, izbornik, negative};{ambience general, Snooze, positive}","{restaurant miscellaneous, Snooze, negative};{restaurant prices, Snooze, negative}"
+"Žalio sam se upravitelju, ali on se nije ni ispričao.","{service general, upravitelju, negative}","{service general, upravitelju, negative}"
+Mnogo više od samog sjajnog pogled!,"{location general, pogled, positive}","{location general, pogled, positive}"
+Atmosfera  je bila sasvim u redu.,"{ambience general, null, neutral}","{ambience general, Atmosfera, neutral}"
+Nakon sjedenja trebalo je oko 30 minuta da konačno dobijemo obrok.,"{service general, null, negative}","{service general, null, negative}"
+"– U doba povećanja troškova u restoranima, lijepo je vidjeti mjesto koje se protivi tom trendu i jednostavno pruža visoku kvalitetu hrana i dobru usluga, točka.","{service general, usluga, positive};{food quality, hrana, positive}","{service general, usluga, positive};{food quality, hrana, positive}"
+"Jako mi se svidjela atmosfera, ali hrana nije bila vrijedna te cijene.","{ambience general, atmosfera, positive};{food quality, hrana, negative};{food prices, hrana, negative}","{ambience general, atmosfera, positive};{food quality, hrana, negative};{food prices, hrana, negative}"
+"Nalazi se u trgovačkom centru u blizini Beverly Centera, nije najbolji lokacija, ali hrana me tjera da se vraćam po još.","{location general, lokacija, neutral};{food quality, hrana, positive}","{food quality, hrana, positive};{location general, null, negative}"
+"Na svom obroku morao sam vratiti svoja jaja zbog jednostavnog zahtjeva da razbijem jarmove prije kuhanja, i morao bih ih ponovno poslati da nisam odbio obrok svi zajedno .","{food quality, obroku, negative};{food quality, jaja, negative}","{food quality, jaja, negative};{food style_options, obrok, negative}"
+"bend je bio vrlo dobar, a usluga je bila pažljiva.","{ambience general, bend, positive};{service general, usluga, positive}","{service general, usluga, positive};{ambience general, bend, positive}"
+"– Kako opisati najbolji sushi u New Yorku: hmmmm, ukusan, nevjerojatan, fantastičan, sočan, savršen, ne, sve gore navedeno.","{food quality, sushi, positive}","{food quality, sushi, positive}"
+– Šarmantan lokacija uz marinu u Long Beachu i prosječan hrana Schoonera ili Latera nažalost ne nadoknađuju njegovu vrlo lošu korisnička služba.,"{service general, korisnička služba, negative};{food quality, hrana, neutral};{location general, lokacija uz marinu u Long Beachu, positive}","{location general, lokacija, positive};{food quality, hrana, neutral};{service general, korisnička služba, negative}"
+"Odmah smo sjeli, stol je bio privatan i lijep.","{ambience general, stol, positive}","{ambience general, stol, positive}"
+"dobro sake, dobro hrana – iskreno, uopće ne znam puno o japanskoj hrani.","{drinks quality, sake, positive};{food quality, hrana, positive}","{drinks quality, sake, positive};{food quality, hrana, positive}"
+Ponesite svoj mobitel jer ćete možda morati čekati da uđete u najbolji sushi restoran na svijetu: BLUE RIBBON SUSHI .,"{restaurant general, BLUE RIBBON SUSHI, positive}","{restaurant general, BLUE RIBBON SUSHI, positive}"
+"Na kraju je naš ček iznosio 27 dolara za 4 male palačinke, burrito za doručak, sok od naranče i ledeni čaj (imao sam vodu).","{food style_options, palačinke, negative};{food prices, burrito za doručak, negative};{drinks prices, sok od naranče, negative};{food prices, palačinke, negative};{drinks prices, ledeni čaj, negative}","{food prices, null, negative};{food style_options, palačinke, negative};{drinks prices, ledeni čaj, negative};{drinks style_options, sok od naranče, negative};{food style_options, burrito za doručak, negative}"
+Dobro hrana!,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+"catering nije na ovom svijetu, a Raouls pileća juha od povrća ljulja moj svijet! ! !","{food quality, Raouls pileća juha od povrća, positive};{food quality, catering, positive}","{food quality, pileća juha od povrća, positive};{food quality, catering, positive}"
+Trebao sam samo tražiti ček kad sam to vidio; ali njihov jelovnik bio je toliko jedinstven da sam nastavio .,"{food style_options, jelovnik, positive}","{food style_options, jelovnik, positive}"
+Sjajno doručak,"{food quality, doručak, positive}","{food quality, doručak, positive}"
+brancin na rižotu od jastoga bio je najbolji.,"{food quality, brancin na rižotu od jastoga, positive}","{food quality, brancin na rižotu od jastoga, positive}"
+– Atmosfera  izvrsna je za svaku posebnu prigodu koju želite proslaviti.,"{ambience general, null, positive}","{ambience general, Atmosfera, positive}"
+"Sjajno sezonska riba i plodovi mora, s otmjenom okruženje uz obalu .","{food quality, sezonska riba, positive};{food quality, plodovi mora, positive};{ambience general, okruženje uz obalu, positive}","{food quality, sezonska riba i plodovi mora, positive};{ambience general, okruženje uz obalu, positive}"
+"pizze nisu velike, a kora je tanka ... imajte to na umu kada naručujete.","{food style_options, pizze, neutral};{food style_options, kora, neutral}","{food style_options, pizze, negative};{food quality, kora, negative}"
+Jedina pozitivna stvar kod Mioposta je lijepa lokacija.,"{location general, lokacija, positive}","{location general, lokacija, positive}"
+Cijenim i njihovu dostavu.,"{service general, dostavu, positive}","{service general, dostavu, positive}"
+Jako razočaran.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+"pizza je ukusna, a salate su fantastične.","{food quality, pizza, positive};{food quality, salate, positive}","{food quality, pizza, positive};{food quality, salate, positive}"
+Najsvježije sushi – volim ovo restoran .,"{restaurant general, restoran, positive};{food quality, sushi, positive}","{food quality, sushi, positive}"
+odrezak je pečen baš po mojim željama (srednje pečen) i bio je lijep i sočan.,"{food quality, odrezak, positive}","{food quality, odrezak, positive};{food style_options, odrezak, positive}"
+"Ozbiljno, nećete pogriješiti ako tražite nepretencioznu lokalnu zabavu.","{ambience general, null, positive}","{ambience general, zabavu, positive}"
+"vlasnici su super zabavni, a izbor piva vrijedi ostati.","{service general, vlasnici, positive};{drinks style_options, izbor piva, positive}","{drinks style_options, izbor piva, positive};{service general, vlasnici, positive}"
+Sjajno točeno i izbor boca i pizza kamenje.,"{food quality, pizza, positive};{drinks style_options, točeno i izbor boca, positive}","{drinks style_options, izbor boca, positive};{food quality, pizza kamenje, positive};{service general, null, positive}"
+"Jamčim da se nećete razočarati, tu je i usluga parkiranja.","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, usluga, positive}"
+Kasnovečernja večera s izuzetnim hrana .,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+"porcije su ipak velike, pa nemojte naručivati previše.","{food style_options, porcije, neutral}","{food style_options, porcije, positive}"
+Definitivno ima jedan od najboljih jukebox koje sam vidio u dugo vremena.,"{ambience general, jukebox, positive}","{ambience general, jukebox, positive}"
+Usluga bila je pristojna.,"{service general, Usluga, neutral}","{service general, Usluga, neutral}"
+Apsolutno ukusno.,"{food quality, null, positive}","{food quality, null, positive}"
+"Oh, i krumpirići sa sirom su sjajni!","{food quality, krumpirići sa sirom, positive}","{food quality, krumpirići sa sirom, positive}"
+Svi koji su sjedili straga vani složili su se da je to najgora usluga koju smo ikada dobili.,"{service general, usluga, negative}","{service general, usluga, negative}"
+"Možda nisam guru za sushi, ali mogu vam reći da je hrana ovdje sasvim u redu i da nema puno više od toga.","{food quality, hrana, negative}","{food quality, hrana, neutral}"
+"Izvrsno hrana, lijepo ambijent, prilično skupo","{restaurant prices, null, negative};{ambience general, ambijent, positive};{food quality, hrana, positive}","{ambience general, ambijent, positive};{food quality, hrana, positive};{restaurant prices, null, negative}"
+"Tope se u ustima nigiri i sashmi , a i vrlo ukusni kiflice.","{food quality, kiflice, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}","{food quality, kiflice, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}"
+Napokon obrok koji ćete dugo pamtiti!,"{food quality, obrok, positive}","{food quality, obrok, positive}"
+"Najbolje hrana, fenomenalno usluga","{service general, usluga, positive};{food quality, hrana, positive}","{service general, usluga, positive};{food quality, hrana, positive}"
+Preporučam ga za noć kada se želite razbacivati! (bilo je malo skupo),"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}"
+"Iako je ova zalogajnica imala relativno dobru hranu, osoblje restorana se činilo potpuno ravnodušnim prema našoj prisutnosti, a takav se stav odrazio na nedostatak usluge.","{food quality, hranu, positive};{service general, osoblje restorana, negative}","{service general, osoblje, negative};{food quality, hranu, positive}"
+Bez usporedbe,"{restaurant general, null, positive}","{restaurant general, null, neutral}"
+"pa što se tiče kozice, bile su svježe i imale su laganu hrskavost u odnosu na tijesto ... takooo dobro ... orasi su narezani na manje komade i vrlo su hrskavi i ukusni.","{food quality, kozice, positive};{food quality, orasi, positive};{food quality, tijesto, positive}","{food quality, kozice, positive};{food quality, orasi, positive}"
+Tako sam sretan što imam prekrasan talijanski restoran u svom susjedstvu.,"{restaurant general, talijanski restoran, positive}","{restaurant general, talijanski restoran, positive}"
+Čekali smo sat vremena da sjednemo.,"{service general, null, negative}","{service general, null, negative}"
+"Naručili smo i iako smo naručili 4 predjela, hrana je stigla tek 45 minuta kasnije... UZ NAŠE GLAVNO JELO.","{service general, null, negative}","{service general, null, negative}"
+Jedva čekam da se ponovno vratim nadolazeći vikend!,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Ako ste zainteresirani za dobar okus (bez okusa i mirisa ribe), velika porcije i kreativna sushi jela ovo je vaše mjesto...","{food quality, null, positive};{food style_options, porcije, positive};{food style_options, sushi jela, positive}","{food quality, sushi jela, positive};{food style_options, velika porcije, positive};{food style_options, null, positive}"
+Savršeno mjesto za izvođenje gostiju iz grada u bilo koje doba godine.,"{restaurant general, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+Probao sam sva tri artikla na njoj tanjur i bili su izvrsni.,"{food quality, tanjur, positive}","{food quality, artikla na njoj tanjur, positive}"
+Dobro za večeru kasno u noć (planiranje u zadnji čas) bez rezervacije.,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+tamo nikad nisam razočaran hrana.,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+– Daleko najbolji bar u East Villageu ...,"{restaurant general, bar, positive}","{restaurant general, bar, positive}"
+To je sjajno mjesto za gledanje ljudi.,"{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}"
+"Prostor je bio ograničen, ali hrana je to nadoknadila.","{food quality, hrana, positive};{restaurant miscellaneous, Prostor, negative}","{food quality, hrana, positive};{ambience general, Prostor, negative}"
+Jakobove kapice se očito kuhaju na crnom maslinovom maslacu što ih zaista čini jedinstvenima (da ne spominjemo ukusnima).,"{food quality, Jakobove kapice, positive};{food style_options, Jakobove kapice, positive}","{food quality, Jakobove kapice, positive}"
+Ovo mjesto je šarmantno i opuštajuće.,"{ambience general, mjesto, positive}","{ambience general, mjesto, positive}"
+uopće nije za žvakanje.,"{food quality, null, positive}","{food quality, null, negative}"
+Bili smo u Seattleu samo jednu noć i tako mi je drago što smo odabrali Rays za večeru!,"{restaurant general, Rays, positive}","{restaurant general, Rays, positive}"
+"– Nikada neću zaboraviti nevjerojatan obrok, usluga i ambijent koji doživljavam u ovom restoranu.","{service general, usluga, positive};{ambience general, ambijent, positive};{food quality, obrok, positive}","{ambience general, ambijent, positive};{service general, usluga, positive};{food quality, obrok, positive}"
+Sjajno posebno predjelo od španjolske skuše i savršeno sushi u kutiji (to jegulja s avodcaom -- um um um ) .,"{food quality, sushi u kutiji, positive};{food quality, posebno predjelo od španjolske skuše, positive};{food quality, jegulja s avodcaom, positive}","{food quality, posebno predjelo od španjolske skuše, positive};{food quality, sushi u kutiji (to jegulja s avodcaom -- um um um, positive}"
+Vikendom ćete možda morati čekati nekoliko sati.,"{service general, null, neutral}","{service general, null, neutral}"
+"– hrana nije bila sjajna, a konobari su bili nepristojni.","{service general, konobari, negative};{food quality, hrana, negative}","{service general, konobari, negative};{food quality, hrana, negative}"
+"9 oz odrezak je došao sljedeći i imao je odličan okus, barem u početku.","{food quality, 9 oz odrezak, positive}","{food quality, odrezak, positive};{food style_options, odrezak, neutral}"
+"Kad sam stigao tamo, sjeo sam uz stepenice gdje je atmosfera bila ugodna, a usluga užasna!","{service general, usluga, negative};{ambience general, atmosfera, positive}","{service general, usluga, negative};{ambience general, atmosfera, positive}"
+"vinska karta je nevjerojatna, opsežna i raznolika, hrana je nevjerojatna, a osoblje je sve bilo jako lijepo, dobro u svom poslu i kulturno.","{service general, osoblje, positive};{drinks style_options, vinska karta, positive};{food quality, hrana, positive}","{drinks style_options, vinska karta, positive};{service general, osoblje, positive};{food quality, hrana, positive};{service general, null, positive}"
+– NE MOŽE BITI BOLJE! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Nedjeljom poslijepodne svira bend i jako je zabavno.,"{ambience general, bend, positive}","{ambience general, null, positive}"
+"Sve, a mislim sve na izborniku je preslatko.","{food quality, izborniku, positive}","{food quality, null, positive}"
+"Znam da mnogi ljudi imaju svoje omiljene vrste pizza i pizza mjesta, ali Mioposto pizza nema kvalitetu i dobar okus.","{food quality, pizza, negative}","{food quality, pizza, negative};{food quality, pizza, negative}"
+"Postoji samo jedno mjesto na istočnoj obali koje ima sve, plus puno više.","{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+Uvijek pobjednik.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Prethodne recenzije su rekle da su prilagođene djeci ... dajte mi odmor s dvoje male djece što je svjetlosna godina.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, positive}"
+pizze su lagane i ukusne.,"{food quality, pizze, positive}","{food quality, pizze, positive}"
+"Pogledajte umjetnost na zidovima, vrlo šarena!","{ambience general, umjetnost na zidovima, positive}","{ambience general, umjetnost na zidovima, positive}"
+Osrednji hrana,"{food quality, hrana, neutral}","{food quality, hrana, neutral}"
+Nikad se više neću vratiti.,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+Bilo nam je vrlo teško privući pozornost konobarice i konačno smo morali ustati i ući unutra razgovarati s upraviteljem.,"{service general, konobarice, negative}","{service general, konobarice, negative}"
+Nikad prevelika gužva i uvijek odlično usluga .,"{service general, usluga, positive};{restaurant miscellaneous, null, positive}","{service general, usluga, positive};{ambience general, gužva, negative}"
+ti si na vrućem spoju i on/ona ima potrebu za sushi ... onda bi ovo moglo biti pravo mjesto.,"{food quality, sushi, positive}","{restaurant miscellaneous, null, positive}"
+"– Ne mogu vjerovati Murphy's postoji više od 25 godina, nevjerojatno.","{restaurant miscellaneous, Murphy's, positive}","{restaurant general, Murphy's, positive}"
+"Možete biti zauzeti petkom za stolom, ali kada sjednete, usluga je toliko učinkovita da možete brzo ući i izaći.","{service general, usluga, positive}","{service general, usluga, positive}"
+"to? poslužuju se ili s umak od papra ili redukcija crnog vina, iako se oba nisu mogla razlikovati po okusu.","{food quality, redukcija crnog vina, neutral};{food quality, umak od papra, neutral}","{food quality, umak od papra, negative};{food quality, crnog vina, negative}"
+Najljepši konobari u gradu.,"{service general, konobari, positive}","{service general, konobari, positive}"
+usluga bila je ljubazna i pažljiva.,"{service general, usluga, positive}","{service general, usluga, positive}"
+"Dok sam ovo pisao, upravo sam ponovno pokušao dati link i još uvijek ne radi.","{restaurant miscellaneous, null, negative}","{service general, null, negative}"
+sve daljnje potrebe koje smo možda imali nisu mogle biti zadovoljene jer nitko nije stao pokraj stola.,"{service general, null, negative}","{service general, null, negative}"
+"Dobar Sushi, visoka cijena","{food quality, Sushi, positive};{food prices, Sushi, negative}","{food quality, Sushi, positive};{food prices, Sushi, negative}"
+Ali poslužitelji bili su iznimno pažljivi i vrlo prijateljski raspoloženi.,"{service general, poslužitelji, positive}","{service general, poslužitelji, positive}"
+"Bio sam na ovom mjesto, ljudi, i LOŠE je.","{restaurant general, mjesto, negative}","{restaurant general, ljudi, negative}"
+odlično usluga,"{service general, usluga, positive}","{service general, usluga, positive}"
+Bilo je to kao da jedete u potpuno drugom restoranu.,"{restaurant general, null, positive}","{ambience general, restoranu, negative}"
+Dva palca gore!,"{food quality, null, positive}","{restaurant general, null, positive}"
+Zamislite moje sretno iznenađenje kada sam otkrio da su pogledi tek treća najbolja stvar kod Rayovih!,"{restaurant general, Rayovih, positive};{location general, pogledi, positive}","{restaurant miscellaneous, Rayovih, positive}"
+"Ruku na srce, najbolji tuna koji sam ikada jeo.","{food quality, tuna, positive}","{food quality, tuna, positive}"
+"Ako idete vidjeti Dannyja Gansa ili samo odsjesti u Mirageu, ne propustite ovo.","{restaurant general, null, positive}","{restaurant miscellaneous, Mirageu, positive}"
+odlično mjesto za ručak,"{restaurant general, mjesto za ručak, positive}","{restaurant general, mjesto, positive}"
+Volim doručak ovdje.,"{food quality, doručak, positive}","{restaurant general, doručak, positive}"
+sashimi bio je najsvježiji i najnježniji koji sam ikada probao.,"{food quality, sashimi, positive}","{food quality, sashimi, positive}"
+Njihov jelovnik neće vas razočarati.,"{food style_options, jelovnik, positive}","{food style_options, jelovnik, positive}"
+"Mnogi ljudi govore o odličnoj pizza i lošoj usluga, tako da to ne mogu biti samo vrijeđanja nekoliko nezadovoljnih kupaca.","{food quality, pizza, positive};{service general, usluga, negative}","{food quality, pizza, positive};{service general, usluga, negative}"
+Neću se vratiti .,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+moja usluga bila je sjajna!,"{service general, usluga, positive}","{service general, usluga, positive}"
+sigurno se vraćamo u ovaj restoran .,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}"
+Sigurno će se vratiti.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Možda je dobro za onu jednu noć jednom za plavog mjeseca kada kuhari odluče upotrijebiti riba to je napola pristojno.,"{food quality, riba, negative}","{food quality, null, negative}"
+"– Bio sam na Open Sesame samo jednom, ali još uvijek se vrtim od iskustva! !","{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}"
+"palačinke su svakako bile inventivne, ali 8,50 $ za 3 - 6 `` palačinke (jedna od njih je bila više kao 5 ``) u letu palačinki (uzorak od 3 različite palačinke) je dobro precijenjen.","{food style_options, palačinke, positive};{food prices, palačinke, negative}","{food style_options, palačinki, negative};{food prices, palačinki, negative};{food style_options, letu palačinki, negative}"
+"MEĐUTIM, jednog nedjeljnog poslijepodneva suprug i ja smo ipak otišli (iako uz moje glasno negodovanje) i bili smo ugodno iznenađeni.","{restaurant general, null, positive}","{restaurant general, null, positive}"
+Itekako vrijedno toga,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Oprez - stvarna je hrana za ljude koji vole najbolje.,"{food quality, hrana, positive}","{food quality, hrana, positive}"
+"Imam, ali ovdje - u toaletu zahod je bila kupaonica, što je bilo čudno.","{restaurant miscellaneous, zahod, negative}","{ambience general, toaletu, negative}"
+Najbolje jelo su honwy kozice od oraha - jednostavno izvanredne.,"{food quality, honwy kozice od oraha, positive}","{food quality, honwy kozice od oraha, positive}"
+palačinke trebaju biti veće (najmanje 8 ``) kako bi opravdale trošak čak i uz jedinstvene ponude.,"{food style_options, palačinke, negative}","{food style_options, palačinke, negative};{food prices, palačinke, negative};{food quality, palačinke, positive}"
+– Prvi put sam večerao u ovom restoranu sa svojim sinom i bilo je apsolutno užasno!,"{restaurant general, restoranu, negative}","{restaurant general, restoranu, negative}"
+Izvrsno,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Parking je relativno dobar, imaju svoje parkiralište i možete parkirati u obližnjem parku.","{restaurant miscellaneous, null, positive}","{parking general, parkiralište, positive};{parking general, null, positive}"
+Cezar salata bila je izvrsna.,"{food quality, Cezar salata, positive}","{food quality, Cezar salata, positive}"
+"– Ne razumijem kako sam tako dugo bio stranac na ovom mjestu ... the fajita salata , the colorado , the fajitas - SVE je ukusno .","{food quality, colorado, positive};{food quality, fajita salata, positive};{food quality, fajitas, positive}","{food quality, the fajita salata, positive};{food quality, the colorado, positive};{food quality, the fajitas, positive}"
+najbolje kineska hrana koje sam probao u dugo vremena,"{food quality, kineska hrana, positive}","{food quality, kineska hrana, positive}"
+Cijena je također bila odgovarajuća.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+Ukusno...!,"{food quality, null, positive}","{food quality, null, positive}"
+Stavili smo ime i iako je bilo otvorenih stolova rečeno nam je da će biti potrebno čekati 30 minuta.,"{service general, null, negative}","{service general, null, negative}"
+kava je također vrlo dobra.,"{drinks quality, kava, positive}","{food quality, kava, positive}"
+"Na piće smo čekali više od 30 minuta, a na hranu više od 1 i 2 sata.","{service general, null, negative}","{service general, null, negative}"
+poslužitelji iza pulta uvijek su ljubazni i uslužni.,"{service general, poslužitelji iza pulta, positive}","{service general, poslužitelji iza pulta, positive}"
+"Naš konobar nije postojao i nakon što je naša hrana konačno stigla više od sat vremena nakon što smo naručili, nismo dobili vodu ni posuđe.","{service general, konobar, negative}","{service general, konobar, negative};{food quality, hrana, negative};{service general, null, negative}"
+– Ovo mjesto je nevjerojatno precijenjeno.,"{restaurant general, mjesto, negative}","{restaurant general, mjesto, negative}"
+Vrlo loše služba za korisnike .,"{service general, služba za korisnike, negative}","{service general, služba za korisnike, negative}"
+Ne možemo reći dovoljno o njihovim ukusnim gurmanima pizze!,"{food quality, pizze, positive}","{food quality, gurmanima pizze, positive}"
+"Nadalje, dok je riba nedvojbeno svježa, rolice obično su neobjašnjivo bljutave.","{food quality, rolice, negative};{food quality, riba, positive}","{food quality, rolice, negative};{food quality, riba, positive}"
+Jedina mana je gužva sjedenje i sporost usluga.,"{service general, usluga, negative};{restaurant miscellaneous, sjedenje, negative}","{service general, usluga, negative};{ambience general, sjedenje, negative}"
+"Nije ostalo puno mjesta za pušenje u New Yorku, ali pronašao sam svoju omiljenu pušaču balkon u gradu.","{restaurant miscellaneous, balkon, positive}","{ambience general, balkon, positive}"
+"Podijelili smo obiteljski pladanj, a ja sam posebno uživao u crni bakalar u sake kasu .","{food quality, crni bakalar u sake kasu, positive}","{food quality, crni bakalar u sake kasu, positive}"
+"Ali prostor je malen i lijep, a usluga je korisna.","{ambience general, prostor, positive};{service general, usluga, positive}","{service general, usluga, positive};{ambience general, prostor, positive}"
+Vrijedilo je čekati.,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+ukusan .,"{food quality, null, positive}","{food quality, null, positive}"
+Sladak,"{food quality, null, positive}","{food quality, null, positive}"
+- Osrednji Usluga / Kvaliteta,"{service general, Usluga, neutral}","{service general, Usluga, negative}"
+"– Ovo je jedno od mojih najboljih mjesta za ručak, ogromno porcije, brzo usluga i nevjerojatno margarite! !","{service general, usluga, positive};{drinks quality, margarite, positive};{restaurant general, null, positive};{food style_options, porcije, positive}","{service general, usluga, positive};{restaurant general, null, positive};{food style_options, porcije, positive};{drinks quality, margarite, positive}"
+Najbolji kolači od rakova u gradu,"{food quality, kolači od rakova, positive}","{food quality, kolači od rakova, positive}"
+"Sve što sam ovdje jeo je dobro, taco salate, burritos, enchilade volim ovo mjesto.","{food quality, taco salate, positive};{food quality, null, positive};{restaurant general, mjesto, positive};{food quality, burritos, positive};{food quality, enchilade, positive}","{food quality, taco salate, burritos, enchilade, positive}"
+"Odlično Pizza, Loše Usluga","{food quality, Pizza, positive};{service general, Usluga, negative}","{food quality, Pizza, positive};{service general, Usluga, negative}"
+sjajan,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Moja najbolja prijateljica jela pileća shawarma i JOŠ UVIJEK oduševljeno govori o tome da je najbolja posvuda!,"{food quality, pileća shawarma, positive}","{food quality, pileća shawarma, positive}"
+Chintzy porcije,"{food style_options, porcije, negative}","{food style_options, porcije, negative}"
+Dobro jede .,"{food quality, jede, positive}","{food quality, jede, positive}"
+"Obično vas na mjestima pitaju koliko vruće želite, ali nisu.","{service general, null, negative}","{service general, null, negative}"
+"Uvijek sam smatrao da je osoblje konobara i, ako sjedite za šankom, kuhari vrlo ljubazni.","{service general, kuhari, positive}","{service general, konobara, positive};{service general, kuhari, positive}"
+Ništa na izborniku nije manje nego nevjerojatno.,"{food quality, izborniku, positive}","{food quality, null, positive}"
+"Moja grupa od dvoje bila je posebno ambiciozna i razbacili smo se Shilshole Sampler ... prekrasnim izborom golemih bijelih zaljevskih kozica, dimljene bijele tune, Rayeve fantastične manila školjke začinjeno koprom, jakobovim kapicama u ukusnom sojinom preljevu i malenom hrpicom Dungeness rakova na vrhu uzvišenog umak od maslaca .","{food quality, umak od maslaca, positive};{food style_options, Shilshole Sampler, positive};{food style_options, bijelih zaljevskih kozica, positive};{food quality, manila školjke, positive};{food quality, sojinom preljevu, positive}","{food style_options, Shilshole Sampler, positive};{food style_options, null, positive}"
+"Bio sam iskreno šokiran kada sam pročitao loše kritike - ovo mjesto je fantastično; nije nas iznevjerio ni na koji način, a jeli smo ovdje više od 10 puta.","{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"Vaš obožavatelj sushi, volite stručno rezanu ribu, sjajnu sake, ubojitu SOHO lokacija i naravno: losos, tuna, metilj, žuti rep, bakalar, Skuša, žele riba, morski jež, škampi, jastog, orada, pastrva, mliječna riba, Tuna plave peraje, jegulja, rakovi, sardine, grdobine, ikra, jakobove kapice, kamenice i razne vrste Toro.","{food quality, sushi, positive};{location general, SOHO lokacija, positive};{food style_options, Toro, positive};{drinks quality, sake, positive};{food style_options, ribu, positive}","{food style_options, riba, positive};{food quality, sushi, positive};{drinks quality, sake, positive};{location general, SOHO lokacija, positive}"
+usluga je fantastična na ovom zabavnom mjestu .,"{restaurant general, mjestu, positive};{service general, usluga, positive}","{service general, usluga, positive};{ambience general, mjestu, positive}"
+"Također, bio je samo jedan kupaonska kabina - vjerojatno treba više za tako velike gužve.","{restaurant miscellaneous, kupaonska kabina, negative}","{ambience general, null, negative}"
+Otišli smo a da uopće nismo dobili usluga .,"{service general, usluga, negative}","{service general, usluga, negative}"
+Svidjelo mi se .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Toplo preporučujem Mioposto .,"{restaurant general, Mioposto, positive}","{restaurant general, Mioposto, positive}"
+"hrana je fantastična, autentična, ukusna i vrlo, vrlo pristupačna.","{food quality, hrana, positive};{food prices, hrana, positive}","{food quality, hrana, positive};{food prices, hrana, positive}"
+Ovdje sam jeo tri puta i utvrdio sam da su kvaliteta i raznolikost ribe izvrsni.,"{food quality, ribe, positive};{food style_options, ribe, positive}","{food quality, ribe, positive};{food style_options, ribe, positive}"
+"Ali ona je vrlo prijateljski nastrojena s nekim ljudima, što to čini još iritantnijim.","{service general, null, negative}","{service general, null, negative}"
+obični jelovnik ovdje je malo iznad prosjeka što nije vrijedno šmrkavog stava koji imate.,"{food quality, obični jelovnik, neutral};{service general, null, negative}","{food quality, obični jelovnik, positive}"
+"Također, poslužuju NAJBOLJE hummus u Americi, uz kapljicu mirisnog maslinovog ulja (što je, vjerujem, tradicionalan način)!","{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive}"
+odlično pivo,"{drinks quality, pivo, positive}","{drinks quality, pivo, positive}"
+Plodovi mora Plus,"{food quality, Plodovi mora, positive}","{food quality, Plodovi mora, positive}"
+"tužno je što nema puno ljudi koji često jedu na ovakvim mjestima koja izgledaju skupo jer su u hotelu ... ali su definitivno ona koja ne želite propustiti, pogotovo ako ste u centru San Josea.","{restaurant general, null, positive}","{restaurant general, null, positive}"
+"Poslužuju ga u visokoj, tankoj čaši u obliku pješčanog sata kako bi prikrili činjenicu da u supermarketu dobivate mali sok po cijeni od pola galona.","{drinks style_options, sok, negative};{drinks prices, sok, negative}","{food style_options, null, negative};{food style_options, čaši, negative}"
+"hrana je bila u redu, ali usluga je bila toliko loša da je hrana bila hladna, što je omogućilo da svi u mojoj grupi budu posluženi.","{service general, usluga, negative};{food quality, hrana, neutral}","{service general, usluga, negative};{food quality, hrana, negative}"
+odlično obrok – riba na pladnju s omikaseom bilo je apsolutno dekadentno -- nije bilo ništa od žilavosti koja ponekad prati pošteni sushi -- ova je riba bila savršena! ! ! !,"{food quality, riba na pladnju s omikaseom, positive};{food quality, obrok, positive}","{food quality, obrok, positive};{food quality, riba na pladnju s omikaseom, positive}"
+Pića su izvrsna i osjećam se kao da sam u zemlji Trećeg svijeta kad uđem na vrata.,"{drinks quality, Pića, positive};{ambience general, null, positive}","{drinks quality, Pića, positive}"
+Otvori i ohladi mjesto s najboljim pizza i kava,"{ambience general, mjesto, positive};{food quality, pizza, positive};{drinks quality, kava, positive}","{food quality, pizza, positive};{ambience general, mjesto, positive};{drinks quality, kava, positive}"
+Creme brulee od zelenog čaja je obavezan!,"{food quality, Creme brulee od zelenog čaja, positive}","{food quality, Creme brulee od zelenog čaja, positive}"
+Našao sam novi dom i upravo sam se preselio s dugotrajnim najmom.,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+"Nisu najpričljiviji, ali svaki put kad sam bio tamo bili su jako zaposleni, što je vjerojatno razlog za nedostatak razgovora.","{service general, null, neutral}","{service general, null, neutral}"
+"Sama pizza nije baš najbolja koju sam IKAD jeo, ali je ipak prilično dobra.","{food quality, pizza, positive}","{food quality, pizza, neutral}"
+"Imali smo isto konobar drugi put, pa je možda usluga manjkava i naša sreća.","{service general, konobar, positive}","{service general, usluga, negative}"
+– To je velika izjava s obzirom na to da izvlačim zamke za rakove i izrađujem kolače sam od svoje sedme godine - ali nešto u vezi s ovim malim vragovima svaki put postaje bolje.,"{food quality, kolače, positive}","{restaurant general, null, positive}"
+Sjajno talijanska hrana!,"{food quality, talijanska hrana, positive}","{food quality, talijanska hrana, positive}"
+"Međutim, ovo mjesto je dragulj i neću se prestati vraćati.","{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+"postaje jako prometno, stoga dođite ranije kako biste mogli zgrabiti mjesto, ako morate čekati, nije loše jer usluga je brza!","{service general, usluga, positive}","{restaurant miscellaneous, null, neutral};{service general, usluga, positive}"
+"Za večeru nam je trebalo samo oko sat vremena, a cijene su bile u redu za strip, gotovo 50 dolara po osobi nakon poreza i napojnice (otprilike prosjek).","{restaurant prices, null, neutral}","{restaurant prices, null, neutral};{service general, null, positive}"
+kolutiće luka su odlični!,"{food quality, kolutiće luka, positive}","{food quality, kolutiće luka, positive}"
+"Ako ste u blizini, ne biste trebali biti razočarani.","{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Velika financijska četvrt meksičko mjesto .,"{restaurant general, meksičko mjesto, positive}","{restaurant prices, meksičko mjesto, negative}"
+posebna rola za kuću je stvarno dobra.,"{food quality, posebna rola za kuću, positive}","{food quality, posebna rola za kuću, positive}"
+konobari vrlo su iskusni i od pomoći pri uparivanju vašeg izbora pića s vašim ukusom hrane ili obrnuto.,"{service general, konobari, positive}","{service general, konobari, positive}"
+Savršenstvo .,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Loše služba za korisnike / loše pizza .,"{food quality, pizza, negative};{service general, služba za korisnike, negative}","{service general, služba za korisnike, negative};{food quality, pizza, negative}"
+"Sve u svemu, vratio bih se i ponovno jeo u restoranu.","{restaurant general, restoranu, positive}","{restaurant general, restoranu, positive}"
+Poslužitelj dao je nekoliko sake prijedloga koji su bili vrlo dobri.,"{drinks quality, sake, positive};{service general, Poslužitelj, positive}","{service general, null, positive}"
+Moj jedini negativan komentar je da bih volio da su komadi malo veći.,"{food style_options, komadi, negative}","{food style_options, komadi, negative}"
+Ubrao sam šparoge koje su se pokazale nevjerojatno i savršeno pripremljene.,"{food quality, šparoge, positive}","{food quality, šparoge, positive}"
+Ono što bi većini moglo biti zanimljivo je da najgora usluga/stav dolazi od vlasnika ovog objekta.,"{service general, vlasnika, negative}","{service general, usluga/stav, negative}"
+"Jedina mana je što je ovo mjesto stvarno skupo, a porcije su male.","{restaurant prices, mjesto, negative};{food style_options, porcije, negative}","{restaurant prices, mjesto, negative};{food style_options, porcije, negative}"
+"Užasno usluga, hrana ok, skupo","{service general, usluga, negative};{restaurant prices, null, negative};{food quality, hrana, neutral}","{service general, usluga, negative};{food quality, hrana, neutral};{food prices, hrana, negative}"
+Iako bi se usluga mogla poboljšati s obzirom na novac koji ste uložili.,"{service general, usluga, negative}","{service general, usluga, negative}"
+"Redovito vidite indijske obitelji i prijatelje kako tamo ručaju, što je uvijek dobar znak.","{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+"Ako želim stajati u redu u nedjelju sat vremena kako bih dobio prosječnu hranu hrana za užinu, onda bih stavio Murphy's na vrh popisa.","{service general, null, negative};{food quality, hrana za užinu, neutral}","{restaurant general, Murphy's, positive};{food quality, hrana, neutral}"
+Za količinu hrane koju smo dobili cijene su trebale biti niže.,"{food prices, hrane, negative}","{restaurant prices, null, negative}"
+"Uvijek zauzeti, ali su dobri u tome da vas brzo smjeste i imaju brzu uslugu.","{service general, uslugu, positive};{service general, null, positive}","{service general, uslugu, positive};{restaurant miscellaneous, null, positive}"
+"vinska karta je prekrasna, a hrana me podsjeća na moje nedavno putovanje u Italiju.","{drinks style_options, vinska karta, positive}","{drinks style_options, vinska karta, positive};{food quality, hrana, positive}"
+"hrana je bila odlična, margarite također, ali konobarica je bila previše zauzeta ljubaznošću prema svojoj drugoj većoj grupi nego da bi se bolje brinula o mojoj prijateljici i meni.","{drinks quality, margarite, positive};{service general, konobarica, negative};{food quality, hrana, positive}","{service general, konobarica, negative};{food quality, hrana, positive};{drinks quality, margarite, positive}"
+Ne mogu reći dovoljno dobrih stvari o ovom restoran i jedva čekam sljedećih nekoliko posjeta.,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}"
+Volim svaki put,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+Mi smo mještani i imamo osjećaj da je jedini način na koji ovo mjesto preživljava s takvim prosjekom hrana taj što su većina gostiju vjerojatno samo jednokratni gosti.,"{food quality, hrana, negative}","{restaurant miscellaneous, mjesto, negative};{food quality, hrana, negative}"
+Također volim njihovu cezer salata .,"{food quality, cezer salata, positive}","{food quality, cezer salata, positive}"
+Ne čini da se osjećate dobrodošli i tretira vas kao gnjavatora.,"{service general, null, negative}","{service general, null, negative}"
+Upravo je prave veličine za jelovnik.,"{restaurant miscellaneous, null, positive}","{food style_options, jelovnik, positive}"
+"hrana je fantastična, a osoblje bilo je savršeno svaki put kad smo bili tamo.","{service general, osoblje, positive};{food quality, hrana, positive}","{service general, osoblje, positive};{food quality, hrana, positive}"
+pustinja bio je savršen završetak gotovo savršene večere.,"{food quality, večere, positive};{food quality, pustinja, positive}","{food quality, pustinja, positive}"
+"Bio sam ovdje, potrošio sam hrpu novca na posebnu večeru kuhara i bilo je to veliko razočaranje.","{food prices, posebnu večeru kuhara, negative};{food quality, posebnu večeru kuhara, negative}","{food quality, posebnu večeru kuhara, negative};{food prices, posebnu večeru kuhara, negative}"
+PRONAŠAO SAM NOVI DOM NA DRUGOJ AVENIJI! ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, NOVI DOM, positive}"
+"– Morao sam čekati trideset minuta da uđem na vrata u utorak ujutro, ali bilo je vrijedno toga.","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive}"
+"– Tužno je vidjeti mjesto koje je nekoć bilo `` ONO `` mjesto za sastajanje i jelo za post ili ručak, a sada budi mjesto koje je veliko `` NE SMIRAJ SE . ``","{restaurant general, mjesto, negative}","{restaurant general, mjesto, negative}"
+"piletina s limunom imala je okus poput ljepljivih slatkih krafni, a kozice s medom i orahom, ono malo što vam zapravo daju... nije bilo dobro.","{food quality, piletina s limunom, negative};{food quality, kozice s medom i orahom, negative};{food style_options, kozice s medom i orahom, negative}","{food quality, piletina s limunom, negative};{food quality, kozice s medom i orahom, negative}"
+"Bilo je romantično - pa čak i lijepo čak i s mojom sestrom, podsjetilo me na Italiju i imalo je umjetničko djelo i glazbu koje su održavale osjećaj da se nalazim u mediteranskoj vili.","{ambience general, null, positive};{ambience general, glazbu, positive};{ambience general, umjetničko djelo, positive}","{ambience general, null, positive}"
+"sushi je bio odličan, a posluga je bila brza.","{service general, posluga, positive};{food quality, sushi, positive}","{service general, posluga, positive};{food quality, sushi, positive}"
+"Zapravo, mnogi se žele vratiti i drugi put tijekom svog posjeta.","{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Najbolje meksičko mjesto za ručak u financijskoj četvrti.,"{restaurant general, meksičko mjesto, positive}","{restaurant general, meksičko mjesto, positive}"
+volim ovo mjesto!,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}"
+atmosfera je sjajna.,"{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive}"
+Savršen za hladan dan.,"{food quality, null, positive}","{restaurant miscellaneous, null, positive}"