Upload folder using huggingface_hub

.gitattributes

@@ -60,3 +60,6 @@ experiments/de-vi/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -t
 experiments/hr-zh/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 experiments/hr-zh/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 experiments/hr-zh/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/sk-zh/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/sk-zh/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+experiments/sk-zh/checkpoint-790/tokenizer.json filter=lfs diff=lfs merge=lfs -text

experiments/sk-zh/README.md

@@ -0,0 +1,59 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: transformers
+model_name: sk-zh
+tags:
+- generated_from_trainer
+- unsloth
+- sft
+- trl
+licence: license
+---
+
+# Model Card for sk-zh
+
+This model is a fine-tuned version of [unsloth/meta-llama-3.1-8b-instruct-bnb-4bit](https://huggingface.co/unsloth/meta-llama-3.1-8b-instruct-bnb-4bit).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="None", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+ 
+
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.22.2
+- Transformers: 4.56.0
+- Pytorch: 2.8.0+cu129
+- Datasets: 4.3.0
+- Tokenizers: 0.22.0
+
+## Citations
+
+
+
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

experiments/sk-zh/adapter/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/sk-zh/adapter/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/sk-zh/adapter/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73dd837e8d5423f555cb01ee894f1b2af1f113d7a971d4ffe4546f388f6737ad
+size 83945296

experiments/sk-zh/adapter/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/sk-zh/adapter/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/sk-zh/adapter/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/sk-zh/adapter/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "left",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/sk-zh/checkpoint-500/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/sk-zh/checkpoint-500/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/sk-zh/checkpoint-500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:862cad99c2bb9cea67e5e8369bf51e41e12409306ac431aabab75877e7f7dd4b
+size 83945296

experiments/sk-zh/checkpoint-500/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/sk-zh/checkpoint-500/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b71854186c8ad4ccfb86dd2d9d405a46d989f2f6e1064505597b89ce50af40a
+size 43123429

experiments/sk-zh/checkpoint-500/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6d8fafcd1ee268414be5acf0366296af5b03d60871978712eac1979cb42d65
+size 14645

experiments/sk-zh/checkpoint-500/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f58070f27ecc1447cda3df381e75b78a82815c8dd68eab34fe5e56c98549f266
+size 1465

experiments/sk-zh/checkpoint-500/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/sk-zh/checkpoint-500/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/sk-zh/checkpoint-500/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/sk-zh/checkpoint-500/trainer_state.json

@@ -0,0 +1,734 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 3.1645569620253164,
+  "eval_steps": 500,
+  "global_step": 500,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03164556962025317,
+      "grad_norm": 9.636250495910645,
+      "learning_rate": 0.0002,
+      "loss": 2.7406,
+      "step": 5
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 1.6461654901504517,
+      "learning_rate": 0.00019872773536895675,
+      "loss": 0.9506,
+      "step": 10
+    },
+    {
+      "epoch": 0.0949367088607595,
+      "grad_norm": 1.761650562286377,
+      "learning_rate": 0.00019745547073791352,
+      "loss": 0.6273,
+      "step": 15
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 0.9863831400871277,
+      "learning_rate": 0.00019618320610687023,
+      "loss": 0.6092,
+      "step": 20
+    },
+    {
+      "epoch": 0.15822784810126583,
+      "grad_norm": 1.2868099212646484,
+      "learning_rate": 0.00019491094147582698,
+      "loss": 0.6429,
+      "step": 25
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 1.0715737342834473,
+      "learning_rate": 0.00019363867684478372,
+      "loss": 0.5648,
+      "step": 30
+    },
+    {
+      "epoch": 0.22151898734177214,
+      "grad_norm": 1.0320993661880493,
+      "learning_rate": 0.00019236641221374049,
+      "loss": 0.5792,
+      "step": 35
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 0.9238957762718201,
+      "learning_rate": 0.00019109414758269723,
+      "loss": 0.4947,
+      "step": 40
+    },
+    {
+      "epoch": 0.2848101265822785,
+      "grad_norm": 1.0267781019210815,
+      "learning_rate": 0.00018982188295165394,
+      "loss": 0.5085,
+      "step": 45
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 0.9670472145080566,
+      "learning_rate": 0.00018854961832061068,
+      "loss": 0.5587,
+      "step": 50
+    },
+    {
+      "epoch": 0.34810126582278483,
+      "grad_norm": 1.065898060798645,
+      "learning_rate": 0.00018727735368956745,
+      "loss": 0.5423,
+      "step": 55
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 1.0073872804641724,
+      "learning_rate": 0.0001860050890585242,
+      "loss": 0.5977,
+      "step": 60
+    },
+    {
+      "epoch": 0.41139240506329117,
+      "grad_norm": 0.9359777569770813,
+      "learning_rate": 0.00018473282442748093,
+      "loss": 0.4922,
+      "step": 65
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 1.3410602807998657,
+      "learning_rate": 0.00018346055979643765,
+      "loss": 0.5653,
+      "step": 70
+    },
+    {
+      "epoch": 0.47468354430379744,
+      "grad_norm": 0.8348254561424255,
+      "learning_rate": 0.00018218829516539442,
+      "loss": 0.5515,
+      "step": 75
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 0.9806696176528931,
+      "learning_rate": 0.00018091603053435116,
+      "loss": 0.548,
+      "step": 80
+    },
+    {
+      "epoch": 0.5379746835443038,
+      "grad_norm": 0.8727517127990723,
+      "learning_rate": 0.0001796437659033079,
+      "loss": 0.5175,
+      "step": 85
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.8037821054458618,
+      "learning_rate": 0.00017837150127226464,
+      "loss": 0.5135,
+      "step": 90
+    },
+    {
+      "epoch": 0.6012658227848101,
+      "grad_norm": 0.7310634851455688,
+      "learning_rate": 0.00017709923664122138,
+      "loss": 0.4609,
+      "step": 95
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 1.0002307891845703,
+      "learning_rate": 0.00017582697201017812,
+      "loss": 0.5671,
+      "step": 100
+    },
+    {
+      "epoch": 0.6645569620253164,
+      "grad_norm": 0.7429682612419128,
+      "learning_rate": 0.00017455470737913486,
+      "loss": 0.5205,
+      "step": 105
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.7771511673927307,
+      "learning_rate": 0.00017328244274809163,
+      "loss": 0.5279,
+      "step": 110
+    },
+    {
+      "epoch": 0.7278481012658228,
+      "grad_norm": 0.6377614140510559,
+      "learning_rate": 0.00017201017811704835,
+      "loss": 0.4976,
+      "step": 115
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.9541120529174805,
+      "learning_rate": 0.0001707379134860051,
+      "loss": 0.5249,
+      "step": 120
+    },
+    {
+      "epoch": 0.7911392405063291,
+      "grad_norm": 0.8480327725410461,
+      "learning_rate": 0.00016946564885496183,
+      "loss": 0.4799,
+      "step": 125
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.7675257325172424,
+      "learning_rate": 0.0001681933842239186,
+      "loss": 0.4845,
+      "step": 130
+    },
+    {
+      "epoch": 0.8544303797468354,
+      "grad_norm": 0.8189133405685425,
+      "learning_rate": 0.00016692111959287534,
+      "loss": 0.4981,
+      "step": 135
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.8288174867630005,
+      "learning_rate": 0.00016564885496183205,
+      "loss": 0.4781,
+      "step": 140
+    },
+    {
+      "epoch": 0.9177215189873418,
+      "grad_norm": 0.7553529739379883,
+      "learning_rate": 0.0001643765903307888,
+      "loss": 0.538,
+      "step": 145
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.7369087338447571,
+      "learning_rate": 0.00016310432569974556,
+      "loss": 0.5297,
+      "step": 150
+    },
+    {
+      "epoch": 0.9810126582278481,
+      "grad_norm": 0.745081901550293,
+      "learning_rate": 0.0001618320610687023,
+      "loss": 0.529,
+      "step": 155
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.760235071182251,
+      "learning_rate": 0.00016055979643765905,
+      "loss": 0.5206,
+      "step": 160
+    },
+    {
+      "epoch": 1.0443037974683544,
+      "grad_norm": 0.6101222038269043,
+      "learning_rate": 0.0001592875318066158,
+      "loss": 0.3851,
+      "step": 165
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.7095821499824524,
+      "learning_rate": 0.00015801526717557253,
+      "loss": 0.419,
+      "step": 170
+    },
+    {
+      "epoch": 1.1075949367088607,
+      "grad_norm": 0.8603990077972412,
+      "learning_rate": 0.00015674300254452927,
+      "loss": 0.4204,
+      "step": 175
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.7504400014877319,
+      "learning_rate": 0.000155470737913486,
+      "loss": 0.367,
+      "step": 180
+    },
+    {
+      "epoch": 1.1708860759493671,
+      "grad_norm": 0.756787121295929,
+      "learning_rate": 0.00015419847328244275,
+      "loss": 0.393,
+      "step": 185
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.8656795620918274,
+      "learning_rate": 0.0001529262086513995,
+      "loss": 0.4357,
+      "step": 190
+    },
+    {
+      "epoch": 1.2341772151898733,
+      "grad_norm": 0.8514489531517029,
+      "learning_rate": 0.00015165394402035624,
+      "loss": 0.4215,
+      "step": 195
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7526264190673828,
+      "learning_rate": 0.00015038167938931298,
+      "loss": 0.3651,
+      "step": 200
+    },
+    {
+      "epoch": 1.2974683544303798,
+      "grad_norm": 0.7162966132164001,
+      "learning_rate": 0.00014910941475826972,
+      "loss": 0.4073,
+      "step": 205
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 0.9087608456611633,
+      "learning_rate": 0.0001478371501272265,
+      "loss": 0.4026,
+      "step": 210
+    },
+    {
+      "epoch": 1.360759493670886,
+      "grad_norm": 0.7543425559997559,
+      "learning_rate": 0.0001465648854961832,
+      "loss": 0.3645,
+      "step": 215
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.740563154220581,
+      "learning_rate": 0.00014529262086513994,
+      "loss": 0.4309,
+      "step": 220
+    },
+    {
+      "epoch": 1.4240506329113924,
+      "grad_norm": 0.7612570524215698,
+      "learning_rate": 0.0001440203562340967,
+      "loss": 0.3908,
+      "step": 225
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.9129316806793213,
+      "learning_rate": 0.00014274809160305345,
+      "loss": 0.422,
+      "step": 230
+    },
+    {
+      "epoch": 1.4873417721518987,
+      "grad_norm": 0.8029764890670776,
+      "learning_rate": 0.0001414758269720102,
+      "loss": 0.3866,
+      "step": 235
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 0.7712852954864502,
+      "learning_rate": 0.0001402035623409669,
+      "loss": 0.4168,
+      "step": 240
+    },
+    {
+      "epoch": 1.5506329113924051,
+      "grad_norm": 0.8392740488052368,
+      "learning_rate": 0.00013893129770992368,
+      "loss": 0.4102,
+      "step": 245
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 0.9574406743049622,
+      "learning_rate": 0.00013765903307888042,
+      "loss": 0.4312,
+      "step": 250
+    },
+    {
+      "epoch": 1.6139240506329116,
+      "grad_norm": 0.8071485757827759,
+      "learning_rate": 0.00013638676844783716,
+      "loss": 0.4148,
+      "step": 255
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.9748886227607727,
+      "learning_rate": 0.0001351145038167939,
+      "loss": 0.3916,
+      "step": 260
+    },
+    {
+      "epoch": 1.6772151898734178,
+      "grad_norm": 0.8215563893318176,
+      "learning_rate": 0.00013384223918575064,
+      "loss": 0.4227,
+      "step": 265
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.8115125894546509,
+      "learning_rate": 0.00013256997455470738,
+      "loss": 0.351,
+      "step": 270
+    },
+    {
+      "epoch": 1.740506329113924,
+      "grad_norm": 0.7755597233772278,
+      "learning_rate": 0.00013129770992366413,
+      "loss": 0.3745,
+      "step": 275
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 0.9101290106773376,
+      "learning_rate": 0.00013002544529262087,
+      "loss": 0.4006,
+      "step": 280
+    },
+    {
+      "epoch": 1.8037974683544302,
+      "grad_norm": 0.9382388591766357,
+      "learning_rate": 0.0001287531806615776,
+      "loss": 0.4191,
+      "step": 285
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 0.945472002029419,
+      "learning_rate": 0.00012748091603053435,
+      "loss": 0.4278,
+      "step": 290
+    },
+    {
+      "epoch": 1.8670886075949367,
+      "grad_norm": 0.8501671552658081,
+      "learning_rate": 0.0001262086513994911,
+      "loss": 0.3932,
+      "step": 295
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 0.9624788761138916,
+      "learning_rate": 0.00012493638676844783,
+      "loss": 0.38,
+      "step": 300
+    },
+    {
+      "epoch": 1.9303797468354431,
+      "grad_norm": 0.8801245093345642,
+      "learning_rate": 0.0001236641221374046,
+      "loss": 0.4113,
+      "step": 305
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.851109504699707,
+      "learning_rate": 0.00012239185750636134,
+      "loss": 0.4172,
+      "step": 310
+    },
+    {
+      "epoch": 1.9936708860759493,
+      "grad_norm": 0.8253706097602844,
+      "learning_rate": 0.00012111959287531807,
+      "loss": 0.3971,
+      "step": 315
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.6801413297653198,
+      "learning_rate": 0.00011984732824427483,
+      "loss": 0.333,
+      "step": 320
+    },
+    {
+      "epoch": 2.0569620253164556,
+      "grad_norm": 0.9851354956626892,
+      "learning_rate": 0.00011857506361323157,
+      "loss": 0.2744,
+      "step": 325
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.9322072863578796,
+      "learning_rate": 0.0001173027989821883,
+      "loss": 0.2749,
+      "step": 330
+    },
+    {
+      "epoch": 2.1202531645569622,
+      "grad_norm": 0.7314637899398804,
+      "learning_rate": 0.00011603053435114504,
+      "loss": 0.2624,
+      "step": 335
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 1.0124112367630005,
+      "learning_rate": 0.00011475826972010179,
+      "loss": 0.2748,
+      "step": 340
+    },
+    {
+      "epoch": 2.1835443037974684,
+      "grad_norm": 1.046563982963562,
+      "learning_rate": 0.00011348600508905853,
+      "loss": 0.3032,
+      "step": 345
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 0.7314551472663879,
+      "learning_rate": 0.00011221374045801527,
+      "loss": 0.2785,
+      "step": 350
+    },
+    {
+      "epoch": 2.2468354430379747,
+      "grad_norm": 0.8836460113525391,
+      "learning_rate": 0.000110941475826972,
+      "loss": 0.2636,
+      "step": 355
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.9266633987426758,
+      "learning_rate": 0.00010966921119592877,
+      "loss": 0.2603,
+      "step": 360
+    },
+    {
+      "epoch": 2.310126582278481,
+      "grad_norm": 0.8955816030502319,
+      "learning_rate": 0.0001083969465648855,
+      "loss": 0.278,
+      "step": 365
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.855516254901886,
+      "learning_rate": 0.00010712468193384224,
+      "loss": 0.2716,
+      "step": 370
+    },
+    {
+      "epoch": 2.3734177215189876,
+      "grad_norm": 1.0072673559188843,
+      "learning_rate": 0.00010585241730279898,
+      "loss": 0.2755,
+      "step": 375
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 1.1514896154403687,
+      "learning_rate": 0.00010458015267175574,
+      "loss": 0.2964,
+      "step": 380
+    },
+    {
+      "epoch": 2.4367088607594938,
+      "grad_norm": 0.8913586139678955,
+      "learning_rate": 0.00010330788804071248,
+      "loss": 0.2751,
+      "step": 385
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 0.7696821093559265,
+      "learning_rate": 0.00010203562340966922,
+      "loss": 0.2647,
+      "step": 390
+    },
+    {
+      "epoch": 2.5,
+      "grad_norm": 0.7826597690582275,
+      "learning_rate": 0.00010076335877862595,
+      "loss": 0.2792,
+      "step": 395
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 1.0873520374298096,
+      "learning_rate": 9.94910941475827e-05,
+      "loss": 0.2768,
+      "step": 400
+    },
+    {
+      "epoch": 2.5632911392405062,
+      "grad_norm": 0.9065166115760803,
+      "learning_rate": 9.821882951653944e-05,
+      "loss": 0.2633,
+      "step": 405
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 1.171126127243042,
+      "learning_rate": 9.694656488549618e-05,
+      "loss": 0.2774,
+      "step": 410
+    },
+    {
+      "epoch": 2.6265822784810124,
+      "grad_norm": 1.0864486694335938,
+      "learning_rate": 9.567430025445293e-05,
+      "loss": 0.2772,
+      "step": 415
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.846960723400116,
+      "learning_rate": 9.440203562340968e-05,
+      "loss": 0.2697,
+      "step": 420
+    },
+    {
+      "epoch": 2.689873417721519,
+      "grad_norm": 0.9240285158157349,
+      "learning_rate": 9.312977099236642e-05,
+      "loss": 0.2764,
+      "step": 425
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 0.863296627998352,
+      "learning_rate": 9.185750636132316e-05,
+      "loss": 0.2899,
+      "step": 430
+    },
+    {
+      "epoch": 2.7531645569620253,
+      "grad_norm": 0.9361215829849243,
+      "learning_rate": 9.05852417302799e-05,
+      "loss": 0.259,
+      "step": 435
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 1.0570683479309082,
+      "learning_rate": 8.931297709923665e-05,
+      "loss": 0.2944,
+      "step": 440
+    },
+    {
+      "epoch": 2.8164556962025316,
+      "grad_norm": 0.9439765214920044,
+      "learning_rate": 8.804071246819339e-05,
+      "loss": 0.2777,
+      "step": 445
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 0.8426817655563354,
+      "learning_rate": 8.676844783715013e-05,
+      "loss": 0.2987,
+      "step": 450
+    },
+    {
+      "epoch": 2.879746835443038,
+      "grad_norm": 0.9855856895446777,
+      "learning_rate": 8.549618320610687e-05,
+      "loss": 0.3083,
+      "step": 455
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 0.9780887961387634,
+      "learning_rate": 8.422391857506363e-05,
+      "loss": 0.2942,
+      "step": 460
+    },
+    {
+      "epoch": 2.9430379746835444,
+      "grad_norm": 0.9429991245269775,
+      "learning_rate": 8.295165394402035e-05,
+      "loss": 0.289,
+      "step": 465
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 0.9554647207260132,
+      "learning_rate": 8.167938931297711e-05,
+      "loss": 0.2911,
+      "step": 470
+    },
+    {
+      "epoch": 3.0063291139240507,
+      "grad_norm": 0.7053874135017395,
+      "learning_rate": 8.040712468193385e-05,
+      "loss": 0.2495,
+      "step": 475
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 0.9854986071586609,
+      "learning_rate": 7.913486005089059e-05,
+      "loss": 0.1796,
+      "step": 480
+    },
+    {
+      "epoch": 3.069620253164557,
+      "grad_norm": 1.658312439918518,
+      "learning_rate": 7.786259541984733e-05,
+      "loss": 0.1849,
+      "step": 485
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 1.205978512763977,
+      "learning_rate": 7.659033078880407e-05,
+      "loss": 0.1818,
+      "step": 490
+    },
+    {
+      "epoch": 3.132911392405063,
+      "grad_norm": 0.9182310700416565,
+      "learning_rate": 7.531806615776081e-05,
+      "loss": 0.1675,
+      "step": 495
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 0.8463435173034668,
+      "learning_rate": 7.404580152671756e-05,
+      "loss": 0.1622,
+      "step": 500
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 790,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 6.197846446374912e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/sk-zh/checkpoint-500/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e0bfa3c8048434787bbdf9f9f63214cb24a8a21257cbf492f12a840e4ed2a293
+size 6289

experiments/sk-zh/checkpoint-790/README.md

@@ -0,0 +1,210 @@
+---
+base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

experiments/sk-zh/checkpoint-790/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": {
+    "base_model_class": "LlamaForCausalLM",
+    "parent_library": "transformers.models.llama.modeling_llama",
+    "unsloth_fixed": true
+  },
+  "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "v_proj",
+    "o_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": true
+}

experiments/sk-zh/checkpoint-790/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73dd837e8d5423f555cb01ee894f1b2af1f113d7a971d4ffe4546f388f6737ad
+size 83945296

experiments/sk-zh/checkpoint-790/chat_template.jinja

@@ -0,0 +1,109 @@
+{{- bos_token }}
+{%- if custom_tools is defined %}
+    {%- set tools = custom_tools %}
+{%- endif %}
+{%- if not tools_in_user_message is defined %}
+    {%- set tools_in_user_message = true %}
+{%- endif %}
+{%- if not date_string is defined %}
+    {%- set date_string = "26 Jul 2024" %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+
+{#- This block extracts the system message, so we can slot it into the right place. #}
+{%- if messages[0]['role'] == 'system' %}
+    {%- set system_message = messages[0]['content']|trim %}
+    {%- set messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+{%- endif %}
+
+{#- System message + builtin tools #}
+{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
+{%- if builtin_tools is defined or tools is not none %}
+    {{- "Environment: ipython\n" }}
+{%- endif %}
+{%- if builtin_tools is defined %}
+    {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}
+{%- endif %}
+{{- "Cutting Knowledge Date: December 2023\n" }}
+{{- "Today Date: " + date_string + "\n\n" }}
+{%- if tools is not none and not tools_in_user_message %}
+    {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+{%- endif %}
+{{- system_message }}
+{{- "<|eot_id|>" }}
+
+{#- Custom tools are passed in a user message with some extra guidance #}
+{%- if tools_in_user_message and not tools is none %}
+    {#- Extract the first user message so we can plug it in here #}
+    {%- if messages | length != 0 %}
+        {%- set first_user_message = messages[0]['content']|trim %}
+        {%- set messages = messages[1:] %}
+    {%- else %}
+        {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
+{%- endif %}
+    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
+    {{- "Given the following functions, please respond with a JSON for a function call " }}
+    {{- "with its proper arguments that best answers the given prompt.\n\n" }}
+    {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
+    {{- "Do not use variables.\n\n" }}
+    {%- for t in tools %}
+        {{- t | tojson(indent=4) }}
+        {{- "\n\n" }}
+    {%- endfor %}
+    {{- first_user_message + "<|eot_id|>"}}
+{%- endif %}
+
+{%- for message in messages %}
+    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
+        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
+    {%- elif 'tool_calls' in message %}
+        {%- if not message.tool_calls|length == 1 %}
+            {{- raise_exception("This model only supports single tool-calls at once!") }}
+        {%- endif %}
+        {%- set tool_call = message.tool_calls[0].function %}
+        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- "<|python_tag|>" + tool_call.name + ".call(" }}
+            {%- for arg_name, arg_val in tool_call.arguments | items %}
+                {{- arg_name + '="' + arg_val + '"' }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- endif %}
+                {%- endfor %}
+            {{- ")" }}
+        {%- else  %}
+            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
+            {{- '{"name": "' + tool_call.name + '", ' }}
+            {{- '"parameters": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- "}" }}
+        {%- endif %}
+        {%- if builtin_tools is defined %}
+            {#- This means we're in ipython mode #}
+            {{- "<|eom_id|>" }}
+        {%- else %}
+            {{- "<|eot_id|>" }}
+        {%- endif %}
+    {%- elif message.role == "tool" or message.role == "ipython" %}
+        {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
+        {%- if message.content is mapping or message.content is iterable %}
+            {{- message.content | tojson }}
+        {%- else %}
+            {{- message.content }}
+        {%- endif %}
+        {{- "<|eot_id|>" }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
+{%- endif %}

experiments/sk-zh/checkpoint-790/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13b76e68b14c90fe24270002d9b7856adff972a396545101f64246acf4312690
+size 43123429

experiments/sk-zh/checkpoint-790/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89645f9f6a2a8823b334e0748e4f5ea683a27b3d02632f0a241397db55d82fad
+size 14645

experiments/sk-zh/checkpoint-790/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:35051bf7f4f2e2be5c96ec74ea328521409c95bd45c583cbfff0b643a5cb5e1d
+size 1465

experiments/sk-zh/checkpoint-790/special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

experiments/sk-zh/checkpoint-790/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

experiments/sk-zh/checkpoint-790/tokenizer_config.json

@@ -0,0 +1,2066 @@
+{
+  "add_bos_token": true,
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "right",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": null
+}

experiments/sk-zh/checkpoint-790/trainer_state.json

@@ -0,0 +1,1140 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 5.0,
+  "eval_steps": 500,
+  "global_step": 790,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03164556962025317,
+      "grad_norm": 9.636250495910645,
+      "learning_rate": 0.0002,
+      "loss": 2.7406,
+      "step": 5
+    },
+    {
+      "epoch": 0.06329113924050633,
+      "grad_norm": 1.6461654901504517,
+      "learning_rate": 0.00019872773536895675,
+      "loss": 0.9506,
+      "step": 10
+    },
+    {
+      "epoch": 0.0949367088607595,
+      "grad_norm": 1.761650562286377,
+      "learning_rate": 0.00019745547073791352,
+      "loss": 0.6273,
+      "step": 15
+    },
+    {
+      "epoch": 0.12658227848101267,
+      "grad_norm": 0.9863831400871277,
+      "learning_rate": 0.00019618320610687023,
+      "loss": 0.6092,
+      "step": 20
+    },
+    {
+      "epoch": 0.15822784810126583,
+      "grad_norm": 1.2868099212646484,
+      "learning_rate": 0.00019491094147582698,
+      "loss": 0.6429,
+      "step": 25
+    },
+    {
+      "epoch": 0.189873417721519,
+      "grad_norm": 1.0715737342834473,
+      "learning_rate": 0.00019363867684478372,
+      "loss": 0.5648,
+      "step": 30
+    },
+    {
+      "epoch": 0.22151898734177214,
+      "grad_norm": 1.0320993661880493,
+      "learning_rate": 0.00019236641221374049,
+      "loss": 0.5792,
+      "step": 35
+    },
+    {
+      "epoch": 0.25316455696202533,
+      "grad_norm": 0.9238957762718201,
+      "learning_rate": 0.00019109414758269723,
+      "loss": 0.4947,
+      "step": 40
+    },
+    {
+      "epoch": 0.2848101265822785,
+      "grad_norm": 1.0267781019210815,
+      "learning_rate": 0.00018982188295165394,
+      "loss": 0.5085,
+      "step": 45
+    },
+    {
+      "epoch": 0.31645569620253167,
+      "grad_norm": 0.9670472145080566,
+      "learning_rate": 0.00018854961832061068,
+      "loss": 0.5587,
+      "step": 50
+    },
+    {
+      "epoch": 0.34810126582278483,
+      "grad_norm": 1.065898060798645,
+      "learning_rate": 0.00018727735368956745,
+      "loss": 0.5423,
+      "step": 55
+    },
+    {
+      "epoch": 0.379746835443038,
+      "grad_norm": 1.0073872804641724,
+      "learning_rate": 0.0001860050890585242,
+      "loss": 0.5977,
+      "step": 60
+    },
+    {
+      "epoch": 0.41139240506329117,
+      "grad_norm": 0.9359777569770813,
+      "learning_rate": 0.00018473282442748093,
+      "loss": 0.4922,
+      "step": 65
+    },
+    {
+      "epoch": 0.4430379746835443,
+      "grad_norm": 1.3410602807998657,
+      "learning_rate": 0.00018346055979643765,
+      "loss": 0.5653,
+      "step": 70
+    },
+    {
+      "epoch": 0.47468354430379744,
+      "grad_norm": 0.8348254561424255,
+      "learning_rate": 0.00018218829516539442,
+      "loss": 0.5515,
+      "step": 75
+    },
+    {
+      "epoch": 0.5063291139240507,
+      "grad_norm": 0.9806696176528931,
+      "learning_rate": 0.00018091603053435116,
+      "loss": 0.548,
+      "step": 80
+    },
+    {
+      "epoch": 0.5379746835443038,
+      "grad_norm": 0.8727517127990723,
+      "learning_rate": 0.0001796437659033079,
+      "loss": 0.5175,
+      "step": 85
+    },
+    {
+      "epoch": 0.569620253164557,
+      "grad_norm": 0.8037821054458618,
+      "learning_rate": 0.00017837150127226464,
+      "loss": 0.5135,
+      "step": 90
+    },
+    {
+      "epoch": 0.6012658227848101,
+      "grad_norm": 0.7310634851455688,
+      "learning_rate": 0.00017709923664122138,
+      "loss": 0.4609,
+      "step": 95
+    },
+    {
+      "epoch": 0.6329113924050633,
+      "grad_norm": 1.0002307891845703,
+      "learning_rate": 0.00017582697201017812,
+      "loss": 0.5671,
+      "step": 100
+    },
+    {
+      "epoch": 0.6645569620253164,
+      "grad_norm": 0.7429682612419128,
+      "learning_rate": 0.00017455470737913486,
+      "loss": 0.5205,
+      "step": 105
+    },
+    {
+      "epoch": 0.6962025316455697,
+      "grad_norm": 0.7771511673927307,
+      "learning_rate": 0.00017328244274809163,
+      "loss": 0.5279,
+      "step": 110
+    },
+    {
+      "epoch": 0.7278481012658228,
+      "grad_norm": 0.6377614140510559,
+      "learning_rate": 0.00017201017811704835,
+      "loss": 0.4976,
+      "step": 115
+    },
+    {
+      "epoch": 0.759493670886076,
+      "grad_norm": 0.9541120529174805,
+      "learning_rate": 0.0001707379134860051,
+      "loss": 0.5249,
+      "step": 120
+    },
+    {
+      "epoch": 0.7911392405063291,
+      "grad_norm": 0.8480327725410461,
+      "learning_rate": 0.00016946564885496183,
+      "loss": 0.4799,
+      "step": 125
+    },
+    {
+      "epoch": 0.8227848101265823,
+      "grad_norm": 0.7675257325172424,
+      "learning_rate": 0.0001681933842239186,
+      "loss": 0.4845,
+      "step": 130
+    },
+    {
+      "epoch": 0.8544303797468354,
+      "grad_norm": 0.8189133405685425,
+      "learning_rate": 0.00016692111959287534,
+      "loss": 0.4981,
+      "step": 135
+    },
+    {
+      "epoch": 0.8860759493670886,
+      "grad_norm": 0.8288174867630005,
+      "learning_rate": 0.00016564885496183205,
+      "loss": 0.4781,
+      "step": 140
+    },
+    {
+      "epoch": 0.9177215189873418,
+      "grad_norm": 0.7553529739379883,
+      "learning_rate": 0.0001643765903307888,
+      "loss": 0.538,
+      "step": 145
+    },
+    {
+      "epoch": 0.9493670886075949,
+      "grad_norm": 0.7369087338447571,
+      "learning_rate": 0.00016310432569974556,
+      "loss": 0.5297,
+      "step": 150
+    },
+    {
+      "epoch": 0.9810126582278481,
+      "grad_norm": 0.745081901550293,
+      "learning_rate": 0.0001618320610687023,
+      "loss": 0.529,
+      "step": 155
+    },
+    {
+      "epoch": 1.0126582278481013,
+      "grad_norm": 0.760235071182251,
+      "learning_rate": 0.00016055979643765905,
+      "loss": 0.5206,
+      "step": 160
+    },
+    {
+      "epoch": 1.0443037974683544,
+      "grad_norm": 0.6101222038269043,
+      "learning_rate": 0.0001592875318066158,
+      "loss": 0.3851,
+      "step": 165
+    },
+    {
+      "epoch": 1.0759493670886076,
+      "grad_norm": 0.7095821499824524,
+      "learning_rate": 0.00015801526717557253,
+      "loss": 0.419,
+      "step": 170
+    },
+    {
+      "epoch": 1.1075949367088607,
+      "grad_norm": 0.8603990077972412,
+      "learning_rate": 0.00015674300254452927,
+      "loss": 0.4204,
+      "step": 175
+    },
+    {
+      "epoch": 1.139240506329114,
+      "grad_norm": 0.7504400014877319,
+      "learning_rate": 0.000155470737913486,
+      "loss": 0.367,
+      "step": 180
+    },
+    {
+      "epoch": 1.1708860759493671,
+      "grad_norm": 0.756787121295929,
+      "learning_rate": 0.00015419847328244275,
+      "loss": 0.393,
+      "step": 185
+    },
+    {
+      "epoch": 1.2025316455696202,
+      "grad_norm": 0.8656795620918274,
+      "learning_rate": 0.0001529262086513995,
+      "loss": 0.4357,
+      "step": 190
+    },
+    {
+      "epoch": 1.2341772151898733,
+      "grad_norm": 0.8514489531517029,
+      "learning_rate": 0.00015165394402035624,
+      "loss": 0.4215,
+      "step": 195
+    },
+    {
+      "epoch": 1.2658227848101267,
+      "grad_norm": 0.7526264190673828,
+      "learning_rate": 0.00015038167938931298,
+      "loss": 0.3651,
+      "step": 200
+    },
+    {
+      "epoch": 1.2974683544303798,
+      "grad_norm": 0.7162966132164001,
+      "learning_rate": 0.00014910941475826972,
+      "loss": 0.4073,
+      "step": 205
+    },
+    {
+      "epoch": 1.3291139240506329,
+      "grad_norm": 0.9087608456611633,
+      "learning_rate": 0.0001478371501272265,
+      "loss": 0.4026,
+      "step": 210
+    },
+    {
+      "epoch": 1.360759493670886,
+      "grad_norm": 0.7543425559997559,
+      "learning_rate": 0.0001465648854961832,
+      "loss": 0.3645,
+      "step": 215
+    },
+    {
+      "epoch": 1.3924050632911391,
+      "grad_norm": 0.740563154220581,
+      "learning_rate": 0.00014529262086513994,
+      "loss": 0.4309,
+      "step": 220
+    },
+    {
+      "epoch": 1.4240506329113924,
+      "grad_norm": 0.7612570524215698,
+      "learning_rate": 0.0001440203562340967,
+      "loss": 0.3908,
+      "step": 225
+    },
+    {
+      "epoch": 1.4556962025316456,
+      "grad_norm": 0.9129316806793213,
+      "learning_rate": 0.00014274809160305345,
+      "loss": 0.422,
+      "step": 230
+    },
+    {
+      "epoch": 1.4873417721518987,
+      "grad_norm": 0.8029764890670776,
+      "learning_rate": 0.0001414758269720102,
+      "loss": 0.3866,
+      "step": 235
+    },
+    {
+      "epoch": 1.518987341772152,
+      "grad_norm": 0.7712852954864502,
+      "learning_rate": 0.0001402035623409669,
+      "loss": 0.4168,
+      "step": 240
+    },
+    {
+      "epoch": 1.5506329113924051,
+      "grad_norm": 0.8392740488052368,
+      "learning_rate": 0.00013893129770992368,
+      "loss": 0.4102,
+      "step": 245
+    },
+    {
+      "epoch": 1.5822784810126582,
+      "grad_norm": 0.9574406743049622,
+      "learning_rate": 0.00013765903307888042,
+      "loss": 0.4312,
+      "step": 250
+    },
+    {
+      "epoch": 1.6139240506329116,
+      "grad_norm": 0.8071485757827759,
+      "learning_rate": 0.00013638676844783716,
+      "loss": 0.4148,
+      "step": 255
+    },
+    {
+      "epoch": 1.6455696202531644,
+      "grad_norm": 0.9748886227607727,
+      "learning_rate": 0.0001351145038167939,
+      "loss": 0.3916,
+      "step": 260
+    },
+    {
+      "epoch": 1.6772151898734178,
+      "grad_norm": 0.8215563893318176,
+      "learning_rate": 0.00013384223918575064,
+      "loss": 0.4227,
+      "step": 265
+    },
+    {
+      "epoch": 1.7088607594936709,
+      "grad_norm": 0.8115125894546509,
+      "learning_rate": 0.00013256997455470738,
+      "loss": 0.351,
+      "step": 270
+    },
+    {
+      "epoch": 1.740506329113924,
+      "grad_norm": 0.7755597233772278,
+      "learning_rate": 0.00013129770992366413,
+      "loss": 0.3745,
+      "step": 275
+    },
+    {
+      "epoch": 1.7721518987341773,
+      "grad_norm": 0.9101290106773376,
+      "learning_rate": 0.00013002544529262087,
+      "loss": 0.4006,
+      "step": 280
+    },
+    {
+      "epoch": 1.8037974683544302,
+      "grad_norm": 0.9382388591766357,
+      "learning_rate": 0.0001287531806615776,
+      "loss": 0.4191,
+      "step": 285
+    },
+    {
+      "epoch": 1.8354430379746836,
+      "grad_norm": 0.945472002029419,
+      "learning_rate": 0.00012748091603053435,
+      "loss": 0.4278,
+      "step": 290
+    },
+    {
+      "epoch": 1.8670886075949367,
+      "grad_norm": 0.8501671552658081,
+      "learning_rate": 0.0001262086513994911,
+      "loss": 0.3932,
+      "step": 295
+    },
+    {
+      "epoch": 1.8987341772151898,
+      "grad_norm": 0.9624788761138916,
+      "learning_rate": 0.00012493638676844783,
+      "loss": 0.38,
+      "step": 300
+    },
+    {
+      "epoch": 1.9303797468354431,
+      "grad_norm": 0.8801245093345642,
+      "learning_rate": 0.0001236641221374046,
+      "loss": 0.4113,
+      "step": 305
+    },
+    {
+      "epoch": 1.9620253164556962,
+      "grad_norm": 0.851109504699707,
+      "learning_rate": 0.00012239185750636134,
+      "loss": 0.4172,
+      "step": 310
+    },
+    {
+      "epoch": 1.9936708860759493,
+      "grad_norm": 0.8253706097602844,
+      "learning_rate": 0.00012111959287531807,
+      "loss": 0.3971,
+      "step": 315
+    },
+    {
+      "epoch": 2.0253164556962027,
+      "grad_norm": 0.6801413297653198,
+      "learning_rate": 0.00011984732824427483,
+      "loss": 0.333,
+      "step": 320
+    },
+    {
+      "epoch": 2.0569620253164556,
+      "grad_norm": 0.9851354956626892,
+      "learning_rate": 0.00011857506361323157,
+      "loss": 0.2744,
+      "step": 325
+    },
+    {
+      "epoch": 2.088607594936709,
+      "grad_norm": 0.9322072863578796,
+      "learning_rate": 0.0001173027989821883,
+      "loss": 0.2749,
+      "step": 330
+    },
+    {
+      "epoch": 2.1202531645569622,
+      "grad_norm": 0.7314637899398804,
+      "learning_rate": 0.00011603053435114504,
+      "loss": 0.2624,
+      "step": 335
+    },
+    {
+      "epoch": 2.151898734177215,
+      "grad_norm": 1.0124112367630005,
+      "learning_rate": 0.00011475826972010179,
+      "loss": 0.2748,
+      "step": 340
+    },
+    {
+      "epoch": 2.1835443037974684,
+      "grad_norm": 1.046563982963562,
+      "learning_rate": 0.00011348600508905853,
+      "loss": 0.3032,
+      "step": 345
+    },
+    {
+      "epoch": 2.2151898734177213,
+      "grad_norm": 0.7314551472663879,
+      "learning_rate": 0.00011221374045801527,
+      "loss": 0.2785,
+      "step": 350
+    },
+    {
+      "epoch": 2.2468354430379747,
+      "grad_norm": 0.8836460113525391,
+      "learning_rate": 0.000110941475826972,
+      "loss": 0.2636,
+      "step": 355
+    },
+    {
+      "epoch": 2.278481012658228,
+      "grad_norm": 0.9266633987426758,
+      "learning_rate": 0.00010966921119592877,
+      "loss": 0.2603,
+      "step": 360
+    },
+    {
+      "epoch": 2.310126582278481,
+      "grad_norm": 0.8955816030502319,
+      "learning_rate": 0.0001083969465648855,
+      "loss": 0.278,
+      "step": 365
+    },
+    {
+      "epoch": 2.3417721518987342,
+      "grad_norm": 0.855516254901886,
+      "learning_rate": 0.00010712468193384224,
+      "loss": 0.2716,
+      "step": 370
+    },
+    {
+      "epoch": 2.3734177215189876,
+      "grad_norm": 1.0072673559188843,
+      "learning_rate": 0.00010585241730279898,
+      "loss": 0.2755,
+      "step": 375
+    },
+    {
+      "epoch": 2.4050632911392404,
+      "grad_norm": 1.1514896154403687,
+      "learning_rate": 0.00010458015267175574,
+      "loss": 0.2964,
+      "step": 380
+    },
+    {
+      "epoch": 2.4367088607594938,
+      "grad_norm": 0.8913586139678955,
+      "learning_rate": 0.00010330788804071248,
+      "loss": 0.2751,
+      "step": 385
+    },
+    {
+      "epoch": 2.4683544303797467,
+      "grad_norm": 0.7696821093559265,
+      "learning_rate": 0.00010203562340966922,
+      "loss": 0.2647,
+      "step": 390
+    },
+    {
+      "epoch": 2.5,
+      "grad_norm": 0.7826597690582275,
+      "learning_rate": 0.00010076335877862595,
+      "loss": 0.2792,
+      "step": 395
+    },
+    {
+      "epoch": 2.5316455696202533,
+      "grad_norm": 1.0873520374298096,
+      "learning_rate": 9.94910941475827e-05,
+      "loss": 0.2768,
+      "step": 400
+    },
+    {
+      "epoch": 2.5632911392405062,
+      "grad_norm": 0.9065166115760803,
+      "learning_rate": 9.821882951653944e-05,
+      "loss": 0.2633,
+      "step": 405
+    },
+    {
+      "epoch": 2.5949367088607596,
+      "grad_norm": 1.171126127243042,
+      "learning_rate": 9.694656488549618e-05,
+      "loss": 0.2774,
+      "step": 410
+    },
+    {
+      "epoch": 2.6265822784810124,
+      "grad_norm": 1.0864486694335938,
+      "learning_rate": 9.567430025445293e-05,
+      "loss": 0.2772,
+      "step": 415
+    },
+    {
+      "epoch": 2.6582278481012658,
+      "grad_norm": 0.846960723400116,
+      "learning_rate": 9.440203562340968e-05,
+      "loss": 0.2697,
+      "step": 420
+    },
+    {
+      "epoch": 2.689873417721519,
+      "grad_norm": 0.9240285158157349,
+      "learning_rate": 9.312977099236642e-05,
+      "loss": 0.2764,
+      "step": 425
+    },
+    {
+      "epoch": 2.721518987341772,
+      "grad_norm": 0.863296627998352,
+      "learning_rate": 9.185750636132316e-05,
+      "loss": 0.2899,
+      "step": 430
+    },
+    {
+      "epoch": 2.7531645569620253,
+      "grad_norm": 0.9361215829849243,
+      "learning_rate": 9.05852417302799e-05,
+      "loss": 0.259,
+      "step": 435
+    },
+    {
+      "epoch": 2.7848101265822782,
+      "grad_norm": 1.0570683479309082,
+      "learning_rate": 8.931297709923665e-05,
+      "loss": 0.2944,
+      "step": 440
+    },
+    {
+      "epoch": 2.8164556962025316,
+      "grad_norm": 0.9439765214920044,
+      "learning_rate": 8.804071246819339e-05,
+      "loss": 0.2777,
+      "step": 445
+    },
+    {
+      "epoch": 2.848101265822785,
+      "grad_norm": 0.8426817655563354,
+      "learning_rate": 8.676844783715013e-05,
+      "loss": 0.2987,
+      "step": 450
+    },
+    {
+      "epoch": 2.879746835443038,
+      "grad_norm": 0.9855856895446777,
+      "learning_rate": 8.549618320610687e-05,
+      "loss": 0.3083,
+      "step": 455
+    },
+    {
+      "epoch": 2.911392405063291,
+      "grad_norm": 0.9780887961387634,
+      "learning_rate": 8.422391857506363e-05,
+      "loss": 0.2942,
+      "step": 460
+    },
+    {
+      "epoch": 2.9430379746835444,
+      "grad_norm": 0.9429991245269775,
+      "learning_rate": 8.295165394402035e-05,
+      "loss": 0.289,
+      "step": 465
+    },
+    {
+      "epoch": 2.9746835443037973,
+      "grad_norm": 0.9554647207260132,
+      "learning_rate": 8.167938931297711e-05,
+      "loss": 0.2911,
+      "step": 470
+    },
+    {
+      "epoch": 3.0063291139240507,
+      "grad_norm": 0.7053874135017395,
+      "learning_rate": 8.040712468193385e-05,
+      "loss": 0.2495,
+      "step": 475
+    },
+    {
+      "epoch": 3.037974683544304,
+      "grad_norm": 0.9854986071586609,
+      "learning_rate": 7.913486005089059e-05,
+      "loss": 0.1796,
+      "step": 480
+    },
+    {
+      "epoch": 3.069620253164557,
+      "grad_norm": 1.658312439918518,
+      "learning_rate": 7.786259541984733e-05,
+      "loss": 0.1849,
+      "step": 485
+    },
+    {
+      "epoch": 3.1012658227848102,
+      "grad_norm": 1.205978512763977,
+      "learning_rate": 7.659033078880407e-05,
+      "loss": 0.1818,
+      "step": 490
+    },
+    {
+      "epoch": 3.132911392405063,
+      "grad_norm": 0.9182310700416565,
+      "learning_rate": 7.531806615776081e-05,
+      "loss": 0.1675,
+      "step": 495
+    },
+    {
+      "epoch": 3.1645569620253164,
+      "grad_norm": 0.8463435173034668,
+      "learning_rate": 7.404580152671756e-05,
+      "loss": 0.1622,
+      "step": 500
+    },
+    {
+      "epoch": 3.1962025316455698,
+      "grad_norm": 1.0516126155853271,
+      "learning_rate": 7.27735368956743e-05,
+      "loss": 0.1747,
+      "step": 505
+    },
+    {
+      "epoch": 3.2278481012658227,
+      "grad_norm": 1.1708065271377563,
+      "learning_rate": 7.150127226463105e-05,
+      "loss": 0.1698,
+      "step": 510
+    },
+    {
+      "epoch": 3.259493670886076,
+      "grad_norm": 1.0445353984832764,
+      "learning_rate": 7.022900763358778e-05,
+      "loss": 0.1787,
+      "step": 515
+    },
+    {
+      "epoch": 3.291139240506329,
+      "grad_norm": 1.0697447061538696,
+      "learning_rate": 6.895674300254454e-05,
+      "loss": 0.1688,
+      "step": 520
+    },
+    {
+      "epoch": 3.3227848101265822,
+      "grad_norm": 1.305916428565979,
+      "learning_rate": 6.768447837150128e-05,
+      "loss": 0.18,
+      "step": 525
+    },
+    {
+      "epoch": 3.3544303797468356,
+      "grad_norm": 0.9434958100318909,
+      "learning_rate": 6.641221374045802e-05,
+      "loss": 0.1711,
+      "step": 530
+    },
+    {
+      "epoch": 3.3860759493670884,
+      "grad_norm": 1.0028834342956543,
+      "learning_rate": 6.513994910941476e-05,
+      "loss": 0.1734,
+      "step": 535
+    },
+    {
+      "epoch": 3.4177215189873418,
+      "grad_norm": 0.984062135219574,
+      "learning_rate": 6.38676844783715e-05,
+      "loss": 0.1719,
+      "step": 540
+    },
+    {
+      "epoch": 3.449367088607595,
+      "grad_norm": 1.2475136518478394,
+      "learning_rate": 6.259541984732826e-05,
+      "loss": 0.1744,
+      "step": 545
+    },
+    {
+      "epoch": 3.481012658227848,
+      "grad_norm": 1.1773546934127808,
+      "learning_rate": 6.132315521628498e-05,
+      "loss": 0.1743,
+      "step": 550
+    },
+    {
+      "epoch": 3.5126582278481013,
+      "grad_norm": 1.021459937095642,
+      "learning_rate": 6.005089058524174e-05,
+      "loss": 0.1689,
+      "step": 555
+    },
+    {
+      "epoch": 3.5443037974683547,
+      "grad_norm": 1.0893386602401733,
+      "learning_rate": 5.877862595419847e-05,
+      "loss": 0.1737,
+      "step": 560
+    },
+    {
+      "epoch": 3.5759493670886076,
+      "grad_norm": 1.0144004821777344,
+      "learning_rate": 5.750636132315522e-05,
+      "loss": 0.16,
+      "step": 565
+    },
+    {
+      "epoch": 3.607594936708861,
+      "grad_norm": 0.8611662983894348,
+      "learning_rate": 5.6234096692111956e-05,
+      "loss": 0.1719,
+      "step": 570
+    },
+    {
+      "epoch": 3.6392405063291138,
+      "grad_norm": 1.2304856777191162,
+      "learning_rate": 5.496183206106871e-05,
+      "loss": 0.1787,
+      "step": 575
+    },
+    {
+      "epoch": 3.670886075949367,
+      "grad_norm": 1.1288779973983765,
+      "learning_rate": 5.3689567430025446e-05,
+      "loss": 0.1747,
+      "step": 580
+    },
+    {
+      "epoch": 3.7025316455696204,
+      "grad_norm": 0.9914140701293945,
+      "learning_rate": 5.2417302798982194e-05,
+      "loss": 0.1698,
+      "step": 585
+    },
+    {
+      "epoch": 3.7341772151898733,
+      "grad_norm": 1.0418596267700195,
+      "learning_rate": 5.114503816793893e-05,
+      "loss": 0.1665,
+      "step": 590
+    },
+    {
+      "epoch": 3.7658227848101267,
+      "grad_norm": 0.9959351420402527,
+      "learning_rate": 4.9872773536895677e-05,
+      "loss": 0.1788,
+      "step": 595
+    },
+    {
+      "epoch": 3.7974683544303796,
+      "grad_norm": 1.0242741107940674,
+      "learning_rate": 4.860050890585242e-05,
+      "loss": 0.1696,
+      "step": 600
+    },
+    {
+      "epoch": 3.829113924050633,
+      "grad_norm": 0.8512247204780579,
+      "learning_rate": 4.7328244274809166e-05,
+      "loss": 0.1715,
+      "step": 605
+    },
+    {
+      "epoch": 3.8607594936708862,
+      "grad_norm": 1.0411094427108765,
+      "learning_rate": 4.605597964376591e-05,
+      "loss": 0.194,
+      "step": 610
+    },
+    {
+      "epoch": 3.892405063291139,
+      "grad_norm": 0.8123801350593567,
+      "learning_rate": 4.478371501272265e-05,
+      "loss": 0.1568,
+      "step": 615
+    },
+    {
+      "epoch": 3.9240506329113924,
+      "grad_norm": 0.9734017252922058,
+      "learning_rate": 4.351145038167939e-05,
+      "loss": 0.1567,
+      "step": 620
+    },
+    {
+      "epoch": 3.9556962025316453,
+      "grad_norm": 1.0225167274475098,
+      "learning_rate": 4.223918575063613e-05,
+      "loss": 0.17,
+      "step": 625
+    },
+    {
+      "epoch": 3.9873417721518987,
+      "grad_norm": 1.0845963954925537,
+      "learning_rate": 4.096692111959288e-05,
+      "loss": 0.1732,
+      "step": 630
+    },
+    {
+      "epoch": 4.018987341772152,
+      "grad_norm": 0.5236292481422424,
+      "learning_rate": 3.969465648854962e-05,
+      "loss": 0.1263,
+      "step": 635
+    },
+    {
+      "epoch": 4.050632911392405,
+      "grad_norm": 0.7206861972808838,
+      "learning_rate": 3.842239185750636e-05,
+      "loss": 0.1063,
+      "step": 640
+    },
+    {
+      "epoch": 4.082278481012658,
+      "grad_norm": 0.7728809714317322,
+      "learning_rate": 3.7150127226463104e-05,
+      "loss": 0.1101,
+      "step": 645
+    },
+    {
+      "epoch": 4.113924050632911,
+      "grad_norm": 0.8304474353790283,
+      "learning_rate": 3.5877862595419845e-05,
+      "loss": 0.1053,
+      "step": 650
+    },
+    {
+      "epoch": 4.1455696202531644,
+      "grad_norm": 1.2666995525360107,
+      "learning_rate": 3.4605597964376594e-05,
+      "loss": 0.1052,
+      "step": 655
+    },
+    {
+      "epoch": 4.177215189873418,
+      "grad_norm": 0.8301147222518921,
+      "learning_rate": 3.3333333333333335e-05,
+      "loss": 0.1018,
+      "step": 660
+    },
+    {
+      "epoch": 4.208860759493671,
+      "grad_norm": 0.739557683467865,
+      "learning_rate": 3.2061068702290076e-05,
+      "loss": 0.1029,
+      "step": 665
+    },
+    {
+      "epoch": 4.2405063291139244,
+      "grad_norm": 0.6500698924064636,
+      "learning_rate": 3.078880407124682e-05,
+      "loss": 0.1012,
+      "step": 670
+    },
+    {
+      "epoch": 4.272151898734177,
+      "grad_norm": 0.8295223712921143,
+      "learning_rate": 2.9516539440203562e-05,
+      "loss": 0.1055,
+      "step": 675
+    },
+    {
+      "epoch": 4.30379746835443,
+      "grad_norm": 0.7999599575996399,
+      "learning_rate": 2.824427480916031e-05,
+      "loss": 0.1013,
+      "step": 680
+    },
+    {
+      "epoch": 4.3354430379746836,
+      "grad_norm": 0.7890852093696594,
+      "learning_rate": 2.6972010178117052e-05,
+      "loss": 0.1084,
+      "step": 685
+    },
+    {
+      "epoch": 4.367088607594937,
+      "grad_norm": 0.682808518409729,
+      "learning_rate": 2.5699745547073793e-05,
+      "loss": 0.1047,
+      "step": 690
+    },
+    {
+      "epoch": 4.39873417721519,
+      "grad_norm": 0.8218865394592285,
+      "learning_rate": 2.4427480916030535e-05,
+      "loss": 0.1059,
+      "step": 695
+    },
+    {
+      "epoch": 4.430379746835443,
+      "grad_norm": 0.8919423818588257,
+      "learning_rate": 2.3155216284987276e-05,
+      "loss": 0.107,
+      "step": 700
+    },
+    {
+      "epoch": 4.462025316455696,
+      "grad_norm": 0.890254557132721,
+      "learning_rate": 2.1882951653944024e-05,
+      "loss": 0.1052,
+      "step": 705
+    },
+    {
+      "epoch": 4.493670886075949,
+      "grad_norm": 0.7770714163780212,
+      "learning_rate": 2.0610687022900766e-05,
+      "loss": 0.1076,
+      "step": 710
+    },
+    {
+      "epoch": 4.525316455696203,
+      "grad_norm": 0.822676956653595,
+      "learning_rate": 1.9338422391857507e-05,
+      "loss": 0.1098,
+      "step": 715
+    },
+    {
+      "epoch": 4.556962025316456,
+      "grad_norm": 0.8674812316894531,
+      "learning_rate": 1.8066157760814252e-05,
+      "loss": 0.1049,
+      "step": 720
+    },
+    {
+      "epoch": 4.588607594936709,
+      "grad_norm": 0.9034451246261597,
+      "learning_rate": 1.6793893129770993e-05,
+      "loss": 0.1035,
+      "step": 725
+    },
+    {
+      "epoch": 4.620253164556962,
+      "grad_norm": 0.8883581161499023,
+      "learning_rate": 1.5521628498727735e-05,
+      "loss": 0.1136,
+      "step": 730
+    },
+    {
+      "epoch": 4.651898734177215,
+      "grad_norm": 0.7039092779159546,
+      "learning_rate": 1.424936386768448e-05,
+      "loss": 0.1085,
+      "step": 735
+    },
+    {
+      "epoch": 4.6835443037974684,
+      "grad_norm": 0.7304778099060059,
+      "learning_rate": 1.2977099236641221e-05,
+      "loss": 0.1052,
+      "step": 740
+    },
+    {
+      "epoch": 4.715189873417722,
+      "grad_norm": 0.7564213871955872,
+      "learning_rate": 1.1704834605597966e-05,
+      "loss": 0.1159,
+      "step": 745
+    },
+    {
+      "epoch": 4.746835443037975,
+      "grad_norm": 0.8755419850349426,
+      "learning_rate": 1.0432569974554709e-05,
+      "loss": 0.1071,
+      "step": 750
+    },
+    {
+      "epoch": 4.7784810126582276,
+      "grad_norm": 0.674625813961029,
+      "learning_rate": 9.16030534351145e-06,
+      "loss": 0.1052,
+      "step": 755
+    },
+    {
+      "epoch": 4.810126582278481,
+      "grad_norm": 0.6959136724472046,
+      "learning_rate": 7.888040712468193e-06,
+      "loss": 0.1035,
+      "step": 760
+    },
+    {
+      "epoch": 4.841772151898734,
+      "grad_norm": 0.7899979948997498,
+      "learning_rate": 6.615776081424936e-06,
+      "loss": 0.1061,
+      "step": 765
+    },
+    {
+      "epoch": 4.8734177215189876,
+      "grad_norm": 0.7598320841789246,
+      "learning_rate": 5.343511450381679e-06,
+      "loss": 0.1107,
+      "step": 770
+    },
+    {
+      "epoch": 4.905063291139241,
+      "grad_norm": 0.8173516392707825,
+      "learning_rate": 4.0712468193384225e-06,
+      "loss": 0.1028,
+      "step": 775
+    },
+    {
+      "epoch": 4.936708860759493,
+      "grad_norm": 1.0041359663009644,
+      "learning_rate": 2.7989821882951656e-06,
+      "loss": 0.1099,
+      "step": 780
+    },
+    {
+      "epoch": 4.968354430379747,
+      "grad_norm": 0.7591622471809387,
+      "learning_rate": 1.5267175572519084e-06,
+      "loss": 0.1034,
+      "step": 785
+    },
+    {
+      "epoch": 5.0,
+      "grad_norm": 0.8075107336044312,
+      "learning_rate": 2.544529262086514e-07,
+      "loss": 0.1052,
+      "step": 790
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 790,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 5,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 9.78470061291602e+16,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

experiments/sk-zh/checkpoint-790/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e0bfa3c8048434787bbdf9f9f63214cb24a8a21257cbf492f12a840e4ed2a293
+size 6289

experiments/sk-zh/metrics.json

@@ -0,0 +1,12 @@
+{
+    "zh": {
+        "precision": 0.683,
+        "recall": 0.6883,
+        "f1": 0.6856
+    },
+    "sk": {
+        "precision": 0.6692,
+        "recall": 0.6771,
+        "f1": 0.6731
+    }
+}

experiments/sk-zh/preds_zh.csv

@@ -0,0 +1,545 @@
+input,gold,pred
+我等了 10-15 分钟服务点了一杯啤酒，但之后再也没有人提供服务。,"{service general, 服务, negative}","{service general, 服务, negative}"
+氛围 是孩子们在迪士尼市中心奔跑时享受的一个宁静而轻松的休息时间。,"{ambience general, 氛围, positive}","{ambience general, 氛围, positive}"
+隐藏的小杰姆,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+我和一位外地的朋友一起去了那里...我们都非常感动！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+它有很棒的寿司甚至更好的服务。,"{food quality, 寿司, positive};{service general, 服务, positive}","{food quality, 寿司, positive};{service general, 服务, positive}"
+他们的所有菜单项都很受欢迎，而且还提供含羞草鸡尾酒。,"{food quality, 菜单项, positive}","{drinks style_options, 含羞草鸡尾酒, positive};{food style_options, 菜单项, positive}"
+–...以及最佳的夏季甲板体验——如果您在西雅图的夜晚感到寒冷，他们甚至会给您送来毯子。,"{ambience general, 甲板, positive};{service general, null, positive}","{ambience general, 甲板, positive}"
+– 在西雅图住了 12 年之后雷家被评为我们总是回去的地方。,"{restaurant general, 雷家, positive}","{restaurant general, 雷家, positive}"
+在这儿你不会出错。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+我想我可能已经尝试过他们菜单上的每道菜至少一次，每道菜都很棒。,"{food quality, 菜单, positive}","{food quality, 菜单, positive}"
+– 意大利辣香肠 切得很厚——好吃。,"{food style_options, 意大利辣香肠, positive}","{food quality, 意大利辣香肠, positive}"
+绿茶焦糖布丁我每次吃都觉得味道更好。,"{food quality, 绿茶焦糖布丁, positive}","{food quality, 绿茶焦糖布丁, positive}"
+不要以为太精致，你就觉得不舒服，而要打扮。,"{ambience general, null, positive}","{ambience general, null, negative}"
+气氛很好。,"{ambience general, 气氛, positive}","{ambience general, 气氛, positive}"
+绝对棒极了！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+避开地点,"{restaurant general, 地点, negative}","{restaurant general, 地点, negative}"
+说实话，我吃过更好的冷冻食品披萨。,"{food quality, 披萨, negative}","{food quality, 披萨, negative}"
+服务 非常出色——有时感觉我们受到了一群友好的 服务员 的服务。,"{service general, 服务员, positive};{service general, 服务, positive}","{service general, 服务员, positive};{service general, 服务, positive}"
+而且他们把所有东西都包装得很好，所以不会洒出来。,"{service general, null, positive}","{food style_options, null, positive}"
+非常好 ！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+这食物是有罪的。,"{food quality, 食物, positive}","{food quality, 食物, negative}"
+首先，大约 8-10 盎司橙汁的价格为 3 美元。,"{drinks prices, 橙汁, negative}","{drinks prices, 橙汁, negative}"
+好清酒选择。,"{drinks style_options, 清酒选择, positive}","{drinks quality, 清酒选择, positive}"
+尽管我可以没有和我们一起度过这个夜晚的年轻人，但我们出色的服务员和食物使这次体验非常愉快。,"{restaurant miscellaneous, null, positive};{food quality, 食物, positive};{service general, 服务员, positive}","{food quality, 食物, positive};{service general, 服务员, positive}"
+多么棒的发现啊！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– Mioposto 有非常有创意又美味的披萨菜单。,"{food quality, 披萨菜单, positive};{food style_options, 披萨菜单, positive}","{food style_options, 披萨菜单, positive};{food quality, 披萨菜单, positive}"
+在最近的一次旅行中，我们的服务员极其不屑一顾，而至少三名工作人员却对坐在附近的一对日本女孩百般伺候。,"{service general, 服务员, negative}","{service general, 工作人员, negative};{service general, 服务员, negative}"
+当我点这类食物时，我通常吃不完西兰花，但第一次吃到时，每一块都和第一块一样丰富多彩……扇贝和虾非常新鲜，烹饪得非常好。,"{food quality, 虾, positive};{food quality, 西兰花, positive};{food quality, 扇贝, positive}","{food quality, null, positive};{food style_options, null, positive};{food quality, 蜂蜜烤虾, positive};{food quality, 扇贝, positive}"
+它不是最便宜的寿司但每次都是值得的。,"{food prices, 寿司, neutral};{food quality, 寿司, positive}","{food prices, 寿司, negative};{food quality, 寿司, positive}"
+在那里吃过饭后，你绝不会感到恶心和饱。,"{food quality, null, positive}","{restaurant general, null, positive}"
+作为一个四人小团体的一部分，���们的食物被毫无评论地送走了；,"{service general, null, negative}","{service general, null, negative}"
+我希望有一天纵帆船或更高版本能恢复到以前的样子。,"{restaurant general, 纵帆船或更高版本, negative}","{restaurant general, 纵帆船或更高版本, negative}"
+首先，食物上得很快，而且很齐整：）我喜欢这一点...我讨厌食物一件接一件上来的浮夸。,"{service general, null, positive}","{service general, null, positive}"
+食物很棒！,"{food quality, 食物, positive}","{food quality, 食物, positive}"
+如果某个地方在开放期间，每周的每一天都有人排队，那你就知道它很棒了。,"{restaurant general, 地方, positive}","{restaurant miscellaneous, 地方, positive}"
+最令人惊喜的是，支票没有超出我的预期，就像在大多数地方一样。,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+充其量，食物很好，但价格肯定过高。,"{food prices, 食物, negative};{food quality, 食物, positive}","{restaurant prices, null, negative};{food quality, 食物, positive}"
+室外露台区有一个简短的菜单。,"{food style_options, 菜单, neutral}","{drinks style_options, 室外露台区, neutral}"
+洛杉矶最佳印度菜,"{food quality, 印度菜, positive}","{food quality, 印度菜, positive}"
+直奔主题吧--这真是太神奇了！,"{restaurant general, null, positive}","{food quality, null, positive}"
+食物 已经不像以前那样了 ( 药水 已经严重缩减) 价格上涨了，而且 服务 是我在任何地方 (包括欧洲大陆) 经历过的最差的。,"{food prices, 食物, negative};{food style_options, 药水, negative};{food quality, 食物, negative};{service general, 服务, negative}","{food quality, 食物, negative};{food prices, 食物, negative};{service general, 服务, negative}"
+黎巴嫩食物！好吃！,"{food quality, 黎巴嫩食物, positive}","{food quality, 黎巴嫩食物, positive}"
+西兰花非常新鲜，味道也很好。,"{food quality, 西兰花, positive}","{food quality, 西兰花, positive}"
+而且他们提供的数量和价格都很合适。,"{food style_options, null, positive}","{food prices, 数量, positive};{food style_options, 数量, positive}"
+非常令人失望,"{restaurant general, null, negative}","{food quality, null, negative}"
+西雅图最佳 酒单,"{drinks style_options, 酒单, positive}","{drinks style_options, 酒单, positive}"
+– 我对这个地方说不完。,"{restaurant general, 地方, positive}","{restaurant general, 地方, positive}"
+– 我已经在这个地方吃饭超过 8 年了，从来没有吃过一顿糟糕的餐。,"{food quality, 餐, positive}","{food quality, 餐, positive}"
+我回到家并再次在网上查找，发现有一个赠品链接无效，于是给餐厅发了一封电子邮件，告知他们不存在的服务和欺骗性链接。,"{restaurant miscellaneous, 餐厅, negative}","{service general, null, negative}"
+价值 100 美元（1 盘）的盘子里摆满了精美的（3 块奇异的鱼）菜肴，但没有一块是可吃的。,"{food quality, 奇异的鱼, negative};{food style_options, 奇异的鱼, negative};{food prices, 盘子, negative}","{food quality, 她（3 块奇异的鱼, negative};{food prices, 盘子, negative}"
+我吃了美味的羊肉咖喱，萨格奶酪，萨莫萨三角饺，印度烤饼等。,"{food quality, 萨格奶酪, positive};{food quality, 印度烤饼, positive};{food quality, 羊肉咖喱, positive};{food quality, 萨莫萨三角饺, positive}","{food quality, 印度烤饼, positive};{food quality, 羊肉咖喱, positive};{food quality, 萨格奶酪, positive};{food quality, 萨莫萨三角饺, positive}"
+服务非常好寿司。,"{food quality, 寿司, positive}","{food quality, 寿司, positive};{service general, 服务, positive}"
+和往常一样，主厨搭配在新鲜度上没有让人失望，尽管在创造力和选择性方面得分较低。,"{food quality, 主厨搭配, positive};{food style_options, 主厨搭配, negative}","{food quality, null, positive};{food style_options, null, negative};{food style_innovative, null, negative}"
+米饭太干，金枪鱼也不太新鲜。,"{food quality, 金枪鱼, negative};{food quality, 米饭, negative}","{food quality, null, negative};{food quality, 米饭, negative}"
+他们的蟹肉班尼迪克蛋令人上瘾。,"{food quality, 蟹肉班尼迪克蛋, positive}","{food quality, 蟹肉班尼迪克蛋, positive}"
+留点空间吃美味的甜点。,"{food quality, 甜点, positive}","{food quality, 甜点, positive}"
+我们的服务员非常专业且友好。,"{service general, 服务员, positive}","{service general, 服务员, positive}"
+我是根据推荐来这里的，并且肯定会一次又一次地再来。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+食物 都很好，但是味道太淡了。,"{food quality, 食物, positive};{food quality, 食物, negative}","{food quality, 食物, negative}"
+– 我和我的丈夫喜欢在 Mioposto Café 吃饭。,"{restaurant general, Mioposto 咖啡馆, positive}","{restaurant general, Mioposto Café, positive}"
+– 这是一次很棒的用餐体验。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+工作人员 真的很友好。,"{service general, 工作人员, positive}","{service general, 工作人员, positive}"
+我们每人轻易就花掉了 40 多美元（不包括酒水），而且仍然很饿。,"{restaurant prices, null, negative};{food style_options, null, negative}","{food prices, null, negative};{food quality, null, negative}"
+就新鲜度而言，这里与东京的餐厅不相上下。,"{food quality, null, positive}","{restaurant miscellaneous, null, positive}"
+Groovy音乐让晚餐变得轻松随意。,"{ambience general, 音乐, positive}","{ambience general, Groovy音乐, positive}"
+在我们团体中的一名成员被一名女服务员反复撞倒后，我们礼貌地请求他不要被撞，这让那名女服务员开始破口大骂。,"{service general, 女服务员, negative}","{service general, 女服务员, negative}"
+– Ray's（令人惊讶地）拥有这座城市最好、最丰富多彩的酒单。,"{drinks style_options, 酒单, positive}","{drinks style_options, 酒单, positive}"
+不过我可能不会再回去，因为我不知道是否值得。,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+薯片和莎莎酱 非常美味，而且价格非常实惠。,"{restaurant prices, null, positive};{food quality, 薯片和莎莎酱, positive}","{food quality, 薯片, positive};{food prices, 薯片, positive};{food quality, 莎莎酱, positive};{food prices, 莎莎酱, positive}"
+侍酒师 非常棒，很踏实，而且知识渊博。,"{service general, 侍酒师, positive}","{service general, 侍酒师, positive}"
+大厚意大利辣香肠,"{food style_options, 意大利辣香肠, positive}","{food quality, 意大利辣香肠, positive}"
+根本不值得去那里并在那里花钱！！！,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+价格高得离谱,"{restaurant prices, null, negative}","{restaurant prices, null, negative}"
+室内氛围很现代。,"{ambience general, 室内氛围, positive}","{ambience general, 室内, positive}"
+不要去！,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+在这种情况发生之前，我的建议是远离。,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+哦，我忘了说了，他们没有面包服务。,"{service general, null, negative}","{service general, null, negative}"
+它们一点也不油腻。,"{food quality, null, positive}","{food quality, null, positive}"
+音乐 很棒，没有比这更好或更坏的夜晚，酒吧招待员 慷慨地倒酒，轻松的 氛围 会让你精神振奋。,"{ambience general, 氛围, positive};{ambience general, 音乐, positive};{drinks style_options, 酒吧招待员, positive}","{service general, 酒吧招待员, positive};{ambience general, 氛围, positive};{drinks style_options, 倒酒, positive};{ambience general, 音乐, positive}"
+不错氛围，但被高估了地点。,"{ambience general, 氛围, positive};{restaurant general, 地点, negative}","{ambience general, 地点, positive};{restaurant general, 地点, negative};{ambience general, 氛围, positive}"
+这里的寿司很美味！,"{food quality, 寿司, positive}","{food quality, 寿司, positive}"
+– 我非常高兴地报告，我上周五在Ray's Boathouse吃的晚餐完全超出了我的预期。,"{restaurant general, Ray's Boathouse, positive}","{food quality, 晚餐, positive}"
+就食品质量而言，晚餐一直都很棒。,"{food quality, 晚餐, positive}","{food quality, 食品, positive}"
+他们的应用程序都很美味。,"{food quality, 应用程序, positive}","{food quality, null, positive}"
+蓝丝带不负其盛名。,"{restaurant general, 蓝丝带, positive}","{restaurant general, 蓝丝带, positive}"
+我感到很尴尬，下次就去了赌场的卫生间。,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, 赌场的卫生间, negative}"
+– 我决定在 Stack 吃饭，因为他们的演出前晚餐有固定价格。,"{food prices, 演出前晚餐有固定价格, neutral}","{restaurant prices, Stack, positive}"
+– 我带父母来这里庆祝他们的结婚纪念日——非常非常失望！！！,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+无与伦比寿司！,"{food quality, 寿司, positive}","{food quality, 寿司, positive}"
+首先，我们可爱的服务员布鲁克很快就过来为我拿下饮料订单。,"{service general, 布鲁克, positive}","{service general, 服务员布鲁克, positive}"
+每次叫“0-sixtynine”的时候调酒师都会给大家买酒！,"{service general, 调酒师, positive}","{service general, 调酒师, positive}"
+无尽的乐趣，令人敬畏音乐，很棒员工！！！,"{service general, 员工, positive};{restaurant general, null, positive};{ambience general, 音乐, positive}","{ambience general, 音乐, positive};{restaurant general, null, positive};{service general, 员工, positive}"
+公平菜单选择。,"{food style_options, 菜单选择, neutral}","{food prices, 菜单选择, positive}"
+晚餐的第一部分，有两个淘气的孩子坐在我们附近......后来他们被一个可爱的青春期前儿童所取代，每次在她的餐桌上提到海鲜，她都会假装作呕。,"{restaurant miscellaneous, null, negative}","{ambience general, null, negative};{service general, null, negative}"
+我拒绝了，因为在试图修复鸡蛋的过程中，他们打破了盘子中的其他东西，我太沮丧了，无法继续下去。,"{food quality, 盘子, negative}","{service general, null, negative}"
+有很多菜，但最好的是三种龙虾。,"{food quality, 三种龙虾, positive}","{food style_options, 菜, neutral};{food quality, 三种龙虾, positive}"
+开胃菜 很有趣，但是 焦糖布丁 非常美味可口。,"{food quality, 焦糖布丁, positive};{food quality, 开胃菜, positive}","{food quality, 焦糖布丁, positive};{food style_options, 开胃菜, positive}"
+装饰 美丽而独特。,"{ambience general, 装饰, positive}","{ambience general, 装饰, positive}"
+它新鲜，热情，美味，令人放松。,"{food quality, null, positive};{ambience general, null, positive}","{food quality, null, positive}"
+令人上瘾！,"{restaurant general, null, positive}","{food quality, null, positive}"
+甚至连我通常认为太干的鹰嘴豆都好吃。,"{food quality, 鹰嘴豆, positive}","{food quality, 鹰嘴豆, positive}"
+这地方太棒了！！,"{restaurant general, 地方, positive}","{restaurant general, 地方, positive}"
+"这 是 一个 极大 的 赞美 , 特别 是 在 变化无常 的 餐饮 业 中 , ... 已经 足够 了 !	","{restaurant general, null, positive}","{restaurant general, null, positive}"
+我端着空杯子坐在那里二十多分钟后就离开了。,"{service general, null, negative}","{service general, null, negative}"
+一定要尝尝牡蛎卷。,"{food quality, 牡蛎卷, positive}","{food quality, 牡蛎卷, positive}"
+我很惊讶这个餐厅被归类为$ $ $ 而不是$ $ $ $ 。,"{restaurant prices, 餐厅, negative}","{restaurant prices, 餐厅, negative}"
+还不错，但没有什么特别的。,"{food quality, null, neutral}","{food quality, null, neutral}"
+服务 有点慢，我们的 女服务员 花了很长时间才给我们账单，尽管当时不是很忙。,"{service general, 女服务员, negative};{service general, 服务, negative}","{service general, 女服务员, negative};{service general, 服务, negative}"
+– 很棒饮料、玉米牛肉丁、咖啡、B 快餐卷饼、无麸质菜单。,"{drinks quality, 咖啡, positive};{food style_options, 菜单, positive};{food quality, 玉米牛肉丁, positive};{drinks quality, 饮料, positive};{food quality, B 快餐卷饼, positive}","{food quality, 玉米牛肉丁, positive};{drinks quality, 饮料, positive};{food quality, B 快餐卷饼, positive};{food quality, 无麸质菜单, positive};{drinks quality, 咖啡, positive}"
+午餐菜单 太划算了！,"{food prices, 午餐菜单, positive}","{food prices, 午餐菜单, positive}"
+她花了很长时间才为我们点菜，续水的要求太高了，而且唯一一次她速度很快的是当我们要求结账时，我们才引起了她的注意。,"{service general, null, negative}","{service general, null, negative};{service general, she, negative}"
+服务员有点不友好，感觉餐厅很拥挤。,"{ambience general, 感觉, negative};{service general, 服务员, negative}","{ambience general, 餐厅, negative};{service general, 服务员, negative}"
+– 我最近有幸在第二大街这家令人愉快的餐厅用餐，哇，我们度过了一个多么美好的夜晚。,"{restaurant general, 餐厅, positive}","{restaurant general, 餐厅, positive}"
+这里的特色菜是颓废菜煎饼，但我已经回来过四次了，每次都让我惊叹不已。,"{food quality, 煎饼, positive}","{food quality, 特色菜是颓废菜煎饼, positive}"
+– 在市中心坐下来吃墨西哥菜相当便宜。,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant prices, null, positive}"
+开胃菜：牡蛎、龙虾、螃蟹（小份）对我的妻子来说是一道完美的主菜。,"{food quality, 开胃菜：牡蛎、龙虾、螃蟹（小份, positive}","{food quality, 开胃菜：牡蛎、龙虾、螃蟹（小份, positive}"
+我刚刚发现你可以在晚上和周末拥有一个属于你自己的地方来举办一个私人聚会——迫不及待地想在那里庆祝我的下一个生日。,"{restaurant miscellaneous, 地方, positive}","{restaurant miscellaneous, 地方, positive}"
+– 与西雅图的大多数餐厅一样，Mioposto 的服务很差而且食物价格过高。,"{food prices, 食物, negative};{service general, 服务, negative}","{restaurant prices, Mioposto, negative};{service general, 服务, negative}"
+但你可以很容易地听到他的声音，所以那是一种令人愉快的声音，而不是霸道的。,"{ambience general, null, positive}","{ambience general, null, positive}"
+你亲自去那儿看看吧。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+如果服务不是那么没有人情味和企业化的话，这是一个很棒的地方，有很大的潜力成为社区酒吧。,"{restaurant general, 地方, positive};{service general, 服务, negative}","{restaurant general, 地方, positive};{service general, 服务, negative}"
+墨菲餐厅的 早午餐 美味极了，我的拿手菜... 蛋清煎蛋卷，食物 总是新鲜烹制的。,"{food quality, 蛋清煎蛋卷, positive};{food quality, 早午餐, positive};{food quality, 食物, positive}","{food quality, 早午餐, positive};{food quality, 蛋清煎蛋卷, positive};{food quality, 食物, positive}"
+妈妈咪呀——我就住在这个附近，很幸运能住在这么棒的披萨店附近。,"{restaurant general, 披萨店, positive}","{restaurant general, 披萨店, positive}"
+– 隐藏在比弗利中心附近。,"{location general, null, neutral}","{location general, null, neutral}"
+工作人员非常友好。,"{service general, 工作人员, positive}","{service general, 工作人员, positive}"
+而且服务简直太棒了——令人非常高兴。,"{service general, 服务, positive}","{service general, 服务, positive}"
+好吧...——也许我去的时候正好是某人心情不好的时候......,"{restaurant general, null, negative}","{service general, null, negative}"
+我尝过水母、竹荚鱼、蓝鳍金枪鱼和清酒鱼卷等，味道都很好吃。,"{food quality, 水母, positive};{food quality, 蓝鳍金枪鱼, positive};{food quality, 竹荚鱼, positive};{food quality, 清酒鱼卷, positive}","{food quality, 水母, positive};{food quality, 竹荚鱼, positive};{food quality, 蓝鳍金枪鱼, positive};{food quality, 清酒鱼卷, positive}"
+你还能说什么 很棒 人 很棒 食物 哇哦,"{service general, 人, positive};{food quality, 食物, positive}","{food quality, 食物, positive};{service general, 人, positive}"
+一直都很好。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+之后我觉得口干舌燥，离开餐厅后，喉咙里仍然有股独特的“味精”味道。,"{food quality, null, negative}","{food quality, 味精, negative}"
+噢是的... 视图 也很好。,"{location general, 视图, positive}","{location general, 视图, positive}"
+经理 不断地打断我们说“我还能为您做些什么吗？”，这是一个奇怪的评论，因为她几乎没有听我们说话，更不用说回应我们对这次经历所表达的失望了。,"{service general, 经理, negative}","{service general, 经理, negative}"
+服务从平庸到令人反感。,"{service general, 服务, negative}","{service general, 服务, negative}"
+新鲜原料而且超级美味。,"{food quality, null, positive};{food quality, 原料, positive}","{food quality, 原料, positive};{food quality, null, positive}"
+这家餐厅的氛围很好，适合享用精致的菜肴。,"{ambience general, 氛围, positive}","{ambience general, 氛围, positive};{food quality, 菜肴, positive}"
+而且楼上是一个很棒的闲逛地点。,"{ambience general, 楼上, positive}","{ambience general, 楼上, positive}"
+- 不错 。,"{restaurant general, null, neutral}","{restaurant general, null, positive}"
+我吃了Kafta 盘子，它很完美。,"{food quality, Kafta 盘子, positive}","{food quality, Kafta 盘子, positive}"
+– 这个地方因其早餐而闻名。,"{food quality, 早餐, positive}","{food quality, 早餐, positive}"
+等了 35 分钟才等到一张 8 人桌，对于这么大一群人来说还算可以。,"{service general, null, neutral}","{service general, null, neutral}"
+全体 工作人员 都非常热情周到，照顾到我的每一个需要。,"{service general, 工作人员, positive}","{service general, 工作人员, positive}"
+这个地方真的很不错氛围... 美妙音乐，气氛而且看起来很开心人们。,"{restaurant miscellaneous, 人们, positive};{ambience general, 氛围, positive};{ambience general, 气氛, positive};{ambience general, 音乐, positive}","{ambience general, 人们, positive};{ambience general, 氛围, positive};{ambience general, 音乐, positive}"
+尝试一下主厨精选寿司，因为烟熏黄尾鱼令人难以置信，而且卷也很美味。,"{food quality, 卷, positive};{food quality, 主厨精选寿司, positive};{food quality, 烟熏黄尾鱼, positive}","{food quality, 卷, positive};{food quality, 烟熏黄尾鱼, positive};{food quality, 主厨精选寿司, positive}"
+寿司非常新鲜？你会觉得海洋就在他们家的后院，这可不是开玩笑！,"{food quality, 寿司, positive}","{food quality, 寿司, positive}"
+食物 很好，但比平常 莎莎酱 稍微好吃一点。,"{food quality, 莎莎酱, positive};{food quality, 食物, positive}","{food quality, 莎莎酱, positive};{food quality, 食物, positive}"
+对于挑剔的寿司爱好者和品尝过纽约最佳美食的人来说，鱼是最新鲜的，服务也是一流的。,"{food quality, 鱼, positive};{service general, 服务, positive}","{food quality, 鱼, positive};{service general, 服务, positive}"
+老可靠,"{restaurant general, null, positive}","{restaurant general, 老可靠, positive}"
+镇上最好的寿司店之一。,"{restaurant general, 寿司店, positive}","{restaurant general, 寿司店, positive}"
+从 食物 方面来说，还不错，但是考虑到 餐厅 并不是一个高档的地方，所以价格有点贵。,"{food quality, 食物, neutral};{restaurant prices, 餐厅, negative};{ambience general, 餐厅, neutral}","{restaurant prices, 餐厅, neutral};{food quality, 食物, positive}"
+– 喜欢他们的披萨，尤其是蘑菇披萨。,"{food quality, 披萨, positive};{food quality, 蘑菇披萨, positive}","{food quality, 蘑菇披萨, positive};{food quality, 披萨, positive}"
+它们装在自己精致的外卖盒中，上面涂着一些自制的糖霜；非常清淡而且不太甜。,"{food quality, null, positive}","{food quality, null, positive}"
+享受食物,"{food quality, 食物, positive}","{food quality, 食物, positive}"
+我已经去过这家餐厅十几次了，到目前为止还没有什么抱怨。,"{restaurant general, 餐厅, positive}","{restaurant general, 餐厅, positive}"
+我更喜欢自己点餐然后自己去取，因为我不喜欢那个服务员，尤其是那个年轻女子。,"{service general, 年轻女子, negative};{service general, 服务员, negative}","{service general, 女子, negative};{service general, 服务员, negative}"
+很棒的发现,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+虽然不是最新鲜的海鲜，但是味道和外观还不错。,"{food quality, 海鲜, neutral};{food style_options, 海鲜, neutral}","{food quality, 海鲜, neutral}"
+但价值和服务都严重缺乏。,"{restaurant prices, null, negative};{service general, 服务, negative}","{restaurant prices, null, negative};{service general, 服务, negative}"
+在格拉梅西/联合广场/东村，这是我的邻居，也是我最喜欢的 地点。,"{restaurant general, 地点, positive}","{restaurant general, 地点, positive}"
+土豆配菜美味极了，labne（酸奶酱）也同样美味。,"{food quality, labne（酸奶酱, positive};{food quality, 土豆配菜, positive}","{food quality, 土豆配菜, positive};{food quality, labne（酸奶, positive}"
+惊人的 。,"{restaurant general, null, positive}","{food quality, null, positive}"
+多么美味、酥脆的美食啊！,"{food quality, null, positive}","{food quality, null, positive}"
+很棒食物，更好玛格丽塔酒！,"{drinks quality, 玛格丽塔酒, positive};{food quality, 食物, positive}","{food quality, 食物, positive};{drinks quality, 玛格丽塔酒, positive}"
+服务 确实周到、迷人。,"{service general, 服务, positive}","{service general, 服务, positive}"
+最重要的是，看到这个非常有创意的菜单后，我们对食物感到非常兴奋。,"{food style_options, 菜单, positive}","{food style_options, 菜单, positive}"
+适合 2 人居住的舒适点,"{ambience general, 点, positive}","{ambience general, null, positive}"
+最好的事情是，价格也相当合理。,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+她答应和那位怒气冲冲走的女服务员谈话，但我们很难把她的诺言当真，因为她根本没记下女服务员的名字。,"{service general, null, negative}","{service general, 女服务员, negative}"
+鹰嘴豆咖喱（chana masala）也非常棒。,"{food quality, 鹰嘴豆咖喱（chana masala, positive}","{food quality, 鹰嘴豆咖喱（chana, positive}"
+"这个机构在 Guy Fieri 主持的美食电视节目“DINERS , DRIVE-INS , AND DIVES”播出后（这是反复出现的故事），确实明显衰落了，其中 Schooner or Later 是该节目的主题。","{restaurant general, 机构, negative}","{restaurant miscellaneous, Schooner or Later, negative}"
+我喜欢珍宝蟹，在 Ray's 你可以用大约 6 种不同的方式享用它们！,"{food style_options, 珍宝蟹, positive}","{food quality, 珍宝蟹, positive}"
+食物 很美味，令人胃口大开。,"{food quality, 食物, positive}","{food quality, 食物, positive}"
+这真是太神奇了。,"{restaurant general, null, positive}","{food quality, null, positive}"
+这是一个享用美味餐点的好地方。,"{food quality, 餐点, positive}","{food quality, 餐点, positive}"
+另外，我对米饭过敏，但服务员却非常热情周到——甚至都没有眨一下眼睛！,"{service general, 服务员, positive}","{service general, 服务员, positive}"
+– 我对 Pagoda 的食物非常失望。,"{food quality, 食物, negative}","{food quality, 食物, negative}"
+价格过高,"{restaurant prices, null, negative}","{restaurant prices, null, negative}"
+对于曾经是您吃过的最好的餐厅之一来说，这真是太可悲了。,"{restaurant general, null, negative}","{restaurant general, 餐厅, negative}"
+一旦进入内部，真正的体验就开始了。,"{restaurant general, null, positive}","{ambience general, 内部, positive}"
+服务员推荐了一杯完美的清酒！！,"{drinks quality, 清酒, positive}","{drinks quality, 一杯完美的清酒, positive};{service general, 服务员, positive}"
+业主 对有投诉的客人很挑衅。,"{service general, 业主, negative}","{service general, 业主, negative}"
+您想要的一切，甚至更多，非常新鲜。,"{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive}"
+我的朋友很喜欢烤阿拉斯加帝王鲑鱼搭配美味的奶油华盛顿褐皮土豆和酥脆的青豆。,"{food quality, 奶油华盛顿褐皮土豆, positive};{food quality, 烤阿拉斯加帝王鲑鱼, positive};{food quality, 青豆, positive}","{food quality, 奶油华盛顿褐皮土豆, positive};{food quality, 烤阿拉斯加帝王鲑鱼, positive};{food quality, 青豆, positive}"
+食物非常好，菲力牛排大概是我尝过的最好的。,"{food quality, 菲力牛排, positive};{food quality, 食物, positive}","{food quality, 菲力牛排, positive};{food quality, 食物, positive}"
+– 梅赛德斯餐厅味道太好了，服务无疑棒极了！,"{food quality, null, positive};{service general, 服务, positive}","{food quality, 餐厅, positive};{service general, 服务, positive}"
+我强烈推荐他们的各种萨格和奶豆腐和科尔马。,"{food quality, 科尔马, positive};{food quality, 奶豆腐, positive};{food quality, 萨格, positive}","{food quality, 奶豆腐, positive};{food quality, 萨格, positive};{food quality, 科尔马, positive}"
+食物 很棒，而且他们调制的 血腥玛丽 很美味。,"{drinks quality, 血腥玛丽, positive};{food quality, 食物, positive}","{drinks quality, 血腥玛丽, positive};{food quality, 食物, positive}"
+不错食物但是没有香料！,"{food quality, 食物, positive};{food quality, 食物, negative}","{food quality, 香料, negative};{food quality, 食物, positive}"
+另一个优点是餐厅四周都是玻璃墙，给人一种开放感觉的感觉。,"{ambience general, 感觉, positive}","{ambience general, 餐厅, positive}"
+好吃！,"{food quality, null, positive}","{food quality, null, positive}"
+浴室 本身很小，有两个马桶和一个水槽，女孩一直待在那儿从分配器里取出纸巾。,"{restaurant miscellaneous, 浴室, negative}","{ambience general, 浴室, negative}"
+喜欢辣酱玉米卷饼和鸡汤——一定要尝尝他们的特色菜。,"{food quality, 辣酱玉米卷饼, positive};{food quality, 鸡汤, positive};{food quality, 特色菜, positive}","{food quality, 辣酱玉米卷饼, positive};{food quality, 鸡汤——一定要尝尝他们的特色菜, positive}"
+这食物简直让人难忘！,"{food quality, 食物, positive}","{food quality, 食物, positive}"
+管理层应该真正注意并培训他们的服务员并教他们一些适当的礼仪。,"{service general, 服务员, negative}","{service general, 服务员, negative}"
+工作人员 很友好，装饰 很有道德且色彩缤纷。,"{service general, 工作人员, positive};{ambience general, 装饰, positive}","{ambience general, 装饰, positive};{service general, 工作人员, positive}"
+我吃过的最好的茹万蒸。,"{food quality, 茹万蒸, positive}","{food quality, 茹万蒸, positive}"
+份量对我来说足够了，但对于大胃王来说可能不太够。,"{food style_options, 份量, neutral}","{food style_options, 份量, neutral}"
+尝试一下Insalata 披萨！,"{food quality, Insalata 披萨, positive}","{food quality, Insalata 披萨, positive}"
+我仍然会推荐这个地方。,"{restaurant general, 地方, positive}","{restaurant general, 地方, positive}"
+– 这里的寿司非常好，但是对于 5 美元一份的价格来说，要么鱼片应该更大一些，要么就不应该假装这是一家价格适中的餐厅（即使在纽约）。,"{food prices, 寿司, negative};{food style_options, 寿司, negative};{food quality, 寿司, positive};{restaurant prices, 餐厅, negative}","{food quality, 寿司, positive};{food prices, 寿司, negative}"
+您一定会度过一段非常愉快的时光。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+我们后来又回来了，并且获得了很棒的体验，品尝了更多的小吃和各种各样的啤酒（冰凉、美味）。,"{drinks quality, 啤酒, positive};{restaurant general, null, positive}","{drinks quality, 啤酒（冰凉, positive};{food quality, 小吃, positive}"
+镇上最好的寿司。,"{food quality, 寿司, positive}","{food quality, 寿司, positive}"
+工作人员非常友好，彬彬有礼，而且显然是中国人。,"{service general, 工作人员, positive}","{service general, 工作人员, positive}"
+我们点了一些小盘菜，洋葱圈、山羊奶酪披萨、烤芦笋和炸布里干酪和水果都很好吃。,"{food quality, 烤芦笋, positive};{food quality, 洋葱圈, positive};{food quality, 炸布里干酪和水果, positive};{food quality, 山羊奶酪披萨, positive}","{food quality, 洋葱圈, positive};{food quality, 炸布里干酪和水果, positive};{food quality, 烤芦笋, positive};{food quality, 山羊奶酪披萨, positive}"
+干得好！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+不过，后来我意识到一件事，那就是这家餐厅在牛排上要么用了味精，要么用了嫩肉粉。,"{food quality, 牛排, negative}","{food quality, 牛排, negative}"
+很棒清酒的选择。,"{drinks style_options, 清酒的选择, positive}","{drinks style_options, 清酒的选择, positive}"
+向这些人致敬。,"{restaurant general, null, positive}","{service general, 人, positive}"
+除非你只是来喝几杯，否则我不建议你去这里。,"{restaurant general, null, negative}","{restaurant miscellaneous, null, negative}"
+太棒了（1 瓶酒）。,"{drinks quality, 酒, positive}","{drinks quality, (1 瓶酒, positive}"
+芝麻开门拼盘给出的一大堆食物很划算。,"{food style_options, 芝麻开门拼盘, positive};{food prices, 芝麻开门拼盘, positive}","{food prices, 芝麻开门拼盘, positive};{food style_options, 芝麻开门拼盘, positive};{food quality, 芝麻开门拼盘, positive}"
+被高估太多了！！！,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+值得等待,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+没有比这更好的了。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+我们尝过的最好的蜂蜜核桃虾。,"{food quality, 蜂蜜核桃虾, positive}","{food quality, 蜂蜜核桃虾, positive}"
+他们已经登上了美食网络，这是他们应得的。,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+我喜欢温暖、舒适的环境。,"{ambience general, 环境, positive}","{ambience general, 环境, positive}"
+傲慢态度,"{service general, null, negative}","{service general, null, negative}"
+气氛令人向往，装饰喜庆而令人惊叹……,"{ambience general, 气氛, positive};{ambience general, 装饰, positive}","{ambience general, 装饰, positive};{ambience general, 气氛, positive}"
+他们的特色卷令人印象深刻，尽管我不记得我们吃了什么。,"{food quality, 特色卷, positive}","{food quality, 卷, positive};{food style_options, 卷, positive}"
+– 我很喜欢南瓜馄饨和山羊奶酪面疙瘩（一盘里有 5 个大面疙瘩，而不是 20 个左右的小面疙瘩），我姐姐也很喜欢她菠菜和土豆泥上的菲力牛排。,"{food quality, 南瓜馄饨, positive};{food quality, 山羊奶酪面疙瘩, positive};{food style_options, 山羊奶酪面疙瘩, positive};{food quality, 菠菜和土豆泥上的菲力牛排, positive}","{food quality, 南瓜馄饨, positive};{food quality, 山羊奶酪面疙瘩, positive}"
+份量不是最大 份量 但是足够了。,"{food style_options, 份量, neutral}","{food style_options, 份量, neutral}"
+和一些朋友一起去，喝一杯咖啡等待半个小时左右，享受比平常更多的乐趣早餐。,"{food quality, 早餐, positive};{restaurant general, null, positive}","{restaurant general, null, positive}"
+很棒服务。,"{service general, 服务, positive}","{service general, 服务, positive}"
+然后他们向我们收取了最贵的清酒费（每份 20 美元以上），但实际上我们喝的清酒价格还不到这个价格的一半。,"{service general, null, negative}","{drinks prices, 清酒, negative}"
+可口的,"{food quality, null, positive}","{food quality, null, positive}"
+咖喱鸡和鸡肉咖喱是我最喜欢的肉类菜肴。,"{food quality, 咖喱鸡, positive};{food quality, 鸡肉咖喱, positive}","{food quality, 咖喱鸡和鸡肉咖喱, positive}"
+世界上最好的餐厅、优秀装饰、优秀客户服务、友好经理,"{service general, 经理, positive};{restaurant general, 餐厅, positive};{ambience general, 装饰, positive};{service general, 客户服务, positive}","{ambience general, 装饰, positive};{restaurant general, 餐厅, positive};{service general, 客户服务, positive};{service general, 经理, positive}"
+饮料 很好。,"{drinks quality, 饮料, positive}","{drinks quality, 饮料, positive}"
+食物 的呈现是额外的奖励，它看起来和尝起来一样棒！,"{food quality, 食物, positive};{food style_options, 食物, positive}","{food style_options, 食物, positive}"
+即使如此，订单仍然不正确，我们仍在等待几件物品。,"{service general, null, negative}","{service general, null, negative}"
+– 有一次我们在这里吃早餐时受到了非常粗鲁的对待。,"{service general, null, negative}","{service general, null, negative}"
+美味食物、绝佳位置和友好服务让我们年复一年地光临。,"{location general, 位置, positive};{food quality, 食物, positive};{service general, 服务, positive}","{location general, 位置, positive};{food quality, 食物, positive};{service general, 服务, positive}"
+哇 ！ ！ ！ ！ ！ ！ ！ ！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– 避免浪费时间，不要前往。,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+食物 很美味，又便宜。,"{food quality, 食物, positive};{food prices, 食物, positive}","{food quality, 食物, positive};{food prices, 食物, positive}"
+嗯嗯...好！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+如果你在那里度过一天并且不想开车去吃饭，那就太好了。,"{location general, null, positive}","{restaurant miscellaneous, null, positive}"
+总而言之，我不得不说 Ray's Boathouse 值得拥有西雅图机构的称号。,"{restaurant general, Ray's Boathouse, positive}","{restaurant miscellaneous, Ray's Boathouse, positive}"
+非常超值寿司，品质高，而且很漂亮设置。,"{ambience general, 设置, positive};{food prices, 寿司, positive};{food quality, 寿司, positive}","{food quality, 寿司, positive};{food style_options, 寿司, positive};{food prices, 寿司, positive}"
+虽然份量太多，我几乎吃不完，但是我还是吃完了，因为它太美味了。,"{food style_options, null, neutral};{food quality, null, positive}","{food style_options, 份量, negative};{food quality, null, positive}"
+我喜欢这个餐厅,"{restaurant general, 餐厅, positive}","{restaurant general, 餐厅, positive}"
+不推荐！！！,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+我们在那里站了 10 分钟，而员工来回走动，无视我们。,"{service general, 员工, negative}","{service general, 员工, negative}"
+我和我的女朋友都认为食物非常平庸，尤其是考虑到价格。,"{food prices, 食物, negative};{food quality, 食物, negative}","{food quality, 食物, negative};{food prices, 食物, negative}"
+– 这里的食物令人难以置信，尽管午餐的质量不稳定。,"{food quality, 午餐, negative};{food quality, 食物, positive}","{food quality, 午餐, negative};{food quality, 食物, positive}"
+对于这个地方我并没有什么不好的评价。,"{restaurant general, 地方, positive}","{restaurant general, 地方, positive}"
+唯一的问题是你真的必须先加热披萨然后才能食用，即使你提前订购也是如此。,"{food quality, 披萨, negative}","{food quality, 披萨, negative}"
+– 这是我“必须带外地客人去”的餐厅，他们总是很喜欢它并对其赞不绝口。,"{restaurant general, 餐厅, positive}","{restaurant miscellaneous, 餐厅, positive}"
+我吃了kafta 盘并且我很喜欢它。,"{food quality, kafta 盘, positive}","{food quality, kafta 盘, positive}"
+很显然他并不真的关心。,"{service general, null, negative}","{service general, null, negative}"
+我点的凯撒沙拉柠檬太多了，我吃不下去。,"{food quality, 凯撒沙拉, negative}","{food quality, 凯撒沙拉, negative}"
+我们的服务员整个晚上都很细心，但我仍然对一个问题感到困惑：谁认为Ray's是带小孩子去吃饭的合适地方？,"{restaurant miscellaneous, Ray's, neutral};{service general, 服务员, positive}","{restaurant miscellaneous, Ray's, negative};{service general, 服务员, positive}"
+"好 食物 , 很好 服务 , 平均价格 ( 拉斯维加斯大道 )","{restaurant prices, null, neutral};{food quality, 食物, positive};{service general, 服务, positive}","{food prices, 食物, neutral};{food quality, 食物, positive};{service general, 服务, positive}"
+星期六下午 6 点，百老汇戏剧演出前，我们很快就入座并得到了服务。,"{service general, null, positive}","{service general, 服务, positive}"
+他们对一切都非常细心，从味噌汤到复杂卷。,"{food quality, 卷, positive};{food quality, 味噌汤, positive}","{food quality, 卷, positive};{food quality, 味噌汤, positive}"
+加上小费共计 6 美元。,"{restaurant prices, null, positive}","{service general, null, negative}"
+气氛很棒。,"{ambience general, 气氛, positive}","{ambience general, 气氛, positive}"
+换句话说，如果他们没有从您身上赚钱，那么您在他们的“服务等级”上的评分就不会很高。,"{service general, 服务, negative}","{restaurant prices, null, negative};{service general, 服务等级, negative}"
+– 我真的很喜欢在这里吃的顿饭。,"{food quality, 顿饭, positive}","{food quality, 饭, positive}"
+播放的音乐很时髦，有20-30首流行音乐，但音响系统的低音炮却位于我的座位下方，这在晚餐时变得很烦人。,"{ambience general, 音响系统的低音炮, negative};{ambience general, 音乐, positive}","{ambience general, 音响系统, negative};{ambience general, 低音炮, negative};{ambience general, 音乐, positive}"
+神圣鹰嘴豆泥！,"{food quality, 鹰嘴豆泥, positive}","{food quality, 鹰嘴豆泥, positive}"
+作为我的主菜���我非常喜欢烤阿拉斯加海扇贝搭配瑞士甜菜、洋蓟心、茴香和托斯卡纳佩科里诺奶酪。,"{food quality, 烤阿拉斯加海扇贝, positive};{food style_options, 烤阿拉斯加海扇贝, positive}","{food quality, 烤阿拉斯加海扇贝搭配瑞士甜菜、洋蓟心、茴香和托斯卡纳佩科里诺奶酪, positive}"
+装饰是质朴的、传统的日本风格。,"{ambience general, 装饰, neutral}","{ambience general, 装饰, positive}"
+不仅选择可以具有创新性，而且传统寿司也能保持良好的平衡。,"{food style_options, 寿司, positive};{food style_options, 选择, positive}","{food style_options, null, positive};{food quality, 寿司, positive}"
+你很可能会失望。,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+食物 很棒，调酒师 也尽心尽力。,"{service general, 调酒师, positive};{food quality, 食物, positive}","{service general, 调酒师, positive};{food quality, 食物, positive}"
+该餐厅提供丰富的酒单和您难忘的氛围！,"{ambience general, 氛围, positive};{drinks style_options, 酒单, positive}","{ambience general, 氛围, positive};{drinks style_options, 酒单, positive}"
+馕 是我吃过的最好的食物之一，我真的很喜欢 巴达，番茄味不太重。,"{food quality, 馕, positive};{food quality, 巴达, positive}","{food quality, 馕, positive};{food quality, 番茄味不太重, positive}"
+致芝麻开门的主人......太棒了......我迫不及待地想回来到你们的餐厅吃饭！,"{restaurant general, 芝麻开门, positive}","{restaurant general, 芝麻开门的主人, positive}"
+尽管鱼切得很薄，但它很新鲜。,"{food style_options, 鱼, negative};{food quality, 鱼, positive}","{food quality, 鱼, positive}"
+从那时起我去过那里很多次，每次都过得很愉快。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+我最喜欢的西雅图餐厅披萨店,"{restaurant general, 披萨店, positive}","{restaurant general, 披萨店, positive}"
+我强烈推荐这个地方给所有第一次想尝试印度美食的人。,"{food quality, 印度美食, positive}","{restaurant miscellaneous, 地方, positive}"
+被高估了,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+我经历过的最差服务,"{service general, 服务, positive}","{service general, 服务, negative}"
+事实证明，老板就坐在我们旁边，当他过来检查我们的问题时，却不屑一顾，只给我们的账单象征性地提供了 20% 的折扣。,"{service general, 老板, negative}","{service general, 老板, negative}"
+一天晚上，我和一些朋友去那里玩宾果游戏并观看红袜队的比赛，真是太棒了！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+完全被高估了！,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+– 鸡蛋、煎饼、土豆、新鲜水果和酸奶——他们供应的一切都十分美味。,"{food quality, null, positive};{food quality, 土豆, positive};{food quality, 煎饼, positive};{food quality, 鸡蛋, positive};{food quality, 新鲜水果, positive};{food quality, 酸奶, positive}","{food quality, 新鲜水果, positive};{food quality, 酸奶, positive};{food quality, 土豆, positive};{food quality, 鸡蛋, positive};{food quality, 煎饼, positive}"
+– Ray's 是享受高品质海鲜晚餐的最佳去处。,"{food quality, 海鲜晚餐, positive}","{food quality, 海鲜, positive}"
+我也非常喜欢小餐馆的简洁装饰和亲密感觉。,"{ambience general, 装饰, positive};{ambience general, 感觉, positive}","{ambience general, 装饰, positive};{ambience general, 感觉, positive}"
+我们要回去了。：D,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+我本该想到要提起这件事，但没想到食物会那么清淡。,"{food quality, 食物, negative}","{food quality, 食物, negative}"
+当我走进去时，我被他们令人难以置信的木质装饰震惊了。,"{ambience general, 木质装饰, positive}","{ambience general, 木质装饰, positive}"
+这是一家很小的地方所以如果你在周末（星期四 - 星期日）晚上 8 点之前到达那里，你会发现更容易在寿司吧找到一张桌子或一个座位。,"{restaurant miscellaneous, 地方, neutral}","{restaurant miscellaneous, 地方, positive}"
+最佳邻居待命。,"{restaurant general, 待命, positive}","{restaurant general, null, positive}"
+我会立刻再回去那里。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+价格非常合理，尤其是考虑到食物的质量。,"{food prices, 食物, positive}","{food prices, 食物, positive};{food quality, 食物, positive}"
+有足够的食物，相信我。,"{food style_options, 食物, positive}","{food style_options, 食物, positive}"
+这里是二人浪漫约会或秘密幽会的完美地点！,"{restaurant miscellaneous, 地点, positive};{ambience general, 地点, positive}","{restaurant miscellaneous, 地点, positive}"
+还有很棒的玛格丽塔酒！,"{drinks quality, 玛格丽塔酒, positive}","{drinks quality, 玛格丽塔酒, positive}"
+它很朴实，很隐秘。,"{ambience general, null, positive}","{ambience general, null, positive}"
+这个地方是我妈妈做的饭菜以外最好的。,"{food quality, null, positive}","{food quality, 地方, positive}"
+最佳地点是在游艇周围享用休闲的周日早餐，然后漫步到附近的农贸市场。,"{restaurant miscellaneous, 地点, positive}","{restaurant miscellaneous, 地点, positive}"
+如果可以的话，乘船来到这个地方并玩上一整个晚上。,"{restaurant miscellaneous, 地方, positive}","{restaurant general, 地方, positive}"
+我们吃的甜点是芒果姜汁焦糖布丁...噢啦啦，美味极了！！！,"{food quality, 芒果姜汁焦糖布丁, positive}","{food quality, 芒果姜汁焦糖布丁, positive}"
+等待是值得的，特别是当桌子准备好时他们会给你打电话。,"{restaurant general, null, positive}","{service general, 等待, positive}"
+他们拥有种类繁多的鱼，甚至列出了它们来自哪个大洋：大西洋或太平洋。,"{food style_options, 鱼, positive}","{food style_options, 鱼, positive}"
+嗯，我想，当一个人对工作人员来说是看不见的，那么就座是很难的。,"{service general, 工作人员, negative}","{service general, 工作人员, negative};{restaurant miscellaneous, null, negative}"
+非常开放和友好氛围。,"{ambience general, 氛围, positive}","{ambience general, 氛围, positive}"
+用餐结束后与经理的简短交谈让我们感到非常失望——说我们“被冷落”也是一种轻描淡写。,"{service general, 经理, negative}","{service general, 经理, negative}"
+Ray's 是西雅图的一家老店，但考虑到它的美丽海峡景观，我曾怀疑它的荣誉更多是归功于它的风景，而不是它的食物和服务。,"{location general, 海峡景观, positive}","{location general, 海峡景观, positive};{restaurant general, Ray's, positive};{food quality, 食物, positive};{service general, 服务, positive}"
+我发誓再也不回来吃温热的啤酒和平庸的饭菜了。,"{drinks quality, 啤酒, negative};{food quality, 饭菜, negative}","{food quality, 饭菜, negative};{drinks quality, 啤酒, negative}"
+如果外面天气好的话，可以要求一张阳台的桌子。,"{ambience general, 阳台, positive}","{ambience general, 阳台的桌子, positive}"
+很棒食物，超棒氛围！,"{ambience general, 氛围, positive};{food quality, 食物, positive}","{ambience general, 氛围, positive};{food quality, 食物, positive}"
+我以一种不寻常的方式结束了这顿晚餐波特酒和巧克力品尝甜点......真好吃！,"{food quality, 波特酒和巧克力品尝甜点, positive}","{drinks quality, 波特酒, positive};{food quality, 甜点, positive}"
+我吃了贝类和虾开胃菜，味道还不错。,"{food quality, 贝类和虾开胃菜, neutral}","{food quality, 贝类和虾开胃菜, positive}"
+披萨 皮很薄，菜单 提供非常有创意的组合和配料。,"{food style_options, 披萨, positive};{food style_options, 菜单, positive}","{food style_options, 菜单, positive};{food quality, 披萨, positive}"
+这是一个享受美食和会见朋友的好地方。,"{food quality, 美食, positive};{restaurant miscellaneous, 地方, positive}","{restaurant general, 地方, positive}"
+服务 非常棒，咖啡 甚至按照星巴克的标准来看也很不错，食物 非常出色。,"{drinks quality, 咖啡, positive};{food quality, 食物, positive};{service general, 服务, positive}","{food quality, 食物, positive};{service general, 服务, positive};{drinks quality, 咖啡, positive}"
+这是地方放松和享受业界所能提供的最优质食物。,"{ambience general, 地方, positive};{food quality, 食物, positive}","{food quality, 食物, positive}"
+我会独自回去体验葡萄酒。,"{drinks quality, 葡萄酒, positive}","{restaurant general, null, positive}"
+西雅图最好的鱿鱼！,"{food quality, 鱿鱼, positive}","{food quality, 鱿鱼, positive}"
+斯努兹 的摆设非常精美，是那种只要你到那里就会感觉自己更高级的地方；但剥开层层外衣，你就会发现这是一家价格过高的 IHOP，而且菜单高档 菜单。,"{restaurant prices, 斯努兹, negative};{food style_options, 菜单, negative};{ambience general, 斯努兹, positive}","{ambience general, 排列, positive};{food prices, 高档 菜单, negative};{food prices, null, negative};{ambience general, 摆设, positive}"
+我向经理投诉，但他甚至没有道歉。,"{service general, 经理, negative}","{service general, 经理, negative}"
+不仅仅是一个伟大的景观！,"{location general, 景观, positive}","{location general, 景观, positive}"
+气氛还不错。,"{ambience general, 气氛, neutral}","{ambience general, 气氛, positive}"
+坐下后大约花了 30 分钟才终于吃到饭。,"{service general, null, negative}","{service general, null, negative}"
+– 在餐厅不断削减成本的时代，很高兴看到有一家餐厅能够逆势而上，提供高品质食物和优质服务的服务，仅此而已。,"{food quality, 食物, positive};{service general, 服务, positive}","{food quality, 食物, positive};{service general, 服务, positive}"
+我非常喜欢氛围，但是食物不值这个价。,"{food prices, 食物, negative};{ambience general, 氛围, positive};{food quality, 食物, negative}","{ambience general, 氛围, positive};{food prices, 食物, negative}"
+它位于比佛利购物中心附近的一个商业街上，虽然不是最好的位置，但是食物让我不断回来。,"{location general, 位置, neutral};{food quality, 食物, positive}","{location general, 位置, negative};{food quality, 食物, positive}"
+在我的餐中，我不得不退回我的鸡蛋，因为一个简单的要求是在烹饪之前打碎蛋黄，如果我没有完全拒绝餐的话，我就不得不再次将它们送回。,"{food quality, 鸡蛋, negative};{food quality, 餐, negative}","{food quality, 鸡蛋, negative}"
+乐队 非常棒而且 服务 很周到。,"{ambience general, 乐队, positive};{service general, 服务, positive}","{ambience general, 乐队, positive};{service general, 服务, positive}"
+– 如何形容纽约最好的寿司：嗯，美味，惊人，极好，多汁，完美，不，以上皆是。,"{food quality, 寿司, positive}","{food quality, 寿司, positive}"
+– Schooner or Later 的迷人之处位于长滩码头的位置和平凡之处食物遗憾的是无法弥补其极差的品质客户服务。,"{service general, 客户服务, negative};{location general, 位于长滩码头的位置, positive};{food quality, 食物, neutral}","{location general, 位于长滩码头, positive};{food quality, 食物, negative};{service general, 客户服务, negative}"
+我们马上就坐了，那张桌子很私密，很舒适。,"{ambience general, table, positive};{ambience general, 桌子, positive}","{ambience general,桌子, positive}"
+好清酒，好食物——说实话，我根本不太了解日本食物。,"{drinks quality, 清酒, positive};{food quality, 食物, positive}","{drinks quality, 清酒, positive};{food quality, 食物, positive};{food quality, 日本食物, positive}"
+带上您的手机，因为您可能需要等待才能进入世界上最好的寿司餐厅：蓝带寿司。,"{restaurant general, 蓝带寿司, positive}","{restaurant general, 蓝带寿司, positive}"
+最后我们花了 27 美元，吃了 4 小份（2 份煎饼）、一份（3 份早餐卷饼）、一份（4 份橙汁）和一份（5 份冰茶）（我喝了水）。,"{food prices, 煎饼, negative};{drinks prices, 冰茶, negative};{food prices, 早餐卷饼, negative};{food style_options, 煎饼, negative};{drinks prices, 橙汁, negative}","{drinks prices, (5 份冰茶, positive};{drinks prices, (4 份橙汁, positive};{food prices, 4 小份（2 份煎饼, positive};{food prices, 3 份早餐卷饼, positive}"
+好食物！,"{food quality, 食物, positive}","{food quality, 食物, positive}"
+餐饮 令人难以置信，而且 Raouls 鸡肉蔬菜汤 震撼了我的世界！！！,"{food quality, Raouls 鸡肉蔬菜汤, positive};{food quality, 餐饮, positive}","{food quality, 鸡肉蔬菜汤, positive};{food quality, 餐饮, positive}"
+当我看到那个时我应该直接要求结账；但是他们的菜单是如此独特所以我继续吃了。,"{food style_options, 菜单, positive}","{food style_options, 菜单, positive}"
+很棒早餐,"{food quality, 早餐, positive}","{food quality, 早餐, positive}"
+龙虾烩饭鲈鱼是最好的。,"{food quality, 龙虾烩饭鲈鱼, positive}","{food quality, 龙虾烩饭鲈鱼, positive}"
+– 无论您是想庆祝什么特殊场合，这里的氛围都非常棒。,"{ambience general, 氛围, positive}","{ambience general, 氛围, positive}"
+很棒时令鱼和海鲜，而且很优雅海滨环境。,"{ambience general, 海滨环境, positive};{food quality, 时令鱼, positive};{food quality, 海鲜, positive}","{ambience general, 海滨环境, positive};{food quality, 时令鱼, positive};{food quality, 海鲜, positive}"
+披萨 不是很大而且 饼皮 很薄... 点餐时请记住这一点。,"{food style_options, 披萨, neutral};{food style_options, 饼皮, neutral}","{food style_options, 披萨, negative};{food quality, 饼皮, negative}"
+Mioposto 唯一的优点是其优越的位置。,"{location general, 位置, positive}","{location general, Mioposto, positive}"
+我也很欣赏他们的送货。,"{service general, 送货, positive}","{service general, 送货, positive}"
+非常失望。,"{restaurant general, null, negative}","{food quality, null, negative}"
+披萨 很美味，沙拉 也棒极了。,"{food quality, 披萨, positive};{food quality, 沙拉, positive}","{food quality, 披萨, positive};{food quality, 沙拉, positive}"
+最新鲜的寿司——我喜欢这个餐厅。,"{restaurant general, 餐厅, positive};{food quality, 寿司, positive}","{food quality, 寿司, positive}"
+牛排 做得完全符合我的口味 (半熟)，而且美味多汁。,"{food quality, 牛排, positive}","{food quality, 牛排, positive}"
+说实话，如果您追求的是朴实无华的当地乐趣，那么来这里准没错。,"{ambience general, null, positive}","{restaurant miscellaneous, null, positive}"
+业主 非常有趣，啤酒选择 值得一去。,"{service general, 业主, positive};{drinks style_options, 啤酒选择, positive}","{drinks style_options, 啤酒选择, positive};{service general, 业主, positive}"
+很棒生啤酒和瓶装啤酒选择而且披萨很棒。,"{food quality, 披萨, positive};{drinks style_options, 生啤酒和瓶装啤酒选择, positive}","{drinks style_options, 瓶装啤酒选择, positive};{food quality, 披萨, positive};{drinks quality, 生啤酒, positive}"
+我保证你不会失望，这里还有代客停车服务。,"{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, 代客停车服务, positive}"
+享用美味的夜宵食物。,"{food quality, 食物, positive}","{food quality, 夜宵食物, positive}"
+不过 份量 很大，所以不要点太多。,"{food style_options, 份量, neutral}","{food style_options, 份量, neutral}"
+绝对是我很长时间以来见过的最好的点唱机之一。,"{ambience general, 点唱机, positive}","{restaurant general, 点唱机, positive}"
+服务 不错。,"{service general, 服务, neutral}","{service general, 服务, positive}"
+绝对美味。,"{food quality, null, positive}","{food quality, null, positive}"
+噢，还有奶酪薯条太棒了！,"{food quality, 奶酪薯条, positive}","{food quality, 奶酪薯条, positive}"
+坐在外面后排的每个人都同意这是我们所经历过的最差的服务。,"{service general, 服务, negative}","{service general, 服务, negative}"
+我可能不是寿司大师，但我可以告诉你，这里的食物只是一般，没有什么特别之处。,"{food quality, 食物, negative}","{food quality, 食物, negative}"
+优秀食物，不错氛围，相当昂贵,"{restaurant prices, null, negative};{ambience general, 氛围, positive};{food quality, 食物, positive}","{ambience general, 氛围, neutral};{food quality, 食物, positive};{food prices, 食物, negative}"
+入口即化握寿司和生鱼片，而且非常美味卷寿司。,"{food quality, 握寿司, positive};{food quality, 生鱼片, positive};{food quality, 卷寿司, positive}","{food quality, 抱握寿司, positive};{food quality, 卷寿司, positive};{food quality, 生鱼片, positive};{food quality, 入口即化, positive}"
+最后，这是一顿令您终生难忘的餐饭！,"{food quality, 餐, positive}","{food quality, 餐饭, positive}"
+最好食物，卓越服务,"{food quality, 食物, positive};{service general, 服务, positive}","{food quality, 食物, positive};{service general, 服务, positive}"
+如果您想挥霍一晚，我推荐您来这里！（有点贵）,"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}"
+虽然这家餐馆的食物相当不错，但是餐厅工作人员似乎对我们的存在完全漠不关心，这种态度反映在服务的缺乏上。,"{service general, 餐厅工作人员, negative};{food quality, 食物, positive}","{service general, 服务, negative};{food quality, 食物, positive}"
+无可比性,"{restaurant general, null, positive}","{food quality, null, positive}"
+所以关于虾，它们很新鲜并且面糊有点脆......非常好......核桃被切成小块并且非常脆并且很好吃。,"{food quality, 虾, positive};{food quality, 面糊, positive};{food quality, 核桃, positive}","{food quality, 核桃, positive};{food quality, 虾, positive};{food quality, 面糊, positive}"
+我很高兴我家附近有一家很棒的意大利餐厅。,"{restaurant general, 意大利餐厅, positive}","{restaurant general, 意大利餐厅, positive}"
+我们等了一个小时才有座位。,"{service general, null, negative}","{service general, null, negative}"
+我们下了订单，虽然我们点了 4 份开胃菜，但食物直到 45 分钟后才送来......还有主菜。,"{service general, null, negative}","{service general, null, negative}"
+我已经等不及这个周末再回去了！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+如果您对美味（没有鱼的味道或气味）、大份份量和有创意寿司菜肴感兴趣，那么这里就是您的最佳选择……,"{food style_options, 份量, positive};{food quality, null, positive};{food style_options, 寿司菜肴, positive}","{food quality, 寿司菜肴, positive};{food style_options, 份量, positive}"
+一年中任何时候，这里都是接待外地客人的完美之地。,"{restaurant general, 地, positive}","{restaurant miscellaneous, 地方, positive}"
+我品尝了她盘子里的所有三道菜，味道都很棒。,"{food quality, 盘子, positive}","{food quality, 盘子里的��有三道菜, positive}"
+适合无需预订的深夜用餐（最后一刻计划）。,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+我从来没有对那里的食物失望过。,"{food quality, 食物, positive}","{food quality, 食物, positive}"
+– 迄今为止东村最好的酒吧……,"{restaurant general, 酒吧, positive}","{drinks quality, 酒吧, positive}"
+这是一个非常适合观赏人们的地方。,"{restaurant miscellaneous, 地方, positive}","{ambience general, 地方, positive}"
+空间 有限，但是 食物 弥补了这一点。,"{food quality, 食物, positive};{restaurant miscellaneous, 空间, negative}","{ambience general, 空间, negative};{food quality, 食物, positive}"
+扇贝 显然是用黑橄榄黄油烹制的，这确实使它们独一无二（更不用说美味了）。,"{food quality, 扇贝, positive};{food style_options, 扇贝, positive}","{food quality, 扇贝, positive};{food style_options, 扇贝, positive}"
+这个地方很迷人，让人放松。,"{ambience general, 地方, positive}","{ambience general, 地方, positive}"
+一点儿也不耐嚼。,"{food quality, null, positive}","{food quality, null, negative}"
+我们只在西雅图呆了一晚，我很高兴我们选择了光芒作为晚餐！,"{restaurant general, 光芒, positive}","{restaurant general, 光芒, positive}"
+– 我永远不会忘记在这家餐厅体验到的令人惊叹的饭菜、服务和氛围。,"{ambience general, 氛围, positive};{food quality, 饭菜, positive};{service general, 服务, positive}","{ambience general, 氛围, positive};{food quality, 饭菜, positive};{service general, 服务, positive}"
+令人惊叹西班牙鲭鱼特色开胃菜和完美盒装寿司（那鳗鱼配鳄梨——嗯嗯嗯）。,"{food quality, 盒装寿司, positive};{food quality, 鳗鱼配鳄梨, positive};{food quality, 西班牙鲭鱼特色开胃菜, positive}","{food quality, 西班牙鲭鱼特色开胃菜, positive};{food quality, 箱装寿司（那鳗鱼配鳄梨, positive}"
+在周末，您可能需要等待几个小时。,"{service general, null, neutral}","{restaurant miscellaneous, null, negative}"
+– 食物 不太好 & 服务员 很粗鲁。,"{food quality, 食物, negative};{service general, 服务员, negative}","{service general, 服务员, negative};{food quality, 食物, negative}"
+接下来是9 盎司牛排，味道很棒，至少一开始是这样的。,"{food quality, 9 盎司牛排, positive}","{food quality, 9 盎司牛排, positive}"
+当我到达那里时，我坐在楼上，那里的气氛很舒适，但服务却很糟糕！,"{ambience general, 气氛, positive};{service general, 服务, negative}","{ambience general, 气氛, positive};{service general, 服务, negative}"
+酒单令人难以置信，种类繁多，食物全都令人难以置信，工作人员都非常友好，工作出色，有文化。,"{service general, 工作人员, positive};{drinks style_options, 酒单, positive};{food quality, 食物, positive}","{service general, 工作人员, positive};{drinks style_options, 酒单, positive};{food quality, 食物, positive};{service general, 工作出色, positive}"
+– 不可能再好了！！！！！！！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+星期天下午有乐队演奏，非常有趣。,"{ambience general, 乐队, positive}","{ambience general, null, positive}"
+一切，我的意思是菜单上的一切都是美味的。,"{food quality, 菜单上, positive}","{food quality, 菜单, positive}"
+我知道很多人都有自己喜欢的披萨类型和披萨餐厅，但是 Mioposto 的披萨质量不佳，味道也不好。,"{food quality, 披萨, negative}","{food quality, 披萨, negative};{food style_options, 披萨, negative}"
+东海岸只有一个地方拥有这一切，甚至更多。,"{restaurant general, 地方, positive}","{restaurant general, null, positive}"
+永远是赢家。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+之前的评论说对孩子很友好... 让我带着两个小孩休息一下，这真是太轻松了。,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, positive}"
+披萨 又清淡又美味。,"{food quality, 披萨, positive}","{food quality, 披萨, positive}"
+看看墙上的艺术品，颜色非常丰富多彩！,"{ambience general, 墙上的艺术品, positive}","{ambience general, 壁上的艺术品, positive}"
+平庸食物,"{food quality, 食物, neutral}","{food quality, 食物, negative}"
+我再也不会回来了。,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+我们费了好大劲才引起女服务员的注意，最后不得不起身走进去和经理谈话。,"{service general, 女服务员, negative}","{service general, 女服务员, negative}"
+永远不会太拥挤而且总是很棒服务。,"{restaurant miscellaneous, null, positive};{service general, 服务, positive}","{restaurant miscellaneous, null, positive};{service general, 服务, positive}"
+你和一个热辣的约会对象在一起，他/她很想吃寿司...那么这里可能就是你要找的地方。,"{food quality, 寿司, positive}","{restaurant miscellaneous, 地方, positive}"
+— 我简直不敢相信Murphy's已经存在了 25 多年，太神奇了。,"{restaurant miscellaneous, Murphy's, positive}","{restaurant general, Murphy's, positive}"
+周五可能会很忙，但是一旦入座，服务非常高效，您可以快速进出。,"{service general, 服务, positive}","{service general, 服务, positive}"
+它可搭配胡椒酱或红酒浓汁一起食用，但两者的味道难以区分。,"{food quality, 胡椒酱, neutral};{food quality, 红酒浓汁, neutral}","{food quality, null, negative}"
+城里最友善的 服务员。,"{service general, 服务员, positive}","{service general, 服务员, positive}"
+服务很礼貌，很周到。,"{service general, 服务, positive}","{service general, 服务, positive}"
+在撰写本文时，我刚刚再次尝试了他们提供的链接，但仍然不起作用。,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}"
+由于没有人在桌边停留，所以我们可能有的任何其他需求都无法得到满足。,"{service general, null, negative}","{service general, null, negative}"
+好寿司，价格高,"{food prices, 寿司, negative};{food quality, 寿司, positive}","{food quality, 寿司, positive};{food prices, 寿司, negative}"
+但是服务员非常细心，非常友好。,"{service general, 服务员, positive}","{service general, 服务员, positive}"
+各位朋友，我去过这个地方，那里很糟糕。,"{restaurant general, 地方, negative}","{restaurant general, 地方, negative}"
+很棒服务,"{service general, 服务, positive}","{service general, 服务, positive}"
+这就像在一家完全不同的餐厅用餐一样。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+竖起两个大拇指！,"{food quality, null, positive}","{restaurant general, null, positive}"
+想象一下，当我发现观点仅仅是Ray 的的第三好东西时，我有多么惊喜！,"{restaurant general, Ray 的, positive};{location general, 观点, positive}","{food quality, 观点, positive}"
+毫无疑问，这是我吃过的最好吃的金枪鱼。,"{food quality, 金枪鱼, positive}","{food quality, 金枪鱼, positive}"
+如果您要去看丹尼·甘斯 (Danny Gans) 或者只是在 Mirage 酒店住宿，千万不要错过这个。,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+很棒午餐地点,"{restaurant general, 午餐地点, positive}","{restaurant general, 地点, positive}"
+我喜欢这里的早餐。,"{food quality, 早餐, positive}","{food quality, early breakfast, positive}"
+生鱼片 是我尝过的最好吃、最鲜嫩的。,"{food quality, 生鱼片, positive}","{food quality, 生鱼片, positive}"
+他们的菜单一定不会令你失望。,"{food style_options, 菜单, positive}","{food style_options, 菜单, positive}"
+很多人都在谈论好吃的披萨和差的服务，所以这不可能只是少数不满意的顾客的牢骚。,"{food quality, 披萨, positive};{service general, 服务, negative}","{food quality, 披萨, positive};{service general, 服务, negative}"
+我不会回去。,"{restaurant general, null, negative}","{restaurant general, null, negative}"
+我的服务非常出色！,"{service general, 服务, positive}","{service general, 服务, positive}"
+我们肯定会再来这家餐厅。,"{restaurant general, 餐厅, positive}","{restaurant general, 餐厅, positive}"
+一定会回来的。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+也许在某个千载难逢的晚上，当厨师决定使用还算不错的鱼时，这道菜会很不错。,"{food quality, 鱼, negative}","{food quality, 鱼, neutral}"
+– 我只去过芝麻开门一次，但我仍然对这次经历感到震惊！！,"{restaurant general, 芝麻开门, positive}","{restaurant general, 芝麻开门, negative}"
+煎饼 确实很有创意，但是煎饼套餐（ 3 种不同的 煎饼 样品）中 3-6 英寸 煎饼（其中一个更像是 5 英寸）的价格为 8.50 美元，这确实太贵了。,"{food prices, 煎饼, negative};{food style_options, 煎饼, positive}","{food quality, 煎饼, positive};{food style_options, 煎饼套餐, negative};{food prices, 煎饼套餐, negative}"
+然而，一个星期天下午，我和我的丈夫去了（尽管我大声抗议），并且感到很惊喜。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+非常值得,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+注意——对于热爱极品的人来说，它是真正的食物。,"{food quality, 食物, positive}","{food quality, null, positive}"
+我有一个但是——卫生间里有一名卫生间服务员，这很奇怪。,"{restaurant miscellaneous, 卫生间, negative}","{service general, 卫生间服务员, negative}"
+最好的菜是亲爱���核桃虾——非常出色。,"{food quality, 亲爱的核桃虾, positive}","{food quality, 核桃虾, positive}"
+即使提供独特的菜肴，煎饼也应该更大（至少 8 英寸）才能证明花费是合理的。,"{food style_options, 煎饼, negative}","{food style_options, 煎饼, negative};{food quality, 菜肴, positive};{food prices, 煎饼, negative}"
+– 我第一次来这家餐厅吃饭是和我儿子一起，那真是太糟糕了！,"{restaurant general, 餐厅, negative}","{restaurant general, 餐厅, negative}"
+出色的,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+停车场相当不错，他们有自己的停车场，你也可以把车停在附近的公园。,"{restaurant miscellaneous, null, positive}","{parking general, 停车场, positive}"
+凯撒沙拉非常棒。,"{food quality, 凯撒沙拉, positive}","{food quality, 凯撒沙拉, positive}"
+— 我不明白我怎么会对这个地方陌生这么久...法士达沙拉，科罗拉多，法士达——一切都很美味。,"{food quality, 科罗拉多, positive};{food quality, 法士达, positive};{food quality, 法士达沙拉, positive}","{food quality, 法士达沙拉, positive};{food quality, 科罗拉多, positive};{food quality, 法士达, positive}"
+我很久以来尝过的最好的中国菜,"{food quality, 中国菜, positive}","{food quality, 中国菜, positive}"
+价格也合适。,"{restaurant prices, null, positive}","{restaurant prices, null, positive}"
+可口的 ... ！,"{food quality, null, positive}","{food quality, null, positive}"
+我们报了名，尽管还有空桌子，但我们被告知要等 30 分钟。,"{service general, null, negative}","{service general, null, negative}"
+咖啡 也很好。,"{drinks quality, 咖啡, positive}","{drinks quality, 咖啡, positive}"
+我们等了 30 多分钟才等到饮料，等了一个半小时才等到食物。,"{service general, null, negative}","{service general, null, negative}"
+柜台后面的服务员 总是友好而乐于助人。,"{service general, 柜台后面的服务员, positive}","{service general, 柜台后面的服务员, positive}"
+我们的服务员根本不存在，而且在我们点餐一个多小时后食物终于送到了，却没有给我们任何水或餐具。,"{service general, 服务员, negative}","{service general, 服务员, negative};{service general, null, negative}"
+— 这个地方被高估得令人难以置信。,"{restaurant general, 地方, negative}","{restaurant general, 地方, negative}"
+非常差客户服务。,"{service general, 客户服务, negative}","{service general, 客户服务, negative}"
+我们对于他们的美味佳肴披萨赞不绝口！,"{food quality, 披萨, positive}","{food quality, 披萨, positive}"
+此外，虽然鱼无疑是新鲜的，但卷却往往令人费解地寡淡。,"{food quality, 卷, negative};{food quality, 鱼, positive}","{food quality, 卷, negative};{food quality, 鱼, positive}"
+唯一的缺点是拥挤座位和缓慢服务。,"{restaurant miscellaneous, 座位, negative};{service general, 服务, negative}","{service general, 服务, negative};{ambience general, 座位, negative}"
+纽约剩下的吸烟场所不多了，但我在城里找到了我最喜欢的吸烟场所阳台。,"{restaurant miscellaneous, 阳台, positive}","{restaurant miscellaneous, 阳台, positive}"
+我们分享了家庭拼盘，我特别喜欢酒糟黑鳕鱼。,"{food quality, 酒糟黑鳕鱼, positive}","{food quality, 酒糟黑鳕鱼, positive}"
+但是空间小巧可爱，而且服务很有帮助。,"{ambience general, 空间, positive};{service general, 服务, positive}","{ambience general, 空间, positive};{service general, 服务, positive}"
+等待是值得的。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+好吃。,"{food quality, null, positive}","{food quality, null, positive}"
+美味可口,"{food quality, null, positive}","{food quality, null, positive}"
+- 平庸服务/质量,"{service general, 服务, neutral}","{food quality, null, negative};{service general, 服务, negative}"
+– 这是我最喜欢的午餐地点之一，份量足份量，速度快服务，味道棒极了玛格丽塔酒！！,"{food style_options, 份量, positive};{restaurant general, null, positive};{drinks quality, 玛格丽塔酒, positive};{service general, 服务, positive}","{drinks quality, 玛格丽塔酒, positive};{food style_options, 份量, positive};{service general, 服务, positive}"
+镇上最好的蟹饼,"{food quality, 蟹饼, positive}","{food quality, 蟹饼, positive}"
+我在这里吃过的所有东西都很好吃，墨西哥沙拉，墨西哥卷饼，辣酱玉米卷饼我喜欢这个地方。,"{food quality, null, positive};{food quality, 墨西哥沙拉, positive};{restaurant general, 地方, positive};{food quality, 辣酱玉米卷饼, positive};{food quality, 墨西哥卷饼, positive}","{food quality, 墨西哥沙拉, positive};{food quality, 辣酱玉米卷饼, positive};{restaurant general, 地方, positive};{food quality, 墨西哥卷饼, positive}"
+很好 披萨，很差 服务,"{food quality, 披萨, positive};{service general, 服务, negative}","{food quality, 披萨, positive};{service general, 服务, negative}"
+灿烂,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+我最好的朋友吃了鸡肉沙威玛，她仍然赞叹不已，说它是最好吃的！,"{food quality, 鸡肉沙威玛, positive}","{food quality, 鸡肉沙威玛, positive}"
+印花棉布 份,"{food style_options, 份, negative}","{food quality, 印花棉布, negative}"
+好吃。,"{food quality, 吃, positive}","{food quality, null, positive}"
+通常情况下，餐馆会询问你想要多辣的辣度，但他们没有。,"{service general, null, negative}","{service general, null, negative}"
+我一直觉得服务员和厨师（如果你坐在吧台）都非常友好。,"{service general, 厨师, positive}","{service general, 服务员, positive};{service general, 厨师, positive}"
+菜单上的所有菜品都令人赞叹不已。,"{food quality, 菜单, positive}","{food quality, 菜单, positive}"
+我们两人的团队特别有野心，我们大吃了一顿希尔肖尔拼盘……各种各样的巨型白海湾虾、烟熏长鳍金枪鱼、用莳萝调味的雷氏美味马尼拉蛤蜊、美味的扇贝酱油调味汁，以及放在精致的黄油酱上的一小堆珍宝蟹。,"{food quality, 酱油调味汁, positive};{food quality, 马尼拉蛤蜊, positive};{food style_options, 白海湾虾, positive};{food style_options, 希尔肖尔拼盘, positive};{food quality, 黄油酱, positive}","{food style_options, 希尔肖尔拼盘, positive}"
+说实话，当我看到这些负面评论时我感到很震惊——这个地方太棒了；它没有让我们失望，我们已经在这里吃过 10 多次了。,"{restaurant general, 地方, positive}","{restaurant general, 地方, positive}"
+您是寿司的粉丝，您喜欢切得精致的鱼、美味的清酒、美味可口的SOHO 位置，当然还有：鲑鱼、金枪鱼、比目鱼、黄尾鱼、鳕鱼、鲭鱼、水母鱼、海胆、虾、龙虾、鲷鱼、鳟鱼、虱目鱼、蓝鳍金枪鱼、鳗鱼、螃蟹、沙丁鱼、安康鱼、鱼子、扇贝、牡蛎和各种各样的金枪鱼腹肉。,"{location general, SOHO 位置, positive};{food style_options, 鱼, positive};{drinks quality, 清酒, positive};{food quality, 寿司, positive};{food style_options, 金枪鱼腹肉, positive}","{food quality, 鲑鱼, positive};{food quality, 金枪鱼, positive};{ambience general, SOHO 位置, positive};{drinks quality, 清酒, positive};{food quality, 虾, positive};{food quality, 鳕鱼, positive};{food quality, 水母鱼, positive};{food quality, 海胆, positive};{food quality, 龙虾, positive};{food quality, 鲷鱼, positive};{food quality, 虱目鱼, positive};{food quality, 蓝鳍金枪鱼,"
+这个有趣的地方的服务非常棒。,"{restaurant general, 地方, positive};{service general, 服务, positive}","{service general, 服务, positive}"
+此外，只有一个卫生隔间——对于如此大的人群来说，可能需要更多。,"{restaurant miscellaneous, 卫生隔间, negative}","{restaurant miscellaneous, null, negative};{restroom general, 卫生隔间, negative}"
+我们离开时甚至没有得到服务。,"{service general, 服务, negative}","{service general, 服务, negative}"
+我喜欢它。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– 我强烈推荐米奥波斯托。,"{restaurant general, 米奥波斯托, positive}","{restaurant general, 米奥波斯托, positive}"
+食物 非常棒，正宗，美味，而且非常非常实惠。,"{food quality, 食物, positive};{food prices, 食物, positive}","{food quality, 食物, positive};{food prices, 食物, positive}"
+我在这里吃过三次，发现鱼的品质和种类都非常棒。,"{food style_options, 鱼, positive};{food quality, 鱼, positive}","{food quality, 鱼, positive};{food style_options, 鱼, positive}"
+但她对某些人却很友好，这让事情变得更加烦人。,"{service general, null, negative}","{service general, null, negative}"
+这里的常规菜单略高于平均水平，不值得您受到如此傲慢的态度。,"{service general, null, negative};{food quality, 常规菜单, neutral}","{service general, null, negative};{food quality, 常规菜单, negative}"
+此外，他们还提供美国最好的鹰嘴豆泥，淋上芳香的橄榄油（我相信这是传统方式）！,"{food quality, 鹰嘴豆泥, positive};{food style_options, 鹰嘴豆泥, positive}","{food quality, 鹰嘴豆泥, positive}"
+很棒啤酒,"{drinks quality, 啤酒, positive}","{drinks quality, 啤酒, positive}"
+海鲜 加,"{food quality, 海鲜, positive}","{food quality, 海鲜, positive}"
+遗憾的是，没有多少人经常去这些看起来价格昂贵的餐厅就餐，因为它们位于酒店内......但它们绝对是你不想错过的，特别是如果你在圣何塞市中心。,"{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}"
+他们把它放在一个又高又细的沙漏形玻璃杯中，以掩盖这样一个事实：你花在超市半加仑果汁的价钱却能买到一小杯果汁。,"{drinks prices, 果汁, negative};{drinks style_options, 果汁, negative}","{drinks prices, fruit juice, negative};{drinks style_options, fruit juice, negative}"
+食物 还可以，但是 服务 太差了，以致于 食物 在为我聚会中的每个人服务时都是冷的。,"{food quality, 食物, neutral};{service general, 服务, negative}","{food quality, 食物, neutral};{service general, 服务, negative}"
+很棒餐点——御厨拼盘上的鱼绝对美味——没有普通寿司有时会出现的纤维质——这条鱼太完美了！！！！！！,"{food quality, 御厨拼盘上的鱼, positive};{food quality, 餐点, positive}","{food quality, 鱼, positive};{food quality, 餐点, positive};{food quality, 御厨拼盘, positive}"
+饮料非常棒，当我走进门时，我感觉自己仿佛身处第三世界国家。,"{ambience general, null, positive};{drinks quality, 饮料, positive}","{drinks quality, 饮料, positive};{ambience general, null, positive}"
+开放而酷炫地点，最佳披萨和咖啡,"{food quality, 披萨, positive};{drinks quality, 咖啡, positive};{ambience general, 地点, positive}","{ambience general, 地点, positive};{food quality, 披萨, positive};{drinks quality, 咖啡, positive}"
+绿茶焦糖布丁是必点的！,"{food quality, 绿茶焦糖布丁, positive}","{food quality, 绿茶焦糖布丁, positive}"
+我找到了新家并且刚刚搬进来并且签订了长期租约。,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}"
+他们并不是最健谈的人，但每次我去那里，他们都很忙，这可能是缺乏交谈的原因。,"{service general, null, neutral}","{service general, null, neutral}"
+披萨本身并不是我吃过的最好的，但还是相当不错的。,"{food quality, 披萨, positive}","{food quality, 披萨, positive}"
+第二次我们确实遇到了同样的情况服务员，所以也许服务不太好，而且我们的运气不错。,"{service general, 服务员, positive}","{service general, 服务, negative};{service general, 服务员, negative}"
+— 这是一个很大的声明，因为我从七岁左右就开始自己拉螃蟹笼和做蛋糕了——但这些小恶魔每次都有所进步。,"{food quality, 蛋糕, positive}","{food quality, 螃蟹笼, positive}"
+极好意大利菜！,"{food quality, 意大利菜, positive}","{food quality, 意大利菜, positive}"
+然而，这个地方是一颗宝石，我不会停止回去的。,"{restaurant general, 地方, positive}","{restaurant general, 地方, positive}"
+那里真的很忙，所以要早点到那里，这样你就可以占到座位，如果你确实需要等待，那也没关系，因为服务很快！,"{service general, 服务, positive}","{service general, 服务, positive};{ambience general, null, neutral}"
+我们只花了大约一个小时就吃完了这顿晚餐，价格也还不错，税后和小费后大约每人 50 美元（大约是平均水平）。,"{restaurant prices, null, neutral}","{restaurant prices, null, neutral};{food quality, 晚餐, positive};{service general, null, positive}"
+洋葱圈 很棒！,"{food quality, 洋葱圈, positive}","{food quality, 洋葱圈, positive}"
+如果你来到该地区你一定不会失望。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– 大金融区墨西哥城。,"{restaurant general, 墨西哥城, positive}","{restaurant miscellaneous, null, positive}"
+自家特制卷 真的好好吃啊。,"{food quality, 自家特制卷, positive}","{food quality, 卷, positive}"
+服务员 经验非常丰富，能够帮助您根据食物口味搭配您选择的饮料，反之亦然。,"{service general, 服务员, positive}","{service general, 服务员, positive}"
+完美。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+差客户服务/差披萨。,"{food quality, 披萨, negative};{service general, 客户服务, negative}","{food quality, 披萨, negative};{service general, 客户服务, negative}"
+总的来说，我会再回去餐厅吃饭。,"{restaurant general, 餐厅, positive}","{restaurant general, 餐厅, positive}"
+服务员 提出了几项 清酒 建议，非常好。,"{drinks quality, 清酒, positive};{service general, 服务员, positive}","{service general, 服务员, positive}"
+我唯一的负面评论是，我希望件稍微大一些。,"{food style_options, 件, negative}","{food style_options, 件, negative}"
+我选了芦笋，味道棒极了，而且烹调得非常完美。,"{food quality, 芦笋, positive}","{food quality, 芦笋, positive};{food style_options, 芦笋, positive}"
+大多数人可能感兴趣的是，最差的服务/态度来自该机构的业主。,"{service general, 业主, negative}","{service general, 服务, negative};{service general, 业主, negative}"
+唯一的缺点是这个地方真的很贵，而且份量��点小。,"{restaurant prices, 地方, negative};{food style_options, 份量, negative}","{restaurant prices, 地方, negative};{food style_options, 份量, negative}"
+糟糕服务，食物还行，价格昂贵,"{restaurant prices, null, negative};{food quality, 食物, neutral};{service general, 服务, negative}","{restaurant prices, null, negative};{food quality, 食物, neutral};{service general, 服务, negative}"
+尽管考虑到您投入的金钱，服务还有待改进。,"{service general, 服务, negative}","{service general, 服务, negative}"
+您经常会看到印度家人和朋友在那里用餐，这始终是一个好兆头。,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}"
+如果我愿意在周日排队一个小时去吃一份普通的早午餐食物，那么我会把 Murphy’s 放在首位。,"{food quality, 早午餐, neutral};{service general, null, negative}","{food quality, ordinary breakfast food, positive};{restaurant miscellaneous, Murphy’s, positive}"
+就我们所得到的食物数量而言，价格应该更低一些。,"{food prices, 食物, negative}","{food prices, 食物, negative};{food quality, 食物, negative}"
+总是很忙，但是他们会及时为您安排座位并提供快速的服务。,"{service general, null, positive};{service general, 服务, positive}","{service general, 服务, positive}"
+酒单 很棒，食物让我想起了最近去意大利的旅行。,"{drinks style_options, 酒单, positive}","{drinks style_options, 酒单, positive};{food quality, 食物, positive}"
+食物 很棒，玛格丽塔酒 也很棒，但是 女服务员 太忙于接待其他更大的聚会客人，而没有更好地照顾我和我的朋友。,"{drinks quality, 玛格丽塔酒, positive};{food quality, 食物, positive};{service general, 女服务员, negative}","{service general, 女服务员, negative};{food quality, 食物, positive};{drinks quality, 玛格丽塔酒, positive}"
+我对这家餐厅的赞美之词真是说不完，我已经迫不及待地想下次再来。,"{restaurant general, 餐厅, positive}","{restaurant general, 餐厅, positive}"
+每次都很喜欢,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+我们是当地人，感觉这个地方能够以如此平庸的食物生存下来的唯一原因是因为大多数顾客可能都是一次性游客。,"{food quality, 食物, negative}","{food quality, 食物, negative}"
+也喜欢他们的凯撒沙拉。,"{food quality, 凯撒沙拉, positive}","{food quality, 凯撒沙拉, positive}"
+她没有让你感到受欢迎并且把你当成一个讨厌的人。,"{service general, null, negative}","{service general, null, negative}"
+它 的 尺寸 正好 适合 菜单 .	,"{restaurant miscellaneous, null, positive}","{food style_options, null, positive}"
+食物非常棒，而且每次我们去的时候，服务员都很完美。,"{food quality, 食物, positive};{service general, 服务员, positive}","{service general, 服务员, positive};{food quality, 食物, positive}"
+甜点 是一顿近乎完美的 晚餐 的完美结局。,"{food quality, 晚餐, positive};{food quality, 甜点, positive}","{food quality, 甜点, positive}"
+我来过这里，花了很多钱吃了一顿厨师特别晚餐，结果却令人大失所望。,"{food quality, 厨师特别晚餐, negative};{food prices, 厨师特别晚餐, negative}","{food quality, 厨师特别晚餐, negative};{food prices, 厨师特别晚餐, negative}"
+我在第二大道找到了新家！！！！！！！！！！！！！！！,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– 周二早上不得不等三十分钟才能进门，但这非常值得。,"{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive}"
+– 令人伤心的是，曾经是“早餐或午餐的地方”的地方现在变成了“不用担心”的地方。,"{restaurant general, 地方, negative}","{restaurant general, 地方, negative}"
+柠檬鸡 尝起来像粘稠的甜甜圈，而 蜂蜜核桃虾，他们实际上给你的那几只……并不好吃。,"{food quality, 蜂蜜核桃虾, negative};{food quality, 柠檬鸡, negative};{food style_options, 蜂蜜核桃虾, negative}","{food quality, 柠檬鸡, negative};{food quality, 蜂蜜核桃虾, negative}"
+它很浪漫——甚至和我的姐姐在一起也很愉快，让我想起了意大利，并且有艺术品和音乐让我保持着在地中海别墅中的感觉。,"{ambience general, null, positive};{ambience general, 音乐, positive};{ambience general, 艺术品, positive}","{ambience general, null, positive};{ambience general, 音乐, positive};{ambience general, 艺术品, positive}"
+寿司 很棒而且 服务员 很快。,"{food quality, 寿司, positive};{service general, 服务员, positive}","{food quality, 寿司, positive};{service general, 服务员, positive}"
+事实上，许多游客都想再次来这里。,"{restaurant general, null, positive}","{restaurant general, null, positive}"
+– 金融区最适合吃午餐的墨西哥餐厅。,"{restaurant general, 墨西哥餐厅, positive}","{restaurant general, 墨西哥餐厅, positive}"
+我喜欢这个地方！,"{restaurant general, 地方, positive}","{restaurant general, 地方, positive}"
+气氛很棒。,"{ambience general, 气氛, positive}","{ambience general, 气氛, positive}"
+寒冷的日子里非常适合。,"{food quality, null, positive}","{ambience general, null, positive}"