diff --git a/.gitattributes b/.gitattributes index a6344aac8c09253b3b630fb776ae94478aa0275b..75a727fa8fe2d78f4aa884e8afea7866ee71252e 100644 --- a/.gitattributes +++ b/.gitattributes @@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text *.zip filter=lfs diff=lfs merge=lfs -text *.zst filter=lfs diff=lfs merge=lfs -text *tfevents* filter=lfs diff=lfs merge=lfs -text +experiments/Natural/adapter/tokenizer.json filter=lfs diff=lfs merge=lfs -text +experiments/Natural/checkpoint-1000/tokenizer.json filter=lfs diff=lfs merge=lfs -text +experiments/Natural/checkpoint-1500/tokenizer.json filter=lfs diff=lfs merge=lfs -text +experiments/Natural/checkpoint-1580/tokenizer.json filter=lfs diff=lfs merge=lfs -text +experiments/Natural/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text +experiments/Natural/checkpoint-948/tokenizer.json filter=lfs diff=lfs merge=lfs -text diff --git a/experiments/Natural/README.md b/experiments/Natural/README.md new file mode 100644 index 0000000000000000000000000000000000000000..73da86e205845c6c71bcfd0fdd062b73bd6ab50b --- /dev/null +++ b/experiments/Natural/README.md @@ -0,0 +1,59 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +library_name: transformers +model_name: Natural +tags: +- generated_from_trainer +- unsloth +- sft +- trl +licence: license +--- + +# Model Card for Natural + +This model is a fine-tuned version of [unsloth/meta-llama-3.1-8b-instruct-bnb-4bit](https://huggingface.co/unsloth/meta-llama-3.1-8b-instruct-bnb-4bit). +It has been trained using [TRL](https://github.com/huggingface/trl). + +## Quick start + +```python +from transformers import pipeline + +question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?" +generator = pipeline("text-generation", model="None", device="cuda") +output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0] +print(output["generated_text"]) +``` + +## Training procedure + + + + +This model was trained with SFT. + +### Framework versions + +- TRL: 0.22.2 +- Transformers: 4.56.2 +- Pytorch: 2.10.0 +- Datasets: 4.3.0 +- Tokenizers: 0.22.0 + +## Citations + + + +Cite TRL as: + +```bibtex +@misc{vonwerra2022trl, + title = {{TRL: Transformer Reinforcement Learning}}, + author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec}, + year = 2020, + journal = {GitHub repository}, + publisher = {GitHub}, + howpublished = {\url{https://github.com/huggingface/trl}} +} +``` \ No newline at end of file diff --git a/experiments/Natural/adapter/README.md b/experiments/Natural/adapter/README.md new file mode 100644 index 0000000000000000000000000000000000000000..6e1128c4737461313d01ab9fe9909a170568a6d0 --- /dev/null +++ b/experiments/Natural/adapter/README.md @@ -0,0 +1,210 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +library_name: peft +pipeline_tag: text-generation +tags: +- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +- lora +- sft +- transformers +- trl +- unsloth +--- + +# Model Card for Model ID + + + + + +## Model Details + +### Model Description + + + + + +- **Developed by:** [More Information Needed] +- **Funded by [optional]:** [More Information Needed] +- **Shared by [optional]:** [More Information Needed] +- **Model type:** [More Information Needed] +- **Language(s) (NLP):** [More Information Needed] +- **License:** [More Information Needed] +- **Finetuned from model [optional]:** [More Information Needed] + +### Model Sources [optional] + + + +- **Repository:** [More Information Needed] +- **Paper [optional]:** [More Information Needed] +- **Demo [optional]:** [More Information Needed] + +## Uses + + + +### Direct Use + + + +[More Information Needed] + +### Downstream Use [optional] + + + +[More Information Needed] + +### Out-of-Scope Use + + + +[More Information Needed] + +## Bias, Risks, and Limitations + + + +[More Information Needed] + +### Recommendations + + + +Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. + +## How to Get Started with the Model + +Use the code below to get started with the model. + +[More Information Needed] + +## Training Details + +### Training Data + + + +[More Information Needed] + +### Training Procedure + + + +#### Preprocessing [optional] + +[More Information Needed] + + +#### Training Hyperparameters + +- **Training regime:** [More Information Needed] + +#### Speeds, Sizes, Times [optional] + + + +[More Information Needed] + +## Evaluation + + + +### Testing Data, Factors & Metrics + +#### Testing Data + + + +[More Information Needed] + +#### Factors + + + +[More Information Needed] + +#### Metrics + + + +[More Information Needed] + +### Results + +[More Information Needed] + +#### Summary + + + +## Model Examination [optional] + + + +[More Information Needed] + +## Environmental Impact + + + +Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). + +- **Hardware Type:** [More Information Needed] +- **Hours used:** [More Information Needed] +- **Cloud Provider:** [More Information Needed] +- **Compute Region:** [More Information Needed] +- **Carbon Emitted:** [More Information Needed] + +## Technical Specifications [optional] + +### Model Architecture and Objective + +[More Information Needed] + +### Compute Infrastructure + +[More Information Needed] + +#### Hardware + +[More Information Needed] + +#### Software + +[More Information Needed] + +## Citation [optional] + + + +**BibTeX:** + +[More Information Needed] + +**APA:** + +[More Information Needed] + +## Glossary [optional] + + + +[More Information Needed] + +## More Information [optional] + +[More Information Needed] + +## Model Card Authors [optional] + +[More Information Needed] + +## Model Card Contact + +[More Information Needed] +### Framework versions + +- PEFT 0.18.1 \ No newline at end of file diff --git a/experiments/Natural/adapter/adapter_config.json b/experiments/Natural/adapter/adapter_config.json new file mode 100644 index 0000000000000000000000000000000000000000..7c2e352b20dfcbcac0e45c46b2bd6a1fddd7caf6 --- /dev/null +++ b/experiments/Natural/adapter/adapter_config.json @@ -0,0 +1,50 @@ +{ + "alora_invocation_tokens": null, + "alpha_pattern": {}, + "arrow_config": null, + "auto_mapping": { + "base_model_class": "LlamaForCausalLM", + "parent_library": "transformers.models.llama.modeling_llama", + "unsloth_fixed": true + }, + "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit", + "bias": "none", + "corda_config": null, + "ensure_weight_tying": false, + "eva_config": null, + "exclude_modules": null, + "fan_in_fan_out": false, + "inference_mode": true, + "init_lora_weights": true, + "layer_replication": null, + "layers_pattern": null, + "layers_to_transform": null, + "loftq_config": {}, + "lora_alpha": 32, + "lora_bias": false, + "lora_dropout": 0, + "megatron_config": null, + "megatron_core": "megatron.core", + "modules_to_save": null, + "peft_type": "LORA", + "peft_version": "0.18.1", + "qalora_group_size": 16, + "r": 16, + "rank_pattern": {}, + "revision": null, + "target_modules": [ + "gate_proj", + "v_proj", + "o_proj", + "k_proj", + "up_proj", + "down_proj", + "q_proj" + ], + "target_parameters": null, + "task_type": "CAUSAL_LM", + "trainable_token_indices": null, + "use_dora": false, + "use_qalora": false, + "use_rslora": true +} \ No newline at end of file diff --git a/experiments/Natural/adapter/adapter_model.safetensors b/experiments/Natural/adapter/adapter_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c71aebb4df4e299fa614cc1eaa32e4c398e361c5 --- /dev/null +++ b/experiments/Natural/adapter/adapter_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c99d378dc26e507db69f1bbadaa36666676e1f90c50253e525406eeb68810ea8 +size 167832240 diff --git a/experiments/Natural/adapter/chat_template.jinja b/experiments/Natural/adapter/chat_template.jinja new file mode 100644 index 0000000000000000000000000000000000000000..33089ace1be88f22a10fe861ad49718d5d886090 --- /dev/null +++ b/experiments/Natural/adapter/chat_template.jinja @@ -0,0 +1,109 @@ +{{- bos_token }} +{%- if custom_tools is defined %} + {%- set tools = custom_tools %} +{%- endif %} +{%- if not tools_in_user_message is defined %} + {%- set tools_in_user_message = true %} +{%- endif %} +{%- if not date_string is defined %} + {%- set date_string = "26 Jul 2024" %} +{%- endif %} +{%- if not tools is defined %} + {%- set tools = none %} +{%- endif %} + +{#- This block extracts the system message, so we can slot it into the right place. #} +{%- if messages[0]['role'] == 'system' %} + {%- set system_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} +{%- else %} + {%- set system_message = "" %} +{%- endif %} + +{#- System message + builtin tools #} +{{- "<|start_header_id|>system<|end_header_id|>\n\n" }} +{%- if builtin_tools is defined or tools is not none %} + {{- "Environment: ipython\n" }} +{%- endif %} +{%- if builtin_tools is defined %} + {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}} +{%- endif %} +{{- "Cutting Knowledge Date: December 2023\n" }} +{{- "Today Date: " + date_string + "\n\n" }} +{%- if tools is not none and not tools_in_user_message %} + {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} +{%- endif %} +{{- system_message }} +{{- "<|eot_id|>" }} + +{#- Custom tools are passed in a user message with some extra guidance #} +{%- if tools_in_user_message and not tools is none %} + {#- Extract the first user message so we can plug it in here #} + {%- if messages | length != 0 %} + {%- set first_user_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} + {%- else %} + {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }} +{%- endif %} + {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}} + {{- "Given the following functions, please respond with a JSON for a function call " }} + {{- "with its proper arguments that best answers the given prompt.\n\n" }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} + {{- first_user_message + "<|eot_id|>"}} +{%- endif %} + +{%- for message in messages %} + {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %} + {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }} + {%- elif 'tool_calls' in message %} + {%- if not message.tool_calls|length == 1 %} + {{- raise_exception("This model only supports single tool-calls at once!") }} + {%- endif %} + {%- set tool_call = message.tool_calls[0].function %} + {%- if builtin_tools is defined and tool_call.name in builtin_tools %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- "<|python_tag|>" + tool_call.name + ".call(" }} + {%- for arg_name, arg_val in tool_call.arguments | items %} + {{- arg_name + '="' + arg_val + '"' }} + {%- if not loop.last %} + {{- ", " }} + {%- endif %} + {%- endfor %} + {{- ")" }} + {%- else %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- '{"name": "' + tool_call.name + '", ' }} + {{- '"parameters": ' }} + {{- tool_call.arguments | tojson }} + {{- "}" }} + {%- endif %} + {%- if builtin_tools is defined %} + {#- This means we're in ipython mode #} + {{- "<|eom_id|>" }} + {%- else %} + {{- "<|eot_id|>" }} + {%- endif %} + {%- elif message.role == "tool" or message.role == "ipython" %} + {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }} + {%- if message.content is mapping or message.content is iterable %} + {{- message.content | tojson }} + {%- else %} + {{- message.content }} + {%- endif %} + {{- "<|eot_id|>" }} + {%- endif %} +{%- endfor %} +{%- if add_generation_prompt %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }} +{%- endif %} diff --git a/experiments/Natural/adapter/special_tokens_map.json b/experiments/Natural/adapter/special_tokens_map.json new file mode 100644 index 0000000000000000000000000000000000000000..3c1d04911c269b925af977a3151c9704e990e4d0 --- /dev/null +++ b/experiments/Natural/adapter/special_tokens_map.json @@ -0,0 +1,23 @@ +{ + "bos_token": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "eos_token": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "pad_token": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + } +} diff --git a/experiments/Natural/adapter/tokenizer.json b/experiments/Natural/adapter/tokenizer.json new file mode 100644 index 0000000000000000000000000000000000000000..b7e5ec93d2cb9bd159189c7959d15c610250c2c9 --- /dev/null +++ b/experiments/Natural/adapter/tokenizer.json @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:145cc0211ce61596383d8ae33aa07aa5555cb220e67064f0e36bf4beaffa025d +size 17210200 diff --git a/experiments/Natural/adapter/tokenizer_config.json b/experiments/Natural/adapter/tokenizer_config.json new file mode 100644 index 0000000000000000000000000000000000000000..eccf8220a2480c666974c86c40d153feae85894c --- /dev/null +++ b/experiments/Natural/adapter/tokenizer_config.json @@ -0,0 +1,2066 @@ +{ + "add_bos_token": true, + "added_tokens_decoder": { + "128000": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128001": { + "content": "<|end_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128002": { + "content": "<|reserved_special_token_0|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128003": { + "content": "<|reserved_special_token_1|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128004": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128005": { + "content": "<|reserved_special_token_2|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128006": { + "content": "<|start_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128007": { + "content": "<|end_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128008": { + "content": "<|eom_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128009": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128010": { + "content": "<|python_tag|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128011": { + "content": "<|reserved_special_token_3|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128012": { + "content": "<|reserved_special_token_4|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128013": { + "content": "<|reserved_special_token_5|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128014": { + "content": "<|reserved_special_token_6|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128015": { + "content": "<|reserved_special_token_7|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128016": { + "content": "<|reserved_special_token_8|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128017": { + "content": "<|reserved_special_token_9|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128018": { + "content": "<|reserved_special_token_10|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128019": { + "content": "<|reserved_special_token_11|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128020": { + "content": "<|reserved_special_token_12|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128021": { + "content": "<|reserved_special_token_13|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128022": { + "content": "<|reserved_special_token_14|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128023": { + "content": "<|reserved_special_token_15|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128024": { + "content": "<|reserved_special_token_16|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128025": { + "content": "<|reserved_special_token_17|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128026": { + "content": "<|reserved_special_token_18|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128027": { + "content": "<|reserved_special_token_19|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128028": { + "content": "<|reserved_special_token_20|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128029": { + "content": "<|reserved_special_token_21|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128030": { + "content": "<|reserved_special_token_22|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128031": { + "content": "<|reserved_special_token_23|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128032": { + "content": "<|reserved_special_token_24|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128033": { + "content": "<|reserved_special_token_25|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128034": { + "content": "<|reserved_special_token_26|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128035": { + "content": "<|reserved_special_token_27|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128036": { + "content": "<|reserved_special_token_28|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128037": { + "content": "<|reserved_special_token_29|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128038": { + "content": "<|reserved_special_token_30|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128039": { + "content": "<|reserved_special_token_31|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128040": { + "content": "<|reserved_special_token_32|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128041": { + "content": "<|reserved_special_token_33|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128042": { + "content": "<|reserved_special_token_34|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128043": { + "content": "<|reserved_special_token_35|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128044": { + "content": "<|reserved_special_token_36|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128045": { + "content": "<|reserved_special_token_37|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128046": { + "content": "<|reserved_special_token_38|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128047": { + "content": "<|reserved_special_token_39|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128048": { + "content": "<|reserved_special_token_40|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128049": { + "content": "<|reserved_special_token_41|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128050": { + "content": "<|reserved_special_token_42|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128051": { + "content": "<|reserved_special_token_43|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128052": { + "content": "<|reserved_special_token_44|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128053": { + "content": "<|reserved_special_token_45|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128054": { + "content": "<|reserved_special_token_46|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128055": { + "content": "<|reserved_special_token_47|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128056": { + "content": "<|reserved_special_token_48|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128057": { + "content": "<|reserved_special_token_49|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128058": { + "content": "<|reserved_special_token_50|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128059": { + "content": "<|reserved_special_token_51|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128060": { + "content": "<|reserved_special_token_52|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128061": { + "content": "<|reserved_special_token_53|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128062": { + "content": "<|reserved_special_token_54|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128063": { + "content": "<|reserved_special_token_55|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128064": { + "content": "<|reserved_special_token_56|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128065": { + "content": "<|reserved_special_token_57|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128066": { + "content": "<|reserved_special_token_58|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128067": { + "content": "<|reserved_special_token_59|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128068": { + "content": "<|reserved_special_token_60|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128069": { + "content": "<|reserved_special_token_61|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128070": { + "content": "<|reserved_special_token_62|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128071": { + "content": "<|reserved_special_token_63|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128072": { + "content": "<|reserved_special_token_64|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128073": { + "content": "<|reserved_special_token_65|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128074": { + "content": "<|reserved_special_token_66|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128075": { + "content": "<|reserved_special_token_67|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128076": { + "content": "<|reserved_special_token_68|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128077": { + "content": "<|reserved_special_token_69|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128078": { + "content": "<|reserved_special_token_70|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128079": { + "content": "<|reserved_special_token_71|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128080": { + "content": "<|reserved_special_token_72|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128081": { + "content": "<|reserved_special_token_73|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128082": { + "content": "<|reserved_special_token_74|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128083": { + "content": "<|reserved_special_token_75|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128084": { + "content": "<|reserved_special_token_76|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128085": { + "content": "<|reserved_special_token_77|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128086": { + "content": "<|reserved_special_token_78|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128087": { + "content": "<|reserved_special_token_79|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128088": { + "content": "<|reserved_special_token_80|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128089": { + "content": "<|reserved_special_token_81|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128090": { + "content": "<|reserved_special_token_82|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128091": { + "content": "<|reserved_special_token_83|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128092": { + "content": "<|reserved_special_token_84|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128093": { + "content": "<|reserved_special_token_85|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128094": { + "content": "<|reserved_special_token_86|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128095": { + "content": "<|reserved_special_token_87|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128096": { + "content": "<|reserved_special_token_88|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128097": { + "content": "<|reserved_special_token_89|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128098": { + "content": "<|reserved_special_token_90|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128099": { + "content": "<|reserved_special_token_91|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128100": { + "content": "<|reserved_special_token_92|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128101": { + "content": "<|reserved_special_token_93|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128102": { + "content": "<|reserved_special_token_94|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128103": { + "content": "<|reserved_special_token_95|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128104": { + "content": "<|reserved_special_token_96|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128105": { + "content": "<|reserved_special_token_97|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128106": { + "content": "<|reserved_special_token_98|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128107": { + "content": "<|reserved_special_token_99|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128108": { + "content": "<|reserved_special_token_100|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128109": { + "content": "<|reserved_special_token_101|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128110": { + "content": "<|reserved_special_token_102|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128111": { + "content": "<|reserved_special_token_103|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128112": { + "content": "<|reserved_special_token_104|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128113": { + "content": "<|reserved_special_token_105|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128114": { + "content": "<|reserved_special_token_106|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128115": { + "content": "<|reserved_special_token_107|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128116": { + "content": "<|reserved_special_token_108|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128117": { + "content": "<|reserved_special_token_109|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128118": { + "content": "<|reserved_special_token_110|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128119": { + "content": "<|reserved_special_token_111|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128120": { + "content": "<|reserved_special_token_112|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128121": { + "content": "<|reserved_special_token_113|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128122": { + "content": "<|reserved_special_token_114|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128123": { + "content": "<|reserved_special_token_115|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128124": { + "content": "<|reserved_special_token_116|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128125": { + "content": "<|reserved_special_token_117|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128126": { + "content": "<|reserved_special_token_118|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128127": { + "content": "<|reserved_special_token_119|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128128": { + "content": "<|reserved_special_token_120|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128129": { + "content": "<|reserved_special_token_121|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128130": { + "content": "<|reserved_special_token_122|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128131": { + "content": "<|reserved_special_token_123|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128132": { + "content": "<|reserved_special_token_124|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128133": { + "content": "<|reserved_special_token_125|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128134": { + "content": "<|reserved_special_token_126|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128135": { + "content": "<|reserved_special_token_127|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128136": { + "content": "<|reserved_special_token_128|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128137": { + "content": "<|reserved_special_token_129|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128138": { + "content": "<|reserved_special_token_130|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128139": { + "content": "<|reserved_special_token_131|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128140": { + "content": "<|reserved_special_token_132|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128141": { + "content": "<|reserved_special_token_133|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128142": { + "content": "<|reserved_special_token_134|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128143": { + "content": "<|reserved_special_token_135|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128144": { + "content": "<|reserved_special_token_136|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128145": { + "content": "<|reserved_special_token_137|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128146": { + "content": "<|reserved_special_token_138|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128147": { + "content": "<|reserved_special_token_139|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128148": { + "content": "<|reserved_special_token_140|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128149": { + "content": "<|reserved_special_token_141|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128150": { + "content": "<|reserved_special_token_142|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128151": { + "content": "<|reserved_special_token_143|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128152": { + "content": "<|reserved_special_token_144|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128153": { + "content": "<|reserved_special_token_145|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128154": { + "content": "<|reserved_special_token_146|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128155": { + "content": "<|reserved_special_token_147|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128156": { + "content": "<|reserved_special_token_148|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128157": { + "content": "<|reserved_special_token_149|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128158": { + "content": "<|reserved_special_token_150|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128159": { + "content": "<|reserved_special_token_151|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128160": { + "content": "<|reserved_special_token_152|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128161": { + "content": "<|reserved_special_token_153|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128162": { + "content": "<|reserved_special_token_154|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128163": { + "content": "<|reserved_special_token_155|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128164": { + "content": "<|reserved_special_token_156|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128165": { + "content": "<|reserved_special_token_157|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128166": { + "content": "<|reserved_special_token_158|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128167": { + "content": "<|reserved_special_token_159|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128168": { + "content": "<|reserved_special_token_160|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128169": { + "content": "<|reserved_special_token_161|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128170": { + "content": "<|reserved_special_token_162|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128171": { + "content": "<|reserved_special_token_163|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128172": { + "content": "<|reserved_special_token_164|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128173": { + "content": "<|reserved_special_token_165|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128174": { + "content": "<|reserved_special_token_166|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128175": { + "content": "<|reserved_special_token_167|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128176": { + "content": "<|reserved_special_token_168|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128177": { + "content": "<|reserved_special_token_169|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128178": { + "content": "<|reserved_special_token_170|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128179": { + "content": "<|reserved_special_token_171|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128180": { + "content": "<|reserved_special_token_172|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128181": { + "content": "<|reserved_special_token_173|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128182": { + "content": "<|reserved_special_token_174|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128183": { + "content": "<|reserved_special_token_175|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128184": { + "content": "<|reserved_special_token_176|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128185": { + "content": "<|reserved_special_token_177|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128186": { + "content": "<|reserved_special_token_178|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128187": { + "content": "<|reserved_special_token_179|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128188": { + "content": "<|reserved_special_token_180|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128189": { + "content": "<|reserved_special_token_181|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128190": { + "content": "<|reserved_special_token_182|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128191": { + "content": "<|reserved_special_token_183|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128192": { + "content": "<|reserved_special_token_184|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128193": { + "content": "<|reserved_special_token_185|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128194": { + "content": "<|reserved_special_token_186|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128195": { + "content": "<|reserved_special_token_187|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128196": { + "content": "<|reserved_special_token_188|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128197": { + "content": "<|reserved_special_token_189|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128198": { + "content": "<|reserved_special_token_190|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128199": { + "content": "<|reserved_special_token_191|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128200": { + "content": "<|reserved_special_token_192|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128201": { + "content": "<|reserved_special_token_193|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128202": { + "content": "<|reserved_special_token_194|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128203": { + "content": "<|reserved_special_token_195|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128204": { + "content": "<|reserved_special_token_196|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128205": { + "content": "<|reserved_special_token_197|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128206": { + "content": "<|reserved_special_token_198|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128207": { + "content": "<|reserved_special_token_199|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128208": { + "content": "<|reserved_special_token_200|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128209": { + "content": "<|reserved_special_token_201|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128210": { + "content": "<|reserved_special_token_202|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128211": { + "content": "<|reserved_special_token_203|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128212": { + "content": "<|reserved_special_token_204|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128213": { + "content": "<|reserved_special_token_205|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128214": { + "content": "<|reserved_special_token_206|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128215": { + "content": "<|reserved_special_token_207|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128216": { + "content": "<|reserved_special_token_208|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128217": { + "content": "<|reserved_special_token_209|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128218": { + "content": "<|reserved_special_token_210|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128219": { + "content": "<|reserved_special_token_211|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128220": { + "content": "<|reserved_special_token_212|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128221": { + "content": "<|reserved_special_token_213|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128222": { + "content": "<|reserved_special_token_214|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128223": { + "content": "<|reserved_special_token_215|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128224": { + "content": "<|reserved_special_token_216|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128225": { + "content": "<|reserved_special_token_217|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128226": { + "content": "<|reserved_special_token_218|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128227": { + "content": "<|reserved_special_token_219|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128228": { + "content": "<|reserved_special_token_220|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128229": { + "content": "<|reserved_special_token_221|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128230": { + "content": "<|reserved_special_token_222|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128231": { + "content": "<|reserved_special_token_223|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128232": { + "content": "<|reserved_special_token_224|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128233": { + "content": "<|reserved_special_token_225|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128234": { + "content": "<|reserved_special_token_226|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128235": { + "content": "<|reserved_special_token_227|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128236": { + "content": "<|reserved_special_token_228|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128237": { + "content": "<|reserved_special_token_229|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128238": { + "content": "<|reserved_special_token_230|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128239": { + "content": "<|reserved_special_token_231|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128240": { + "content": "<|reserved_special_token_232|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128241": { + "content": "<|reserved_special_token_233|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128242": { + "content": "<|reserved_special_token_234|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128243": { + "content": "<|reserved_special_token_235|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128244": { + "content": "<|reserved_special_token_236|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128245": { + "content": "<|reserved_special_token_237|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128246": { + "content": "<|reserved_special_token_238|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128247": { + "content": "<|reserved_special_token_239|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128248": { + "content": "<|reserved_special_token_240|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128249": { + "content": "<|reserved_special_token_241|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128250": { + "content": "<|reserved_special_token_242|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128251": { + "content": "<|reserved_special_token_243|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128252": { + "content": "<|reserved_special_token_244|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128253": { + "content": "<|reserved_special_token_245|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128254": { + "content": "<|reserved_special_token_246|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128255": { + "content": "<|reserved_special_token_247|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + } + }, + "bos_token": "<|begin_of_text|>", + "clean_up_tokenization_spaces": true, + "eos_token": "<|eot_id|>", + "extra_special_tokens": {}, + "model_input_names": [ + "input_ids", + "attention_mask" + ], + "model_max_length": 131072, + "pad_token": "<|finetune_right_pad_id|>", + "padding_side": "left", + "tokenizer_class": "PreTrainedTokenizerFast", + "unk_token": null +} diff --git a/experiments/Natural/checkpoint-1000/README.md b/experiments/Natural/checkpoint-1000/README.md new file mode 100644 index 0000000000000000000000000000000000000000..6e1128c4737461313d01ab9fe9909a170568a6d0 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/README.md @@ -0,0 +1,210 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +library_name: peft +pipeline_tag: text-generation +tags: +- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +- lora +- sft +- transformers +- trl +- unsloth +--- + +# Model Card for Model ID + + + + + +## Model Details + +### Model Description + + + + + +- **Developed by:** [More Information Needed] +- **Funded by [optional]:** [More Information Needed] +- **Shared by [optional]:** [More Information Needed] +- **Model type:** [More Information Needed] +- **Language(s) (NLP):** [More Information Needed] +- **License:** [More Information Needed] +- **Finetuned from model [optional]:** [More Information Needed] + +### Model Sources [optional] + + + +- **Repository:** [More Information Needed] +- **Paper [optional]:** [More Information Needed] +- **Demo [optional]:** [More Information Needed] + +## Uses + + + +### Direct Use + + + +[More Information Needed] + +### Downstream Use [optional] + + + +[More Information Needed] + +### Out-of-Scope Use + + + +[More Information Needed] + +## Bias, Risks, and Limitations + + + +[More Information Needed] + +### Recommendations + + + +Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. + +## How to Get Started with the Model + +Use the code below to get started with the model. + +[More Information Needed] + +## Training Details + +### Training Data + + + +[More Information Needed] + +### Training Procedure + + + +#### Preprocessing [optional] + +[More Information Needed] + + +#### Training Hyperparameters + +- **Training regime:** [More Information Needed] + +#### Speeds, Sizes, Times [optional] + + + +[More Information Needed] + +## Evaluation + + + +### Testing Data, Factors & Metrics + +#### Testing Data + + + +[More Information Needed] + +#### Factors + + + +[More Information Needed] + +#### Metrics + + + +[More Information Needed] + +### Results + +[More Information Needed] + +#### Summary + + + +## Model Examination [optional] + + + +[More Information Needed] + +## Environmental Impact + + + +Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). + +- **Hardware Type:** [More Information Needed] +- **Hours used:** [More Information Needed] +- **Cloud Provider:** [More Information Needed] +- **Compute Region:** [More Information Needed] +- **Carbon Emitted:** [More Information Needed] + +## Technical Specifications [optional] + +### Model Architecture and Objective + +[More Information Needed] + +### Compute Infrastructure + +[More Information Needed] + +#### Hardware + +[More Information Needed] + +#### Software + +[More Information Needed] + +## Citation [optional] + + + +**BibTeX:** + +[More Information Needed] + +**APA:** + +[More Information Needed] + +## Glossary [optional] + + + +[More Information Needed] + +## More Information [optional] + +[More Information Needed] + +## Model Card Authors [optional] + +[More Information Needed] + +## Model Card Contact + +[More Information Needed] +### Framework versions + +- PEFT 0.18.1 \ No newline at end of file diff --git a/experiments/Natural/checkpoint-1000/adapter_config.json b/experiments/Natural/checkpoint-1000/adapter_config.json new file mode 100644 index 0000000000000000000000000000000000000000..7c2e352b20dfcbcac0e45c46b2bd6a1fddd7caf6 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/adapter_config.json @@ -0,0 +1,50 @@ +{ + "alora_invocation_tokens": null, + "alpha_pattern": {}, + "arrow_config": null, + "auto_mapping": { + "base_model_class": "LlamaForCausalLM", + "parent_library": "transformers.models.llama.modeling_llama", + "unsloth_fixed": true + }, + "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit", + "bias": "none", + "corda_config": null, + "ensure_weight_tying": false, + "eva_config": null, + "exclude_modules": null, + "fan_in_fan_out": false, + "inference_mode": true, + "init_lora_weights": true, + "layer_replication": null, + "layers_pattern": null, + "layers_to_transform": null, + "loftq_config": {}, + "lora_alpha": 32, + "lora_bias": false, + "lora_dropout": 0, + "megatron_config": null, + "megatron_core": "megatron.core", + "modules_to_save": null, + "peft_type": "LORA", + "peft_version": "0.18.1", + "qalora_group_size": 16, + "r": 16, + "rank_pattern": {}, + "revision": null, + "target_modules": [ + "gate_proj", + "v_proj", + "o_proj", + "k_proj", + "up_proj", + "down_proj", + "q_proj" + ], + "target_parameters": null, + "task_type": "CAUSAL_LM", + "trainable_token_indices": null, + "use_dora": false, + "use_qalora": false, + "use_rslora": true +} \ No newline at end of file diff --git a/experiments/Natural/checkpoint-1000/adapter_model.safetensors b/experiments/Natural/checkpoint-1000/adapter_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9d2c6dc05d9b300f8557e23bf89925be19c6d30a --- /dev/null +++ b/experiments/Natural/checkpoint-1000/adapter_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9111d7a36a7be6e9dcde676d86c7ec69015abd3f3dbbe161afdf9929a082db22 +size 167832240 diff --git a/experiments/Natural/checkpoint-1000/chat_template.jinja b/experiments/Natural/checkpoint-1000/chat_template.jinja new file mode 100644 index 0000000000000000000000000000000000000000..33089ace1be88f22a10fe861ad49718d5d886090 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/chat_template.jinja @@ -0,0 +1,109 @@ +{{- bos_token }} +{%- if custom_tools is defined %} + {%- set tools = custom_tools %} +{%- endif %} +{%- if not tools_in_user_message is defined %} + {%- set tools_in_user_message = true %} +{%- endif %} +{%- if not date_string is defined %} + {%- set date_string = "26 Jul 2024" %} +{%- endif %} +{%- if not tools is defined %} + {%- set tools = none %} +{%- endif %} + +{#- This block extracts the system message, so we can slot it into the right place. #} +{%- if messages[0]['role'] == 'system' %} + {%- set system_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} +{%- else %} + {%- set system_message = "" %} +{%- endif %} + +{#- System message + builtin tools #} +{{- "<|start_header_id|>system<|end_header_id|>\n\n" }} +{%- if builtin_tools is defined or tools is not none %} + {{- "Environment: ipython\n" }} +{%- endif %} +{%- if builtin_tools is defined %} + {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}} +{%- endif %} +{{- "Cutting Knowledge Date: December 2023\n" }} +{{- "Today Date: " + date_string + "\n\n" }} +{%- if tools is not none and not tools_in_user_message %} + {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} +{%- endif %} +{{- system_message }} +{{- "<|eot_id|>" }} + +{#- Custom tools are passed in a user message with some extra guidance #} +{%- if tools_in_user_message and not tools is none %} + {#- Extract the first user message so we can plug it in here #} + {%- if messages | length != 0 %} + {%- set first_user_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} + {%- else %} + {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }} +{%- endif %} + {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}} + {{- "Given the following functions, please respond with a JSON for a function call " }} + {{- "with its proper arguments that best answers the given prompt.\n\n" }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} + {{- first_user_message + "<|eot_id|>"}} +{%- endif %} + +{%- for message in messages %} + {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %} + {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }} + {%- elif 'tool_calls' in message %} + {%- if not message.tool_calls|length == 1 %} + {{- raise_exception("This model only supports single tool-calls at once!") }} + {%- endif %} + {%- set tool_call = message.tool_calls[0].function %} + {%- if builtin_tools is defined and tool_call.name in builtin_tools %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- "<|python_tag|>" + tool_call.name + ".call(" }} + {%- for arg_name, arg_val in tool_call.arguments | items %} + {{- arg_name + '="' + arg_val + '"' }} + {%- if not loop.last %} + {{- ", " }} + {%- endif %} + {%- endfor %} + {{- ")" }} + {%- else %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- '{"name": "' + tool_call.name + '", ' }} + {{- '"parameters": ' }} + {{- tool_call.arguments | tojson }} + {{- "}" }} + {%- endif %} + {%- if builtin_tools is defined %} + {#- This means we're in ipython mode #} + {{- "<|eom_id|>" }} + {%- else %} + {{- "<|eot_id|>" }} + {%- endif %} + {%- elif message.role == "tool" or message.role == "ipython" %} + {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }} + {%- if message.content is mapping or message.content is iterable %} + {{- message.content | tojson }} + {%- else %} + {{- message.content }} + {%- endif %} + {{- "<|eot_id|>" }} + {%- endif %} +{%- endfor %} +{%- if add_generation_prompt %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }} +{%- endif %} diff --git a/experiments/Natural/checkpoint-1000/optimizer.pt b/experiments/Natural/checkpoint-1000/optimizer.pt new file mode 100644 index 0000000000000000000000000000000000000000..11a1a8a5784e3adbcb008818d04245f4481339db --- /dev/null +++ b/experiments/Natural/checkpoint-1000/optimizer.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9856ff7815f52a98c20f479f59360a650a6dad7fb88208a4cdf83b441486197b +size 85724133 diff --git a/experiments/Natural/checkpoint-1000/rng_state.pth b/experiments/Natural/checkpoint-1000/rng_state.pth new file mode 100644 index 0000000000000000000000000000000000000000..fead4304753e2900e172284781541c879e4507c4 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/rng_state.pth @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3d6d8fafcd1ee268414be5acf0366296af5b03d60871978712eac1979cb42d65 +size 14645 diff --git a/experiments/Natural/checkpoint-1000/scheduler.pt b/experiments/Natural/checkpoint-1000/scheduler.pt new file mode 100644 index 0000000000000000000000000000000000000000..a0bffdf8924f358e1c201230f174e1fb5a256641 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/scheduler.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1feb61d72397a28143be1198f03058782ef1f0e224e34c944ec5ee1c06b328c7 +size 1465 diff --git a/experiments/Natural/checkpoint-1000/special_tokens_map.json b/experiments/Natural/checkpoint-1000/special_tokens_map.json new file mode 100644 index 0000000000000000000000000000000000000000..3c1d04911c269b925af977a3151c9704e990e4d0 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/special_tokens_map.json @@ -0,0 +1,23 @@ +{ + "bos_token": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "eos_token": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "pad_token": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + } +} diff --git a/experiments/Natural/checkpoint-1000/tokenizer.json b/experiments/Natural/checkpoint-1000/tokenizer.json new file mode 100644 index 0000000000000000000000000000000000000000..1c1d8d5c9024994f1d3b00f9662b8dd89ca13cf2 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/tokenizer.json @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b +size 17209920 diff --git a/experiments/Natural/checkpoint-1000/tokenizer_config.json b/experiments/Natural/checkpoint-1000/tokenizer_config.json new file mode 100644 index 0000000000000000000000000000000000000000..69b6ed0e11b81375bae750eb8ec4a7e1146eeca3 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/tokenizer_config.json @@ -0,0 +1,2066 @@ +{ + "add_bos_token": true, + "added_tokens_decoder": { + "128000": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128001": { + "content": "<|end_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128002": { + "content": "<|reserved_special_token_0|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128003": { + "content": "<|reserved_special_token_1|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128004": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128005": { + "content": "<|reserved_special_token_2|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128006": { + "content": "<|start_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128007": { + "content": "<|end_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128008": { + "content": "<|eom_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128009": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128010": { + "content": "<|python_tag|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128011": { + "content": "<|reserved_special_token_3|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128012": { + "content": "<|reserved_special_token_4|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128013": { + "content": "<|reserved_special_token_5|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128014": { + "content": "<|reserved_special_token_6|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128015": { + "content": "<|reserved_special_token_7|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128016": { + "content": "<|reserved_special_token_8|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128017": { + "content": "<|reserved_special_token_9|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128018": { + "content": "<|reserved_special_token_10|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128019": { + "content": "<|reserved_special_token_11|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128020": { + "content": "<|reserved_special_token_12|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128021": { + "content": "<|reserved_special_token_13|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128022": { + "content": "<|reserved_special_token_14|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128023": { + "content": "<|reserved_special_token_15|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128024": { + "content": "<|reserved_special_token_16|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128025": { + "content": "<|reserved_special_token_17|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128026": { + "content": "<|reserved_special_token_18|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128027": { + "content": "<|reserved_special_token_19|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128028": { + "content": "<|reserved_special_token_20|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128029": { + "content": "<|reserved_special_token_21|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128030": { + "content": "<|reserved_special_token_22|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128031": { + "content": "<|reserved_special_token_23|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128032": { + "content": "<|reserved_special_token_24|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128033": { + "content": "<|reserved_special_token_25|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128034": { + "content": "<|reserved_special_token_26|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128035": { + "content": "<|reserved_special_token_27|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128036": { + "content": "<|reserved_special_token_28|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128037": { + "content": "<|reserved_special_token_29|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128038": { + "content": "<|reserved_special_token_30|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128039": { + "content": "<|reserved_special_token_31|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128040": { + "content": "<|reserved_special_token_32|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128041": { + "content": "<|reserved_special_token_33|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128042": { + "content": "<|reserved_special_token_34|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128043": { + "content": "<|reserved_special_token_35|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128044": { + "content": "<|reserved_special_token_36|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128045": { + "content": "<|reserved_special_token_37|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128046": { + "content": "<|reserved_special_token_38|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128047": { + "content": "<|reserved_special_token_39|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128048": { + "content": "<|reserved_special_token_40|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128049": { + "content": "<|reserved_special_token_41|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128050": { + "content": "<|reserved_special_token_42|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128051": { + "content": "<|reserved_special_token_43|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128052": { + "content": "<|reserved_special_token_44|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128053": { + "content": "<|reserved_special_token_45|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128054": { + "content": "<|reserved_special_token_46|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128055": { + "content": "<|reserved_special_token_47|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128056": { + "content": "<|reserved_special_token_48|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128057": { + "content": "<|reserved_special_token_49|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128058": { + "content": "<|reserved_special_token_50|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128059": { + "content": "<|reserved_special_token_51|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128060": { + "content": "<|reserved_special_token_52|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128061": { + "content": "<|reserved_special_token_53|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128062": { + "content": "<|reserved_special_token_54|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128063": { + "content": "<|reserved_special_token_55|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128064": { + "content": "<|reserved_special_token_56|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128065": { + "content": "<|reserved_special_token_57|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128066": { + "content": "<|reserved_special_token_58|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128067": { + "content": "<|reserved_special_token_59|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128068": { + "content": "<|reserved_special_token_60|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128069": { + "content": "<|reserved_special_token_61|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128070": { + "content": "<|reserved_special_token_62|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128071": { + "content": "<|reserved_special_token_63|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128072": { + "content": "<|reserved_special_token_64|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128073": { + "content": "<|reserved_special_token_65|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128074": { + "content": "<|reserved_special_token_66|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128075": { + "content": "<|reserved_special_token_67|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128076": { + "content": "<|reserved_special_token_68|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128077": { + "content": "<|reserved_special_token_69|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128078": { + "content": "<|reserved_special_token_70|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128079": { + "content": "<|reserved_special_token_71|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128080": { + "content": "<|reserved_special_token_72|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128081": { + "content": "<|reserved_special_token_73|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128082": { + "content": "<|reserved_special_token_74|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128083": { + "content": "<|reserved_special_token_75|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128084": { + "content": "<|reserved_special_token_76|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128085": { + "content": "<|reserved_special_token_77|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128086": { + "content": "<|reserved_special_token_78|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128087": { + "content": "<|reserved_special_token_79|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128088": { + "content": "<|reserved_special_token_80|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128089": { + "content": "<|reserved_special_token_81|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128090": { + "content": "<|reserved_special_token_82|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128091": { + "content": "<|reserved_special_token_83|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128092": { + "content": "<|reserved_special_token_84|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128093": { + "content": "<|reserved_special_token_85|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128094": { + "content": "<|reserved_special_token_86|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128095": { + "content": "<|reserved_special_token_87|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128096": { + "content": "<|reserved_special_token_88|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128097": { + "content": "<|reserved_special_token_89|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128098": { + "content": "<|reserved_special_token_90|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128099": { + "content": "<|reserved_special_token_91|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128100": { + "content": "<|reserved_special_token_92|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128101": { + "content": "<|reserved_special_token_93|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128102": { + "content": "<|reserved_special_token_94|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128103": { + "content": "<|reserved_special_token_95|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128104": { + "content": "<|reserved_special_token_96|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128105": { + "content": "<|reserved_special_token_97|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128106": { + "content": "<|reserved_special_token_98|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128107": { + "content": "<|reserved_special_token_99|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128108": { + "content": "<|reserved_special_token_100|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128109": { + "content": "<|reserved_special_token_101|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128110": { + "content": "<|reserved_special_token_102|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128111": { + "content": "<|reserved_special_token_103|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128112": { + "content": "<|reserved_special_token_104|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128113": { + "content": "<|reserved_special_token_105|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128114": { + "content": "<|reserved_special_token_106|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128115": { + "content": "<|reserved_special_token_107|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128116": { + "content": "<|reserved_special_token_108|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128117": { + "content": "<|reserved_special_token_109|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128118": { + "content": "<|reserved_special_token_110|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128119": { + "content": "<|reserved_special_token_111|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128120": { + "content": "<|reserved_special_token_112|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128121": { + "content": "<|reserved_special_token_113|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128122": { + "content": "<|reserved_special_token_114|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128123": { + "content": "<|reserved_special_token_115|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128124": { + "content": "<|reserved_special_token_116|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128125": { + "content": "<|reserved_special_token_117|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128126": { + "content": "<|reserved_special_token_118|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128127": { + "content": "<|reserved_special_token_119|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128128": { + "content": "<|reserved_special_token_120|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128129": { + "content": "<|reserved_special_token_121|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128130": { + "content": "<|reserved_special_token_122|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128131": { + "content": "<|reserved_special_token_123|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128132": { + "content": "<|reserved_special_token_124|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128133": { + "content": "<|reserved_special_token_125|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128134": { + "content": "<|reserved_special_token_126|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128135": { + "content": "<|reserved_special_token_127|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128136": { + "content": "<|reserved_special_token_128|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128137": { + "content": "<|reserved_special_token_129|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128138": { + "content": "<|reserved_special_token_130|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128139": { + "content": "<|reserved_special_token_131|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128140": { + "content": "<|reserved_special_token_132|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128141": { + "content": "<|reserved_special_token_133|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128142": { + "content": "<|reserved_special_token_134|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128143": { + "content": "<|reserved_special_token_135|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128144": { + "content": "<|reserved_special_token_136|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128145": { + "content": "<|reserved_special_token_137|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128146": { + "content": "<|reserved_special_token_138|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128147": { + "content": "<|reserved_special_token_139|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128148": { + "content": "<|reserved_special_token_140|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128149": { + "content": "<|reserved_special_token_141|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128150": { + "content": "<|reserved_special_token_142|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128151": { + "content": "<|reserved_special_token_143|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128152": { + "content": "<|reserved_special_token_144|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128153": { + "content": "<|reserved_special_token_145|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128154": { + "content": "<|reserved_special_token_146|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128155": { + "content": "<|reserved_special_token_147|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128156": { + "content": "<|reserved_special_token_148|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128157": { + "content": "<|reserved_special_token_149|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128158": { + "content": "<|reserved_special_token_150|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128159": { + "content": "<|reserved_special_token_151|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128160": { + "content": "<|reserved_special_token_152|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128161": { + "content": "<|reserved_special_token_153|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128162": { + "content": "<|reserved_special_token_154|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128163": { + "content": "<|reserved_special_token_155|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128164": { + "content": "<|reserved_special_token_156|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128165": { + "content": "<|reserved_special_token_157|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128166": { + "content": "<|reserved_special_token_158|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128167": { + "content": "<|reserved_special_token_159|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128168": { + "content": "<|reserved_special_token_160|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128169": { + "content": "<|reserved_special_token_161|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128170": { + "content": "<|reserved_special_token_162|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128171": { + "content": "<|reserved_special_token_163|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128172": { + "content": "<|reserved_special_token_164|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128173": { + "content": "<|reserved_special_token_165|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128174": { + "content": "<|reserved_special_token_166|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128175": { + "content": "<|reserved_special_token_167|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128176": { + "content": "<|reserved_special_token_168|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128177": { + "content": "<|reserved_special_token_169|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128178": { + "content": "<|reserved_special_token_170|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128179": { + "content": "<|reserved_special_token_171|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128180": { + "content": "<|reserved_special_token_172|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128181": { + "content": "<|reserved_special_token_173|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128182": { + "content": "<|reserved_special_token_174|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128183": { + "content": "<|reserved_special_token_175|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128184": { + "content": "<|reserved_special_token_176|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128185": { + "content": "<|reserved_special_token_177|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128186": { + "content": "<|reserved_special_token_178|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128187": { + "content": "<|reserved_special_token_179|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128188": { + "content": "<|reserved_special_token_180|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128189": { + "content": "<|reserved_special_token_181|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128190": { + "content": "<|reserved_special_token_182|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128191": { + "content": "<|reserved_special_token_183|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128192": { + "content": "<|reserved_special_token_184|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128193": { + "content": "<|reserved_special_token_185|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128194": { + "content": "<|reserved_special_token_186|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128195": { + "content": "<|reserved_special_token_187|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128196": { + "content": "<|reserved_special_token_188|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128197": { + "content": "<|reserved_special_token_189|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128198": { + "content": "<|reserved_special_token_190|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128199": { + "content": "<|reserved_special_token_191|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128200": { + "content": "<|reserved_special_token_192|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128201": { + "content": "<|reserved_special_token_193|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128202": { + "content": "<|reserved_special_token_194|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128203": { + "content": "<|reserved_special_token_195|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128204": { + "content": "<|reserved_special_token_196|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128205": { + "content": "<|reserved_special_token_197|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128206": { + "content": "<|reserved_special_token_198|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128207": { + "content": "<|reserved_special_token_199|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128208": { + "content": "<|reserved_special_token_200|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128209": { + "content": "<|reserved_special_token_201|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128210": { + "content": "<|reserved_special_token_202|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128211": { + "content": "<|reserved_special_token_203|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128212": { + "content": "<|reserved_special_token_204|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128213": { + "content": "<|reserved_special_token_205|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128214": { + "content": "<|reserved_special_token_206|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128215": { + "content": "<|reserved_special_token_207|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128216": { + "content": "<|reserved_special_token_208|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128217": { + "content": "<|reserved_special_token_209|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128218": { + "content": "<|reserved_special_token_210|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128219": { + "content": "<|reserved_special_token_211|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128220": { + "content": "<|reserved_special_token_212|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128221": { + "content": "<|reserved_special_token_213|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128222": { + "content": "<|reserved_special_token_214|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128223": { + "content": "<|reserved_special_token_215|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128224": { + "content": "<|reserved_special_token_216|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128225": { + "content": "<|reserved_special_token_217|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128226": { + "content": "<|reserved_special_token_218|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128227": { + "content": "<|reserved_special_token_219|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128228": { + "content": "<|reserved_special_token_220|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128229": { + "content": "<|reserved_special_token_221|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128230": { + "content": "<|reserved_special_token_222|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128231": { + "content": "<|reserved_special_token_223|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128232": { + "content": "<|reserved_special_token_224|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128233": { + "content": "<|reserved_special_token_225|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128234": { + "content": "<|reserved_special_token_226|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128235": { + "content": "<|reserved_special_token_227|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128236": { + "content": "<|reserved_special_token_228|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128237": { + "content": "<|reserved_special_token_229|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128238": { + "content": "<|reserved_special_token_230|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128239": { + "content": "<|reserved_special_token_231|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128240": { + "content": "<|reserved_special_token_232|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128241": { + "content": "<|reserved_special_token_233|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128242": { + "content": "<|reserved_special_token_234|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128243": { + "content": "<|reserved_special_token_235|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128244": { + "content": "<|reserved_special_token_236|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128245": { + "content": "<|reserved_special_token_237|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128246": { + "content": "<|reserved_special_token_238|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128247": { + "content": "<|reserved_special_token_239|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128248": { + "content": "<|reserved_special_token_240|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128249": { + "content": "<|reserved_special_token_241|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128250": { + "content": "<|reserved_special_token_242|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128251": { + "content": "<|reserved_special_token_243|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128252": { + "content": "<|reserved_special_token_244|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128253": { + "content": "<|reserved_special_token_245|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128254": { + "content": "<|reserved_special_token_246|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128255": { + "content": "<|reserved_special_token_247|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + } + }, + "bos_token": "<|begin_of_text|>", + "clean_up_tokenization_spaces": true, + "eos_token": "<|eot_id|>", + "extra_special_tokens": {}, + "model_input_names": [ + "input_ids", + "attention_mask" + ], + "model_max_length": 131072, + "pad_token": "<|finetune_right_pad_id|>", + "padding_side": "right", + "tokenizer_class": "PreTrainedTokenizerFast", + "unk_token": null +} diff --git a/experiments/Natural/checkpoint-1000/trainer_state.json b/experiments/Natural/checkpoint-1000/trainer_state.json new file mode 100644 index 0000000000000000000000000000000000000000..1932eaa9dda299c7b827f8919325f5ca1b3c6447 --- /dev/null +++ b/experiments/Natural/checkpoint-1000/trainer_state.json @@ -0,0 +1,734 @@ +{ + "best_global_step": null, + "best_metric": null, + "best_model_checkpoint": null, + "epoch": 3.1645569620253164, + "eval_steps": 500, + "global_step": 1000, + "is_hyper_param_search": false, + "is_local_process_zero": true, + "is_world_process_zero": true, + "log_history": [ + { + "epoch": 0.03164556962025317, + "grad_norm": 5.501315116882324, + "learning_rate": 0.00018, + "loss": 2.5563, + "step": 10 + }, + { + "epoch": 0.06329113924050633, + "grad_norm": 160.5225067138672, + "learning_rate": 0.00019885350318471338, + "loss": 1.5451, + "step": 20 + }, + { + "epoch": 0.0949367088607595, + "grad_norm": 10.833513259887695, + "learning_rate": 0.00019757961783439492, + "loss": 1.8865, + "step": 30 + }, + { + "epoch": 0.12658227848101267, + "grad_norm": 16.25729751586914, + "learning_rate": 0.00019630573248407643, + "loss": 1.3788, + "step": 40 + }, + { + "epoch": 0.15822784810126583, + "grad_norm": 3.233597755432129, + "learning_rate": 0.00019503184713375797, + "loss": 1.1314, + "step": 50 + }, + { + "epoch": 0.189873417721519, + "grad_norm": 3.3475453853607178, + "learning_rate": 0.0001937579617834395, + "loss": 1.0585, + "step": 60 + }, + { + "epoch": 0.22151898734177214, + "grad_norm": 2.3403992652893066, + "learning_rate": 0.00019248407643312102, + "loss": 1.0554, + "step": 70 + }, + { + "epoch": 0.25316455696202533, + "grad_norm": 2.324516534805298, + "learning_rate": 0.00019121019108280256, + "loss": 1.0274, + "step": 80 + }, + { + "epoch": 0.2848101265822785, + "grad_norm": 2.125304937362671, + "learning_rate": 0.0001899363057324841, + "loss": 1.0045, + "step": 90 + }, + { + "epoch": 0.31645569620253167, + "grad_norm": 2.1273205280303955, + "learning_rate": 0.0001886624203821656, + "loss": 0.9993, + "step": 100 + }, + { + "epoch": 0.34810126582278483, + "grad_norm": 2.5348403453826904, + "learning_rate": 0.00018738853503184714, + "loss": 1.0386, + "step": 110 + }, + { + "epoch": 0.379746835443038, + "grad_norm": 2.660738468170166, + "learning_rate": 0.00018611464968152868, + "loss": 0.992, + "step": 120 + }, + { + "epoch": 0.41139240506329117, + "grad_norm": 2.187695026397705, + "learning_rate": 0.0001848407643312102, + "loss": 1.0174, + "step": 130 + }, + { + "epoch": 0.4430379746835443, + "grad_norm": 2.0130527019500732, + "learning_rate": 0.00018356687898089173, + "loss": 1.0349, + "step": 140 + }, + { + "epoch": 0.47468354430379744, + "grad_norm": 2.2986974716186523, + "learning_rate": 0.00018229299363057327, + "loss": 1.0426, + "step": 150 + }, + { + "epoch": 0.5063291139240507, + "grad_norm": 2.0907416343688965, + "learning_rate": 0.00018101910828025478, + "loss": 0.9566, + "step": 160 + }, + { + "epoch": 0.5379746835443038, + "grad_norm": 2.263169765472412, + "learning_rate": 0.00017974522292993632, + "loss": 0.9728, + "step": 170 + }, + { + "epoch": 0.569620253164557, + "grad_norm": 1.950455665588379, + "learning_rate": 0.00017847133757961786, + "loss": 0.9681, + "step": 180 + }, + { + "epoch": 0.6012658227848101, + "grad_norm": 1.991625189781189, + "learning_rate": 0.00017719745222929937, + "loss": 0.9877, + "step": 190 + }, + { + "epoch": 0.6329113924050633, + "grad_norm": 2.5864851474761963, + "learning_rate": 0.0001759235668789809, + "loss": 0.9536, + "step": 200 + }, + { + "epoch": 0.6645569620253164, + "grad_norm": 1.9064277410507202, + "learning_rate": 0.00017464968152866244, + "loss": 0.9546, + "step": 210 + }, + { + "epoch": 0.6962025316455697, + "grad_norm": 2.235928773880005, + "learning_rate": 0.00017337579617834396, + "loss": 0.9241, + "step": 220 + }, + { + "epoch": 0.7278481012658228, + "grad_norm": 1.9112043380737305, + "learning_rate": 0.0001721019108280255, + "loss": 0.966, + "step": 230 + }, + { + "epoch": 0.759493670886076, + "grad_norm": 2.6696879863739014, + "learning_rate": 0.00017082802547770703, + "loss": 0.8924, + "step": 240 + }, + { + "epoch": 0.7911392405063291, + "grad_norm": 2.395738124847412, + "learning_rate": 0.00016955414012738854, + "loss": 0.9879, + "step": 250 + }, + { + "epoch": 0.8227848101265823, + "grad_norm": 2.1325836181640625, + "learning_rate": 0.00016828025477707008, + "loss": 0.9125, + "step": 260 + }, + { + "epoch": 0.8544303797468354, + "grad_norm": 3.023322582244873, + "learning_rate": 0.00016700636942675162, + "loss": 0.9578, + "step": 270 + }, + { + "epoch": 0.8860759493670886, + "grad_norm": 2.16930890083313, + "learning_rate": 0.00016573248407643313, + "loss": 0.9655, + "step": 280 + }, + { + "epoch": 0.9177215189873418, + "grad_norm": 2.751526355743408, + "learning_rate": 0.00016445859872611467, + "loss": 0.8529, + "step": 290 + }, + { + "epoch": 0.9493670886075949, + "grad_norm": 2.2014594078063965, + "learning_rate": 0.00016318471337579618, + "loss": 0.8895, + "step": 300 + }, + { + "epoch": 0.9810126582278481, + "grad_norm": 2.498781681060791, + "learning_rate": 0.00016191082802547772, + "loss": 0.9022, + "step": 310 + }, + { + "epoch": 1.0126582278481013, + "grad_norm": 1.6269073486328125, + "learning_rate": 0.00016063694267515926, + "loss": 0.7462, + "step": 320 + }, + { + "epoch": 1.0443037974683544, + "grad_norm": 2.417710304260254, + "learning_rate": 0.00015936305732484077, + "loss": 0.6435, + "step": 330 + }, + { + "epoch": 1.0759493670886076, + "grad_norm": 2.120162010192871, + "learning_rate": 0.0001580891719745223, + "loss": 0.6222, + "step": 340 + }, + { + "epoch": 1.1075949367088607, + "grad_norm": 1.8784149885177612, + "learning_rate": 0.00015681528662420385, + "loss": 0.6014, + "step": 350 + }, + { + "epoch": 1.139240506329114, + "grad_norm": 1.9097055196762085, + "learning_rate": 0.00015554140127388536, + "loss": 0.618, + "step": 360 + }, + { + "epoch": 1.1708860759493671, + "grad_norm": 3.8499958515167236, + "learning_rate": 0.0001542675159235669, + "loss": 0.6094, + "step": 370 + }, + { + "epoch": 1.2025316455696202, + "grad_norm": 2.857755184173584, + "learning_rate": 0.00015299363057324843, + "loss": 0.644, + "step": 380 + }, + { + "epoch": 1.2341772151898733, + "grad_norm": 1.798422932624817, + "learning_rate": 0.00015171974522292994, + "loss": 0.6059, + "step": 390 + }, + { + "epoch": 1.2658227848101267, + "grad_norm": 2.251343011856079, + "learning_rate": 0.00015044585987261148, + "loss": 0.6059, + "step": 400 + }, + { + "epoch": 1.2974683544303798, + "grad_norm": 1.714311122894287, + "learning_rate": 0.000149171974522293, + "loss": 0.6263, + "step": 410 + }, + { + "epoch": 1.3291139240506329, + "grad_norm": 2.1517114639282227, + "learning_rate": 0.00014789808917197453, + "loss": 0.6018, + "step": 420 + }, + { + "epoch": 1.360759493670886, + "grad_norm": 2.019310235977173, + "learning_rate": 0.00014662420382165604, + "loss": 0.6241, + "step": 430 + }, + { + "epoch": 1.3924050632911391, + "grad_norm": 3.1832761764526367, + "learning_rate": 0.00014535031847133758, + "loss": 0.6105, + "step": 440 + }, + { + "epoch": 1.4240506329113924, + "grad_norm": 2.199019432067871, + "learning_rate": 0.0001440764331210191, + "loss": 0.6367, + "step": 450 + }, + { + "epoch": 1.4556962025316456, + "grad_norm": 2.4912033081054688, + "learning_rate": 0.00014280254777070063, + "loss": 0.6339, + "step": 460 + }, + { + "epoch": 1.4873417721518987, + "grad_norm": 2.6481103897094727, + "learning_rate": 0.00014152866242038217, + "loss": 0.6062, + "step": 470 + }, + { + "epoch": 1.518987341772152, + "grad_norm": 2.133782386779785, + "learning_rate": 0.00014025477707006368, + "loss": 0.6095, + "step": 480 + }, + { + "epoch": 1.5506329113924051, + "grad_norm": 2.9077465534210205, + "learning_rate": 0.00013898089171974522, + "loss": 0.5843, + "step": 490 + }, + { + "epoch": 1.5822784810126582, + "grad_norm": 2.5229060649871826, + "learning_rate": 0.00013770700636942676, + "loss": 0.6227, + "step": 500 + }, + { + "epoch": 1.6139240506329116, + "grad_norm": 2.6327691078186035, + "learning_rate": 0.00013643312101910827, + "loss": 0.6238, + "step": 510 + }, + { + "epoch": 1.6455696202531644, + "grad_norm": 2.156597852706909, + "learning_rate": 0.0001351592356687898, + "loss": 0.5719, + "step": 520 + }, + { + "epoch": 1.6772151898734178, + "grad_norm": 2.23740553855896, + "learning_rate": 0.00013388535031847134, + "loss": 0.5821, + "step": 530 + }, + { + "epoch": 1.7088607594936709, + "grad_norm": 2.254840135574341, + "learning_rate": 0.00013261146496815286, + "loss": 0.6063, + "step": 540 + }, + { + "epoch": 1.740506329113924, + "grad_norm": 2.106001377105713, + "learning_rate": 0.0001313375796178344, + "loss": 0.6252, + "step": 550 + }, + { + "epoch": 1.7721518987341773, + "grad_norm": 2.2712509632110596, + "learning_rate": 0.00013006369426751593, + "loss": 0.6271, + "step": 560 + }, + { + "epoch": 1.8037974683544302, + "grad_norm": 2.142057180404663, + "learning_rate": 0.00012878980891719744, + "loss": 0.575, + "step": 570 + }, + { + "epoch": 1.8354430379746836, + "grad_norm": 1.9250198602676392, + "learning_rate": 0.00012751592356687898, + "loss": 0.568, + "step": 580 + }, + { + "epoch": 1.8670886075949367, + "grad_norm": 2.0625407695770264, + "learning_rate": 0.00012624203821656052, + "loss": 0.6047, + "step": 590 + }, + { + "epoch": 1.8987341772151898, + "grad_norm": 3.7402431964874268, + "learning_rate": 0.00012496815286624203, + "loss": 0.581, + "step": 600 + }, + { + "epoch": 1.9303797468354431, + "grad_norm": 1.8032431602478027, + "learning_rate": 0.00012369426751592357, + "loss": 0.6124, + "step": 610 + }, + { + "epoch": 1.9620253164556962, + "grad_norm": 2.4170119762420654, + "learning_rate": 0.0001224203821656051, + "loss": 0.5682, + "step": 620 + }, + { + "epoch": 1.9936708860759493, + "grad_norm": 2.7495386600494385, + "learning_rate": 0.00012114649681528662, + "loss": 0.566, + "step": 630 + }, + { + "epoch": 2.0253164556962027, + "grad_norm": 2.5206427574157715, + "learning_rate": 0.00011987261146496816, + "loss": 0.3717, + "step": 640 + }, + { + "epoch": 2.0569620253164556, + "grad_norm": 2.323184013366699, + "learning_rate": 0.00011859872611464968, + "loss": 0.3412, + "step": 650 + }, + { + "epoch": 2.088607594936709, + "grad_norm": 2.0928003787994385, + "learning_rate": 0.0001173248407643312, + "loss": 0.3217, + "step": 660 + }, + { + "epoch": 2.1202531645569622, + "grad_norm": 2.0109825134277344, + "learning_rate": 0.00011605095541401274, + "loss": 0.3313, + "step": 670 + }, + { + "epoch": 2.151898734177215, + "grad_norm": 2.067814826965332, + "learning_rate": 0.00011477707006369427, + "loss": 0.3388, + "step": 680 + }, + { + "epoch": 2.1835443037974684, + "grad_norm": 2.0013394355773926, + "learning_rate": 0.0001135031847133758, + "loss": 0.338, + "step": 690 + }, + { + "epoch": 2.2151898734177213, + "grad_norm": 1.7796369791030884, + "learning_rate": 0.00011222929936305733, + "loss": 0.324, + "step": 700 + }, + { + "epoch": 2.2468354430379747, + "grad_norm": 2.0786919593811035, + "learning_rate": 0.00011095541401273886, + "loss": 0.3391, + "step": 710 + }, + { + "epoch": 2.278481012658228, + "grad_norm": 2.154378890991211, + "learning_rate": 0.00010968152866242038, + "loss": 0.3377, + "step": 720 + }, + { + "epoch": 2.310126582278481, + "grad_norm": 2.065183639526367, + "learning_rate": 0.00010840764331210192, + "loss": 0.3486, + "step": 730 + }, + { + "epoch": 2.3417721518987342, + "grad_norm": 1.972088098526001, + "learning_rate": 0.00010713375796178344, + "loss": 0.3347, + "step": 740 + }, + { + "epoch": 2.3734177215189876, + "grad_norm": 2.141294002532959, + "learning_rate": 0.00010585987261146497, + "loss": 0.335, + "step": 750 + }, + { + "epoch": 2.4050632911392404, + "grad_norm": 2.27059006690979, + "learning_rate": 0.0001045859872611465, + "loss": 0.3481, + "step": 760 + }, + { + "epoch": 2.4367088607594938, + "grad_norm": 2.0947511196136475, + "learning_rate": 0.00010331210191082803, + "loss": 0.3437, + "step": 770 + }, + { + "epoch": 2.4683544303797467, + "grad_norm": 2.0567169189453125, + "learning_rate": 0.00010203821656050956, + "loss": 0.3434, + "step": 780 + }, + { + "epoch": 2.5, + "grad_norm": 2.0784637928009033, + "learning_rate": 0.00010076433121019108, + "loss": 0.335, + "step": 790 + }, + { + "epoch": 2.5316455696202533, + "grad_norm": 1.9443864822387695, + "learning_rate": 9.949044585987262e-05, + "loss": 0.349, + "step": 800 + }, + { + "epoch": 2.5632911392405062, + "grad_norm": 2.338250160217285, + "learning_rate": 9.821656050955414e-05, + "loss": 0.3433, + "step": 810 + }, + { + "epoch": 2.5949367088607596, + "grad_norm": 1.9308645725250244, + "learning_rate": 9.694267515923567e-05, + "loss": 0.3344, + "step": 820 + }, + { + "epoch": 2.6265822784810124, + "grad_norm": 2.1741745471954346, + "learning_rate": 9.566878980891721e-05, + "loss": 0.3241, + "step": 830 + }, + { + "epoch": 2.6582278481012658, + "grad_norm": 1.8227561712265015, + "learning_rate": 9.439490445859873e-05, + "loss": 0.3289, + "step": 840 + }, + { + "epoch": 2.689873417721519, + "grad_norm": 2.090834856033325, + "learning_rate": 9.312101910828026e-05, + "loss": 0.3431, + "step": 850 + }, + { + "epoch": 2.721518987341772, + "grad_norm": 1.823628544807434, + "learning_rate": 9.18471337579618e-05, + "loss": 0.3502, + "step": 860 + }, + { + "epoch": 2.7531645569620253, + "grad_norm": 2.5202064514160156, + "learning_rate": 9.057324840764332e-05, + "loss": 0.3409, + "step": 870 + }, + { + "epoch": 2.7848101265822782, + "grad_norm": 1.9167916774749756, + "learning_rate": 8.929936305732484e-05, + "loss": 0.3372, + "step": 880 + }, + { + "epoch": 2.8164556962025316, + "grad_norm": 2.5479819774627686, + "learning_rate": 8.802547770700637e-05, + "loss": 0.3442, + "step": 890 + }, + { + "epoch": 2.848101265822785, + "grad_norm": 1.6813645362854004, + "learning_rate": 8.675159235668791e-05, + "loss": 0.336, + "step": 900 + }, + { + "epoch": 2.879746835443038, + "grad_norm": 2.1691527366638184, + "learning_rate": 8.547770700636943e-05, + "loss": 0.3275, + "step": 910 + }, + { + "epoch": 2.911392405063291, + "grad_norm": 1.9385488033294678, + "learning_rate": 8.420382165605096e-05, + "loss": 0.3433, + "step": 920 + }, + { + "epoch": 2.9430379746835444, + "grad_norm": 1.9246203899383545, + "learning_rate": 8.29299363057325e-05, + "loss": 0.3487, + "step": 930 + }, + { + "epoch": 2.9746835443037973, + "grad_norm": 1.95414137840271, + "learning_rate": 8.165605095541402e-05, + "loss": 0.3437, + "step": 940 + }, + { + "epoch": 3.0063291139240507, + "grad_norm": 1.1191596984863281, + "learning_rate": 8.038216560509555e-05, + "loss": 0.3057, + "step": 950 + }, + { + "epoch": 3.037974683544304, + "grad_norm": 1.5922425985336304, + "learning_rate": 7.910828025477708e-05, + "loss": 0.2133, + "step": 960 + }, + { + "epoch": 3.069620253164557, + "grad_norm": 1.863950252532959, + "learning_rate": 7.783439490445861e-05, + "loss": 0.2167, + "step": 970 + }, + { + "epoch": 3.1012658227848102, + "grad_norm": 1.3625264167785645, + "learning_rate": 7.656050955414013e-05, + "loss": 0.2169, + "step": 980 + }, + { + "epoch": 3.132911392405063, + "grad_norm": 1.5241615772247314, + "learning_rate": 7.528662420382167e-05, + "loss": 0.2297, + "step": 990 + }, + { + "epoch": 3.1645569620253164, + "grad_norm": 1.5062488317489624, + "learning_rate": 7.401273885350318e-05, + "loss": 0.2299, + "step": 1000 + } + ], + "logging_steps": 10, + "max_steps": 1580, + "num_input_tokens_seen": 0, + "num_train_epochs": 5, + "save_steps": 500, + "stateful_callbacks": { + "TrainerControl": { + "args": { + "should_epoch_stop": false, + "should_evaluate": false, + "should_log": false, + "should_save": true, + "should_training_stop": false + }, + "attributes": {} + } + }, + "total_flos": 6.44985502138368e+16, + "train_batch_size": 8, + "trial_name": null, + "trial_params": null +} diff --git a/experiments/Natural/checkpoint-1000/training_args.bin b/experiments/Natural/checkpoint-1000/training_args.bin new file mode 100644 index 0000000000000000000000000000000000000000..99f86c4b08bf7d822cc3dfc3af42fda12dd8131d --- /dev/null +++ b/experiments/Natural/checkpoint-1000/training_args.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05dd2bd1bfc0875dd1346331bc6ef556abef03f996a81a19556acac64e1f133a +size 6289 diff --git a/experiments/Natural/checkpoint-1500/README.md b/experiments/Natural/checkpoint-1500/README.md new file mode 100644 index 0000000000000000000000000000000000000000..6e1128c4737461313d01ab9fe9909a170568a6d0 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/README.md @@ -0,0 +1,210 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +library_name: peft +pipeline_tag: text-generation +tags: +- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +- lora +- sft +- transformers +- trl +- unsloth +--- + +# Model Card for Model ID + + + + + +## Model Details + +### Model Description + + + + + +- **Developed by:** [More Information Needed] +- **Funded by [optional]:** [More Information Needed] +- **Shared by [optional]:** [More Information Needed] +- **Model type:** [More Information Needed] +- **Language(s) (NLP):** [More Information Needed] +- **License:** [More Information Needed] +- **Finetuned from model [optional]:** [More Information Needed] + +### Model Sources [optional] + + + +- **Repository:** [More Information Needed] +- **Paper [optional]:** [More Information Needed] +- **Demo [optional]:** [More Information Needed] + +## Uses + + + +### Direct Use + + + +[More Information Needed] + +### Downstream Use [optional] + + + +[More Information Needed] + +### Out-of-Scope Use + + + +[More Information Needed] + +## Bias, Risks, and Limitations + + + +[More Information Needed] + +### Recommendations + + + +Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. + +## How to Get Started with the Model + +Use the code below to get started with the model. + +[More Information Needed] + +## Training Details + +### Training Data + + + +[More Information Needed] + +### Training Procedure + + + +#### Preprocessing [optional] + +[More Information Needed] + + +#### Training Hyperparameters + +- **Training regime:** [More Information Needed] + +#### Speeds, Sizes, Times [optional] + + + +[More Information Needed] + +## Evaluation + + + +### Testing Data, Factors & Metrics + +#### Testing Data + + + +[More Information Needed] + +#### Factors + + + +[More Information Needed] + +#### Metrics + + + +[More Information Needed] + +### Results + +[More Information Needed] + +#### Summary + + + +## Model Examination [optional] + + + +[More Information Needed] + +## Environmental Impact + + + +Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). + +- **Hardware Type:** [More Information Needed] +- **Hours used:** [More Information Needed] +- **Cloud Provider:** [More Information Needed] +- **Compute Region:** [More Information Needed] +- **Carbon Emitted:** [More Information Needed] + +## Technical Specifications [optional] + +### Model Architecture and Objective + +[More Information Needed] + +### Compute Infrastructure + +[More Information Needed] + +#### Hardware + +[More Information Needed] + +#### Software + +[More Information Needed] + +## Citation [optional] + + + +**BibTeX:** + +[More Information Needed] + +**APA:** + +[More Information Needed] + +## Glossary [optional] + + + +[More Information Needed] + +## More Information [optional] + +[More Information Needed] + +## Model Card Authors [optional] + +[More Information Needed] + +## Model Card Contact + +[More Information Needed] +### Framework versions + +- PEFT 0.18.1 \ No newline at end of file diff --git a/experiments/Natural/checkpoint-1500/adapter_config.json b/experiments/Natural/checkpoint-1500/adapter_config.json new file mode 100644 index 0000000000000000000000000000000000000000..7c2e352b20dfcbcac0e45c46b2bd6a1fddd7caf6 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/adapter_config.json @@ -0,0 +1,50 @@ +{ + "alora_invocation_tokens": null, + "alpha_pattern": {}, + "arrow_config": null, + "auto_mapping": { + "base_model_class": "LlamaForCausalLM", + "parent_library": "transformers.models.llama.modeling_llama", + "unsloth_fixed": true + }, + "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit", + "bias": "none", + "corda_config": null, + "ensure_weight_tying": false, + "eva_config": null, + "exclude_modules": null, + "fan_in_fan_out": false, + "inference_mode": true, + "init_lora_weights": true, + "layer_replication": null, + "layers_pattern": null, + "layers_to_transform": null, + "loftq_config": {}, + "lora_alpha": 32, + "lora_bias": false, + "lora_dropout": 0, + "megatron_config": null, + "megatron_core": "megatron.core", + "modules_to_save": null, + "peft_type": "LORA", + "peft_version": "0.18.1", + "qalora_group_size": 16, + "r": 16, + "rank_pattern": {}, + "revision": null, + "target_modules": [ + "gate_proj", + "v_proj", + "o_proj", + "k_proj", + "up_proj", + "down_proj", + "q_proj" + ], + "target_parameters": null, + "task_type": "CAUSAL_LM", + "trainable_token_indices": null, + "use_dora": false, + "use_qalora": false, + "use_rslora": true +} \ No newline at end of file diff --git a/experiments/Natural/checkpoint-1500/adapter_model.safetensors b/experiments/Natural/checkpoint-1500/adapter_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..0cb6cb90d5fae34c54bb19260cfdfb3fb1c2bb9b --- /dev/null +++ b/experiments/Natural/checkpoint-1500/adapter_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4a13b18909a061c72c46af2ab66de0c47967ca8448b626042b94e4d0d5d98d06 +size 167832240 diff --git a/experiments/Natural/checkpoint-1500/chat_template.jinja b/experiments/Natural/checkpoint-1500/chat_template.jinja new file mode 100644 index 0000000000000000000000000000000000000000..33089ace1be88f22a10fe861ad49718d5d886090 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/chat_template.jinja @@ -0,0 +1,109 @@ +{{- bos_token }} +{%- if custom_tools is defined %} + {%- set tools = custom_tools %} +{%- endif %} +{%- if not tools_in_user_message is defined %} + {%- set tools_in_user_message = true %} +{%- endif %} +{%- if not date_string is defined %} + {%- set date_string = "26 Jul 2024" %} +{%- endif %} +{%- if not tools is defined %} + {%- set tools = none %} +{%- endif %} + +{#- This block extracts the system message, so we can slot it into the right place. #} +{%- if messages[0]['role'] == 'system' %} + {%- set system_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} +{%- else %} + {%- set system_message = "" %} +{%- endif %} + +{#- System message + builtin tools #} +{{- "<|start_header_id|>system<|end_header_id|>\n\n" }} +{%- if builtin_tools is defined or tools is not none %} + {{- "Environment: ipython\n" }} +{%- endif %} +{%- if builtin_tools is defined %} + {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}} +{%- endif %} +{{- "Cutting Knowledge Date: December 2023\n" }} +{{- "Today Date: " + date_string + "\n\n" }} +{%- if tools is not none and not tools_in_user_message %} + {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} +{%- endif %} +{{- system_message }} +{{- "<|eot_id|>" }} + +{#- Custom tools are passed in a user message with some extra guidance #} +{%- if tools_in_user_message and not tools is none %} + {#- Extract the first user message so we can plug it in here #} + {%- if messages | length != 0 %} + {%- set first_user_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} + {%- else %} + {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }} +{%- endif %} + {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}} + {{- "Given the following functions, please respond with a JSON for a function call " }} + {{- "with its proper arguments that best answers the given prompt.\n\n" }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} + {{- first_user_message + "<|eot_id|>"}} +{%- endif %} + +{%- for message in messages %} + {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %} + {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }} + {%- elif 'tool_calls' in message %} + {%- if not message.tool_calls|length == 1 %} + {{- raise_exception("This model only supports single tool-calls at once!") }} + {%- endif %} + {%- set tool_call = message.tool_calls[0].function %} + {%- if builtin_tools is defined and tool_call.name in builtin_tools %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- "<|python_tag|>" + tool_call.name + ".call(" }} + {%- for arg_name, arg_val in tool_call.arguments | items %} + {{- arg_name + '="' + arg_val + '"' }} + {%- if not loop.last %} + {{- ", " }} + {%- endif %} + {%- endfor %} + {{- ")" }} + {%- else %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- '{"name": "' + tool_call.name + '", ' }} + {{- '"parameters": ' }} + {{- tool_call.arguments | tojson }} + {{- "}" }} + {%- endif %} + {%- if builtin_tools is defined %} + {#- This means we're in ipython mode #} + {{- "<|eom_id|>" }} + {%- else %} + {{- "<|eot_id|>" }} + {%- endif %} + {%- elif message.role == "tool" or message.role == "ipython" %} + {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }} + {%- if message.content is mapping or message.content is iterable %} + {{- message.content | tojson }} + {%- else %} + {{- message.content }} + {%- endif %} + {{- "<|eot_id|>" }} + {%- endif %} +{%- endfor %} +{%- if add_generation_prompt %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }} +{%- endif %} diff --git a/experiments/Natural/checkpoint-1500/optimizer.pt b/experiments/Natural/checkpoint-1500/optimizer.pt new file mode 100644 index 0000000000000000000000000000000000000000..80ec80457d0fe770d173acd60fa9a0c1b9a95848 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/optimizer.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fa0f40561f07a50da65fbcb118850411dc6801e1cff24b5bcce175ae889476f4 +size 85724133 diff --git a/experiments/Natural/checkpoint-1500/rng_state.pth b/experiments/Natural/checkpoint-1500/rng_state.pth new file mode 100644 index 0000000000000000000000000000000000000000..ecd5163c23b56be6c4d0a107794dc7b316f940a1 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/rng_state.pth @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89645f9f6a2a8823b334e0748e4f5ea683a27b3d02632f0a241397db55d82fad +size 14645 diff --git a/experiments/Natural/checkpoint-1500/scheduler.pt b/experiments/Natural/checkpoint-1500/scheduler.pt new file mode 100644 index 0000000000000000000000000000000000000000..ca8119860b1d8353bb4b74fb00666caac7685424 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/scheduler.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:335baa63e82597c255e7611a04eab7c11007a23568b10cf1834afbadbcafd733 +size 1465 diff --git a/experiments/Natural/checkpoint-1500/special_tokens_map.json b/experiments/Natural/checkpoint-1500/special_tokens_map.json new file mode 100644 index 0000000000000000000000000000000000000000..3c1d04911c269b925af977a3151c9704e990e4d0 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/special_tokens_map.json @@ -0,0 +1,23 @@ +{ + "bos_token": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "eos_token": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "pad_token": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + } +} diff --git a/experiments/Natural/checkpoint-1500/tokenizer.json b/experiments/Natural/checkpoint-1500/tokenizer.json new file mode 100644 index 0000000000000000000000000000000000000000..1c1d8d5c9024994f1d3b00f9662b8dd89ca13cf2 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/tokenizer.json @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b +size 17209920 diff --git a/experiments/Natural/checkpoint-1500/tokenizer_config.json b/experiments/Natural/checkpoint-1500/tokenizer_config.json new file mode 100644 index 0000000000000000000000000000000000000000..69b6ed0e11b81375bae750eb8ec4a7e1146eeca3 --- /dev/null +++ b/experiments/Natural/checkpoint-1500/tokenizer_config.json @@ -0,0 +1,2066 @@ +{ + "add_bos_token": true, + "added_tokens_decoder": { + "128000": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128001": { + "content": "<|end_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128002": { + "content": "<|reserved_special_token_0|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128003": { + "content": "<|reserved_special_token_1|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128004": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128005": { + "content": "<|reserved_special_token_2|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128006": { + "content": "<|start_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128007": { + "content": "<|end_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128008": { + "content": "<|eom_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128009": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128010": { + "content": "<|python_tag|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128011": { + "content": "<|reserved_special_token_3|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128012": { + "content": "<|reserved_special_token_4|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128013": { + "content": "<|reserved_special_token_5|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128014": { + "content": "<|reserved_special_token_6|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128015": { + "content": "<|reserved_special_token_7|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128016": { + "content": "<|reserved_special_token_8|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128017": { + "content": "<|reserved_special_token_9|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128018": { + "content": "<|reserved_special_token_10|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128019": { + "content": "<|reserved_special_token_11|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128020": { + "content": "<|reserved_special_token_12|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128021": { + "content": "<|reserved_special_token_13|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128022": { + "content": "<|reserved_special_token_14|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128023": { + "content": "<|reserved_special_token_15|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128024": { + "content": "<|reserved_special_token_16|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128025": { + "content": "<|reserved_special_token_17|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128026": { + "content": "<|reserved_special_token_18|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128027": { + "content": "<|reserved_special_token_19|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128028": { + "content": "<|reserved_special_token_20|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128029": { + "content": "<|reserved_special_token_21|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128030": { + "content": "<|reserved_special_token_22|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128031": { + "content": "<|reserved_special_token_23|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128032": { + "content": "<|reserved_special_token_24|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128033": { + "content": "<|reserved_special_token_25|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128034": { + "content": "<|reserved_special_token_26|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128035": { + "content": "<|reserved_special_token_27|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128036": { + "content": "<|reserved_special_token_28|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128037": { + "content": "<|reserved_special_token_29|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128038": { + "content": "<|reserved_special_token_30|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128039": { + "content": "<|reserved_special_token_31|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128040": { + "content": "<|reserved_special_token_32|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128041": { + "content": "<|reserved_special_token_33|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128042": { + "content": "<|reserved_special_token_34|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128043": { + "content": "<|reserved_special_token_35|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128044": { + "content": "<|reserved_special_token_36|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128045": { + "content": "<|reserved_special_token_37|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128046": { + "content": "<|reserved_special_token_38|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128047": { + "content": "<|reserved_special_token_39|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128048": { + "content": "<|reserved_special_token_40|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128049": { + "content": "<|reserved_special_token_41|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128050": { + "content": "<|reserved_special_token_42|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128051": { + "content": "<|reserved_special_token_43|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128052": { + "content": "<|reserved_special_token_44|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128053": { + "content": "<|reserved_special_token_45|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128054": { + "content": "<|reserved_special_token_46|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128055": { + "content": "<|reserved_special_token_47|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128056": { + "content": "<|reserved_special_token_48|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128057": { + "content": "<|reserved_special_token_49|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128058": { + "content": "<|reserved_special_token_50|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128059": { + "content": "<|reserved_special_token_51|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128060": { + "content": "<|reserved_special_token_52|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128061": { + "content": "<|reserved_special_token_53|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128062": { + "content": "<|reserved_special_token_54|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128063": { + "content": "<|reserved_special_token_55|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128064": { + "content": "<|reserved_special_token_56|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128065": { + "content": "<|reserved_special_token_57|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128066": { + "content": "<|reserved_special_token_58|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128067": { + "content": "<|reserved_special_token_59|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128068": { + "content": "<|reserved_special_token_60|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128069": { + "content": "<|reserved_special_token_61|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128070": { + "content": "<|reserved_special_token_62|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128071": { + "content": "<|reserved_special_token_63|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128072": { + "content": "<|reserved_special_token_64|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128073": { + "content": "<|reserved_special_token_65|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128074": { + "content": "<|reserved_special_token_66|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128075": { + "content": "<|reserved_special_token_67|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128076": { + "content": "<|reserved_special_token_68|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128077": { + "content": "<|reserved_special_token_69|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128078": { + "content": "<|reserved_special_token_70|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128079": { + "content": "<|reserved_special_token_71|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128080": { + "content": "<|reserved_special_token_72|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128081": { + "content": "<|reserved_special_token_73|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128082": { + "content": "<|reserved_special_token_74|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128083": { + "content": "<|reserved_special_token_75|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128084": { + "content": "<|reserved_special_token_76|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128085": { + "content": "<|reserved_special_token_77|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128086": { + "content": "<|reserved_special_token_78|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128087": { + "content": "<|reserved_special_token_79|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128088": { + "content": "<|reserved_special_token_80|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128089": { + "content": "<|reserved_special_token_81|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128090": { + "content": "<|reserved_special_token_82|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128091": { + "content": "<|reserved_special_token_83|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128092": { + "content": "<|reserved_special_token_84|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128093": { + "content": "<|reserved_special_token_85|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128094": { + "content": "<|reserved_special_token_86|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128095": { + "content": "<|reserved_special_token_87|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128096": { + "content": "<|reserved_special_token_88|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128097": { + "content": "<|reserved_special_token_89|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128098": { + "content": "<|reserved_special_token_90|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128099": { + "content": "<|reserved_special_token_91|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128100": { + "content": "<|reserved_special_token_92|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128101": { + "content": "<|reserved_special_token_93|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128102": { + "content": "<|reserved_special_token_94|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128103": { + "content": "<|reserved_special_token_95|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128104": { + "content": "<|reserved_special_token_96|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128105": { + "content": "<|reserved_special_token_97|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128106": { + "content": "<|reserved_special_token_98|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128107": { + "content": "<|reserved_special_token_99|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128108": { + "content": "<|reserved_special_token_100|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128109": { + "content": "<|reserved_special_token_101|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128110": { + "content": "<|reserved_special_token_102|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128111": { + "content": "<|reserved_special_token_103|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128112": { + "content": "<|reserved_special_token_104|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128113": { + "content": "<|reserved_special_token_105|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128114": { + "content": "<|reserved_special_token_106|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128115": { + "content": "<|reserved_special_token_107|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128116": { + "content": "<|reserved_special_token_108|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128117": { + "content": "<|reserved_special_token_109|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128118": { + "content": "<|reserved_special_token_110|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128119": { + "content": "<|reserved_special_token_111|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128120": { + "content": "<|reserved_special_token_112|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128121": { + "content": "<|reserved_special_token_113|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128122": { + "content": "<|reserved_special_token_114|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128123": { + "content": "<|reserved_special_token_115|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128124": { + "content": "<|reserved_special_token_116|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128125": { + "content": "<|reserved_special_token_117|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128126": { + "content": "<|reserved_special_token_118|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128127": { + "content": "<|reserved_special_token_119|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128128": { + "content": "<|reserved_special_token_120|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128129": { + "content": "<|reserved_special_token_121|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128130": { + "content": "<|reserved_special_token_122|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128131": { + "content": "<|reserved_special_token_123|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128132": { + "content": "<|reserved_special_token_124|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128133": { + "content": "<|reserved_special_token_125|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128134": { + "content": "<|reserved_special_token_126|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128135": { + "content": "<|reserved_special_token_127|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128136": { + "content": "<|reserved_special_token_128|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128137": { + "content": "<|reserved_special_token_129|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128138": { + "content": "<|reserved_special_token_130|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128139": { + "content": "<|reserved_special_token_131|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128140": { + "content": "<|reserved_special_token_132|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128141": { + "content": "<|reserved_special_token_133|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128142": { + "content": "<|reserved_special_token_134|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128143": { + "content": "<|reserved_special_token_135|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128144": { + "content": "<|reserved_special_token_136|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128145": { + "content": "<|reserved_special_token_137|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128146": { + "content": "<|reserved_special_token_138|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128147": { + "content": "<|reserved_special_token_139|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128148": { + "content": "<|reserved_special_token_140|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128149": { + "content": "<|reserved_special_token_141|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128150": { + "content": "<|reserved_special_token_142|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128151": { + "content": "<|reserved_special_token_143|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128152": { + "content": "<|reserved_special_token_144|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128153": { + "content": "<|reserved_special_token_145|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128154": { + "content": "<|reserved_special_token_146|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128155": { + "content": "<|reserved_special_token_147|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128156": { + "content": "<|reserved_special_token_148|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128157": { + "content": "<|reserved_special_token_149|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128158": { + "content": "<|reserved_special_token_150|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128159": { + "content": "<|reserved_special_token_151|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128160": { + "content": "<|reserved_special_token_152|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128161": { + "content": "<|reserved_special_token_153|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128162": { + "content": "<|reserved_special_token_154|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128163": { + "content": "<|reserved_special_token_155|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128164": { + "content": "<|reserved_special_token_156|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128165": { + "content": "<|reserved_special_token_157|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128166": { + "content": "<|reserved_special_token_158|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128167": { + "content": "<|reserved_special_token_159|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128168": { + "content": "<|reserved_special_token_160|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128169": { + "content": "<|reserved_special_token_161|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128170": { + "content": "<|reserved_special_token_162|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128171": { + "content": "<|reserved_special_token_163|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128172": { + "content": "<|reserved_special_token_164|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128173": { + "content": "<|reserved_special_token_165|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128174": { + "content": "<|reserved_special_token_166|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128175": { + "content": "<|reserved_special_token_167|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128176": { + "content": "<|reserved_special_token_168|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128177": { + "content": "<|reserved_special_token_169|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128178": { + "content": "<|reserved_special_token_170|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128179": { + "content": "<|reserved_special_token_171|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128180": { + "content": "<|reserved_special_token_172|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128181": { + "content": "<|reserved_special_token_173|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128182": { + "content": "<|reserved_special_token_174|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128183": { + "content": "<|reserved_special_token_175|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128184": { + "content": "<|reserved_special_token_176|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128185": { + "content": "<|reserved_special_token_177|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128186": { + "content": "<|reserved_special_token_178|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128187": { + "content": "<|reserved_special_token_179|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128188": { + "content": "<|reserved_special_token_180|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128189": { + "content": "<|reserved_special_token_181|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128190": { + "content": "<|reserved_special_token_182|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128191": { + "content": "<|reserved_special_token_183|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128192": { + "content": "<|reserved_special_token_184|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128193": { + "content": "<|reserved_special_token_185|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128194": { + "content": "<|reserved_special_token_186|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128195": { + "content": "<|reserved_special_token_187|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128196": { + "content": "<|reserved_special_token_188|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128197": { + "content": "<|reserved_special_token_189|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128198": { + "content": "<|reserved_special_token_190|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128199": { + "content": "<|reserved_special_token_191|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128200": { + "content": "<|reserved_special_token_192|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128201": { + "content": "<|reserved_special_token_193|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128202": { + "content": "<|reserved_special_token_194|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128203": { + "content": "<|reserved_special_token_195|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128204": { + "content": "<|reserved_special_token_196|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128205": { + "content": "<|reserved_special_token_197|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128206": { + "content": "<|reserved_special_token_198|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128207": { + "content": "<|reserved_special_token_199|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128208": { + "content": "<|reserved_special_token_200|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128209": { + "content": "<|reserved_special_token_201|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128210": { + "content": "<|reserved_special_token_202|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128211": { + "content": "<|reserved_special_token_203|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128212": { + "content": "<|reserved_special_token_204|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128213": { + "content": "<|reserved_special_token_205|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128214": { + "content": "<|reserved_special_token_206|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128215": { + "content": "<|reserved_special_token_207|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128216": { + "content": "<|reserved_special_token_208|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128217": { + "content": "<|reserved_special_token_209|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128218": { + "content": "<|reserved_special_token_210|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128219": { + "content": "<|reserved_special_token_211|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128220": { + "content": "<|reserved_special_token_212|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128221": { + "content": "<|reserved_special_token_213|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128222": { + "content": "<|reserved_special_token_214|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128223": { + "content": "<|reserved_special_token_215|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128224": { + "content": "<|reserved_special_token_216|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128225": { + "content": "<|reserved_special_token_217|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128226": { + "content": "<|reserved_special_token_218|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128227": { + "content": "<|reserved_special_token_219|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128228": { + "content": "<|reserved_special_token_220|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128229": { + "content": "<|reserved_special_token_221|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128230": { + "content": "<|reserved_special_token_222|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128231": { + "content": "<|reserved_special_token_223|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128232": { + "content": "<|reserved_special_token_224|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128233": { + "content": "<|reserved_special_token_225|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128234": { + "content": "<|reserved_special_token_226|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128235": { + "content": "<|reserved_special_token_227|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128236": { + "content": "<|reserved_special_token_228|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128237": { + "content": "<|reserved_special_token_229|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128238": { + "content": "<|reserved_special_token_230|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128239": { + "content": "<|reserved_special_token_231|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128240": { + "content": "<|reserved_special_token_232|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128241": { + "content": "<|reserved_special_token_233|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128242": { + "content": "<|reserved_special_token_234|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128243": { + "content": "<|reserved_special_token_235|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128244": { + "content": "<|reserved_special_token_236|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128245": { + "content": "<|reserved_special_token_237|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128246": { + "content": "<|reserved_special_token_238|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128247": { + "content": "<|reserved_special_token_239|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128248": { + "content": "<|reserved_special_token_240|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128249": { + "content": "<|reserved_special_token_241|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128250": { + "content": "<|reserved_special_token_242|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128251": { + "content": "<|reserved_special_token_243|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128252": { + "content": "<|reserved_special_token_244|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128253": { + "content": "<|reserved_special_token_245|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128254": { + "content": "<|reserved_special_token_246|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128255": { + "content": "<|reserved_special_token_247|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + } + }, + "bos_token": "<|begin_of_text|>", + "clean_up_tokenization_spaces": true, + "eos_token": "<|eot_id|>", + "extra_special_tokens": {}, + "model_input_names": [ + "input_ids", + "attention_mask" + ], + "model_max_length": 131072, + "pad_token": "<|finetune_right_pad_id|>", + "padding_side": "right", + "tokenizer_class": "PreTrainedTokenizerFast", + "unk_token": null +} diff --git a/experiments/Natural/checkpoint-1500/trainer_state.json b/experiments/Natural/checkpoint-1500/trainer_state.json new file mode 100644 index 0000000000000000000000000000000000000000..a725f182456a8a0cfb914e6449b1d43d39ce3a0e --- /dev/null +++ b/experiments/Natural/checkpoint-1500/trainer_state.json @@ -0,0 +1,1084 @@ +{ + "best_global_step": null, + "best_metric": null, + "best_model_checkpoint": null, + "epoch": 4.746835443037975, + "eval_steps": 500, + "global_step": 1500, + "is_hyper_param_search": false, + "is_local_process_zero": true, + "is_world_process_zero": true, + "log_history": [ + { + "epoch": 0.03164556962025317, + "grad_norm": 5.501315116882324, + "learning_rate": 0.00018, + "loss": 2.5563, + "step": 10 + }, + { + "epoch": 0.06329113924050633, + "grad_norm": 160.5225067138672, + "learning_rate": 0.00019885350318471338, + "loss": 1.5451, + "step": 20 + }, + { + "epoch": 0.0949367088607595, + "grad_norm": 10.833513259887695, + "learning_rate": 0.00019757961783439492, + "loss": 1.8865, + "step": 30 + }, + { + "epoch": 0.12658227848101267, + "grad_norm": 16.25729751586914, + "learning_rate": 0.00019630573248407643, + "loss": 1.3788, + "step": 40 + }, + { + "epoch": 0.15822784810126583, + "grad_norm": 3.233597755432129, + "learning_rate": 0.00019503184713375797, + "loss": 1.1314, + "step": 50 + }, + { + "epoch": 0.189873417721519, + "grad_norm": 3.3475453853607178, + "learning_rate": 0.0001937579617834395, + "loss": 1.0585, + "step": 60 + }, + { + "epoch": 0.22151898734177214, + "grad_norm": 2.3403992652893066, + "learning_rate": 0.00019248407643312102, + "loss": 1.0554, + "step": 70 + }, + { + "epoch": 0.25316455696202533, + "grad_norm": 2.324516534805298, + "learning_rate": 0.00019121019108280256, + "loss": 1.0274, + "step": 80 + }, + { + "epoch": 0.2848101265822785, + "grad_norm": 2.125304937362671, + "learning_rate": 0.0001899363057324841, + "loss": 1.0045, + "step": 90 + }, + { + "epoch": 0.31645569620253167, + "grad_norm": 2.1273205280303955, + "learning_rate": 0.0001886624203821656, + "loss": 0.9993, + "step": 100 + }, + { + "epoch": 0.34810126582278483, + "grad_norm": 2.5348403453826904, + "learning_rate": 0.00018738853503184714, + "loss": 1.0386, + "step": 110 + }, + { + "epoch": 0.379746835443038, + "grad_norm": 2.660738468170166, + "learning_rate": 0.00018611464968152868, + "loss": 0.992, + "step": 120 + }, + { + "epoch": 0.41139240506329117, + "grad_norm": 2.187695026397705, + "learning_rate": 0.0001848407643312102, + "loss": 1.0174, + "step": 130 + }, + { + "epoch": 0.4430379746835443, + "grad_norm": 2.0130527019500732, + "learning_rate": 0.00018356687898089173, + "loss": 1.0349, + "step": 140 + }, + { + "epoch": 0.47468354430379744, + "grad_norm": 2.2986974716186523, + "learning_rate": 0.00018229299363057327, + "loss": 1.0426, + "step": 150 + }, + { + "epoch": 0.5063291139240507, + "grad_norm": 2.0907416343688965, + "learning_rate": 0.00018101910828025478, + "loss": 0.9566, + "step": 160 + }, + { + "epoch": 0.5379746835443038, + "grad_norm": 2.263169765472412, + "learning_rate": 0.00017974522292993632, + "loss": 0.9728, + "step": 170 + }, + { + "epoch": 0.569620253164557, + "grad_norm": 1.950455665588379, + "learning_rate": 0.00017847133757961786, + "loss": 0.9681, + "step": 180 + }, + { + "epoch": 0.6012658227848101, + "grad_norm": 1.991625189781189, + "learning_rate": 0.00017719745222929937, + "loss": 0.9877, + "step": 190 + }, + { + "epoch": 0.6329113924050633, + "grad_norm": 2.5864851474761963, + "learning_rate": 0.0001759235668789809, + "loss": 0.9536, + "step": 200 + }, + { + "epoch": 0.6645569620253164, + "grad_norm": 1.9064277410507202, + "learning_rate": 0.00017464968152866244, + "loss": 0.9546, + "step": 210 + }, + { + "epoch": 0.6962025316455697, + "grad_norm": 2.235928773880005, + "learning_rate": 0.00017337579617834396, + "loss": 0.9241, + "step": 220 + }, + { + "epoch": 0.7278481012658228, + "grad_norm": 1.9112043380737305, + "learning_rate": 0.0001721019108280255, + "loss": 0.966, + "step": 230 + }, + { + "epoch": 0.759493670886076, + "grad_norm": 2.6696879863739014, + "learning_rate": 0.00017082802547770703, + "loss": 0.8924, + "step": 240 + }, + { + "epoch": 0.7911392405063291, + "grad_norm": 2.395738124847412, + "learning_rate": 0.00016955414012738854, + "loss": 0.9879, + "step": 250 + }, + { + "epoch": 0.8227848101265823, + "grad_norm": 2.1325836181640625, + "learning_rate": 0.00016828025477707008, + "loss": 0.9125, + "step": 260 + }, + { + "epoch": 0.8544303797468354, + "grad_norm": 3.023322582244873, + "learning_rate": 0.00016700636942675162, + "loss": 0.9578, + "step": 270 + }, + { + "epoch": 0.8860759493670886, + "grad_norm": 2.16930890083313, + "learning_rate": 0.00016573248407643313, + "loss": 0.9655, + "step": 280 + }, + { + "epoch": 0.9177215189873418, + "grad_norm": 2.751526355743408, + "learning_rate": 0.00016445859872611467, + "loss": 0.8529, + "step": 290 + }, + { + "epoch": 0.9493670886075949, + "grad_norm": 2.2014594078063965, + "learning_rate": 0.00016318471337579618, + "loss": 0.8895, + "step": 300 + }, + { + "epoch": 0.9810126582278481, + "grad_norm": 2.498781681060791, + "learning_rate": 0.00016191082802547772, + "loss": 0.9022, + "step": 310 + }, + { + "epoch": 1.0126582278481013, + "grad_norm": 1.6269073486328125, + "learning_rate": 0.00016063694267515926, + "loss": 0.7462, + "step": 320 + }, + { + "epoch": 1.0443037974683544, + "grad_norm": 2.417710304260254, + "learning_rate": 0.00015936305732484077, + "loss": 0.6435, + "step": 330 + }, + { + "epoch": 1.0759493670886076, + "grad_norm": 2.120162010192871, + "learning_rate": 0.0001580891719745223, + "loss": 0.6222, + "step": 340 + }, + { + "epoch": 1.1075949367088607, + "grad_norm": 1.8784149885177612, + "learning_rate": 0.00015681528662420385, + "loss": 0.6014, + "step": 350 + }, + { + "epoch": 1.139240506329114, + "grad_norm": 1.9097055196762085, + "learning_rate": 0.00015554140127388536, + "loss": 0.618, + "step": 360 + }, + { + "epoch": 1.1708860759493671, + "grad_norm": 3.8499958515167236, + "learning_rate": 0.0001542675159235669, + "loss": 0.6094, + "step": 370 + }, + { + "epoch": 1.2025316455696202, + "grad_norm": 2.857755184173584, + "learning_rate": 0.00015299363057324843, + "loss": 0.644, + "step": 380 + }, + { + "epoch": 1.2341772151898733, + "grad_norm": 1.798422932624817, + "learning_rate": 0.00015171974522292994, + "loss": 0.6059, + "step": 390 + }, + { + "epoch": 1.2658227848101267, + "grad_norm": 2.251343011856079, + "learning_rate": 0.00015044585987261148, + "loss": 0.6059, + "step": 400 + }, + { + "epoch": 1.2974683544303798, + "grad_norm": 1.714311122894287, + "learning_rate": 0.000149171974522293, + "loss": 0.6263, + "step": 410 + }, + { + "epoch": 1.3291139240506329, + "grad_norm": 2.1517114639282227, + "learning_rate": 0.00014789808917197453, + "loss": 0.6018, + "step": 420 + }, + { + "epoch": 1.360759493670886, + "grad_norm": 2.019310235977173, + "learning_rate": 0.00014662420382165604, + "loss": 0.6241, + "step": 430 + }, + { + "epoch": 1.3924050632911391, + "grad_norm": 3.1832761764526367, + "learning_rate": 0.00014535031847133758, + "loss": 0.6105, + "step": 440 + }, + { + "epoch": 1.4240506329113924, + "grad_norm": 2.199019432067871, + "learning_rate": 0.0001440764331210191, + "loss": 0.6367, + "step": 450 + }, + { + "epoch": 1.4556962025316456, + "grad_norm": 2.4912033081054688, + "learning_rate": 0.00014280254777070063, + "loss": 0.6339, + "step": 460 + }, + { + "epoch": 1.4873417721518987, + "grad_norm": 2.6481103897094727, + "learning_rate": 0.00014152866242038217, + "loss": 0.6062, + "step": 470 + }, + { + "epoch": 1.518987341772152, + "grad_norm": 2.133782386779785, + "learning_rate": 0.00014025477707006368, + "loss": 0.6095, + "step": 480 + }, + { + "epoch": 1.5506329113924051, + "grad_norm": 2.9077465534210205, + "learning_rate": 0.00013898089171974522, + "loss": 0.5843, + "step": 490 + }, + { + "epoch": 1.5822784810126582, + "grad_norm": 2.5229060649871826, + "learning_rate": 0.00013770700636942676, + "loss": 0.6227, + "step": 500 + }, + { + "epoch": 1.6139240506329116, + "grad_norm": 2.6327691078186035, + "learning_rate": 0.00013643312101910827, + "loss": 0.6238, + "step": 510 + }, + { + "epoch": 1.6455696202531644, + "grad_norm": 2.156597852706909, + "learning_rate": 0.0001351592356687898, + "loss": 0.5719, + "step": 520 + }, + { + "epoch": 1.6772151898734178, + "grad_norm": 2.23740553855896, + "learning_rate": 0.00013388535031847134, + "loss": 0.5821, + "step": 530 + }, + { + "epoch": 1.7088607594936709, + "grad_norm": 2.254840135574341, + "learning_rate": 0.00013261146496815286, + "loss": 0.6063, + "step": 540 + }, + { + "epoch": 1.740506329113924, + "grad_norm": 2.106001377105713, + "learning_rate": 0.0001313375796178344, + "loss": 0.6252, + "step": 550 + }, + { + "epoch": 1.7721518987341773, + "grad_norm": 2.2712509632110596, + "learning_rate": 0.00013006369426751593, + "loss": 0.6271, + "step": 560 + }, + { + "epoch": 1.8037974683544302, + "grad_norm": 2.142057180404663, + "learning_rate": 0.00012878980891719744, + "loss": 0.575, + "step": 570 + }, + { + "epoch": 1.8354430379746836, + "grad_norm": 1.9250198602676392, + "learning_rate": 0.00012751592356687898, + "loss": 0.568, + "step": 580 + }, + { + "epoch": 1.8670886075949367, + "grad_norm": 2.0625407695770264, + "learning_rate": 0.00012624203821656052, + "loss": 0.6047, + "step": 590 + }, + { + "epoch": 1.8987341772151898, + "grad_norm": 3.7402431964874268, + "learning_rate": 0.00012496815286624203, + "loss": 0.581, + "step": 600 + }, + { + "epoch": 1.9303797468354431, + "grad_norm": 1.8032431602478027, + "learning_rate": 0.00012369426751592357, + "loss": 0.6124, + "step": 610 + }, + { + "epoch": 1.9620253164556962, + "grad_norm": 2.4170119762420654, + "learning_rate": 0.0001224203821656051, + "loss": 0.5682, + "step": 620 + }, + { + "epoch": 1.9936708860759493, + "grad_norm": 2.7495386600494385, + "learning_rate": 0.00012114649681528662, + "loss": 0.566, + "step": 630 + }, + { + "epoch": 2.0253164556962027, + "grad_norm": 2.5206427574157715, + "learning_rate": 0.00011987261146496816, + "loss": 0.3717, + "step": 640 + }, + { + "epoch": 2.0569620253164556, + "grad_norm": 2.323184013366699, + "learning_rate": 0.00011859872611464968, + "loss": 0.3412, + "step": 650 + }, + { + "epoch": 2.088607594936709, + "grad_norm": 2.0928003787994385, + "learning_rate": 0.0001173248407643312, + "loss": 0.3217, + "step": 660 + }, + { + "epoch": 2.1202531645569622, + "grad_norm": 2.0109825134277344, + "learning_rate": 0.00011605095541401274, + "loss": 0.3313, + "step": 670 + }, + { + "epoch": 2.151898734177215, + "grad_norm": 2.067814826965332, + "learning_rate": 0.00011477707006369427, + "loss": 0.3388, + "step": 680 + }, + { + "epoch": 2.1835443037974684, + "grad_norm": 2.0013394355773926, + "learning_rate": 0.0001135031847133758, + "loss": 0.338, + "step": 690 + }, + { + "epoch": 2.2151898734177213, + "grad_norm": 1.7796369791030884, + "learning_rate": 0.00011222929936305733, + "loss": 0.324, + "step": 700 + }, + { + "epoch": 2.2468354430379747, + "grad_norm": 2.0786919593811035, + "learning_rate": 0.00011095541401273886, + "loss": 0.3391, + "step": 710 + }, + { + "epoch": 2.278481012658228, + "grad_norm": 2.154378890991211, + "learning_rate": 0.00010968152866242038, + "loss": 0.3377, + "step": 720 + }, + { + "epoch": 2.310126582278481, + "grad_norm": 2.065183639526367, + "learning_rate": 0.00010840764331210192, + "loss": 0.3486, + "step": 730 + }, + { + "epoch": 2.3417721518987342, + "grad_norm": 1.972088098526001, + "learning_rate": 0.00010713375796178344, + "loss": 0.3347, + "step": 740 + }, + { + "epoch": 2.3734177215189876, + "grad_norm": 2.141294002532959, + "learning_rate": 0.00010585987261146497, + "loss": 0.335, + "step": 750 + }, + { + "epoch": 2.4050632911392404, + "grad_norm": 2.27059006690979, + "learning_rate": 0.0001045859872611465, + "loss": 0.3481, + "step": 760 + }, + { + "epoch": 2.4367088607594938, + "grad_norm": 2.0947511196136475, + "learning_rate": 0.00010331210191082803, + "loss": 0.3437, + "step": 770 + }, + { + "epoch": 2.4683544303797467, + "grad_norm": 2.0567169189453125, + "learning_rate": 0.00010203821656050956, + "loss": 0.3434, + "step": 780 + }, + { + "epoch": 2.5, + "grad_norm": 2.0784637928009033, + "learning_rate": 0.00010076433121019108, + "loss": 0.335, + "step": 790 + }, + { + "epoch": 2.5316455696202533, + "grad_norm": 1.9443864822387695, + "learning_rate": 9.949044585987262e-05, + "loss": 0.349, + "step": 800 + }, + { + "epoch": 2.5632911392405062, + "grad_norm": 2.338250160217285, + "learning_rate": 9.821656050955414e-05, + "loss": 0.3433, + "step": 810 + }, + { + "epoch": 2.5949367088607596, + "grad_norm": 1.9308645725250244, + "learning_rate": 9.694267515923567e-05, + "loss": 0.3344, + "step": 820 + }, + { + "epoch": 2.6265822784810124, + "grad_norm": 2.1741745471954346, + "learning_rate": 9.566878980891721e-05, + "loss": 0.3241, + "step": 830 + }, + { + "epoch": 2.6582278481012658, + "grad_norm": 1.8227561712265015, + "learning_rate": 9.439490445859873e-05, + "loss": 0.3289, + "step": 840 + }, + { + "epoch": 2.689873417721519, + "grad_norm": 2.090834856033325, + "learning_rate": 9.312101910828026e-05, + "loss": 0.3431, + "step": 850 + }, + { + "epoch": 2.721518987341772, + "grad_norm": 1.823628544807434, + "learning_rate": 9.18471337579618e-05, + "loss": 0.3502, + "step": 860 + }, + { + "epoch": 2.7531645569620253, + "grad_norm": 2.5202064514160156, + "learning_rate": 9.057324840764332e-05, + "loss": 0.3409, + "step": 870 + }, + { + "epoch": 2.7848101265822782, + "grad_norm": 1.9167916774749756, + "learning_rate": 8.929936305732484e-05, + "loss": 0.3372, + "step": 880 + }, + { + "epoch": 2.8164556962025316, + "grad_norm": 2.5479819774627686, + "learning_rate": 8.802547770700637e-05, + "loss": 0.3442, + "step": 890 + }, + { + "epoch": 2.848101265822785, + "grad_norm": 1.6813645362854004, + "learning_rate": 8.675159235668791e-05, + "loss": 0.336, + "step": 900 + }, + { + "epoch": 2.879746835443038, + "grad_norm": 2.1691527366638184, + "learning_rate": 8.547770700636943e-05, + "loss": 0.3275, + "step": 910 + }, + { + "epoch": 2.911392405063291, + "grad_norm": 1.9385488033294678, + "learning_rate": 8.420382165605096e-05, + "loss": 0.3433, + "step": 920 + }, + { + "epoch": 2.9430379746835444, + "grad_norm": 1.9246203899383545, + "learning_rate": 8.29299363057325e-05, + "loss": 0.3487, + "step": 930 + }, + { + "epoch": 2.9746835443037973, + "grad_norm": 1.95414137840271, + "learning_rate": 8.165605095541402e-05, + "loss": 0.3437, + "step": 940 + }, + { + "epoch": 3.0063291139240507, + "grad_norm": 1.1191596984863281, + "learning_rate": 8.038216560509555e-05, + "loss": 0.3057, + "step": 950 + }, + { + "epoch": 3.037974683544304, + "grad_norm": 1.5922425985336304, + "learning_rate": 7.910828025477708e-05, + "loss": 0.2133, + "step": 960 + }, + { + "epoch": 3.069620253164557, + "grad_norm": 1.863950252532959, + "learning_rate": 7.783439490445861e-05, + "loss": 0.2167, + "step": 970 + }, + { + "epoch": 3.1012658227848102, + "grad_norm": 1.3625264167785645, + "learning_rate": 7.656050955414013e-05, + "loss": 0.2169, + "step": 980 + }, + { + "epoch": 3.132911392405063, + "grad_norm": 1.5241615772247314, + "learning_rate": 7.528662420382167e-05, + "loss": 0.2297, + "step": 990 + }, + { + "epoch": 3.1645569620253164, + "grad_norm": 1.5062488317489624, + "learning_rate": 7.401273885350318e-05, + "loss": 0.2299, + "step": 1000 + }, + { + "epoch": 3.1962025316455698, + "grad_norm": 1.576797366142273, + "learning_rate": 7.273885350318471e-05, + "loss": 0.2315, + "step": 1010 + }, + { + "epoch": 3.2278481012658227, + "grad_norm": 1.5570958852767944, + "learning_rate": 7.146496815286625e-05, + "loss": 0.2351, + "step": 1020 + }, + { + "epoch": 3.259493670886076, + "grad_norm": 1.7670010328292847, + "learning_rate": 7.019108280254777e-05, + "loss": 0.2324, + "step": 1030 + }, + { + "epoch": 3.291139240506329, + "grad_norm": 1.346665382385254, + "learning_rate": 6.89171974522293e-05, + "loss": 0.2395, + "step": 1040 + }, + { + "epoch": 3.3227848101265822, + "grad_norm": 1.9827314615249634, + "learning_rate": 6.764331210191083e-05, + "loss": 0.2353, + "step": 1050 + }, + { + "epoch": 3.3544303797468356, + "grad_norm": 1.4799753427505493, + "learning_rate": 6.636942675159236e-05, + "loss": 0.2326, + "step": 1060 + }, + { + "epoch": 3.3860759493670884, + "grad_norm": 1.2080479860305786, + "learning_rate": 6.509554140127388e-05, + "loss": 0.2384, + "step": 1070 + }, + { + "epoch": 3.4177215189873418, + "grad_norm": 1.2935141324996948, + "learning_rate": 6.382165605095542e-05, + "loss": 0.2348, + "step": 1080 + }, + { + "epoch": 3.449367088607595, + "grad_norm": 1.9431143999099731, + "learning_rate": 6.254777070063695e-05, + "loss": 0.2404, + "step": 1090 + }, + { + "epoch": 3.481012658227848, + "grad_norm": 1.132179617881775, + "learning_rate": 6.127388535031847e-05, + "loss": 0.2417, + "step": 1100 + }, + { + "epoch": 3.5126582278481013, + "grad_norm": 1.3407566547393799, + "learning_rate": 6e-05, + "loss": 0.2338, + "step": 1110 + }, + { + "epoch": 3.5443037974683547, + "grad_norm": 1.1325492858886719, + "learning_rate": 5.8726114649681526e-05, + "loss": 0.2323, + "step": 1120 + }, + { + "epoch": 3.5759493670886076, + "grad_norm": 1.514183759689331, + "learning_rate": 5.745222929936306e-05, + "loss": 0.2398, + "step": 1130 + }, + { + "epoch": 3.607594936708861, + "grad_norm": 0.9589794278144836, + "learning_rate": 5.617834394904459e-05, + "loss": 0.2402, + "step": 1140 + }, + { + "epoch": 3.6392405063291138, + "grad_norm": 1.094794750213623, + "learning_rate": 5.4904458598726114e-05, + "loss": 0.2304, + "step": 1150 + }, + { + "epoch": 3.670886075949367, + "grad_norm": 1.4192887544631958, + "learning_rate": 5.3630573248407645e-05, + "loss": 0.2376, + "step": 1160 + }, + { + "epoch": 3.7025316455696204, + "grad_norm": 1.1269867420196533, + "learning_rate": 5.235668789808918e-05, + "loss": 0.2368, + "step": 1170 + }, + { + "epoch": 3.7341772151898733, + "grad_norm": 1.1314181089401245, + "learning_rate": 5.10828025477707e-05, + "loss": 0.2492, + "step": 1180 + }, + { + "epoch": 3.7658227848101267, + "grad_norm": 1.1598172187805176, + "learning_rate": 4.980891719745223e-05, + "loss": 0.2331, + "step": 1190 + }, + { + "epoch": 3.7974683544303796, + "grad_norm": 1.347269892692566, + "learning_rate": 4.853503184713376e-05, + "loss": 0.2343, + "step": 1200 + }, + { + "epoch": 3.829113924050633, + "grad_norm": 1.251792073249817, + "learning_rate": 4.726114649681529e-05, + "loss": 0.2425, + "step": 1210 + }, + { + "epoch": 3.8607594936708862, + "grad_norm": 1.0543699264526367, + "learning_rate": 4.598726114649682e-05, + "loss": 0.2347, + "step": 1220 + }, + { + "epoch": 3.892405063291139, + "grad_norm": 1.0103930234909058, + "learning_rate": 4.4713375796178346e-05, + "loss": 0.2341, + "step": 1230 + }, + { + "epoch": 3.9240506329113924, + "grad_norm": 1.5386909246444702, + "learning_rate": 4.343949044585988e-05, + "loss": 0.2337, + "step": 1240 + }, + { + "epoch": 3.9556962025316453, + "grad_norm": 1.2150837182998657, + "learning_rate": 4.21656050955414e-05, + "loss": 0.2372, + "step": 1250 + }, + { + "epoch": 3.9873417721518987, + "grad_norm": 0.9687594771385193, + "learning_rate": 4.089171974522293e-05, + "loss": 0.2281, + "step": 1260 + }, + { + "epoch": 4.018987341772152, + "grad_norm": 0.9844681024551392, + "learning_rate": 3.9617834394904465e-05, + "loss": 0.2126, + "step": 1270 + }, + { + "epoch": 4.050632911392405, + "grad_norm": 0.8446369171142578, + "learning_rate": 3.834394904458599e-05, + "loss": 0.1889, + "step": 1280 + }, + { + "epoch": 4.082278481012658, + "grad_norm": 1.152707815170288, + "learning_rate": 3.7070063694267514e-05, + "loss": 0.181, + "step": 1290 + }, + { + "epoch": 4.113924050632911, + "grad_norm": 0.7320122718811035, + "learning_rate": 3.5796178343949046e-05, + "loss": 0.1839, + "step": 1300 + }, + { + "epoch": 4.1455696202531644, + "grad_norm": 0.6252226829528809, + "learning_rate": 3.452229299363057e-05, + "loss": 0.1951, + "step": 1310 + }, + { + "epoch": 4.177215189873418, + "grad_norm": 0.6970034837722778, + "learning_rate": 3.32484076433121e-05, + "loss": 0.1914, + "step": 1320 + }, + { + "epoch": 4.208860759493671, + "grad_norm": 0.768865168094635, + "learning_rate": 3.197452229299363e-05, + "loss": 0.1804, + "step": 1330 + }, + { + "epoch": 4.2405063291139244, + "grad_norm": 0.6791852712631226, + "learning_rate": 3.070063694267516e-05, + "loss": 0.1857, + "step": 1340 + }, + { + "epoch": 4.272151898734177, + "grad_norm": 1.2060372829437256, + "learning_rate": 2.942675159235669e-05, + "loss": 0.1908, + "step": 1350 + }, + { + "epoch": 4.30379746835443, + "grad_norm": 0.9151805639266968, + "learning_rate": 2.8152866242038218e-05, + "loss": 0.1834, + "step": 1360 + }, + { + "epoch": 4.3354430379746836, + "grad_norm": 1.5451514720916748, + "learning_rate": 2.6878980891719746e-05, + "loss": 0.1899, + "step": 1370 + }, + { + "epoch": 4.367088607594937, + "grad_norm": 0.7110710144042969, + "learning_rate": 2.5605095541401274e-05, + "loss": 0.1871, + "step": 1380 + }, + { + "epoch": 4.39873417721519, + "grad_norm": 1.055672287940979, + "learning_rate": 2.4331210191082805e-05, + "loss": 0.1831, + "step": 1390 + }, + { + "epoch": 4.430379746835443, + "grad_norm": 1.0316555500030518, + "learning_rate": 2.3057324840764334e-05, + "loss": 0.2008, + "step": 1400 + }, + { + "epoch": 4.462025316455696, + "grad_norm": 1.0614982843399048, + "learning_rate": 2.178343949044586e-05, + "loss": 0.1919, + "step": 1410 + }, + { + "epoch": 4.493670886075949, + "grad_norm": 0.6679489612579346, + "learning_rate": 2.050955414012739e-05, + "loss": 0.1945, + "step": 1420 + }, + { + "epoch": 4.525316455696203, + "grad_norm": 0.7181932330131531, + "learning_rate": 1.9235668789808918e-05, + "loss": 0.1879, + "step": 1430 + }, + { + "epoch": 4.556962025316456, + "grad_norm": 1.0753055810928345, + "learning_rate": 1.7961783439490446e-05, + "loss": 0.1906, + "step": 1440 + }, + { + "epoch": 4.588607594936709, + "grad_norm": 0.5957285165786743, + "learning_rate": 1.6687898089171974e-05, + "loss": 0.1888, + "step": 1450 + }, + { + "epoch": 4.620253164556962, + "grad_norm": 0.6847863793373108, + "learning_rate": 1.5414012738853502e-05, + "loss": 0.1856, + "step": 1460 + }, + { + "epoch": 4.651898734177215, + "grad_norm": 1.2106820344924927, + "learning_rate": 1.4140127388535032e-05, + "loss": 0.1805, + "step": 1470 + }, + { + "epoch": 4.6835443037974684, + "grad_norm": 0.7890735268592834, + "learning_rate": 1.2866242038216562e-05, + "loss": 0.1869, + "step": 1480 + }, + { + "epoch": 4.715189873417722, + "grad_norm": 0.9127280712127686, + "learning_rate": 1.159235668789809e-05, + "loss": 0.1941, + "step": 1490 + }, + { + "epoch": 4.746835443037975, + "grad_norm": 0.6244585514068604, + "learning_rate": 1.031847133757962e-05, + "loss": 0.1931, + "step": 1500 + } + ], + "logging_steps": 10, + "max_steps": 1580, + "num_input_tokens_seen": 0, + "num_train_epochs": 5, + "save_steps": 500, + "stateful_callbacks": { + "TrainerControl": { + "args": { + "should_epoch_stop": false, + "should_evaluate": false, + "should_log": false, + "should_save": true, + "should_training_stop": false + }, + "attributes": {} + } + }, + "total_flos": 9.67235545941934e+16, + "train_batch_size": 8, + "trial_name": null, + "trial_params": null +} diff --git a/experiments/Natural/checkpoint-1500/training_args.bin b/experiments/Natural/checkpoint-1500/training_args.bin new file mode 100644 index 0000000000000000000000000000000000000000..99f86c4b08bf7d822cc3dfc3af42fda12dd8131d --- /dev/null +++ b/experiments/Natural/checkpoint-1500/training_args.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05dd2bd1bfc0875dd1346331bc6ef556abef03f996a81a19556acac64e1f133a +size 6289 diff --git a/experiments/Natural/checkpoint-1580/README.md b/experiments/Natural/checkpoint-1580/README.md new file mode 100644 index 0000000000000000000000000000000000000000..6e1128c4737461313d01ab9fe9909a170568a6d0 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/README.md @@ -0,0 +1,210 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +library_name: peft +pipeline_tag: text-generation +tags: +- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +- lora +- sft +- transformers +- trl +- unsloth +--- + +# Model Card for Model ID + + + + + +## Model Details + +### Model Description + + + + + +- **Developed by:** [More Information Needed] +- **Funded by [optional]:** [More Information Needed] +- **Shared by [optional]:** [More Information Needed] +- **Model type:** [More Information Needed] +- **Language(s) (NLP):** [More Information Needed] +- **License:** [More Information Needed] +- **Finetuned from model [optional]:** [More Information Needed] + +### Model Sources [optional] + + + +- **Repository:** [More Information Needed] +- **Paper [optional]:** [More Information Needed] +- **Demo [optional]:** [More Information Needed] + +## Uses + + + +### Direct Use + + + +[More Information Needed] + +### Downstream Use [optional] + + + +[More Information Needed] + +### Out-of-Scope Use + + + +[More Information Needed] + +## Bias, Risks, and Limitations + + + +[More Information Needed] + +### Recommendations + + + +Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. + +## How to Get Started with the Model + +Use the code below to get started with the model. + +[More Information Needed] + +## Training Details + +### Training Data + + + +[More Information Needed] + +### Training Procedure + + + +#### Preprocessing [optional] + +[More Information Needed] + + +#### Training Hyperparameters + +- **Training regime:** [More Information Needed] + +#### Speeds, Sizes, Times [optional] + + + +[More Information Needed] + +## Evaluation + + + +### Testing Data, Factors & Metrics + +#### Testing Data + + + +[More Information Needed] + +#### Factors + + + +[More Information Needed] + +#### Metrics + + + +[More Information Needed] + +### Results + +[More Information Needed] + +#### Summary + + + +## Model Examination [optional] + + + +[More Information Needed] + +## Environmental Impact + + + +Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). + +- **Hardware Type:** [More Information Needed] +- **Hours used:** [More Information Needed] +- **Cloud Provider:** [More Information Needed] +- **Compute Region:** [More Information Needed] +- **Carbon Emitted:** [More Information Needed] + +## Technical Specifications [optional] + +### Model Architecture and Objective + +[More Information Needed] + +### Compute Infrastructure + +[More Information Needed] + +#### Hardware + +[More Information Needed] + +#### Software + +[More Information Needed] + +## Citation [optional] + + + +**BibTeX:** + +[More Information Needed] + +**APA:** + +[More Information Needed] + +## Glossary [optional] + + + +[More Information Needed] + +## More Information [optional] + +[More Information Needed] + +## Model Card Authors [optional] + +[More Information Needed] + +## Model Card Contact + +[More Information Needed] +### Framework versions + +- PEFT 0.18.1 \ No newline at end of file diff --git a/experiments/Natural/checkpoint-1580/adapter_config.json b/experiments/Natural/checkpoint-1580/adapter_config.json new file mode 100644 index 0000000000000000000000000000000000000000..7c2e352b20dfcbcac0e45c46b2bd6a1fddd7caf6 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/adapter_config.json @@ -0,0 +1,50 @@ +{ + "alora_invocation_tokens": null, + "alpha_pattern": {}, + "arrow_config": null, + "auto_mapping": { + "base_model_class": "LlamaForCausalLM", + "parent_library": "transformers.models.llama.modeling_llama", + "unsloth_fixed": true + }, + "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit", + "bias": "none", + "corda_config": null, + "ensure_weight_tying": false, + "eva_config": null, + "exclude_modules": null, + "fan_in_fan_out": false, + "inference_mode": true, + "init_lora_weights": true, + "layer_replication": null, + "layers_pattern": null, + "layers_to_transform": null, + "loftq_config": {}, + "lora_alpha": 32, + "lora_bias": false, + "lora_dropout": 0, + "megatron_config": null, + "megatron_core": "megatron.core", + "modules_to_save": null, + "peft_type": "LORA", + "peft_version": "0.18.1", + "qalora_group_size": 16, + "r": 16, + "rank_pattern": {}, + "revision": null, + "target_modules": [ + "gate_proj", + "v_proj", + "o_proj", + "k_proj", + "up_proj", + "down_proj", + "q_proj" + ], + "target_parameters": null, + "task_type": "CAUSAL_LM", + "trainable_token_indices": null, + "use_dora": false, + "use_qalora": false, + "use_rslora": true +} \ No newline at end of file diff --git a/experiments/Natural/checkpoint-1580/adapter_model.safetensors b/experiments/Natural/checkpoint-1580/adapter_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c71aebb4df4e299fa614cc1eaa32e4c398e361c5 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/adapter_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c99d378dc26e507db69f1bbadaa36666676e1f90c50253e525406eeb68810ea8 +size 167832240 diff --git a/experiments/Natural/checkpoint-1580/chat_template.jinja b/experiments/Natural/checkpoint-1580/chat_template.jinja new file mode 100644 index 0000000000000000000000000000000000000000..33089ace1be88f22a10fe861ad49718d5d886090 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/chat_template.jinja @@ -0,0 +1,109 @@ +{{- bos_token }} +{%- if custom_tools is defined %} + {%- set tools = custom_tools %} +{%- endif %} +{%- if not tools_in_user_message is defined %} + {%- set tools_in_user_message = true %} +{%- endif %} +{%- if not date_string is defined %} + {%- set date_string = "26 Jul 2024" %} +{%- endif %} +{%- if not tools is defined %} + {%- set tools = none %} +{%- endif %} + +{#- This block extracts the system message, so we can slot it into the right place. #} +{%- if messages[0]['role'] == 'system' %} + {%- set system_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} +{%- else %} + {%- set system_message = "" %} +{%- endif %} + +{#- System message + builtin tools #} +{{- "<|start_header_id|>system<|end_header_id|>\n\n" }} +{%- if builtin_tools is defined or tools is not none %} + {{- "Environment: ipython\n" }} +{%- endif %} +{%- if builtin_tools is defined %} + {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}} +{%- endif %} +{{- "Cutting Knowledge Date: December 2023\n" }} +{{- "Today Date: " + date_string + "\n\n" }} +{%- if tools is not none and not tools_in_user_message %} + {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} +{%- endif %} +{{- system_message }} +{{- "<|eot_id|>" }} + +{#- Custom tools are passed in a user message with some extra guidance #} +{%- if tools_in_user_message and not tools is none %} + {#- Extract the first user message so we can plug it in here #} + {%- if messages | length != 0 %} + {%- set first_user_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} + {%- else %} + {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }} +{%- endif %} + {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}} + {{- "Given the following functions, please respond with a JSON for a function call " }} + {{- "with its proper arguments that best answers the given prompt.\n\n" }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} + {{- first_user_message + "<|eot_id|>"}} +{%- endif %} + +{%- for message in messages %} + {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %} + {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }} + {%- elif 'tool_calls' in message %} + {%- if not message.tool_calls|length == 1 %} + {{- raise_exception("This model only supports single tool-calls at once!") }} + {%- endif %} + {%- set tool_call = message.tool_calls[0].function %} + {%- if builtin_tools is defined and tool_call.name in builtin_tools %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- "<|python_tag|>" + tool_call.name + ".call(" }} + {%- for arg_name, arg_val in tool_call.arguments | items %} + {{- arg_name + '="' + arg_val + '"' }} + {%- if not loop.last %} + {{- ", " }} + {%- endif %} + {%- endfor %} + {{- ")" }} + {%- else %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- '{"name": "' + tool_call.name + '", ' }} + {{- '"parameters": ' }} + {{- tool_call.arguments | tojson }} + {{- "}" }} + {%- endif %} + {%- if builtin_tools is defined %} + {#- This means we're in ipython mode #} + {{- "<|eom_id|>" }} + {%- else %} + {{- "<|eot_id|>" }} + {%- endif %} + {%- elif message.role == "tool" or message.role == "ipython" %} + {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }} + {%- if message.content is mapping or message.content is iterable %} + {{- message.content | tojson }} + {%- else %} + {{- message.content }} + {%- endif %} + {{- "<|eot_id|>" }} + {%- endif %} +{%- endfor %} +{%- if add_generation_prompt %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }} +{%- endif %} diff --git a/experiments/Natural/checkpoint-1580/optimizer.pt b/experiments/Natural/checkpoint-1580/optimizer.pt new file mode 100644 index 0000000000000000000000000000000000000000..f9a96cd1800731a063a39faaeacfe5e346ef77a1 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/optimizer.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9dc13c92702a124555a2b9b199b455104e3397b99e6b50ca021d05557a4c50d +size 85724133 diff --git a/experiments/Natural/checkpoint-1580/rng_state.pth b/experiments/Natural/checkpoint-1580/rng_state.pth new file mode 100644 index 0000000000000000000000000000000000000000..ecd5163c23b56be6c4d0a107794dc7b316f940a1 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/rng_state.pth @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89645f9f6a2a8823b334e0748e4f5ea683a27b3d02632f0a241397db55d82fad +size 14645 diff --git a/experiments/Natural/checkpoint-1580/scheduler.pt b/experiments/Natural/checkpoint-1580/scheduler.pt new file mode 100644 index 0000000000000000000000000000000000000000..4fa5bdcf671bb686ed8ea85a4694894105660be6 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/scheduler.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0a97f21c0a7d8518fbc52270f43024d3897b647f2dc864b2af25dddfb74924be +size 1465 diff --git a/experiments/Natural/checkpoint-1580/special_tokens_map.json b/experiments/Natural/checkpoint-1580/special_tokens_map.json new file mode 100644 index 0000000000000000000000000000000000000000..3c1d04911c269b925af977a3151c9704e990e4d0 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/special_tokens_map.json @@ -0,0 +1,23 @@ +{ + "bos_token": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "eos_token": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "pad_token": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + } +} diff --git a/experiments/Natural/checkpoint-1580/tokenizer.json b/experiments/Natural/checkpoint-1580/tokenizer.json new file mode 100644 index 0000000000000000000000000000000000000000..1c1d8d5c9024994f1d3b00f9662b8dd89ca13cf2 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/tokenizer.json @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b +size 17209920 diff --git a/experiments/Natural/checkpoint-1580/tokenizer_config.json b/experiments/Natural/checkpoint-1580/tokenizer_config.json new file mode 100644 index 0000000000000000000000000000000000000000..69b6ed0e11b81375bae750eb8ec4a7e1146eeca3 --- /dev/null +++ b/experiments/Natural/checkpoint-1580/tokenizer_config.json @@ -0,0 +1,2066 @@ +{ + "add_bos_token": true, + "added_tokens_decoder": { + "128000": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128001": { + "content": "<|end_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128002": { + "content": "<|reserved_special_token_0|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128003": { + "content": "<|reserved_special_token_1|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128004": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128005": { + "content": "<|reserved_special_token_2|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128006": { + "content": "<|start_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128007": { + "content": "<|end_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128008": { + "content": "<|eom_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128009": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128010": { + "content": "<|python_tag|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128011": { + "content": "<|reserved_special_token_3|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128012": { + "content": "<|reserved_special_token_4|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128013": { + "content": "<|reserved_special_token_5|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128014": { + "content": "<|reserved_special_token_6|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128015": { + "content": "<|reserved_special_token_7|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128016": { + "content": "<|reserved_special_token_8|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128017": { + "content": "<|reserved_special_token_9|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128018": { + "content": "<|reserved_special_token_10|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128019": { + "content": "<|reserved_special_token_11|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128020": { + "content": "<|reserved_special_token_12|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128021": { + "content": "<|reserved_special_token_13|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128022": { + "content": "<|reserved_special_token_14|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128023": { + "content": "<|reserved_special_token_15|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128024": { + "content": "<|reserved_special_token_16|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128025": { + "content": "<|reserved_special_token_17|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128026": { + "content": "<|reserved_special_token_18|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128027": { + "content": "<|reserved_special_token_19|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128028": { + "content": "<|reserved_special_token_20|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128029": { + "content": "<|reserved_special_token_21|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128030": { + "content": "<|reserved_special_token_22|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128031": { + "content": "<|reserved_special_token_23|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128032": { + "content": "<|reserved_special_token_24|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128033": { + "content": "<|reserved_special_token_25|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128034": { + "content": "<|reserved_special_token_26|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128035": { + "content": "<|reserved_special_token_27|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128036": { + "content": "<|reserved_special_token_28|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128037": { + "content": "<|reserved_special_token_29|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128038": { + "content": "<|reserved_special_token_30|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128039": { + "content": "<|reserved_special_token_31|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128040": { + "content": "<|reserved_special_token_32|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128041": { + "content": "<|reserved_special_token_33|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128042": { + "content": "<|reserved_special_token_34|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128043": { + "content": "<|reserved_special_token_35|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128044": { + "content": "<|reserved_special_token_36|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128045": { + "content": "<|reserved_special_token_37|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128046": { + "content": "<|reserved_special_token_38|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128047": { + "content": "<|reserved_special_token_39|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128048": { + "content": "<|reserved_special_token_40|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128049": { + "content": "<|reserved_special_token_41|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128050": { + "content": "<|reserved_special_token_42|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128051": { + "content": "<|reserved_special_token_43|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128052": { + "content": "<|reserved_special_token_44|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128053": { + "content": "<|reserved_special_token_45|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128054": { + "content": "<|reserved_special_token_46|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128055": { + "content": "<|reserved_special_token_47|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128056": { + "content": "<|reserved_special_token_48|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128057": { + "content": "<|reserved_special_token_49|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128058": { + "content": "<|reserved_special_token_50|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128059": { + "content": "<|reserved_special_token_51|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128060": { + "content": "<|reserved_special_token_52|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128061": { + "content": "<|reserved_special_token_53|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128062": { + "content": "<|reserved_special_token_54|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128063": { + "content": "<|reserved_special_token_55|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128064": { + "content": "<|reserved_special_token_56|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128065": { + "content": "<|reserved_special_token_57|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128066": { + "content": "<|reserved_special_token_58|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128067": { + "content": "<|reserved_special_token_59|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128068": { + "content": "<|reserved_special_token_60|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128069": { + "content": "<|reserved_special_token_61|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128070": { + "content": "<|reserved_special_token_62|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128071": { + "content": "<|reserved_special_token_63|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128072": { + "content": "<|reserved_special_token_64|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128073": { + "content": "<|reserved_special_token_65|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128074": { + "content": "<|reserved_special_token_66|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128075": { + "content": "<|reserved_special_token_67|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128076": { + "content": "<|reserved_special_token_68|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128077": { + "content": "<|reserved_special_token_69|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128078": { + "content": "<|reserved_special_token_70|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128079": { + "content": "<|reserved_special_token_71|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128080": { + "content": "<|reserved_special_token_72|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128081": { + "content": "<|reserved_special_token_73|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128082": { + "content": "<|reserved_special_token_74|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128083": { + "content": "<|reserved_special_token_75|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128084": { + "content": "<|reserved_special_token_76|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128085": { + "content": "<|reserved_special_token_77|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128086": { + "content": "<|reserved_special_token_78|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128087": { + "content": "<|reserved_special_token_79|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128088": { + "content": "<|reserved_special_token_80|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128089": { + "content": "<|reserved_special_token_81|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128090": { + "content": "<|reserved_special_token_82|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128091": { + "content": "<|reserved_special_token_83|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128092": { + "content": "<|reserved_special_token_84|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128093": { + "content": "<|reserved_special_token_85|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128094": { + "content": "<|reserved_special_token_86|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128095": { + "content": "<|reserved_special_token_87|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128096": { + "content": "<|reserved_special_token_88|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128097": { + "content": "<|reserved_special_token_89|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128098": { + "content": "<|reserved_special_token_90|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128099": { + "content": "<|reserved_special_token_91|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128100": { + "content": "<|reserved_special_token_92|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128101": { + "content": "<|reserved_special_token_93|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128102": { + "content": "<|reserved_special_token_94|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128103": { + "content": "<|reserved_special_token_95|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128104": { + "content": "<|reserved_special_token_96|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128105": { + "content": "<|reserved_special_token_97|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128106": { + "content": "<|reserved_special_token_98|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128107": { + "content": "<|reserved_special_token_99|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128108": { + "content": "<|reserved_special_token_100|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128109": { + "content": "<|reserved_special_token_101|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128110": { + "content": "<|reserved_special_token_102|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128111": { + "content": "<|reserved_special_token_103|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128112": { + "content": "<|reserved_special_token_104|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128113": { + "content": "<|reserved_special_token_105|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128114": { + "content": "<|reserved_special_token_106|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128115": { + "content": "<|reserved_special_token_107|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128116": { + "content": "<|reserved_special_token_108|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128117": { + "content": "<|reserved_special_token_109|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128118": { + "content": "<|reserved_special_token_110|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128119": { + "content": "<|reserved_special_token_111|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128120": { + "content": "<|reserved_special_token_112|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128121": { + "content": "<|reserved_special_token_113|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128122": { + "content": "<|reserved_special_token_114|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128123": { + "content": "<|reserved_special_token_115|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128124": { + "content": "<|reserved_special_token_116|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128125": { + "content": "<|reserved_special_token_117|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128126": { + "content": "<|reserved_special_token_118|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128127": { + "content": "<|reserved_special_token_119|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128128": { + "content": "<|reserved_special_token_120|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128129": { + "content": "<|reserved_special_token_121|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128130": { + "content": "<|reserved_special_token_122|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128131": { + "content": "<|reserved_special_token_123|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128132": { + "content": "<|reserved_special_token_124|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128133": { + "content": "<|reserved_special_token_125|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128134": { + "content": "<|reserved_special_token_126|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128135": { + "content": "<|reserved_special_token_127|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128136": { + "content": "<|reserved_special_token_128|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128137": { + "content": "<|reserved_special_token_129|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128138": { + "content": "<|reserved_special_token_130|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128139": { + "content": "<|reserved_special_token_131|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128140": { + "content": "<|reserved_special_token_132|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128141": { + "content": "<|reserved_special_token_133|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128142": { + "content": "<|reserved_special_token_134|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128143": { + "content": "<|reserved_special_token_135|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128144": { + "content": "<|reserved_special_token_136|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128145": { + "content": "<|reserved_special_token_137|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128146": { + "content": "<|reserved_special_token_138|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128147": { + "content": "<|reserved_special_token_139|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128148": { + "content": "<|reserved_special_token_140|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128149": { + "content": "<|reserved_special_token_141|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128150": { + "content": "<|reserved_special_token_142|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128151": { + "content": "<|reserved_special_token_143|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128152": { + "content": "<|reserved_special_token_144|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128153": { + "content": "<|reserved_special_token_145|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128154": { + "content": "<|reserved_special_token_146|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128155": { + "content": "<|reserved_special_token_147|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128156": { + "content": "<|reserved_special_token_148|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128157": { + "content": "<|reserved_special_token_149|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128158": { + "content": "<|reserved_special_token_150|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128159": { + "content": "<|reserved_special_token_151|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128160": { + "content": "<|reserved_special_token_152|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128161": { + "content": "<|reserved_special_token_153|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128162": { + "content": "<|reserved_special_token_154|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128163": { + "content": "<|reserved_special_token_155|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128164": { + "content": "<|reserved_special_token_156|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128165": { + "content": "<|reserved_special_token_157|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128166": { + "content": "<|reserved_special_token_158|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128167": { + "content": "<|reserved_special_token_159|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128168": { + "content": "<|reserved_special_token_160|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128169": { + "content": "<|reserved_special_token_161|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128170": { + "content": "<|reserved_special_token_162|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128171": { + "content": "<|reserved_special_token_163|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128172": { + "content": "<|reserved_special_token_164|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128173": { + "content": "<|reserved_special_token_165|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128174": { + "content": "<|reserved_special_token_166|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128175": { + "content": "<|reserved_special_token_167|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128176": { + "content": "<|reserved_special_token_168|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128177": { + "content": "<|reserved_special_token_169|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128178": { + "content": "<|reserved_special_token_170|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128179": { + "content": "<|reserved_special_token_171|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128180": { + "content": "<|reserved_special_token_172|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128181": { + "content": "<|reserved_special_token_173|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128182": { + "content": "<|reserved_special_token_174|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128183": { + "content": "<|reserved_special_token_175|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128184": { + "content": "<|reserved_special_token_176|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128185": { + "content": "<|reserved_special_token_177|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128186": { + "content": "<|reserved_special_token_178|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128187": { + "content": "<|reserved_special_token_179|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128188": { + "content": "<|reserved_special_token_180|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128189": { + "content": "<|reserved_special_token_181|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128190": { + "content": "<|reserved_special_token_182|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128191": { + "content": "<|reserved_special_token_183|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128192": { + "content": "<|reserved_special_token_184|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128193": { + "content": "<|reserved_special_token_185|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128194": { + "content": "<|reserved_special_token_186|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128195": { + "content": "<|reserved_special_token_187|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128196": { + "content": "<|reserved_special_token_188|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128197": { + "content": "<|reserved_special_token_189|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128198": { + "content": "<|reserved_special_token_190|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128199": { + "content": "<|reserved_special_token_191|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128200": { + "content": "<|reserved_special_token_192|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128201": { + "content": "<|reserved_special_token_193|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128202": { + "content": "<|reserved_special_token_194|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128203": { + "content": "<|reserved_special_token_195|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128204": { + "content": "<|reserved_special_token_196|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128205": { + "content": "<|reserved_special_token_197|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128206": { + "content": "<|reserved_special_token_198|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128207": { + "content": "<|reserved_special_token_199|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128208": { + "content": "<|reserved_special_token_200|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128209": { + "content": "<|reserved_special_token_201|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128210": { + "content": "<|reserved_special_token_202|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128211": { + "content": "<|reserved_special_token_203|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128212": { + "content": "<|reserved_special_token_204|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128213": { + "content": "<|reserved_special_token_205|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128214": { + "content": "<|reserved_special_token_206|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128215": { + "content": "<|reserved_special_token_207|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128216": { + "content": "<|reserved_special_token_208|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128217": { + "content": "<|reserved_special_token_209|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128218": { + "content": "<|reserved_special_token_210|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128219": { + "content": "<|reserved_special_token_211|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128220": { + "content": "<|reserved_special_token_212|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128221": { + "content": "<|reserved_special_token_213|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128222": { + "content": "<|reserved_special_token_214|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128223": { + "content": "<|reserved_special_token_215|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128224": { + "content": "<|reserved_special_token_216|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128225": { + "content": "<|reserved_special_token_217|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128226": { + "content": "<|reserved_special_token_218|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128227": { + "content": "<|reserved_special_token_219|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128228": { + "content": "<|reserved_special_token_220|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128229": { + "content": "<|reserved_special_token_221|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128230": { + "content": "<|reserved_special_token_222|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128231": { + "content": "<|reserved_special_token_223|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128232": { + "content": "<|reserved_special_token_224|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128233": { + "content": "<|reserved_special_token_225|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128234": { + "content": "<|reserved_special_token_226|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128235": { + "content": "<|reserved_special_token_227|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128236": { + "content": "<|reserved_special_token_228|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128237": { + "content": "<|reserved_special_token_229|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128238": { + "content": "<|reserved_special_token_230|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128239": { + "content": "<|reserved_special_token_231|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128240": { + "content": "<|reserved_special_token_232|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128241": { + "content": "<|reserved_special_token_233|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128242": { + "content": "<|reserved_special_token_234|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128243": { + "content": "<|reserved_special_token_235|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128244": { + "content": "<|reserved_special_token_236|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128245": { + "content": "<|reserved_special_token_237|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128246": { + "content": "<|reserved_special_token_238|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128247": { + "content": "<|reserved_special_token_239|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128248": { + "content": "<|reserved_special_token_240|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128249": { + "content": "<|reserved_special_token_241|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128250": { + "content": "<|reserved_special_token_242|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128251": { + "content": "<|reserved_special_token_243|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128252": { + "content": "<|reserved_special_token_244|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128253": { + "content": "<|reserved_special_token_245|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128254": { + "content": "<|reserved_special_token_246|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128255": { + "content": "<|reserved_special_token_247|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + } + }, + "bos_token": "<|begin_of_text|>", + "clean_up_tokenization_spaces": true, + "eos_token": "<|eot_id|>", + "extra_special_tokens": {}, + "model_input_names": [ + "input_ids", + "attention_mask" + ], + "model_max_length": 131072, + "pad_token": "<|finetune_right_pad_id|>", + "padding_side": "right", + "tokenizer_class": "PreTrainedTokenizerFast", + "unk_token": null +} diff --git a/experiments/Natural/checkpoint-1580/trainer_state.json b/experiments/Natural/checkpoint-1580/trainer_state.json new file mode 100644 index 0000000000000000000000000000000000000000..9c27fe4995a6d1175db6764efa3d8c594c58b9ef --- /dev/null +++ b/experiments/Natural/checkpoint-1580/trainer_state.json @@ -0,0 +1,1140 @@ +{ + "best_global_step": null, + "best_metric": null, + "best_model_checkpoint": null, + "epoch": 5.0, + "eval_steps": 500, + "global_step": 1580, + "is_hyper_param_search": false, + "is_local_process_zero": true, + "is_world_process_zero": true, + "log_history": [ + { + "epoch": 0.03164556962025317, + "grad_norm": 5.501315116882324, + "learning_rate": 0.00018, + "loss": 2.5563, + "step": 10 + }, + { + "epoch": 0.06329113924050633, + "grad_norm": 160.5225067138672, + "learning_rate": 0.00019885350318471338, + "loss": 1.5451, + "step": 20 + }, + { + "epoch": 0.0949367088607595, + "grad_norm": 10.833513259887695, + "learning_rate": 0.00019757961783439492, + "loss": 1.8865, + "step": 30 + }, + { + "epoch": 0.12658227848101267, + "grad_norm": 16.25729751586914, + "learning_rate": 0.00019630573248407643, + "loss": 1.3788, + "step": 40 + }, + { + "epoch": 0.15822784810126583, + "grad_norm": 3.233597755432129, + "learning_rate": 0.00019503184713375797, + "loss": 1.1314, + "step": 50 + }, + { + "epoch": 0.189873417721519, + "grad_norm": 3.3475453853607178, + "learning_rate": 0.0001937579617834395, + "loss": 1.0585, + "step": 60 + }, + { + "epoch": 0.22151898734177214, + "grad_norm": 2.3403992652893066, + "learning_rate": 0.00019248407643312102, + "loss": 1.0554, + "step": 70 + }, + { + "epoch": 0.25316455696202533, + "grad_norm": 2.324516534805298, + "learning_rate": 0.00019121019108280256, + "loss": 1.0274, + "step": 80 + }, + { + "epoch": 0.2848101265822785, + "grad_norm": 2.125304937362671, + "learning_rate": 0.0001899363057324841, + "loss": 1.0045, + "step": 90 + }, + { + "epoch": 0.31645569620253167, + "grad_norm": 2.1273205280303955, + "learning_rate": 0.0001886624203821656, + "loss": 0.9993, + "step": 100 + }, + { + "epoch": 0.34810126582278483, + "grad_norm": 2.5348403453826904, + "learning_rate": 0.00018738853503184714, + "loss": 1.0386, + "step": 110 + }, + { + "epoch": 0.379746835443038, + "grad_norm": 2.660738468170166, + "learning_rate": 0.00018611464968152868, + "loss": 0.992, + "step": 120 + }, + { + "epoch": 0.41139240506329117, + "grad_norm": 2.187695026397705, + "learning_rate": 0.0001848407643312102, + "loss": 1.0174, + "step": 130 + }, + { + "epoch": 0.4430379746835443, + "grad_norm": 2.0130527019500732, + "learning_rate": 0.00018356687898089173, + "loss": 1.0349, + "step": 140 + }, + { + "epoch": 0.47468354430379744, + "grad_norm": 2.2986974716186523, + "learning_rate": 0.00018229299363057327, + "loss": 1.0426, + "step": 150 + }, + { + "epoch": 0.5063291139240507, + "grad_norm": 2.0907416343688965, + "learning_rate": 0.00018101910828025478, + "loss": 0.9566, + "step": 160 + }, + { + "epoch": 0.5379746835443038, + "grad_norm": 2.263169765472412, + "learning_rate": 0.00017974522292993632, + "loss": 0.9728, + "step": 170 + }, + { + "epoch": 0.569620253164557, + "grad_norm": 1.950455665588379, + "learning_rate": 0.00017847133757961786, + "loss": 0.9681, + "step": 180 + }, + { + "epoch": 0.6012658227848101, + "grad_norm": 1.991625189781189, + "learning_rate": 0.00017719745222929937, + "loss": 0.9877, + "step": 190 + }, + { + "epoch": 0.6329113924050633, + "grad_norm": 2.5864851474761963, + "learning_rate": 0.0001759235668789809, + "loss": 0.9536, + "step": 200 + }, + { + "epoch": 0.6645569620253164, + "grad_norm": 1.9064277410507202, + "learning_rate": 0.00017464968152866244, + "loss": 0.9546, + "step": 210 + }, + { + "epoch": 0.6962025316455697, + "grad_norm": 2.235928773880005, + "learning_rate": 0.00017337579617834396, + "loss": 0.9241, + "step": 220 + }, + { + "epoch": 0.7278481012658228, + "grad_norm": 1.9112043380737305, + "learning_rate": 0.0001721019108280255, + "loss": 0.966, + "step": 230 + }, + { + "epoch": 0.759493670886076, + "grad_norm": 2.6696879863739014, + "learning_rate": 0.00017082802547770703, + "loss": 0.8924, + "step": 240 + }, + { + "epoch": 0.7911392405063291, + "grad_norm": 2.395738124847412, + "learning_rate": 0.00016955414012738854, + "loss": 0.9879, + "step": 250 + }, + { + "epoch": 0.8227848101265823, + "grad_norm": 2.1325836181640625, + "learning_rate": 0.00016828025477707008, + "loss": 0.9125, + "step": 260 + }, + { + "epoch": 0.8544303797468354, + "grad_norm": 3.023322582244873, + "learning_rate": 0.00016700636942675162, + "loss": 0.9578, + "step": 270 + }, + { + "epoch": 0.8860759493670886, + "grad_norm": 2.16930890083313, + "learning_rate": 0.00016573248407643313, + "loss": 0.9655, + "step": 280 + }, + { + "epoch": 0.9177215189873418, + "grad_norm": 2.751526355743408, + "learning_rate": 0.00016445859872611467, + "loss": 0.8529, + "step": 290 + }, + { + "epoch": 0.9493670886075949, + "grad_norm": 2.2014594078063965, + "learning_rate": 0.00016318471337579618, + "loss": 0.8895, + "step": 300 + }, + { + "epoch": 0.9810126582278481, + "grad_norm": 2.498781681060791, + "learning_rate": 0.00016191082802547772, + "loss": 0.9022, + "step": 310 + }, + { + "epoch": 1.0126582278481013, + "grad_norm": 1.6269073486328125, + "learning_rate": 0.00016063694267515926, + "loss": 0.7462, + "step": 320 + }, + { + "epoch": 1.0443037974683544, + "grad_norm": 2.417710304260254, + "learning_rate": 0.00015936305732484077, + "loss": 0.6435, + "step": 330 + }, + { + "epoch": 1.0759493670886076, + "grad_norm": 2.120162010192871, + "learning_rate": 0.0001580891719745223, + "loss": 0.6222, + "step": 340 + }, + { + "epoch": 1.1075949367088607, + "grad_norm": 1.8784149885177612, + "learning_rate": 0.00015681528662420385, + "loss": 0.6014, + "step": 350 + }, + { + "epoch": 1.139240506329114, + "grad_norm": 1.9097055196762085, + "learning_rate": 0.00015554140127388536, + "loss": 0.618, + "step": 360 + }, + { + "epoch": 1.1708860759493671, + "grad_norm": 3.8499958515167236, + "learning_rate": 0.0001542675159235669, + "loss": 0.6094, + "step": 370 + }, + { + "epoch": 1.2025316455696202, + "grad_norm": 2.857755184173584, + "learning_rate": 0.00015299363057324843, + "loss": 0.644, + "step": 380 + }, + { + "epoch": 1.2341772151898733, + "grad_norm": 1.798422932624817, + "learning_rate": 0.00015171974522292994, + "loss": 0.6059, + "step": 390 + }, + { + "epoch": 1.2658227848101267, + "grad_norm": 2.251343011856079, + "learning_rate": 0.00015044585987261148, + "loss": 0.6059, + "step": 400 + }, + { + "epoch": 1.2974683544303798, + "grad_norm": 1.714311122894287, + "learning_rate": 0.000149171974522293, + "loss": 0.6263, + "step": 410 + }, + { + "epoch": 1.3291139240506329, + "grad_norm": 2.1517114639282227, + "learning_rate": 0.00014789808917197453, + "loss": 0.6018, + "step": 420 + }, + { + "epoch": 1.360759493670886, + "grad_norm": 2.019310235977173, + "learning_rate": 0.00014662420382165604, + "loss": 0.6241, + "step": 430 + }, + { + "epoch": 1.3924050632911391, + "grad_norm": 3.1832761764526367, + "learning_rate": 0.00014535031847133758, + "loss": 0.6105, + "step": 440 + }, + { + "epoch": 1.4240506329113924, + "grad_norm": 2.199019432067871, + "learning_rate": 0.0001440764331210191, + "loss": 0.6367, + "step": 450 + }, + { + "epoch": 1.4556962025316456, + "grad_norm": 2.4912033081054688, + "learning_rate": 0.00014280254777070063, + "loss": 0.6339, + "step": 460 + }, + { + "epoch": 1.4873417721518987, + "grad_norm": 2.6481103897094727, + "learning_rate": 0.00014152866242038217, + "loss": 0.6062, + "step": 470 + }, + { + "epoch": 1.518987341772152, + "grad_norm": 2.133782386779785, + "learning_rate": 0.00014025477707006368, + "loss": 0.6095, + "step": 480 + }, + { + "epoch": 1.5506329113924051, + "grad_norm": 2.9077465534210205, + "learning_rate": 0.00013898089171974522, + "loss": 0.5843, + "step": 490 + }, + { + "epoch": 1.5822784810126582, + "grad_norm": 2.5229060649871826, + "learning_rate": 0.00013770700636942676, + "loss": 0.6227, + "step": 500 + }, + { + "epoch": 1.6139240506329116, + "grad_norm": 2.6327691078186035, + "learning_rate": 0.00013643312101910827, + "loss": 0.6238, + "step": 510 + }, + { + "epoch": 1.6455696202531644, + "grad_norm": 2.156597852706909, + "learning_rate": 0.0001351592356687898, + "loss": 0.5719, + "step": 520 + }, + { + "epoch": 1.6772151898734178, + "grad_norm": 2.23740553855896, + "learning_rate": 0.00013388535031847134, + "loss": 0.5821, + "step": 530 + }, + { + "epoch": 1.7088607594936709, + "grad_norm": 2.254840135574341, + "learning_rate": 0.00013261146496815286, + "loss": 0.6063, + "step": 540 + }, + { + "epoch": 1.740506329113924, + "grad_norm": 2.106001377105713, + "learning_rate": 0.0001313375796178344, + "loss": 0.6252, + "step": 550 + }, + { + "epoch": 1.7721518987341773, + "grad_norm": 2.2712509632110596, + "learning_rate": 0.00013006369426751593, + "loss": 0.6271, + "step": 560 + }, + { + "epoch": 1.8037974683544302, + "grad_norm": 2.142057180404663, + "learning_rate": 0.00012878980891719744, + "loss": 0.575, + "step": 570 + }, + { + "epoch": 1.8354430379746836, + "grad_norm": 1.9250198602676392, + "learning_rate": 0.00012751592356687898, + "loss": 0.568, + "step": 580 + }, + { + "epoch": 1.8670886075949367, + "grad_norm": 2.0625407695770264, + "learning_rate": 0.00012624203821656052, + "loss": 0.6047, + "step": 590 + }, + { + "epoch": 1.8987341772151898, + "grad_norm": 3.7402431964874268, + "learning_rate": 0.00012496815286624203, + "loss": 0.581, + "step": 600 + }, + { + "epoch": 1.9303797468354431, + "grad_norm": 1.8032431602478027, + "learning_rate": 0.00012369426751592357, + "loss": 0.6124, + "step": 610 + }, + { + "epoch": 1.9620253164556962, + "grad_norm": 2.4170119762420654, + "learning_rate": 0.0001224203821656051, + "loss": 0.5682, + "step": 620 + }, + { + "epoch": 1.9936708860759493, + "grad_norm": 2.7495386600494385, + "learning_rate": 0.00012114649681528662, + "loss": 0.566, + "step": 630 + }, + { + "epoch": 2.0253164556962027, + "grad_norm": 2.5206427574157715, + "learning_rate": 0.00011987261146496816, + "loss": 0.3717, + "step": 640 + }, + { + "epoch": 2.0569620253164556, + "grad_norm": 2.323184013366699, + "learning_rate": 0.00011859872611464968, + "loss": 0.3412, + "step": 650 + }, + { + "epoch": 2.088607594936709, + "grad_norm": 2.0928003787994385, + "learning_rate": 0.0001173248407643312, + "loss": 0.3217, + "step": 660 + }, + { + "epoch": 2.1202531645569622, + "grad_norm": 2.0109825134277344, + "learning_rate": 0.00011605095541401274, + "loss": 0.3313, + "step": 670 + }, + { + "epoch": 2.151898734177215, + "grad_norm": 2.067814826965332, + "learning_rate": 0.00011477707006369427, + "loss": 0.3388, + "step": 680 + }, + { + "epoch": 2.1835443037974684, + "grad_norm": 2.0013394355773926, + "learning_rate": 0.0001135031847133758, + "loss": 0.338, + "step": 690 + }, + { + "epoch": 2.2151898734177213, + "grad_norm": 1.7796369791030884, + "learning_rate": 0.00011222929936305733, + "loss": 0.324, + "step": 700 + }, + { + "epoch": 2.2468354430379747, + "grad_norm": 2.0786919593811035, + "learning_rate": 0.00011095541401273886, + "loss": 0.3391, + "step": 710 + }, + { + "epoch": 2.278481012658228, + "grad_norm": 2.154378890991211, + "learning_rate": 0.00010968152866242038, + "loss": 0.3377, + "step": 720 + }, + { + "epoch": 2.310126582278481, + "grad_norm": 2.065183639526367, + "learning_rate": 0.00010840764331210192, + "loss": 0.3486, + "step": 730 + }, + { + "epoch": 2.3417721518987342, + "grad_norm": 1.972088098526001, + "learning_rate": 0.00010713375796178344, + "loss": 0.3347, + "step": 740 + }, + { + "epoch": 2.3734177215189876, + "grad_norm": 2.141294002532959, + "learning_rate": 0.00010585987261146497, + "loss": 0.335, + "step": 750 + }, + { + "epoch": 2.4050632911392404, + "grad_norm": 2.27059006690979, + "learning_rate": 0.0001045859872611465, + "loss": 0.3481, + "step": 760 + }, + { + "epoch": 2.4367088607594938, + "grad_norm": 2.0947511196136475, + "learning_rate": 0.00010331210191082803, + "loss": 0.3437, + "step": 770 + }, + { + "epoch": 2.4683544303797467, + "grad_norm": 2.0567169189453125, + "learning_rate": 0.00010203821656050956, + "loss": 0.3434, + "step": 780 + }, + { + "epoch": 2.5, + "grad_norm": 2.0784637928009033, + "learning_rate": 0.00010076433121019108, + "loss": 0.335, + "step": 790 + }, + { + "epoch": 2.5316455696202533, + "grad_norm": 1.9443864822387695, + "learning_rate": 9.949044585987262e-05, + "loss": 0.349, + "step": 800 + }, + { + "epoch": 2.5632911392405062, + "grad_norm": 2.338250160217285, + "learning_rate": 9.821656050955414e-05, + "loss": 0.3433, + "step": 810 + }, + { + "epoch": 2.5949367088607596, + "grad_norm": 1.9308645725250244, + "learning_rate": 9.694267515923567e-05, + "loss": 0.3344, + "step": 820 + }, + { + "epoch": 2.6265822784810124, + "grad_norm": 2.1741745471954346, + "learning_rate": 9.566878980891721e-05, + "loss": 0.3241, + "step": 830 + }, + { + "epoch": 2.6582278481012658, + "grad_norm": 1.8227561712265015, + "learning_rate": 9.439490445859873e-05, + "loss": 0.3289, + "step": 840 + }, + { + "epoch": 2.689873417721519, + "grad_norm": 2.090834856033325, + "learning_rate": 9.312101910828026e-05, + "loss": 0.3431, + "step": 850 + }, + { + "epoch": 2.721518987341772, + "grad_norm": 1.823628544807434, + "learning_rate": 9.18471337579618e-05, + "loss": 0.3502, + "step": 860 + }, + { + "epoch": 2.7531645569620253, + "grad_norm": 2.5202064514160156, + "learning_rate": 9.057324840764332e-05, + "loss": 0.3409, + "step": 870 + }, + { + "epoch": 2.7848101265822782, + "grad_norm": 1.9167916774749756, + "learning_rate": 8.929936305732484e-05, + "loss": 0.3372, + "step": 880 + }, + { + "epoch": 2.8164556962025316, + "grad_norm": 2.5479819774627686, + "learning_rate": 8.802547770700637e-05, + "loss": 0.3442, + "step": 890 + }, + { + "epoch": 2.848101265822785, + "grad_norm": 1.6813645362854004, + "learning_rate": 8.675159235668791e-05, + "loss": 0.336, + "step": 900 + }, + { + "epoch": 2.879746835443038, + "grad_norm": 2.1691527366638184, + "learning_rate": 8.547770700636943e-05, + "loss": 0.3275, + "step": 910 + }, + { + "epoch": 2.911392405063291, + "grad_norm": 1.9385488033294678, + "learning_rate": 8.420382165605096e-05, + "loss": 0.3433, + "step": 920 + }, + { + "epoch": 2.9430379746835444, + "grad_norm": 1.9246203899383545, + "learning_rate": 8.29299363057325e-05, + "loss": 0.3487, + "step": 930 + }, + { + "epoch": 2.9746835443037973, + "grad_norm": 1.95414137840271, + "learning_rate": 8.165605095541402e-05, + "loss": 0.3437, + "step": 940 + }, + { + "epoch": 3.0063291139240507, + "grad_norm": 1.1191596984863281, + "learning_rate": 8.038216560509555e-05, + "loss": 0.3057, + "step": 950 + }, + { + "epoch": 3.037974683544304, + "grad_norm": 1.5922425985336304, + "learning_rate": 7.910828025477708e-05, + "loss": 0.2133, + "step": 960 + }, + { + "epoch": 3.069620253164557, + "grad_norm": 1.863950252532959, + "learning_rate": 7.783439490445861e-05, + "loss": 0.2167, + "step": 970 + }, + { + "epoch": 3.1012658227848102, + "grad_norm": 1.3625264167785645, + "learning_rate": 7.656050955414013e-05, + "loss": 0.2169, + "step": 980 + }, + { + "epoch": 3.132911392405063, + "grad_norm": 1.5241615772247314, + "learning_rate": 7.528662420382167e-05, + "loss": 0.2297, + "step": 990 + }, + { + "epoch": 3.1645569620253164, + "grad_norm": 1.5062488317489624, + "learning_rate": 7.401273885350318e-05, + "loss": 0.2299, + "step": 1000 + }, + { + "epoch": 3.1962025316455698, + "grad_norm": 1.576797366142273, + "learning_rate": 7.273885350318471e-05, + "loss": 0.2315, + "step": 1010 + }, + { + "epoch": 3.2278481012658227, + "grad_norm": 1.5570958852767944, + "learning_rate": 7.146496815286625e-05, + "loss": 0.2351, + "step": 1020 + }, + { + "epoch": 3.259493670886076, + "grad_norm": 1.7670010328292847, + "learning_rate": 7.019108280254777e-05, + "loss": 0.2324, + "step": 1030 + }, + { + "epoch": 3.291139240506329, + "grad_norm": 1.346665382385254, + "learning_rate": 6.89171974522293e-05, + "loss": 0.2395, + "step": 1040 + }, + { + "epoch": 3.3227848101265822, + "grad_norm": 1.9827314615249634, + "learning_rate": 6.764331210191083e-05, + "loss": 0.2353, + "step": 1050 + }, + { + "epoch": 3.3544303797468356, + "grad_norm": 1.4799753427505493, + "learning_rate": 6.636942675159236e-05, + "loss": 0.2326, + "step": 1060 + }, + { + "epoch": 3.3860759493670884, + "grad_norm": 1.2080479860305786, + "learning_rate": 6.509554140127388e-05, + "loss": 0.2384, + "step": 1070 + }, + { + "epoch": 3.4177215189873418, + "grad_norm": 1.2935141324996948, + "learning_rate": 6.382165605095542e-05, + "loss": 0.2348, + "step": 1080 + }, + { + "epoch": 3.449367088607595, + "grad_norm": 1.9431143999099731, + "learning_rate": 6.254777070063695e-05, + "loss": 0.2404, + "step": 1090 + }, + { + "epoch": 3.481012658227848, + "grad_norm": 1.132179617881775, + "learning_rate": 6.127388535031847e-05, + "loss": 0.2417, + "step": 1100 + }, + { + "epoch": 3.5126582278481013, + "grad_norm": 1.3407566547393799, + "learning_rate": 6e-05, + "loss": 0.2338, + "step": 1110 + }, + { + "epoch": 3.5443037974683547, + "grad_norm": 1.1325492858886719, + "learning_rate": 5.8726114649681526e-05, + "loss": 0.2323, + "step": 1120 + }, + { + "epoch": 3.5759493670886076, + "grad_norm": 1.514183759689331, + "learning_rate": 5.745222929936306e-05, + "loss": 0.2398, + "step": 1130 + }, + { + "epoch": 3.607594936708861, + "grad_norm": 0.9589794278144836, + "learning_rate": 5.617834394904459e-05, + "loss": 0.2402, + "step": 1140 + }, + { + "epoch": 3.6392405063291138, + "grad_norm": 1.094794750213623, + "learning_rate": 5.4904458598726114e-05, + "loss": 0.2304, + "step": 1150 + }, + { + "epoch": 3.670886075949367, + "grad_norm": 1.4192887544631958, + "learning_rate": 5.3630573248407645e-05, + "loss": 0.2376, + "step": 1160 + }, + { + "epoch": 3.7025316455696204, + "grad_norm": 1.1269867420196533, + "learning_rate": 5.235668789808918e-05, + "loss": 0.2368, + "step": 1170 + }, + { + "epoch": 3.7341772151898733, + "grad_norm": 1.1314181089401245, + "learning_rate": 5.10828025477707e-05, + "loss": 0.2492, + "step": 1180 + }, + { + "epoch": 3.7658227848101267, + "grad_norm": 1.1598172187805176, + "learning_rate": 4.980891719745223e-05, + "loss": 0.2331, + "step": 1190 + }, + { + "epoch": 3.7974683544303796, + "grad_norm": 1.347269892692566, + "learning_rate": 4.853503184713376e-05, + "loss": 0.2343, + "step": 1200 + }, + { + "epoch": 3.829113924050633, + "grad_norm": 1.251792073249817, + "learning_rate": 4.726114649681529e-05, + "loss": 0.2425, + "step": 1210 + }, + { + "epoch": 3.8607594936708862, + "grad_norm": 1.0543699264526367, + "learning_rate": 4.598726114649682e-05, + "loss": 0.2347, + "step": 1220 + }, + { + "epoch": 3.892405063291139, + "grad_norm": 1.0103930234909058, + "learning_rate": 4.4713375796178346e-05, + "loss": 0.2341, + "step": 1230 + }, + { + "epoch": 3.9240506329113924, + "grad_norm": 1.5386909246444702, + "learning_rate": 4.343949044585988e-05, + "loss": 0.2337, + "step": 1240 + }, + { + "epoch": 3.9556962025316453, + "grad_norm": 1.2150837182998657, + "learning_rate": 4.21656050955414e-05, + "loss": 0.2372, + "step": 1250 + }, + { + "epoch": 3.9873417721518987, + "grad_norm": 0.9687594771385193, + "learning_rate": 4.089171974522293e-05, + "loss": 0.2281, + "step": 1260 + }, + { + "epoch": 4.018987341772152, + "grad_norm": 0.9844681024551392, + "learning_rate": 3.9617834394904465e-05, + "loss": 0.2126, + "step": 1270 + }, + { + "epoch": 4.050632911392405, + "grad_norm": 0.8446369171142578, + "learning_rate": 3.834394904458599e-05, + "loss": 0.1889, + "step": 1280 + }, + { + "epoch": 4.082278481012658, + "grad_norm": 1.152707815170288, + "learning_rate": 3.7070063694267514e-05, + "loss": 0.181, + "step": 1290 + }, + { + "epoch": 4.113924050632911, + "grad_norm": 0.7320122718811035, + "learning_rate": 3.5796178343949046e-05, + "loss": 0.1839, + "step": 1300 + }, + { + "epoch": 4.1455696202531644, + "grad_norm": 0.6252226829528809, + "learning_rate": 3.452229299363057e-05, + "loss": 0.1951, + "step": 1310 + }, + { + "epoch": 4.177215189873418, + "grad_norm": 0.6970034837722778, + "learning_rate": 3.32484076433121e-05, + "loss": 0.1914, + "step": 1320 + }, + { + "epoch": 4.208860759493671, + "grad_norm": 0.768865168094635, + "learning_rate": 3.197452229299363e-05, + "loss": 0.1804, + "step": 1330 + }, + { + "epoch": 4.2405063291139244, + "grad_norm": 0.6791852712631226, + "learning_rate": 3.070063694267516e-05, + "loss": 0.1857, + "step": 1340 + }, + { + "epoch": 4.272151898734177, + "grad_norm": 1.2060372829437256, + "learning_rate": 2.942675159235669e-05, + "loss": 0.1908, + "step": 1350 + }, + { + "epoch": 4.30379746835443, + "grad_norm": 0.9151805639266968, + "learning_rate": 2.8152866242038218e-05, + "loss": 0.1834, + "step": 1360 + }, + { + "epoch": 4.3354430379746836, + "grad_norm": 1.5451514720916748, + "learning_rate": 2.6878980891719746e-05, + "loss": 0.1899, + "step": 1370 + }, + { + "epoch": 4.367088607594937, + "grad_norm": 0.7110710144042969, + "learning_rate": 2.5605095541401274e-05, + "loss": 0.1871, + "step": 1380 + }, + { + "epoch": 4.39873417721519, + "grad_norm": 1.055672287940979, + "learning_rate": 2.4331210191082805e-05, + "loss": 0.1831, + "step": 1390 + }, + { + "epoch": 4.430379746835443, + "grad_norm": 1.0316555500030518, + "learning_rate": 2.3057324840764334e-05, + "loss": 0.2008, + "step": 1400 + }, + { + "epoch": 4.462025316455696, + "grad_norm": 1.0614982843399048, + "learning_rate": 2.178343949044586e-05, + "loss": 0.1919, + "step": 1410 + }, + { + "epoch": 4.493670886075949, + "grad_norm": 0.6679489612579346, + "learning_rate": 2.050955414012739e-05, + "loss": 0.1945, + "step": 1420 + }, + { + "epoch": 4.525316455696203, + "grad_norm": 0.7181932330131531, + "learning_rate": 1.9235668789808918e-05, + "loss": 0.1879, + "step": 1430 + }, + { + "epoch": 4.556962025316456, + "grad_norm": 1.0753055810928345, + "learning_rate": 1.7961783439490446e-05, + "loss": 0.1906, + "step": 1440 + }, + { + "epoch": 4.588607594936709, + "grad_norm": 0.5957285165786743, + "learning_rate": 1.6687898089171974e-05, + "loss": 0.1888, + "step": 1450 + }, + { + "epoch": 4.620253164556962, + "grad_norm": 0.6847863793373108, + "learning_rate": 1.5414012738853502e-05, + "loss": 0.1856, + "step": 1460 + }, + { + "epoch": 4.651898734177215, + "grad_norm": 1.2106820344924927, + "learning_rate": 1.4140127388535032e-05, + "loss": 0.1805, + "step": 1470 + }, + { + "epoch": 4.6835443037974684, + "grad_norm": 0.7890735268592834, + "learning_rate": 1.2866242038216562e-05, + "loss": 0.1869, + "step": 1480 + }, + { + "epoch": 4.715189873417722, + "grad_norm": 0.9127280712127686, + "learning_rate": 1.159235668789809e-05, + "loss": 0.1941, + "step": 1490 + }, + { + "epoch": 4.746835443037975, + "grad_norm": 0.6244585514068604, + "learning_rate": 1.031847133757962e-05, + "loss": 0.1931, + "step": 1500 + }, + { + "epoch": 4.7784810126582276, + "grad_norm": 1.7066004276275635, + "learning_rate": 9.044585987261146e-06, + "loss": 0.1857, + "step": 1510 + }, + { + "epoch": 4.810126582278481, + "grad_norm": 0.8739455342292786, + "learning_rate": 7.770700636942676e-06, + "loss": 0.1884, + "step": 1520 + }, + { + "epoch": 4.841772151898734, + "grad_norm": 0.7169327139854431, + "learning_rate": 6.496815286624204e-06, + "loss": 0.1793, + "step": 1530 + }, + { + "epoch": 4.8734177215189876, + "grad_norm": 0.7804775834083557, + "learning_rate": 5.222929936305733e-06, + "loss": 0.1912, + "step": 1540 + }, + { + "epoch": 4.905063291139241, + "grad_norm": 0.8794851303100586, + "learning_rate": 3.949044585987261e-06, + "loss": 0.1893, + "step": 1550 + }, + { + "epoch": 4.936708860759493, + "grad_norm": 0.9111006259918213, + "learning_rate": 2.67515923566879e-06, + "loss": 0.1883, + "step": 1560 + }, + { + "epoch": 4.968354430379747, + "grad_norm": 1.3351935148239136, + "learning_rate": 1.4012738853503185e-06, + "loss": 0.1967, + "step": 1570 + }, + { + "epoch": 5.0, + "grad_norm": 0.9245270490646362, + "learning_rate": 1.2738853503184713e-07, + "loss": 0.1912, + "step": 1580 + } + ], + "logging_steps": 10, + "max_steps": 1580, + "num_input_tokens_seen": 0, + "num_train_epochs": 5, + "save_steps": 500, + "stateful_callbacks": { + "TrainerControl": { + "args": { + "should_epoch_stop": false, + "should_evaluate": false, + "should_log": false, + "should_save": true, + "should_training_stop": true + }, + "attributes": {} + } + }, + "total_flos": 1.0182402966867149e+17, + "train_batch_size": 8, + "trial_name": null, + "trial_params": null +} diff --git a/experiments/Natural/checkpoint-1580/training_args.bin b/experiments/Natural/checkpoint-1580/training_args.bin new file mode 100644 index 0000000000000000000000000000000000000000..99f86c4b08bf7d822cc3dfc3af42fda12dd8131d --- /dev/null +++ b/experiments/Natural/checkpoint-1580/training_args.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05dd2bd1bfc0875dd1346331bc6ef556abef03f996a81a19556acac64e1f133a +size 6289 diff --git a/experiments/Natural/checkpoint-500/README.md b/experiments/Natural/checkpoint-500/README.md new file mode 100644 index 0000000000000000000000000000000000000000..6e1128c4737461313d01ab9fe9909a170568a6d0 --- /dev/null +++ b/experiments/Natural/checkpoint-500/README.md @@ -0,0 +1,210 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +library_name: peft +pipeline_tag: text-generation +tags: +- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +- lora +- sft +- transformers +- trl +- unsloth +--- + +# Model Card for Model ID + + + + + +## Model Details + +### Model Description + + + + + +- **Developed by:** [More Information Needed] +- **Funded by [optional]:** [More Information Needed] +- **Shared by [optional]:** [More Information Needed] +- **Model type:** [More Information Needed] +- **Language(s) (NLP):** [More Information Needed] +- **License:** [More Information Needed] +- **Finetuned from model [optional]:** [More Information Needed] + +### Model Sources [optional] + + + +- **Repository:** [More Information Needed] +- **Paper [optional]:** [More Information Needed] +- **Demo [optional]:** [More Information Needed] + +## Uses + + + +### Direct Use + + + +[More Information Needed] + +### Downstream Use [optional] + + + +[More Information Needed] + +### Out-of-Scope Use + + + +[More Information Needed] + +## Bias, Risks, and Limitations + + + +[More Information Needed] + +### Recommendations + + + +Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. + +## How to Get Started with the Model + +Use the code below to get started with the model. + +[More Information Needed] + +## Training Details + +### Training Data + + + +[More Information Needed] + +### Training Procedure + + + +#### Preprocessing [optional] + +[More Information Needed] + + +#### Training Hyperparameters + +- **Training regime:** [More Information Needed] + +#### Speeds, Sizes, Times [optional] + + + +[More Information Needed] + +## Evaluation + + + +### Testing Data, Factors & Metrics + +#### Testing Data + + + +[More Information Needed] + +#### Factors + + + +[More Information Needed] + +#### Metrics + + + +[More Information Needed] + +### Results + +[More Information Needed] + +#### Summary + + + +## Model Examination [optional] + + + +[More Information Needed] + +## Environmental Impact + + + +Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). + +- **Hardware Type:** [More Information Needed] +- **Hours used:** [More Information Needed] +- **Cloud Provider:** [More Information Needed] +- **Compute Region:** [More Information Needed] +- **Carbon Emitted:** [More Information Needed] + +## Technical Specifications [optional] + +### Model Architecture and Objective + +[More Information Needed] + +### Compute Infrastructure + +[More Information Needed] + +#### Hardware + +[More Information Needed] + +#### Software + +[More Information Needed] + +## Citation [optional] + + + +**BibTeX:** + +[More Information Needed] + +**APA:** + +[More Information Needed] + +## Glossary [optional] + + + +[More Information Needed] + +## More Information [optional] + +[More Information Needed] + +## Model Card Authors [optional] + +[More Information Needed] + +## Model Card Contact + +[More Information Needed] +### Framework versions + +- PEFT 0.18.1 \ No newline at end of file diff --git a/experiments/Natural/checkpoint-500/adapter_config.json b/experiments/Natural/checkpoint-500/adapter_config.json new file mode 100644 index 0000000000000000000000000000000000000000..7c2e352b20dfcbcac0e45c46b2bd6a1fddd7caf6 --- /dev/null +++ b/experiments/Natural/checkpoint-500/adapter_config.json @@ -0,0 +1,50 @@ +{ + "alora_invocation_tokens": null, + "alpha_pattern": {}, + "arrow_config": null, + "auto_mapping": { + "base_model_class": "LlamaForCausalLM", + "parent_library": "transformers.models.llama.modeling_llama", + "unsloth_fixed": true + }, + "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit", + "bias": "none", + "corda_config": null, + "ensure_weight_tying": false, + "eva_config": null, + "exclude_modules": null, + "fan_in_fan_out": false, + "inference_mode": true, + "init_lora_weights": true, + "layer_replication": null, + "layers_pattern": null, + "layers_to_transform": null, + "loftq_config": {}, + "lora_alpha": 32, + "lora_bias": false, + "lora_dropout": 0, + "megatron_config": null, + "megatron_core": "megatron.core", + "modules_to_save": null, + "peft_type": "LORA", + "peft_version": "0.18.1", + "qalora_group_size": 16, + "r": 16, + "rank_pattern": {}, + "revision": null, + "target_modules": [ + "gate_proj", + "v_proj", + "o_proj", + "k_proj", + "up_proj", + "down_proj", + "q_proj" + ], + "target_parameters": null, + "task_type": "CAUSAL_LM", + "trainable_token_indices": null, + "use_dora": false, + "use_qalora": false, + "use_rslora": true +} \ No newline at end of file diff --git a/experiments/Natural/checkpoint-500/adapter_model.safetensors b/experiments/Natural/checkpoint-500/adapter_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..581d646cff28a37358fb5d2bf3795ed8bb8de197 --- /dev/null +++ b/experiments/Natural/checkpoint-500/adapter_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c8e7c0df1445cef401fb37206256df291405d9a7e3d152620a2e0c967070bf46 +size 167832240 diff --git a/experiments/Natural/checkpoint-500/chat_template.jinja b/experiments/Natural/checkpoint-500/chat_template.jinja new file mode 100644 index 0000000000000000000000000000000000000000..33089ace1be88f22a10fe861ad49718d5d886090 --- /dev/null +++ b/experiments/Natural/checkpoint-500/chat_template.jinja @@ -0,0 +1,109 @@ +{{- bos_token }} +{%- if custom_tools is defined %} + {%- set tools = custom_tools %} +{%- endif %} +{%- if not tools_in_user_message is defined %} + {%- set tools_in_user_message = true %} +{%- endif %} +{%- if not date_string is defined %} + {%- set date_string = "26 Jul 2024" %} +{%- endif %} +{%- if not tools is defined %} + {%- set tools = none %} +{%- endif %} + +{#- This block extracts the system message, so we can slot it into the right place. #} +{%- if messages[0]['role'] == 'system' %} + {%- set system_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} +{%- else %} + {%- set system_message = "" %} +{%- endif %} + +{#- System message + builtin tools #} +{{- "<|start_header_id|>system<|end_header_id|>\n\n" }} +{%- if builtin_tools is defined or tools is not none %} + {{- "Environment: ipython\n" }} +{%- endif %} +{%- if builtin_tools is defined %} + {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}} +{%- endif %} +{{- "Cutting Knowledge Date: December 2023\n" }} +{{- "Today Date: " + date_string + "\n\n" }} +{%- if tools is not none and not tools_in_user_message %} + {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} +{%- endif %} +{{- system_message }} +{{- "<|eot_id|>" }} + +{#- Custom tools are passed in a user message with some extra guidance #} +{%- if tools_in_user_message and not tools is none %} + {#- Extract the first user message so we can plug it in here #} + {%- if messages | length != 0 %} + {%- set first_user_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} + {%- else %} + {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }} +{%- endif %} + {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}} + {{- "Given the following functions, please respond with a JSON for a function call " }} + {{- "with its proper arguments that best answers the given prompt.\n\n" }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} + {{- first_user_message + "<|eot_id|>"}} +{%- endif %} + +{%- for message in messages %} + {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %} + {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }} + {%- elif 'tool_calls' in message %} + {%- if not message.tool_calls|length == 1 %} + {{- raise_exception("This model only supports single tool-calls at once!") }} + {%- endif %} + {%- set tool_call = message.tool_calls[0].function %} + {%- if builtin_tools is defined and tool_call.name in builtin_tools %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- "<|python_tag|>" + tool_call.name + ".call(" }} + {%- for arg_name, arg_val in tool_call.arguments | items %} + {{- arg_name + '="' + arg_val + '"' }} + {%- if not loop.last %} + {{- ", " }} + {%- endif %} + {%- endfor %} + {{- ")" }} + {%- else %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- '{"name": "' + tool_call.name + '", ' }} + {{- '"parameters": ' }} + {{- tool_call.arguments | tojson }} + {{- "}" }} + {%- endif %} + {%- if builtin_tools is defined %} + {#- This means we're in ipython mode #} + {{- "<|eom_id|>" }} + {%- else %} + {{- "<|eot_id|>" }} + {%- endif %} + {%- elif message.role == "tool" or message.role == "ipython" %} + {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }} + {%- if message.content is mapping or message.content is iterable %} + {{- message.content | tojson }} + {%- else %} + {{- message.content }} + {%- endif %} + {{- "<|eot_id|>" }} + {%- endif %} +{%- endfor %} +{%- if add_generation_prompt %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }} +{%- endif %} diff --git a/experiments/Natural/checkpoint-500/optimizer.pt b/experiments/Natural/checkpoint-500/optimizer.pt new file mode 100644 index 0000000000000000000000000000000000000000..7473487141119b6d3722f44840e95ec041d69812 --- /dev/null +++ b/experiments/Natural/checkpoint-500/optimizer.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7564892702d27cd3d005ca1ad15fa9974e5a345dd87e706301cbce9b24d5f4ff +size 85724133 diff --git a/experiments/Natural/checkpoint-500/rng_state.pth b/experiments/Natural/checkpoint-500/rng_state.pth new file mode 100644 index 0000000000000000000000000000000000000000..a18368651274f7c0847c1b9873fe8c9f4ac945ba --- /dev/null +++ b/experiments/Natural/checkpoint-500/rng_state.pth @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7c800b778fa7e115e4c34de8529902de8b61c9a1b4bab3eb8295d06dafff030e +size 14645 diff --git a/experiments/Natural/checkpoint-500/scheduler.pt b/experiments/Natural/checkpoint-500/scheduler.pt new file mode 100644 index 0000000000000000000000000000000000000000..55f476b823bd6cef425d6407c801f36770b38b3e --- /dev/null +++ b/experiments/Natural/checkpoint-500/scheduler.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6e751455d2c61182da53a15edf0f9cb0df249f9544bca91c504ee410daefb62 +size 1465 diff --git a/experiments/Natural/checkpoint-500/special_tokens_map.json b/experiments/Natural/checkpoint-500/special_tokens_map.json new file mode 100644 index 0000000000000000000000000000000000000000..3c1d04911c269b925af977a3151c9704e990e4d0 --- /dev/null +++ b/experiments/Natural/checkpoint-500/special_tokens_map.json @@ -0,0 +1,23 @@ +{ + "bos_token": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "eos_token": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "pad_token": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + } +} diff --git a/experiments/Natural/checkpoint-500/tokenizer.json b/experiments/Natural/checkpoint-500/tokenizer.json new file mode 100644 index 0000000000000000000000000000000000000000..1c1d8d5c9024994f1d3b00f9662b8dd89ca13cf2 --- /dev/null +++ b/experiments/Natural/checkpoint-500/tokenizer.json @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b +size 17209920 diff --git a/experiments/Natural/checkpoint-500/tokenizer_config.json b/experiments/Natural/checkpoint-500/tokenizer_config.json new file mode 100644 index 0000000000000000000000000000000000000000..69b6ed0e11b81375bae750eb8ec4a7e1146eeca3 --- /dev/null +++ b/experiments/Natural/checkpoint-500/tokenizer_config.json @@ -0,0 +1,2066 @@ +{ + "add_bos_token": true, + "added_tokens_decoder": { + "128000": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128001": { + "content": "<|end_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128002": { + "content": "<|reserved_special_token_0|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128003": { + "content": "<|reserved_special_token_1|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128004": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128005": { + "content": "<|reserved_special_token_2|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128006": { + "content": "<|start_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128007": { + "content": "<|end_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128008": { + "content": "<|eom_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128009": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128010": { + "content": "<|python_tag|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128011": { + "content": "<|reserved_special_token_3|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128012": { + "content": "<|reserved_special_token_4|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128013": { + "content": "<|reserved_special_token_5|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128014": { + "content": "<|reserved_special_token_6|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128015": { + "content": "<|reserved_special_token_7|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128016": { + "content": "<|reserved_special_token_8|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128017": { + "content": "<|reserved_special_token_9|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128018": { + "content": "<|reserved_special_token_10|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128019": { + "content": "<|reserved_special_token_11|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128020": { + "content": "<|reserved_special_token_12|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128021": { + "content": "<|reserved_special_token_13|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128022": { + "content": "<|reserved_special_token_14|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128023": { + "content": "<|reserved_special_token_15|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128024": { + "content": "<|reserved_special_token_16|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128025": { + "content": "<|reserved_special_token_17|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128026": { + "content": "<|reserved_special_token_18|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128027": { + "content": "<|reserved_special_token_19|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128028": { + "content": "<|reserved_special_token_20|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128029": { + "content": "<|reserved_special_token_21|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128030": { + "content": "<|reserved_special_token_22|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128031": { + "content": "<|reserved_special_token_23|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128032": { + "content": "<|reserved_special_token_24|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128033": { + "content": "<|reserved_special_token_25|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128034": { + "content": "<|reserved_special_token_26|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128035": { + "content": "<|reserved_special_token_27|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128036": { + "content": "<|reserved_special_token_28|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128037": { + "content": "<|reserved_special_token_29|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128038": { + "content": "<|reserved_special_token_30|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128039": { + "content": "<|reserved_special_token_31|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128040": { + "content": "<|reserved_special_token_32|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128041": { + "content": "<|reserved_special_token_33|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128042": { + "content": "<|reserved_special_token_34|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128043": { + "content": "<|reserved_special_token_35|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128044": { + "content": "<|reserved_special_token_36|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128045": { + "content": "<|reserved_special_token_37|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128046": { + "content": "<|reserved_special_token_38|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128047": { + "content": "<|reserved_special_token_39|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128048": { + "content": "<|reserved_special_token_40|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128049": { + "content": "<|reserved_special_token_41|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128050": { + "content": "<|reserved_special_token_42|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128051": { + "content": "<|reserved_special_token_43|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128052": { + "content": "<|reserved_special_token_44|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128053": { + "content": "<|reserved_special_token_45|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128054": { + "content": "<|reserved_special_token_46|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128055": { + "content": "<|reserved_special_token_47|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128056": { + "content": "<|reserved_special_token_48|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128057": { + "content": "<|reserved_special_token_49|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128058": { + "content": "<|reserved_special_token_50|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128059": { + "content": "<|reserved_special_token_51|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128060": { + "content": "<|reserved_special_token_52|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128061": { + "content": "<|reserved_special_token_53|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128062": { + "content": "<|reserved_special_token_54|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128063": { + "content": "<|reserved_special_token_55|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128064": { + "content": "<|reserved_special_token_56|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128065": { + "content": "<|reserved_special_token_57|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128066": { + "content": "<|reserved_special_token_58|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128067": { + "content": "<|reserved_special_token_59|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128068": { + "content": "<|reserved_special_token_60|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128069": { + "content": "<|reserved_special_token_61|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128070": { + "content": "<|reserved_special_token_62|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128071": { + "content": "<|reserved_special_token_63|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128072": { + "content": "<|reserved_special_token_64|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128073": { + "content": "<|reserved_special_token_65|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128074": { + "content": "<|reserved_special_token_66|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128075": { + "content": "<|reserved_special_token_67|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128076": { + "content": "<|reserved_special_token_68|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128077": { + "content": "<|reserved_special_token_69|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128078": { + "content": "<|reserved_special_token_70|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128079": { + "content": "<|reserved_special_token_71|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128080": { + "content": "<|reserved_special_token_72|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128081": { + "content": "<|reserved_special_token_73|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128082": { + "content": "<|reserved_special_token_74|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128083": { + "content": "<|reserved_special_token_75|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128084": { + "content": "<|reserved_special_token_76|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128085": { + "content": "<|reserved_special_token_77|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128086": { + "content": "<|reserved_special_token_78|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128087": { + "content": "<|reserved_special_token_79|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128088": { + "content": "<|reserved_special_token_80|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128089": { + "content": "<|reserved_special_token_81|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128090": { + "content": "<|reserved_special_token_82|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128091": { + "content": "<|reserved_special_token_83|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128092": { + "content": "<|reserved_special_token_84|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128093": { + "content": "<|reserved_special_token_85|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128094": { + "content": "<|reserved_special_token_86|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128095": { + "content": "<|reserved_special_token_87|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128096": { + "content": "<|reserved_special_token_88|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128097": { + "content": "<|reserved_special_token_89|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128098": { + "content": "<|reserved_special_token_90|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128099": { + "content": "<|reserved_special_token_91|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128100": { + "content": "<|reserved_special_token_92|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128101": { + "content": "<|reserved_special_token_93|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128102": { + "content": "<|reserved_special_token_94|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128103": { + "content": "<|reserved_special_token_95|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128104": { + "content": "<|reserved_special_token_96|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128105": { + "content": "<|reserved_special_token_97|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128106": { + "content": "<|reserved_special_token_98|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128107": { + "content": "<|reserved_special_token_99|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128108": { + "content": "<|reserved_special_token_100|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128109": { + "content": "<|reserved_special_token_101|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128110": { + "content": "<|reserved_special_token_102|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128111": { + "content": "<|reserved_special_token_103|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128112": { + "content": "<|reserved_special_token_104|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128113": { + "content": "<|reserved_special_token_105|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128114": { + "content": "<|reserved_special_token_106|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128115": { + "content": "<|reserved_special_token_107|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128116": { + "content": "<|reserved_special_token_108|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128117": { + "content": "<|reserved_special_token_109|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128118": { + "content": "<|reserved_special_token_110|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128119": { + "content": "<|reserved_special_token_111|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128120": { + "content": "<|reserved_special_token_112|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128121": { + "content": "<|reserved_special_token_113|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128122": { + "content": "<|reserved_special_token_114|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128123": { + "content": "<|reserved_special_token_115|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128124": { + "content": "<|reserved_special_token_116|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128125": { + "content": "<|reserved_special_token_117|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128126": { + "content": "<|reserved_special_token_118|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128127": { + "content": "<|reserved_special_token_119|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128128": { + "content": "<|reserved_special_token_120|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128129": { + "content": "<|reserved_special_token_121|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128130": { + "content": "<|reserved_special_token_122|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128131": { + "content": "<|reserved_special_token_123|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128132": { + "content": "<|reserved_special_token_124|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128133": { + "content": "<|reserved_special_token_125|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128134": { + "content": "<|reserved_special_token_126|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128135": { + "content": "<|reserved_special_token_127|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128136": { + "content": "<|reserved_special_token_128|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128137": { + "content": "<|reserved_special_token_129|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128138": { + "content": "<|reserved_special_token_130|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128139": { + "content": "<|reserved_special_token_131|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128140": { + "content": "<|reserved_special_token_132|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128141": { + "content": "<|reserved_special_token_133|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128142": { + "content": "<|reserved_special_token_134|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128143": { + "content": "<|reserved_special_token_135|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128144": { + "content": "<|reserved_special_token_136|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128145": { + "content": "<|reserved_special_token_137|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128146": { + "content": "<|reserved_special_token_138|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128147": { + "content": "<|reserved_special_token_139|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128148": { + "content": "<|reserved_special_token_140|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128149": { + "content": "<|reserved_special_token_141|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128150": { + "content": "<|reserved_special_token_142|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128151": { + "content": "<|reserved_special_token_143|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128152": { + "content": "<|reserved_special_token_144|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128153": { + "content": "<|reserved_special_token_145|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128154": { + "content": "<|reserved_special_token_146|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128155": { + "content": "<|reserved_special_token_147|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128156": { + "content": "<|reserved_special_token_148|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128157": { + "content": "<|reserved_special_token_149|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128158": { + "content": "<|reserved_special_token_150|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128159": { + "content": "<|reserved_special_token_151|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128160": { + "content": "<|reserved_special_token_152|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128161": { + "content": "<|reserved_special_token_153|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128162": { + "content": "<|reserved_special_token_154|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128163": { + "content": "<|reserved_special_token_155|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128164": { + "content": "<|reserved_special_token_156|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128165": { + "content": "<|reserved_special_token_157|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128166": { + "content": "<|reserved_special_token_158|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128167": { + "content": "<|reserved_special_token_159|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128168": { + "content": "<|reserved_special_token_160|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128169": { + "content": "<|reserved_special_token_161|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128170": { + "content": "<|reserved_special_token_162|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128171": { + "content": "<|reserved_special_token_163|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128172": { + "content": "<|reserved_special_token_164|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128173": { + "content": "<|reserved_special_token_165|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128174": { + "content": "<|reserved_special_token_166|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128175": { + "content": "<|reserved_special_token_167|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128176": { + "content": "<|reserved_special_token_168|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128177": { + "content": "<|reserved_special_token_169|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128178": { + "content": "<|reserved_special_token_170|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128179": { + "content": "<|reserved_special_token_171|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128180": { + "content": "<|reserved_special_token_172|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128181": { + "content": "<|reserved_special_token_173|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128182": { + "content": "<|reserved_special_token_174|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128183": { + "content": "<|reserved_special_token_175|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128184": { + "content": "<|reserved_special_token_176|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128185": { + "content": "<|reserved_special_token_177|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128186": { + "content": "<|reserved_special_token_178|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128187": { + "content": "<|reserved_special_token_179|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128188": { + "content": "<|reserved_special_token_180|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128189": { + "content": "<|reserved_special_token_181|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128190": { + "content": "<|reserved_special_token_182|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128191": { + "content": "<|reserved_special_token_183|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128192": { + "content": "<|reserved_special_token_184|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128193": { + "content": "<|reserved_special_token_185|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128194": { + "content": "<|reserved_special_token_186|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128195": { + "content": "<|reserved_special_token_187|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128196": { + "content": "<|reserved_special_token_188|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128197": { + "content": "<|reserved_special_token_189|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128198": { + "content": "<|reserved_special_token_190|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128199": { + "content": "<|reserved_special_token_191|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128200": { + "content": "<|reserved_special_token_192|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128201": { + "content": "<|reserved_special_token_193|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128202": { + "content": "<|reserved_special_token_194|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128203": { + "content": "<|reserved_special_token_195|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128204": { + "content": "<|reserved_special_token_196|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128205": { + "content": "<|reserved_special_token_197|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128206": { + "content": "<|reserved_special_token_198|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128207": { + "content": "<|reserved_special_token_199|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128208": { + "content": "<|reserved_special_token_200|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128209": { + "content": "<|reserved_special_token_201|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128210": { + "content": "<|reserved_special_token_202|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128211": { + "content": "<|reserved_special_token_203|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128212": { + "content": "<|reserved_special_token_204|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128213": { + "content": "<|reserved_special_token_205|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128214": { + "content": "<|reserved_special_token_206|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128215": { + "content": "<|reserved_special_token_207|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128216": { + "content": "<|reserved_special_token_208|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128217": { + "content": "<|reserved_special_token_209|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128218": { + "content": "<|reserved_special_token_210|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128219": { + "content": "<|reserved_special_token_211|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128220": { + "content": "<|reserved_special_token_212|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128221": { + "content": "<|reserved_special_token_213|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128222": { + "content": "<|reserved_special_token_214|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128223": { + "content": "<|reserved_special_token_215|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128224": { + "content": "<|reserved_special_token_216|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128225": { + "content": "<|reserved_special_token_217|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128226": { + "content": "<|reserved_special_token_218|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128227": { + "content": "<|reserved_special_token_219|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128228": { + "content": "<|reserved_special_token_220|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128229": { + "content": "<|reserved_special_token_221|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128230": { + "content": "<|reserved_special_token_222|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128231": { + "content": "<|reserved_special_token_223|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128232": { + "content": "<|reserved_special_token_224|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128233": { + "content": "<|reserved_special_token_225|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128234": { + "content": "<|reserved_special_token_226|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128235": { + "content": "<|reserved_special_token_227|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128236": { + "content": "<|reserved_special_token_228|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128237": { + "content": "<|reserved_special_token_229|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128238": { + "content": "<|reserved_special_token_230|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128239": { + "content": "<|reserved_special_token_231|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128240": { + "content": "<|reserved_special_token_232|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128241": { + "content": "<|reserved_special_token_233|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128242": { + "content": "<|reserved_special_token_234|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128243": { + "content": "<|reserved_special_token_235|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128244": { + "content": "<|reserved_special_token_236|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128245": { + "content": "<|reserved_special_token_237|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128246": { + "content": "<|reserved_special_token_238|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128247": { + "content": "<|reserved_special_token_239|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128248": { + "content": "<|reserved_special_token_240|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128249": { + "content": "<|reserved_special_token_241|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128250": { + "content": "<|reserved_special_token_242|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128251": { + "content": "<|reserved_special_token_243|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128252": { + "content": "<|reserved_special_token_244|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128253": { + "content": "<|reserved_special_token_245|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128254": { + "content": "<|reserved_special_token_246|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128255": { + "content": "<|reserved_special_token_247|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + } + }, + "bos_token": "<|begin_of_text|>", + "clean_up_tokenization_spaces": true, + "eos_token": "<|eot_id|>", + "extra_special_tokens": {}, + "model_input_names": [ + "input_ids", + "attention_mask" + ], + "model_max_length": 131072, + "pad_token": "<|finetune_right_pad_id|>", + "padding_side": "right", + "tokenizer_class": "PreTrainedTokenizerFast", + "unk_token": null +} diff --git a/experiments/Natural/checkpoint-500/trainer_state.json b/experiments/Natural/checkpoint-500/trainer_state.json new file mode 100644 index 0000000000000000000000000000000000000000..5d047aa2db830ab62592ee114ad091b89ea17000 --- /dev/null +++ b/experiments/Natural/checkpoint-500/trainer_state.json @@ -0,0 +1,384 @@ +{ + "best_global_step": null, + "best_metric": null, + "best_model_checkpoint": null, + "epoch": 1.5822784810126582, + "eval_steps": 500, + "global_step": 500, + "is_hyper_param_search": false, + "is_local_process_zero": true, + "is_world_process_zero": true, + "log_history": [ + { + "epoch": 0.03164556962025317, + "grad_norm": 5.501315116882324, + "learning_rate": 0.00018, + "loss": 2.5563, + "step": 10 + }, + { + "epoch": 0.06329113924050633, + "grad_norm": 160.5225067138672, + "learning_rate": 0.00019885350318471338, + "loss": 1.5451, + "step": 20 + }, + { + "epoch": 0.0949367088607595, + "grad_norm": 10.833513259887695, + "learning_rate": 0.00019757961783439492, + "loss": 1.8865, + "step": 30 + }, + { + "epoch": 0.12658227848101267, + "grad_norm": 16.25729751586914, + "learning_rate": 0.00019630573248407643, + "loss": 1.3788, + "step": 40 + }, + { + "epoch": 0.15822784810126583, + "grad_norm": 3.233597755432129, + "learning_rate": 0.00019503184713375797, + "loss": 1.1314, + "step": 50 + }, + { + "epoch": 0.189873417721519, + "grad_norm": 3.3475453853607178, + "learning_rate": 0.0001937579617834395, + "loss": 1.0585, + "step": 60 + }, + { + "epoch": 0.22151898734177214, + "grad_norm": 2.3403992652893066, + "learning_rate": 0.00019248407643312102, + "loss": 1.0554, + "step": 70 + }, + { + "epoch": 0.25316455696202533, + "grad_norm": 2.324516534805298, + "learning_rate": 0.00019121019108280256, + "loss": 1.0274, + "step": 80 + }, + { + "epoch": 0.2848101265822785, + "grad_norm": 2.125304937362671, + "learning_rate": 0.0001899363057324841, + "loss": 1.0045, + "step": 90 + }, + { + "epoch": 0.31645569620253167, + "grad_norm": 2.1273205280303955, + "learning_rate": 0.0001886624203821656, + "loss": 0.9993, + "step": 100 + }, + { + "epoch": 0.34810126582278483, + "grad_norm": 2.5348403453826904, + "learning_rate": 0.00018738853503184714, + "loss": 1.0386, + "step": 110 + }, + { + "epoch": 0.379746835443038, + "grad_norm": 2.660738468170166, + "learning_rate": 0.00018611464968152868, + "loss": 0.992, + "step": 120 + }, + { + "epoch": 0.41139240506329117, + "grad_norm": 2.187695026397705, + "learning_rate": 0.0001848407643312102, + "loss": 1.0174, + "step": 130 + }, + { + "epoch": 0.4430379746835443, + "grad_norm": 2.0130527019500732, + "learning_rate": 0.00018356687898089173, + "loss": 1.0349, + "step": 140 + }, + { + "epoch": 0.47468354430379744, + "grad_norm": 2.2986974716186523, + "learning_rate": 0.00018229299363057327, + "loss": 1.0426, + "step": 150 + }, + { + "epoch": 0.5063291139240507, + "grad_norm": 2.0907416343688965, + "learning_rate": 0.00018101910828025478, + "loss": 0.9566, + "step": 160 + }, + { + "epoch": 0.5379746835443038, + "grad_norm": 2.263169765472412, + "learning_rate": 0.00017974522292993632, + "loss": 0.9728, + "step": 170 + }, + { + "epoch": 0.569620253164557, + "grad_norm": 1.950455665588379, + "learning_rate": 0.00017847133757961786, + "loss": 0.9681, + "step": 180 + }, + { + "epoch": 0.6012658227848101, + "grad_norm": 1.991625189781189, + "learning_rate": 0.00017719745222929937, + "loss": 0.9877, + "step": 190 + }, + { + "epoch": 0.6329113924050633, + "grad_norm": 2.5864851474761963, + "learning_rate": 0.0001759235668789809, + "loss": 0.9536, + "step": 200 + }, + { + "epoch": 0.6645569620253164, + "grad_norm": 1.9064277410507202, + "learning_rate": 0.00017464968152866244, + "loss": 0.9546, + "step": 210 + }, + { + "epoch": 0.6962025316455697, + "grad_norm": 2.235928773880005, + "learning_rate": 0.00017337579617834396, + "loss": 0.9241, + "step": 220 + }, + { + "epoch": 0.7278481012658228, + "grad_norm": 1.9112043380737305, + "learning_rate": 0.0001721019108280255, + "loss": 0.966, + "step": 230 + }, + { + "epoch": 0.759493670886076, + "grad_norm": 2.6696879863739014, + "learning_rate": 0.00017082802547770703, + "loss": 0.8924, + "step": 240 + }, + { + "epoch": 0.7911392405063291, + "grad_norm": 2.395738124847412, + "learning_rate": 0.00016955414012738854, + "loss": 0.9879, + "step": 250 + }, + { + "epoch": 0.8227848101265823, + "grad_norm": 2.1325836181640625, + "learning_rate": 0.00016828025477707008, + "loss": 0.9125, + "step": 260 + }, + { + "epoch": 0.8544303797468354, + "grad_norm": 3.023322582244873, + "learning_rate": 0.00016700636942675162, + "loss": 0.9578, + "step": 270 + }, + { + "epoch": 0.8860759493670886, + "grad_norm": 2.16930890083313, + "learning_rate": 0.00016573248407643313, + "loss": 0.9655, + "step": 280 + }, + { + "epoch": 0.9177215189873418, + "grad_norm": 2.751526355743408, + "learning_rate": 0.00016445859872611467, + "loss": 0.8529, + "step": 290 + }, + { + "epoch": 0.9493670886075949, + "grad_norm": 2.2014594078063965, + "learning_rate": 0.00016318471337579618, + "loss": 0.8895, + "step": 300 + }, + { + "epoch": 0.9810126582278481, + "grad_norm": 2.498781681060791, + "learning_rate": 0.00016191082802547772, + "loss": 0.9022, + "step": 310 + }, + { + "epoch": 1.0126582278481013, + "grad_norm": 1.6269073486328125, + "learning_rate": 0.00016063694267515926, + "loss": 0.7462, + "step": 320 + }, + { + "epoch": 1.0443037974683544, + "grad_norm": 2.417710304260254, + "learning_rate": 0.00015936305732484077, + "loss": 0.6435, + "step": 330 + }, + { + "epoch": 1.0759493670886076, + "grad_norm": 2.120162010192871, + "learning_rate": 0.0001580891719745223, + "loss": 0.6222, + "step": 340 + }, + { + "epoch": 1.1075949367088607, + "grad_norm": 1.8784149885177612, + "learning_rate": 0.00015681528662420385, + "loss": 0.6014, + "step": 350 + }, + { + "epoch": 1.139240506329114, + "grad_norm": 1.9097055196762085, + "learning_rate": 0.00015554140127388536, + "loss": 0.618, + "step": 360 + }, + { + "epoch": 1.1708860759493671, + "grad_norm": 3.8499958515167236, + "learning_rate": 0.0001542675159235669, + "loss": 0.6094, + "step": 370 + }, + { + "epoch": 1.2025316455696202, + "grad_norm": 2.857755184173584, + "learning_rate": 0.00015299363057324843, + "loss": 0.644, + "step": 380 + }, + { + "epoch": 1.2341772151898733, + "grad_norm": 1.798422932624817, + "learning_rate": 0.00015171974522292994, + "loss": 0.6059, + "step": 390 + }, + { + "epoch": 1.2658227848101267, + "grad_norm": 2.251343011856079, + "learning_rate": 0.00015044585987261148, + "loss": 0.6059, + "step": 400 + }, + { + "epoch": 1.2974683544303798, + "grad_norm": 1.714311122894287, + "learning_rate": 0.000149171974522293, + "loss": 0.6263, + "step": 410 + }, + { + "epoch": 1.3291139240506329, + "grad_norm": 2.1517114639282227, + "learning_rate": 0.00014789808917197453, + "loss": 0.6018, + "step": 420 + }, + { + "epoch": 1.360759493670886, + "grad_norm": 2.019310235977173, + "learning_rate": 0.00014662420382165604, + "loss": 0.6241, + "step": 430 + }, + { + "epoch": 1.3924050632911391, + "grad_norm": 3.1832761764526367, + "learning_rate": 0.00014535031847133758, + "loss": 0.6105, + "step": 440 + }, + { + "epoch": 1.4240506329113924, + "grad_norm": 2.199019432067871, + "learning_rate": 0.0001440764331210191, + "loss": 0.6367, + "step": 450 + }, + { + "epoch": 1.4556962025316456, + "grad_norm": 2.4912033081054688, + "learning_rate": 0.00014280254777070063, + "loss": 0.6339, + "step": 460 + }, + { + "epoch": 1.4873417721518987, + "grad_norm": 2.6481103897094727, + "learning_rate": 0.00014152866242038217, + "loss": 0.6062, + "step": 470 + }, + { + "epoch": 1.518987341772152, + "grad_norm": 2.133782386779785, + "learning_rate": 0.00014025477707006368, + "loss": 0.6095, + "step": 480 + }, + { + "epoch": 1.5506329113924051, + "grad_norm": 2.9077465534210205, + "learning_rate": 0.00013898089171974522, + "loss": 0.5843, + "step": 490 + }, + { + "epoch": 1.5822784810126582, + "grad_norm": 2.5229060649871826, + "learning_rate": 0.00013770700636942676, + "loss": 0.6227, + "step": 500 + } + ], + "logging_steps": 10, + "max_steps": 1580, + "num_input_tokens_seen": 0, + "num_train_epochs": 5, + "save_steps": 500, + "stateful_callbacks": { + "TrainerControl": { + "args": { + "should_epoch_stop": false, + "should_evaluate": false, + "should_log": false, + "should_save": true, + "should_training_stop": false + }, + "attributes": {} + } + }, + "total_flos": 3.211886523285504e+16, + "train_batch_size": 8, + "trial_name": null, + "trial_params": null +} diff --git a/experiments/Natural/checkpoint-500/training_args.bin b/experiments/Natural/checkpoint-500/training_args.bin new file mode 100644 index 0000000000000000000000000000000000000000..99f86c4b08bf7d822cc3dfc3af42fda12dd8131d --- /dev/null +++ b/experiments/Natural/checkpoint-500/training_args.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05dd2bd1bfc0875dd1346331bc6ef556abef03f996a81a19556acac64e1f133a +size 6289 diff --git a/experiments/Natural/checkpoint-948/README.md b/experiments/Natural/checkpoint-948/README.md new file mode 100644 index 0000000000000000000000000000000000000000..6e1128c4737461313d01ab9fe9909a170568a6d0 --- /dev/null +++ b/experiments/Natural/checkpoint-948/README.md @@ -0,0 +1,210 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +library_name: peft +pipeline_tag: text-generation +tags: +- base_model:adapter:unsloth/meta-llama-3.1-8b-instruct-bnb-4bit +- lora +- sft +- transformers +- trl +- unsloth +--- + +# Model Card for Model ID + + + + + +## Model Details + +### Model Description + + + + + +- **Developed by:** [More Information Needed] +- **Funded by [optional]:** [More Information Needed] +- **Shared by [optional]:** [More Information Needed] +- **Model type:** [More Information Needed] +- **Language(s) (NLP):** [More Information Needed] +- **License:** [More Information Needed] +- **Finetuned from model [optional]:** [More Information Needed] + +### Model Sources [optional] + + + +- **Repository:** [More Information Needed] +- **Paper [optional]:** [More Information Needed] +- **Demo [optional]:** [More Information Needed] + +## Uses + + + +### Direct Use + + + +[More Information Needed] + +### Downstream Use [optional] + + + +[More Information Needed] + +### Out-of-Scope Use + + + +[More Information Needed] + +## Bias, Risks, and Limitations + + + +[More Information Needed] + +### Recommendations + + + +Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. + +## How to Get Started with the Model + +Use the code below to get started with the model. + +[More Information Needed] + +## Training Details + +### Training Data + + + +[More Information Needed] + +### Training Procedure + + + +#### Preprocessing [optional] + +[More Information Needed] + + +#### Training Hyperparameters + +- **Training regime:** [More Information Needed] + +#### Speeds, Sizes, Times [optional] + + + +[More Information Needed] + +## Evaluation + + + +### Testing Data, Factors & Metrics + +#### Testing Data + + + +[More Information Needed] + +#### Factors + + + +[More Information Needed] + +#### Metrics + + + +[More Information Needed] + +### Results + +[More Information Needed] + +#### Summary + + + +## Model Examination [optional] + + + +[More Information Needed] + +## Environmental Impact + + + +Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). + +- **Hardware Type:** [More Information Needed] +- **Hours used:** [More Information Needed] +- **Cloud Provider:** [More Information Needed] +- **Compute Region:** [More Information Needed] +- **Carbon Emitted:** [More Information Needed] + +## Technical Specifications [optional] + +### Model Architecture and Objective + +[More Information Needed] + +### Compute Infrastructure + +[More Information Needed] + +#### Hardware + +[More Information Needed] + +#### Software + +[More Information Needed] + +## Citation [optional] + + + +**BibTeX:** + +[More Information Needed] + +**APA:** + +[More Information Needed] + +## Glossary [optional] + + + +[More Information Needed] + +## More Information [optional] + +[More Information Needed] + +## Model Card Authors [optional] + +[More Information Needed] + +## Model Card Contact + +[More Information Needed] +### Framework versions + +- PEFT 0.18.1 \ No newline at end of file diff --git a/experiments/Natural/checkpoint-948/adapter_config.json b/experiments/Natural/checkpoint-948/adapter_config.json new file mode 100644 index 0000000000000000000000000000000000000000..7c2e352b20dfcbcac0e45c46b2bd6a1fddd7caf6 --- /dev/null +++ b/experiments/Natural/checkpoint-948/adapter_config.json @@ -0,0 +1,50 @@ +{ + "alora_invocation_tokens": null, + "alpha_pattern": {}, + "arrow_config": null, + "auto_mapping": { + "base_model_class": "LlamaForCausalLM", + "parent_library": "transformers.models.llama.modeling_llama", + "unsloth_fixed": true + }, + "base_model_name_or_path": "unsloth/meta-llama-3.1-8b-instruct-bnb-4bit", + "bias": "none", + "corda_config": null, + "ensure_weight_tying": false, + "eva_config": null, + "exclude_modules": null, + "fan_in_fan_out": false, + "inference_mode": true, + "init_lora_weights": true, + "layer_replication": null, + "layers_pattern": null, + "layers_to_transform": null, + "loftq_config": {}, + "lora_alpha": 32, + "lora_bias": false, + "lora_dropout": 0, + "megatron_config": null, + "megatron_core": "megatron.core", + "modules_to_save": null, + "peft_type": "LORA", + "peft_version": "0.18.1", + "qalora_group_size": 16, + "r": 16, + "rank_pattern": {}, + "revision": null, + "target_modules": [ + "gate_proj", + "v_proj", + "o_proj", + "k_proj", + "up_proj", + "down_proj", + "q_proj" + ], + "target_parameters": null, + "task_type": "CAUSAL_LM", + "trainable_token_indices": null, + "use_dora": false, + "use_qalora": false, + "use_rslora": true +} \ No newline at end of file diff --git a/experiments/Natural/checkpoint-948/adapter_model.safetensors b/experiments/Natural/checkpoint-948/adapter_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a8a07a9d6b00f145f31a17487fd4f53c3ee79274 --- /dev/null +++ b/experiments/Natural/checkpoint-948/adapter_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6a9f4ac82a95dbae10a94af6210c5b8cb33c42426000f745e8a1825aea199f3 +size 167832240 diff --git a/experiments/Natural/checkpoint-948/chat_template.jinja b/experiments/Natural/checkpoint-948/chat_template.jinja new file mode 100644 index 0000000000000000000000000000000000000000..33089ace1be88f22a10fe861ad49718d5d886090 --- /dev/null +++ b/experiments/Natural/checkpoint-948/chat_template.jinja @@ -0,0 +1,109 @@ +{{- bos_token }} +{%- if custom_tools is defined %} + {%- set tools = custom_tools %} +{%- endif %} +{%- if not tools_in_user_message is defined %} + {%- set tools_in_user_message = true %} +{%- endif %} +{%- if not date_string is defined %} + {%- set date_string = "26 Jul 2024" %} +{%- endif %} +{%- if not tools is defined %} + {%- set tools = none %} +{%- endif %} + +{#- This block extracts the system message, so we can slot it into the right place. #} +{%- if messages[0]['role'] == 'system' %} + {%- set system_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} +{%- else %} + {%- set system_message = "" %} +{%- endif %} + +{#- System message + builtin tools #} +{{- "<|start_header_id|>system<|end_header_id|>\n\n" }} +{%- if builtin_tools is defined or tools is not none %} + {{- "Environment: ipython\n" }} +{%- endif %} +{%- if builtin_tools is defined %} + {{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}} +{%- endif %} +{{- "Cutting Knowledge Date: December 2023\n" }} +{{- "Today Date: " + date_string + "\n\n" }} +{%- if tools is not none and not tools_in_user_message %} + {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} +{%- endif %} +{{- system_message }} +{{- "<|eot_id|>" }} + +{#- Custom tools are passed in a user message with some extra guidance #} +{%- if tools_in_user_message and not tools is none %} + {#- Extract the first user message so we can plug it in here #} + {%- if messages | length != 0 %} + {%- set first_user_message = messages[0]['content']|trim %} + {%- set messages = messages[1:] %} + {%- else %} + {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }} +{%- endif %} + {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}} + {{- "Given the following functions, please respond with a JSON for a function call " }} + {{- "with its proper arguments that best answers the given prompt.\n\n" }} + {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }} + {{- "Do not use variables.\n\n" }} + {%- for t in tools %} + {{- t | tojson(indent=4) }} + {{- "\n\n" }} + {%- endfor %} + {{- first_user_message + "<|eot_id|>"}} +{%- endif %} + +{%- for message in messages %} + {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %} + {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }} + {%- elif 'tool_calls' in message %} + {%- if not message.tool_calls|length == 1 %} + {{- raise_exception("This model only supports single tool-calls at once!") }} + {%- endif %} + {%- set tool_call = message.tool_calls[0].function %} + {%- if builtin_tools is defined and tool_call.name in builtin_tools %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- "<|python_tag|>" + tool_call.name + ".call(" }} + {%- for arg_name, arg_val in tool_call.arguments | items %} + {{- arg_name + '="' + arg_val + '"' }} + {%- if not loop.last %} + {{- ", " }} + {%- endif %} + {%- endfor %} + {{- ")" }} + {%- else %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}} + {{- '{"name": "' + tool_call.name + '", ' }} + {{- '"parameters": ' }} + {{- tool_call.arguments | tojson }} + {{- "}" }} + {%- endif %} + {%- if builtin_tools is defined %} + {#- This means we're in ipython mode #} + {{- "<|eom_id|>" }} + {%- else %} + {{- "<|eot_id|>" }} + {%- endif %} + {%- elif message.role == "tool" or message.role == "ipython" %} + {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }} + {%- if message.content is mapping or message.content is iterable %} + {{- message.content | tojson }} + {%- else %} + {{- message.content }} + {%- endif %} + {{- "<|eot_id|>" }} + {%- endif %} +{%- endfor %} +{%- if add_generation_prompt %} + {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }} +{%- endif %} diff --git a/experiments/Natural/checkpoint-948/optimizer.pt b/experiments/Natural/checkpoint-948/optimizer.pt new file mode 100644 index 0000000000000000000000000000000000000000..f8ee8ff7253454e1822b007a3c800a5e191b32cf --- /dev/null +++ b/experiments/Natural/checkpoint-948/optimizer.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ea243227db1f7cd5cc296e608f02cfd585ef5870b07fd244fb374791fbbca7f +size 85724133 diff --git a/experiments/Natural/checkpoint-948/rng_state.pth b/experiments/Natural/checkpoint-948/rng_state.pth new file mode 100644 index 0000000000000000000000000000000000000000..9a2f1c6718be043c8a9bbc32d83f6f90b082c4d8 --- /dev/null +++ b/experiments/Natural/checkpoint-948/rng_state.pth @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:181c5f0270cf39930062ddfa3767a2481d0c360f120b11f8e25dbf533a1cdaba +size 14645 diff --git a/experiments/Natural/checkpoint-948/scheduler.pt b/experiments/Natural/checkpoint-948/scheduler.pt new file mode 100644 index 0000000000000000000000000000000000000000..da3778b274c4518122bb21d41af555422b5dc685 --- /dev/null +++ b/experiments/Natural/checkpoint-948/scheduler.pt @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93137690dead97a15b2b04636ec8ecdb8cfc8d961842c452fe04dae7d474c6a2 +size 1465 diff --git a/experiments/Natural/checkpoint-948/special_tokens_map.json b/experiments/Natural/checkpoint-948/special_tokens_map.json new file mode 100644 index 0000000000000000000000000000000000000000..3c1d04911c269b925af977a3151c9704e990e4d0 --- /dev/null +++ b/experiments/Natural/checkpoint-948/special_tokens_map.json @@ -0,0 +1,23 @@ +{ + "bos_token": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "eos_token": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + }, + "pad_token": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false + } +} diff --git a/experiments/Natural/checkpoint-948/tokenizer.json b/experiments/Natural/checkpoint-948/tokenizer.json new file mode 100644 index 0000000000000000000000000000000000000000..1c1d8d5c9024994f1d3b00f9662b8dd89ca13cf2 --- /dev/null +++ b/experiments/Natural/checkpoint-948/tokenizer.json @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b +size 17209920 diff --git a/experiments/Natural/checkpoint-948/tokenizer_config.json b/experiments/Natural/checkpoint-948/tokenizer_config.json new file mode 100644 index 0000000000000000000000000000000000000000..69b6ed0e11b81375bae750eb8ec4a7e1146eeca3 --- /dev/null +++ b/experiments/Natural/checkpoint-948/tokenizer_config.json @@ -0,0 +1,2066 @@ +{ + "add_bos_token": true, + "added_tokens_decoder": { + "128000": { + "content": "<|begin_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128001": { + "content": "<|end_of_text|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128002": { + "content": "<|reserved_special_token_0|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128003": { + "content": "<|reserved_special_token_1|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128004": { + "content": "<|finetune_right_pad_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128005": { + "content": "<|reserved_special_token_2|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128006": { + "content": "<|start_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128007": { + "content": "<|end_header_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128008": { + "content": "<|eom_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128009": { + "content": "<|eot_id|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128010": { + "content": "<|python_tag|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128011": { + "content": "<|reserved_special_token_3|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128012": { + "content": "<|reserved_special_token_4|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128013": { + "content": "<|reserved_special_token_5|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128014": { + "content": "<|reserved_special_token_6|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128015": { + "content": "<|reserved_special_token_7|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128016": { + "content": "<|reserved_special_token_8|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128017": { + "content": "<|reserved_special_token_9|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128018": { + "content": "<|reserved_special_token_10|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128019": { + "content": "<|reserved_special_token_11|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128020": { + "content": "<|reserved_special_token_12|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128021": { + "content": "<|reserved_special_token_13|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128022": { + "content": "<|reserved_special_token_14|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128023": { + "content": "<|reserved_special_token_15|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128024": { + "content": "<|reserved_special_token_16|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128025": { + "content": "<|reserved_special_token_17|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128026": { + "content": "<|reserved_special_token_18|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128027": { + "content": "<|reserved_special_token_19|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128028": { + "content": "<|reserved_special_token_20|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128029": { + "content": "<|reserved_special_token_21|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128030": { + "content": "<|reserved_special_token_22|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128031": { + "content": "<|reserved_special_token_23|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128032": { + "content": "<|reserved_special_token_24|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128033": { + "content": "<|reserved_special_token_25|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128034": { + "content": "<|reserved_special_token_26|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128035": { + "content": "<|reserved_special_token_27|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128036": { + "content": "<|reserved_special_token_28|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128037": { + "content": "<|reserved_special_token_29|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128038": { + "content": "<|reserved_special_token_30|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128039": { + "content": "<|reserved_special_token_31|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128040": { + "content": "<|reserved_special_token_32|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128041": { + "content": "<|reserved_special_token_33|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128042": { + "content": "<|reserved_special_token_34|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128043": { + "content": "<|reserved_special_token_35|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128044": { + "content": "<|reserved_special_token_36|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128045": { + "content": "<|reserved_special_token_37|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128046": { + "content": "<|reserved_special_token_38|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128047": { + "content": "<|reserved_special_token_39|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128048": { + "content": "<|reserved_special_token_40|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128049": { + "content": "<|reserved_special_token_41|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128050": { + "content": "<|reserved_special_token_42|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128051": { + "content": "<|reserved_special_token_43|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128052": { + "content": "<|reserved_special_token_44|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128053": { + "content": "<|reserved_special_token_45|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128054": { + "content": "<|reserved_special_token_46|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128055": { + "content": "<|reserved_special_token_47|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128056": { + "content": "<|reserved_special_token_48|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128057": { + "content": "<|reserved_special_token_49|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128058": { + "content": "<|reserved_special_token_50|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128059": { + "content": "<|reserved_special_token_51|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128060": { + "content": "<|reserved_special_token_52|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128061": { + "content": "<|reserved_special_token_53|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128062": { + "content": "<|reserved_special_token_54|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128063": { + "content": "<|reserved_special_token_55|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128064": { + "content": "<|reserved_special_token_56|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128065": { + "content": "<|reserved_special_token_57|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128066": { + "content": "<|reserved_special_token_58|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128067": { + "content": "<|reserved_special_token_59|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128068": { + "content": "<|reserved_special_token_60|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128069": { + "content": "<|reserved_special_token_61|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128070": { + "content": "<|reserved_special_token_62|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128071": { + "content": "<|reserved_special_token_63|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128072": { + "content": "<|reserved_special_token_64|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128073": { + "content": "<|reserved_special_token_65|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128074": { + "content": "<|reserved_special_token_66|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128075": { + "content": "<|reserved_special_token_67|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128076": { + "content": "<|reserved_special_token_68|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128077": { + "content": "<|reserved_special_token_69|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128078": { + "content": "<|reserved_special_token_70|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128079": { + "content": "<|reserved_special_token_71|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128080": { + "content": "<|reserved_special_token_72|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128081": { + "content": "<|reserved_special_token_73|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128082": { + "content": "<|reserved_special_token_74|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128083": { + "content": "<|reserved_special_token_75|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128084": { + "content": "<|reserved_special_token_76|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128085": { + "content": "<|reserved_special_token_77|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128086": { + "content": "<|reserved_special_token_78|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128087": { + "content": "<|reserved_special_token_79|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128088": { + "content": "<|reserved_special_token_80|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128089": { + "content": "<|reserved_special_token_81|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128090": { + "content": "<|reserved_special_token_82|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128091": { + "content": "<|reserved_special_token_83|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128092": { + "content": "<|reserved_special_token_84|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128093": { + "content": "<|reserved_special_token_85|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128094": { + "content": "<|reserved_special_token_86|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128095": { + "content": "<|reserved_special_token_87|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128096": { + "content": "<|reserved_special_token_88|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128097": { + "content": "<|reserved_special_token_89|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128098": { + "content": "<|reserved_special_token_90|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128099": { + "content": "<|reserved_special_token_91|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128100": { + "content": "<|reserved_special_token_92|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128101": { + "content": "<|reserved_special_token_93|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128102": { + "content": "<|reserved_special_token_94|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128103": { + "content": "<|reserved_special_token_95|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128104": { + "content": "<|reserved_special_token_96|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128105": { + "content": "<|reserved_special_token_97|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128106": { + "content": "<|reserved_special_token_98|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128107": { + "content": "<|reserved_special_token_99|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128108": { + "content": "<|reserved_special_token_100|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128109": { + "content": "<|reserved_special_token_101|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128110": { + "content": "<|reserved_special_token_102|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128111": { + "content": "<|reserved_special_token_103|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128112": { + "content": "<|reserved_special_token_104|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128113": { + "content": "<|reserved_special_token_105|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128114": { + "content": "<|reserved_special_token_106|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128115": { + "content": "<|reserved_special_token_107|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128116": { + "content": "<|reserved_special_token_108|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128117": { + "content": "<|reserved_special_token_109|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128118": { + "content": "<|reserved_special_token_110|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128119": { + "content": "<|reserved_special_token_111|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128120": { + "content": "<|reserved_special_token_112|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128121": { + "content": "<|reserved_special_token_113|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128122": { + "content": "<|reserved_special_token_114|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128123": { + "content": "<|reserved_special_token_115|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128124": { + "content": "<|reserved_special_token_116|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128125": { + "content": "<|reserved_special_token_117|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128126": { + "content": "<|reserved_special_token_118|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128127": { + "content": "<|reserved_special_token_119|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128128": { + "content": "<|reserved_special_token_120|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128129": { + "content": "<|reserved_special_token_121|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128130": { + "content": "<|reserved_special_token_122|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128131": { + "content": "<|reserved_special_token_123|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128132": { + "content": "<|reserved_special_token_124|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128133": { + "content": "<|reserved_special_token_125|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128134": { + "content": "<|reserved_special_token_126|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128135": { + "content": "<|reserved_special_token_127|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128136": { + "content": "<|reserved_special_token_128|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128137": { + "content": "<|reserved_special_token_129|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128138": { + "content": "<|reserved_special_token_130|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128139": { + "content": "<|reserved_special_token_131|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128140": { + "content": "<|reserved_special_token_132|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128141": { + "content": "<|reserved_special_token_133|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128142": { + "content": "<|reserved_special_token_134|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128143": { + "content": "<|reserved_special_token_135|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128144": { + "content": "<|reserved_special_token_136|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128145": { + "content": "<|reserved_special_token_137|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128146": { + "content": "<|reserved_special_token_138|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128147": { + "content": "<|reserved_special_token_139|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128148": { + "content": "<|reserved_special_token_140|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128149": { + "content": "<|reserved_special_token_141|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128150": { + "content": "<|reserved_special_token_142|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128151": { + "content": "<|reserved_special_token_143|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128152": { + "content": "<|reserved_special_token_144|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128153": { + "content": "<|reserved_special_token_145|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128154": { + "content": "<|reserved_special_token_146|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128155": { + "content": "<|reserved_special_token_147|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128156": { + "content": "<|reserved_special_token_148|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128157": { + "content": "<|reserved_special_token_149|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128158": { + "content": "<|reserved_special_token_150|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128159": { + "content": "<|reserved_special_token_151|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128160": { + "content": "<|reserved_special_token_152|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128161": { + "content": "<|reserved_special_token_153|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128162": { + "content": "<|reserved_special_token_154|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128163": { + "content": "<|reserved_special_token_155|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128164": { + "content": "<|reserved_special_token_156|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128165": { + "content": "<|reserved_special_token_157|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128166": { + "content": "<|reserved_special_token_158|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128167": { + "content": "<|reserved_special_token_159|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128168": { + "content": "<|reserved_special_token_160|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128169": { + "content": "<|reserved_special_token_161|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128170": { + "content": "<|reserved_special_token_162|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128171": { + "content": "<|reserved_special_token_163|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128172": { + "content": "<|reserved_special_token_164|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128173": { + "content": "<|reserved_special_token_165|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128174": { + "content": "<|reserved_special_token_166|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128175": { + "content": "<|reserved_special_token_167|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128176": { + "content": "<|reserved_special_token_168|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128177": { + "content": "<|reserved_special_token_169|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128178": { + "content": "<|reserved_special_token_170|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128179": { + "content": "<|reserved_special_token_171|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128180": { + "content": "<|reserved_special_token_172|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128181": { + "content": "<|reserved_special_token_173|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128182": { + "content": "<|reserved_special_token_174|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128183": { + "content": "<|reserved_special_token_175|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128184": { + "content": "<|reserved_special_token_176|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128185": { + "content": "<|reserved_special_token_177|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128186": { + "content": "<|reserved_special_token_178|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128187": { + "content": "<|reserved_special_token_179|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128188": { + "content": "<|reserved_special_token_180|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128189": { + "content": "<|reserved_special_token_181|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128190": { + "content": "<|reserved_special_token_182|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128191": { + "content": "<|reserved_special_token_183|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128192": { + "content": "<|reserved_special_token_184|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128193": { + "content": "<|reserved_special_token_185|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128194": { + "content": "<|reserved_special_token_186|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128195": { + "content": "<|reserved_special_token_187|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128196": { + "content": "<|reserved_special_token_188|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128197": { + "content": "<|reserved_special_token_189|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128198": { + "content": "<|reserved_special_token_190|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128199": { + "content": "<|reserved_special_token_191|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128200": { + "content": "<|reserved_special_token_192|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128201": { + "content": "<|reserved_special_token_193|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128202": { + "content": "<|reserved_special_token_194|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128203": { + "content": "<|reserved_special_token_195|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128204": { + "content": "<|reserved_special_token_196|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128205": { + "content": "<|reserved_special_token_197|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128206": { + "content": "<|reserved_special_token_198|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128207": { + "content": "<|reserved_special_token_199|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128208": { + "content": "<|reserved_special_token_200|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128209": { + "content": "<|reserved_special_token_201|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128210": { + "content": "<|reserved_special_token_202|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128211": { + "content": "<|reserved_special_token_203|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128212": { + "content": "<|reserved_special_token_204|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128213": { + "content": "<|reserved_special_token_205|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128214": { + "content": "<|reserved_special_token_206|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128215": { + "content": "<|reserved_special_token_207|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128216": { + "content": "<|reserved_special_token_208|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128217": { + "content": "<|reserved_special_token_209|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128218": { + "content": "<|reserved_special_token_210|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128219": { + "content": "<|reserved_special_token_211|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128220": { + "content": "<|reserved_special_token_212|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128221": { + "content": "<|reserved_special_token_213|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128222": { + "content": "<|reserved_special_token_214|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128223": { + "content": "<|reserved_special_token_215|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128224": { + "content": "<|reserved_special_token_216|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128225": { + "content": "<|reserved_special_token_217|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128226": { + "content": "<|reserved_special_token_218|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128227": { + "content": "<|reserved_special_token_219|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128228": { + "content": "<|reserved_special_token_220|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128229": { + "content": "<|reserved_special_token_221|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128230": { + "content": "<|reserved_special_token_222|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128231": { + "content": "<|reserved_special_token_223|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128232": { + "content": "<|reserved_special_token_224|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128233": { + "content": "<|reserved_special_token_225|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128234": { + "content": "<|reserved_special_token_226|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128235": { + "content": "<|reserved_special_token_227|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128236": { + "content": "<|reserved_special_token_228|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128237": { + "content": "<|reserved_special_token_229|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128238": { + "content": "<|reserved_special_token_230|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128239": { + "content": "<|reserved_special_token_231|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128240": { + "content": "<|reserved_special_token_232|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128241": { + "content": "<|reserved_special_token_233|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128242": { + "content": "<|reserved_special_token_234|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128243": { + "content": "<|reserved_special_token_235|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128244": { + "content": "<|reserved_special_token_236|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128245": { + "content": "<|reserved_special_token_237|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128246": { + "content": "<|reserved_special_token_238|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128247": { + "content": "<|reserved_special_token_239|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128248": { + "content": "<|reserved_special_token_240|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128249": { + "content": "<|reserved_special_token_241|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128250": { + "content": "<|reserved_special_token_242|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128251": { + "content": "<|reserved_special_token_243|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128252": { + "content": "<|reserved_special_token_244|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128253": { + "content": "<|reserved_special_token_245|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128254": { + "content": "<|reserved_special_token_246|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + }, + "128255": { + "content": "<|reserved_special_token_247|>", + "lstrip": false, + "normalized": false, + "rstrip": false, + "single_word": false, + "special": true + } + }, + "bos_token": "<|begin_of_text|>", + "clean_up_tokenization_spaces": true, + "eos_token": "<|eot_id|>", + "extra_special_tokens": {}, + "model_input_names": [ + "input_ids", + "attention_mask" + ], + "model_max_length": 131072, + "pad_token": "<|finetune_right_pad_id|>", + "padding_side": "right", + "tokenizer_class": "PreTrainedTokenizerFast", + "unk_token": null +} diff --git a/experiments/Natural/checkpoint-948/trainer_state.json b/experiments/Natural/checkpoint-948/trainer_state.json new file mode 100644 index 0000000000000000000000000000000000000000..bf5158f2ac5553024855aa570da2d007a192eb0a --- /dev/null +++ b/experiments/Natural/checkpoint-948/trainer_state.json @@ -0,0 +1,692 @@ +{ + "best_global_step": null, + "best_metric": null, + "best_model_checkpoint": null, + "epoch": 3.0, + "eval_steps": 500, + "global_step": 948, + "is_hyper_param_search": false, + "is_local_process_zero": true, + "is_world_process_zero": true, + "log_history": [ + { + "epoch": 0.03164556962025317, + "grad_norm": 5.501315116882324, + "learning_rate": 0.00018, + "loss": 2.5563, + "step": 10 + }, + { + "epoch": 0.06329113924050633, + "grad_norm": 208.8762664794922, + "learning_rate": 0.0001980810234541578, + "loss": 1.5462, + "step": 20 + }, + { + "epoch": 0.0949367088607595, + "grad_norm": 2.5434937477111816, + "learning_rate": 0.0001959488272921109, + "loss": 1.2888, + "step": 30 + }, + { + "epoch": 0.12658227848101267, + "grad_norm": 2.095930337905884, + "learning_rate": 0.00019381663113006398, + "loss": 1.0692, + "step": 40 + }, + { + "epoch": 0.15822784810126583, + "grad_norm": 2.7760283946990967, + "learning_rate": 0.00019168443496801708, + "loss": 1.0187, + "step": 50 + }, + { + "epoch": 0.189873417721519, + "grad_norm": 2.404048442840576, + "learning_rate": 0.00018955223880597015, + "loss": 1.0407, + "step": 60 + }, + { + "epoch": 0.22151898734177214, + "grad_norm": 2.1488564014434814, + "learning_rate": 0.00018742004264392324, + "loss": 1.0402, + "step": 70 + }, + { + "epoch": 0.25316455696202533, + "grad_norm": 1.9336700439453125, + "learning_rate": 0.00018528784648187634, + "loss": 1.0029, + "step": 80 + }, + { + "epoch": 0.2848101265822785, + "grad_norm": 1.9072555303573608, + "learning_rate": 0.00018315565031982943, + "loss": 0.9752, + "step": 90 + }, + { + "epoch": 0.31645569620253167, + "grad_norm": 2.0148863792419434, + "learning_rate": 0.00018102345415778253, + "loss": 0.9779, + "step": 100 + }, + { + "epoch": 0.34810126582278483, + "grad_norm": 2.134287118911743, + "learning_rate": 0.0001788912579957356, + "loss": 1.0056, + "step": 110 + }, + { + "epoch": 0.379746835443038, + "grad_norm": 2.3993921279907227, + "learning_rate": 0.00017675906183368872, + "loss": 0.9696, + "step": 120 + }, + { + "epoch": 0.41139240506329117, + "grad_norm": 2.1493868827819824, + "learning_rate": 0.00017462686567164178, + "loss": 0.9977, + "step": 130 + }, + { + "epoch": 0.4430379746835443, + "grad_norm": 2.0282540321350098, + "learning_rate": 0.0001724946695095949, + "loss": 0.9989, + "step": 140 + }, + { + "epoch": 0.47468354430379744, + "grad_norm": 2.0911059379577637, + "learning_rate": 0.00017036247334754797, + "loss": 1.0107, + "step": 150 + }, + { + "epoch": 0.5063291139240507, + "grad_norm": 1.9412617683410645, + "learning_rate": 0.0001682302771855011, + "loss": 0.937, + "step": 160 + }, + { + "epoch": 0.5379746835443038, + "grad_norm": 2.1742329597473145, + "learning_rate": 0.00016609808102345416, + "loss": 0.9576, + "step": 170 + }, + { + "epoch": 0.569620253164557, + "grad_norm": 1.9778038263320923, + "learning_rate": 0.00016396588486140726, + "loss": 0.9447, + "step": 180 + }, + { + "epoch": 0.6012658227848101, + "grad_norm": 1.9321210384368896, + "learning_rate": 0.00016183368869936035, + "loss": 0.9709, + "step": 190 + }, + { + "epoch": 0.6329113924050633, + "grad_norm": 2.3531970977783203, + "learning_rate": 0.00015970149253731345, + "loss": 0.9245, + "step": 200 + }, + { + "epoch": 0.6645569620253164, + "grad_norm": 1.7041960954666138, + "learning_rate": 0.00015756929637526654, + "loss": 0.9306, + "step": 210 + }, + { + "epoch": 0.6962025316455697, + "grad_norm": 2.324159622192383, + "learning_rate": 0.0001554371002132196, + "loss": 0.8963, + "step": 220 + }, + { + "epoch": 0.7278481012658228, + "grad_norm": 2.119621515274048, + "learning_rate": 0.0001533049040511727, + "loss": 0.9523, + "step": 230 + }, + { + "epoch": 0.759493670886076, + "grad_norm": 2.0477793216705322, + "learning_rate": 0.0001511727078891258, + "loss": 0.8706, + "step": 240 + }, + { + "epoch": 0.7911392405063291, + "grad_norm": 2.5919649600982666, + "learning_rate": 0.0001490405117270789, + "loss": 0.9686, + "step": 250 + }, + { + "epoch": 0.8227848101265823, + "grad_norm": 1.9912266731262207, + "learning_rate": 0.000146908315565032, + "loss": 0.8971, + "step": 260 + }, + { + "epoch": 0.8544303797468354, + "grad_norm": 2.3511784076690674, + "learning_rate": 0.00014477611940298508, + "loss": 0.9294, + "step": 270 + }, + { + "epoch": 0.8860759493670886, + "grad_norm": 2.0004653930664062, + "learning_rate": 0.00014264392324093818, + "loss": 0.9372, + "step": 280 + }, + { + "epoch": 0.9177215189873418, + "grad_norm": 2.2056915760040283, + "learning_rate": 0.00014051172707889127, + "loss": 0.8292, + "step": 290 + }, + { + "epoch": 0.9493670886075949, + "grad_norm": 1.875032663345337, + "learning_rate": 0.00013837953091684434, + "loss": 0.87, + "step": 300 + }, + { + "epoch": 0.9810126582278481, + "grad_norm": 2.4730782508850098, + "learning_rate": 0.00013624733475479746, + "loss": 0.8752, + "step": 310 + }, + { + "epoch": 1.0126582278481013, + "grad_norm": 1.4958025217056274, + "learning_rate": 0.00013411513859275053, + "loss": 0.7282, + "step": 320 + }, + { + "epoch": 1.0443037974683544, + "grad_norm": 2.051508665084839, + "learning_rate": 0.00013198294243070365, + "loss": 0.6241, + "step": 330 + }, + { + "epoch": 1.0759493670886076, + "grad_norm": 1.6825811862945557, + "learning_rate": 0.00012985074626865672, + "loss": 0.5981, + "step": 340 + }, + { + "epoch": 1.1075949367088607, + "grad_norm": 1.9630382061004639, + "learning_rate": 0.00012771855010660981, + "loss": 0.5786, + "step": 350 + }, + { + "epoch": 1.139240506329114, + "grad_norm": 1.9352911710739136, + "learning_rate": 0.0001255863539445629, + "loss": 0.586, + "step": 360 + }, + { + "epoch": 1.1708860759493671, + "grad_norm": 1.8921730518341064, + "learning_rate": 0.00012345415778251598, + "loss": 0.5849, + "step": 370 + }, + { + "epoch": 1.2025316455696202, + "grad_norm": 2.428544759750366, + "learning_rate": 0.0001213219616204691, + "loss": 0.6045, + "step": 380 + }, + { + "epoch": 1.2341772151898733, + "grad_norm": 1.5441521406173706, + "learning_rate": 0.00011918976545842218, + "loss": 0.5826, + "step": 390 + }, + { + "epoch": 1.2658227848101267, + "grad_norm": 2.047736167907715, + "learning_rate": 0.00011705756929637527, + "loss": 0.5839, + "step": 400 + }, + { + "epoch": 1.2974683544303798, + "grad_norm": 1.9724676609039307, + "learning_rate": 0.00011492537313432837, + "loss": 0.5984, + "step": 410 + }, + { + "epoch": 1.3291139240506329, + "grad_norm": 1.8715415000915527, + "learning_rate": 0.00011279317697228145, + "loss": 0.5652, + "step": 420 + }, + { + "epoch": 1.360759493670886, + "grad_norm": 1.9804896116256714, + "learning_rate": 0.00011066098081023454, + "loss": 0.5841, + "step": 430 + }, + { + "epoch": 1.3924050632911391, + "grad_norm": 2.00898814201355, + "learning_rate": 0.00010852878464818763, + "loss": 0.5855, + "step": 440 + }, + { + "epoch": 1.4240506329113924, + "grad_norm": 2.335874319076538, + "learning_rate": 0.00010639658848614073, + "loss": 0.5998, + "step": 450 + }, + { + "epoch": 1.4556962025316456, + "grad_norm": 2.285264730453491, + "learning_rate": 0.00010426439232409382, + "loss": 0.5909, + "step": 460 + }, + { + "epoch": 1.4873417721518987, + "grad_norm": 2.85251522064209, + "learning_rate": 0.00010213219616204692, + "loss": 0.5592, + "step": 470 + }, + { + "epoch": 1.518987341772152, + "grad_norm": 1.88075852394104, + "learning_rate": 0.0001, + "loss": 0.5729, + "step": 480 + }, + { + "epoch": 1.5506329113924051, + "grad_norm": 2.382542610168457, + "learning_rate": 9.78678038379531e-05, + "loss": 0.5452, + "step": 490 + }, + { + "epoch": 1.5822784810126582, + "grad_norm": 4.036933422088623, + "learning_rate": 9.57356076759062e-05, + "loss": 0.5823, + "step": 500 + }, + { + "epoch": 1.6139240506329116, + "grad_norm": 3.3066916465759277, + "learning_rate": 9.360341151385929e-05, + "loss": 0.5795, + "step": 510 + }, + { + "epoch": 1.6455696202531644, + "grad_norm": 1.9409579038619995, + "learning_rate": 9.147121535181237e-05, + "loss": 0.5375, + "step": 520 + }, + { + "epoch": 1.6772151898734178, + "grad_norm": 2.17864727973938, + "learning_rate": 8.933901918976547e-05, + "loss": 0.5335, + "step": 530 + }, + { + "epoch": 1.7088607594936709, + "grad_norm": 2.006638288497925, + "learning_rate": 8.720682302771856e-05, + "loss": 0.5519, + "step": 540 + }, + { + "epoch": 1.740506329113924, + "grad_norm": 1.947319507598877, + "learning_rate": 8.507462686567164e-05, + "loss": 0.5785, + "step": 550 + }, + { + "epoch": 1.7721518987341773, + "grad_norm": 2.2128632068634033, + "learning_rate": 8.294243070362474e-05, + "loss": 0.5755, + "step": 560 + }, + { + "epoch": 1.8037974683544302, + "grad_norm": 1.9778517484664917, + "learning_rate": 8.081023454157783e-05, + "loss": 0.5226, + "step": 570 + }, + { + "epoch": 1.8354430379746836, + "grad_norm": 1.8911027908325195, + "learning_rate": 7.867803837953091e-05, + "loss": 0.5219, + "step": 580 + }, + { + "epoch": 1.8670886075949367, + "grad_norm": 2.0345847606658936, + "learning_rate": 7.6545842217484e-05, + "loss": 0.5483, + "step": 590 + }, + { + "epoch": 1.8987341772151898, + "grad_norm": 2.2605462074279785, + "learning_rate": 7.44136460554371e-05, + "loss": 0.5321, + "step": 600 + }, + { + "epoch": 1.9303797468354431, + "grad_norm": 2.2855758666992188, + "learning_rate": 7.22814498933902e-05, + "loss": 0.5593, + "step": 610 + }, + { + "epoch": 1.9620253164556962, + "grad_norm": 2.232529640197754, + "learning_rate": 7.014925373134329e-05, + "loss": 0.5144, + "step": 620 + }, + { + "epoch": 1.9936708860759493, + "grad_norm": 2.504122495651245, + "learning_rate": 6.801705756929639e-05, + "loss": 0.5164, + "step": 630 + }, + { + "epoch": 2.0253164556962027, + "grad_norm": 2.175163507461548, + "learning_rate": 6.588486140724947e-05, + "loss": 0.3421, + "step": 640 + }, + { + "epoch": 2.0569620253164556, + "grad_norm": 2.2923076152801514, + "learning_rate": 6.375266524520256e-05, + "loss": 0.3113, + "step": 650 + }, + { + "epoch": 2.088607594936709, + "grad_norm": 1.4199978113174438, + "learning_rate": 6.162046908315566e-05, + "loss": 0.2876, + "step": 660 + }, + { + "epoch": 2.1202531645569622, + "grad_norm": 1.810011863708496, + "learning_rate": 5.9488272921108744e-05, + "loss": 0.3009, + "step": 670 + }, + { + "epoch": 2.151898734177215, + "grad_norm": 2.0927467346191406, + "learning_rate": 5.735607675906184e-05, + "loss": 0.2992, + "step": 680 + }, + { + "epoch": 2.1835443037974684, + "grad_norm": 2.0043625831604004, + "learning_rate": 5.5223880597014934e-05, + "loss": 0.2909, + "step": 690 + }, + { + "epoch": 2.2151898734177213, + "grad_norm": 1.6236121654510498, + "learning_rate": 5.3091684434968015e-05, + "loss": 0.2914, + "step": 700 + }, + { + "epoch": 2.2468354430379747, + "grad_norm": 2.248943567276001, + "learning_rate": 5.095948827292111e-05, + "loss": 0.2934, + "step": 710 + }, + { + "epoch": 2.278481012658228, + "grad_norm": 1.8461322784423828, + "learning_rate": 4.88272921108742e-05, + "loss": 0.3024, + "step": 720 + }, + { + "epoch": 2.310126582278481, + "grad_norm": 2.2742624282836914, + "learning_rate": 4.669509594882729e-05, + "loss": 0.3082, + "step": 730 + }, + { + "epoch": 2.3417721518987342, + "grad_norm": 1.7575095891952515, + "learning_rate": 4.456289978678039e-05, + "loss": 0.2886, + "step": 740 + }, + { + "epoch": 2.3734177215189876, + "grad_norm": 1.605080246925354, + "learning_rate": 4.2430703624733475e-05, + "loss": 0.2903, + "step": 750 + }, + { + "epoch": 2.4050632911392404, + "grad_norm": 2.1212081909179688, + "learning_rate": 4.029850746268657e-05, + "loss": 0.3036, + "step": 760 + }, + { + "epoch": 2.4367088607594938, + "grad_norm": 1.8760476112365723, + "learning_rate": 3.8166311300639665e-05, + "loss": 0.2987, + "step": 770 + }, + { + "epoch": 2.4683544303797467, + "grad_norm": 1.7300761938095093, + "learning_rate": 3.603411513859275e-05, + "loss": 0.2982, + "step": 780 + }, + { + "epoch": 2.5, + "grad_norm": 1.789894700050354, + "learning_rate": 3.390191897654584e-05, + "loss": 0.2918, + "step": 790 + }, + { + "epoch": 2.5316455696202533, + "grad_norm": 2.4871201515197754, + "learning_rate": 3.1769722814498935e-05, + "loss": 0.3034, + "step": 800 + }, + { + "epoch": 2.5632911392405062, + "grad_norm": 1.8031909465789795, + "learning_rate": 2.9637526652452023e-05, + "loss": 0.2916, + "step": 810 + }, + { + "epoch": 2.5949367088607596, + "grad_norm": 1.842882513999939, + "learning_rate": 2.7505330490405118e-05, + "loss": 0.2844, + "step": 820 + }, + { + "epoch": 2.6265822784810124, + "grad_norm": 1.6206183433532715, + "learning_rate": 2.537313432835821e-05, + "loss": 0.2805, + "step": 830 + }, + { + "epoch": 2.6582278481012658, + "grad_norm": 1.6810400485992432, + "learning_rate": 2.32409381663113e-05, + "loss": 0.2831, + "step": 840 + }, + { + "epoch": 2.689873417721519, + "grad_norm": 2.3619446754455566, + "learning_rate": 2.1108742004264392e-05, + "loss": 0.2777, + "step": 850 + }, + { + "epoch": 2.721518987341772, + "grad_norm": 1.741870403289795, + "learning_rate": 1.8976545842217487e-05, + "loss": 0.291, + "step": 860 + }, + { + "epoch": 2.7531645569620253, + "grad_norm": 1.6769717931747437, + "learning_rate": 1.6844349680170575e-05, + "loss": 0.2779, + "step": 870 + }, + { + "epoch": 2.7848101265822782, + "grad_norm": 1.9720354080200195, + "learning_rate": 1.4712153518123666e-05, + "loss": 0.2874, + "step": 880 + }, + { + "epoch": 2.8164556962025316, + "grad_norm": 2.417759418487549, + "learning_rate": 1.257995735607676e-05, + "loss": 0.2919, + "step": 890 + }, + { + "epoch": 2.848101265822785, + "grad_norm": 1.6461621522903442, + "learning_rate": 1.0447761194029851e-05, + "loss": 0.2788, + "step": 900 + }, + { + "epoch": 2.879746835443038, + "grad_norm": 1.541041612625122, + "learning_rate": 8.315565031982942e-06, + "loss": 0.2838, + "step": 910 + }, + { + "epoch": 2.911392405063291, + "grad_norm": 1.8973344564437866, + "learning_rate": 6.1833688699360345e-06, + "loss": 0.2868, + "step": 920 + }, + { + "epoch": 2.9430379746835444, + "grad_norm": 1.9327278137207031, + "learning_rate": 4.051172707889126e-06, + "loss": 0.2896, + "step": 930 + }, + { + "epoch": 2.9746835443037973, + "grad_norm": 1.8000361919403076, + "learning_rate": 1.9189765458422177e-06, + "loss": 0.286, + "step": 940 + } + ], + "logging_steps": 10, + "max_steps": 948, + "num_input_tokens_seen": 0, + "num_train_epochs": 3, + "save_steps": 500, + "stateful_callbacks": { + "TrainerControl": { + "args": { + "should_epoch_stop": false, + "should_evaluate": false, + "should_log": false, + "should_save": true, + "should_training_stop": true + }, + "attributes": {} + } + }, + "total_flos": 6.112491922174771e+16, + "train_batch_size": 8, + "trial_name": null, + "trial_params": null +} diff --git a/experiments/Natural/checkpoint-948/training_args.bin b/experiments/Natural/checkpoint-948/training_args.bin new file mode 100644 index 0000000000000000000000000000000000000000..0d7c8fe7609f908259c478e4401b8fb50c0d4c1f --- /dev/null +++ b/experiments/Natural/checkpoint-948/training_args.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3152d0870ea96c94d222db6a8660a85e5518355a2fdb2f5e001d5faeb0242681 +size 6289 diff --git a/experiments/Natural/preds_hr.csv b/experiments/Natural/preds_hr.csv new file mode 100644 index 0000000000000000000000000000000000000000..9fd6787a75012bff7c61caa88918b308e77181ef --- /dev/null +++ b/experiments/Natural/preds_hr.csv @@ -0,0 +1,545 @@ +input,gold,pred +Čekao sam 10-15 minuta da usluga naručim pivo i nikad više nisam poslužen.,"{service general, usluga, negative}","{service general, usluga, negative}" +ambijent bio je miran i opuštajući odmor među svom djecom koja su trčala uokolo u centru Disneya.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive}" +skriveni mali jem,"{restaurant general, null, positive}","{restaurant general, null, negative}" +Otišao sam tamo s prijateljem iz drugog grada ... i oboje smo bili impresionirani!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Ima odličan sushi i još bolji usluga.,"{service general, usluga, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{service general, usluga, positive}" +"Sve njihove stavke jelovnika su hit, a poslužuju mimoze.","{food quality, stavke jelovnika, positive}","{food quality, jelovnika, positive};{food prices, jelovnika, positive}" +– ... i najbolje ljetno paluba iskustvo -- čak će vam donijeti i deku ako vam bude hladno na večernjem vremenu u Seattleu.,"{ambience general, paluba, positive};{service general, null, positive}","{ambience general, ljetno paluba, positive}" +– Nakon 12 godina u Seattleu Ray's smatra se mjestom kojem se uvijek vraćamo.,"{restaurant general, Ray's, positive}","{restaurant general, Ray's, positive}" +Ovdje ne možete pogriješiti.,"{restaurant general, null, positive}","{restaurant general, null, negative}" +"Mislim da sam vjerojatno probao svaku stavku na njihovom jelovniku barem jednom, sve je izvrsno.","{food quality, jelovniku, positive}","{food quality, jelovnik, positive}" +– feferoni stvarno debelo narezano -- Njam .,"{food style_options, feferoni, positive}","{food quality, feferno, negative}" +Creme brulee od zelenog čaja postaje bolji svaki put kad ga popijem.,"{food quality, Creme brulee od zelenog čaja, positive}","{drinks quality, zelenog čaja, positive}" +nije baš fina misao da se osjećaš nelagodno i da se moraš dotjerati.,"{ambience general, null, positive}","{food quality, misao, negative}" +Atmosfera bilo je lijepo.,"{ambience general, Atmosfera, positive}","{ambience general, Atmosfera, positive}" +apsolutno nevjerojatno! ! !,"{restaurant general, null, positive}","{restaurant general, null, negative}" +IZBJEGAVAJ MJESTO,"{restaurant general, MJESTO, negative}","{restaurant general, MJESTO, positive}" +"Da budem iskren, bolje mi je bilo smrznuto pizza.","{food quality, pizza, negative}","{food quality, pizza, negative}" +usluga je bila izuzetna - ponekad je postojao osjećaj da nas poslužuje vojska ljubaznih konobara.,"{service general, konobara, positive};{service general, usluga, positive}","{service general, konobara, positive};{food quality, usluga, positive}" +I sve su lijepo zapakirali da se nije prosulo .,"{service general, null, positive}","{food quality, null, negative}" +JAKO DOBRO!,"{restaurant general, null, positive}","{restaurant general, JAKO, positive}" +hrana je grešna.,"{food quality, hrana, positive}","{restaurant general, hrana, negative}" +"Za početak, otprilike 8-10 oz sok od naranče koštat će vas 3 USD.","{drinks prices, sok od naranče, negative}","{food quality, naranča, negative};{food prices, naranča, negative}" +dobro izbor sakea .,"{drinks style_options, izbor sakea, positive}","{drinks quality, sake, positive}" +"Iako sam mogao i bez mladih koji su s nama podijelili večer, naše divno poslužitelj i hrana učinilo je iskustvo vrlo pozitivnim.","{restaurant miscellaneous, null, positive};{service general, poslužitelj, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{service general, mladi, negative};{restaurant general, poslužitelj, positive}" +Kakav nalaz!,"{restaurant general, null, positive}","{restaurant general, Kakav, positive}" +– Mioposto ima vrlo kreativan i ukusan pizza meni .,"{food style_options, pizza meni, positive};{food quality, pizza meni, positive}","{food quality, pizza, positive};{food style_options, pizza, positive}" +"Na nedavnom putovanju, naš konobar bio je krajnje omalovažavajući, dok su ni manje ni više nego tri člana osoblja čekala dvije japanske djevojke koje su sjedile u blizini.","{service general, konobar, negative}","{service general, konobar, negative};{service general, japanske djevojke, negative}" +"inače ne bih dovršio brokoli kad naručim ovakvu hranu, ali po prvi put, svaki komad je bio pun događaja kao i prvi ... Jakobove kapice i kozice bili su tako svježe i lijepo kuhano.","{food quality, Jakobove kapice, positive};{food quality, brokoli, positive};{food quality, kozice, positive}","{food quality, Jakobove kapice i kozice, positive};{food quality, brokoli, negative}" +"Nije najjeftiniji sushi, ali se svaki put isplatio.","{food quality, sushi, positive};{food prices, sushi, neutral}","{food quality, sushi, negative};{restaurant general, null, positive}" +Nikada se ne osjećate mrzovoljno i nabijeno nakon što tamo jedete.,"{food quality, null, positive}","{restaurant general, Nikada, negative}" +"Kao dio male četveročlane zabave, naša hrana je dostavljena bez komentara;","{service general, null, negative}","{service general, null, negative}" +Nadam se da će se jednog dana Scooner ili kasnije vratiti ono što je nekad bilo.,"{restaurant general, Scooner ili kasnije, negative}","{restaurant general, Nadam, positive}" +"Kao prvo, hrana je stigla brzo i sve zajedno :) sviđa mi se to... mrzim pretencioznost stvari koje dolaze jedna za drugom.","{service general, null, positive}","{service general, null, positive}" +hrana je bila izvrsna!,"{food quality, hrana, positive}","{restaurant general, hrana, positive}" +"Ako postoji red na isti dan u tjednu cijelo vrijeme dok je mjesto otvoreno, znate da je to sjajno.","{restaurant general, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}" +Najugodnije iznenađenje bio je ček koji nije premašio moja očekivanja kako to uvijek biva u većini mjesta.,"{restaurant prices, null, positive}","{restaurant general, mjesto, positive}" +"U najboljem slučaju, hrana je bila dobra i definitivno precijenjena.","{food quality, hrana, positive};{food prices, hrana, negative}","{food quality, hrana, positive}" +Vanjska terasa ima skraćeni izbornik .,"{food style_options, izbornik, neutral}","{food quality, izbornik, negative}" +Najbolje indijska hrana u L.A.,"{food quality, indijska hrana, positive}","{restaurant general, indija, positive}" +Prijeđite na stvar - ovo je nevjerojatno!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"hrana nije ono što je nekada bila ( napitci došlo je do ozbiljnog smanjenja) cijene su porasle, a usluga je najgora stvar koju sam igdje doživio (uključujući kopnenu Europu).","{service general, usluga, negative};{food style_options, napitci, negative};{food quality, hrana, negative};{food prices, hrana, negative}","{food quality, hrana, negative};{service general, usluga, negative};{drinks prices, napitci, negative}" +Libanonska hrana ! Njam!,"{food quality, Libanonska hrana, positive}","{restaurant general, Liban, positive}" +brokoli bili su tako svježi i ukusni.,"{food quality, brokoli, positive}","{food quality, brokoli, positive}" +I daju dobru količinu za cijenu.,"{food style_options, null, positive}","{food quality, koli, positive}" +Vrlo razočaravajuće,"{restaurant general, null, negative}","{restaurant general, Vrlo, negative}" +NAJBOLJE u Seattleu Popis vina,"{drinks style_options, Popis vina, positive}","{restaurant general, NAJ, positive}" +– Ne mogu reći dovoljno o ovome mjesto .,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}" +– jedem na ovom mjestu već više od 8 godina i nikad nisam pojeo niti jedan loš obrok .,"{food quality, obrok, positive}","{food quality, obrok, positive}" +Otišao sam kući i ponovno ih potražio na mreži gdje sam otkrio da postoji poveznica za darivanje koja ne radi pa sam poslala e-poruku restoranu o nepostojećoj usluzi i obmanjujućoj vezi.,"{restaurant miscellaneous, restoranu, negative}","{service general, veza, negative};{service general, usluga, negative}" +Otmjeni komadi egzotične ribe na 100 dolara tanjur i NI JEDAN se nije mogao jesti.,"{food quality, egzotične ribe, negative};{food style_options, egzotične ribe, negative};{food prices, tanjur, negative}","{food quality, egzotne ribe, negative};{food prices, egzotne ribe, negative}" +"Imao sam ukusno janjeća korma , saag paneer , samose , naan itd.","{food quality, samose, positive};{food quality, naan, positive};{food quality, janjeća korma, positive};{food quality, saag paneer, positive}","{food quality, korma, positive};{food quality, naan, positive};{food quality, imao, positive};{food quality, samose, positive}" +Poslužuje jako dobro sushi.,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"Kao i obično, omikase nije razočarao u svježini, iako je dobio niske ocjene za kreativnost i odabir.","{food style_options, omikase, negative};{food quality, omikase, positive}","{food quality, om, positive};{food style_options, odabir, negative};{food style_options, kreativnost, negative}" +"Riža je presuha, tuna nije bila ni tako svježa.","{food quality, Riža, negative};{food quality, tuna, negative}","{food quality, Riža, positive};{food quality, tuna, positive}" +Njihovo rakova jaja benedict stvara ovisnost.,"{food quality, rakova jaja benedict, positive}","{food quality, jantice, positive}" +Sačuvajte mjesta za ukusne deserti .,"{food quality, deserti, positive}","{food quality, desert, positive}" +Naš poslužitelj bio je vrlo profesionalan i ljubazan.,"{service general, poslužitelj, positive}","{service general, poslužitel, positive}" +Otišao sam ovdje na preporuku i sigurno ću se vraćati uvijek iznova.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"hrana je bila dobra, ali je bila previše blaga.","{food quality, hrana, positive};{food quality, hrana, negative}","{food quality, hrana, negative};{food quality, hrana, negative}" +– Moj suprug i ja volimo jesti u Mioposto Café .,"{restaurant general, Mioposto Café, positive}","{restaurant general, Mioposto, positive}" +– Ovo je bilo sjajno iskustvo objedovanja.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Osoblje bilo je stvarno ljubazno.,"{service general, null, positive}","{restaurant general, Osoblje, positive}" +Lako smo potrošili više od 40 dolara po osobi (ne uključujući alkohol) i još uvijek smo bili gladni.,"{restaurant prices, null, negative};{food style_options, null, negative}","{restaurant prices, Lako, negative};{restaurant general, Lako, negative}" +Ovo je ravno među mjestima u Tokiju što se tiče svježine.,"{food quality, null, positive}","{food quality, null, positive}" +Groovy glazba učinio je večeru ležernom.,"{ambience general, glazba, positive}","{restaurant general, glazba, positive}" +"Nakon što je jednog člana naše stranke više puta udarila konobarica, ljubazan zahtjev da ne bude udaren doveo je konobaricu do uvredljivog brbljanja.","{service general, konobarica, negative}","{service general, konobarica, negative}" +– Ray's (iznenađujuće) ima NAJBOLJE i najraznolikije u gradu vinska karta.,"{drinks style_options, vinska karta, positive}","{drinks style_options, vinska karta, positive}" +Vjerojatno se ipak ne bih vratio jer ne znam je li to vrijedno toga.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"čips i salsa su tako ukusni, a cijene su fantastične.","{restaurant prices, null, positive};{food quality, čips i salsa, positive}","{food quality, cijene, positive};{food quality, čips i salsa, positive}" +"sommelier je fantastičan, prizeman i izuzetno obrazovan.","{service general, sommelier, positive}","{service general, sommelier, positive}" +velika gusta feferoni,"{food style_options, feferoni, positive}","{food quality, feferoni, positive}" +Ne isplati se uopće ići i trošiti novac tamo! ! !,"{restaurant general, null, negative}","{restaurant prices, Ne, negative};{restaurant general, Ne, negative}" +Uvredljivo precijenjen,"{restaurant prices, null, negative}","{restaurant general, null, negative}" +Unutrašnji ambijent je bio moderan.,"{ambience general, Unutrašnji ambijent, positive}","{ambience general, ambijent, positive}" +NE IDITE!,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"Dok se to ne dogodi, moj savjet je da se DRŽITE DALJE.","{restaurant general, null, negative}","{restaurant general, Dok, negative}" +"Oh, zaboravio sam spomenuti da oni nemaju uslugu kruha.","{service general, null, negative}","{food quality, kruha, negative}" +Nisu masni ni ništa.,"{food quality, null, positive}","{restaurant general, null, negative}" +"glazba je sjajna, nijedna noć nije bolja ni gora, barske nježnosti su velikodušne s točenjem, a lagana atmosfera podići će vam raspoloženje.","{ambience general, atmosfera, positive};{drinks style_options, barske nježnosti, positive};{ambience general, glazba, positive}","{ambience general, glazba, positive};{ambience general, lagana atmosfera, positive};{drinks quality, barske nježnosti, positive}" +"Lijepo ambijent, ali jako precijenjeno mjesto.","{restaurant general, mjesto, negative};{ambience general, ambijent, positive}","{restaurant prices, mjesto, negative};{ambience general, ambijent, positive}" +sushi ovdje je izvrstan!,"{food quality, sushi, positive}","{food quality, sushi, positive}" +– Izuzetno mi je drago izvijestiti da je moja večera u Ray's Boathouse prošlog petka u potpunosti nadmašila moja očekivanja.,"{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's, positive}" +"Večere uvijek su bile izvrsne, u smislu kvalitete hrane.","{food quality, Večere, positive}","{food quality, hrane, positive}" +Sve njihove aplikacije su ukusne.,"{food quality, aplikacije, positive}","{food quality, aplikacije, positive}" +Blue Ribbon opravdava svoju fantastičnu reputaciju.,"{restaurant general, Blue Ribbon, positive}","{restaurant miscellaneous, Blue Ribbon, positive}" +Osjećao sam se neugodno i sljedeći put sam otišao u toalet u kasinu.,"{restaurant miscellaneous, null, negative}","{restaurant general, kasino, negative}" +– Odlučio sam jesti u Stacku zbog njihove fiksna cijena večere prije nastupa .,"{food prices, fiksna cijena večere prije nastupa, neutral}","{food quality, večera, negative};{food prices, večera, negative}" +– Odveo sam svoje roditelje ovamo za njihovu godišnjicu – jako jako razočaran! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Nepobjedivo sushi!,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"Za početak, naš ljupki poslužitelj Brooke brzo je bio spreman preuzeti moju narudžbu pića.","{service general, Brooke, positive}","{service general, poslužitelj, positive}" +Svaki put kad se pozove `` 0-sixtynine `` barmen svima kupi piće!,"{service general, barmen, positive}","{restaurant general, Svaki put, positive}" +"Beskrajna zabava, super glazba, sjajno osoblje! ! !","{restaurant general, null, positive};{service general, osoblje, positive};{ambience general, glazba, positive}","{food quality, glazba, positive};{restaurant general, Besk, positive};{food quality, zabava, positive}" +Sajam odabir jelovnika .,"{food style_options, odabir jelovnika, neutral}","{restaurant general, Sajam, positive}" +Dva klinca bezobraznika sjedila su blizu nas u prvom dijelu naše večere... zamijenila ih je ljupka predtinejdžerka koja se pretvarala da guši svaki put kad bi se spomenuli morski plodovi za njezinim stolom.,"{restaurant miscellaneous, null, negative}","{service general, predtinejdžerka, negative}" +Odbio sam to jer su u procesu pokušaja popravka jaja razbili nešto drugo u posudi i bio sam previše frustriran da nastavim.,"{food quality, posudi, negative}","{food quality, poprvak, negative}" +"imao je mnogo jela, ali NAJBOLJE je bilo jastog na 3 načina.","{food quality, jastog na 3 načina, positive}","{food quality, jela, negative};{food style_options, jela, negative};{food quality, jastog, negative}" +"predjelo bilo je zanimljivo, ali Creme Brulee bilo je vrlo ukusno i ukusno.","{food quality, Creme Brulee, positive};{food quality, predjelo, positive}","{food quality, Creme Brulee, positive};{food quality, predjelo, positive}" +dekor je bio lijep i jedinstven.,"{ambience general, dekor, positive}","{ambience general, dekor, positive}" +"Svjež je, gostoljubiv, ukusan i opuštajući.","{food quality, null, positive};{ambience general, null, positive}","{restaurant general, null, positive}" +Stvara ovisnost!,"{restaurant general, null, positive}","{restaurant general, null, negative}" +"Čak je i slanutak, koji inače smatram presuhim, bio dobar.","{food quality, slanutak, positive}","{food quality, slatko, positive}" +Ovo mjesto je super! !,"{restaurant general, mjesto, positive}","{food quality, ovo mjesto, positive}" +"To je veliki kompliment, pogotovo u nestalnom restoranskom poslu,... dosta je već!","{restaurant general, null, positive}","{food style_options, null, positive}" +"Nakon što sam sjedio s praznom čašom više od 20 minuta, otišao sam.","{service general, null, negative}","{service general, null, negative}" +Obavezno probajte rolada od kamenica .,"{food quality, rolada od kamenica, positive}","{food quality, kamenica, positive}" +Začuđen sam da je ovaj restoran kategoriziran kao $ $ $ umjesto kao $ $ $ $.,"{restaurant prices, restoran, negative}","{restaurant prices, restoran, negative}" +"Bilo je pristojno, ali ništa posebno.","{food quality, null, neutral}","{restaurant general, null, neutral}" +"Usluga je bila malo spora, našoj konobarici je trebala čitava vječnost da nam da ček iako nije bilo toliko zauzeto.","{service general, konobarici, negative};{service general, Usluga, negative}","{service general, Usluga, negative}" +"– Odlično pića , hašiš od kukuruzne govedine , kava , B Brzi burritos , Bez glutena jelovnik .","{food quality, hašiš od kukuruzne govedine, positive};{drinks quality, pića, positive};{food style_options, jelovnik, positive};{drinks quality, kava, positive};{food quality, B Brzi burritos, positive}","{food quality, Bez glutena, positive};{food quality, hašiš od kukurzne govedine, positive};{food quality, pića, positive};{food quality, Brzi burritos, positive}" +meni za ručak je sjajna ponuda!,"{food prices, meni za ručak, positive}","{restaurant general, null, positive}" +"Zauvijek je trajalo da preuzmemo našu narudžbu, nadopunjavanje vode bilo je previše za tražiti, a jedini put kad je bila brza bilo je kad smo tražili naš račun kada smo mogli privući njezinu pozornost.","{service general, null, negative}","{service general, null, negative}" +konobar je bio malo neprijateljski raspoložen i osjećaj u restoranu je bio prepun.,"{ambience general, osjećaj, negative};{service general, konobar, negative}","{restaurant miscellaneous, konja bar, negative};{ambience general, restoran, negative}" +– Nedavno sam imao zadovoljstvo večerati u ovom divnom restoranu u 2. ulici i vau kakvu smo sjajnu večer proveli.,"{restaurant general, restoranu, positive}","{restaurant general, restoranu, positive}" +"Specijalitet je ovdje dekadentan palačinke, ali vratio sam se već četiri puta i svaki put sam bio zadivljen.","{food quality, palačinke, positive}","{food quality, palačinke, positive}" +– Prilično jeftino za meksičko sjedište I centar grada.,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant prices, null, positive};{restaurant general, null, positive}" +"predjelo od kamenica, jastoga, rakova (male veličine) bilo je savršeno predjelo za moju ženu.","{food quality, predjelo od kamenica, jastoga, rakova (male veličine, positive}","{food quality, predjelo, positive}" +Upravo sam saznao da možete imati mjesto samo za sebe noću i vikendom za privatnu zabavu - jedva čekam da tamo proslavim moj sljedeći rođendan.,"{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}" +"– Kao i kod većine restorana u Seattleu, Mioposto usluga je bio loš, a hrana precijenjena.","{service general, usluga, negative};{food prices, hrana, negative}","{service general, usluga, negative};{food quality, hrana, negative}" +"Možete ga lako čuti, pa je to bio ugodan zvuk, a ne prenaglašen.","{ambience general, null, positive}","{restaurant general, null, positive}" +Samo idite tamo i uvjerite se sami.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +To je sjajno malo mjesto s tonama potencijala da bude mjesto u susjedstvu da usluga nije tako bezlična i korporativna.,"{restaurant general, mjesto, positive};{service general, usluga, negative}","{service general, usluga, negative};{ambience general, mjesto, positive}" +"Brunch kod Murphyja je za umrijeti, moj specijalitet ... omlet od bjelanjaka , hrana uvijek je svježe pripremljena.","{food quality, omlet od bjelanjaka, positive};{food quality, Brunch, positive};{food quality, hrana, positive}","{food quality, omlet od bjelanjaka, positive};{food quality, hrana, positive}" +Mama Mia – Živim u susjedstvu i osjećam se sretnom što živim pored tako sjajne pizzerija .,"{restaurant general, pizzerija, positive}","{restaurant general, pizzerija, positive}" +– ušuškan pokraj Beverly Centera.,"{location general, null, neutral}","{restaurant general, null, positive}" +osoblje je prilično ljubazno.,"{service general, osoblje, positive}","{restaurant general, osoblje, positive}" +A usluga je jednostavno bila potrošena - pravi užitak.,"{service general, usluga, positive}","{food quality, usluga, positive}" +Ok ... – Možda sam ušao na nečiji loš dan ...,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"Uzeo sam Meduza, Skuš, Plava perajna tuna i Sake Ikura rolada među ostalima, i svi su bili dobri.","{food quality, Plava perajna tuna, positive};{food quality, Sake Ikura rolada, positive};{food quality, Skuš, positive};{food quality, Meduza, positive}","{food quality, Plava perajna, positive};{food quality, Sake, positive};{food quality, Meduza, positive};{food quality, Ikura rolada, positive};{food quality, Skuš, positive}" +ŠTO JOŠ MOŽETE REĆI LIJEPO LJUDI NEVJEROJATNO HRANA WOW,"{food quality, HRANA, positive};{service general, LJUDI, positive}","{restaurant general, null, positive}" +Uvijek dobro.,"{restaurant general, null, positive}","{food quality, null, positive}" +Nakon toga su mi se usta jako osušila i imala sam taj potpis? MSG ? okus koji mi ostaje u grlu nakon što sam napustio restoran.,"{food quality, null, negative}","{food quality, toga, negative};{restaurant general, restoran, negative}" +O da ... pogled je također bio dobar.,"{location general, pogled, positive}","{food quality, null, positive}" +"upravitelj je stalno prekidao s `` Mogu li još nešto učiniti za vas? ``, čudan komentar jer jedva da je slušala, a kamoli odgovorila na naš izraz razočaranja našim iskustvom.","{service general, upravitelj, negative}","{service general, upravitelj, negative}" +servis kreće se od osrednjeg do uvredljivog.,"{service general, servis, negative}","{service general, servis, negative}" +Svježe sastojci i super ukusno.,"{food quality, sastojci, positive};{food quality, null, positive}","{food quality, sastojci, positive};{food quality, null, positive}" +ambijent restorana bio je lijep i dobar za finu večeru.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive};{restaurant general, restor, positive}" +A gore je odlično mjesto za druženje.,"{ambience general, gore, positive}","{restaurant general, mjesto, positive}" +– Nije loše.,"{restaurant general, null, neutral}","{restaurant general, null, negative}" +Imao sam kafta tanjur i bio je savršen.,"{food quality, kafta tanjur, positive}","{food quality, kafta, positive}" +– Ovo je mjesto poznato po doručak .,"{food quality, doručak, positive}","{food quality, ovo, positive}" +Čekali smo 35 minuta na stol za 8 što je bilo u redu za tako veliku gužvu.,"{service general, null, neutral}","{restaurant miscellaneous, gužva, negative};{service general, null, negative}" +Cjelokupno osoblje bilo je izuzetno susretljivo i zadovoljilo je svaku moju potrebu.,"{service general, osoblje, positive}","{food quality, osoblje, positive}" +"Mjesto je bilo jako lijepo vibra ... dobro glazba , atmosfera i sretnog izgleda ljudi .","{ambience general, vibra, positive};{ambience general, atmosfera, positive};{restaurant miscellaneous, ljudi, positive};{ambience general, glazba, positive}","{ambience general, atmosfera, positive};{ambience general, izgleda, positive};{ambience general, glazba, positive}" +"Isprobajte Chefov izbor za sushi jer je dimljeni žuti rep bio nevjerojatan, a rolice također su bile ukusne.","{food quality, Chefov izbor za sushi, positive};{food quality, rolice, positive};{food quality, dimljeni žuti rep, positive}","{food quality, rolice, positive};{food quality, izbor za sushi, positive};{food quality, dimljeni žuti rep, negative}" +"sushi je svjež kao što dolazi? pomislili biste da je ocean u njihovom dvorištu, bez šale!","{food quality, sushi, positive}","{food quality, sushi, positive}" +"hrana je bila u redu, s malo-ukusnijom-od-normalnog salsa .","{food quality, salsa, positive};{food quality, hrana, positive}","{food quality, salsa, negative};{food quality, hrana, negative}" +"Za izbirljive ljubitelje sushija i one koji su kušali najbolje što NYC može ponuditi, riba je najsvježija, a usluga vrhunska.","{service general, usluga, positive};{food quality, riba, positive}","{service general, usluga, positive};{food quality, riba, positive}" +Stari Pouzdan,"{restaurant general, null, positive}","{restaurant general, Pouz, positive}" +Jedan od najboljih Sushi mjesto u gradu.,"{restaurant general, Sushi mjesto, positive}","{food quality, Sushi, positive}" +"Hrana što se tiče hrane, u redu je, ali malo skupo za ono što dobijete s obzirom da restoran nije otmjeno mjesto.","{food quality, Hrana, neutral};{restaurant prices, restoran, negative};{ambience general, restoran, neutral}","{food quality, Hrana, negative};{food prices, Hrana, negative};{ambience general, restoran, negative}" +"– Volim njihovu pizzu, posebno pizzu s gljivama.","{food quality, pizza, positive};{food quality, pizzu s gljivama, positive}","{food quality, pizzu s gljivama, positive};{food quality, pizzu, positive}" +Došli su u vlastitoj otmjenoj kutiji za van i s domaćom glazurom; vrlo lagano i ne preslatko.,"{food quality, null, positive}","{ambience general, kutija, positive}" +Uživao sam u hrana,"{food quality, hrana, positive}","{food quality, hrana, positive}" +Bio sam u ovom restoranu više od desetak puta bez pritužbi do danas.,"{restaurant general, restoranu, positive}","{restaurant general, restoranu, positive}" +"Radije ga naručim i pokupi jer mi se ne sviđaju poslužitelji, posebno jedna mlada žena.","{service general, mlada žena, negative};{service general, poslužitelji, negative}","{service general, žena, negative};{food quality, poslužitelji, negative}" +strašan nalaz,"{restaurant general, null, positive}","{restaurant general, nal, negative}" +"Nije bio najsvježiji plodovi mora ikada, ali okus i prezentacija bili su u redu.","{food quality, plodovi mora, neutral};{food style_options, plodovi mora, neutral}","{food quality, plodovi, positive};{food style_options, plodovi, positive};{service general, prezentacija, positive}" +"Međutim, vrijednost i usluga jako nedostaju.","{service general, usluga, negative};{restaurant prices, null, negative}","{service general, usluga, negative};{food quality, vrijednost, negative}" +U Grammercy/Union Square/East Village ovo su moji susjedi i moj favorit mjesto .,"{restaurant general, mjesto, positive}","{restaurant general, Grammer/Union Square/East Village, positive}" +"strana krumpira je za umrijeti, kao i labne (umak od jogurta).","{food quality, strana krumpira, positive};{food quality, labne (umak od jogurta, positive}","{food quality, krumpira, positive};{food quality, labne (jogurta, positive}" +NEVJEROJATNO .,"{restaurant general, null, positive}","{restaurant general, JAT, negative}" +"Kakva ukusna, pahuljičasta poslastica!","{food quality, null, positive}","{food quality, poslastica, positive}" +"Odlično hrana, bolje Margarite!","{drinks quality, Margarite, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{food quality, Margarita, positive}" +usluga je stvarno pažljiva i šarmantna.,"{service general, usluga, positive}","{ambience general, usluga, positive}" +"Što je najvažnije, bili smo toliko uzbuđeni zbog hrane nakon što smo vidjeli vrlo kreativan jelovnik.","{food style_options, jelovnik, positive}","{food style_options, jelovnik, positive};{food quality, hrana, positive}" +Udoban mjesto za 2,"{ambience general, mjesto, positive}","{restaurant general, Udoban, positive}" +Najbolja stvar je što su cijene također prilično razumne.,"{restaurant prices, null, positive}","{food quality, null, positive}" +"Obećala je da će razgovarati s konobaricom koja je odletjela u bijesu, ali teško da smo njezino obećanje mogli shvatiti ozbiljno, budući da se nije potrudila saznati ime konobarice.","{service general, null, negative}","{service general, konobarica, negative}" +chana masala (garbanzo grah) također je izvrstan.,"{food quality, chana masala (garbanzo grah, positive}","{food quality, chana masala (gabanzo), positive}" +"Ovo ustanova je doista značajno opalo nakon (a to se ponavlja) emitiranja FOOD TELEVISIONS `` DINERS , DRIVE-INS AND DIVES `` čiji je domaćin bio Guy Fieri , u kojem je Schooner or Later bio predmet .","{restaurant general, ustanova, negative}","{restaurant miscellaneous, Ovo ustanova, negative}" +Volim Dungeness rakove i kod Raya ih možete poslužiti na otprilike 6 različitih načina!,"{food style_options, Dungeness rakove, positive}","{food style_options, null, positive}" +Hrana je bila dobra i ukusna.,"{food quality, Hrana, positive}","{food quality, Hrana, positive}" +Bilo je apsolutno nevjerojatno.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Ovo je odlično mjesto za ukusan obrok .,"{food quality, obrok, positive}","{restaurant general, mjesto, positive}" +"plus, ja sam alergičan na rižu, a konobar je bio nevjerojatno susretljiv -- nisam ni trepnuo okom!","{service general, konobar, positive}","{restaurant general, konobar, negative};{food quality, rižu, negative}" +– Jako sam se razočarao hranom u Pagodi.,"{food quality, hranom, negative}","{restaurant general, Pagoda, positive}" +Precijenjen,"{restaurant prices, null, negative}","{restaurant general, null, positive}" +Ovo je tužno zbog onoga što je nekoć bilo jedno od najboljih mjesta na kojima ste ikada mogli jesti.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"Kada uđete unutra, počinje pravo iskustvo.","{restaurant general, null, positive}","{ambience general, null, positive}" +a konobar je predložio savršen sake ! !,"{drinks quality, sake, positive}","{drinks quality, sake, positive}" +vlasnik je ratoboran prema gostima koji imaju pritužbu.,"{service general, vlasnik, negative}","{service general, vlasnik, negative}" +"Sve što želite i još više, vrlo svježe.","{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive}" +Moj prijatelj je uživao u Aljaski kraljevski losos na žaru s ukusnim Washington russet krumpir u kremi i hrskavim zeleni grah .,"{food quality, zeleni grah, positive};{food quality, Aljaski kraljevski losos na žaru, positive};{food quality, Washington russet krumpir u kremi, positive}","{food quality, Aljaski kraljevski losos na žaru, positive};{food quality, Washington russet krumpir u kremi, positive};{food quality, zeleni grah, positive}" +"hrana je bila vrlo dobra, file mignon je vjerojatno najbolja koju sam ikada probao.","{food quality, hrana, positive};{food quality, file mignon, positive}","{food quality, hrana, positive};{food quality, file mignon, positive}" +"– Mercedesov restoran je tako ukusan, usluga je nedvojbeno sjajna!","{service general, usluga, positive};{food quality, null, positive}","{service general, usluga, positive};{ambience general, Mercedesov restoran, positive}" +Mogu toplo preporučiti njihove različite saag i paneer i korma .,"{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}" +hrana je sjajna i zli su Krvava Mary.,"{drinks quality, Krvava Mary, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{food quality, Krvava Mary, positive}" +"Fino hrana, ali bez začina!","{food quality, hrana, positive};{food quality, hrana, negative}","{food quality, hrana, negative}" +Još jedan plus je otvoren osjećaj restorana sa staklenim zidovima sa svih strana.,"{ambience general, osjećaj, positive}","{ambience general, stakleni zidovi, positive}" +Njam!,"{food quality, null, positive}","{restaurant general, Njam, positive}" +"Sama kupaonica je vrlo mala s dva WC-a i samo jednim umivaonikom, djevojka je ostala potpuno usput vješajući papirnate ručnike iz automata.","{restaurant miscellaneous, kupaonica, negative}","{ambience general, kupaonica, negative};{service general, djevojka, negative}" +Volite enchiladas i pileća juha - i svakako pogledajte njihove specijaliteti .,"{food quality, enchiladas, positive};{food quality, pileća juha, positive};{food quality, specijaliteti, positive}","{food quality, enchiladas, positive};{food quality, specijaliteti, positive}" +hrana je jednostavno nezaboravna!,"{food quality, hrana, positive}","{restaurant general, hrana, positive}" +Menadžment bi stvarno trebao obratiti pozornost i trenirati svoje konobarstvo i naučiti ih nekim pravilnim manirima.,"{service general, konobarstvo, negative}","{service general, Menadžment, negative}" +"osoblje je ljubazno, a dekor je bio etičan i šaren.","{ambience general, dekor, positive};{service general, osoblje, positive}","{ambience general, a, positive};{food quality, osoblje, positive}" +Najbolji Chuwam Mushi koji sam ikada imao.,"{food quality, Chuwam Mushi, positive}","{restaurant general, Chuwam, negative}" +"Porcije bilo je sasvim dovoljno za mene, ali možda nije za nekog ko jede puno.","{food style_options, Porcije, neutral}","{food style_options, null, negative};{food quality, null, positive}" +Probajte Pizza Ensalata!,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza, positive}" +Ipak bih preporučio ovo mjesto.,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}" +"– sushi ovdje je savršeno dobar, ali za 5 dolara po komadu, ili bi kriške ribe trebale biti veće ili se ne bi trebalo pretvarati da je ovo restoran umjerene cijene (čak i za NYC) .","{food prices, sushi, negative};{food style_options, sushi, negative};{food quality, sushi, positive};{restaurant prices, restoran, negative}","{food quality, sushi, positive};{food prices, komadu, negative}" +Sigurno ćete se provesti vrlo šarmantno.,"{restaurant general, null, positive}","{restaurant general, Sigurno, positive}" +"Od tada smo se vratili i također smo imali sjajno iskustvo, kušajući više malih tanjura i raznovrsno pivo (hladno i dobro).","{restaurant general, null, positive};{drinks quality, pivo, positive}","{food quality, tanjura, positive};{drinks quality, pivo, positive}" +Najbolji Sushi u gradu.,"{food quality, Sushi, positive}","{food quality, Sushi, positive}" +osoblje bilo je vrlo lijepo i ljubazno i očito kinesko.,"{service general, osoblje, positive}","{food quality, osoblje, positive};{restaurant general, null, positive}" +"Naručili smo izbor malih tanjura, a luk na cipelama, pizza s kozjim sirom, šparoge na žaru i prženi brie s voćem svi su bili vrlo dobri.","{food quality, luk na cipelama, positive};{food quality, šparoge na žaru, positive};{food quality, pizza s kozjim sirom, positive};{food quality, prženi brie s voćem, positive}","{food quality, pizza s kozjim sirom, positive};{food quality, šparoge na žaru, positive};{food quality, prženi brie s voćem, positive};{food quality, luk na cipelama, positive};{food quality, malih tanjura, positive}" +Dobar posao!,"{restaurant general, null, positive}","{restaurant general, Dobar, positive}" +"Ipak, jedna stvar koju sam kasnije shvatio je da je restoran ili koristio MSG ili uređaj za omekšavanje mesa na odrezak.","{food quality, odrezak, negative}","{food quality, odrezak, negative}" +Sjajno izbor sakea .,"{drinks style_options, izbor sakea, positive}","{drinks quality, sake, positive}" +Svaka čast ovim momcima.,"{restaurant general, null, positive}","{service general, mom, positive}" +"Osim ako ne svraćate samo na nekoliko pića, ne bih preporučio da idete ovamo.","{restaurant general, null, negative}","{restaurant general, null, negative}" +Sjajno boca vina .,"{drinks quality, boca vina, positive}","{food quality, vina, negative}" +otvoreni kombinirani tanjur sa sezamom je povoljna cijena za hrpu hrane koja se daje.,"{food style_options, otvoreni kombinirani tanjur sa sezamom, positive};{food prices, otvoreni kombinirani tanjur sa sezamom, positive}","{food quality, hrane, positive};{food prices, hrane, positive}" +PUNO PRECIJENJENO! ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Isplatilo se čekati,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Ne može biti bolje od toga.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +najbolje kozice od meda koje smo svi probali.,"{food quality, kozice od meda, positive}","{food quality, kozice, positive}" +Prikazani su na mreži hrane i to zaslužuju.,"{restaurant miscellaneous, null, positive}","{food quality, hrane, positive}" +Volim toplo i ugodno okruženje .,"{ambience general, okruženje, positive}","{restaurant general, null, positive}" +Šmrkavi stav,"{service general, null, negative}","{restaurant general, Šmr, positive}" +"atmosfera je ambiciozna, a dekor je svečana i nevjerojatna ...","{ambience general, dekor, positive};{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive};{ambience general, dekor, positive}" +"Njihove specijalne rolice su impresivne, iako se ne sjećam što smo imali.","{food quality, specijalne rolice, positive}","{food quality, roslci, positive}" +– Volio sam raviole od bundeve i njoke od kozjeg sira (5 velikih na tanjur umjesto 20-ak malih njoka) i moja sestra ju je obožavala filet mignon na vrh špinata i pire krumpir .,"{food quality, raviole od bundeve, positive};{food quality, filet mignon na vrh špinata i pire krumpir, positive};{food quality, njoke od kozjeg sira, positive};{food style_options, njoke od kozjeg sira, positive}","{food style_options, raviole od bundeve, positive};{food quality, njoke od kozjeg sira, positive};{food quality, filet mignon na vrh špinata, positive}" +"Nije najveći porcije, ali primjeren.","{food style_options, porcije, neutral}","{food style_options, porc, negative};{food quality, porc, positive}" +"Idite s prijateljima, pričekajte pola sata uz šalicu joea i uživajte više od svog prosjeka doručak.","{restaurant general, null, positive};{food quality, doručak, positive}","{drinks style_options, šalicu, positive};{food quality, doručak, positive}" +super usluga .,"{service general, usluga, positive}","{restaurant general, usuga, negative}" +"Tada nam je naplaćen njihov najskuplji sake (20 dolara + po porciji), dok smo zapravo pili sake manji od pola te cijene.","{service general, null, negative}","{drinks prices, sake, negative};{drinks quality, sake, negative}" +ukusno,"{food quality, null, positive}","{restaurant general, null, negative}" +pileći curry i pileća tikka masala su moja omiljena jela od mesa.,"{food quality, pileći curry, positive};{food quality, pileća tikka masala, positive}","{food quality, pileća tikka masala, positive};{food quality, curry, positive}" +"najbolji restoran na svijetu, odličan dekor, odličan služba za korisnike, prijateljski upravitelj","{restaurant general, restoran, positive};{ambience general, dekor, positive};{service general, služba za korisnike, positive};{service general, upravitelj, positive}","{service general, služba za korisnike, positive};{restaurant general, restoran, positive};{ambience general, dekor, positive};{service general, upravitelj, positive}" +pića su bila dobra.,"{drinks quality, pića, positive}","{drinks quality, pića, positive}" +"Prezentacija hrane bila je dodatni bonus, izgledala je jednako dobro kao i okusa!","{food style_options, hrane, positive};{food quality, hrane, positive}","{food style_options, hrana, positive};{food quality, hrana, positive}" +Čak ni tada narudžba nije bila točna i još smo čekali par stvari.,"{service general, null, negative}","{service general, narudba, negative}" +– Ovdje su nas jednom vrlo grubo ponijeli za doručkom.,"{service general, null, negative}","{food quality, doručak, negative}" +"Sjajna hrana, spektakularna lokacija i ljubazna usluga tjeraju nas da se vraćamo iz godine u godinu.","{location general, lokacija, positive};{service general, usluga, positive};{food quality, hrana, positive}","{location general, lokacija, positive};{food quality, hrana, positive};{service general, usluga, positive}" +WOW ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +– Uštedite sebi gubljenje vremena i NEMOJTE posjećivati .,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Hrana je bila dobra i jeftina.,"{food quality, Hrana, positive};{food prices, Hrana, positive}","{food quality, Hrana, positive};{food prices, Hrana, positive}" +Mmm ... dobro !,"{restaurant general, null, positive}","{food quality, null, positive}" +Super je ako ste tamo proveli dan i niste se htjeli voziti da biste jeli.,"{location general, null, positive}","{restaurant general, null, negative}" +"Sve u svemu, moram reći da Ray's Boathouse zaslužuje svoju titulu institucije u Seattleu.","{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}" +Izvrsna vrijednost sushi uz visoku kvalitetu i lijepo okruženje.,"{ambience general, okruženje, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{food quality, sushi, positive};{ambience general, okruženje, positive}" +"Bilo je toliko puno da sam jedva uspio pojesti, ali jesam jer je bilo ukusno.","{food style_options, null, neutral};{food quality, null, positive}","{food quality, null, positive};{food style_options, null, negative}" +Sviđa mi se ovo restoran,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}" +Nije preporučljivo! ! !,"{restaurant general, null, negative}","{restaurant general, null, positive}" +Stajali smo tamo 10 minuta dok su zaposlenici hodali naprijed-natrag ignorirajući nas.,"{service general, zaposlenici, negative}","{service general, zaposlenici, negative}" +"Moj g/ž i ja smo se složili da je hrana vrlo osrednja, posebno s obzirom na cijenu.","{food quality, hrana, negative};{food prices, hrana, negative}","{food quality, hrana, negative};{food prices, hrana, negative}" +"– hrana ovdje je nevjerojatna, iako je kvaliteta nedosljedna tijekom ručka .","{food quality, ručka, negative};{food quality, hrana, positive}","{food quality, ručko, negative};{food quality, hrana, negative}" +Nemam ništa loše za reći o ovome mjesto.,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}" +"jedini problem je što stvarno morate zagrijati pizzu prije nego što postane jestiva, čak i kada naručite unaprijed.","{food quality, pizzu, negative}","{food quality, pizza, negative}" +– Ovo je moj `` koji moram dovesti goste iz grada u `` restoran i uvijek uživaju i oduševljeni su njime.,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}" +Imao sam tanjur za kaftu i uživao sam u njemu.,"{food quality, tanjur za kaftu, positive}","{restaurant general, Ima, positive}" +Bilo je jasno da mu nije stalo.,"{service general, null, negative}","{restaurant general, null, negative}" +Cezar salata koju sam naručio imala je toliko limuna da je nisam mogla pojesti.,"{food quality, Cezar salata, negative}","{food quality, salata, negative}" +"Naš poslužitelj je nastavio biti pažljiv tijekom cijele noći, ali ostao sam zbunjen jednim pitanjem: Tko misli da je Ray's prikladno mjesto za odvođenje male djece na večeru?","{service general, poslužitelj, positive};{restaurant miscellaneous, Ray's, neutral}","{service general, poslužitelj, positive};{restaurant miscellaneous, Ray's, negative}" +"Dobro Hrana, Odlično Usluga, Prosječne cijene (Za Strip)","{food quality, Hrana, positive};{restaurant prices, null, neutral};{service general, Usluga, positive}","{restaurant prices, Hrana, positive};{service general, Usluga, positive};{restaurant general, Hrana, positive}" +18:00 u subotu prije predstave na Broadwayu i brzo smo sjeli i bili posluženi.,"{service general, null, positive}","{service general, null, positive}" +"Oni posvećuju toliko detalja svemu, od miso juha do složenih peciva.","{food quality, miso juha, positive};{food quality, peciva, positive}","{food style_options, peciva, positive};{food quality, miso juha, positive}" +6 dolara s napojnicom.,"{restaurant prices, null, positive}","{restaurant general, napic, positive}" +atmosfera je bila sjajna.,"{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive}" +"Drugim riječima, ako oni 'ne zarađuju $ $ na vama, onda nemate visoku ocjenu na njihovoj 'usluga ljestvici'.","{service general, usluga, negative}","{service general, usluga, negative}" +– Stvarno sam uživao u obroku ovdje.,"{food quality, obroku, positive}","{restaurant general, null, positive}" +"glazba svirala je vrlo moderno, 20-30 nešto pop glazba, ali subwoofer za zvučni sustav nalazio se ispod mog sjedala, što je postalo iritantno usred večere.","{ambience general, subwoofer za zvučni sustav, negative};{ambience general, glazba, positive}","{ambience general, subwoofer, negative};{ambience general, glazba, negative}" +Sveto Humus!,"{food quality, Humus, positive}","{food quality, Humus, negative}" +"Za moj ulaz & eacute ; e, potpuno sam uživao u prženim aljaškim morskim kapicama upotpunjenim blitvom, srcima artičoke, komoračem i pecorinom toscanom.","{food quality, prženim aljaškim morskim kapicama, positive};{food style_options, prženim aljaškim morskim kapicama, positive}","{food quality, prženim aljaškim morskim kapicama upotpunjenim blitvom, positive};{food quality, srcima artičoke, positive};{food quality, pecorinom toscanom, positive}" +"dekor je rustikalni, tradicionalni japanski.","{ambience general, dekor, neutral}","{ambience general, dekor, positive}" +"Ne samo da izbor može biti inovativan, već postoji i lijepa ravnoteža tradicionalnog sushija.","{food style_options, sushija, positive};{food style_options, izbor, positive}","{food style_options, sushija, positive};{food quality, sushija, positive}" +Vjerojatno ćete biti razočarani.,"{restaurant general, null, negative}","{restaurant general, Vjero, positive}" +"hrana je sjajna, barmeni idu dalje.","{service general, barmeni, positive};{food quality, hrana, positive}","{restaurant general, hrana, positive}" +Restoran nudi opsežnu vinska karta i ambijent koji nećete zaboraviti!,"{drinks style_options, vinska karta, positive};{ambience general, ambijent, positive}","{drinks style_options, vinska karta, positive};{ambience general, ambijent, positive}" +"naan je bio jedan od najboljih koje sam jeo i stvarno sam uživao u bhartha, ne previše rajčici.","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, naan, positive};{food quality, bhartha, positive}" +Vlasnicima Open Sesame ... Bravo ... Jedva čekam vratiti se na ručak u vaš restoran!,"{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}" +"riba je bila svježa, iako je bila izrezana vrlo tanko.","{food style_options, riba, negative};{food quality, riba, positive}","{food quality, riba, negative};{food style_options, riba, negative}" +Bio sam tamo puno otad i uvijek se dobro provedem.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Moj favorit pizzerija u Seattleu,"{restaurant general, pizzerija, positive}","{restaurant general, pizzeria, positive}" +toplo preporučujem ovo mjesto svima koji žele probati indain hrana po prvi put.,"{food quality, indain hrana, positive}","{food quality, indain food, positive}" +Precijenjeno,"{restaurant general, null, negative}","{restaurant general, Precijen, positive}" +Najgori usluga koji sam ikada imao,"{service general, usluga, positive}","{restaurant general, usluga, negative}" +"Ispostavilo se da je vlasnik sjedio tik do nas i kada je došao provjeriti naše probleme, bio je vrlo omalovažavajući i ponudio simboličnih 20% popusta na naš račun.","{service general, vlasnik, negative}","{service general, vlasnik, negative}" +Otišao sam tamo s nekim prijateljima jedne večeri igrati bingo i gledati utakmicu soxa i bilo je fantastično!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +POTPUNO PRECIJENJENO!,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"– jaja , palačinke , krumpir , svježe voće i jogurt -- sve što poslužuju je ukusno.","{food quality, palačinke, positive};{food quality, jaja, positive};{food quality, krumpir, positive};{food quality, null, positive};{food quality, jogurt, positive};{food quality, svježe voće, positive}","{food quality, palačinka, positive};{food quality, jogurt, positive};{food quality, krumpir, positive};{food quality, svježe voće, positive}" +– Ray's je mjesto za visoku kvalitetu večere s plodovima mora.,"{food quality, večere s plodovima mora, positive}","{food quality, večere s plodovima, positive}" +Također stvarno uživam u jednostavnosti dekor i intimnosti osjećaj malog restorana.,"{ambience general, dekor, positive};{ambience general, osjećaj, positive}","{ambience general, dekor, positive};{ambience general, restorana, positive}" +Vraćamo se nazad. :D,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Trebao sam to spomenuti, ali nisam očekivao da će hrana biti tako blaga.","{food quality, hrana, negative}","{food quality, hrana, negative}" +"Kad sam ušao, bio sam zatečen njihovim nevjerojatnim drveni dekor.","{ambience general, drveni dekor, positive}","{ambience general, dekor, negative}" +"Maleno je mjesto, pa ako stignete prije 20 sati vikendom (četvrtak? nedjelja), lakše ćete pronaći stol ili mjesto u sushi baru.","{restaurant miscellaneous, mjesto, neutral}","{restaurant miscellaneous, mjesto, positive}" +Najbolje susjedstvo Standby .,"{restaurant general, Standby, positive}","{restaurant general, Standby, positive}" +Vratio bih se tamo u tren oka.,"{restaurant general, null, positive}","{restaurant general, Vratio, positive}" +"Ima *vrlo * razumnu cijenu, posebno zbog kvalitete hrane.","{food prices, hrane, positive}","{food quality, hrane, positive}" +"dosta hrane, vjeruj mi.","{food style_options, hrane, positive}","{restaurant general, hrane, positive}" +To je savršeno mjesto za romantični sastanak u dvoje ili tajni sastanak!,"{ambience general, mjesto, positive};{restaurant miscellaneous, mjesto, positive}","{ambience general, mjesto, positive};{restaurant miscellaneous, mjesto, positive}" +Također imajte odlične margarite!,"{drinks quality, margarite, positive}","{food quality, margarite, positive}" +Nepretenciozno je i podzemno.,"{ambience general, null, positive}","{ambience general, null, positive}" +Mjesto je sljedeća najbolja stvar u kuhanju moje mame.,"{food quality, null, positive}","{food quality, null, positive}" +"Najbolje mjesto za opušteni nedjeljni doručak usred jahti, zatim prošećite obližnjom Farmer's Market.","{restaurant miscellaneous, mjesto, positive}","{restaurant general, Farmer's Market, positive}" +"Ako možete, dođite do ovog mjesta brodom i provedite cijelu večer.","{restaurant miscellaneous, mjesta, positive}","{restaurant general, mjesta, positive}" +za desert smo imali mango đumbir creme brulee ... oh la la yummy ! ! !,"{food quality, mango đumbir creme brulee, positive}","{food quality, mango đumbir creme brulee, positive}" +"Isplati se čekati, pogotovo jer će vas nazvati kad stol bude spreman.","{restaurant general, null, positive}","{service general, null, negative}" +Imaju veliki izbor riba i čak navode iz kojih oceana dolaze; Atlantik ili Pacifik.,"{food style_options, riba, positive}","{food style_options, riba, positive}" +Pa pretpostavljam da je teško sjediti kad si nevidljiv za osoblje.,"{service general, osoblje, negative}","{service general, null, negative}" +Izvrsno otvoren i prijateljski raspoložen ambijent.,"{ambience general, ambijent, positive}","{ambience general, ambijent, positive}" +Kratak razgovor s upraviteljem na kraju obroka bio je najveće razočarenje - bilo bi malo reći da smo ``oduševljeni``.,"{service general, upraviteljem, negative}","{service general, upraviteljem, negative}" +"Ray's je nešto poput ustanove u Seattleu, ali s obzirom na njegov prekrasan zvučni pogled, sumnjao sam da su pohvale više zbog krajolika nego zbog hrane i usluge.","{location general, zvučni pogled, positive}","{location general, zvučni pogled, positive};{restaurant general, Ray's, positive}" +Zakleo sam se da se nikad više neću vraćati po toplo pivo i osrednje jelo.,"{food quality, jelo, negative};{drinks quality, pivo, negative}","{drinks quality, pivo, negative};{food quality, jelo, negative}" +"Ako je vani lijepo, zatražite stol na balkon .","{ambience general, balkon, positive}","{ambience general, balkon, positive}" +Sjajna hrana sa sjajnom atmosferom!,"{ambience general, atmosferom, positive};{food quality, hrana, positive}","{ambience general, atmosferom, positive}" +Završio sam obrok s neobičnim desert s okusom porta i čokolade ... ukusno!,"{food quality, desert s okusom porta i čokolade, positive}","{food quality, s obi, positive};{food quality, porta, positive}" +Dobio sam predjelo od školjki i škampa i bilo je u redu.,"{food quality, predjelo od školjki i škampa, neutral}","{food quality, predjelo, positive};{restaurant general, škampa, positive}" +"pizze su tanke kore, a jelovnik nudi vrlo kreativne kombinacije i nadjeve.","{food style_options, pizze, positive};{food style_options, jelovnik, positive}","{food style_options, kore, positive};{food quality, pizze, positive}" +To je sjajno mjesto za uživanje hrana i upoznavanje prijatelja.,"{restaurant miscellaneous, mjesto, positive};{food quality, hrana, positive}","{restaurant general, mjesto, positive}" +"usluga je bila izvrsna, kava je bila dobra čak i prema standardima Starbucksa, a hrana je bila izvanredna.","{service general, usluga, positive};{food quality, hrana, positive};{drinks quality, kava, positive}","{food quality, hrana, positive};{service general, usluga, positive};{drinks quality, kava, positive}" +Ovo je mjesto za opuštanje i uživanje u najboljoj kvaliteti hrana koju industrija može ponuditi.,"{ambience general, mjesto, positive};{food quality, hrana, positive}","{food quality, hrana, positive}" +Vratio bih se samo zbog vina iskustva.,"{drinks quality, vina, positive}","{drinks quality, vina, negative}" +Najbolji lignje u Seattleu!,"{food quality, lignje, positive}","{restaurant general, null, positive}" +Prezentacija Snooze je izvrsna i jedno je od onih mjesta na kojima se osjećate sofisticiranije samo zato što ste tamo; ali skinite slojeve i dobit ćete precijenjeni IHOP s visokim čelom izbornik .,"{restaurant prices, Snooze, negative};{food style_options, izbornik, negative};{ambience general, Snooze, positive}","{food quality, izbornik, negative};{ambience general, Prezentacija, positive};{restaurant general, Snooze, negative}" +"Žalio sam se upravitelju, ali on se nije ni ispričao.","{service general, upravitelju, negative}","{restaurant general, null, negative}" +Mnogo više od samog sjajnog pogled!,"{location general, pogled, positive}","{restaurant general, null, positive}" +Atmosfera je bila sasvim u redu.,"{ambience general, null, neutral}","{ambience general, Atmosfera, negative}" +Nakon sjedenja trebalo je oko 30 minuta da konačno dobijemo obrok.,"{service general, null, negative}","{service general, null, negative}" +"– U doba povećanja troškova u restoranima, lijepo je vidjeti mjesto koje se protivi tom trendu i jednostavno pruža visoku kvalitetu hrana i dobru usluga, točka.","{service general, usluga, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{restaurant prices, null, negative};{service general, usluga, positive}" +"Jako mi se svidjela atmosfera, ali hrana nije bila vrijedna te cijene.","{ambience general, atmosfera, positive};{food quality, hrana, negative};{food prices, hrana, negative}","{ambience general, atmosfera, positive};{food quality, hrana, negative}" +"Nalazi se u trgovačkom centru u blizini Beverly Centera, nije najbolji lokacija, ali hrana me tjera da se vraćam po još.","{location general, lokacija, neutral};{food quality, hrana, positive}","{food quality, hrana, positive};{location general, lokacija, neutral}" +"Na svom obroku morao sam vratiti svoja jaja zbog jednostavnog zahtjeva da razbijem jarmove prije kuhanja, i morao bih ih ponovno poslati da nisam odbio obrok svi zajedno .","{food quality, obroku, negative};{food quality, jaja, negative}","{service general, null, negative}" +"bend je bio vrlo dobar, a usluga je bila pažljiva.","{ambience general, bend, positive};{service general, usluga, positive}","{food quality, null, negative};{food style_options, null, negative}" +"– Kako opisati najbolji sushi u New Yorku: hmmmm, ukusan, nevjerojatan, fantastičan, sočan, savršen, ne, sve gore navedeno.","{food quality, sushi, positive}","{food quality, sushi, positive}" +– Šarmantan lokacija uz marinu u Long Beachu i prosječan hrana Schoonera ili Latera nažalost ne nadoknađuju njegovu vrlo lošu korisnička služba.,"{service general, korisnička služba, negative};{food quality, hrana, neutral};{location general, lokacija uz marinu u Long Beachu, positive}","{service general, korisnička služba, negative};{location general, lokacija, positive};{food quality, hrana, positive}" +"Odmah smo sjeli, stol je bio privatan i lijep.","{ambience general, stol, positive}","{food quality, Odmah, positive};{ambience general, null, positive}" +"dobro sake, dobro hrana – iskreno, uopće ne znam puno o japanskoj hrani.","{drinks quality, sake, positive};{food quality, hrana, positive}","{drinks quality, dobro sake, positive};{food quality, dobro hrana, positive}" +Ponesite svoj mobitel jer ćete možda morati čekati da uđete u najbolji sushi restoran na svijetu: BLUE RIBBON SUSHI .,"{restaurant general, BLUE RIBBON SUSHI, positive}","{restaurant general, BLUE RIBBON SUSHI, positive}" +"Na kraju je naš ček iznosio 27 dolara za 4 male palačinke, burrito za doručak, sok od naranče i ledeni čaj (imao sam vodu).","{food style_options, palačinke, negative};{food prices, burrito za doručak, negative};{drinks prices, sok od naranče, negative};{food prices, palačinke, negative};{drinks prices, ledeni čaj, negative}","{food style_options, palačinke, negative};{food prices, palačinke, negative};{food quality, palačinke, negative};{drinks style_options, ledeni čaj, positive};{food style_options, burrito, negative};{food quality, sok od naranče, negative}" +Dobro hrana!,"{food quality, hrana, positive}","{restaurant general, hrana, positive}" +"catering nije na ovom svijetu, a Raouls pileća juha od povrća ljulja moj svijet! ! !","{food quality, Raouls pileća juha od povrća, positive};{food quality, catering, positive}","{food quality, pileća ljus, positive};{food quality, catering, negative}" +Trebao sam samo tražiti ček kad sam to vidio; ali njihov jelovnik bio je toliko jedinstven da sam nastavio .,"{food style_options, jelovnik, positive}","{food quality, jelovnik, positive}" +Sjajno doručak,"{food quality, doručak, positive}","{restaurant general, Sjajno, positive}" +brancin na rižotu od jastoga bio je najbolji.,"{food quality, brancin na rižotu od jastoga, positive}","{restaurant general, branci, positive}" +– Atmosfera izvrsna je za svaku posebnu prigodu koju želite proslaviti.,"{ambience general, null, positive}","{ambience general, Atmosfera, positive}" +"Sjajno sezonska riba i plodovi mora, s otmjenom okruženje uz obalu .","{food quality, sezonska riba, positive};{food quality, plodovi mora, positive};{ambience general, okruženje uz obalu, positive}","{food quality, riba i plodovi, positive};{location general, okruženje, positive}" +"pizze nisu velike, a kora je tanka ... imajte to na umu kada naručujete.","{food style_options, pizze, neutral};{food style_options, kora, neutral}","{food style_options, pizze, negative}" +Jedina pozitivna stvar kod Mioposta je lijepa lokacija.,"{location general, lokacija, positive}","{location general, lokacija, positive}" +Cijenim i njihovu dostavu.,"{service general, dostavu, positive}","{service general, null, positive}" +Jako razočaran.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"pizza je ukusna, a salate su fantastične.","{food quality, pizza, positive};{food quality, salate, positive}","{food quality, pizza, positive};{food quality, salate, positive}" +Najsvježije sushi – volim ovo restoran .,"{restaurant general, restoran, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{restaurant general, restoran, positive}" +odrezak je pečen baš po mojim željama (srednje pečen) i bio je lijep i sočan.,"{food quality, odrezak, positive}","{food quality, odrezak, positive};{food style_options, odrezak, positive}" +"Ozbiljno, nećete pogriješiti ako tražite nepretencioznu lokalnu zabavu.","{ambience general, null, positive}","{restaurant miscellaneous, lokalnu zabavu, positive}" +"vlasnici su super zabavni, a izbor piva vrijedi ostati.","{service general, vlasnici, positive};{drinks style_options, izbor piva, positive}","{drinks style_options, izbor piva, positive};{service general, vlasnici, positive}" +Sjajno točeno i izbor boca i pizza kamenje.,"{food quality, pizza, positive};{drinks style_options, točeno i izbor boca, positive}","{food quality, pizza, positive};{food quality, boca, positive}" +"Jamčim da se nećete razočarati, tu je i usluga parkiranja.","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, usluga parkiranja, positive}" +Kasnovečernja večera s izuzetnim hrana .,"{food quality, hrana, positive}","{food quality, hrana, positive}" +"porcije su ipak velike, pa nemojte naručivati previše.","{food style_options, porcije, neutral}","{food style_options, porcije, positive}" +Definitivno ima jedan od najboljih jukebox koje sam vidio u dugo vremena.,"{ambience general, jukebox, positive}","{ambience general, jukebox, positive}" +Usluga bila je pristojna.,"{service general, Usluga, neutral}","{restaurant general, Usluga, positive}" +Apsolutno ukusno.,"{food quality, null, positive}","{restaurant general, null, negative}" +"Oh, i krumpirići sa sirom su sjajni!","{food quality, krumpirići sa sirom, positive}","{food quality, krumpiri, positive}" +Svi koji su sjedili straga vani složili su se da je to najgora usluga koju smo ikada dobili.,"{service general, usluga, negative}","{service general, usluga, negative}" +"Možda nisam guru za sushi, ali mogu vam reći da je hrana ovdje sasvim u redu i da nema puno više od toga.","{food quality, hrana, negative}","{food quality, hrana, positive}" +"Izvrsno hrana, lijepo ambijent, prilično skupo","{restaurant prices, null, negative};{ambience general, ambijent, positive};{food quality, hrana, positive}","{ambience general, ambijent, positive};{restaurant general, hrana, positive}" +"Tope se u ustima nigiri i sashmi , a i vrlo ukusni kiflice.","{food quality, kiflice, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}","{food quality, kiflice, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}" +Napokon obrok koji ćete dugo pamtiti!,"{food quality, obrok, positive}","{restaurant general, null, positive}" +"Najbolje hrana, fenomenalno usluga","{service general, usluga, positive};{food quality, hrana, positive}","{food quality, hrana, positive}" +Preporučam ga za noć kada se želite razbacivati! (bilo je malo skupo),"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}" +"Iako je ova zalogajnica imala relativno dobru hranu, osoblje restorana se činilo potpuno ravnodušnim prema našoj prisutnosti, a takav se stav odrazio na nedostatak usluge.","{food quality, hranu, positive};{service general, osoblje restorana, negative}","{service general, osoblje restorana, negative};{food quality, hranu, positive};{service general, null, negative}" +Bez usporedbe,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"pa što se tiče kozice, bile su svježe i imale su laganu hrskavost u odnosu na tijesto ... takooo dobro ... orasi su narezani na manje komade i vrlo su hrskavi i ukusni.","{food quality, kozice, positive};{food quality, orasi, positive};{food quality, tijesto, positive}","{food quality, kozice, positive};{food style_options, orasi, positive}" +Tako sam sretan što imam prekrasan talijanski restoran u svom susjedstvu.,"{restaurant general, talijanski restoran, positive}","{restaurant general, talijanski restoran, positive}" +Čekali smo sat vremena da sjednemo.,"{service general, null, negative}","{service general, null, negative}" +"Naručili smo i iako smo naručili 4 predjela, hrana je stigla tek 45 minuta kasnije... UZ NAŠE GLAVNO JELO.","{service general, null, negative}","{service general, null, negative}" +Jedva čekam da se ponovno vratim nadolazeći vikend!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Ako ste zainteresirani za dobar okus (bez okusa i mirisa ribe), velika porcije i kreativna sushi jela ovo je vaše mjesto...","{food quality, null, positive};{food style_options, porcije, positive};{food style_options, sushi jela, positive}","{food quality, okus, positive};{food style_options, sushi jela, positive};{food style_options, porcije, positive}" +Savršeno mjesto za izvođenje gostiju iz grada u bilo koje doba godine.,"{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}" +Probao sam sva tri artikla na njoj tanjur i bili su izvrsni.,"{food quality, tanjur, positive}","{food quality, tri artikla, positive}" +Dobro za večeru kasno u noć (planiranje u zadnji čas) bez rezervacije.,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}" +tamo nikad nisam razočaran hrana.,"{food quality, hrana, positive}","{food quality, hrana, positive}" +– Daleko najbolji bar u East Villageu ...,"{restaurant general, bar, positive}","{restaurant general, bar, positive}" +To je sjajno mjesto za gledanje ljudi.,"{restaurant miscellaneous, mjesto, positive}","{restaurant miscellaneous, mjesto, positive}" +"Prostor je bio ograničen, ali hrana je to nadoknadila.","{food quality, hrana, positive};{restaurant miscellaneous, Prostor, negative}","{food quality, hrana, positive};{ambience general, Prostor, negative}" +Jakobove kapice se očito kuhaju na crnom maslinovom maslacu što ih zaista čini jedinstvenima (da ne spominjemo ukusnima).,"{food quality, Jakobove kapice, positive};{food style_options, Jakobove kapice, positive}","{food quality, Jakobove kapice, positive}" +Ovo mjesto je šarmantno i opuštajuće.,"{ambience general, mjesto, positive}","{ambience general, ovo mjesto, positive}" +uopće nije za žvakanje.,"{food quality, null, positive}","{restaurant general, null, negative}" +Bili smo u Seattleu samo jednu noć i tako mi je drago što smo odabrali Rays za večeru!,"{restaurant general, Rays, positive}","{restaurant general, Rays, positive}" +"– Nikada neću zaboraviti nevjerojatan obrok, usluga i ambijent koji doživljavam u ovom restoranu.","{service general, usluga, positive};{ambience general, ambijent, positive};{food quality, obrok, positive}","{service general, usluga, positive};{food quality, obrok, positive};{ambience general, ambijent, positive}" +Sjajno posebno predjelo od španjolske skuše i savršeno sushi u kutiji (to jegulja s avodcaom -- um um um ) .,"{food quality, sushi u kutiji, positive};{food quality, posebno predjelo od španjolske skuše, positive};{food quality, jegulja s avodcaom, positive}","{food quality, posebno predjelo, positive};{food quality, sushi u kutiji, positive}" +Vikendom ćete možda morati čekati nekoliko sati.,"{service general, null, neutral}","{service general, null, negative}" +"– hrana nije bila sjajna, a konobari su bili nepristojni.","{service general, konobari, negative};{food quality, hrana, negative}","{service general, konobari, negative};{food quality, hrana, negative}" +"9 oz odrezak je došao sljedeći i imao je odličan okus, barem u početku.","{food quality, 9 oz odrezak, positive}","{food quality, odrezak, positive}" +"Kad sam stigao tamo, sjeo sam uz stepenice gdje je atmosfera bila ugodna, a usluga užasna!","{service general, usluga, negative};{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive};{service general, usluga, positive}" +"vinska karta je nevjerojatna, opsežna i raznolika, hrana je nevjerojatna, a osoblje je sve bilo jako lijepo, dobro u svom poslu i kulturno.","{service general, osoblje, positive};{drinks style_options, vinska karta, positive};{food quality, hrana, positive}","{food quality, hrana, positive};{drinks style_options, vinska karta, positive};{service general, osoblje, positive};{food style_options, hrana, positive}" +– NE MOŽE BITI BOLJE! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Nedjeljom poslijepodne svira bend i jako je zabavno.,"{ambience general, bend, positive}","{restaurant general, bend, positive}" +"Sve, a mislim sve na izborniku je preslatko.","{food quality, izborniku, positive}","{food quality, sve, positive}" +"Znam da mnogi ljudi imaju svoje omiljene vrste pizza i pizza mjesta, ali Mioposto pizza nema kvalitetu i dobar okus.","{food quality, pizza, negative}","{food quality, pizza, negative};{food style_options, pizza, positive}" +"Postoji samo jedno mjesto na istočnoj obali koje ima sve, plus puno više.","{restaurant general, mjesto, positive}","{restaurant general, mjesto, positive}" +Uvijek pobjednik.,"{restaurant general, null, positive}","{restaurant general, null, negative}" +Prethodne recenzije su rekle da su prilagođene djeci ... dajte mi odmor s dvoje male djece što je svjetlosna godina.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, positive}" +pizze su lagane i ukusne.,"{food quality, pizze, positive}","{food quality, pizze, negative}" +"Pogledajte umjetnost na zidovima, vrlo šarena!","{ambience general, umjetnost na zidovima, positive}","{ambience general, zidovi, positive}" +Osrednji hrana,"{food quality, hrana, neutral}","{restaurant general, hrana, positive}" +Nikad se više neću vratiti.,"{restaurant general, null, negative}","{restaurant general, Nikad, negative}" +Bilo nam je vrlo teško privući pozornost konobarice i konačno smo morali ustati i ući unutra razgovarati s upraviteljem.,"{service general, konobarice, negative}","{service general, konobarica, negative}" +Nikad prevelika gužva i uvijek odlično usluga .,"{service general, usluga, positive};{restaurant miscellaneous, null, positive}","{service general, usluga, positive};{food quality, gužva, positive}" +ti si na vrućem spoju i on/ona ima potrebu za sushi ... onda bi ovo moglo biti pravo mjesto.,"{food quality, sushi, positive}","{restaurant miscellaneous, spoju, positive}" +"– Ne mogu vjerovati Murphy's postoji više od 25 godina, nevjerojatno.","{restaurant miscellaneous, Murphy's, positive}","{restaurant general, Murphy's, positive}" +"Možete biti zauzeti petkom za stolom, ali kada sjednete, usluga je toliko učinkovita da možete brzo ući i izaći.","{service general, usluga, positive}","{service general, usluga, positive}" +"to? poslužuju se ili s umak od papra ili redukcija crnog vina, iako se oba nisu mogla razlikovati po okusu.","{food quality, redukcija crnog vina, neutral};{food quality, umak od papra, neutral}","{drinks quality, redukcija crnog vina, negative};{drinks quality, umak od papra, negative}" +Najljepši konobari u gradu.,"{service general, konobari, positive}","{restaurant general, konobari, positive}" +usluga bila je ljubazna i pažljiva.,"{service general, usluga, positive}","{food quality, usluga, positive}" +"Dok sam ovo pisao, upravo sam ponovno pokušao dati link i još uvijek ne radi.","{restaurant miscellaneous, null, negative}","{service general, null, negative}" +sve daljnje potrebe koje smo možda imali nisu mogle biti zadovoljene jer nitko nije stao pokraj stola.,"{service general, null, negative}","{service general, null, negative}" +"Dobar Sushi, visoka cijena","{food quality, Sushi, positive};{food prices, Sushi, negative}","{restaurant prices, Dobar, negative};{food quality, Sushi, positive}" +Ali poslužitelji bili su iznimno pažljivi i vrlo prijateljski raspoloženi.,"{service general, poslužitelji, positive}","{service general, poslužitelji, positive}" +"Bio sam na ovom mjesto, ljudi, i LOŠE je.","{restaurant general, mjesto, negative}","{restaurant general, mjesto, negative}" +odlično usluga,"{service general, usluga, positive}","{service general, usluga, positive}" +Bilo je to kao da jedete u potpuno drugom restoranu.,"{restaurant general, null, positive}","{restaurant general, null, negative}" +Dva palca gore!,"{food quality, null, positive}","{food quality, palca, negative}" +Zamislite moje sretno iznenađenje kada sam otkrio da su pogledi tek treća najbolja stvar kod Rayovih!,"{restaurant general, Rayovih, positive};{location general, pogledi, positive}","{restaurant general, Rayovih, positive}" +"Ruku na srce, najbolji tuna koji sam ikada jeo.","{food quality, tuna, positive}","{food quality, tuna, positive}" +"Ako idete vidjeti Dannyja Gansa ili samo odsjesti u Mirageu, ne propustite ovo.","{restaurant general, null, positive}","{restaurant general, Mirage, negative}" +odlično mjesto za ručak,"{restaurant general, mjesto za ručak, positive}","{restaurant general, mjesto, positive}" +Volim doručak ovdje.,"{food quality, doručak, positive}","{restaurant general, null, positive}" +sashimi bio je najsvježiji i najnježniji koji sam ikada probao.,"{food quality, sashimi, positive}","{food quality, sashimi, positive}" +Njihov jelovnik neće vas razočarati.,"{food style_options, jelovnik, positive}","{restaurant general, Njihov, negative}" +"Mnogi ljudi govore o odličnoj pizza i lošoj usluga, tako da to ne mogu biti samo vrijeđanja nekoliko nezadovoljnih kupaca.","{food quality, pizza, positive};{service general, usluga, negative}","{service general, usluga, negative};{food quality, pizza, positive}" +Neću se vratiti .,"{restaurant general, null, negative}","{restaurant general, null, negative}" +moja usluga bila je sjajna!,"{service general, usluga, positive}","{restaurant general, usluga, positive}" +sigurno se vraćamo u ovaj restoran .,"{restaurant general, restoran, positive}","{restaurant general, restoran, negative}" +Sigurno će se vratiti.,"{restaurant general, null, positive}","{restaurant general, Sigurn, positive}" +Možda je dobro za onu jednu noć jednom za plavog mjeseca kada kuhari odluče upotrijebiti riba to je napola pristojno.,"{food quality, riba, negative}","{food quality, riba, positive};{food prices, riba, positive}" +"– Bio sam na Open Sesame samo jednom, ali još uvijek se vrtim od iskustva! !","{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}" +"palačinke su svakako bile inventivne, ali 8,50 $ za 3 - 6 `` palačinke (jedna od njih je bila više kao 5 ``) u letu palačinki (uzorak od 3 različite palačinke) je dobro precijenjen.","{food style_options, palačinke, positive};{food prices, palačinke, negative}","{food style_options, palačinke, positive};{food prices, palačinke, negative};{food quality, palačinke, positive}" +"MEĐUTIM, jednog nedjeljnog poslijepodneva suprug i ja smo ipak otišli (iako uz moje glasno negodovanje) i bili smo ugodno iznenađeni.","{restaurant general, null, positive}","{restaurant general, suprug, positive}" +Itekako vrijedno toga,"{restaurant general, null, positive}","{restaurant general, Itek, positive}" +Oprez - stvarna je hrana za ljude koji vole najbolje.,"{food quality, hrana, positive}","{food quality, hrana, positive}" +"Imam, ali ovdje - u toaletu zahod je bila kupaonica, što je bilo čudno.","{restaurant miscellaneous, zahod, negative}","{ambience general, toaletu, negative}" +Najbolje jelo su honwy kozice od oraha - jednostavno izvanredne.,"{food quality, honwy kozice od oraha, positive}","{food quality, kozice od oraha, positive}" +palačinke trebaju biti veće (najmanje 8 ``) kako bi opravdale trošak čak i uz jedinstvene ponude.,"{food style_options, palačinke, negative}","{food style_options, palačinke, negative};{food prices, palačinke, negative}" +– Prvi put sam večerao u ovom restoranu sa svojim sinom i bilo je apsolutno užasno!,"{restaurant general, restoranu, negative}","{restaurant general, restoranu, negative}" +Izvrsno,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Parking je relativno dobar, imaju svoje parkiralište i možete parkirati u obližnjem parku.","{restaurant miscellaneous, null, positive}","{parking general, parkirno mesto, positive};{parking general, Parking, positive}" +Cezar salata bila je izvrsna.,"{food quality, Cezar salata, positive}","{food quality, salata, positive}" +"– Ne razumijem kako sam tako dugo bio stranac na ovom mjestu ... the fajita salata , the colorado , the fajitas - SVE je ukusno .","{food quality, colorado, positive};{food quality, fajita salata, positive};{food quality, fajitas, positive}","{food quality, fajita salata, positive};{food quality, colorado, positive};{food quality, fajitas, positive}" +najbolje kineska hrana koje sam probao u dugo vremena,"{food quality, kineska hrana, positive}","{food quality, kineska hrana, positive}" +Cijena je također bila odgovarajuća.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}" +Ukusno...!,"{food quality, null, positive}","{food quality, null, negative}" +Stavili smo ime i iako je bilo otvorenih stolova rečeno nam je da će biti potrebno čekati 30 minuta.,"{service general, null, negative}","{service general, null, negative}" +kava je također vrlo dobra.,"{drinks quality, kava, positive}","{drinks quality, kava, positive}" +"Na piće smo čekali više od 30 minuta, a na hranu više od 1 i 2 sata.","{service general, null, negative}","{service general, null, negative};{food quality, hranu, negative};{service general, piće, negative}" +poslužitelji iza pulta uvijek su ljubazni i uslužni.,"{service general, poslužitelji iza pulta, positive}","{service general, poslužitelji, positive}" +"Naš konobar nije postojao i nakon što je naša hrana konačno stigla više od sat vremena nakon što smo naručili, nismo dobili vodu ni posuđe.","{service general, konobar, negative}","{service general, konobar, negative};{food quality, hrana, negative};{service general, null, negative}" +– Ovo mjesto je nevjerojatno precijenjeno.,"{restaurant general, mjesto, negative}","{restaurant general, Ovo, negative}" +Vrlo loše služba za korisnike .,"{service general, služba za korisnike, negative}","{service general, služba, negative}" +Ne možemo reći dovoljno o njihovim ukusnim gurmanima pizze!,"{food quality, pizze, positive}","{food quality, pizze, positive}" +"Nadalje, dok je riba nedvojbeno svježa, rolice obično su neobjašnjivo bljutave.","{food quality, rolice, negative};{food quality, riba, positive}","{food quality, riba, positive};{food quality, rolice, positive}" +Jedina mana je gužva sjedenje i sporost usluga.,"{service general, usluga, negative};{restaurant miscellaneous, sjedenje, negative}","{service general, usluga, negative}" +"Nije ostalo puno mjesta za pušenje u New Yorku, ali pronašao sam svoju omiljenu pušaču balkon u gradu.","{restaurant miscellaneous, balkon, positive}","{ambience general, balkon, positive}" +"Podijelili smo obiteljski pladanj, a ja sam posebno uživao u crni bakalar u sake kasu .","{food quality, crni bakalar u sake kasu, positive}","{food quality, crni bakalar u sake, positive}" +"Ali prostor je malen i lijep, a usluga je korisna.","{ambience general, prostor, positive};{service general, usluga, positive}","{service general, usluga, positive};{ambience general, prostor, positive}" +Vrijedilo je čekati.,"{restaurant general, null, positive}","{service general, null, negative}" +ukusan .,"{food quality, null, positive}","{restaurant general, null, negative}" +Sladak,"{food quality, null, positive}","{restaurant general, Slad, positive}" +- Osrednji Usluga / Kvaliteta,"{service general, Usluga, neutral}","{service general, Usluga, positive}" +"– Ovo je jedno od mojih najboljih mjesta za ručak, ogromno porcije, brzo usluga i nevjerojatno margarite! !","{service general, usluga, positive};{drinks quality, margarite, positive};{restaurant general, null, positive};{food style_options, porcije, positive}","{food quality, ovo, positive};{food style_options, porcije, positive};{service general, usluga, positive};{food prices, margarite, positive}" +Najbolji kolači od rakova u gradu,"{food quality, kolači od rakova, positive}","{food quality, kolači, positive}" +"Sve što sam ovdje jeo je dobro, taco salate, burritos, enchilade volim ovo mjesto.","{food quality, taco salate, positive};{food quality, null, positive};{restaurant general, mjesto, positive};{food quality, burritos, positive};{food quality, enchilade, positive}","{food quality, taco salate, positive};{food quality, burritos, positive};{restaurant general, mjesto, positive};{food quality, enchilade, positive}" +"Odlično Pizza, Loše Usluga","{food quality, Pizza, positive};{service general, Usluga, negative}","{food quality, Pizza, negative}" +sjajan,"{restaurant general, null, positive}","{restaurant general, sj, positive}" +Moja najbolja prijateljica jela pileća shawarma i JOŠ UVIJEK oduševljeno govori o tome da je najbolja posvuda!,"{food quality, pileća shawarma, positive}","{food quality, shawarma, positive}" +Chintzy porcije,"{food style_options, porcije, negative}","{restaurant general, null, positive}" +Dobro jede .,"{food quality, jede, positive}","{restaurant general, Dobro, positive}" +"Obično vas na mjestima pitaju koliko vruće želite, ali nisu.","{service general, null, negative}","{restaurant general, null, negative}" +"Uvijek sam smatrao da je osoblje konobara i, ako sjedite za šankom, kuhari vrlo ljubazni.","{service general, kuhari, positive}","{restaurant general, uijet, positive}" +Ništa na izborniku nije manje nego nevjerojatno.,"{food quality, izborniku, positive}","{restaurant general, null, negative}" +"Moja grupa od dvoje bila je posebno ambiciozna i razbacili smo se Shilshole Sampler ... prekrasnim izborom golemih bijelih zaljevskih kozica, dimljene bijele tune, Rayeve fantastične manila školjke začinjeno koprom, jakobovim kapicama u ukusnom sojinom preljevu i malenom hrpicom Dungeness rakova na vrhu uzvišenog umak od maslaca .","{food quality, umak od maslaca, positive};{food style_options, Shilshole Sampler, positive};{food style_options, bijelih zaljevskih kozica, positive};{food quality, manila školjke, positive};{food quality, sojinom preljevu, positive}","{food quality, Shilshole Sampler, positive};{food style_options, Shilshole Sampler, positive}" +"Bio sam iskreno šokiran kada sam pročitao loše kritike - ovo mjesto je fantastično; nije nas iznevjerio ni na koji način, a jeli smo ovdje više od 10 puta.","{restaurant general, mjesto, positive}","{restaurant general, Bio, positive}" +"Vaš obožavatelj sushi, volite stručno rezanu ribu, sjajnu sake, ubojitu SOHO lokacija i naravno: losos, tuna, metilj, žuti rep, bakalar, Skuša, žele riba, morski jež, škampi, jastog, orada, pastrva, mliječna riba, Tuna plave peraje, jegulja, rakovi, sardine, grdobine, ikra, jakobove kapice, kamenice i razne vrste Toro.","{food quality, sushi, positive};{location general, SOHO lokacija, positive};{food style_options, Toro, positive};{drinks quality, sake, positive};{food style_options, ribu, positive}","{food quality, ribu, positive};{location general, SOHO lokacija, positive};{drinks quality, sake, positive};{food style_options, sushi, positive}" +usluga je fantastična na ovom zabavnom mjestu .,"{restaurant general, mjestu, positive};{service general, usluga, positive}","{restaurant general, usuga, positive}" +"Također, bio je samo jedan kupaonska kabina - vjerojatno treba više za tako velike gužve.","{restaurant miscellaneous, kupaonska kabina, negative}","{food style_options, gu, negative};{food quality, kaj, positive}" +Otišli smo a da uopće nismo dobili usluga .,"{service general, usluga, negative}","{restaurant general, null, negative}" +Svidjelo mi se .,"{restaurant general, null, positive}","{restaurant general, Svid, positive}" +– Toplo preporučujem Mioposto .,"{restaurant general, Mioposto, positive}","{restaurant general, Top of the Town, positive}" +"hrana je fantastična, autentična, ukusna i vrlo, vrlo pristupačna.","{food quality, hrana, positive};{food prices, hrana, positive}","{food quality, hrana, positive};{food prices, hrana, positive};{food style_options, hrana, positive}" +Ovdje sam jeo tri puta i utvrdio sam da su kvaliteta i raznolikost ribe izvrsni.,"{food quality, ribe, positive};{food style_options, ribe, positive}","{food quality, ribe, positive};{food style_options, ribe, positive}" +"Ali ona je vrlo prijateljski nastrojena s nekim ljudima, što to čini još iritantnijim.","{service general, null, negative}","{service general, ljudima, negative}" +obični jelovnik ovdje je malo iznad prosjeka što nije vrijedno šmrkavog stava koji imate.,"{food quality, obični jelovnik, neutral};{service general, null, negative}","{food quality, ovo, negative}" +"Također, poslužuju NAJBOLJE hummus u Americi, uz kapljicu mirisnog maslinovog ulja (što je, vjerujem, tradicionalan način)!","{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive}" +odlično pivo,"{drinks quality, pivo, positive}","{drinks quality, pivo, positive}" +Plodovi mora Plus,"{food quality, Plodovi mora, positive}","{restaurant general, Plus, positive}" +"tužno je što nema puno ljudi koji često jedu na ovakvim mjestima koja izgledaju skupo jer su u hotelu ... ali su definitivno ona koja ne želite propustiti, pogotovo ako ste u centru San Josea.","{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant miscellaneous, null, positive}" +"Poslužuju ga u visokoj, tankoj čaši u obliku pješčanog sata kako bi prikrili činjenicu da u supermarketu dobivate mali sok po cijeni od pola galona.","{drinks style_options, sok, negative};{drinks prices, sok, negative}","{drinks style_options, u obliku pješčanog sata, negative}" +"hrana je bila u redu, ali usluga je bila toliko loša da je hrana bila hladna, što je omogućilo da svi u mojoj grupi budu posluženi.","{service general, usluga, negative};{food quality, hrana, neutral}","{food quality, hrana, negative};{service general, usluga, negative}" +odlično obrok – riba na pladnju s omikaseom bilo je apsolutno dekadentno -- nije bilo ništa od žilavosti koja ponekad prati pošteni sushi -- ova je riba bila savršena! ! ! !,"{food quality, riba na pladnju s omikaseom, positive};{food quality, obrok, positive}","{food quality, riba na pladnju s omikaseom, negative};{food quality, obrok, positive}" +Pića su izvrsna i osjećam se kao da sam u zemlji Trećeg svijeta kad uđem na vrata.,"{drinks quality, Pića, positive};{ambience general, null, positive}","{food quality, Pića, positive}" +Otvori i ohladi mjesto s najboljim pizza i kava,"{ambience general, mjesto, positive};{food quality, pizza, positive};{drinks quality, kava, positive}","{food quality, pizza, positive};{drinks quality, kava, positive}" +Creme brulee od zelenog čaja je obavezan!,"{food quality, Creme brulee od zelenog čaja, positive}","{food quality, Creme brulee, positive}" +Našao sam novi dom i upravo sam se preselio s dugotrajnim najmom.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Nisu najpričljiviji, ali svaki put kad sam bio tamo bili su jako zaposleni, što je vjerojatno razlog za nedostatak razgovora.","{service general, null, neutral}","{service general, null, negative}" +"Sama pizza nije baš najbolja koju sam IKAD jeo, ali je ipak prilično dobra.","{food quality, pizza, positive}","{food quality, pizza, positive}" +"Imali smo isto konobar drugi put, pa je možda usluga manjkava i naša sreća.","{service general, konobar, positive}","{service general, usluga, negative}" +– To je velika izjava s obzirom na to da izvlačim zamke za rakove i izrađujem kolače sam od svoje sedme godine - ali nešto u vezi s ovim malim vragovima svaki put postaje bolje.,"{food quality, kolače, positive}","{food quality, kolače, positive};{restaurant general, null, positive}" +Sjajno talijanska hrana!,"{food quality, talijanska hrana, positive}","{food quality, hrana, positive}" +"Međutim, ovo mjesto je dragulj i neću se prestati vraćati.","{restaurant general, mjesto, positive}","{restaurant general, mesto, positive}" +"postaje jako prometno, stoga dođite ranije kako biste mogli zgrabiti mjesto, ako morate čekati, nije loše jer usluga je brza!","{service general, usluga, positive}","{service general, usluga, positive};{restaurant miscellaneous, mesto, positive}" +"Za večeru nam je trebalo samo oko sat vremena, a cijene su bile u redu za strip, gotovo 50 dolara po osobi nakon poreza i napojnice (otprilike prosjek).","{restaurant prices, null, neutral}","{restaurant prices, null, positive};{service general, null, positive};{drinks prices, napojnice, positive}" +kolutiće luka su odlični!,"{food quality, kolutiće luka, positive}","{restaurant general, luka, positive}" +"Ako ste u blizini, ne biste trebali biti razočarani.","{restaurant general, null, positive}","{restaurant general, null, positive}" +– Velika financijska četvrt meksičko mjesto .,"{restaurant general, meksičko mjesto, positive}","{restaurant general, meksičko mjesto, positive}" +posebna rola za kuću je stvarno dobra.,"{food quality, posebna rola za kuću, positive}","{food quality, rola, positive}" +konobari vrlo su iskusni i od pomoći pri uparivanju vašeg izbora pića s vašim ukusom hrane ili obrnuto.,"{service general, konobari, positive}","{drinks quality, konobari, positive}" +Savršenstvo .,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Loše služba za korisnike / loše pizza .,"{food quality, pizza, negative};{service general, služba za korisnike, negative}","{service general, služika, negative};{food quality, pizza, negative}" +"Sve u svemu, vratio bih se i ponovno jeo u restoranu.","{restaurant general, restoranu, positive}","{restaurant general, restoran, positive}" +Poslužitelj dao je nekoliko sake prijedloga koji su bili vrlo dobri.,"{drinks quality, sake, positive};{service general, Poslužitelj, positive}","{food quality, prijeda, positive}" +Moj jedini negativan komentar je da bih volio da su komadi malo veći.,"{food style_options, komadi, negative}","{food style_options, null, negative}" +Ubrao sam šparoge koje su se pokazale nevjerojatno i savršeno pripremljene.,"{food quality, šparoge, positive}","{food quality, null, positive}" +Ono što bi većini moglo biti zanimljivo je da najgora usluga/stav dolazi od vlasnika ovog objekta.,"{service general, vlasnika, negative}","{service general, usluga, negative}" +"Jedina mana je što je ovo mjesto stvarno skupo, a porcije su male.","{restaurant prices, mjesto, negative};{food style_options, porcije, negative}","{ambience general, mjesto, negative};{food style_options, su, negative}" +"Užasno usluga, hrana ok, skupo","{service general, usluga, negative};{restaurant prices, null, negative};{food quality, hrana, neutral}","{restaurant general, us, positive}" +Iako bi se usluga mogla poboljšati s obzirom na novac koji ste uložili.,"{service general, usluga, negative}","{restaurant prices, null, negative}" +"Redovito vidite indijske obitelji i prijatelje kako tamo ručaju, što je uvijek dobar znak.","{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, indijske obitelji, positive}" +"Ako želim stajati u redu u nedjelju sat vremena kako bih dobio prosječnu hranu hrana za užinu, onda bih stavio Murphy's na vrh popisa.","{service general, null, negative};{food quality, hrana za užinu, neutral}","{food quality, hrana, positive};{restaurant general, Murphy's, positive}" +Za količinu hrane koju smo dobili cijene su trebale biti niže.,"{food prices, hrane, negative}","{food quality, hrane, negative}" +"Uvijek zauzeti, ali su dobri u tome da vas brzo smjeste i imaju brzu uslugu.","{service general, uslugu, positive};{service general, null, positive}","{service general, null, positive}" +"vinska karta je prekrasna, a hrana me podsjeća na moje nedavno putovanje u Italiju.","{drinks style_options, vinska karta, positive}","{food style_options, vinska karta, positive}" +"hrana je bila odlična, margarite također, ali konobarica je bila previše zauzeta ljubaznošću prema svojoj drugoj većoj grupi nego da bi se bolje brinula o mojoj prijateljici i meni.","{drinks quality, margarite, positive};{service general, konobarica, negative};{food quality, hrana, positive}","{service general, konobarica, negative};{food quality, hrana, positive};{food quality, margarite, positive}" +Ne mogu reći dovoljno dobrih stvari o ovom restoran i jedva čekam sljedećih nekoliko posjeta.,"{restaurant general, restoran, positive}","{restaurant general, restoran, positive}" +Volim svaki put,"{restaurant general, null, positive}","{restaurant general, svaki, positive}" +Mi smo mještani i imamo osjećaj da je jedini način na koji ovo mjesto preživljava s takvim prosjekom hrana taj što su većina gostiju vjerojatno samo jednokratni gosti.,"{food quality, hrana, negative}","{food quality, hrana, negative};{restaurant miscellaneous, mjesto, negative}" +Također volim njihovu cezer salata .,"{food quality, cezer salata, positive}","{food quality, cezer, positive}" +Ne čini da se osjećate dobrodošli i tretira vas kao gnjavatora.,"{service general, null, negative}","{service general, null, negative}" +Upravo je prave veličine za jelovnik.,"{restaurant miscellaneous, null, positive}","{food quality, Upravo, positive}" +"hrana je fantastična, a osoblje bilo je savršeno svaki put kad smo bili tamo.","{service general, osoblje, positive};{food quality, hrana, positive}","{restaurant general, null, positive};{food quality, hrana, positive}" +pustinja bio je savršen završetak gotovo savršene večere.,"{food quality, večere, positive};{food quality, pustinja, positive}","{food quality, večere, positive}" +"Bio sam ovdje, potrošio sam hrpu novca na posebnu večeru kuhara i bilo je to veliko razočaranje.","{food prices, posebnu večeru kuhara, negative};{food quality, posebnu večeru kuhara, negative}","{food quality, kuhara, positive}" +PRONAŠAO SAM NOVI DOM NA DRUGOJ AVENIJI! ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, DOM, positive}" +"– Morao sam čekati trideset minuta da uđem na vrata u utorak ujutro, ali bilo je vrijedno toga.","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive}" +"– Tužno je vidjeti mjesto koje je nekoć bilo `` ONO `` mjesto za sastajanje i jelo za post ili ručak, a sada budi mjesto koje je veliko `` NE SMIRAJ SE . ``","{restaurant general, mjesto, negative}","{restaurant general, mjesto, negative}" +"piletina s limunom imala je okus poput ljepljivih slatkih krafni, a kozice s medom i orahom, ono malo što vam zapravo daju... nije bilo dobro.","{food quality, piletina s limunom, negative};{food quality, kozice s medom i orahom, negative};{food style_options, kozice s medom i orahom, negative}","{food quality, kozice s medom i orahom, negative};{food quality, piletina s limunom, negative}" +"Bilo je romantično - pa čak i lijepo čak i s mojom sestrom, podsjetilo me na Italiju i imalo je umjetničko djelo i glazbu koje su održavale osjećaj da se nalazim u mediteranskoj vili.","{ambience general, null, positive};{ambience general, glazbu, positive};{ambience general, umjetničko djelo, positive}","{ambience general, null, positive}" +"sushi je bio odličan, a posluga je bila brza.","{service general, posluga, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{service general, posluga, positive}" +"Zapravo, mnogi se žele vratiti i drugi put tijekom svog posjeta.","{restaurant general, null, positive}","{restaurant general, Zapravo, positive}" +– Najbolje meksičko mjesto za ručak u financijskoj četvrti.,"{restaurant general, meksičko mjesto, positive}","{restaurant general, mjesto, positive}" +volim ovo mjesto!,"{restaurant general, mjesto, positive}","{food quality, ovo mjesto, positive}" +atmosfera je sjajna.,"{ambience general, atmosfera, positive}","{ambience general, atmosfera, positive}" +Savršen za hladan dan.,"{food quality, null, positive}","{restaurant general, null, positive}" diff --git a/experiments/Natural/preds_sk.csv b/experiments/Natural/preds_sk.csv new file mode 100644 index 0000000000000000000000000000000000000000..b20544f256abd761a88b9dabb1e1db62d8cc0895 --- /dev/null +++ b/experiments/Natural/preds_sk.csv @@ -0,0 +1,545 @@ +input,gold,pred +Čakal som 10 - 15 minút na služba objednané pivo a už sa nikdy nepodávalo.,"{service general, služba, negative}","{service general, služba, negative}" +atmosféra bola pokojná a relaxačná prestávka medzi všetkými deťmi pobehujúcimi v Downtown Disney.,"{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive}" +skrytý malý jem,"{restaurant general, null, positive}","{restaurant miscellaneous, null, negative}" +Išiel som tam s priateľom mimo mesta ... a obaja sme boli veľmi ohromení!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Má skvelé sushi a ešte lepšie služba.,"{service general, služba, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{service general, služba, positive}" +Všetky ich položky menu sú hitom a podávajú mimózy.,"{food quality, položky menu, positive}","{food quality, menu, positive}" +"– ... a najlepší letný zážitok paluba -- dokonca vám prinesú aj deku, ak vám bude zima vo večernom počasí v Seattli.","{ambience general, paluba, positive};{service general, null, positive}","{restaurant miscellaneous, paluba, positive}" +"– Po 12 rokoch v Seattli Ray's hodnotím ako miesto, kam sa vždy vraciame.","{restaurant general, Ray's, positive}","{restaurant general, Ray's, positive}" +Tu sa nemôžete pokaziť.,"{restaurant general, null, positive}","{restaurant general, null, negative}" +"Myslím, že som pravdepodobne vyskúšal každú položku v ich menu aspoň raz, všetko je vynikajúce.","{food quality, menu, positive}","{food quality, menu, positive}" +– feferónky nakrájané na skutočne hrubé – mňam.,"{food style_options, feferónky, positive}","{food quality, null, negative}" +"Creme brulee zo zeleného čaju sa zlepšuje zakaždým, keď si ho dám.","{food quality, Creme brulee zo zeleného čaju, positive}","{food quality, zeleného čaju creme brulee, positive}" +"nie príliš jemná myšlienka, že sa cítite nepohodlne a musíte sa prezliecť.","{ambience general, null, positive}","{restaurant miscellaneous, null, negative}" +Atmosféra bola pekná.,"{ambience general, Atmosféra, positive}","{ambience general, Atmosfera, positive}" +úplne báječné! ! !,"{restaurant general, null, positive}","{food quality, null, negative}" +VYHNITE SA MIESTO,"{restaurant general, MIESTO, negative}","{restaurant general, MIesto, positive}" +"Aby som bol úprimný, mal som lepšiu mrazenú pizza.","{food quality, pizza, negative}","{food quality, pizza, positive}" +"služba bola výnimočná - niekedy bol pocit, že nás obsluhuje armáda priateľských čašníci.","{service general, služba, positive};{service general, čašníci, positive}","{service general, služba, negative}" +A všetko pekne zabalili aby sa to nevylialo .,"{service general, null, positive}","{food quality, null, negative}" +VEĽMI DOBRÉ!,"{restaurant general, null, positive}","{restaurant general, DOBRÉ, positive}" +jedlo je hriešne.,"{food quality, jedlo, positive}","{restaurant general, hrie, positive}" +Na začiatok vás približne 8-10 uncí pomarančový džús bude stáť 3 doláre.,"{drinks prices, pomarančový džús, negative}","{food quality, pomoderné džus, negative};{food prices, pomoderné džus, negative}" +dobrý výber saké .,"{drinks style_options, výber saké, positive}","{drinks quality, saké, positive}" +"Aj keď by som sa mohol zaobísť bez mládeže, ktorá s nami zdieľala večer, náš úžasný server a jedlo urobili tento zážitok veľmi pozitívnym.","{restaurant miscellaneous, null, positive};{service general, server, positive};{food quality, jedlo, positive}","{service general, server, positive};{food quality, jedlo, positive}" +Aký nález!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +– Mioposto má veľmi kreatívne a chutné menu pizze.,"{food quality, menu pizze, positive};{food style_options, menu pizze, positive}","{food style_options, menu, positive};{food quality, pizze, positive}" +"Na nedávnej ceste bol náš čašník mimoriadne odmietavý, zatiaľ čo najmenej traja zamestnanci čakali rukami a nohami na dvojicu japonských dievčat sediacich neďaleko.","{service general, čašník, negative}","{service general, zamestnanci, negative}" +"Za normálnych okolností by som nedojedol brokolica, keď si objednávam tento druh jedla, ale po prvýkrát bol každý kúsok taký bohatý ako ten prvý... mušle a krevety boli také čerstvé a pekne uvarené.","{food quality, krevety, positive};{food quality, mušle, positive};{food quality, brokolica, positive}","{food quality, brokolica, positive};{food quality, mušle, positive};{food quality, krevety, positive}" +"Nie je to najlacnejšie sushi, ale vždy to stálo za to.","{food quality, sushi, positive};{food prices, sushi, neutral}","{food quality, sushi, positive}" +Po jedle sa nikdy necítite zle a napchato.,"{food quality, null, positive}","{food quality, null, negative}" +Ako súčasť malej štvorčlennej párty bolo naše jedlo vynechané bez komentára;,"{service general, null, negative}","{service general, párty, negative}" +"Dúfam, že jedného dňa Scooner alebo neskôr sa vráti to, čo bolo kedysi.","{restaurant general, Scooner alebo neskôr, negative}","{restaurant general, Scooner, positive}" +"Po prvé, jedlo prišlo rýchlo a všetko spolu:) páči sa mi to... neznášam domýšľavosť vecí, ktoré prichádzajú jedna za druhou.","{service general, null, positive}","{food quality, jedlo, positive};{service general, null, positive}" +jedlo bolo skvelé!,"{food quality, jedlo, positive}","{food quality, bolo, positive}" +"Ak existuje linka v deň v týždni po celú dobu otvorenia miesto, viete, že je to skvelé.","{restaurant general, miesto, positive}","{restaurant general, miesto, positive}" +"Najpríjemnejším prekvapením bol šek, ktorý neprekonal moje očakávania, ako to na väčšine miest vždy býva.","{restaurant prices, null, positive}","{restaurant general, null, positive}" +V najlepšom prípade jedlo bolo dobré a určite predražené.,"{food quality, jedlo, positive};{food prices, jedlo, negative}","{food quality, jedlo, negative};{food prices, jedlo, negative}" +Vonkajšia terasa má skrátenú menu .,"{food style_options, menu, neutral}","{food quality, menu, negative}" +Najlepšie indické jedlo v L.A.,"{food quality, indické jedlo, positive}","{food quality, indické jedlo, positive}" +Vystrihnúť na vec – to je úžasné!,"{restaurant general, null, positive}","{food quality, null, positive}" +"jedlo už nie je to, čo bolo (elixíry vážne sa znížili), ceny stúpli a služba je to najhoršie, čo som kedy zažil (vrátane kontinentálnej Európy).","{service general, služba, negative};{food style_options, elixíry, negative};{food quality, jedlo, negative};{food prices, jedlo, negative}","{restaurant prices, jedlo, negative};{service general, služba, negative};{food quality, elixíry, negative}" +Libanonské jedlo ! Mňam!,"{food quality, Libanonské jedlo, positive}","{restaurant general, Liban, positive}" +brokolica boli tak čerstvé a chutné.,"{food quality, brokolica, positive}","{food quality, brokolica, positive}" +A dávajú dobré množstvo za cenu.,"{food style_options, null, positive}","{food style_options, null, positive};{food quality, null, positive};{food prices, null, positive}" +Veľmi sklamanie,"{restaurant general, null, negative}","{restaurant general, null, positive}" +TO NAJLEPŠIE v Seattli Vínny lístok,"{drinks style_options, WinelVínny lístokist, positive}","{restaurant general, Vín, positive}" +– Nemôžem o tom povedať dosť miesto .,"{restaurant general, miesto, positive}","{restaurant general, miesto, positive}" +– Stravujem sa na tomto mieste už viac ako 8 rokov a nikdy som nemal ani jedno zlé jedlo.,"{food quality, jedlo, positive}","{food quality, jedlo, positive}" +"Išiel som domov a znova som ich vyhľadal online, kde som zistil, že existuje odkaz na darček, ktorý nefunguje, a tak som poslal e-mail do reštaurácia o neexistujúcej službe a klamlivom odkaze.","{restaurant miscellaneous, reštaurácia, negative}","{service general, služba, negative};{service general, odkaz, negative}" +Efektné kúsky exotické ryby na 100 dolároch tanier a ANI JEDNA sa nedala jesť.,"{food quality, exotické ryby, negative};{food prices, tanier, negative};{food style_options, exotické ryby, negative}","{food quality, kúsky, negative};{food style_options, ryby, positive}" +"Mal som mňam jahňacie korma, saag paneer, samosas, naan atď.","{food quality, jahňacie korma, positive};{food quality, naan, positive};{food quality, saag paneer, positive};{food quality, samosas, positive}","{food quality, korma, positive};{food quality, naan, positive};{food quality, paneer, positive};{food quality, samosas, positive}" +Podáva naozaj dobre sushi.,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"Ako obvykle omikase nesklamala v čerstvosti, hoci v kreativite a výbere zaznamenala nízke skóre.","{food style_options, omikase, negative};{food quality, omikase, positive}","{food quality, omlet, negative};{food quality, skóre, negative}" +"Ryža je príliš suchá, tuniak tiež nebola taká čerstvá.","{food quality, tuniak, negative};{food quality, Ryža, negative}","{food quality, Ryža, negative}" +Ich krabie vajcia benedikt je návykový.,"{food quality, krabie vajcia benedikt, positive}","{food quality, vajc, positive}" +Ušetrite miesto pre báječné dezerty .,"{food quality, dezerty, positive}","{food quality, dezert, positive}" +Náš server bol veľmi profesionálny a priateľský.,"{service general, server, positive}","{service general, server, positive}" +Išiel som sem na odporúčanie a určite sa vrátim znova a znova.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"jedlo bolo všetko dobré, ale bolo to príliš mierne.","{food quality, jedlo, negative};{food quality, jedlo, positive}","{food quality, bolo, negative};{food quality, jedo, positive}" +– Môj manžel a ja radi jeme v Mioposto Café .,"{restaurant general, Mioposto Café, positive}","{restaurant general, Miop, positive}" +- Bol to skvelý kulinársky zážitok.,"{restaurant general, null, positive}","{food quality, kulin, positive}" +personál bol skutočne priateľský.,"{service general, personál, positive}","{service general, personál, positive}" +Ľahko sme minuli viac ako 40 dolárov na osobu (bez alkoholu) a stále sme boli hladní.,"{restaurant prices, null, negative};{food style_options, null, negative}","{restaurant general, null, negative};{restaurant prices, null, negative}" +"Čo sa týka čerstvosti, je to tu s miestami v Tokiu.","{food quality, null, positive}","{food quality, čerstvost, positive}" +Groovy hudba urobil večeru neformálnou.,"{ambience general, hudba, positive}","{restaurant general, null, positive}" +"Potom, čo jedného člena našej skupiny opakovane zrazila čašníčka, zdvorilá žiadosť, aby nebol zrazený, spôsobila, že čašníčka urážal.","{service general, čašníčka, negative}","{service general, čašníčka, negative}" +– Ray's (prekvapivo) má to NAJLEPŠIE a najrozmanitejšie v meste vínny lístok.,"{drinks style_options, vínny lístok, positive}","{drinks quality, vínny lístok, positive};{drinks style_options, vínny lístok, positive}" +"Pravdepodobne by som sa nevrátil, pretože neviem, či to stojí za to.","{restaurant general, null, negative}","{restaurant general, null, negative}" +čipy a salsa sú také chutné a ceny sú báječné.,"{restaurant prices, null, positive};{food quality, čipy a salsa, positive}","{food quality, čipy, positive};{food quality, salsa, positive};{restaurant prices, null, positive}" +"someliér je fantastický, prostý a mimoriadne informovaný.","{service general, someliér, positive}","{service general, null, positive}" +veľké husté feferónky,"{food style_options, feferónky, positive}","{food quality, feferky, positive}" +Vôbec sa neoplatí ísť a minúť tam svoje peniaze! ! !,"{restaurant general, null, negative}","{restaurant prices, null, negative}" +Urážlivo predražené,"{restaurant prices, null, negative}","{restaurant miscellaneous, null, negative}" +Vnútorné prostredie bolo moderné.,"{ambience general, Vnútorné prostredie, positive}","{food quality, Vnút, positive}" +NECHOĎTE !,"{restaurant general, null, negative}","{restaurant general, NE, positive}" +"Kým sa to nestane, moja rada je ZOSTAŇ PREČ.","{restaurant general, null, negative}","{restaurant general, null, negative}" +"Oh, zabudol som spomenúť, že nemajú službu chleba.","{service general, null, negative}","{service general, službu, negative}" +Nie sú mastné ani nič podobné .,"{food quality, null, positive}","{food quality, null, negative}" +"hudba je skvelá, žiadna noc nie je lepšia alebo horšia, barové ponuky sú veľkorysé s nalievaním a veselá atmosféra vám zdvihne náladu.","{drinks style_options, barové ponuky, positive};{ambience general, atmosféra, positive};{ambience general, hudba, positive}","{ambience general, atmosféra, positive};{drinks style_options, barové ponuky, positive};{food style_options, hudba, positive}" +"Pekné atmosféra, ale vysoko nadhodnotené miesto.","{restaurant general, miesto, negative};{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive};{restaurant general, miesto, negative}" +sushi tu je vynikajúce!,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"– Som nesmierne rád, že môžem oznámiť, že moja večera v Ray's Boathouse minulý piatok úplne prekonala moje očakávania.","{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's, positive}" +"Večere boli vždy vynikajúce, pokiaľ ide o kvalitu potravín.","{food quality, Večere, positive}","{food quality, potravín, positive}" +Všetky ich aplikácie sú vynikajúce.,"{food quality, aplikácie, positive}","{food quality, aplikácie, positive}" +Blue Ribbon dostojí svojej fantastickej povesti.,"{restaurant general, Blue Ribbon, positive}","{restaurant general, Blue Ribbon, positive}" +Cítil som sa trápne a nabudúce som išiel do kúpeľne v kasíne.,"{restaurant miscellaneous, null, negative}","{restaurant general, null, negative}" +– Rozhodol som sa jesť v Stack kvôli ich fixná cena pred predstavením .,"{food prices, fixná cena pred predstavením, neutral}","{restaurant prices, null, positive}" +– Vzal som sem svojich rodičov na ich výročie – som veľmi sklamaný! ! !,"{restaurant general, null, negative}","{restaurant general, Vz, negative}" +Neprekonateľné sushi!,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"Na začiatok bola naša milá servírka Brooke rýchlo po ruke, aby prijala moju objednávku na drink.","{service general, Brooke, positive}","{service general, Brooke, positive}" +"Zakaždým, keď sa `` 0-sixtynine `` nazýva barman, kúpi všetkým nápoje!","{service general, barman, positive}","{drinks quality, nápoje, positive};{service general, barman, positive}" +"Nekonečná zábava, úžasné hudba, skvelé personál! ! !","{restaurant general, null, positive};{service general, personál, positive};{ambience general, hudba, positive}","{service general, personál, positive};{ambience general, zábava, positive};{ambience general, hudba, positive}" +Fair výber z menu .,"{food style_options, výber z menu, neutral}","{food quality, menu, positive}" +"Dve nezbedné deti sedeli blízko nás počas prvej časti našej večere... nahradila ich rozkošná nedospelá tínedžerka, ktorá predstierala dávenie zakaždým, keď sa pri jej stole spomenuli morské plody.","{restaurant miscellaneous, null, negative}","{service general, nedospelá tínedžerka, negative}" +"Odmietol som to, pretože v procese pokusu opraviť vajcia rozbili niečo iné v miske a bol som príliš frustrovaný na to, aby som pokračoval.","{food quality, miske, negative}","{restaurant general, null, negative}" +"mal veľa jedál, ale NAJLEPŠIE bolo homár 3 spôsoby.","{food quality, homár 3 spôsoby, positive}","{food quality, jedl, negative};{food quality, bhoj, negative};{food quality, spôsob, negative}" +"predjedlo bolo zaujímavé, ale Creme Brulee bolo veľmi pikantné a chutné.","{food quality, Creme Brulee, positive};{food quality, predjedlo, positive}","{food quality, Creme Brulee, positive};{food quality, bolo, positive};{food quality, predjed, positive}" +dekor bol krásny a jedinečný.,"{ambience general, dekor, positive}","{ambience general, dekor, positive}" +"Je to čerstvé, príjemné, chutné a relaxačné.","{food quality, null, positive};{ambience general, null, positive}","{food quality, null, positive};{ambience general, null, positive}" +Návykové!,"{restaurant general, null, positive}","{restaurant general, Návy, negative}" +"Dokonca aj cícer, ktorý sa mi normálne zdá príliš suchý, bol dobrý.","{food quality, cícer, positive}","{food quality, null, positive}" +Toto miesto rockuje! !,"{restaurant general, miesto, positive}","{food quality, rock, positive}" +"To je obrovský kompliment, najmä v nestálom reštauračnom biznise, ... už dosť!","{restaurant general, null, positive}","{restaurant general, rešta, positive}" +"Potom, čo som tam sedel s prázdnym pohárom viac ako 20 minút, odišiel som.","{service general, null, negative}","{restaurant general, Potom, negative}" +Určite vyskúšajte ustrice roll .,"{food quality, ustrice roll, positive}","{food quality, ustrice, positive}" +"Som prekvapený, že táto reštaurácia je kategorizovaná ako $ $ $ a nie $ $ $ $.","{restaurant prices, reštaurácia, negative}","{restaurant prices, reštačnia, negative}" +"Bolo to slušné, ale nič výnimočné.","{food quality, null, neutral}","{food quality, null, neutral};{food quality, Bolo, positive}" +"Služba bola trochu pomalá, našej čašníčke trvalo večnosť, kým nám dala náš šek, aj keď to nebolo také zaneprázdnené.","{service general, čašníčke, negative};{service general, Služba, negative}","{service general, Služba, negative};{restaurant miscellaneous, čašní, negative}" +"– Skvelé nápoje , kukuričný hovädzí hash, káva , B rýchle burritos , Bezlepkové menu .","{food style_options, menu, positive};{food quality, kukuričný hovädzí hash, positive};{food quality, B rýchle burritos, positive};{drinks quality, káva, positive};{drinks quality, nápoje, positive}","{food style_options, Bezlepkové menu, positive};{food quality, Skvelpoj, positive};{food quality, burritos, positive};{food quality, káva, positive}" +obedové menu je skvelá ponuka!,"{food prices, obedové menu, positive}","{food quality, ponák, positive}" +"Trvalo celú večnosť, kým sme dostali objednávku, doplnenie vody bolo príliš veľa na to, aby sme ju žiadali, a jediný prípad, keď bola rýchla, bolo, keď sme požiadali o náš účet, keď sme mohli upútať jej pozornosť.","{service general, null, negative}","{service general, null, negative};{service general, doplnenie vody, negative}" +čašník bol trochu nepriateľský a pocit reštaurácie bol preplnený.,"{service general, čašník, negative};{ambience general, pocit, negative}","{food quality, čašník, negative};{restaurant general, reštaurant, negative}" +"– Nedávno som mal to potešenie stolovať v tejto nádhernej reštaurácia na 2. ulici a wow, aký skvelý večer sme mali.","{restaurant general, reštaurácia, positive}","{restaurant general, reštaurácia, positive}" +"Špecialitou sú dekadentné palacinky, ale teraz som sa vrátil štyrikrát a zakaždým som bol ohromený.","{food quality, palacinky, positive}","{food quality, sú, positive};{food quality, palacinky, positive}" +- Docela lacné na posedenie v Mexiku A v centre mesta.,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant general, null, positive}" +"predjedlo z ustríc, homára, kraba (malá veľkosť) bolo pre moju ženu dokonalým jedlom.","{food quality, predjedlo z ustríc, homára, kraba (malá veľkosť, positive}","{food quality, homára, positive};{food style_options, kraba, positive};{food quality, z predjedlo, positive}" +"Práve som zistil, že môžete mať miesto pre seba cez noci a víkendy na súkromnú párty - už sa neviem dočkať, kedy tam oslávim moje ďalšie narodeniny.","{restaurant miscellaneous, miesto, positive}","{restaurant miscellaneous, miesto, positive}" +"– Ako vo väčšine reštaurácií v Seattli, Mioposto's služba bola zlá a jedlo bola predražená.","{service general, služba, negative};{food prices, jedlo, negative}","{service general, služba, negative};{food prices, jedlo, negative}" +"Môžete ho však ľahko počuť, takže to bol príjemný zvuk a nie arogantný.","{ambience general, null, positive}","{food quality, null, positive}" +Choďte tam a presvedčte sa sami.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Je to skvelá maličkosť miesto s množstvom potenciálu stať sa susedom, ak by služba nebola taká neosobná a korporátna.","{service general, služba, negative};{restaurant general, miesto, positive}","{service general, služba, negative};{restaurant miscellaneous, miesto, positive}" +"Brunch u Murphyho je zomrieť pre , moja špecialita ... omeleta z vaječných bielkov, jedlo je vždy čerstvo pripravené.","{food quality, Brunch, positive};{food quality, jedlo, positive};{food quality, omeleta z vaječných bielkov, positive}","{food quality, omeleta z vaječných bielkov, positive}" +"Mama Mia – Bývam v susedstve a mám šťastie, že bývam v takom skvelom pizzeria .","{restaurant general, pizzeria, positive}","{restaurant general, pizzeria, positive}" +– schovaný pri Beverly Center .,"{location general, null, neutral}","{restaurant general, Beverly Center, negative}" +personál je celkom priateľský.,"{service general, personál, positive}","{service general, personál, positive}" +A služba bola jednoducho vynaložená - celkom potešenie.,"{service general, služba, positive}","{service general, služba, positive}" +Ok... – Možno som vstúpil do niekoho zlého dňa...,"{restaurant general, null, negative}","{restaurant general, dňa, positive}" +"Mal som okrem iného Medúza, Stavrida, Tuniak modroplutvý a Sake Ikura roll a všetky boli dobré.","{food quality, Medúza, positive};{food quality, Sake Ikura roll, positive};{food quality, Tuniak modroplutvý, positive};{food quality, Stavrida, positive}","{food quality, Stavrida, positive};{drinks quality, Sake, positive};{food quality, Tuniak, positive};{food quality, Medúza, positive};{food quality, Sake Ikura roll, positive}" +ČO EŠTE MÔŽETE POVEDAŤ PEKNÉ ĽUDIA ÚŽASNÉ JEDLO WOW,"{food quality, JEDLO, positive};{service general, ĽUDIA, positive}","{restaurant miscellaneous, ČO, positive}" +Vždy dobré.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"V ústach som mal potom veľmi sucho a mal som ten podpis? MSG? Chuť pretrvávajúca v mojom hrdle po tom, čo som odišiel z reštaurácie.","{food quality, null, negative}","{food quality, null, negative};{restaurant general, null, negative}" +Ach áno ... aj ten pohľad bol dobrý.,"{location general, pohľad, positive}","{food quality, bol, positive}" +"manažér neustále prerušoval slovami `` Môžem pre vás ešte niečo urobiť? ``, zvláštny komentár, pretože takmer nepočúvala, nieto ešte reagovala na náš výraz sklamania z našej skúsenosti.","{service general, manažér, negative}","{service general, manažér, negative}" +služba sa pohybuje od priemernej až po urážlivú.,"{service general, služba, negative}","{service general, služba, negative}" +Čerstvé prísady a super chutné.,"{food quality, null, positive};{food quality, prísady, positive}","{food quality, prísady, positive};{food quality, null, positive}" +atmosféra reštaurácie bola pekná a vhodná na dobré jedlo.,"{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive};{restaurant general, null, positive}" +A hore je skvelé miesto na stretnutie.,"{ambience general, hore, positive}","{restaurant general, null, positive}" +– Nie je to zlé.,"{restaurant general, null, neutral}","{restaurant general, null, negative}" +Mal som tanier Kafta a bolo to perfektné.,"{food quality, tanier Kafta, positive}","{food quality, bolo, positive}" +– Toto miesto je známe svojimi raňajky .,"{food quality, raňajky, positive}","{restaurant general, null, positive}" +"Čakal sa 35 minút na stôl pre 8, čo bolo v poriadku pre taký veľký dav.","{service general, null, neutral}","{restaurant miscellaneous, null, negative};{service general, null, negative}" +Celý personál bol mimoriadne ústretový a staral sa o každú moju potrebu.,"{service general, personál, positive}","{service general, personál, positive}" +"Na mieste bolo naozaj pekné atmosféra ... dobré hudba, atmosféra a veselý vzhľad ľudia.","{restaurant miscellaneous, ľudia, positive};{ambience general, atmosféra, positive};{ambience general, hudba, positive}","{ambience general, atmosféra, positive};{ambience general, hudba, positive};{ambience general, vzhled, positive};{service general, ľudia, positive}" +"Vyskúšajte Chef's Choice pre sushi, pretože údený žltochvost bol neuveriteľný a rolky boli tiež chutné.","{food quality, rolky, positive};{food quality, Chef's Choice pre sushi, positive};{food quality, údený žltochvost, positive}","{food quality, rolky, positive};{food quality, Chef's Choice pre sushi, positive};{food quality, údne žltochov, positive}" +"sushi je také čerstvé, ako príde? Mysleli by ste si , že oceán je na ich dvore , žiadny vtip !","{food quality, sushi, positive}","{food quality, sushi, positive}" +"jedlo bolo v poriadku, trochu chutnejšie ako normálne salsa.","{food quality, salsa, positive};{food quality, jedlo, positive}","{food quality, jedlo, positive}" +"Pre vyberavých sushi a tých, ktorí ochutnali to najlepšie, čo NYC ponúka, je ryba najčerstvejšie a služba je vynikajúca.","{service general, služba, positive};{food quality, ryba, positive}","{food quality, ryba, positive};{service general, služba, positive};{food quality, sushi, positive}" +Starý spoľahlivý,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Jedno z najlepších Sushi miesto v meste.,"{restaurant general, Sushi miesto, positive}","{food quality, Sushi, positive}" +"Jedlo múdre, je to v poriadku, ale trochu drahé za to, čo dostanete, pretože reštaurácia nie je luxusné miesto.","{food quality, Jedlo, neutral};{restaurant prices, reštaurácia, negative};{ambience general, reštaurácia, neutral}","{restaurant prices, reštaurácia, negative};{restaurant general, reštaurácia, neutral}" +"Milujte ich pizzu, najmä hubovú pizzu.","{food quality, pizza, positive};{food quality, hubovú pizzu, positive}","{food quality, pizzu, positive}" +Prišli vo svojej vlastnej šikovnej škatuľke a s trochou domácej polevy; veľmi ľahké a nie príliš sladké.,"{food quality, null, positive}","{food quality, null, negative};{food style_options, null, positive}" +Užil si jedlo,"{food quality, jedlo, positive}","{restaurant general, null, positive}" +Bol som v tejto reštaurácii viac ako tucetkrát bez sťažností.,"{restaurant general, reštaurácii, positive}","{restaurant general, reštaurácii, positive}" +"Radšej si to objednajte a vyzdvihnite, pretože sa mi nepáčia najmä servery, jeden mladá žena.","{service general, mladá žena, negative};{service general, servery, negative}","{service general, mladá žena, negative}" +úžasný nález,"{restaurant general, null, positive}","{restaurant general, nález, positive}" +"Nebolo to najčerstvejšie morské plody, ale chuť a prezentácia boli v poriadku.","{food quality, morské plody, neutral};{food style_options, morské plody, neutral}","{food quality, morské plody, positive};{food style_options, morské plody, positive};{food style_options, chuť, positive}" +Hodnota a služba však výrazne chýbajú.,"{service general, služba, negative};{restaurant prices, null, negative}","{service general, služba, negative}" +V Grammercy/Union Square/East Village sú to moji susedia a moje obľúbené miesto.,"{restaurant general, miesto, positive}","{restaurant general, Grammercy/Union Square/East Village, positive}" +"strana zemiakov má zomrieť, rovnako ako labne (jogurtový dip) .","{food quality, strana zemiakov, positive};{food quality, labne (jogurtový dip, positive}","{food quality, zemi, positive};{food quality, labne (jogurtový dip, positive}" +ÚŽASNÉ .,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Aká chutná, šupinatá pochúťka!","{food quality, null, positive}","{food quality, pochútky, positive}" +"Skvelé jedlo, lepšie Margarity!","{drinks quality, Margarity, positive};{food quality, jedlo, positive}","{food quality, Margarity, positive}" +služba je skutočne pozorná a očarujúca.,"{service general, služba, positive}","{service general, služba, positive}" +"Najdôležitejšie je, že sme boli tak nadšení z jedla, keď sme videli veľmi kreatívne menu.","{food style_options, menu, positive}","{food style_options, menu, positive};{food quality, jedla, positive}" +Útulné miesto pre 2,"{ambience general, miesto, positive}","{restaurant general, null, positive}" +"Najlepšie na tom je, že ceny sú tiež celkom rozumné.","{restaurant prices, null, positive}","{restaurant prices, null, positive}" +"Sľúbila, že sa porozpráva s čašníčkou, ktorá rozzúrená odletela, ale jej sľub sme sotva mohli brať vážne, keďže sa neobťažovala získať meno čašníčky.","{service general, null, negative}","{service general, čašníčka, negative}" +chana masala (garbanzo fazuľa) sú tiež vynikajúce.,"{food quality, chana masala (garbanzo fazuľa, positive}","{food quality, chana masala (fazola, positive}" +"Toto podnik skutočne zaznamenalo výrazný pokles po (a toto je opakujúci sa príbeh) odvysielaní FOOD TELEVISIONS `` DINERS , DRIVE-INS , AND DIVES `` organizovaných Guyom Fierim, v ktorom bol Škuner alebo neskôr predmetom .","{restaurant general, podnik, negative}","{restaurant general, Škuner, negative}" +Milujem Kraby Dungeness a v Ray's ich dostanete naservírované asi 6 rôznymi spôsobmi!,"{food style_options, Kraby Dungeness, positive}","{food quality, null, positive}" +Jedlo bolo dobré a chutné.,"{food quality, Jedlo, positive}","{food quality, Jedlo, positive}" +Bolo to úplne úžasné.,"{restaurant general, null, positive}","{food quality, Bolo, positive}" +Toto je skvelé miesto na získanie vynikajúceho jedla.,"{food quality, jedla, positive}","{food quality, jedľa, positive}" +navyše som alergický na ryžu a obsluha čašník bola neuveriteľne ústretová - ani nemihla!,"{service general, čašník, positive}","{service general, obsluha, negative};{food quality, ryba, negative}" +– Bol som veľmi sklamaný z jedlo v Pagode.,"{food quality, jedlo, negative}","{restaurant general, Pagoda, positive}" +Predražené,"{restaurant prices, null, negative}","{restaurant general, null, negative}" +"Je to smutné pre to, čo bolo kedysi jedným z najlepších miest, aké ste kedy mohli jesť.","{restaurant general, null, negative}","{restaurant general, null, negative}" +"Akonáhle ste vo vnútri, skutočný zážitok začína.","{restaurant general, null, positive}","{restaurant general, null, positive}" +a čašník navrhol perfektné saké! !,"{drinks quality, saké, positive}","{drinks quality, čašník, positive}" +"vlastník je agresívny voči hosťom, ktorí majú sťažnosť.","{service general, vlastník, negative}","{service general, null, negative}" +"Všetko, čo chcete, a ešte viac, veľmi čerstvé.","{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive}" +Môjmu priateľovi chutil grilovaný aljašský kráľovský losos s delikátnymi smotanovými washingtonskými červenohnedými zemiakmi a chrumkavými zelenými fazuľkami.,"{food quality, grilovaný aljašský kráľovský losos, positive};{food quality, smotanovými washingtonskými červenohnedými zemiakmi, positive};{food quality, zelenými fazuľkami, positive}","{food quality, grilovaný aljašský kráľovský losos, positive};{food quality, washingtonské červenohnedé zemiak, positive};{food quality, chrumkavé zelené fazuľky, positive}" +"jedlo bolo veľmi dobré, filet mignon bolo pravdepodobne to najlepšie, čo som kedy skúšal.","{food quality, filet mignon, positive};{food quality, jedlo, positive}","{food quality, filet mignon, positive};{food quality, jedlo bolo, positive}" +"- Reštaurácia Mercedes je taká chutná, že služba je nepopierateľne úžasná!","{service general, služba, positive};{food quality, null, positive}","{service general, služba, positive};{food quality, Reštaurácia, positive}" +Môžem vrelo odporučiť ich rôzne saag a paneer a korma.,"{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}" +jedlo je skvelé a robia priemer krvavá Mária.,"{drinks quality, krvavá Mária, positive};{food quality, jedlo, positive}","{food quality, Mária, positive}" +"Pekné jedlo, ale bez korenia!","{food quality, jedlo, negative};{food quality, jedlo, positive}","{food quality, jedlo, positive}" +Ďalším plusom je otvorená pocit reštaurácie so sklenenými stenami na všetkých stranách.,"{ambience general, pocit, positive}","{ambience general, stenami, positive}" +Mňam!,"{food quality, null, positive}","{restaurant general, Mňam, positive}" +"Samotná kúpeľňa je veľmi malá s dvoma toaletami a iba jedným umývadlom, dievča zostalo úplne na ceste a vešalo papierové utierky z dávkovača.","{restaurant miscellaneous, kúpeľňa, negative}","{ambience general, kúpeľňa, negative}" +Milujte enchiladas a kuracia polievka – a určite si pozrite ich špeciály .,"{food quality, enchiladas, positive};{food quality, špeciály, positive};{food quality, kuracia polievka, positive}","{food quality, enchiladas, positive};{food quality, polievka, positive};{food quality, špeciály, positive}" +jedlo je jednoducho nezabudnuteľné!,"{food quality, jedlo, positive}","{restaurant general, null, positive}" +Manažment by si mal naozaj všímať a vyškoliť ich čašníkov a naučiť ich nejakému správnemu správaniu.,"{service general, čašníkov, negative}","{service general, čašníkov, negative}" +personál je priateľský a dekor bol etický a farebný.,"{ambience general, dekor, positive};{service general, personál, positive}","{ambience general, dekor, positive};{service general, personál, positive}" +"Najlepšie Chuwam Mushi, aké som kedy mal.","{food quality, Chuwam Mushi, positive}","{food quality, Chuwam, positive}" +"Porcie mi stačilo, ale možno nie pre veľkého jedlíka.","{food style_options, Porcie, neutral}","{food style_options, null, negative};{food quality, null, negative}" +Vyskúšajte Pizza Ensalata!,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza, positive}" +Napriek tomu by som to odporučil miesto.,"{restaurant general, miesto, positive}","{restaurant general, null, positive}" +"– sushi tu je úplne dobré, ale za 5 dolárov za kus by mali byť plátky ryby väčšie, alebo by sa nemalo predstierať, že ide o strednú cenu reštaurácia (aj pre NYC) .","{food prices, sushi, negative};{food style_options, sushi, negative};{restaurant prices, reštaurácia, negative};{food quality, sushi, positive}","{food quality, sushi, positive};{food prices, sushi, neutral};{food style_options, sushi, negative}" +Určite zažijete veľmi očarujúce chvíle.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Odvtedy sme sa vrátili a tiež sme mali skvelý zážitok, ochutnali sme viac malých tanierov a rôzne pivo (studené a dobré).","{restaurant general, null, positive};{drinks quality, pivo, positive}","{food quality, tanierov, positive};{drinks quality, pivo, positive};{restaurant general, null, positive}" +Najlepšie Sushi v meste.,"{food quality, Sushi, positive}","{food quality, Sushi, positive}" +personál bol veľmi milý a zdvorilý a zjavne čínsky.,"{service general, personál, positive}","{service general, personál, negative}" +"Objednali sme si výber z malých tanierov a cibuľa na topánkach, pizza s kozím syrom, grilovaná špargľa a vyprážané brie s ovocím boli všetky veľmi dobré.","{food quality, pizza s kozím syrom, positive};{food quality, vyprážané brie s ovocím, positive};{food quality, grilovaná špargľa, positive};{food quality, cibuľa na topánkach, positive}","{food quality, pizza s kozím syrom, positive};{food quality, vyprážené brie s ovocím, positive};{food quality, grilovaná špargľa, positive};{food quality, cibuľa na topánkach, positive};{food quality, výber z malých tanierov, positive}" +Pekná práca!,"{restaurant general, null, positive}","{restaurant general, práca, positive}" +"Jedna vec, ktorú som si neskôr uvedomil, bolo, že reštaurácia používala na steak MSG alebo zmäkčovač mäsa.","{food quality, steak, negative}","{food quality, steak, negative};{food quality, mäsa, negative}" +Skvelé výber saké .,"{drinks style_options, výber saké, positive}","{drinks quality, saké, positive}" +Sláva týmto chlapom.,"{restaurant general, null, positive}","{restaurant general, Sláva, positive}" +"Ak sa práve nezastavíte na pár drinkov, neodporúčam vám ísť sem.","{restaurant general, null, negative}","{drinks quality, drink, positive}" +Skvelé fľaša vína.,"{drinks quality, fľaša vína, positive}","{drinks quality, vína, positive}" +otvorený sezamový kombinovaný tanier je výhodná ponuka za hromadu jedla.,"{food style_options, otvorený sezamový kombinovaný tanier, positive};{food prices, otvorený sezamový kombinovaný tanier, positive}","{food quality, kombinovaný tanier, positive};{food prices, hromada, positive}" +DÔRAZNE PREHODNENÉ! ! ! !,"{restaurant general, null, negative}","{restaurant general, DÔRAZ, negative}" +Oplatí sa čakať,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Lepšie to už nebude.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"najlepšie krevety s medom walnyt, ktoré každý ochutnal.","{food quality, krevety s medom walnyt, positive}","{food quality, krevety s medom, positive}" +Objavili sa v potravinovej sieti a zaslúžia si to.,"{restaurant miscellaneous, null, positive}","{food quality, siet, negative}" +Milujem teplé a útulné prostredie.,"{ambience general, prostredie, positive}","{restaurant general, a, positive}" +Snotty Attitude,"{service general, null, negative}","{service general, Attitude, negative}" +atmosféra je ašpirujúca a dekor je slávnostná a úžasná...,"{ambience general, dekor, positive};{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive};{ambience general, dekor, positive}" +"Ich špeciálne rolky sú pôsobivé, aj keď si nepamätám, čo sme mali.","{food quality, špeciálne rolky, positive}","{food quality, rolky, positive}" +– Miloval som tekvicové ravioli a halušky z kozieho syra (5 veľkých na tanier namiesto asi 20 malých halušiek) a moja sestra ju milovala filet mignon na špenáte a roztlačený zemiaky.,"{food quality, halušky z kozieho syra, positive};{food style_options, halušky z kozieho syra, positive};{food quality, filet mignon na špenáte a roztlačený zemiaky, positive};{food quality, tekvicové ravioli, positive}","{food quality, tekvicové ravioli, positive};{food quality, halušky z kozieho syra, positive};{food style_options, halušky z kozieho syra, positive};{food quality, filet mignon na špenáte, positive};{food quality, zemiaky, positive}" +"Nie najväčšie porcie, ale primerané.","{food style_options, porcie, neutral}","{restaurant general, null, positive}" +"Choďte s niekoľkými priateľmi, počkajte asi pol hodiny s šálkou joe a vychutnajte si viac, ako je váš priemer raňajky.","{restaurant general, null, positive};{food quality, raňajky, positive}","{drinks quality, šálka, positive};{restaurant miscellaneous, priateľmi, positive}" +skvelé služba.,"{service general, služba, positive}","{service general, služba, positive}" +"Potom nám bolo účtované ich najdrahšie saké (20 dolárov + za porciu), keď sme v skutočnosti vypili saké za menej ako polovicu tejto ceny.","{service general, null, negative}","{drinks prices, saké, negative};{drinks quality, saké, negative}" +Chutné,"{food quality, null, positive}","{restaurant general, Chutney, positive}" +kuracie kari a kuracie tikka masala sú moje obľúbené mäsové jedlá.,"{food quality, kuracie kari, positive};{food quality, kuracie tikka masala, positive}","{food quality, tikka masala, positive};{food quality, mäsové jedlá, positive}" +"najlepšia reštaurácia na svete, skvelá výzdoba, skvelá služby zákazníkom, priateľská manažér","{service general, manažér, positive};{service general, služby zákazníkom, positive};{restaurant general, reštaurácia, positive};{ambience general, výzdoba, positive}","{ambience general, výzdoba, positive};{restaurant general, reštaurácia, positive};{service general, služby, positive}" +Nápoje boli dobré.,"{drinks quality, Nápoje, positive}","{food quality, Nápoje, positive}" +"Prezentácia jedlo bola ďalším bonusom, vyzeralo to rovnako skvele, ako to chutilo!","{food quality, jedlo, positive};{food style_options, jedlo, positive}","{food quality, jedlo, positive};{food style_options, jedlo, positive}" +Dokonca aj vtedy nebola objednávka správna a stále sme čakali na pár položiek.,"{service general, null, negative}","{food quality, objednávka, positive}" +– Raz sa k nám pri raňajkách správali veľmi hrubo.,"{service general, null, negative}","{food quality, raňajáky, negative}" +"Skvelé jedlo, veľkolepé umiestnenie a priateľské služba nás neustále vracajú rok čo rok.","{service general, služba, positive};{food quality, jedlo, positive};{location general, umiestnenie, positive}","{food quality, jedlo, positive};{service general, služba, positive};{ambience general, umiestnenie, positive}" +WOW! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +- Ušetrite stratu času a nenavštevujte stránku.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Jedlo bolo dobré a lacné.,"{food quality, Jedlo, positive};{food prices, Jedlo, positive}","{food quality, bolo, positive};{food prices, bolo, positive}" +Mmm... dobre!,"{restaurant general, null, positive}","{food quality, dobre, positive}" +"Je to skvelé, ak ste tam strávili deň a nechceli ste ísť autom jesť.","{location general, null, positive}","{restaurant general, null, positive}" +"Keď to vezmeme do úvahy, musím povedať, že Ray's Boathouse si svoj titul ako inštitúcia v Seattli zaslúži.","{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}" +Skvelá hodnota sushi s vysokou kvalitou a pekným nastavenie.,"{ambience general, nastavenie, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{food quality, sushi, positive};{food prices, sushi, positive}" +"Bolo toho tak veľa, že som to ledva dojedol, ale urobil som to, pretože to bolo vynikajúce.","{food style_options, null, neutral};{food quality, null, positive}","{food quality, null, positive};{food style_options, null, positive}" +Milujem to reštaurácia,"{restaurant general, reštaurácia, positive}","{restaurant general, reštaučia, positive}" +Neodporúča sa! ! !,"{restaurant general, null, negative}","{restaurant general, Neod, positive}" +"Stáli sme tam 10 minút, zatiaľ čo zamestnanci chodili tam a späť a ignorovali nás.","{service general, zamestnanci, negative}","{service general, zamestanci, negative}" +"Môj g / f a ja sme sa zhodli, že jedlo bolo veľmi priemerné, najmä vzhľadom na cenu.","{food quality, jedlo, negative};{food prices, jedlo, negative}","{food quality, jedlo, negative};{food prices, jedlo, negative}" +"– jedlo je tu neuveriteľné, hoci kvalita je počas obed nekonzistentná.","{food quality, obed, negative};{food quality, jedlo, positive}","{food quality, null, negative};{food style_options, null, negative}" +K tomu nemám čo povedať miesto .,"{restaurant general, miesto, positive}","{restaurant general, miesto, negative}" +"Jediným problémom je, že naozaj musíte zohriať pizzu skôr, ako je jedlá, aj keď si objednáte dopredu.","{food quality, pizzu, negative}","{food quality, pizzu, negative}" +"– Toto je môj ``, ktorý musím priviesť hostí z mesta do `` reštaurácia a vždy si to užívajú a chvália.","{restaurant general, reštaurácia, positive}","{restaurant general, reštaurácia, positive}" +Mal som tanier kafta a užil som si to.,"{food quality, tanier kafta, positive}","{restaurant general, null, positive}" +"Bolo jasné, že mu to bolo úplne jedno.","{service general, null, negative}","{food quality, bolo, positive}" +"Caesar šalát, ktorý som si objednal, mal toľko citrónu, že som ho nemohol zjesť.","{food quality, Caesar šalát, negative}","{food quality, Caesar šalát, negative}" +"Náš server bol aj naďalej pozorný počas noci, ale zostal som zmätený jedným problémom: Kto si myslí, že Ray's je vhodným miestom na zobratie malých detí na večeru?","{restaurant miscellaneous, Ray's, neutral};{service general, server, positive}","{service general, server, positive};{restaurant miscellaneous, Ray's, negative}" +"Dobré jedlo, skvelé služba, priemerné ceny (pre Strip)","{service general, služba, positive};{restaurant prices, null, neutral};{food quality, jedlo, positive}","{restaurant prices, Strip, neutral};{service general, služba, positive};{food quality, jedlo, positive}" +18:00 v sobotu pred hrou na Broadwayi a rýchlo sme boli usadení a obsluhovaní.,"{service general, null, positive}","{service general, null, positive}" +Venujú také podrobnosti všetkému od miso polievka až po komplex rožky.,"{food quality, rožky, positive};{food quality, miso polievka, positive}","{food quality, rožky, positive};{food quality, miso polévku, positive}" +6 dolárov s prepitným.,"{restaurant prices, null, positive}","{restaurant general, s, positive}" +atmosféra bola skvelá.,"{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive}" +"Inými slovami, ak z vás nezarábajú $ $, potom nemáte vysokú mieru na ich 'service scale'.","{service general, service, negative}","{service general, service, negative};{restaurant prices, null, negative}" +– Veľmi sa mi páčilo moje jedlo tu .,"{food quality, jedlo, positive}","{food quality, jedlo, negative}" +"Hra hudba bola veľmi módna, 20-30 niečo popové hudba, ale subwoofer k zvukovému systému sa nachádzal pod mojím sedadlom, čo začalo byť počas večere otravné.","{ambience general, subwoofer k zvukovému systému, negative};{ambience general, hudba, positive}","{ambience general, null, negative};{ambience general, hudba, positive}" +Svätý Hummus!,"{food quality, Hummus, positive}","{food quality, Hummus, positive}" +"Pre môj entr & eacute ; Úplne som si užil vyprážané aljašské morské mušle doplnené o mangold , artičokové srdiečka , fenikel a pecorino toscano .","{food style_options, vyprážané aljašské morské mušle, positive};{food quality, vyprážané aljašské morské mušle, positive}","{food quality, entr & eacute;, positive};{food quality, aljašské morské mušle, positive}" +"dekor je rustikálny, tradičný japonský.","{ambience general, dekor, neutral}","{ambience general, dekor, positive}" +"Nielen, že výber môže byť inovatívny, ale je tu aj pekná rovnováha tradičného sushi.","{food style_options, sushi, positive};{food style_options, výber, positive}","{food quality, sushi, positive};{food style_options, sushi, positive}" +Pravdepodobne budete sklamaní.,"{restaurant general, null, negative}","{restaurant general, null, positive}" +"jedlo je skvelé, barmani idú o tú míľu navyše.","{service general, barmani, positive};{food quality, jedlo, positive}","{restaurant general, null, negative}" +"Reštaurácia ponúka rozsiahlu vínna karta a atmosféru, na ktorú nezabudnete!","{drinks style_options, vínna karta, positive};{ambience general, atmosféru, positive}","{ambience general, karta, positive};{food style_options, vínna, positive}" +"naan bolo jedno z najlepších, aké som mal, a naozaj som si užil bhartha, nie príliš paradajkový.","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, naan bolo, positive};{food style_options, naan bolo, neutral}" +"Majiteľom Open Sesame ... Bravo ... už sa neviem dočkať, kedy sa vrátim na večeru do vašej reštaurácie!","{restaurant general, Open Sesame, positive}","{restaurant general, reštaurácie, positive}" +"ryba bola čerstvá, hoci bola nakrájaná na veľmi tenko.","{food quality, ryba, positive};{food style_options, ryba, negative}","{food quality, bola, negative};{food style_options, bola, negative}" +Odvtedy som tam bol veľa a vždy je to dobrý čas.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Moja obľúbená pizza v Seattli,"{restaurant general, pizza, positive}","{food quality, pizza, positive}" +"Vrelo odporúčam toto miesto všetkým, ktorí chcú prvýkrát vyskúšať indické jedlo.","{food quality, indické jedlo, positive}","{food quality, indické jedlo, positive}" +Preceňované,"{restaurant general, null, negative}","{restaurant general, null, positive}" +"Najhoršie Služba, akú som kedy mal","{service general, Služba, positive}","{restaurant general, Služba, negative}" +"Ako sa ukázalo, majiteľ sedel hneď vedľa nás a keď prišiel skontrolovať naše problémy, bol veľmi odmietavý a ponúkol symbolickú 20% zľavu z nášho účtu.","{service general, majiteľ, negative}","{service general, majiteľ, negative}" +Jednu noc som tam išiel s niekoľkými priateľmi hrať bingo a pozerať sa na hru sox a bola to pecka!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +ÚPLNE NADHODNOTENÉ!,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"– vajcia, palacinky, zemiaky, čerstvé ovocie a jogurt – všetko, čo podávajú, je vynikajúce.","{food quality, null, positive};{food quality, zemiaky, positive};{food quality, jogurt, positive};{food quality, palacinky, positive};{food quality, vajcia, positive};{food quality, čerstvé ovocie, positive}","{food quality, zemiak, positive};{food quality, palacinky, positive};{food quality, jogurt, positive};{food quality, ovocie, positive}" +"– Ray's je miesto, kam ísť pre vysokú kvalitu večere z morských plodov.","{food quality, večere z morských plodov, positive}","{food quality, z morských plodov, positive}" +Tiež sa mi veľmi páči jednoduchosť dekor a intímny pocit malej reštaurácie.,"{ambience general, pocit, positive};{ambience general, dekor, positive}","{ambience general, dekor, positive};{restaurant general, reštaurácie, positive}" +Ideme späť . :D,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Mal som si to predstaviť, ale nikdy som neočakával, že jedlo bude také mierne.","{food quality, jedlo, negative}","{food quality, jedlo, positive}" +"Keď som vošiel, bol som zaskočený ich neuveriteľným drevený dekor.","{ambience general, drevený dekor, positive}","{ambience general, dekor, negative}" +"Je to maličké miesto, takže ak sa tam dostanete pred 20:00 cez víkend (štvrtok? Ne), ľahšie získate stôl alebo miesto v sushi bare.","{restaurant miscellaneous, miesto, neutral}","{restaurant miscellaneous, miesto, positive}" +Najlepšie susedstvo Pohotovostný režim .,"{restaurant general, Pohotovostný režim, positive}","{restaurant general, susedstvo, positive}" +Hneď by som sa tam vrátil.,"{restaurant general, null, positive}","{restaurant general, null, negative}" +"Je to *veľmi * za rozumnú cenu, najmä pre kvalitu jedlo.","{food prices, jedlo, positive}","{food prices, null, positive};{food quality, jedlo, positive}" +"veľa jedlo, ver mi.","{food style_options, jedlo, positive}","{restaurant general, null, positive}" +Je to ideálne miesto na romantické rande vo dvoch alebo na tajné stretnutie!,"{ambience general, miesto, positive};{restaurant miscellaneous, miesto, positive}","{restaurant miscellaneous, null, positive}" +Tiež si dajte skvelé margarity!,"{drinks quality, margarity, positive}","{food quality, margaritas, positive}" +Je to nenáročné a podzemné.,"{ambience general, null, positive}","{restaurant general, null, negative}" +Miesto je ďalšia najlepšia vec k vareniu mojich mamičiek.,"{food quality, null, positive}","{restaurant general, Miesto, positive}" +Najlepšie miesto na oddychové nedeľné raňajky medzi jachtami a potom sa prejdite na neďaleký Farmársky trh.,"{restaurant miscellaneous, miesto, positive}","{location general, miesto, positive}" +"Ak môžete, príďte na toto miesto loďou a urobte si z toho celý večer.","{restaurant miscellaneous, miesto, positive}","{restaurant general, loď, positive}" +na púšť sme mali mango zázvorový krém brulee ... oh la la mňam! ! !,"{food quality, mango zázvorový krém brulee, positive}","{food quality, brulee, positive};{food quality, mango, positive}" +"Stojí za to čakať, najmä preto, že vám zavolajú, keď bude stôl pripravený.","{restaurant general, null, positive}","{service general, null, positive}" +"Majú širokú škálu ryby a dokonca uvádzajú, z ktorých oceánov pochádzajú; Atlantický alebo Tichý oceán.","{food style_options, ryby, positive}","{food style_options, ryby, positive}" +"No, myslím, že je ťažké sedieť, keď je jeden pre zamestnancov neviditeľný personál.","{service general, personál, negative}","{service general, personál, negative}" +Skvelé otvorené a priateľské atmosféra.,"{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive}" +"Krátky rozhovor s manažérom na konci jedla bol najväčším sklamaním – povedať, že sme boli `` vyrazení ``, by bolo slabé slovo.","{service general, manažérom, negative}","{service general, manažérom, negative}" +"Ray's je niečo ako inštitúcia v Seattli, ale vzhľadom na jej nádherné Zvukové výhľady som mal podozrenie, že ocenenia boli spôsobené skôr scenériou ako jedlom a službami.","{location general, Zvukové výhľady, positive}","{location general, Zvukové výhľady, positive};{restaurant miscellaneous, Ray's, neutral};{food quality, jedlom, negative};{service general, službami, negative}" +"Prisahal som, že sa nikdy nevrátim pre teplé pivo a priemerné jedlo.","{food quality, jedlo, negative};{drinks quality, pivo, negative}","{drinks quality, pivo, negative};{food quality, jedlo, negative}" +"Ak je vonku pekne, požiadajte o stôl na balkón .","{ambience general, balkón, positive}","{ambience general, balkón, positive}" +Skvelé jedlo s úžasnou atmosféra!,"{food quality, jedlo, positive};{ambience general, atmosféra, positive}","{ambience general, atmosfera, positive}" +Jedlo som zakončil nezvyčajným dezert z portského a ochutnávka čokolády ... mňam!,"{food quality, dezert z portského a ochutnávka čokolády, positive}","{food quality, dezert, positive};{food quality, čokoláda, positive}" +Dostal som predjedlo z mäkkýšov a kreviet a bolo to v poriadku.,"{food quality, predjedlo z mäkkýšov a kreviet, neutral}","{food quality, mäkký, positive};{food quality, krev, positive};{food quality, dost, positive}" +pizza je tenká kôrka a menu ponúka veľmi kreatívne kombinácie a polevy.,"{food style_options, pizza, positive};{food style_options, menu, positive}","{food style_options, pizza, positive};{food style_options, menu, positive};{food quality, pizza, positive}" +"Je to skvelé miesto, kde si môžete vychutnať jedlo a stretnúť sa s priateľmi.","{food quality, jedlo, positive};{restaurant miscellaneous, miesto, positive}","{food quality, jedlo, positive};{restaurant general, mi, positive}" +"služba bola vynikajúca, káva bola dobrá aj podľa štandardov Starbucks a jedlo bola vynikajúca.","{service general, služba, positive};{food quality, jedlo, positive};{drinks quality, káva, positive}","{service general, služba, positive};{drinks quality, káva, positive};{food quality, jedlo, positive}" +"Toto je miesto, kde si môžete oddýchnuť a vychutnať si najlepšiu kvalitu jedlo, ktoré môže toto odvetvie ponúknuť.","{ambience general, miesto, positive};{food quality, jedlo, positive}","{food quality, jedlo, positive}" +Vrátil by som sa sám pre zážitok víno.,"{drinks quality, víno, positive}","{restaurant general, Vrátil, positive}" +Najlepšie kalamáre v Seattli!,"{food quality, kalamáre, positive}","{restaurant general, null, positive}" +"Prezentácia Snooze je vynikajúca a je to jedno z miest, kde sa cítite sofistikovanejšie už len preto, že ste tam; ale zlúpnite vrstvy a máte predražený IHOP s vysokým obočím Snooze .","{food style_options, menu, negative};{restaurant prices, Snooze, negative};{ambience general, Snooze, positive}","{food quality, vrstvy, negative};{restaurant prices, Snooze, negative};{ambience general, Snooze, positive}" +"Sťažoval som sa manažérovi, ale ani sa neospravedlnil.","{service general, manažérovi, negative}","{restaurant general, manažéro, negative}" +Oveľa viac ako len skvelé zobrazenie!,"{location general, zobrazenie, positive}","{restaurant general, Ove, positive}" +atmosféra bola v poriadku.,"{ambience general, atmosféra, neutral}","{ambience general, atmosfera, positive}" +"Po usadení trvalo asi 30 minút, kým ste konečne dostali jedlo.","{service general, null, negative}","{service general, null, negative};{food quality, jedlo, negative}" +"– Vo veku postupného znižovania nákladov v reštauráciách je pekné vidieť miesto, ktoré tento trend vzdoruje a jednoducho poskytuje vysokú kvalitu jedlo a dobré služba, bodka.","{service general, služba, positive};{food quality, jedlo, positive}","{food quality, jedlo, positive};{service general, služba, positive}" +"Veľmi sa mi páčilo atmosféra, ale jedlo nestálo za cenu.","{food quality, jedlo, negative};{ambience general, atmosféra, positive};{food prices, jedlo, negative}","{ambience general, atmosféra, negative};{food quality, jedl, positive}" +"Nachádza sa v obchodnom centre neďaleko Beverly Center, nie je to najväčšie umiestnenie, ale jedlo ma núti vracať sa viac.","{food quality, jedlo, positive};{location general, umiestnenie, neutral}","{restaurant general, null, positive}" +"Pri mojom jedlo som musel poslať späť svoje vajcia na jednoduchú žiadosť o rozbitie jarmov pred varením a musel by som ich znova poslať späť, keby som neodmietol jedlo všetci spolu.","{food quality, jedlo, negative};{food quality, vajcia, negative}","{service general, null, negative}" +pásmo bolo veľmi dobré a služba bolo pozorné.,"{service general, služba, positive};{ambience general, pásmo, positive}","{food quality, bolo, positive};{service general, služba, positive}" +"– Ako opísať to najlepšie sushi v NYC: hmmmm, lahodné, úžasné, fantastické, šťavnaté, dokonalé, nie, všetko vyššie uvedené.","{food quality, sushi, positive}","{food quality, sushi, positive}" +"– Škuner alebo Later je očarujúce umiestnenie pozdĺž prístavu v Long Beach a priemerné jedlo, bohužiaľ, nevykompenzuje jeho veľmi zlé zákaznícky servis.","{location general, umiestnenie pozdĺž prístavu v Long Beach, positive};{service general, zákaznícky servis, negative};{food quality, jedlo, neutral}","{location general, Škuner alebo Later, positive};{food quality, jedlo, negative};{service general, zákaznícky servis, negative}" +"Okamžite sme sedeli, stôl bol súkromný a pekný.","{ambience general, stôl, positive}","{ambience general, súkromný, positive}" +"dobrý saké , dobrý jedlo – úprimne, o japončine toho veľa neviem jedlo vôbec.","{food quality, jedlo, positive};{drinks quality, saké, positive}","{food quality, jedlo, positive};{drinks quality, saké, positive}" +"Prineste si mobil, pretože možno budete musieť počkať, kým sa dostanete do najlepšej sushi reštaurácie na svete: BLUE RIBBON SUSHI.","{restaurant general, BLUE RIBBON SUSHI, positive}","{restaurant general, BLUE RIBBON SUSHI, positive}" +"Nakoniec náš šek vyšiel na 27 dolárov za 4 malé palacinky, raňajkové burrito, pomarančový džús a ľadový čaj (mal som vodu).","{food prices, palacinky, negative};{food prices, raňajkové burrito, negative};{drinks prices, ľadový čaj, negative};{food style_options, palacinky, negative};{drinks prices, pomarančový džús, negative}","{food quality, burrito, negative};{food style_options, palacinky, negative};{food prices, palacinky, negative};{food quality, pomarančový džús, negative};{drinks quality, ľadový čaj, negative}" +Dobré jedlo!,"{food quality, jedlo, positive}","{restaurant general, Dobré, positive}" +catering je mimo tohto sveta a kuracia zeleninová polievka Raouls otriasa mojím svetom! ! !,"{food quality, kuracia zeleninová polievka Raouls, positive};{food quality, catering, positive}","{food quality, zelená polievka Raouls, positive}" +"Mal som požiadať o šek, keď som to videl; ale ich menu bolo také jedinečné, že som pokračoval.","{food style_options, menu, positive}","{food quality, menu, positive};{food quality, null, positive}" +Skvelé raňajky,"{food quality, raňajky, positive}","{restaurant general, ra, positive}" +Morský vlk na homárovom rizote bol najlepší.,"{food quality, Morský vlk na homárovom rizote, positive}","{food quality, Morský vlk, positive}" +"– Atmosféra atmosféra je skvelá pre každú špeciálnu príležitosť, ktorú by ste chceli osláviť.","{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive}" +Skvelé sezónne ryby a morské plody s nóbl prostredie na nábreží.,"{food quality, morské plody, positive};{ambience general, prostredie na nábreží, positive};{food quality, sezónne ryby, positive}","{food quality, ryby, positive};{food quality, morské plody, positive}" +"pizza nie sú veľké a kôrka je tenká... majte to na pamäti, keď budete objednávať.","{food style_options, pizza, neutral};{food style_options, kôrka, neutral}","{food quality, kôrka, positive};{food style_options, pizza, positive}" +Jedinou pozitívnou vecou na Mioposto je pekné umiestnenie.,"{location general, umiestnenie, positive}","{ambience general, umiestnenie, positive}" +Oceňujem aj ich doručenie.,"{service general, doručenie, positive}","{food quality, ich, positive}" +Veľmi sklamaný.,"{restaurant general, null, negative}","{restaurant general, null, positive}" +pizza je vynikajúca a šaláty sú fantastické.,"{food quality, pizza, positive};{food quality, šaláty, positive}","{food quality, pizza, positive};{food quality, šaláty, positive}" +Najčerstvejšie sushi – milujem to reštaurácia .,"{restaurant general, reštaurácia, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{restaurant general, reštauracia, positive}" +steak bol urobený presne podľa mojich predstáv (stredne vzácny) a bol pekný a šťavnatý.,"{food quality, steak, positive}","{food quality, steak bol urobený, positive};{food quality, steak, positive}" +"Vážne, nemôžete sa pokaziť, ak hľadáte nenáročnú miestnu zábavu.","{ambience general, null, positive}","{restaurant miscellaneous, null, positive}" +majitelia sú skvelá zábava a výber piva stojí za to zostať.,"{service general, majitelia, positive};{drinks style_options, výber piva, positive}","{drinks prices, piva, positive};{restaurant general, majitelia, positive}" +Skvelé výber čapov a fliaš a pizza kamene.,"{food quality, pizza, positive};{drinks style_options, výber čapov a fliaš, positive}","{food quality, pizza, positive};{food quality, čapov, positive};{food quality, fliaš, positive}" +"Garantujem vám, že nebudete sklamaní, je tu aj parkovanie s obsluhou.","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, obsluha, positive}" +Neskoré nočné stolovanie s výnimočným jedlo.,"{food quality, jedlo, positive}","{food quality, jedlo, positive}" +"porcie sú však veľké, takže si neobjednajte príliš veľa.","{food style_options, porcie, neutral}","{food style_options, príce, negative}" +"Rozhodne má jeden z najlepších jukebox, aké som po dlhom čase videl.","{ambience general, jukebox, positive}","{ambience general, jukebox, positive}" +Služba bola slušná.,"{service general, Služba, neutral}","{food quality, Služba, positive}" +Absolútne chutné.,"{food quality, null, positive}","{food quality, null, positive}" +"Oh, a syrové hranolky sú úžasné!","{food quality, syrové hranolky, positive}","{food quality, hranolky, positive}" +"Všetci, ktorí sedeli vzadu vonku, súhlasili s tým, že to bola najhoršia služba, akú sme kedy dostali.","{service general, služba, negative}","{service general, služba, negative}" +"Možno nie som sushi guru, ale môžem vám povedať, že jedlo tu je v poriadku a že v tom nie je nič iné.","{food quality, jedlo, negative}","{food quality, sushi, positive}" +"Vynikajúce jedlo, pekné prostredie, pomerne drahé","{ambience general, prostredie, positive};{restaurant prices, null, negative};{food quality, jedlo, positive}","{restaurant general, Vynke, positive}" +Roztopte sa v ústach nigiri a sashmi a tiež veľmi chutné rolky.,"{food quality, nigiri, positive};{food quality, rolky, positive};{food quality, sashmi, positive}","{food quality, rolky, positive}" +"Konečne jedlo, na ktoré budete ešte dlho spomínať!","{food quality, jedlo, positive}","{restaurant general, null, positive}" +"Najlepšie jedlo, fenominálne služba","{service general, služba, positive};{food quality, jedlo, positive}","{food quality, jedl, positive};{service general, služba, positive}" +"Odporúčam to na noc, keď chcete plytvať! (bolo to trochu drahé)","{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}" +"Zatiaľ čo táto reštaurácia mala pomerne dobrú jedlo, personál reštaurácie sa zdala byť úplne ľahostajná k našej prítomnosti a tento postoj sa odrážal v nedostatku služieb.","{service general, personál reštaurácie, negative};{food quality, jedlo, positive}","{service general, personál, negative};{food quality, jedlo, positive}" +Žiadne porovnanie,"{restaurant general, null, positive}","{restaurant general, por, positive}" +"takže o krevety, boli čerstvé a mali mierne chrumkavosť okolo cesto ... veľmi dobré ... vlašské orechy boli nakrájané na menšie kúsky a veľmi chrumkavé a chutné.","{food quality, krevety, positive};{food quality, cesto, positive};{food quality, vlašské orechy, positive}","{food quality, krevety, positive};{food quality, vlašské orechy, positive}" +"Som tak šťastný, že mám vo svojom okolí skvelú taliansku reštauráciu.","{restaurant general, taliansku reštauráciu, positive}","{restaurant general, talianska reštaúncia, positive}" +Na sedenie sme čakali hodinu.,"{service general, null, negative}","{restaurant general, null, positive}" +"Zadali sme objednávku a hoci sme si objednali 4 predjedlá, jedlo prišlo až o 45 minút neskôr... S NAŠIM HLAVNÝM JEDOM.","{service general, null, negative}","{service general, null, negative};{food quality, JEDLO, negative}" +"Nemôžem sa dočkať, až sa vrátim tento nadchádzajúci víkend!","{restaurant general, null, positive}","{restaurant general, null, positive}" +"Ak máte záujem o dobrú chuť (bez rybej chuti a vône), veľké porcie a kreatívne sushi jedlá, toto je vaše miesto...","{food style_options, porcie, positive};{food quality, null, positive};{food style_options, sushi jedlá, positive}","{food style_options, sushi, positive};{food quality, jedlá, positive};{food quality, chuť, positive}" +"Perfektné miesto, ktoré si vezmete mimo mesta hostí kedykoľvek počas roka.","{restaurant general, miesto, positive}","{restaurant general, miesto, positive}" +Ochutnal som všetky tri položky na nej tanier a boli vynikajúce.,"{food quality, tanier, positive}","{food quality, tri položky, positive}" +Dobré pre neskoré nočné stolovanie (plánovanie na poslednú chvíľu) bez výhrad.,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, nočné stolovanie, positive}" +Nikdy som tam nebol sklamaný jedlo.,"{food quality, jedlo, positive}","{restaurant general, null, positive}" +– Zďaleka najlepší bar vo východnej dedine ...,"{restaurant general, bar, positive}","{restaurant general, bar, positive}" +"Je to skvelé miesto, ktoré ľudia sledujú.","{restaurant miscellaneous, miesto, positive}","{restaurant miscellaneous, miesto, positive}" +"Priestor bol obmedzený, ale jedlo to vynahradilo.","{restaurant miscellaneous, Priestor, negative};{food quality, jedlo, positive}","{food quality, jedlo, positive};{restaurant miscellaneous, Priestor, negative}" +"hrebenatky sú zjavne varené na masle z čiernych olív, vďaka čomu sú skutočne jedinečné (nehovoriac o chuti).","{food quality, hrebenatky, positive};{food style_options, hrebenatky, positive}","{food quality, hrebenatky, negative}" +Toto miesto je očarujúce a relaxačné.,"{ambience general, miesto, positive}","{ambience general, null, positive}" +vôbec nie žuvacie .,"{food quality, null, positive}","{restaurant general, null, positive}" +"Boli sme v Seattli len na jednu noc a som tak rád, že sme si vybrali Rays na večeru!","{restaurant general, Rays, positive}","{restaurant general, Rays, positive}" +"– Nikdy nezabudnem na úžasné jedlo, služba a atmosféra, ktoré zažívam v tejto reštaurácii.","{service general, služba, positive};{food quality, jedlo, positive};{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive};{food quality, jedlo, positive};{service general, služba, positive}" +Úžasné špeciálne predjedlo zo španielskej makrely a dokonalé krabicové sushi (to úhor s avodcao -- ehm hm ).,"{food quality, krabicové sushi, positive};{food quality, úhor s avodcao, positive};{food quality, špeciálne predjedlo zo španielskej makrely, positive}","{food quality, špeciálne predjedlo zo španielskej makrely, positive};{food quality, krabicové sushi, positive}" +Cez víkendy možno budete musieť počkať niekoľko hodín.,"{service general, null, neutral}","{restaurant miscellaneous, null, negative}" +- jedlo nebolo skvelé a čašníci boli neslušní.,"{service general, čašníci, negative};{food quality, jedlo, negative}","{drinks quality, čašníci, negative};{food quality, jedlo, negative}" +"Nasledoval steak 9 oz a chutil skvele, aspoň spočiatku.","{food quality, 9 oz, positive}","{food quality, steak 9 oz, positive}" +"Keď som sa tam dostal, posadil som sa po schodoch, kde bola atmosféra útulná a služba bola hrozná!","{service general, služba, negative};{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive};{service general, služba, negative}" +"vínny lístok je neuveriteľný, rozsiahly a rôznorodý, všetko jedlo je neuveriteľné a personál bol veľmi milý, dobrý vo svojej práci a kultivovaný.","{service general, personál, positive};{food quality, jedlo, positive};{drinks style_options, vínny lístok, positive}","{food quality, jedlo, positive};{food style_options, vínny lístok, positive};{service general, personál, positive}" +– LEPŠIE TO NEBUDE! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, negative}" +V nedeľu popoludní hrá kapela a je tu veľa zábavy.,"{ambience general, kapela, positive}","{ambience general, kapela, positive}" +Všetko a myslím tým všetko v menu je delikátne.,"{food quality, menu, positive}","{food quality, menu, positive}" +"Viem, že veľa ľudí má svoje obľúbené typy miest pizza a pizza, ale Mioposto pizza nemá kvalitu a dobrú chuť.","{food quality, pizza, negative}","{food quality, pizza, negative};{food style_options, pizza, positive}" +"Na východnom pobreží je len jedno miesto, ktoré má všetko a ešte oveľa viac.","{restaurant general, miesto, positive}","{restaurant general, miesto, positive}" +Vždy víťaz.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"V predchádzajúcich recenziách sa uvádzalo, že priateľské k deťom... dajte mi pokoj s dvoma malými deťmi, ktoré majú svetelné roky.","{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, positive}" +pizza sú ľahké a chutné.,"{food quality, pizza, positive}","{food quality, pizza, positive}" +"Pozrite sa na umenie na stenách, veľmi farebné!","{ambience general, umenie na stenách, positive}","{food quality, stenách, positive}" +Priemerný jedlo,"{food quality, jedlo, neutral}","{restaurant general, Priem, positive}" +Už sa nikdy nevrátim.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"Mali sme veľmi ťažké získať pozornosť čašníčka a nakoniec sme museli vstať a ísť dovnútra, aby sme sa porozprávali s manažérom.","{service general, čašníčka, negative}","{service general, čašníčka, negative};{service general, manažérom, negative}" +Nikdy nie príliš preplnené a vždy skvelé služba.,"{service general, služba, positive};{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive};{service general, služba, positive}" +ste na horúcom rande a on/ona má nutkanie na sushi ... potom by to mohlo byť to pravé miesto.,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"– Nemôžem uveriť Murphy's existuje už viac ako 25 rokov, úžasné.","{restaurant miscellaneous, Murphy's, positive}","{restaurant general, Murphy's, positive}" +"V piatok môžete byť zaneprázdnení pri stole, ale keď sa usadíte, služba služba je taká efektívna, že môžete rýchlo prísť a odísť.","{service general, služba, positive}","{service general, služba, positive}" +"to ? sa podáva buď s korenistá omáčka alebo redukcia z červeného vína, hoci obe boli chuťovo na nerozoznanie.","{food quality, korenistá omáčka, neutral};{food quality, redukcia z červeného vína, neutral}","{food quality, omáčka, negative};{drinks quality, redukcia z červeného vína, negative}" +Najkrajší čašníci v meste.,"{service general, čašníci, positive}","{restaurant general, null, positive}" +služba bola zdvorilá a pozorná.,"{service general, služba, positive}","{service general, služba, negative}" +Pri písaní tohto článku som znova skúsil dať ich odkaz a stále to nefunguje.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, negative}" +"akékoľvek ďalšie potreby, ktoré sme mohli mať, nebolo možné uspokojiť, pretože sa nikto nezastavil pri stole.","{service general, null, negative}","{service general, null, negative}" +"Dobré Sushi, vysoká cena","{food quality, Sushi, positive};{food prices, Sushi, negative}","{restaurant prices, Dobré Sushi, negative}" +Ale servery boli mimoriadne pozorní a veľmi priateľskí.,"{service general, servery, positive}","{food quality, boliad, positive};{restaurant general, null, positive}" +"Bol som na tomto miesto, ľudia a je to ZLÉ.","{restaurant general, miesto, negative}","{restaurant general, ZL, positive}" +skvelé služba,"{service general, služba, positive}","{service general, služba, positive}" +Bolo to ako stolovanie v úplne inej reštaurácii.,"{restaurant general, null, positive}","{restaurant general, reštaurácii, negative}" +Dva palce hore!,"{food quality, null, positive}","{restaurant general, null, negative}" +"Predstavte si moje šťastné prekvapenie, keď som zistil, že zhliadnutia sú len treťou najlepšou vecou na Rayove!","{location general, zhliadnutia, positive};{restaurant general, Rayove, positive}","{restaurant general, Ray, positive}" +"Ruku na srdce, najlepší tuniak, aký som kedy mal.","{food quality, tuniak, positive}","{restaurant general, Ruku, positive}" +"Ak sa chystáte vidieť Dannyho Gansa alebo len zostať v Mirage, nenechajte si ujsť toto.","{restaurant general, null, positive}","{restaurant general, null, negative}" +skvelé miesto na obed,"{restaurant general, miesto na obed, positive}","{restaurant general, null, positive}" +Milujem raňajky tu .,"{food quality, raňajky, positive}","{restaurant general, raiky, positive}" +"sashimi bolo najčerstvejšie a najjemnejšie, aké som kedy ochutnal.","{food quality, sashimi, positive}","{food quality, sashimi, positive}" +Nebudete sklamaní ich menu.,"{food style_options, menu, positive}","{food quality, menu, negative}" +"Veľa ľudí hovorí o skvelých pizza a chudobných obsluha, takže to nemôže byť len chrapúnstvo niekoľkých nespokojných zákazníkov.","{food quality, pizza, positive};{service general, obsluha, negative}","{restaurant miscellaneous, obsluha, negative};{food quality, pizza, positive};{restaurant miscellaneous, null, negative}" +už sa nevrátim .,"{restaurant general, null, negative}","{restaurant general, null, negative}" +moja služba bola hviezdna!,"{service general, služba, positive}","{service general, služba, positive}" +určite sa sem vrátime reštaurácia.,"{restaurant general, reštaurácia, positive}","{restaurant general, rešta, positive}" +Určite sa vráti.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Možno je to dobré na tú jednu noc pri modrom mesiaci, keď sa kuchári rozhodnú použiť rybu, čo je napoly slušné.","{food quality, rybu, negative}","{food quality, ryba, positive}" +"– Bol som na Open Sesame iba raz, ale stále som spamätaný zo zážitku! !","{restaurant general, Open Sesame, positive}","{restaurant general, Open, positive}" +"palacinky boli určite vynaliezavé, ale 8,50 $ za 3 - 6 `` palacinky (jedna z nich bola skôr ako 5 ``) v palacinkovom lete ( vzorka 3 rôznych palacinky ) je dobre predražené.","{food prices, palacinky, negative};{food style_options, palacinky, positive}","{food quality, palacinky, positive};{food style_options, palacinky, negative};{food prices, palacinky, negative}" +V jedno nedeľné popoludnie sme však s manželom išli (aj keď s mojimi hlasnými protestmi) a boli sme príjemne prekvapení.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Stojí to za to,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Pozor - je to skutočné jedlo pre ľudí, ktorí milujú to najlepšie.","{food quality, jedlo, positive}","{food quality, Pozor, positive}" +"Mám, ale tu - v toaleta bola obsluha v kúpeľni, čo bolo zvláštne.","{restaurant miscellaneous, toaleta, negative}","{service general, bola, negative}" +Najlepšie jedlo sú krevety z vlašských orechov - jednoducho vynikajúce.,"{food quality, krevety z vlašských orechov, positive}","{food quality, krevety z vlašských orech, positive}" +"palacinky by mali byť väčšie (aspoň 8 `` ), aby odôvodnili náklady aj pri jedinečných ponukách.","{food style_options, palacinky, negative}","{food style_options, palacinky, positive};{food prices, palacinky, positive}" +- Prvýkrát som v tejto reštaurácii reštaurácia obedoval s mojím synom a bolo to úplne hrozné!,"{restaurant general, reštaurácia, negative}","{restaurant general, reštaurácia, negative}" +Výborne,"{restaurant general, null, positive}","{restaurant general, null, negative}" +"Parkovanie je pomerne dobré, majú svoj vlastný pozemok a môžete parkovať v neďalekom parku.","{restaurant miscellaneous, null, positive}","{parking general, pozemok, positive}" +Caesar šalát bol vynikajúci.,"{food quality, Caesar šalát, positive}","{food quality, Caesar šalát, positive}" +"– Nechápem, ako som bol na tomto mieste tak dlho cudzincom ... fajita šalát, colorado, fajitas - VŠETKO je vynikajúce.","{food quality, fajita šalát, positive};{food quality, colorado, positive};{food quality, fajitas, positive}","{food quality, fajita šalát, positive};{food quality, colorado, positive};{food quality, fajitas, positive}" +"najlepšie čínske jedlo, ktoré som ochutnal už dlho","{food quality, čínske jedlo, positive}","{food quality, čínske jedlo, positive}" +Cena bola tiež správna.,"{restaurant prices, null, positive}","{restaurant general, Cena, positive}" +Chutné...!,"{food quality, null, positive}","{food quality, Chutney, positive}" +"Napísali sme meno a hoci boli otvorené stoly, bolo nám povedané, že budeme čakať 30 minút.","{service general, null, negative}","{service general, null, negative}" +káva je tiež veľmi dobrá.,"{drinks quality, káva, positive}","{drinks quality, kava, positive}" +Čakali sme viac ako 30 minút na naše nápoje a viac ako 1 1/2 hodiny na naše jedlo.,"{service general, null, negative}","{service general, null, negative};{food quality, jedlo, negative};{drinks quality, nápoje, negative}" +servery za pultom sú vždy priateľské a užitočné.,"{service general, servery za pultom, positive}","{food quality, servery, positive}" +"Náš čašník neexistoval a keď naše jedlo konečne dorazilo viac ako hodinu po tom, čo sme si objednali, nedostali sme žiadnu vodu ani riad.","{service general, čašník, negative}","{service general, čašník, negative};{service general, riad, negative};{food quality, jedlo, negative};{service general, null, negative}" +– Toto miesto je neuveriteľne nadhodnotené.,"{restaurant general, miesto, negative}","{restaurant general, null, negative}" +Veľmi zlé zákaznícky servis.,"{service general, zákaznícky servis, negative}","{service general, servis, negative}" +Nemôžeme povedať dosť o ich lahodnom gurmánovi pizza!,"{food quality, pizza, positive}","{food quality, pizza, positive}" +"Okrem toho, zatiaľ čo ryba je nepochybne čerstvá, rožky majú tendenciu byť nevysvetliteľne nevýrazné.","{food quality, rožky, negative};{food quality, ryba, positive}","{food quality, ryba, positive};{food quality, rožky, negative}" +Jedinou nevýhodou je preplnené sedenie a pomalé služba.,"{service general, služba, negative};{restaurant miscellaneous, sedenie, negative}","{service general, služba, negative};{ambience general, sedenie, negative}" +"V New Yorku nezostalo veľa miest na fajčenie, ale našiel som svoje obľúbené fajčenie balkón v meste.","{restaurant miscellaneous, balkón, positive}","{restaurant miscellaneous, balkón v meste, positive}" +Zdieľali sme rodinný tanier a obzvlášť som si užil čierna treska v saké kasu.,"{food quality, čierna treska v saké kasu, positive}","{food quality, čierna treska, positive};{restaurant miscellaneous, rodinný, positive}" +Ale priestor je malý a krásny a služba je užitočný.,"{service general, služba, positive};{ambience general, priestor, positive}","{service general, služba, positive};{restaurant general, Ale, positive}" +Oplatilo sa čakať.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +mňam .,"{food quality, null, positive}","{restaurant general, mňam, positive}" +Delikátne,"{food quality, null, positive}","{restaurant general, null, positive}" +- Priemerná Služba / Kvalita,"{service general, Služba, neutral}","{service general, Služba, positive}" +"– Toto je jedno z mojich najlepších miest na obed, obrovské porcie, rýchle služba a úžasné margarity! !","{food style_options, porcie, positive};{service general, služba, positive};{restaurant general, null, positive};{drinks quality, margarity, positive}","{food style_options, porcie, positive};{service general, služba, positive};{food quality, margarity, positive};{restaurant general, null, positive}" +Najlepšie Krabie koláče v meste,"{food quality, Krabie koláče, positive}","{food quality, Krabie, positive}" +"Všetko, čo som tu mal, je dobré, taco šaláty, burritos, enchiladas milujem to miesto.","{food quality, null, positive};{restaurant general, miesto, positive};{food quality, taco šaláty, positive};{food quality, burritos, positive};{food quality, enchiladas, positive}","{food quality, taco šaláty, positive};{restaurant general, miesto, positive};{food quality, burritos, positive};{food quality, enchiladas, positive}" +"Skvelé pizza, zlé služba","{food quality, pizza, positive};{service general, služba, negative}","{food quality, pizza, positive}" +skvelé,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Moja najlepšia kamarátka mala chicken shawarma a STÁLE chváli, že je to najlepšie kdekoľvek!","{food quality, chicken shawarma, positive}","{food quality, chicken shawarma, positive}" +Chintzy porcie,"{food style_options, porcie, negative}","{restaurant general, null, positive}" +Dobre zje .,"{food quality, zje, positive}","{restaurant general, null, positive}" +"Normálne sa miesta pýtajú, aké horúce to chcete, ale neurobili to.","{service general, null, negative}","{food quality, to, positive}" +"Vždy som našiel obsluhu a, ak sedíte v bare, kuchári veľmi priateľskí.","{service general, kuchári, positive}","{restaurant general, bare, positive}" +Nič v ponuke menu nie je menej ako úžasné.,"{food quality, menu, positive}","{food quality, menu, negative}" +"Moja dvojčlenná partia sa cítila obzvlášť ambiciózne a hýrili sme Shilshole Sampler ... krásnym sortimentom obrovských krevety z bieleho zálivu, údeného tuniaka dlhoplutvého, Rayovho fantastického manilské mušle ochutené kôprom, mušľami v chutnom sójovom dresingu a malou kôpkou kraba Dungeness na vrchu vznešený maslová omáčka .","{food style_options, Shilshole Sampler, positive};{food quality, maslová omáčka, positive};{food quality, sójovom dresingu, positive};{food quality, manilské mušle, positive};{food style_options, krevety z bieleho zálivu, positive}","{food quality, Shilshole Sampler, positive};{food style_options, Shilshole Sampler, positive}" +"Bol som úprimne šokovaný, keď som si prečítal zlé recenzie - toto miesto je fantastické; v žiadnom prípade nás to nesklamalo a jedli sme tu viac ako 10-krát.","{restaurant general, miesto, positive}","{restaurant general, null, positive};{restaurant general, null, positive}" +"Ste fanúšikom sushi, milujete odborne krájané ryby, skvelé saké, zabijaka lokalita SOHO a samozrejme: losos, tuniak, fluke, žltý chvost, treska, Makrela, želé (2: ryba), ježovka, krevety, homár, pražma, pstruh, mliečna ryba, modrá plutva Tuniak, úhor, krab, sardinka, mních, ikry, hrebenatky, ustrice a rôzne druhy Toro.","{location general, lokalita SOHO, positive};{food quality, sushi, positive};{food style_options, ryby, positive};{food style_options, Toro, positive};{drinks quality, saké, positive}","{food quality, ryba, positive};{food quality, sushi, positive};{food quality, homár, positive};{food quality, krab, positive};{food quality, sardinka, positive};{food quality, ikry, positive};{food quality, pražma, positive};{food quality, hrebenatky, positive};{food quality, modrá plutva Tuniak, positive};{food quality, losos, positive};{food quality, mliečna ryba, positive};{food quality, treska, positive};{food quality, Makrela," +služba je v tejto zábave fantastická miesto.,"{service general, služba, positive};{restaurant general, miesto, positive}","{restaurant general, null, positive}" +Tiež tam bol len jeden kúpeľňový stánok - pravdepodobne potrebuje viac pre také veľké davy.,"{restaurant miscellaneous, kúpeľňový stánok, negative}","{restaurant general, stánok, positive}" +"Odišli sme bez toho, aby sme vôbec dostali služba.","{service general, služba, negative}","{service general, služba, positive}" +Páčilo sa mi to.,"{restaurant general, null, positive}","{food quality, null, positive}" +– Vrelo odporúčam Mioposto .,"{restaurant general, Mioposto, positive}","{restaurant general, Vre, negative}" +"jedlo je fantastické, autentické, chutné a veľmi, veľmi cenovo dostupné.","{food quality, jedlo, positive};{food prices, jedlo, positive}","{food quality, jedlo, positive};{food prices, jedlo, positive};{food style_options, jedlo, positive}" +"Jedol som tu trikrát a zistil som, že kvalita a rozmanitosť ryby sú vynikajúce.","{food quality, ryby, positive};{food style_options, ryby, positive}","{food quality, ryby, positive};{food quality, manjáky, positive}" +"Ale k niektorým ľuďom je veľmi priateľská, takže je to ešte otravnejšie.","{service general, null, negative}","{food quality, null, negative}" +"bežné menu je tu mierne nad priemerom, ktorý nestojí za nafúkaný postoj, ktorý dostávate.","{food quality, bežné menu, neutral};{service general, null, negative}","{food quality, menu, positive};{food style_options, menu, neutral}" +Podávajú tiež to najlepšie hummus v Amerike s kvapkou voňavého olivového oleja (čo je podľa mňa tradičný spôsob)!,"{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive};{food quality, kvapkovo olej, positive}" +skvelé pivo,"{drinks quality, pivo, positive}","{restaurant general, pivo, negative}" +Morské plody Plus,"{food quality, Morské plody, positive}","{food quality, plody, positive}" +"je smutné, že nie je veľa ľudí, ktorí často jedia na miestach, ako sú tieto, ktoré vyzerajú draho, pretože sú v hoteli... ale určite sú tými, ktorých si nechcete nechať ujsť, najmä ak ste v centre San Jose.","{restaurant general, null, positive}","{restaurant prices, null, negative};{ambience general, null, negative}" +"Podávajú ho vo vysokom, tenkom pohári v tvare presýpacích hodín, aby zamaskovali skutočnosť, že v supermarkete dostanete malý džús za cenu pol galónu.","{drinks style_options, džús, negative};{drinks prices, džús, negative}","{food prices, null, negative};{food style_options, null, negative}" +"jedlo bolo v poriadku, ale služba bolo také zlé, že jedlo bolo studené, kým sa obslúžili všetci v mojej skupine.","{service general, služba, negative};{food quality, jedlo, neutral}","{food quality, bolo, negative};{service general, služba, negative}" +"skvelé jedlo – ryba na tanieri s omikasom bola absolútne dekadentná – nebolo tam nič z toho, čo občas sprevádza poctivé sushi – táto ryba bola perfektná! ! ! !","{food quality, ryba na tanieri s omikasom, positive};{food quality, jedlo, positive}","{food quality, skvelé jedlo, positive};{food quality, ryba, positive}" +"Nápoje sú suberb a keď vstúpim do dverí, cítim sa ako v krajine tretieho sveta.","{drinks quality, Nápoje, positive};{ambience general, null, positive}","{ambience general, Nápoje, positive}" +Open & Cool miesto s tým najlepším pizza a káva,"{food quality, pizza, positive};{ambience general, miesto, positive};{drinks quality, káva, positive}","{food quality, pizza, positive};{drinks quality, káva, positive}" +Green Tea creme brulee je nutnosťou!,"{food quality, Green Tea creme brulee, positive}","{food quality, Green Tea creme, positive}" +Našiel som si nový domov a práve som sa presťahoval s dlhodobým prenájmom.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Nie sú najzhovorčivejší, ale vždy, keď som tam bol, boli veľmi zaneprázdnení, čo pravdepodobne vysvetľuje nedostatok konverzácie.","{service general, null, neutral}","{service general, null, negative}" +"Samotná pizza nie je úplne najlepšia, akú som KEDY mal, ale stále celkom dobrá.","{food quality, pizza, positive}","{food quality, pizza, positive}" +"Mali sme to isté čašník druhýkrát, takže možno je služba špinavá a naše šťastie je dobré.","{service general, čašník, positive}","{service general, služba, negative};{restaurant general, Mali, positive}" +"– To je veľké tvrdenie vzhľadom na to, že som asi od siedmich rokov sám ťahal pasce na krabie a vyrábal koláče – ale niečo na týchto malých diabloch sa zakaždým zlepší.","{food quality, koláče, positive}","{food quality, null, positive}" +Úžasné talianske jedlo!,"{food quality, talianske jedlo, positive}","{food quality, talians, negative}" +Toto miesto je však klenot a neprestanem sa tam vracať.,"{restaurant general, miesto, positive}","{restaurant general, null, positive}" +"je to naozaj zaneprázdnené, takže sa tam dostaňte na začiatku, aby ste si mohli vziať miesto, ak musíte čakať, nie je to zlé, pretože služba je rýchla!","{service general, služba, positive}","{service general, služba, positive};{ambience general, null, negative}" +"Večera nám trvala len asi hodinu a ceny za pás boli v poriadku, takmer 50 dolárov za osobu po zdanení a prepitnom (približne priemer).","{restaurant prices, null, neutral}","{restaurant prices, null, positive};{restaurant general, null, positive}" +cibuľové krúžky sú skvelé!,"{food quality, cibuľové krúžky, positive}","{food quality, krúžky, positive}" +"Ak ste v oblasti, nemali by ste byť sklamaní.","{restaurant general, null, positive}","{restaurant general, oblasti, negative}" +– Skvelá finančná štvrť mexické miesto .,"{restaurant general, mexické miesto, positive}","{restaurant general, mexicisko, positive}" +domáca špeciálna rolka je naozaj dobrá.,"{food quality, domáca špeciálna rolka, positive}","{food quality, rolka, positive}" +čašníci sú veľmi skúsení a nápomocní pri spárovaní výberu nápojov s chuťou jedla alebo naopak.,"{service general, čašníci, positive}","{food quality, čašníci, negative};{service general, pri, negative}" +Dokonalosť .,"{restaurant general, null, positive}","{restaurant general, Dokonal, positive}" +Slabý zákaznícky servis / zlý pizza .,"{food quality, pizza, negative};{service general, zákaznícky servis, negative}","{service general, servis, negative}" +Celkovo by som sa vrátil a znova by som jedol v reštaurácia.,"{restaurant general, reštaurácia, positive}","{restaurant general, Celkovo, positive}" +"Server predložil niekoľko saké návrhov, ktoré boli veľmi dobré.","{service general, Server, positive};{drinks quality, saké, positive}","{food quality, návrh, positive}" +"Mojím jediným negatívnym komentárom je, že by som si prial, aby kusov boli o niečo väčšie.","{food style_options, kusov, negative}","{food style_options, kus, negative}" +"Vybral som si špargľu, ktorý sa ukázal ako neuveriteľný a dokonale pripravený.","{food quality, špargľu, positive}","{food quality, špargu, positive}" +"To, čo môže byť pre väčšinu zaujímavé, je najhoršia služba / postoj pochádza od majiteľov tohto zariadenia.","{service general, majiteľov, negative}","{service general, služba, negative}" +"Jedinou nevýhodou je, že toto miesto je skutočne drahé a porcie sú na malej strane.","{restaurant prices, miesto, negative};{food style_options, porcie, negative}","{restaurant prices, null, negative};{location general, sú, negative}" +"Hrozné služba, jedlo v poriadku, drahé","{service general, služba, negative};{restaurant prices, null, negative};{food quality, jedlo, neutral}","{service general, služba, positive}" +Hoci služba by sa mohla zlepšiť vzhľadom na vložené peniaze.,"{service general, služba, negative}","{service general, služba, negative}" +"Bežne tam vidíte stolovať indické rodiny a priateľov, čo je vždy dobré znamenie.","{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, indické rodiny, positive}" +"Ak chcem v nedeľu stáť v rade hodinu, aby som dostal priemer brunch jedlo, potom by som dal Murphyho na začiatok zoznamu.","{food quality, brunch jedlo, neutral};{service general, null, negative}","{food quality, brunch, negative};{restaurant general, Murphy, negative}" +"Za množstvo jedlo, ktoré sme dostali, mali byť ceny nižšie.","{food prices, jedlo, negative}","{food prices, jedlo, positive}" +"Vždy zaneprázdnení, ale vedia vás rýchlo usadiť a rýchlo služba.","{service general, služba, positive};{service general, null, positive}","{service general, služba, positive}" +vínny lístok je úžasný a jedlo mi pripomína moju nedávnu cestu do Talianska.,"{drinks style_options, vínny lístok, positive}","{food quality, vínny lístok, positive};{restaurant general, null, positive}" +"jedlo bolo skvelé, margarity tiež, ale čašníčka bola príliš zaneprázdnená tým, že bola milá na svoju ďalšiu väčšiu párty, než aby sa lepšie postarala o môjho priateľa a mňa.","{drinks quality, margarity, positive};{service general, čašníčka, negative};{food quality, jedlo, positive}","{service general, čašníčka, negative};{food quality, bolo, positive};{food quality, margarity, positive}" +Nemôžem o tom povedať dosť dobrých vecí reštaurácia a nemôžem sa dočkať svojich ďalších niekoľkých návštev.,"{restaurant general, reštaurácia, positive}","{restaurant general, reštaurácia, positive}" +Milujte to zakaždým,"{restaurant general, null, positive}","{restaurant general, zaka, positive}" +"Sme miestni obyvatelia a máme pocit, že jediným spôsobom, ako toto miesto prežije s takým priemerom jedlo, je to, že väčšina zákazníkov sú pravdepodobne jednorazoví zákazníci.","{food quality, jedlo, negative}","{restaurant miscellaneous, miesto, negative}" +Tiež milujte ich caeser šalát.,"{food quality, caeser šalát, positive}","{food quality, šalát, positive}" +"Neprináša vám pocit, že ste vítaní a správa sa k vám ako k nepríjemnostiam.","{service general, null, negative}","{ambience general, null, positive}" +Má správnu veľkosť pre menu.,"{restaurant miscellaneous, null, positive}","{food quality, menu, negative}" +"jedlo je fantastické a čakajúci personál bolo perfektné zakaždým, keď sme tam boli.","{food quality, jedlo, positive};{service general, čakajúci personál, positive}","{service general, personál, positive};{restaurant general, jedlo, positive}" +púšť bol dokonalým zakončením takmer dokonalého večera.,"{food quality, večera, positive};{food quality, púšť, positive}","{restaurant general, null, positive}" +"Bol som tu, minul som veľa peňazí na špeciálna večera šéfkuchára a bolo to veľké sklamanie.","{food quality, špeciálna večera šéfkuchára, negative};{food prices, špeciálna večera šéfkuchára, negative}","{food quality, null, negative}" +NAŠLA SOM NOVÝ DOM NA DRUHEJ AVENUE! ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"– V utorok ráno som musel čakať tridsať minút, kým som sa dostal do dverí, ale stálo to za to.","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive};{service general, null, negative}" +"– Je smutné vidieť miesto, ktoré bolo kedysi `` THE `` miesto, kde sa stretávať a jesť na Bfast alebo Lunch, teraz buďte miesto, ktoré je veľké `` NEOBRÁVAJ SA . ``","{restaurant general, miesto, negative}","{restaurant general, miesto, negative}" +"citrónové kura chutilo ako lepkavé sladké šišky a krevety s medom z vlašských orechov, tých pár, čo vám skutočne dali... nebolo dobré.","{food quality, citrónové kura, negative};{food style_options, krevety s medom z vlašských orechov, negative};{food quality, krevety s medom z vlašských orechov, negative}","{food quality, null, negative};{food quality, šišky, negative}" +"Bolo to romantické - a dokonca pekné dokonca aj s mojou sestrou, pripomenulo mi to Taliansko a malo to umelecké diela a hudba, ktoré udržovali pocit, že som v stredomorskej vile.","{ambience general, null, positive};{ambience general, umelecké diela, positive};{ambience general, hudba, positive}","{ambience general, null, positive};{ambience general, hudba, positive};{ambience general, umelecké diela, positive}" +sushi bolo vynikajúce a obsluha bolo rýchle.,"{service general, obsluha, positive};{food quality, sushi, positive}","{service general, obsluha, positive}" +V skutočnosti sa mnohí chcú počas svojej návštevy vrátiť druhýkrát.,"{restaurant general, null, positive}","{restaurant general, null, negative}" +– Najlepšie mexické miesto na obed vo finančnej štvrti .,"{restaurant general, mexické miesto, positive}","{restaurant general, null, positive}" +milujem to miesto!,"{restaurant general, miesto, positive}","{restaurant general, null, positive}" +atmosféra je skvelá.,"{ambience general, atmosféra, positive}","{ambience general, atmosféra, positive}" +Perfektné na chladný deň.,"{food quality, null, positive}","{food quality, na chladný, positive}" diff --git a/experiments/Natural/preds_sw.csv b/experiments/Natural/preds_sw.csv new file mode 100644 index 0000000000000000000000000000000000000000..cfe5f412175fa3a1807b2908039e1336f4254f2c --- /dev/null +++ b/experiments/Natural/preds_sw.csv @@ -0,0 +1,545 @@ +input,gold,pred +Nilisubiri kwa dakika 10-15 kwa huduma niliagiza bia na sikutolewa tena.,"{service general, huduma, negative}","{service general, nili, negative}" +mandhari ilikuwa mapumziko ya amani na ya kustarehesha miongoni mwa watoto wote waliokuwa wakikimbia huku na huko Downtown Disney.,"{ambience general, mandhari, positive}","{restaurant general, mandhari, positive}" +jem ndogo iliyofichwa,"{restaurant general, null, positive}","{restaurant general, jem, positive}" +Nilienda huko na rafiki kutoka nje ya mji ... na sote tulivutiwa sana!,"{restaurant general, null, positive}","{restaurant general, Nilienda, positive}" +Ina kubwa sushi na bora zaidi huduma .,"{service general, huduma, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{food style_options, sushi, positive}" +"Wote wao vitu vya menyu ni hit , na hutumikia mimosas .","{food quality, vitu vya menyu, positive}","{drinks quality, mimosas, positive};{food quality, menyu, positive}" +– ... na uzoefu bora wa majira ya joto sitaha -- watakuletea blanketi ukipata baridi katika hali ya hewa ya jioni ya Seattle .,"{ambience general, sitaha, positive};{service general, null, positive}","{ambience general, bora wa majira ya joto, positive}" +– Baada ya miaka 12 katika Seattle Ray's hukadiria kama mahali tunarudi kila mara.,"{restaurant general, Ray's, positive}","{restaurant general, Ray's, positive}" +Huwezi Kukosea Hapa.,"{restaurant general, null, positive}","{restaurant general, Hapa, positive}" +Nadhani labda nimejaribu kila kitu kwenye menyu angalau mara moja ni bora zaidi.,"{food quality, menyu, positive}","{food quality, menyu, positive}" +– The pepperoni's kata nene halisi -- Yum .,"{food style_options, pepperoni's, positive}","{food quality, pepperoni, positive}" +Green tea creme brulee inakuwa bora kila ninapokuwa nayo.,"{food quality, Green tea creme brulee, positive}","{food quality, green tea creme brulee, positive}" +sio wazo nzuri sana kwamba unajisikia vibaya na lazima uvae.,"{ambience general, null, positive}","{restaurant general, wazo, positive}" +Anga ilikuwa nzuri.,"{ambience general, Anga, positive}","{restaurant general, Anga, positive}" +ajabu kabisa! ! !,"{restaurant general, null, positive}","{restaurant general, kabisa, positive}" +EPUKA MAHALI,"{restaurant general, MAHALI, negative}","{restaurant general, EPUKA, positive}" +"Kusema kweli, ni bora kugandisha pizza .","{food quality, pizza, negative}","{food quality, pizza, positive}" +huduma ilikuwa ya kipekee - wakati fulani kulikuwa na hisia kwamba tulihudumiwa na jeshi la urafiki wahudumu .,"{service general, wahudumu, positive};{service general, huduma, positive}","{restaurant general, huduma, negative}" +Na walifunga kila kitu vizuri ili kisimwagike.,"{service general, null, positive}","{restaurant general, walifunga, positive}" +VIZURI SANA!,"{restaurant general, null, positive}","{restaurant general, VIZ, positive}" +chakula ni dhambi.,"{food quality, chakula, positive}","{restaurant general, chakula, positive}" +"Kuanza, takriban oz 8-10 za juisi ya machungwa itakugharimu $ 3.","{drinks prices, juisi ya machungwa, negative}","{restaurant prices, Kuan, positive};{restaurant general, Kuan, positive}" +nzuri uteuzi wa sababu.,"{drinks style_options, uteuzi wa sababu, positive}","{restaurant general, nzuri, positive}" +"Ingawa ningeweza kufanya bila vijana ambao walishiriki jioni nasi , seva na chakula yetu ya ajabu ilifanya uzoefu kuwa mzuri sana.","{service general, seva, positive};{restaurant miscellaneous, null, positive};{food quality, chakula, positive}","{food quality, null, positive};{food quality, chakula ya ajabu, positive}" +Ni kupata nini!,"{restaurant general, null, positive}","{restaurant general, null, negative}" +- Mioposto ina ubunifu na ladha sana menyu ya pizza .,"{food quality, menyu ya pizza, positive};{food style_options, menyu ya pizza, positive}","{food quality, pizza, positive}" +"Katika safari ya hivi majuzi, mhudumu wetu alipuuza kazi sana, huku wafanyikazi wasiopungua watatu wakingoja kwa miguu na miguu kwenye jozi ya wasichana wa Kijapani walioketi karibu.","{service general, mhudumu, negative}","{service general, mhudumu, negative}" +"kwa kawaida nisingemaliza brocolli ninapoagiza vyakula vya aina hii lakini kwa mara ya kwanza, kila kipande kilikuwa na matukio mengi kama kile cha kwanza ... koga na kamba zilikuwa mbichi na zimepikwa vizuri .","{food quality, kamba, positive};{food quality, koga, positive};{food quality, brocolli, positive}","{food quality, brocolli, positive};{food style_options, brocolli, positive}" +Sio bei rahisi zaidi sushi lakini imekuwa ya thamani yake kila wakati.,"{food quality, sushi, positive};{food prices, sushi, neutral}","{food quality, sushi, positive}" +Huwezi kamwe kujisikia icky na stuffed baada ya kula huko.,"{food quality, null, positive}","{food quality, kula, positive}" +"Kama sehemu ya karamu ndogo ya watu wanne, chakula chetu kiliachwa bila maoni;","{service general, null, negative}","{restaurant general, null, negative}" +Natumai siku moja Scooner au Baadaye itarejea kama ilivyokuwa .,"{restaurant general, Scooner au Baadaye, negative}","{restaurant general, Natum, positive}" +"Kwanza kabisa, chakula kilikuja haraka na vyote kwa pamoja","{service general, null, positive}","{restaurant general, Kwan, positive}" +chakula kilikuwa kizuri!,"{food quality, chakula, positive}","{food quality, chakula, positive}" +"Ikiwa kuna mstari siku moja ya juma kwa muda wote ambapo mahali imefunguliwa , unajua ni nzuri .","{restaurant general, mahali, positive}","{restaurant general, Ikiwa, positive}" +Mshangao wa kupendeza zaidi ulikuwa hundi ambayo haikuzidi matarajio yangu kama kawaida hufanyika katika sehemu nyingi.,"{restaurant prices, null, positive}","{food quality, hundi, positive}" +"Bora zaidi, chakula kilikuwa kizuri na cha bei ya juu.","{food prices, chakula, negative};{food quality, chakula, positive}","{food quality, null, positive};{food prices, null, positive}" +Sehemu ya nje ya patio ina kifupi menyu .,"{food style_options, menyu, neutral}","{ambience general, ya patio, positive}" +Bora Chakula cha Kihindi huko L.A.,"{food quality, Chakula cha Kihindi, positive}","{restaurant general, Bora, positive}" +Kata kwa kufukuza - hii ni ya kushangaza!,"{restaurant general, null, positive}","{food quality, null, positive}" +"chakula si kama ilivyokuwa hapo awali ( dawa wameona kupungua kwa bei) bei zimepanda, na huduma ndio mbaya zaidi kuwahi kupata popote (pamoja na bara la Ulaya).","{food style_options, dawa, negative};{food prices, chakula, negative};{service general, huduma, negative};{food quality, chakula, negative}","{restaurant prices, chakula, negative};{service general, huduma, negative};{food quality, dawa, negative}" +Chakula cha Lebanon ! Yum!,"{food quality, Chakula cha Lebanon, positive}","{food quality, Chakula, positive}" +brocollis zilikuwa mbichi na za kitamu sana.,"{food quality, brocollis, positive}","{food quality, bro, positive};{food quality, collis, positive}" +Na wanatoa kiasi kizuri kwa bei.,"{food style_options, null, positive}","{restaurant general, null, positive}" +Inakatisha tamaa Sana,"{restaurant general, null, negative}","{restaurant general, Sana, positive}" +BORA ZA Seattle Orodha ya Mvinyo,"{drinks style_options, Orodha ya Mvinyo, positive}","{restaurant general, Bora, positive}" +– Siwezi kusema vya kutosha kuhusu hili mahali .,"{restaurant general, mahali, positive}","{restaurant general, mahali, positive}" +- nimekuwa nikila mahali hapa kwa zaidi ya miaka 8 sasa na sijawahi kupata mbaya mlo .,"{food quality, mlo, positive}","{restaurant general, null, positive}" +Nilirudi nyumbani na kuzitafuta mtandaoni tena ambapo niligundua kuwa kuna kiungo cha zawadi ambacho hakifanyi kazi hivyo nikatuma barua pepe kwa mgahawa kuhusu huduma isiyokuwepo na kiungo cha udanganyifu .,"{restaurant miscellaneous, mgahawa, negative}","{service general, huduma, negative};{restaurant miscellaneous, mgahawa, negative}" +Vipande vya kupendeza vya samaki wa kigeni kwa dola 100 sahani na HAKUNA MOJA iliyoliwa .,"{food prices, sahani, negative};{food quality, samaki wa kigeni, negative};{food style_options, samaki wa kigeni, negative}","{restaurant prices, null, negative};{restaurant general, null, negative}" +"Nilikuwa na kitamu kondoo korma , saag paneer , samosa , naan , nk.","{food quality, samosa, positive};{food quality, naan, positive};{food quality, saag paneer, positive};{food quality, kondoo korma, positive}","{food quality, nilu, positive};{food quality, saag, positive};{food quality, paneer, positive};{food quality, samosa, positive};{food quality, naan, positive}" +Inatumika vizuri sana sushi .,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"Kama kawaida omikase haikukatisha tamaa katika hali mpya, ingawa ilipata alama ya chini kutokana na ubunifu na uteuzi.","{food style_options, omikase, negative};{food quality, omikase, positive}","{food quality, haik, positive};{food style_options, haik, positive}" +"Mchele ni mkavu sana , tuna haikuwa mbichi pia .","{food quality, Mchele, negative};{food quality, tuna, negative}","{food quality, mchele, positive};{food quality, ni, positive}" +Yao mayai ya kaa benedict ni addicting .,"{food quality, mayai ya kaa benedict, positive}","{restaurant general, Yao, positive}" +Okoa nafasi kwa vyakula vitamu vitindamlo .,"{food quality, vitindamlo, positive}","{restaurant general, nafasi, positive}" +Yetu seva ilikuwa ya kitaalamu na ya kirafiki.,"{service general, seva, positive}","{restaurant general, null, positive}" +Nilienda hapa kwa pendekezo na hakika nitarudi mara kwa mara.,"{restaurant general, null, positive}","{restaurant general, Nili, positive}" +chakula kilikuwa kizuri lakini kilikuwa cha upole sana.,"{food quality, chakula, negative};{food quality, chakula, positive}","{food quality, chakula, positive}" +– Mume wangu na mimi tunapenda kula Mioposto Café .,"{restaurant general, Mioposto Café, positive}","{restaurant general, Café, positive}" +- Hii ilikuwa uzoefu mzuri wa kula.,"{restaurant general, null, positive}","{food quality, kula, positive}" +wafanyakazi walikuwa wa kirafiki sana.,"{service general, wafanyakazi, positive}","{restaurant general, wafiki, negative}" +Tulitumia kwa urahisi zaidi ya $40 kwa kila mtu (bila kujumuisha pombe) na bado tulikuwa na njaa.,"{restaurant prices, null, negative};{food style_options, null, negative}","{restaurant prices, null, negative};{restaurant general, null, negative}" +Hii ni pale juu na maeneo ya Tokyo kwa kadiri hali mpya inavyohusika.,"{food quality, null, positive}","{restaurant general, null, positive}" +Groovy muziki alifanya chakula cha jioni kuwa cha kawaida.,"{ambience general, muziki, positive}","{ambience general, muziki, neutral}" +"Baada ya mwanachama mmoja wa chama chetu kugongwa mara kwa mara na mhudumu , ombi la heshima la kwamba asipigwe lilimpelekea mhudumu maneno ya matusi.","{service general, mhudumu, negative}","{service general, mhudumu, negative};{service general, chama, negative}" +– Ray's ( inashangaza ) ina BORA na anuwai zaidi ya jiji orodha ya divai .,"{drinks style_options, orodha ya divai, positive}","{restaurant general, Ray's, positive}" +Labda nisingerudi nyuma ingawa 'cuz sijui kama inafaa.,"{restaurant general, null, negative}","{restaurant general, Labda, positive}" +"chips na salsa ni tamu sana, na bei ni nzuri.","{restaurant prices, null, positive};{food quality, chips na salsa, positive}","{food quality, chips na salsa, positive}" +"sommelier ni nzuri sana, ya chini-kwa-earth , na inayofahamika sana .","{service general, sommelier, positive}","{drinks quality, sommelier, positive}" +kubwa nene pepperoni,"{food style_options, pepperoni, positive}","{food quality, pepperoni, positive}" +Haifai kwenda hata kidogo na kutumia pesa zako huko! ! !,"{restaurant general, null, negative}","{restaurant prices, null, positive}" +Kwa Kutukana Bei Iliyozidi,"{restaurant prices, null, negative}","{restaurant general, Bei, positive}" +Mazingira ya ndani ilikuwa ya kisasa.,"{ambience general, Mazingira ya ndani, positive}","{restaurant general, null, negative}" +USIENDE!,"{restaurant general, null, negative}","{restaurant general, US, positive}" +"Hadi hili litokee, ushauri wangu ni KAA MBALI.","{restaurant general, null, negative}","{restaurant general, Hadi, positive}" +"Oh, nilisahau kutaja kwamba hawana huduma ya mkate.","{service general, null, negative}","{food quality, nilisahau, negative}" +Wao si greasy au kitu chochote.,"{food quality, null, positive}","{food quality, null, negative}" +"muziki ni mzuri, hakuna usiku bora au mbaya zaidi, zabuni za bar ni wakarimu kwa kumimina, na wenye moyo mwepesi anga watakuinua.","{ambience general, anga, positive};{ambience general, muziki, positive};{drinks style_options, zabuni za bar, positive}","{ambience general, zabuni za bar, positive};{food quality, muziki, positive};{restaurant general, null, positive}" +"Nzuri mazingira , lakini imezidiwa sana mahali .","{restaurant general, mahali, negative};{ambience general, mazingira, positive}","{restaurant general, null, negative}" +sushi hapa ni tamu!,"{food quality, sushi, positive}","{food quality, sushi, positive}" +– Nimefurahiya sana kuripoti kwamba chakula changu cha jioni katika Ray's Boathouse Ijumaa iliyopita kilizidi matarajio yangu.,"{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}" +"Dinners zimekuwa bora kila wakati, katika suala la ubora wa chakula.","{food quality, Dinners, positive}","{food quality, chakula, positive}" +Zao programu zote ni tamu .,"{food quality, programu, positive}","{restaurant general, programu, negative}" +Utepe wa Bluu anaishi kulingana na sifa yake nzuri.,"{restaurant general, Utepe wa Bluu, positive}","{restaurant general, Utepe, positive}" +Nilijisikia vibaya na wakati mwingine nilienda kwenye bafuni ya kasino.,"{restaurant miscellaneous, null, negative}","{restaurant general, bafuni ya kasino, positive}" +– Niliamua kula katika Stack kwa sababu ya bei fasta kabla ya show chakula cha jioni .,"{food prices, bei fasta kabla ya show chakula cha jioni, neutral}","{restaurant general, Nili, positive}" +- Niliwapeleka wazazi wangu hapa kwa maadhimisho yao - nimekata tamaa sana! ! !,"{restaurant general, null, negative}","{restaurant general, null, positive}" +Haiwezi kushindwa sushi !,"{food quality, sushi, positive}","{food quality, sushi, positive}" +"Kuanzisha mambo , seva yetu nzuri Brooke ilikuwa karibu kuchukua agizo langu la kinywaji.","{service general, Brooke, positive}","{restaurant general, Kuan, positive}" +Kila wakati `` 0-sixtynine `` inaitwa mhudumu wa baa hununua kila mtu vinywaji !,"{service general, mhudumu wa baa, positive}","{restaurant general, kila, positive}" +"Burudani isiyo na mwisho, ya kushangaza muziki, nzuri wafanyikazi! ! !","{restaurant general, null, positive};{service general, wafanyikazi, positive};{ambience general, muziki, positive}","{restaurant general, Burudani, positive};{restaurant general, wafu, positive}" +Haki uteuzi wa menyu .,"{food style_options, uteuzi wa menyu, neutral}","{restaurant general, Haki, positive}" +Watoto wawili wakorofi walikuwa wameketi karibu nasi kwa sehemu ya kwanza ya chakula chetu cha jioni ... nafasi yao ilichukuliwa na kijana mrembo ambaye alijifanya kunyamazisha kila wakati dagaa ilipotajwa kwenye meza yake.,"{restaurant miscellaneous, null, negative}","{service general, wakorofi, negative}" +Niliikataa kwa sababu katika mchakato wa kujaribu kurekebisha mayai walivunja kitu kingine kwenye sahani na nilichanganyikiwa sana kuendelea.,"{food quality, sahani, negative}","{food quality, kurekebisha, negative};{food quality, mayai, negative}" +ilikuwa na sahani nyingi lakini BORA zaidi ilikuwa lobster njia 3 .,"{food quality, lobster njia 3, positive}","{food quality, lobster, positive};{food style_options, null, positive}" +"appetizer ilikuwa ya kuvutia , lakini Creme Brulee ilikuwa ya kitamu na ya kitamu sana.","{food quality, Creme Brulee, positive};{food quality, appetizer, positive}","{food quality, appetizer, negative};{food quality, Creme Brulee, positive}" +mapambo ilikuwa nzuri na ya kipekee.,"{ambience general, mapambo, positive}","{restaurant general, null, positive}" +"Ni safi, inakaribisha, inapendeza, na inastarehesha.","{food quality, null, positive};{ambience general, null, positive}","{food quality, null, negative}" +Uraibu!,"{restaurant general, null, positive}","{restaurant general, Ura, negative}" +"Hata zile mbaazi , ambazo mimi huona kuwa kavu sana, zilikuwa nzuri.","{food quality, mbaazi, positive}","{food quality, mbaazi, positive}" +Hii mahali inatikisa! !,"{restaurant general, mahali, positive}","{restaurant general, Hii, positive}" +"Hiyo ni pongezi kubwa, haswa katika biashara ya mikahawa isiyobadilika, ... tayari inatosha!","{restaurant general, null, positive}","{restaurant general, Hiyo, positive};{food quality, mikahawa, positive}" +Baada ya kukaa pale na glasi yangu tupu kwa zaidi ya dakika 20 niliondoka.,"{service general, null, negative}","{restaurant miscellaneous, null, negative}" +Hakikisha umejaribu oyster roll .,"{food quality, oyster roll, positive}","{food quality, oyster roll, positive}" +Ninashangaa kuwa huu mgahawa umeainishwa kama $$$ badala ya $$$$ .,"{restaurant prices, mgahawa, negative}","{restaurant prices, Ninu, negative}" +Ilikuwa ya heshima lakini hakuna kitu cha kipekee.,"{food quality, null, neutral}","{restaurant general, I, negative}" +"Huduma ilikuwa ya polepole , yetu mhudumu ilichukua milele kutupa hundi yetu ingawa haikuwa na shughuli nyingi .","{service general, Huduma, negative};{service general, mhudumu, negative}","{restaurant general, Huduma, positive}" +"– Kubwa vinywaji , hashi ya nyama ya mahindi , kahawa , B haraka burritos , Gluten Free menyu .","{food style_options, menyu, positive};{food quality, B haraka burritos, positive};{drinks quality, kahawa, positive};{drinks quality, vinywaji, positive};{food quality, hashi ya nyama ya mahindi, positive}","{food style_options, null, positive};{food quality, hashi ya nyama, positive};{food quality, Kubwa, positive};{food quality, burritos, positive};{food quality, menyu, positive}" +menyu ya chakula cha mchana ni mpango mzuri!,"{food prices, menyu ya chakula cha mchana, positive}","{food quality, chakula, positive}" +"Ilichukua milele ili agizo letu lichukuliwe, ujazo wa maji ulikuwa mwingi sana kuuliza na wakati pekee alipokuwa haraka ni tulipouliza bili yetu tulipoweza kupata umakini wake.","{service general, null, negative}","{service general, null, negative};{restaurant prices, null, negative}" +mhudumu hakuwa rafiki na hisia ya mgahawa ilikuwa na watu wengi .,"{service general, mhudumu, negative};{ambience general, hisia, negative}","{food quality, haku, negative};{restaurant miscellaneous, null, negative}" +- Hivi majuzi nilifurahiya kula kama mkahawa huu wa kupendeza mkahawa kwenye barabara ya 2 na wow ni jioni njema tuliyokuwa nayo .,"{restaurant general, mkahawa, positive}","{restaurant general, mkahawa, positive}" +"Umaalumu hapa umeharibika pancakes, lakini nimerudi sasa mara nne, na nimekuwa nikistaajabishwa kila wakati.","{food quality, pancakes, positive}","{food quality, pancakes, positive}" +- Kwa bei nafuu kukaa chini Mexico NA katikati mwa jiji.,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant general, null, positive}" +"appetizer ya oysters, lobster, kaa (ukubwa mdogo) ilifanya ingizo kamili kwa mke wangu.","{food quality, appetizer ya oysters, lobster, kaa (ukubwa mdogo, positive}","{food quality, appetizer, positive}" +Nimegundua kuwa unaweza kuwa na mahali peke yako usiku na wikendi kwa sherehe ya faragha - siwezi kusubiri kusherehekea siku yangu ya kuzaliwa ijayo huko .,"{restaurant miscellaneous, mahali, positive}","{restaurant miscellaneous, Nimegundua, positive}" +"– Kama ilivyo kwa mikahawa mingi huko Seattle , Mioposto huduma ilikuwa mbaya na chakula ilikuwa ya bei kupita kiasi .","{food prices, chakula, negative};{service general, huduma, negative}","{food quality, chakula, negative};{restaurant general, Mioposto, negative};{food prices, chakula, negative}" +Unaweza kumsikia kwa urahisi ingawa kwa hivyo ilikuwa sauti ya kupendeza na sio ya kupita kiasi.,"{ambience general, null, positive}","{food quality, null, positive}" +Nenda tu huko ujionee mwenyewe.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Ni sehemu ndogo sana mahali yenye uwezo mkubwa wa kuwa eneo la ujirani ikiwa huduma hazikuwa za kibinafsi na kama shirika.,"{restaurant general, mahali, positive};{service general, huduma, negative}","{restaurant general, mahali, positive}" +"Brunch katika Murphy's ni kufa kwa ajili ya , maalum yangu ... kimanda nyeupe yai, the chakula ni daima freshly tayari.","{food quality, kimanda nyeupe yai, positive};{food quality, Brunch, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{restaurant general, Murphy's, positive}" +Mama Mia – Ninaishi jirani na ninajihisi mwenye bahati kuishi karibu na mahali pazuri sana mahali pa pizza .,"{restaurant general, mahali pa pizza, positive}","{location general, mahali, positive};{restaurant general, Ninaishi, positive}" +- iliyowekwa na Kituo cha Beverly.,"{location general, null, neutral}","{restaurant general, Kituo cha Beverly, positive}" +wafanyakazi ni rafiki sana.,"{service general, wafanyakazi, positive}","{restaurant general, wafaki, positive}" +Na huduma ilitumika tu - ilifurahisha sana.,"{service general, huduma, positive}","{restaurant general, huduma, positive}" +Sawa ... - Labda niliingia kwenye siku mbaya ya mtu ...,"{restaurant general, null, negative}","{restaurant general, Sawa, negative}" +"Nimekuwa na Jellyfish , Horse Mackerel , Blue Fin Tuna na Sake Ikura roll miongoni mwa zingine, na zote zilikuwa nzuri.","{food quality, Horse Mackerel, positive};{food quality, Jellyfish, positive};{food quality, Blue Fin Tuna, positive};{food quality, Sake Ikura roll, positive}","{food quality, Sake Ikura roll, positive};{food quality, Jellyfish, positive};{food quality, Blue Fin Tuna, positive};{food quality, Horse Mackerel, positive}" +NINI NYINGINE UNAWEZA KUSEMA NICE PEOPLE CHA AJABU CHAKULA WOW,"{service general, PEOPLE, positive};{food quality, CHAKULA, positive}","{service general, PEOPLE, positive}" +Daima nzuri.,"{restaurant general, null, positive}","{restaurant general, nzuri, positive}" +Mdomo wangu ulihisi mkavu sana baadaye na nikapata saini hiyo? MSG ? ladha iliendelea kwenye koo langu baada ya kuondoka kwenye mgahawa.,"{food quality, null, negative}","{food quality, saini, negative}" +"Ah ndio ... mtazamo mtazamo ulikuwa mzuri, pia.","{location general, mtazamo, positive}","{food quality, null, positive}" +"meneja alikatizwa mara kwa mara na `` Je, kuna kitu kingine chochote ninachoweza kukufanyia? ``, maoni ya ajabu kwa sababu hakuwa amesikiliza, sembuse kujibu maonyesho yetu ya kukatishwa tamaa na uzoefu wetu.","{service general, meneja, negative}","{service general, meneja, negative}" +huduma ni kati ya kati hadi ya kukera .,"{service general, huduma, negative}","{restaurant general, huduma, positive}" +Safi viungo na kitamu sana.,"{food quality, null, positive};{food quality, viungo, positive}","{restaurant general, Safi, positive}" +mandhari ya mgahawa ilikuwa nzuri na nzuri kwa chakula cha jioni.,"{ambience general, mandhari, positive}","{food quality, chuka, positive};{food quality, mandazi, positive}" +Na ghorofani ni mahali pazuri pa kubarizi.,"{ambience general, ghorofani, positive}","{restaurant general, null, positive}" +- Sio mbaya.,"{restaurant general, null, neutral}","{restaurant general, Sio, positive}" +Nilikuwa na sahani ya Kafta na ilikuwa kamili.,"{food quality, sahani ya Kafta, positive}","{restaurant general, Kafta, positive}" +– Mahali hapa ni maarufu kwa kifungua kinywa .,"{food quality, kifungua kinywa, positive}","{restaurant general, hapa, negative}" +Ilingoja dakika 35 kwa meza kwa 8 ambayo ilikuwa sawa kwa umati mkubwa kama huo.,"{service general, null, neutral}","{food quality, mkate, positive};{food style_options, mkate, positive}" +Wafanyikazi wote wafanyikazi walinijali sana na walishughulikia kila hitaji langu.,"{service general, wafanyikazi, positive}","{food quality, null, positive}" +"Kulikuwa na hali nzuri sana msisimko kuhusu mahali ... nzuri muziki , anga na kuangalia kwa furaha watu .","{restaurant miscellaneous, watu, positive};{ambience general, anga, positive};{ambience general, msisimko, positive};{ambience general, muziki, positive}","{ambience general, muziki, positive}" +Jaribu Chaguo la Mpishi kwa sushi kwani mkia wa njano wa kuvuta sigara ulikuwa wa ajabu na roli pia zilikuwa za kitamu.,"{food quality, mkia wa njano wa kuvuta sigara, positive};{food quality, Chaguo la Mpishi kwa sushi, positive};{food quality, roli, positive}","{food quality, sushi, positive};{food quality, roli, positive}" +"sushi ni safi kama inavyokuja? Utafikiri bahari ilikuwa nyuma ya nyumba yao, hakuna mzaha!","{food quality, sushi, positive}","{food quality, sushi, negative}" +"chakula kilikuwa sawa , na kitamu kidogo-kuliko-kawaida salsa .","{food quality, salsa, positive};{food quality, chakula, positive}","{food quality, salsa, negative};{food style_options, salsa, negative}" +"Kwa wale wanaokula sushi na wale ambao wamechukua sampuli bora zaidi za NYC wanaweza kutoa, samaki ndio safi zaidi na huduma ni bora zaidi.","{food quality, samaki, positive};{service general, huduma, positive}","{food quality, samaki, positive};{service general, huduma, positive}" +Mzee Kutegemewa,"{restaurant general, null, positive}","{restaurant general, Mzee, positive}" +Mojawapo bora Mahali pa Sushi mjini .,"{restaurant general, Mahali pa Sushi, positive}","{food quality, Sushi, positive}" +"Chakula busara , ni sawa lakini ni ghali kidogo kwa kile unachopata ukizingatia mgahawa si mahali pazuri.","{food quality, Chakula, neutral};{ambience general, mgahawa, neutral};{restaurant prices, mgahawa, negative}","{restaurant prices, Chakula, negative};{ambience general, Chakula, negative}" +"– Penda zao pizza , hasa uyoga pizza .","{food quality, pizza, positive};{food quality, uyoga pizza, positive}","{food quality, pizza, positive}" +Walikuja wakiwa katika sanduku lao la kuvutia la kuchukua na wakiwa na barafu iliyotengenezwa nyumbani; nyepesi sana na sio-tamu sana .,"{food quality, null, positive}","{food quality, null, negative};{food style_options, null, negative}" +Nilifurahia chakula,"{food quality, chakula, positive}","{restaurant general, Nilifurah, positive}" +Nimetembelea mkahawa huu zaidi ya mara kadhaa bila malalamiko yoyote hadi sasa .,"{restaurant general, mkahawa, positive}","{restaurant general, null, positive}" +"Pendelea kuiagiza na kuichukua kwa sababu sipendi seva , moja mwanamke mdogo haswa .","{service general, seva, negative};{service general, mwanamke mdogo, negative}","{restaurant miscellaneous, Pendele, negative}" +kupata kushangaza,"{restaurant general, null, positive}","{restaurant general, kupata, positive}" +"Haikuwa safi zaidi dagaa milele , lakini ladha na uwasilishaji ulikuwa sawa.","{food quality, dagaa, neutral};{food style_options, dagaa, neutral}","{food quality, dagaa, positive};{food style_options, dagaa, positive};{service general, uwasilishi, positive}" +"Walakini , thamani na huduma zote zinakosekana sana.","{restaurant prices, null, negative};{service general, huduma, negative}","{restaurant general, Walak, negative}" +Katika Grammercy/Union Square/East Village hawa ni majirani zangu na ninaowapenda sana doa .,"{restaurant general, doa, positive}","{restaurant general, Grammercy/Union Square/East Village, positive}" +"upande wa viazi ni kufa kwa ajili ya , kama ilivyo labne ( yogurt dip) .","{food quality, labne ( yogurt dip, positive};{food quality, upande wa viazi, positive}","{food quality, upande wa viazi, positive}" +AJABU.,"{restaurant general, null, positive}","{restaurant general, AJABU, positive}" +"Ni kitamu kama nini, cha kutisha!","{food quality, null, positive}","{food quality, null, positive}" +"Kubwa chakula , bora Margaritas !","{drinks quality, Margaritas, positive};{food quality, chakula, positive}","{drinks quality, Margaritas, positive}" +huduma ni makini na inavutia sana.,"{service general, huduma, positive}","{restaurant general, huduma, positive}" +"Muhimu zaidi , tulifurahishwa sana na chakula baada ya kuona ubunifu sana menyu .","{food style_options, menyu, positive}","{food quality, null, negative};{food style_options, null, negative}" +Mahali pazuri mahali kwa 2,"{ambience general, mahali, positive}","{restaurant general, mahi, positive}" +"Jambo bora ni, bei pia ni nzuri kabisa.","{restaurant prices, null, positive}","{restaurant general, Jambo, positive}" +"Aliahidi kuongea na mhudumu ambaye aliruka kwa hasira, lakini hatukuweza kuchukua ahadi yake kwa uzito, kwa kuwa hakujisumbua kupata jina la wahudumu.","{service general, null, negative}","{food style_options, ahadi, negative};{food quality, ahadi, negative}" +chana masala ( maharagwe ya garbanzo) pia ni bora.,"{food quality, chana masala ( maharagwe ya garbanzo, positive}","{food quality, chana masala, positive}" +"Hili uanzishwaji ulishuka sana baada ya ( na hii ni hadithi inayojirudia) kupeperushwa kwa TELEVISHENI ZA CHAKULA `` DINERS , DRIVE-INS , AND DIVES `` iliyoandaliwa na Guy Fieri , ambayo Schooner au Baadaye alihusika.","{restaurant general, uanzishwaji, negative}","{restaurant miscellaneous, Schooner, positive}" +Nawapenda Dungeness crabs na kwa Ray unaweza kuwahudumia kwa njia 6 tofauti!,"{food style_options, Dungeness crabs, positive}","{food quality, Nawapenda Dungeness crabs, positive}" +Chakula kilikuwa kizuri na cha kufurahisha.,"{food quality, Chakula, positive}","{restaurant general, Chakula, positive}" +Ilikuwa ya kushangaza kabisa.,"{restaurant general, null, positive}","{restaurant general, I, positive}" +Hapa ni mahali pazuri pa kupata kitamu mlo .,"{food quality, mlo, positive}","{restaurant general, Hapa, positive}" +"pamoja na , sina mzio wa mchele , na watumishi ilikuwa ya kupendeza sana -- hata haikugusa macho!","{service general, watumishi, positive}","{food quality, mzee, positive};{food quality, pamoja, positive}" +- Nilikatishwa tamaa sana na chakula huko Pagoda.,"{food quality, chakula, negative}","{restaurant general, Nil, positive}" +Bei ya juu,"{restaurant prices, null, negative}","{restaurant general, ya, positive}" +Hii inasikitisha kwa kile ambacho hapo awali kilikuwa moja ya sehemu bora zaidi unayoweza kula.,"{restaurant general, null, negative}","{food quality, null, positive}" +"Ukiwa ndani, uzoefu halisi huanza.","{restaurant general, null, positive}","{restaurant general, Uki, positive}" +na mhudumu alipendekeza kamili kwa ajili ya ! !,"{drinks quality, kwa ajili ya, positive}","{restaurant general, mhudumu, positive}" +mmiliki ana ugomvi kwa wageni ambao wana malalamiko .,"{service general, mmiliki, negative}","{restaurant general, null, positive}" +"Kila kitu unachotaka na zaidi, safi sana.","{food quality, null, positive};{food style_options, null, positive}","{restaurant general, null, positive}" +Rafiki yangu alifurahia Salmoni ya Mfalme wa Alaska aliyechomwa na yenye ladha nzuri viazi vya russet vilivyotiwa cream vya Washington na crisp maharagwe ya kijani .,"{food quality, maharagwe ya kijani, positive};{food quality, Salmoni ya Mfalme wa Alaska aliyechomwa, positive};{food quality, viazi vya russet vilivyotiwa cream vya Washington, positive}","{food quality, Salmoni ya Mfalme wa Alaska, positive};{food quality, viazi vya russet, positive};{food quality, cream vya Washington, positive};{food quality, maharagwe ya kijani, positive}" +"chakula kilikuwa kizuri sana , filet mignon pengine kilikuwa bora zaidi ambacho nimewahi kujaribu.","{food quality, filet mignon, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{food quality, filet mignon, positive}" +"- Mkahawa wa Mercedes ni wa kitamu sana, huduma ni ya kustaajabisha bila shaka!","{food quality, null, positive};{service general, huduma, positive}","{food quality, Mkahawa, positive};{food prices, Mkahawa, positive}" +Ninaweza kupendekeza anuwai zao saag na paneer na korma .,"{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, paneer, positive};{food quality, korma, positive}" +chakula ni kubwa na wanafanya maana mary ya damu .,"{drinks quality, mary ya damu, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{food quality, marya, positive}" +Nzuri chakula lakini hakuna viungo!,"{food quality, chakula, negative};{food quality, chakula, positive}","{restaurant general, Nzuri, positive}" +Nyingine ya kuongeza ni wazi hisia ya mgahawa yenye kuta za kioo pande zote.,"{ambience general, hisia, positive}","{food quality, null, positive}" +Yum!,"{food quality, null, positive}","{food quality, null, positive}" +"bafuni yenyewe ni ndogo sana na vyoo viwili na sinki moja tu, msichana alikuwa anakaa kabisa njiani akining'inia taulo za karatasi kutoka kwa kifaa cha kutolea maji.","{restaurant miscellaneous, bafuni, negative}","{ambience general, null, negative}" +Penda enchiladas na supu ya kuku - na hakikisha kuangalia zao maalum .,"{food quality, enchiladas, positive};{food quality, supu ya kuku, positive};{food quality, maalum, positive}","{food quality, enchiladas, positive}" +chakula haiwezi kusahaulika!,"{food quality, chakula, positive}","{food quality, chakula, positive}" +Wasimamizi wanapaswa kuchukua tahadhari na kuwafunza watumishi na kuwafundisha adabu zinazofaa.,"{service general, watumishi, negative}","{food quality, adabu, positive}" +wafanyakazi ni wa kirafiki na mapambo ilikuwa ya maadili na ya kupendeza.,"{ambience general, mapambo, positive};{service general, wafanyakazi, positive}","{food quality, wafayakazi, positive};{food quality, mapenzi, positive}" +Bora zaidi Chuwam Mushi niliyowahi kuwa nayo .,"{food quality, Chuwam Mushi, positive}","{restaurant general, Mushi, positive}" +"Sehemu ilinitosha tu, lakini inaweza isiwe kwa mlaji mkuu.","{food style_options, Sehemu, neutral}","{food quality, ilani, positive}" +Jaribu Pizza Ensalata !,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza, positive}" +Bado ningependekeza hii mahali .,"{restaurant general, mahali, positive}","{restaurant general, null, negative}" +"– Sushi hapa ni nzuri kabisa , lakini kwa $ 5 kipande , ama vipande vya samaki vinapaswa kuwa vikubwa , au kusiwe na kisingizio kwamba hii ni bei ya wastani mgahawa ( hata kwa NYC ) .","{food prices, Sushi, negative};{food style_options, Sushi, negative};{food quality, Sushi, positive};{restaurant prices, mgahawa, negative}","{food quality, Sushi hapa, positive};{food style_options, vipande, negative};{food prices, vipande, negative}" +Wewe ni amefungwa kuwa na wakati haiba sana.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Tangu wakati huo tumerudi na pia kuwa na uzoefu mzuri, kuchukua sampuli za sahani ndogo zaidi na aina mbalimbali za bia (baridi na nzuri).","{drinks quality, bia, positive};{restaurant general, null, positive}","{food quality, sampuli za sahani, positive};{food style_options, aina mbalimbali za bia, positive};{restaurant miscellaneous, Tangu, positive}" +Bora Sushi mjini .,"{food quality, Sushi, positive}","{food quality, Sushi, positive}" +wafanyakazi walikuwa wazuri sana na wenye adabu na bila shaka walikuwa wachina.,"{service general, wafanyakazi, positive}","{service general, wafanyakazi, positive}" +"Tuliamuru uteuzi wa sahani ndogo, na vitunguu vya kamba ya kiatu , pizza ya jibini la mbuzi , asparagus iliyoangaziwa na brie iliyokaanga na matunda yote yalikuwa mazuri sana.","{food quality, vitunguu vya kamba ya kiatu, positive};{food quality, brie iliyokaanga na matunda, positive};{food quality, pizza ya jibini la mbuzi, positive};{food quality, asparagus iliyoangaziwa, positive}","{food quality, pizza ya jibini la mbuzi, positive};{food quality, vitunguu vya kamba ya kiatu, positive};{food quality, asparagus iliyoangaziwa na brie, positive};{food style_options, tuliamuru, positive}" +Kazi nzuri!,"{restaurant general, null, positive}","{restaurant general, Kazi, positive}" +"Ingawa , jambo moja nililogundua baadaye ni kwamba mkahawa huo ulitumia MSG au kiyoyozi cha nyama kwenye nyama ya nyama.","{food quality, nyama ya nyama, negative}","{food quality, nyama ya nyama, negative}" +Kubwa uteuzi wa sababu .,"{drinks style_options, uteuzi wa sababu, positive}","{restaurant general, Kubwa, positive}" +Hongera kwa hawa jamaa.,"{restaurant general, null, positive}","{restaurant general, Hong, positive}" +Isipokuwa ukiacha tu kunywa kidogo singependekeza uende hapa.,"{restaurant general, null, negative}","{restaurant general, null, positive}" +Kubwa chupa ya divai .,"{drinks quality, chupa ya divai, positive}","{restaurant general, Kubwa, negative}" +sahani ya ufuta wazi ni dili kwa lundo la chakula kilichotolewa.,"{food prices, sahani ya ufuta wazi, positive};{food style_options, sahani ya ufuta wazi, positive}","{food quality, sahani ya ufuta, negative}" +ILIVYOPIMWA JUU! ! ! !,"{restaurant general, null, negative}","{restaurant general, ILIVY, positive}" +Thamani ya kusubiri,"{restaurant general, null, positive}","{restaurant general, kusubi, positive}" +Haipati bora zaidi ya hiyo.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +bora asali walnyt kamba ambayo tumeonja kila .,"{food quality, asali walnyt kamba, positive}","{food quality, kamba, positive}" +Wameonyeshwa kwenye mtandao wa chakula na wanastahili.,"{restaurant miscellaneous, null, positive}","{restaurant general, Wame, positive}" +Ninapenda hali ya joto na laini mazingira .,"{ambience general, mazingira, positive}","{food quality, Ninapenda, positive}" +Mtazamo wa Snotty,"{service general, null, negative}","{restaurant general, Snotty, positive}" +"anga inatamani , na mapambo ni ya sherehe na ya kushangaza ...","{ambience general, mapambo, positive};{ambience general, anga, positive}","{restaurant general, anga, positive}" +"Yao safu maalum ni ya kuvutia, ingawa sikumbuki tulikuwa na .","{food quality, safu maalum, positive}","{food quality, safu, positive}" +- Nilipenda ravioli ya malenge na jibini la mbuzi gnocchi ( 5 kubwa kwa sahani badala ya gnocchis 20 au zaidi) na dada yangu alimpenda filet mignon juu ya mchicha na mashed viazi.,"{food quality, jibini la mbuzi gnocchi, positive};{food quality, filet mignon juu ya mchicha na mashed viazi, positive};{food style_options, jibini la mbuzi gnocchi, positive};{food quality, ravioli ya malenge, positive}","{food quality, ravioli ya malenge, positive};{food style_options, gnocchi, positive};{food quality, filet mignon juu ya mchicha na mashed viazi, positive}" +Sio kubwa zaidi sehemu lakini inatosha .,"{food style_options, sehemu, neutral}","{restaurant general, Sio, positive}" +"Nenda na baadhi ya marafiki , subiri nusu saa au zaidi na kikombe cha joe , na ufurahie zaidi ya wastani wako kifungua kinywa .","{food quality, kifungua kinywa, positive};{restaurant general, null, positive}","{drinks quality, kikombe cha joe, positive};{restaurant miscellaneous, baadhi ya marafiki, positive}" +kubwa huduma.,"{service general, huduma, positive}","{restaurant general, null, positive}" +Kisha tulitozwa kwa ajili yao ya gharama kubwa zaidi ($ 20 + kwa kila huduma) wakati kwa hakika tulikunywa kwa ajili ya chini ya nusu ya bei hiyo.,"{service general, null, negative}","{service general, null, negative};{food quality, null, negative};{food prices, null, negative}" +Ladha,"{food quality, null, positive}","{restaurant general, Ladha, positive}" +curry ya kuku na kuku tikka masala ni sahani ninazopenda za nyama .,"{food quality, kuku tikka masala, positive};{food quality, curry ya kuku, positive}","{food quality, curry ya kuku na kuku tikka masala, positive}" +"bora mkahawa ulimwenguni , mzuri mapambo , bora huduma kwa wateja , rafiki meneja","{ambience general, mapambo, positive};{service general, meneja, positive};{service general, huduma kwa wateja, positive};{restaurant general, mkahawa, positive}","{food quality, huduma, positive};{food prices, huduma, positive};{restaurant general, meneja, positive}" +Vinywaji vilikuwa vyema.,"{drinks quality, Vinywaji, positive}","{restaurant general, Vinywaji, positive}" +"Uwasilishaji wa chakula ulikuwa bonasi iliyoongezwa , ilionekana kuwa nzuri kama ilivyoonja !","{food style_options, chakula, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{food style_options, chakula, positive}" +"Hata wakati huo, agizo halikuwa sahihi na bado tulikuwa tukingoja vitu kadhaa.","{service general, null, negative}","{food quality, vitu, positive}" +- Tulitendewa vibaya sana hapa wakati mmoja kwa kifungua kinywa.,"{service general, null, negative}","{restaurant general, null, positive}" +"Nzuri chakula , ya kuvutia eneo , na ya kirafiki huduma hutufanya turudi mwaka baada ya mwaka .","{location general, eneo, positive};{service general, huduma, positive};{food quality, chakula, positive}","{restaurant general, Nzuri chakula, positive};{location general, eneo, positive};{restaurant miscellaneous, Nzuri chakula, positive}" +WOW! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +- Jiokoe upotezaji wa wakati & USITEMBELEE.,"{restaurant general, null, negative}","{restaurant general, Ji, positive}" +Chakula kilikuwa kizuri na cha bei nafuu.,"{food quality, Chakula, positive};{food prices, Chakula, positive}","{food quality, Chakula, positive};{food prices, Chakula, positive}" +Mmm... vizuri!,"{restaurant general, null, positive}","{food quality, vizu, positive}" +Ni nzuri ikiwa ulitumia siku huko na hakutaka kuendesha gari ili kula.,"{location general, null, positive}","{restaurant general, null, negative}" +"Yote yakizingatiwa, lazima niseme kwamba Ray's Boathouse inastahili cheo chake kama taasisi ya Seattle.","{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}" +Thamani kubwa sushi yenye ubora wa juu na nzuri mpangilio .,"{ambience general, mpangilio, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{food quality, sushi, positive}" +"Ilikuwa ni kiasi kwamba sikuweza kumaliza lakini nilifanya, kwa kuwa ilikuwa tamu.","{food style_options, null, neutral};{food quality, null, positive}","{food quality, Ilikuwa, negative}" +Nimeipenda hii mkahawa,"{restaurant general, mkahawa, positive}","{restaurant general, Nime, positive}" +Haipendekezwi! ! !,"{restaurant general, null, negative}","{restaurant general, Haipende, positive}" +Tulisimama pale kwa dakika 10 huku wafanyakazi wakitembea huku na huko wakitupuuza .,"{service general, wafanyakazi, negative}","{service general, wafazazi, negative}" +Mimi na g/f wangu tulikubaliana kuwa chakula kilikuwa cha wastani sana hasa kwa kuzingatia bei.,"{food prices, chakula, negative};{food quality, chakula, negative}","{food quality, null, negative};{food prices, null, negative}" +"– chakula kiko hapa ni cha ajabu , ingawa ubora haulingani wakati wa chakula cha mchana .","{food quality, chakula cha mchana, negative};{food quality, chakula, positive}","{food quality, chakula, positive};{food style_options, chakula, positive}" +Sina jambo baya la kusema kuhusu hili mahali .,"{restaurant general, mahali, positive}","{restaurant general, Sina, negative}" +"tatizo pekee ni lazima upashe moto pizza kabla ya kuliwa, hata unapoagiza mapema.","{food quality, pizza, negative}","{food quality, pizza, positive}" +– Hii ni `` yangu lazima iwalete wageni kutoka mjini `` mgahawa na wanaifurahia na kuichangamkia kila mara .,"{restaurant general, mgahawa, positive}","{restaurant general, mgahawa, positive}" +Nilikuwa na sahani ya kafta na niliifurahia.,"{food quality, sahani ya kafta, positive}","{food quality, kafta, positive}" +Ilikuwa wazi kwamba hakujali sana.,"{service general, null, negative}","{restaurant general, I, positive}" +Saladi ya Kaisari niliyoagiza ilikuwa na limau nyingi sana sikuweza kuila.,"{food quality, Saladi ya Kaisari, negative}","{restaurant general, Saladi ya Kaisari, positive}" +"Yetu seva iliendelea kuwa makini usiku kucha, lakini nilibaki nikishangaa na toleo moja: Nani anafikiri kwamba Ray's ni mahali panapofaa pa kupeleka watoto wadogo kwa chakula cha jioni?","{restaurant miscellaneous, Ray's, neutral};{service general, seva, positive}","{restaurant miscellaneous, Yetu, positive}" +"Nzuri Chakula , Nzuri Huduma , Bei za Wastani ( For the Strip )","{restaurant prices, null, neutral};{food quality, Chakula, positive};{service general, Huduma, positive}","{restaurant miscellaneous, Nzuri Chakula, positive};{restaurant general, Bei za Wastani, positive}" +Saa kumi na mbili jioni kwa Saa moja kabla ya mchezo wa Broadway na tuliketi haraka na kuhudumiwa.,"{service general, null, positive}","{restaurant miscellaneous, null, positive}" +Wanalipa maelezo kama haya kwa kila kitu kutoka supu ya miso hadi ngumu rolls .,"{food quality, rolls, positive};{food quality, supu ya miso, positive}","{food quality, rolls, positive}" +$ 6 na kidokezo.,"{restaurant prices, null, positive}","{restaurant prices, kid, negative}" +anga ilikuwa nzuri.,"{ambience general, anga, positive}","{restaurant general, anga, positive}" +"Kwa maneno mengine , ikiwa hawatengenezi $$ kutoka kwako basi hukadirii kiwango cha juu kwenye mizani yao ya 'huduma' .","{service general, huduma, negative}","{service general, null, negative}" +– Nilifurahia sana mlo wangu hapa.,"{food quality, mlo, positive}","{restaurant general, Nilifurhio, positive}" +"Uchezaji wa muziki ulikuwa wa hip sana, 20-30 kitu cha pop muziki , lakini subwoofer kwa mfumo wa sauti ilikuwa chini ya kiti changu, ambayo ikawa ya kukasirisha katikati ya chakula cha jioni.","{ambience general, subwoofer kwa mfumo wa sauti, negative};{ambience general, muziki, positive}","{ambience general, null, negative};{ambience general, Uchezaji wa muziki, positive}" +Mtakatifu Hummus !,"{food quality, Hummus, positive}","{food quality, Hummus, positive}" +"Kwa kuingia yangu & eacute; e , Nilifurahia kabisa kokwa za bahari ya Alaska zilizokamilishwa na chard , artichoke hearts , fennel , na pecorino toscano .","{food quality, kokwa za bahari ya Alaska, positive};{food style_options, kokwa za bahari ya Alaska, positive}","{food quality, nilifurahia, positive};{food quality, artichoke hearts, positive};{food quality, chard, positive};{food quality, fennel, positive};{food quality, pecorino toscano, positive}" +"The mapambo ni rustic, jadi Kijapani.","{ambience general, mapambo, neutral}","{food quality, jadi Kijapani, positive}" +"Sio tu kwamba uteuzi unaweza kuwa wa kiubunifu , lakini kuna uwiano mzuri wa jadi sushi pia.","{food style_options, uteuzi, positive};{food style_options, sushi, positive}","{food quality, sushi, positive};{food style_options, utezi, positive}" +Una uwezekano wa kukatishwa tamaa.,"{restaurant general, null, negative}","{restaurant general, null, positive}" +"chakula ni nzuri, wahudumu wa baa huenda maili hiyo ya ziada.","{service general, wahudumu wa baa, positive};{food quality, chakula, positive}","{restaurant general, chakula, positive};{restaurant miscellaneous, maili ya ziada, positive}" +Mgahawa hutoa orodha pana orodha ya divai na mandhari ambayo hautasahau!,"{drinks style_options, orodha ya divai, positive};{ambience general, mandhari, positive}","{restaurant general, Mgahuto, positive}" +"Ile naan ilikuwa baadhi ya bora zaidi niliyokuwa nayo na nilifurahia sana bhartha , sio tomatoey sana .","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, naan, positive}" +Kwa wamiliki wa Fungua Sesame ... Bravo ... Siwezi kusubiri kurudi kula kwenye mgahawa wako!,"{restaurant general, Fungua Sesame, positive}","{restaurant general, Sesame, positive}" +"samaki ilikuwa mbichi, ingawa ilikuwa imekatwa nyembamba sana.","{food quality, samaki, positive};{food style_options, samaki, negative}","{food quality, samaki, negative};{food style_options, samaki, negative}" +Kumekuwa na mengi tangu na daima ni wakati mzuri.,"{restaurant general, null, positive}","{restaurant general, Kumekuwa, positive}" +Ninapenda pamoja na pizza huko Seattle,"{restaurant general, pamoja na pizza, positive}","{food quality, pizza, positive}" +ninapendekeza sana mahali hapa kwa wote wanaotaka kujaribu chakula cha indiani kwa mara ya kwanza .,"{food quality, chakula cha indiani, positive}","{food quality, chakula cha indiani, positive}" +Imezidiwa,"{restaurant general, null, negative}","{restaurant general, Imezi, positive}" +Mbaya Zaidi Huduma Niliyowahi Kuwa nayo,"{service general, Huduma, positive}","{restaurant general, Huduma, positive}" +Kama ilivyotokea mmiliki alikuwa ameketi karibu nasi na alipokuja kuangalia matatizo yetu alipuuza sana na akatoa punguzo la 20% kwa bili yetu.,"{service general, mmiliki, negative}","{service general, null, negative}" +Nilienda huko na marafiki wengine usiku mmoja kucheza bingo na kutazama mchezo wa sox na ulikuwa mlipuko!,"{restaurant general, null, positive}","{restaurant general, Nilienda, positive}" +ILIYOPITIWA KABISA!,"{restaurant general, null, negative}","{restaurant general, ILIYOP, positive}" +"– Mayai , pancakes , viazi , matunda mapya na mtindi -- kila kitu wanachotoa ni kitamu.","{food quality, mtindi, positive};{food quality, null, positive};{food quality, viazi, positive};{food quality, matunda mapya, positive};{food quality, pancakes, positive};{food quality, Mayai, positive}","{food quality, null, positive}" +– Ray ni mahali pa kwenda kwa ubora wa juu chakula cha jioni cha dagaa .,"{food quality, chakula cha jioni cha dagaa, positive}","{food quality, jioni cha dagaa, positive}" +Pia ninafurahia sana urahisi wa mapambo na ya karibu hisia ya mkahawa mdogo .,"{ambience general, mapambo, positive};{ambience general, hisia, positive}","{restaurant general, Pia, positive}" +Tunarudi nyuma. :D,"{restaurant general, null, positive}","{restaurant general, Tunar, positive}" +Ningefikiria kuileta lakini sikutarajia chakula kuwa laini kiasi hicho.,"{food quality, chakula, negative}","{food quality, kuileta, negative}" +"Nilipoingia ndani, nilistaajabishwa na mambo yao ya ajabu mapambo ya mbao .","{ambience general, mapambo ya mbao, positive}","{food quality, mapambo ya ajabu, positive}" +Ni sehemu ndogo mahali kwa hivyo ukifika hapo kabla ya saa nane mchana wikendi ( Alh? Sun ) utaona ni rahisi kupata meza au kiti kwenye baa ya sushi.,"{restaurant miscellaneous, mahali, neutral}","{restaurant miscellaneous, Alh, positive}" +Ujirani Bora Standby .,"{restaurant general, Standby, positive}","{restaurant general, Bora, positive}" +Ningerudi huko kwa mapigo ya moyo.,"{restaurant general, null, positive}","{restaurant general, Ninger, positive}" +"*Ina bei nzuri* sana, esp kwa ubora wa chakula .","{food prices, chakula, positive}","{food quality, chakula, positive}" +"nyingi chakula, niamini.","{food style_options, chakula, positive}","{food quality, chakula, positive}" +Ni kamili doa kwa tarehe ya kimapenzi kwa 2 au mkutano wa siri !,"{ambience general, doa, positive};{restaurant miscellaneous, doa, positive}","{restaurant miscellaneous, null, positive}" +Pia kuwa nzuri margaritas !,"{drinks quality, margaritas, positive}","{drinks quality, margaritas, positive}" +Ni unpretentious na chini ya ardhi.,"{ambience general, null, positive}","{restaurant general, null, positive}" +Mahali hapa ni jambo bora zaidi kwa Mama zangu kupika.,"{food quality, null, positive}","{food quality, null, positive}" +"Mahali pazuri zaidi Mahali kwa ajili ya kifungua kinywa cha Jumapili cha burudani katikati ya boti , kisha tembeza kwenye Soko la Mkulima lililo karibu.","{restaurant miscellaneous, Mahali, positive}","{restaurant miscellaneous, Mahali, positive}" +"Ikiwa unaweza, njoo hapa mahali kwa mashua na uifanye jioni nzima.","{restaurant miscellaneous, mahali, positive}","{restaurant general, Iki, positive}" +kwa jangwa tulikuwa na mango ginger creme brulee ... oh la la yummy ! ! !,"{food quality, mango ginger creme brulee, positive}","{food quality, mango ginger creme brulee, positive}" +"Inastahili kusubiri, hasa kwa vile watakupigia simu wakati meza iko tayari.","{restaurant general, null, positive}","{service general, null, negative}" +Wana aina nyingi za samaki na hata wanaorodhesha ni bahari gani wanatoka; Atlantiki au Pasifiki.,"{food style_options, samaki, positive}","{food quality, wanaorodhesa, negative};{food quality, samaki, negative}" +"Naam, nadhani ni vigumu kuketi wakati mtu haonekani kwa wafanyakazi .","{service general, wafanyakazi, negative}","{service general, wafanyakazi, negative}" +Kubwa wazi na ya kirafiki mazingira .,"{ambience general, mazingira, positive}","{restaurant general, Kubwa, positive}" +Mazungumzo mafupi na meneja mwishoni mwa mlo yalikuwa ni masikitiko makubwa zaidi -- kusema tulikuwa `` tulipuuzwa `` itakuwa ni jambo la chini.,"{service general, meneja, negative}","{service general, meneja, negative};{food quality, mafupi, negative}" +"Ray's ni taasisi ya Seattle, lakini kutokana na uzuri wake Mionekano ya sauti, nilishuku kuwa sifa hizo zilitokana na mandhari kuliko chakula na huduma.","{location general, Mionekano ya sauti, positive}","{food quality, Mionekano ya sauti, positive};{restaurant general, Ray's, positive};{service general, huduma, positive}" +Niliapa kutorudi kwa joto bia na wastani mlo .,"{food quality, mlo, negative};{drinks quality, bia, negative}","{restaurant general, Nili, positive}" +"Ikiwa nje ni nzuri, omba meza kwenye balcony .","{ambience general, balcony, positive}","{ambience general, balcony, positive}" +Kubwa chakula na kushangaza anga !,"{ambience general, anga, positive};{food quality, chakula, positive}","{food quality, chakula, positive}" +Nilimaliza chakula na isiyo ya kawaida dessert ya bandari na kuonja chokoleti ... kitamu !,"{food quality, dessert ya bandari na kuonja chokoleti, positive}","{food quality, dessert, negative}" +Nilipata samakigamba na kivutio cha shrimp na ilikuwa sawa.,"{food quality, samakigamba na kivutio cha shrimp, neutral}","{food quality, samakamba, neutral}" +pizza ’ s ni ukoko nyembamba na menyu hutoa michanganyiko ya ubunifu sana na viongezeo .,"{food style_options, menyu, positive};{food style_options, pizza ’ s, positive}","{food quality, pizza, positive};{food style_options, pizza, positive}" +Ni pazuri mahali pa kufurahia chakula na kukutana na marafiki .,"{restaurant miscellaneous, mahali, positive};{food quality, chakula, positive}","{food quality, chakula, negative};{food quality, mahabali, negative}" +"huduma ilikuwa bora, kahawa ilikuwa nzuri hata kwa viwango vya nyota na chakula ilikuwa bora.","{service general, huduma, positive};{drinks quality, kahawa, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{ambience general, kahawa, positive};{food quality, huduma, positive}" +Hapa ndipo mahali pa kupumzika na kufurahia ubora bora chakula ambacho sekta inaweza kutoa .,"{ambience general, mahali, positive};{food quality, chakula, positive}","{food quality, chula, positive}" +Ningerudi kwa mvinyo uzoefu peke yangu.,"{drinks quality, mvinyo, positive}","{restaurant general, null, positive}" +Bora zaidi calamari huko Seattle !,"{food quality, calamari, positive}","{food quality, calamari, positive}" +Wasilisho la Sinzia ni bora na ni mojawapo ya maeneo ambayo unahisi ya kisasa zaidi kwa kuwa hapo tu; lakini rudisha tabaka na unayo IHOP ya bei iliyozidi na uso wa juu menyu .,"{ambience general, Sinzia, positive};{restaurant prices, Sinzia, negative};{food style_options, menyu, negative}","{food quality, menyu, negative};{food prices, menyu, negative};{ambience general, Sinzia, positive}" +"Nililalamika kwa meneja, lakini hata hakuomba msamaha.","{service general, meneja, negative}","{service general, null, negative}" +Zaidi ya kubwa tu mtazamo!,"{location general, mtazamo, positive}","{restaurant general, null, positive}" +anga ilikuwa sawa.,"{ambience general, anga, neutral}","{restaurant general, null, positive}" +Mara baada ya kukaa ilichukua kama dakika 30 kupata mlo.,"{service general, null, negative}","{service general, null, negative}" +"– Katika enzi ya upunguzaji wa gharama katika mikahawa, inapendeza kuona mahali ambapo pesa nyingi hubadilika, na hutoa ubora wa juu chakula na nzuri huduma , kipindi .","{service general, huduma, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{restaurant prices, null, positive};{service general, huduma, positive}" +Nilipenda anga sana lakini chakula haikuwa na thamani ya bei.,"{food prices, chakula, negative};{ambience general, anga, positive};{food quality, chakula, negative}","{restaurant prices, Nilipenda, positive}" +"Iko katika maduka karibu na Beverly Center, sio kubwa zaidi eneo, lakini chakula hunifanya nirudi kwa zaidi.","{location general, eneo, neutral};{food quality, chakula, positive}","{restaurant general, Iko, positive}" +"Katika mlo wangu ilinibidi kurudisha mayai yangu kwa ombi rahisi la kuvunja nira kabla ya kupika, na ingebidi niwarejeshe tena ikiwa singekataa mlo wote pamoja.","{food quality, mlo, negative};{food quality, mayai, negative}","{food quality, mlo, negative};{service general, null, negative}" +bendi ilikuwa nzuri sana na huduma ilikuwa makini.,"{ambience general, bendi, positive};{service general, huduma, positive}","{food quality, null, positive};{restaurant general, null, positive}" +"– Jinsi ya kuelezea bora sushi katika NYC : hmmmm , ladha , ajabu , ajabu , suculent , kamili , nah , yote yaliyo hapo juu .","{food quality, sushi, positive}","{food quality, sushi, positive}" +"– Schooner au Urembo wa Baadaye eneo kando ya bahari katika Long Beach na wastani chakula haulipii , kwa bahati mbaya , fidia kwa hali duni sana huduma kwa wateja .","{location general, eneo kando ya bahari katika Long Beach, positive};{service general, huduma kwa wateja, negative};{food quality, chakula, neutral}","{service general, huduma, negative};{food quality, chakula, negative};{location general, eneo kando ya bahari, positive}" +"Tuliketi mara moja, meza ilikuwa ya faragha na nzuri.","{ambience general, meza, positive}","{food quality, meza, positive}" +"nzuri kwa ajili ya , nzuri chakula – kwa kweli sijui mengi kuhusu Kijapani chakula hata kidogo .","{drinks quality, kwa ajili ya, positive};{food quality, chakula, positive}","{food quality, Kijapani chakula, positive};{restaurant general,, positive};{food quality, chakula, positive}" +Lete simu yako ya mkononi kwa sababu unaweza kusubiri ili kuingia kwenye mkahawa bora zaidi wa sushi duniani : SUSHI YA UTETE WA BLUU .,"{restaurant general, SUSHI YA UTETE WA BLUU, positive}","{restaurant general, SUSHI YA UTETE WA BLUU, positive}" +"Mwishowe hundi yetu ilifikia $ 27 kwa 4 ndogo pancakes, a kifungua kinywa burrito, na juisi ya machungwa na chai ya iced (nilikuwa na maji).","{drinks prices, juisi ya machungwa, negative};{food style_options, pancakes, negative};{food prices, kifungua kinywa burrito, negative};{drinks prices, chai ya iced, negative};{food prices, pancakes, negative}","{food quality, pancakes, negative};{food style_options, burrito, negative};{food prices, null, negative}" +Nzuri chakula!,"{food quality, chakula, positive}","{restaurant general, Nzuri, positive}" +"upishi hauko katika ulimwengu huu , na Supu ya mboga ya kuku ya Raouls inatikisa ulimwengu wangu! ! !","{food quality, Supu ya mboga ya kuku ya Raouls, positive};{food quality, upishi, positive}","{restaurant general, Raouls, positive}" +Ningeuliza tu cheki nilipoona kwamba; lakini menyu yao ilikuwa ya kipekee sana hivi kwamba niliendelea .,"{food style_options, menyu, positive}","{food quality, niliyochea, negative};{food quality, menyu, positive}" +Kubwa Kiamsha kinywa,"{food quality, Kiamsha kinywa, positive}","{restaurant general, Kubwa, positive}" +Seabass kwenye lobster risotto ilikuwa bora zaidi.,"{food quality, Seabass kwenye lobster risotto, positive}","{food quality, lobster risotto, positive};{food quality, Seabass, positive}" +- Mazingira anga ni mazuri kwa hafla yoyote maalum ambayo ungependa kusherehekea .,"{ambience general, anga, positive}","{restaurant general, null, positive}" +"Kubwa samaki wa msimu na vyakula vya baharini , na maridadi mpangilio wa maji .","{food quality, vyakula vya baharini, positive};{food quality, samaki wa msimu, positive};{ambience general, mpangilio wa maji, positive}","{food quality, samaki wa msimu, positive};{food quality, vyakula vya baharini, positive};{drinks style_options, maridadi mpangilio wa maji, positive}" +pizza’ s si kubwa na ganda ni nyembamba ... kumbuka hilo unapoagiza tena .,"{food style_options, pizza’ s, neutral};{food style_options, ganda, neutral}","{food style_options, pizza, positive};{food quality, pizza, positive}" +Jambo chanya pekee kuhusu Mioposto ni nzuri eneo .,"{location general, eneo, positive}","{restaurant general, Mioposto, positive}" +Ninashukuru utoaji wao pia.,"{service general, utoaji, positive}","{restaurant general, utoaji, positive}" +Kukata tamaa sana.,"{restaurant general, null, negative}","{restaurant general, Kukata, positive}" +pizza ni ladha na saladi ni nzuri sana.,"{food quality, pizza, positive};{food quality, saladi, positive}","{food quality, pizza, positive};{food quality, saladi, positive}" +Freshest sushi - Ninapenda hii mgahawa .,"{food quality, sushi, positive};{restaurant general, mgahawa, positive}","{food quality, sushi, positive}" +nyama ya nyama ilifanywa kwa kupenda kwangu kabisa ( nadra ya kati) na ilikuwa nzuri na ya juisi.,"{food quality, nyama ya nyama, positive}","{food quality, null, positive};{food style_options, null, positive}" +"Seriously, huwezi kwenda vibaya, kama ni unpretentious furaha ya ndani wewe kutafuta.","{ambience general, null, positive}","{restaurant general, null, positive}" +wamiliki ni furaha kubwa na uteuzi wa bia inafaa kukaa kwa .,"{service general, wamiliki, positive};{drinks style_options, uteuzi wa bia, positive}","{drinks quality, wamiliki, positive};{drinks style_options, wamiliki, positive}" +Kubwa rasimu na uteuzi wa chupa na pizza miamba .,"{food quality, pizza, positive};{drinks style_options, rasimu na uteuzi wa chupa, positive}","{food quality, pizza, negative};{food quality, chupa na miamba, negative}" +"Ninakuhakikishia hautakatishwa tamaa, pia kuna maegesho ya valet.","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, null, positive}" +Mlo wa usiku wa manane na wa kipekee chakula .,"{food quality, chakula, positive}","{food quality, chakula, positive}" +"sehemu ni kubwa ingawa , kwa hivyo usiagize sana .","{food style_options, sehemu, neutral}","{food style_options, sehemu, negative};{food quality, sehemu, negative}" +Hakika ina moja ya bora zaidi jukebox's ambayo nimeona kwa muda mrefu.,"{ambience general, jukebox's, positive}","{ambience general, jukebox's, positive}" +Huduma ilikuwa nzuri.,"{service general, Huduma, neutral}","{restaurant general, Huduma, positive}" +Kitamu kabisa.,"{food quality, null, positive}","{restaurant general, null, positive}" +"Lo, na vifaranga vya jibini ni vya kushangaza!","{food quality, vifaranga vya jibini, positive}","{restaurant general, null, positive}" +Kila mtu aliyeketi nyuma nje alikubali kwamba ilikuwa mbaya zaidi huduma ambayo tumewahi kupokea.,"{service general, huduma, negative}","{restaurant general, null, negative}" +Huenda nisiwe gwiji wa sushi lakini ninaweza kukuambia kwamba chakula hapa ni sawa na kwamba hakuna mengi zaidi yake.,"{food quality, chakula, negative}","{food quality, sushi, positive}" +"Bora chakula , nzuri mazingira, ghali kabisa","{restaurant prices, null, negative};{ambience general, mazingira, positive};{food quality, chakula, positive}","{restaurant general, Bora, positive}" +"Kuyeyusha kinywani mwako nigiri na sashmi , na kitamu sana rolls pia.","{food quality, rolls, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}","{food quality, kuyusha, positive};{food quality, rolls, positive}" +Hatimaye mlo ambao utakumbuka kwa muda mrefu!,"{food quality, mlo, positive}","{restaurant general, Hatim, positive}" +"Bora chakula , cha ajabu huduma","{service general, huduma, positive};{food quality, chakula, positive}","{restaurant general, Bora, positive}" +Ninapendekeza kwa usiku wakati unataka splurge! (ilikuwa ghali kidogo),"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, positive}" +"Ingawa mlo huu wa chakula ulikuwa mzuri kiasi chakula, wafanyakazi wa mgahawa walionekana kutojali kabisa uwepo wetu, na mtazamo huu ulionekana katika ukosefu wa huduma.","{service general, wafanyakazi wa mgahawa, negative};{food quality, chakula, positive}","{service general, wafanyakazi, negative};{food quality, chakula, negative};{service general, mtazamo, negative}" +Hakuna Kulinganisha,"{restaurant general, null, positive}","{restaurant general, Hakuna K, positive}" +"hivyo kuhusu kamba , walikuwa safi na walikuwa na crispiness kidogo kuhusu kugonga ... nzuri sana ... the walnuts zilikatwa vipande vidogo na crunchy sana na kitamu .","{food quality, kamba, positive};{food quality, kugonga, positive};{food quality, walnuts, positive}","{food quality, null, positive};{food quality, kamba, positive}" +Nina furaha sana kuwa na mkahawa wa Kiitaliano mzuri katika mtaa wangu .,"{restaurant general, mkahawa wa Kiitaliano, positive}","{food quality, furaha, positive}" +Tulisubiri kwa saa moja ili tuketi.,"{service general, null, negative}","{restaurant general, Tulisub, positive}" +"Tuliweka oda yetu na ingawa tuliagiza viambishi 4 , chakula hakikufika hadi dakika 45 baadaye ... NA KOZI YETU KUU .","{service general, null, negative}","{service general, null, negative};{food quality, viambishi, negative}" +Siwezi kusubiri kurudi tena wikendi hii ijayo!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Ikiwa una nia ya kuonja vizuri ( bila ladha ya samaki au harufu ), kubwa sehemu na ubunifu sahani za sushi hapa ndipo mahali pako ...","{food quality, null, positive};{food style_options, sahani za sushi, positive};{food style_options, sehemu, positive}","{food style_options, sahani za sushi, positive};{ambience general, sehemu, positive}" +Mahali pazuri mahali pa kuchukua wageni wa jiji wakati wowote wa mwaka .,"{restaurant general, mahali, positive}","{restaurant general, mahali, positive}" +"Nilionja vitu vyote vitatu juu yake sahani, na vilikuwa vyema sana.","{food quality, sahani, positive}","{food quality, null, positive}" +Nzuri kwa mlo wa usiku wa manane (kupanga dakika za mwisho) bila kutoridhishwa.,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}" +sijakatishwa tamaa na hapo chakula .,"{food quality, chakula, positive}","{food quality, tama, negative};{food quality, sijakat, negative}" +- Bora zaidi baa katika kijiji cha mashariki ...,"{restaurant general, baa, positive}","{restaurant general, null, positive}" +Ni pazuri mahali kwa watu kutazama.,"{restaurant miscellaneous, mahali, positive}","{ambience general, null, negative}" +"Nafasi ilikuwa ndogo , lakini chakula iliisaidia.","{restaurant miscellaneous, Nafasi, negative};{food quality, chakula, positive}","{food quality, chakula, positive};{food style_options, Nafasi, negative}" +kokwa hupikwa kwa siagi nyeusi ya mzeituni ambayo kwa kweli huzifanya za kipekee (bila kusahau kitamu).,"{food style_options, kokwa, positive};{food quality, kokwa, positive}","{food quality, hupikwa kwa siagi nyeusi, positive}" +Hapa mahali panapendeza na kustarehesha.,"{ambience general, mahali, positive}","{restaurant general, Hapa, positive}" +sio mcheshi hata kidogo.,"{food quality, null, positive}","{restaurant general, null, negative}" +Tulikuwa Seattle kwa usiku mmoja tu na nina furaha sana tulichagua Miale kwa chakula cha jioni !,"{restaurant general, Miale, positive}","{food quality, chakula cha jioni, positive}" +"– Sitasahau kamwe mambo ya ajabu mlo , huduma , na mandhari ninayopata katika mkahawa huu .","{food quality, mlo, positive};{service general, huduma, positive};{ambience general, mandhari, positive}","{food quality, mambo, positive};{food quality, huduma, positive}" +Inashangaza appetizer maalum ya Kihispania na kamili sanduku la sushi ( hiyo eel na avodcao -- um um um ) .,"{food quality, appetizer maalum ya Kihispania, positive};{food quality, eel na avodcao, positive};{food quality, sanduku la sushi, positive}","{food quality, appetizer maalum ya Kihispania, positive};{food style_options, sanduku la sushi, positive};{food quality, eel na avodcao, positive}" +"Mwishoni mwa wiki, unaweza kusubiri kwa saa kadhaa.","{service general, null, neutral}","{restaurant general, null, positive}" +- chakula haikuwa nzuri na wahudumu walikuwa wakorofi.,"{service general, wahudumu, negative};{food quality, chakula, negative}","{food quality, chakula, positive};{food quality, wahudumu, positive}" +"Nyama ya 9 oz ilifuata na ilipata ladha nzuri, angalau mwanzoni.","{food quality, 9 oz, positive}","{food quality, Nyama ya 9, positive}" +Nilipofika pale niliketi juu ya ngazi ambapo anga ilikuwa laini na huduma ilikuwa ya kutisha!,"{ambience general, anga, positive};{service general, huduma, negative}","{food quality, niliketi, negative};{ambience general, nili, negative}" +"orodha ya mvinyo ni ya ajabu na ya kina na tofauti, chakula yote ni ya ajabu na wafanyakazi wote walikuwa wazuri sana, wazuri katika kazi zao na watu wa utamaduni.","{service general, wafanyakazi, positive};{drinks style_options, orodha ya mvinyo, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{food style_options, orodha ya mvinyo, positive};{service general, wafanyakazi, positive};{food quality, orodha ya mvinyo, positive}" +- HAIWEZI KUPATA BORA YOYOTE! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Jumapili alasiri kuna bendi inayocheza na inafurahisha sana.,"{ambience general, bendi, positive}","{restaurant general, Jumapili, negative}" +"Kila kitu, na ninamaanisha kila kitu kwenye menyu kinaweza kuchaguliwa.","{food quality, menyu, positive}","{food quality, kila kitu, positive}" +"Ninajua watu wengi wana aina wanazopenda za pizza na pizza mahali , lakini Mioposto pizza haina ubora na ladha nzuri.","{food quality, pizza, negative}","{food quality, pizza, negative};{food quality, Ninajua, positive};{food quality, aina za pizza, positive}" +"Kuna moja tu mahali kwenye pwani ya mashariki ambayo ina yote, pamoja na mengi zaidi.","{restaurant general, mahali, positive}","{food style_options, null, positive}" +Daima mshindi.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Maoni ya hapo awali yalisema kuwa ya kirafiki ... nipe mapumziko na watoto wawili wachanga ambao ni wa miaka nyepesi.,"{restaurant miscellaneous, null, negative}","{restaurant general, Maoni, positive}" +pizza ’ s ni nyepesi na safi.,"{food quality, pizza ’ s, positive}","{food quality, pizza, positive}" +"Angalia sanaa kwenye kuta, yenye rangi nyingi!","{ambience general, sanaa kwenye kuta, positive}","{food quality, rangi, positive}" +Wastani chakula,"{food quality, chakula, neutral}","{restaurant general, Wastani, negative}" +Sitarudi tena.,"{restaurant general, null, negative}","{restaurant general, Sitar, positive}" +Tulikuwa na wakati mgumu sana kupata umakini wa mhudumu na hatimaye ilitubidi kuamka na kuingia ndani ili kuzungumza na meneja.,"{service general, mhudumu, negative}","{service general, mhudumu, negative}" +Haijasongamana sana na ni kubwa kila wakati huduma .,"{service general, huduma, positive};{restaurant miscellaneous, null, positive}","{restaurant general, Haijas, negative}" +uko na tarehe moto na ana hamu ya sushi ... basi hii inaweza kuwa mahali .,"{food quality, sushi, positive}","{food quality, sushi, negative};{restaurant general, null, positive}" +"– Siamini Murphy's amekuwepo kwa zaidi ya miaka 25, inashangaza .","{restaurant miscellaneous, Murphy's, positive}","{restaurant general, Siamini, positive}" +"Unaweza kuwa na shughuli nyingi siku za Ijumaa kwa ajili ya meza lakini ukishaketi , huduma ni bora sana unaweza kuingia na kutoka humo haraka.","{service general, huduma, positive}","{service general, huduma, positive}" +"Je! s inayotolewa na mchuzi wa nafaka ya pilipili au kupunguza divai nyekundu , ingawa zote mbili hazikuwa tofauti katika ladha .","{food quality, kupunguza divai nyekundu, neutral};{food quality, mchuzi wa nafaka ya pilipili, neutral}","{food quality, nafaka ya pilipili, negative};{food quality, divai nyekundu, negative}" +Wazuri zaidi wahudumu mjini .,"{service general, wahudumu, positive}","{restaurant general, Wazuri, positive}" +huduma ilikuwa ya adabu na makini.,"{service general, huduma, positive}","{food quality, huduma, positive}" +Wakati wa kuandika hii nilijaribu tu kutoa kiunga tena na bado haifanyi kazi.,"{restaurant miscellaneous, null, negative}","{restaurant general, null, negative}" +mahitaji yoyote zaidi ambayo tunaweza kuwa nayo hayangetimizwa kwa kuwa hakuna mtu aliyesimama karibu na meza.,"{service general, null, negative}","{service general, null, negative}" +"Nzuri Sushi, Bei ya Juu","{food quality, Sushi, positive};{food prices, Sushi, negative}","{food quality, Sushi, positive}" +Lakini seva walikuwa wasikivu sana na wa kirafiki sana.,"{service general, seva, positive}","{restaurant general, null, negative}" +"Nimekuwa kwa hii mahali , watu na ni BAD .","{restaurant general, mahali, negative}","{restaurant general, mahali, negative}" +nzuri huduma,"{service general, huduma, positive}","{restaurant general, huduma, positive}" +Ilikuwa ni kama kula kwenye mgahawa tofauti kabisa.,"{restaurant general, null, positive}","{restaurant general, Ilikuwa, positive}" +Gumba mbili juu!,"{food quality, null, positive}","{restaurant general, Gumba, positive}" +Fikiria mshangao wangu wa furaha baada ya kupata kwamba maoni ni jambo la tatu bora kuhusu Ray's !,"{restaurant general, Ray's, positive};{location general, maoni, positive}","{restaurant general, Ray's, positive}" +"Mikono chini, bora zaidi tuna ambayo nimewahi kupata .","{food quality, tuna, positive}","{restaurant general, Mikono, positive}" +"Ikiwa utamwona Danny Gans au kubaki tu kwenye Mirage, usikose hii.","{restaurant general, null, positive}","{restaurant general, Iki, negative}" +nzuri sehemu ya chakula cha mchana,"{restaurant general, sehemu ya chakula cha mchana, positive}","{restaurant general, nzuri, positive}" +Ninapenda kifungua kinywa hapa.,"{food quality, kifungua kinywa, positive}","{restaurant general, Ninapenda, positive}" +sashimi ilikuwa safi na laini zaidi ambayo nimewahi kuonja .,"{food quality, sashimi, positive}","{food quality, sashimi, positive}" +Hutakatishwa tamaa na wao menyu .,"{food style_options, menyu, positive}","{restaurant general, wao, positive}" +"Watu wengi huzungumza kuhusu great pizza na poor huduma , kwa hivyo haiwezi kuwa tu maoni ya wateja wachache ambao hawajaridhika .","{food quality, pizza, positive};{service general, huduma, negative}","{food quality, pizza, positive};{service general, huduma, negative}" +sitarudi nyuma.,"{restaurant general, null, negative}","{restaurant general, sitar, positive}" +yangu huduma ilikuwa ya nyota!,"{service general, huduma, positive}","{restaurant general, null, positive}" +kwa hakika tunarudi kwenye hii mgahawa .,"{restaurant general, mgahawa, positive}","{restaurant general, null, positive}" +Hakika atarudi.,"{restaurant general, null, positive}","{restaurant general, Hakoni, positive}" +Labda itakuwa nzuri kwa usiku mmoja mara moja katika mwezi wa buluu wakati wapishi wanaamua kutumia samaki ambayo ni sawa.,"{food quality, samaki, negative}","{restaurant general, Labda, positive}" +"– Nimehudhuria Fungua Sesame mara moja tu , lakini bado nina wasiwasi kutokana na uzoefu! !","{restaurant general, Fungua Sesame, positive}","{food quality, Fungu, positive};{food quality, Sesame, positive}" +pancakes hakika zilikuwa za uvumbuzi lakini $ 8.50 kwa 3 - 6 `` pancakes (moja yao ilikuwa kama 5 `` ) katika ndege ya pancake (sampuli ya 3 tofauti pancakes ) vizuri zaidi ya bei.,"{food prices, pancakes, negative};{food style_options, pancakes, positive}","{food quality, pancakes, positive};{food style_options, pancakes, positive};{food prices, pancakes, positive}" +"HATA hivyo, Jumapili moja alasiri mimi na mume wangu tulienda (ingawa kwa maandamano yangu makubwa) na tulishangaa sana.","{restaurant general, null, positive}","{restaurant general, HATA, negative}" +Naam thamani yake,"{restaurant general, null, positive}","{restaurant general, Naam, positive}" +Tahadhari - yake halisi chakula kwa watu wanaopenda bora.,"{food quality, chakula, positive}","{food quality, chakula, positive}" +Nina lakini hapa - kulikuwa na mhudumu wa bafuni kwenye choo ambayo ilikuwa isiyo ya kawaida .,"{restaurant miscellaneous, choo, negative}","{ambience general, null, negative}" +Mlo bora zaidi ni honwy walnuts -- bora zaidi .,"{food quality, honwy walnuts, positive}","{food quality, walnuts, positive}" +pancakes zinapaswa kuwa kubwa ( angalau 8 `` ) ili kuhalalisha gharama hata kwa matoleo ya kipekee .,"{food style_options, pancakes, negative}","{food style_options, pancakes, positive};{food prices, pancakes, positive}" +- Mara yangu ya kwanza kula kwenye mkahawa huu mgahawa ilikuwa na mwanangu na ilikuwa mbaya sana!,"{restaurant general, mgahawa, negative}","{restaurant general, mgahawa, negative}" +Bora kabisa,"{restaurant general, null, positive}","{restaurant general, Bora, positive}" +"Maegesho ni mazuri, yana sehemu yao wenyewe na unaweza kuegesha kwenye bustani iliyo karibu.","{restaurant miscellaneous, null, positive}","{restaurant general, Maegesho, positive};{location general, null, positive}" +Saladi ya Kaisari ilikuwa nzuri sana.,"{food quality, Saladi ya Kaisari, positive}","{restaurant general, Saladi ya Kaisari, positive}" +"– sielewi jinsi nilivyokuwa mgeni mahali hapa kwa muda mrefu ... the fajita salad , the rangi , the fajitas - EVERYTHING is delicious .","{food quality, rangi, positive};{food quality, fajitas, positive};{food quality, fajita salad, positive}","{food quality, fajita salad, positive};{food quality, fajitas, positive};{food quality, rangi, positive};{restaurant general, mahali, positive}" +bora chakula cha kichina nimeonja kwa muda mrefu,"{food quality, chakula cha kichina, positive}","{restaurant general, bora chakula, positive}" +Bei pia ilikuwa sawa.,"{restaurant prices, null, positive}","{restaurant general, pia, neutral}" +Kitamu...!,"{food quality, null, positive}","{restaurant general, Kit, positive}" +Tuliweka jina chini na ingawa kulikuwa na meza wazi tuliambiwa kwamba ingekuwa ni kusubiri kwa dakika 30.,"{service general, null, negative}","{service general, null, negative}" +"kahawa ni nzuri sana, pia.","{drinks quality, kahawa, positive}","{restaurant general, kahawa, positive}" +Tulingoja zaidi ya dakika 30 kwa vinywaji vyetu na zaidi ya saa 1 1/2 kwa chakula chetu.,"{service general, null, negative}","{restaurant prices, null, negative};{service general, null, negative}" +seva nyuma ya kaunta ni rafiki na msaada kila wakati.,"{service general, seva nyuma ya kaunta, positive}","{restaurant general, seva, positive}" +"Yetu mhudumu hakuwepo na baada ya chakula chetu hatimaye kufika zaidi ya saa moja baada ya kuagiza, hatukupewa maji au vyombo.","{service general, mhudumu, negative}","{service general, mhudumu, negative}" +- Hapa mahali pamekadiriwa kupita kiasi .,"{restaurant general, mahali, negative}","{restaurant general, Hapa, positive}" +Duni sana huduma kwa wateja .,"{service general, huduma kwa wateja, negative}","{restaurant general, Duni, positive}" +Hatuwezi kusema vya kutosha kuhusu gourmet yao ya kitamu pizza's !,"{food quality, pizza's, positive}","{food quality, pizza's, positive}" +"Zaidi ya hayo, wakati samaki ni mbichi bila shaka, rolls huwa na rangi isiyoeleweka.","{food quality, rolls, negative};{food quality, samaki, positive}","{food quality, rolls, negative};{food quality, samaki, negative}" +Kikwazo pekee ni msongamano kuketi na polepole huduma .,"{restaurant miscellaneous, kuketi, negative};{service general, huduma, negative}","{restaurant general, Kikwazo, negative}" +"Si maeneo mengi ya kuvuta sigara yaliyosalia New York, lakini nimepata sigara ninayopenda zaidi balcony jijini.","{restaurant miscellaneous, balcony, positive}","{ambience general, balcony, positive}" +Tulishiriki sahani ya familia na nilifurahia hasa chewa mweusi kwa ajili ya kasu .,"{food quality, chewa mweusi kwa ajili ya kasu, positive}","{food quality, sahani, negative};{restaurant miscellaneous, Tulish, negative}" +"Lakini nafasi ni ndogo na ya kupendeza, na huduma inasaidia.","{ambience general, nafasi, positive};{service general, huduma, positive}","{restaurant general, Lakini, positive};{ambience general, Lakini, positive}" +Ilikuwa na thamani ya kusubiri.,"{restaurant general, null, positive}","{restaurant general, I, positive}" +kitamu.,"{food quality, null, positive}","{restaurant general, kit, positive}" +Inaweza kufutwa,"{food quality, null, positive}","{restaurant general, null, positive}" +- Mediocre Huduma / Ubora,"{service general, Huduma, neutral}","{restaurant general, Huduma, negative}" +"– Hii ni mojawapo ya sehemu zangu kuu za chakula cha mchana , kubwa sehemu , haraka huduma na ya kushangaza NULL ! !","{drinks quality, margaritas, positive};{restaurant general, null, positive};{service general, huduma, positive};{food style_options, sehemu, positive}","{food quality, NULL, positive};{service general, NULL, positive};{food style_options, NULL, positive}" +Bora Keki za Kaa Mjini,"{food quality, Keki za Kaa, positive}","{restaurant general, Bora, positive}" +"Kila kitu ambacho nimekuwa nacho hapa ni kizuri , saladi za taco , burritos , enchiladas napenda hii mahali .","{food quality, null, positive};{restaurant general, mahali, positive};{food quality, burritos, positive};{food quality, saladi za taco, positive};{food quality, enchiladas, positive}","{food quality, null, positive};{food quality, burritos, positive};{food quality, enchiladas, positive};{food quality, saladi za taco, positive}" +"Kubwa Pizza , Duni Huduma","{service general, Huduma, negative};{food quality, Pizza, positive}","{food quality, Kubwa Pizza, positive};{restaurant general, Duni, positive}" +kifalme,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Rafiki yangu mkubwa alikuwa na kuku shawarma na BADO anasifu kuwa bora zaidi popote pale !,"{food quality, kuku shawarma, positive}","{food quality, shawarma, positive}" +Chintzy sehemu,"{food style_options, sehemu, negative}","{restaurant general, sehem, positive}" +Nzuri anakula.,"{food quality, anakula, positive}","{restaurant general, anak, negative}" +"Kwa kawaida, maeneo huuliza jinsi unavyotaka joto, lakini hawakutaka.","{service general, null, negative}","{food quality, joto, positive}" +"Nimekuwa nikipata wahudumu wa kusubiri kila wakati na , ukikaa kwenye baa , wapishi ni wa kirafiki sana .","{service general, wapishi, positive}","{restaurant general, null, positive}" +Hakuna kitu kwenye menyu ambacho ni cha chini ya kushangaza.,"{food quality, menyu, positive}","{restaurant general, Hakuna, negative}" +"Sherehe yangu ya watu wawili ilikuwa na shauku kubwa sana , na tuliruka kwenye Shilshole Sampler ... aina mbalimbali nzuri za samaki wakubwa white gulf prawns, tuna albacore kuvuta sigara, Ray's fantastic manila clams iliyokolea bizari, kokwa katika kitamu mavazi ya soya na rundo ndogo la kaa Dungeness juu ya mtukufu mchuzi wa siagi .","{food style_options, white gulf prawns, positive};{food quality, mavazi ya soya, positive};{food style_options, Shilshole Sampler, positive};{food quality, manila clams, positive};{food quality, mchuzi wa siagi, positive}","{food quality, Shilshole Sampler, positive};{food quality, manila clams, positive};{food quality, rundo ndogo la kaa Dungeness, positive};{food quality, white gulf prawns, positive};{food quality, tuna albacore, positive};{food quality, kokwa katika kitamu mavazi ya soya, positive};{food quality, shauku kubwa sana, positive}" +"Nilishtuka sana niliposoma hakiki mbaya - hii mahali ni ya ajabu; haijatuangusha kwa namna yoyote , na tumekula hapa zaidi ya mara 10 .","{restaurant general, mahali, positive}","{restaurant general, Nil, positive}" +"Shabiki wako sushi , unapenda cutly cut samaki , great kwa ajili ya , muuaji SOHO location , na bila shaka : Salmon , Tuna , Fluke , Yellow Tail , Cod , Mackeral , Jellyfish , Urchin ya Baharini, Shrimp, Kambati, Sea Bream, Trout, Samaki Maziwa, Bluu Fin Tuna , Eel , Crab , Sardini , Monk Fish , Roe , Scallop , Oysters , na aina ya Toro .","{food quality, sushi, positive};{food style_options, samaki, positive};{location general, SOHO location, positive};{food style_options, Toro, positive};{drinks quality, kwa ajili ya, positive}","{food quality, samaki, positive};{food quality, Urchin ya Baharini, positive};{food quality, Shabiki wako sushi, positive};{food quality, Kambati, positive};{food quality, Trout, positive};{food quality, Sardini, positive};{food quality, Salmon, positive};{food quality, Crab, positive};{food quality, Fluke, positive};{food quality, Eel, positive};{food quality, Yellow Tail, positive};{food quality, Tuna, positive};{food quality, Monk Fish, positive};{food quality," +huduma ni nzuri katika burudani hii mahali .,"{restaurant general, mahali, positive};{service general, huduma, positive}","{restaurant general, null, positive}" +"Pia, kulikuwa na moja tu duka la bafuni- labda inahitajika zaidi kwa umati mkubwa kama huo.","{restaurant miscellaneous, duka la bafuni, negative}","{restaurant general, Pia, positive}" +Tuliondoka bila kupata huduma .,"{service general, huduma, negative}","{restaurant general, Tulia, positive}" +Niliipenda.,"{restaurant general, null, positive}","{restaurant general, Nili, positive}" +– Ninapendekeza sana Mioposto .,"{restaurant general, Mioposto, positive}","{restaurant general, Ninap, negative}" +"chakula ni cha ajabu, halisi, kitamu na kina bei nafuu sana.","{food prices, chakula, positive};{food quality, chakula, positive}","{food quality, chakula, positive};{food quality, nafuu, positive};{food quality, kitamu, positive}" +Nimekula hapa mara tatu na nimepata ubora na aina ya samaki kuwa bora.,"{food style_options, samaki, positive};{food quality, samaki, positive}","{food quality, hapa, positive};{food quality, samaki, positive}" +"Lakini yeye ni rafiki sana na watu fulani, na kuifanya iwe ya kuudhi zaidi.","{service general, null, negative}","{restaurant general, Lakini, negative}" +menyu ya kawaida hapa iko juu kidogo ya wastani ambayo haifai mtazamo wa ucheshi unaopokea .,"{service general, null, negative};{food quality, menyu ya kawaida, neutral}","{restaurant general, null, negative}" +"Pia, hutumikia THE best hummus katika Amerika, pamoja na drizzle ya mafuta yenye harufu nzuri ya zeituni ( ambayo, naamini ni njia ya jadi )!","{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive};{food quality, zeituni, positive}" +nzuri bia,"{drinks quality, bia, positive}","{restaurant general, nzuri, positive}" +Dagaa Pamoja,"{food quality, Dagaa, positive}","{restaurant general, Dag Hammam, positive}" +"Inasikitisha kuwa hakuna watu wengi ambao hula mara kwa mara kwenye maeneo kama haya ambayo yanaonekana kuwa ghali kwa sababu wako hotelini ... lakini kwa hakika ni watu ambao hutaki kukosa, esp if your in downtown san jose.","{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant miscellaneous, null, negative}" +"Wanaitumikia kwenye glasi ndefu, nyembamba ya umbo la glasi ya saa ili kuficha ukweli kwamba unapata kidogo juisi kwa bei ya galoni nusu kwenye duka kubwa.","{drinks style_options, juisi, negative};{drinks prices, juisi, negative}","{food quality, glasi, negative};{food style_options, glasi, negative};{food prices, glasi, negative}" +"chakula kilikuwa sawa , lakini huduma ilikuwa duni sana hivi kwamba chakula kilikuwa baridi kununua wakati kila mtu katika karamu yangu alihudumiwa.","{service general, huduma, negative};{food quality, chakula, neutral}","{food quality, chakula, positive};{service general, huduma, negative}" +kubwa mlo - samaki kwenye sinia ya omikase ilikuwa imeharibika kabisa -- hakukuwa na ugumu wowote ambao wakati mwingine huambatana na sushi ya haki - samaki huyu alikuwa kamili! ! ! !,"{food quality, mlo, positive};{food quality, samaki kwenye sinia ya omikase, positive}","{food quality, samaki, positive};{food quality, sushi, negative}" +"Vinywaji ni ndogo, na ninahisi kama niko katika nchi ya Ulimwengu wa Tatu ninapoingia mlangoni.","{ambience general, null, positive};{drinks quality, Vinywaji, positive}","{food quality, Vinywaji, negative};{food style_options, Vinywaji, negative}" +Fungua na Utulie Mahali ukiwa na Bora Pizza na Kahawa,"{ambience general, Mahali, positive};{food quality, Pizza, positive};{drinks quality, Kahawa, positive}","{food quality, Pizza, positive}" +Green Tea creme brulee ni lazima!,"{food quality, Green Tea creme brulee, positive}","{food quality, creme brulee, positive}" +Nilipata nyumba mpya na nilihamia tu kwa kukodisha kwa muda mrefu.,"{restaurant general, null, positive}","{restaurant general, nili, negative}" +"Sio waongeaji zaidi, lakini kila nilipokuwa huko wamekuwa na shughuli nyingi, ambayo pengine ni sababu ya ukosefu wa mazungumzo.","{service general, null, neutral}","{restaurant miscellaneous, null, negative}" +"pizza yenyewe sio bora kabisa ambayo nimewahi kuwa nayo, lakini bado ni nzuri sana.","{food quality, pizza, positive}","{food quality, pizza, positive}" +"Tulikuwa na sawa mhudumu mara ya pili, kwa hivyo labda huduma ni ya doa na bahati yetu ni nzuri.","{service general, mhudumu, positive}","{food quality, null, positive};{food style_options, null, positive}" +– Hiyo ni kauli kubwa ukizingatia nimekuwa nikivuta mitego ya kaa na kutengeneza keki mimi mwenyewe tangu nikiwa na umri wa miaka saba - lakini jambo fulani kuhusu hawa mashetani huwa bora kila wakati.,"{food quality, keki, positive}","{food quality, mashetani, positive}" +Fabulous Chakula cha Kiitaliano !,"{food quality, Chakula cha Kiitaliano, positive}","{food quality, Chakula, positive}" +"Walakini , hii mahali ni gem , na sitaacha kurudi nyuma.","{restaurant general, mahali, positive}","{restaurant general, Walak, positive}" +"inakuwa na shughuli nyingi, kwa hivyo fika hapo mapema ili uweze kunyakua kiti, ikiwa itabidi usubiri, sio mbaya kwa sababu huduma ni ya haraka!","{service general, huduma, positive}","{service general, huduma, positive};{restaurant miscellaneous, null, positive}" +"Chakula cha jioni kilituchukua kama saa moja tu na bei zilikuwa sawa kwa kipande hicho, karibu $ 50 / pp baada ya kodi na kidokezo ( takriban wastani ) .","{restaurant prices, null, neutral}","{food quality, null, negative};{food prices, null, negative};{service general, null, negative}" +pete za vitunguu ni nzuri!,"{food quality, pete za vitunguu, positive}","{food quality, pete, positive}" +Ikiwa uko katika eneo hilo hupaswi kukatishwa tamaa.,"{restaurant general, null, positive}","{restaurant general, Iki, positive}" +- Wilaya kubwa ya kifedha doa ya Mexico .,"{restaurant general, doa ya Mexico, positive}","{food quality, null, positive}" +safu maalum ya nyumba ni nzuri sana.,"{food quality, safu maalum ya nyumba, positive}","{restaurant general, safu, positive}" +wahudumu wana uzoefu mkubwa na husaidia katika kuoanisha chaguo lako la kinywaji na ladha yako ya chakula au kinyume chake.,"{service general, wahudumu, positive}","{food quality, chaguo, positive};{food quality, ladha, positive}" +Ukamilifu.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Duni huduma kwa wateja / duni pizza .,"{food quality, pizza, negative};{service general, huduma kwa wateja, negative}","{food quality, pizza, positive}" +"Kwa jumla, ningerudi na kula kwenye mgahawa tena.","{restaurant general, mgahawa, positive}","{food quality, kula, positive};{restaurant general, ningeru, positive}" +Seva alitoa mapendekezo kadhaa kwa ajili ya ambayo yalikuwa mazuri sana .,"{drinks quality, kwa ajili ya, positive};{service general, Seva, positive}","{restaurant general, Seva, positive}" +Maoni yangu hasi tu ni kwamba ninatamani vipande vingekuwa vikubwa zaidi.,"{food style_options, vipande, negative}","{restaurant general, Maoni, negative}" +"Nilichukua avokado , ambayo iligeuka kuwa ya ajabu na iliyoandaliwa kikamilifu.","{food quality, avokado, positive}","{food quality, avokado, positive}" +Kinachoweza kuwa cha kufurahisha zaidi ni mtazamo mbaya zaidi kutoka kwa wamiliki wa shirika hili.,"{service general, wamiliki, negative}","{restaurant miscellaneous, shirika, negative}" +Kikwazo pekee ni kwamba hii mahali ni ghali sana na sehemu ziko upande mdogo .,"{restaurant prices, mahali, negative};{food style_options, sehemu, negative}","{restaurant general, Kikwazo, negative};{ambience general, sehemu, negative}" +"Ya kutisha huduma , chakula sawa , bei","{restaurant prices, null, negative};{service general, huduma, negative};{food quality, chakula, neutral}","{restaurant general, huduma, positive}" +Ingawa huduma inaweza kuboreshwa kwa kuzingatia pesa ulizoweka.,"{service general, huduma, negative}","{restaurant prices, Ingawa, positive}" +"Mara kwa mara unaona familia na marafiki wa Kihindi wakila huko, ambayo daima ni ishara nzuri.","{restaurant miscellaneous, null, positive}","{restaurant general, Mara, positive}" +"Ikiwa ninataka kusimama kwenye mstari Jumapili kwa saa moja ili kupata wastani chakula cha mchana , basi ningeweka Murphy juu ya orodha.","{service general, null, negative};{food quality, chakula cha mchana, neutral}","{restaurant general, Iki, negative}" +Kwa kiasi cha chakula tulichopata bei zilipaswa kuwa chini.,"{food prices, chakula, negative}","{restaurant general, null, negative}" +"Daima wana shughuli nyingi , lakini ni wazuri kukukalisha mara moja na wana haraka huduma .","{service general, huduma, positive};{service general, null, positive}","{service general, null, positive};{food quality, shughuli, positive}" +orodha ya mvinyo ni nzuri na chakula kinanikumbusha safari yangu ya hivi majuzi ya Italia.,"{drinks style_options, orodha ya mvinyo, positive}","{food quality, orodha ya mvinyo, positive};{food quality, chakula, positive}" +"chakula kilikuwa kizuri , margaritas pia lakini mhudumu alikuwa na shughuli nyingi sana kwa kuwa mzuri kwa karamu yake nyingine kubwa kuliko kutunza vizuri mimi na rafiki yangu.","{drinks quality, margaritas, positive};{service general, mhudumu, negative};{food quality, chakula, positive}","{service general, mhudumu, negative};{drinks quality, margaritas, positive};{food quality, chakula, positive}" +"Siwezi kusema mambo mazuri kuhusu hili mgahawa , na siwezi kusubiri ziara zangu kadhaa zinazofuata .","{restaurant general, mgahawa, positive}","{restaurant general, mgahawa, positive}" +Ipende kila wakati,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Sisi ni wenyeji , na tunapata hisia kuwa njia pekee ya kuishi mahali hapa kwa wastani chakula ni kwa sababu wateja wengi huenda ni watalii wa mara moja tu .","{food quality, chakula, negative}","{restaurant miscellaneous, Sisi, negative}" +Pia penda yao saladi ya caeser .,"{food quality, saladi ya caeser, positive}","{restaurant general, Pia, positive}" +Hakufanyi ujisikie umekaribishwa na kukuchukulia kama kero.,"{service general, null, negative}","{restaurant general, Hakufa, positive}" +Ni saizi inayofaa kwa menyu.,"{restaurant miscellaneous, null, positive}","{restaurant general, Ni, positive}" +"chakula ni nzuri sana , na wafanyakazi wanaosubiri wamekuwa wakamilifu kila wakati tumekuwa pale.","{service general, wafanyakazi wanaosubiri, positive};{food quality, chakula, positive}","{restaurant general, chakula, positive};{service general, wafanyakazi, positive}" +jangwa ulikuwa mwisho kamili wa karibu kamili chakula cha jioni .,"{food quality, jangwa, positive};{food quality, chakula cha jioni, positive}","{food quality, jangwa, positive}" +"Nimekuwa hapa, nilitumia tani nyingi za pesa kwenye chakula cha jioni maalum cha mpishi na ilikuwa ya kukatisha tamaa sana.","{food quality, chakula cha jioni maalum cha mpishi, negative};{food prices, chakula cha jioni maalum cha mpishi, negative}","{food quality, tani, negative};{food style_options, tani, negative}" +NILIPATA NYUMBA MPYA KWENYE AWANJA YA PILI! ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, NILI, positive}" +"– Ilibidi kusubiri dakika thelathini ili kuingia mlangoni siku ya Jumanne asubuhi, lakini ilikuwa ya thamani yake.","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive}" +"- Inasikitisha kuona mahali palipokuwa `` THE `` mahali pa kukutana na kula kwa Bfast au Chakula cha Mchana , sasa pawe mahali ambapo ni `` DONT BOTHER . ``","{restaurant general, mahali, negative}","{restaurant general, mahali, negative}" +"kuku wa ndimu walionja kama donati tamu zenye kunata na kamba za walnut , zile chache wanazokupa ... hazikuwa nzuri.","{food quality, kuku wa ndimu, negative};{food style_options, kamba za walnut, negative};{food quality, kamba za walnut, negative}","{food quality, null, negative};{food style_options, null, negative}" +"Ilikuwa ya kimapenzi - na hata ya kufurahisha hata kwa dada yangu, ilinikumbusha juu ya Italia, na ilikuwa na kazi ya sanaa na muziki ambayo iliendeleza hisia za kuwa katika jumba la Mediterrean.","{ambience general, muziki, positive};{ambience general, null, positive};{ambience general, kazi ya sanaa, positive}","{ambience general, null, positive}" +sushi ilikuwa bora na wafanyakazi wa kusubiri ilikuwa ya haraka.,"{food quality, sushi, positive};{service general, wafanyakazi wa kusubiri, positive}","{service general, wa, positive};{food quality, sushi, positive}" +"Kwa kweli, wengi wanataka kurudi mara ya pili wakati wa ziara yao.","{restaurant general, null, positive}","{restaurant general, null, positive}" +– Bora Mahali pa Meksiko kwa chakula cha mchana katika wilaya ya kifedha .,"{restaurant general, Mahali pa Meksiko, positive}","{food quality, Mahi, positive}" +Nimeipenda hii mahali!,"{restaurant general, mahali, positive}","{restaurant general, null, positive}" +anga ni nzuri.,"{ambience general, anga, positive}","{restaurant general, anga, positive}" +Kamili kwa siku ya baridi.,"{food quality, null, positive}","{restaurant general, null, positive}" diff --git a/experiments/Natural/preds_vi.csv b/experiments/Natural/preds_vi.csv new file mode 100644 index 0000000000000000000000000000000000000000..00a7743a97e014f86bdc752152dd231e19c6734a --- /dev/null +++ b/experiments/Natural/preds_vi.csv @@ -0,0 +1,545 @@ +input,gold,pred +Tôi đã đợi 10-15 phút để dịch vụ gọi một cốc bia và không bao giờ được phục vụ nữa.,"{service general, dịch vụ, negative}","{service general, dịch vụ, negative}" +không khí là một kỳ nghỉ yên bình và thư giãn giữa đám trẻ con chạy nhảy khắp Downtown Disney.,"{ambience general, không khí, positive}","{ambience general, không khí, positive}" +viên ngọc nhỏ ẩn giấu,"{restaurant general, null, positive}","{service general, viên, positive}" +Tôi đã đến đó cùng một người bạn từ xa đến... và cả hai chúng tôi đều rất ấn tượng!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Nó tuyệt vời sushi và thậm chí còn tuyệt hơn dịch vụ.,"{food quality, sushi, positive};{service general, dịch vụ, positive}","{food quality, sushi, positive};{service general, dịch vụ, positive}" +Tất cả các món ăn của họ thực đơn đều được ưa chuộng và họ còn phục vụ cả rượu mimosa.,"{food quality, thực đơn, positive}","{drinks style_options, rượu mimosa, positive};{food quality, thực đơn, positive}" +– ... và trải nghiệm mùa hè tuyệt vời nhất boong tàu -- họ thậm chí sẽ mang cho bạn một chiếc chăn nếu bạn bị lạnh trong thời tiết buổi tối ở Seattle.,"{ambience general, boong tàu, positive};{service general, null, positive}","{ambience general, boong tàu, positive}" +– Sau 12 năm ở Seattle Ray's được đánh giá là nơi chúng tôi luôn quay trở lại.,"{restaurant general, Ray's, positive}","{restaurant general, Ray's, positive}" +Bạn không thể sai ở đây được.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Tôi nghĩ có lẽ tôi đã thử từng món trong thực đơn của họ ít nhất một lần, tất cả đều tuyệt vời.","{food quality, thực đơn, positive}","{food quality, thực đơn, positive}" +– pepperoni cắt thật dày -- Ngon quá.,"{food style_options, pepperoni, positive}","{food quality, pepperoni, negative}" +Kem trà xanh creme brulee mỗi lần ăn lại càng ngon hơn.,"{food quality, Kem trà xanh creme brulee, positive}","{food quality, kem trà xanh creme brulee, positive}" +không quá tinh tế khi nghĩ rằng bạn cảm thấy không thoải mái và phải ăn mặc chỉnh tề.,"{ambience general, null, positive}","{ambience general, null, negative}" +Không khí thật tuyệt.,"{ambience general, Không khí, positive}","{ambience general, Không khí, positive}" +thật tuyệt vời ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +TRÁNH NƠI,"{restaurant general, NƠI, negative}","{restaurant general, null, negative}" +"Thành thật mà nói, tôi thích đồ đông lạnh hơn pizza.","{food quality, pizza, negative}","{food quality, pizza, negative}" +dịch vụ thật đặc biệt - đôi khi có cảm giác như chúng tôi được phục vụ bởi một đội quân bồi bàn thân thiện.,"{service general, bồi bàn, positive};{service general, dịch vụ, positive}","{service general, đội ngũ, positive};{service general, dịch vụ, positive}" +Và họ đóng gói mọi thứ cẩn thận để chúng không bị đổ.,"{service general, null, positive}","{food style_options, null, positive}" +RẤT TỐT !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +thức ăn là tội lỗi.,"{food quality, thức ăn, positive}","{food quality, thức ăn, negative}" +"Để bắt đầu, bạn sẽ phải trả khoảng 8-10 oz nước cam giá 3 đô la.","{drinks prices, nước cam, negative}","{food prices, nước cam, negative};{food quality, nước cam, negative}" +tốt lựa chọn rượu sake.,"{drinks style_options, lựa chọn rượu sake, positive}","{drinks quality, rượu, positive}" +"Mặc dù tôi không thể sống thiếu những người trẻ đã cùng chia sẻ buổi tối với chúng tôi, nhưng người phục vụ và đồ ăn tuyệt vời của chúng tôi đã khiến trải nghiệm trở nên rất tích cực.","{service general, người phục vụ, positive};{food quality, đồ ăn, positive};{restaurant miscellaneous, null, positive}","{service general, người trẻ, positive};{service general, người phục vụ, positive};{food quality, đồ ăn, positive}" +Thật là một phát hiện tuyệt vời!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +– Mioposto có thực đơn pizza rất sáng tạo và ngon miệng.,"{food quality, pizza, positive};{food style_options, pizza, positive}","{food style_options, pizza, positive};{food quality, pizza, positive}" +"Trong chuyến đi gần đây, người phục vụ của chúng tôi vô cùng coi thường, trong khi có tới ba nhân viên phục vụ tận tình cho một cặp cô gái Nhật Bản ngồi gần đó.","{service general, phục vụ tận, negative}","{service general, người phục vụ, negative}" +"Thông thường tôi sẽ không ăn hết súp lơ xanh khi gọi những món ăn này nhưng lần đầu tiên, món nào cũng hấp dẫn như món đầu tiên... sò điệp và tôm rất tươi và nấu rất ngon.","{food quality, tôm, positive};{food quality, súp lơ xanh, positive};{food quality, sò điệp, positive}","{food quality, sò điệp và tôm, positive};{food style_options, súp lơ xanh, neutral}" +Đây không phải là nơi rẻ nhất sushi nhưng lần nào cũng đáng giá.,"{food quality, sushi, positive};{food prices, sushi, neutral}","{food quality, sushi, positive};{food prices, sushi, negative}" +Bạn sẽ không bao giờ cảm thấy khó chịu hay no bụng sau khi ăn ở đó.,"{food quality, null, positive}","{restaurant general, null, positive}" +"Với tư cách là một thành viên trong nhóm nhỏ gồm bốn người, đồ ăn của chúng tôi được mang đến mà không có lời bình luận nào;","{service general, null, negative}","{food quality, đồ ăn, neutral}" +Tôi hy vọng một ngày nào đó Scooner hoặc Later sẽ trở lại như xưa.,"{restaurant general, Scooner hoặc Later, negative}","{restaurant general, Scooner, negative}" +"Đầu tiên, đồ ăn được mang ra nhanh và đầy đủ : ) Tôi thích điều đó... Tôi ghét sự khoa trương khi đồ ăn được mang ra liên tục.","{service general, null, positive}","{service general, null, positive}" +đồ ăn thật tuyệt vời!,"{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive}" +"Nếu có một hàng người xếp hàng vào mọi ngày trong tuần trong suốt thời gian một địa điểm mở cửa, thì bạn biết nơi đó rất tuyệt.","{restaurant general, địa điểm, positive}","{restaurant miscellaneous, địa điểm, positive}" +Điều ngạc nhiên thú vị nhất là hóa đơn không vượt quá mong đợi của tôi như thường lệ ở hầu hết các nơi khác.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}" +Tốt nhất là đồ ăn ngon và chắc chắn là đắt đỏ.,"{food quality, đồ ăn, positive};{food prices, đồ ăn, negative}","{food quality, đồ ăn, positive};{food prices, đồ ăn, negative}" +Khu vực sân ngoài trời có một menu được viết tắt.,"{food style_options, null, neutral}","{food style_options, menu, neutral}" +Món ăn ngon nhất Đồ ăn Ấn Độ ở L.A.,"{food quality, Đồ ăn Ấn Độ, positive}","{food quality, Đồ ăn Ấn Độ, positive}" +Nói thẳng vào vấn đề - thật tuyệt vời!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"đồ ăn không còn như xưa (thuốc đã giảm đáng kể) giá cả đã tăng lên, và dịch vụ là tệ nhất mà tôi từng trải nghiệm ở bất cứ đâu (kể cả lục địa Châu Âu).","{food quality, đồ ăn, negative};{service general, dịch vụ, negative};{food prices, đồ ăn, negative};{food style_options, thuốc, negative}","{food quality, đồ ăn, negative};{food prices, đồ ăn, negative};{service general, dịch vụ, negative};{restaurant prices, null, negative}" +Đồ ăn Lebanon ! Ngon quá !,"{food quality, Đồ ăn Lebanon, positive}","{food quality, Đồ Lebanon, positive}" +bông cải xanh rất tươi và ngon.,"{food quality, bông cải xanh, positive}","{food quality, bong xanh, positive}" +Và họ cung cấp số lượng tốt với mức giá đó.,"{food style_options, null, positive}","{food prices, null, positive};{food style_options, null, positive}" +Rất thất vọng,"{restaurant general, null, negative}","{service general, null, negative}" +Seattle TỐT NHẤT Người bán rượu,"{drinks style_options, Người bán rượu, positive}","{drinks quality, Người bán rượu, positive}" +– Tôi không thể nói đủ về điều này địa điểm.,"{restaurant general, địa điểm, positive}","{restaurant general, địa điểm, positive}" +– Tôi đã ăn ở đây hơn 8 năm nay và chưa bao giờ gặp phải một bữa ăn nào tệ bữa ăn.,"{food quality, bữa ăn, positive}","{food quality, bữa ăn, positive}" +Tôi về nhà và tìm kiếm lại trên mạng thì phát hiện có một đường link tặng quà nhưng không hoạt động nên đã gửi email cho nhà hàng về dịch vụ không tồn tại và đường link lừa đảo.,"{restaurant miscellaneous, nhà hàng, negative}","{service general, dịch vụ, negative}" +Những miếng cá lạ mắt cá cảnh trên chiếc đĩa 100 đô la cá và KHÔNG CÓ MỘT miếng nào có thể ăn được.,"{food style_options, cá cảnh, negative};{food quality, cá cảnh, negative};{food prices, cá, negative}","{food quality, cá, negative};{food prices, cá, negative}" +"Tôi đã có món ngon lamb korma, saag paneer, samosas, naan, v.v.","{food quality, naan, positive};{food quality, lamb korma, positive};{food quality, saag paneer, positive};{food quality, samosas, positive}","{food quality, lamb korma, positive};{food quality, naan, positive};{food quality, samosas, positive};{food quality, saag paneer, positive}" +Phục vụ rất tốt sushi.,"{food quality, sushi, positive}","{service general, Phục vụ, positive}" +"Như thường lệ, món omikase không làm chúng ta thất vọng về độ tươi ngon, mặc dù nó được đánh giá thấp về tính sáng tạo và lựa chọn.","{food style_options, omikase, negative};{food quality, omikase, positive}","{food style_options, omikase, negative};{food quality, omikase, positive}" +"Cơm quá khô, cá ngừ cũng không được tươi.","{food quality, cá ngừ, negative};{food quality, Cơm, negative}","{food quality, cá, negative};{food quality, Cơm, negative}" +trứng cua Benedict của họ gây nghiện.,"{food quality, trứng cua Benedict, positive}","{food quality, trứng cua, positive}" +Giữ chỗ cho những món ăn ngon món tráng miệng.,"{food quality, món tráng miệng, positive}","{food quality, món tráng, positive}" +Nhân viên phục vụ của chúng tôi rất chuyên nghiệp và thân thiện.,"{service general, Nhân viên phục vụ, positive}","{service general, nhân viên phục vụ, positive}" +Tôi đến đây theo lời giới thiệu của người khác và chắc chắn sẽ quay lại nhiều lần nữa.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +đồ ăn đều ngon nhưng lại quá nhạt.,"{food quality, đồ ăn, negative};{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive};{food style_options, đồ ăn, negative}" +– Tôi và chồng tôi thích ăn ở Mioposto Café.,"{restaurant general, Mioposto Café, positive}","{restaurant general, Mioposto, positive}" +– Đây là một trải nghiệm ẩm thực tuyệt vời.,"{restaurant general, null, positive}","{food quality, null, positive}" +nhân viên thực sự thân thiện.,"{service general, nhân viên, positive}","{service general, nhân viên, positive}" +Chúng tôi dễ dàng chi hơn 40 đô la cho một người (không bao gồm rượu) và vẫn còn đói.,"{restaurant prices, null, negative};{food style_options, null, negative}","{restaurant prices, null, negative};{restaurant general, null, negative}" +Nơi này có thể sánh ngang với những nơi ở Tokyo về độ tươi ngon.,"{food quality, null, positive}","{food quality, null, positive}" +Groovy âm nhạc làm cho bữa tối trở nên thoải mái.,"{ambience general, âm nhạc, positive}","{ambience general, âm nhạc, positive}" +"Sau khi một thành viên trong đoàn của chúng tôi bị một nữ phục vụ va chạm nhiều lần, một lời yêu cầu lịch sự rằng không nên va chạm đã khiến nữ phục vụ nổi cơn thịnh nộ.","{service general, nữ phục vụ, negative}","{service general, nữ phục vụ, negative}" +– Ray (thật đáng ngạc nhiên) có danh sách rượu vang TỐT NHẤT và đa dạng nhất thành phố .,"{drinks style_options, danh sách rượu vang, positive}","{drinks style_options, danh sách rượu vang, positive}" +"Tuy nhiên, có lẽ tôi sẽ không quay lại vì tôi không biết liệu có đáng hay không.","{restaurant general, null, negative}","{restaurant general, null, negative}" +khoai tây chiên và nước sốt salsa rất ngon và giá cả thì tuyệt vời.,"{restaurant prices, null, positive};{food quality, khoai tây chiên và nước sốt salsa, positive}","{food quality, khoai tây chiên và nước sốt salsa, positive};{food prices, khoai tây chiên và nước sốt salsa, positive}" +"người pha chế rượu thật tuyệt vời, thực tế và cực kỳ hiểu biết.","{service general, người pha chế rượu, positive}","{service general, người pha chế, positive}" +to dày pepperoni,"{food style_options, pepperoni, positive}","{food quality, pepperoni, positive}" +Thật không đáng để đi và tốn tiền ở đó chút nào! ! !,"{restaurant general, null, negative}","{restaurant prices, null, negative}" +Giá quá đắt một cách xúc phạm,"{restaurant prices, null, negative}","{restaurant prices, null, negative}" +Không gian trong nhà hiện đại.,"{ambience general, Không gian trong nhà, positive}","{ambience general, Không gian, positive}" +ĐỪNG ĐI!,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"Cho đến khi điều này xảy ra, lời khuyên của tôi là HÃY TRÁNH XA.","{restaurant general, null, negative}","{restaurant general, null, negative}" +À tôi quên nói là họ không có dịch vụ bánh mì.,"{service general, null, negative}","{service general, null, negative}" +Chúng không hề nhờn hay gì cả.,"{food quality, null, positive}","{food quality, null, negative}" +"âm nhạc thật tuyệt, không có đêm nào tốt hơn hay tệ hơn, nhân viên pha chế rót rượu rất hào phóng, và bầu không khí vui vẻ sẽ nâng cao tinh thần của bạn.","{ambience general, âm nhạc, positive};{drinks style_options, nhân viên pha chế, positive};{ambience general, bầu không khí vui vẻ, positive}","{ambience general, âm nhạc, positive};{ambience general, bầu không khí, positive};{service general, nhân viên pha chế, positive}" +"Tốt không khí, nhưng được đánh giá quá cao địa điểm.","{restaurant general, địa điểm, negative};{ambience general, không khí, positive}","{ambience general, không khí, positive};{restaurant general, địa điểm, positive}" +sushi ở đây ngon lắm!,"{food quality, sushi, positive}","{food quality, sushi, positive}" +– Tôi vô cùng vui mừng khi báo cáo rằng bữa tối của tôi tại Ray's Boathouse vào thứ sáu tuần trước đã hoàn toàn vượt quá mong đợi của tôi.,"{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}" +Bữa tối luôn tuyệt vời về mặt chất lượng thực phẩm.,"{food quality, Bữa tối, positive}","{food quality, thực phẩm, positive}" +Tất cả các ứng dụng của họ đều ngon.,"{food quality, ứng dụng, positive}","{food quality, ứng dụng, positive}" +Blue Ribbon xứng đáng với danh tiếng tuyệt vời của nó.,"{restaurant general, Blue Ribbon, positive}","{restaurant general, Blue Ribbon, positive}" +Tôi cảm thấy ngại ngùng và lần sau đã đi đến phòng vệ sinh của sòng bạc.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, sòng bạc, negative}" +– Tôi quyết định ăn ở Stack vì bữa tối được cố định giá trước buổi biểu diễn của họ.,"{food prices, bữa tối được cố định giá trước buổi biểu diễn, neutral}","{restaurant prices, Stack, positive}" +– Tôi đã đưa bố mẹ tôi đến đây để kỷ niệm ngày cưới của họ-thất vọng vô cùng!!! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Vô địch sushi!,"{food quality, sushi, positive}","{food quality, sushi, negative}" +"Để bắt đầu, người phục vụ đáng yêu của chúng tôi Brooke đã nhanh chóng có mặt để tiếp nhận đơn đặt hàng đồ uống của tôi.","{service general, Brooke, positive}","{service general, Brooke, positive}" +Mỗi lần ``0-sixtynine `` được gọi thì người pha chế sẽ mua đồ uống cho mọi người!,"{service general, người pha chế, positive}","{drinks quality, đồ uống, positive}" +"Niềm vui bất tận, tuyệt vời âm nhạc, tuyệt vời nhân viên ! ! !","{ambience general, âm nhạc, positive};{restaurant general, null, positive};{service general, nhân viên, positive}","{ambience general, âm nhạc, positive};{restaurant general, nhân viên, positive}" +Công bằng lựa chọn thực đơn.,"{food style_options, lựa chọn thực đơn, neutral}","{food style_options, thực đơn, positive}" +Hai đứa trẻ tinh nghịch ngồi gần chúng tôi trong phần đầu bữa tối... chúng được thay thế bằng một cô bé tuổi teen đáng yêu giả vờ nôn ọe mỗi khi có ai nhắc đến hải sản trên bàn của mình.,"{restaurant miscellaneous, null, negative}","{service general, đứa trẻ, negative}" +"Tôi đã từ chối vì trong quá trình cố gắng chế biến trứng, họ đã làm vỡ một thứ gì đó trong đĩa và tôi quá bực bội nên không thể tiếp tục.","{food quality, null, negative}","{service general, null, negative}" +đã ăn nhiều món nhưng món TUYỆT NHẤT là tôm hùm 3 cách.,"{food quality, tôm hùm 3 cách, positive}","{food quality, tôm hùm 3 cách, positive}" +"Món khai vị thì thú vị, nhưng món Creme Brulee thì rất hấp dẫn và ngon miệng.","{food quality, Creme Brulee, positive};{food quality, khai vị, positive}","{food quality, Creme Brulee, positive};{food quality, vị, positive}" +trang trí đẹp và độc đáo.,"{ambience general, trang trí, positive}","{ambience general, trang, positive}" +"Nó tươi mát, hấp dẫn, ngon miệng và thư giãn.","{food quality, null, positive};{ambience general, null, positive}","{food quality, null, positive};{ambience general, null, positive}" +Gây nghiện!,"{restaurant general, null, positive}","{food quality, null, positive}" +"Ngay cả đậu gà, loại mà tôi thường thấy quá khô, cũng ngon.","{food quality, đậu gà, positive}","{food quality, đậu gà, positive}" +địa điểm này thật tuyệt vời! !,"{restaurant general, địa điểm, positive}","{restaurant general, địa điểm, positive}" +"Đó là một lời khen ngợi rất lớn, đặc biệt là trong ngành kinh doanh nhà hàng đầy biến động,... đủ rồi!","{restaurant general, null, positive}","{restaurant general, null, positive}" +"Sau khi ngồi đó với chiếc ly rỗng trong hơn 20 phút, tôi rời đi.","{service general, null, negative}","{service general, null, negative}" +Đừng quên thử món chả hàu.,"{food quality, chả hàu, positive}","{food quality, chả hàu, positive}" +Tôi ngạc nhiên khi thấy nhà hàng này được phân loại là $$ thay vì $$.,"{restaurant prices, nhà hàng, negative}","{restaurant general, nhà hàng, negative}" +Nó khá ổn nhưng không có gì đặc biệt.,"{food quality, null, neutral}","{restaurant general, null, neutral}" +"Dịch vụ khá chậm, cô hầu bàn của chúng tôi mất rất nhiều thời gian mới đưa hóa đơn cho chúng tôi mặc dù lúc đó không quá bận rộn.","{service general, cô hầu bàn, negative};{service general, Dịch vụ, negative}","{service general, cô hầu bàn, negative};{service general, Dịch vụ, negative}" +"– Tuyệt vời đồ uống, thịt bò băm ngô, cà phê, bánh burrito B Fast, Không chứa gluten thực đơn.","{food style_options, thực đơn, positive};{drinks quality, đồ uống, positive};{drinks quality, cà phê, positive};{food quality, thịt bò băm ngô, positive};{food quality, bánh burrito B Fast, positive}","{food style_options, thực đơn, positive};{drinks quality, đồ uống, positive};{food quality, thịt bò băm ngô, positive};{food quality, bánh burrito, positive};{drinks quality, cà phê, positive}" +thực đơn bữa trưa là một món hời tuyệt vời!,"{food prices, thực đơn bữa trưa, positive}","{food quality, thực đơn bữa trưa, positive}" +"Phải mất rất lâu để xử lý đơn hàng của chúng tôi, việc đổ thêm nước thì quá khó khăn và lần duy nhất cô ấy nhanh chóng là khi chúng tôi yêu cầu tính hóa đơn khi chúng tôi có thể thu hút được sự chú ý của cô ấy.","{service general, null, negative}","{service general, null, negative}" +người phục vụ hơi không thân thiện và cảm giác nhà hàng thì đông đúc.,"{service general, người phục vụ, negative};{ambience general, cảm giác, negative}","{service general, người phục vụ, negative};{ambience general, nhà hàng, negative}" +– Gần đây tôi đã có niềm vui được dùng bữa tại nhà hàng tuyệt vời này nhà hàng trên phố thứ 2 và thật tuyệt vời khi chúng tôi có một buổi tối tuyệt vời.,"{restaurant general, nhà hàng, positive}","{restaurant general, nhà hàng, positive}" +"Món đặc sản ở đây là đồ ăn xa xỉ bánh kếp, nhưng tôi đã quay lại đây bốn lần và lần nào cũng bị ấn tượng mạnh.","{food quality, bánh kếp, positive}","{food quality, bánh kếp, positive}" +– Khá rẻ cho một bữa ăn Mexico và ở trung tâm thành phố.,"{restaurant prices, null, positive};{location general, null, positive}","{restaurant prices, null, positive};{food prices, bữa ăn Mexico, positive}" +"Món khai vị gồm hàu, tôm hùm, cua (kích thước nhỏ) là món chính hoàn hảo cho vợ tôi.","{food quality, appetizer of oysters , lobster , crab ( small size ), positive}","{food quality, món khai vị, positive}" +Tôi vừa phát hiện ra rằng bạn có thể có địa điểm cho riêng mình vào buổi tối và cuối tuần để tổ chức tiệc riêng - không thể chờ đợi để tổ chức sinh nhật tiếp theo của tôi ở đó.,"{restaurant miscellaneous, địa điểm, positive}","{restaurant miscellaneous, địa điểm, positive}" +"– Giống như hầu hết các nhà hàng ở Seattle, Mioposto dịch vụ tệ và đồ ăn thì đắt đỏ.","{service general, dịch vụ, negative};{food prices, đồ ăn, negative}","{food prices, đồ ăn, negative};{service general, dịch vụ, negative}" +"Tuy nhiên, bạn có thể dễ dàng nghe thấy anh ấy nói nên âm thanh đó rất dễ chịu và không quá chói tai.","{ambience general, null, positive}","{ambience general, âm thanh, positive}" +Hãy đến đó và tự mình xem nhé.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Đây là một địa điểm nhỏ tuyệt vời với nhiều tiềm năng trở thành một quán ăn địa phương nếu dịch vụ không quá vô cảm và mang tính công ty.,"{restaurant general, địa điểm, positive};{service general, dịch vụ, negative}","{restaurant miscellaneous, địa điểm, positive};{service general, dịch vụ, negative}" +"Bữa sáng muộn tại Murphy thật tuyệt vời, món đặc sản của tôi... trứng ốp la, đồ ăn luôn được chế biến tươi ngon.","{food quality, đồ ăn, positive};{food quality, Bữa sáng muộn, positive};{food quality, trứng ốp la, positive}","{food quality, đồ ăn, positive};{food quality, trứng ốp la, positive};{restaurant general, Murphy, positive}" +Mama Mia – Tôi sống ở khu phố này và cảm thấy may mắn khi được sống gần một tiệm pizza tuyệt vời như vậy.,"{restaurant general, tiệm pizza, positive}","{restaurant general, null, positive}" +– được cất giấu ở gần Trung tâm Beverly.,"{location general, null, neutral}","{location general, null, positive}" +nhân viên khá thân thiện.,"{service general, nhân viên, positive}","{service general, nhân viên, positive}" +Và dịch vụ thực sự rất tuyệt vời - thực sự thú vị.,"{service general, dịch vụ, positive}","{service general, dịch vụ, positive}" +Được thôi ... – Có lẽ tôi đã gặp phải một ngày tồi tệ của ai đó ...,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"Tôi đã thử Sứa, Cá thu ngựa, Cá ngừ vây xanh và Cuộn Sake Ikura cùng nhiều loại khác và tất cả đều ngon.","{food quality, Cuộn Sake Ikura, positive};{food quality, Sứa, positive};{food quality, Cá ngừ vây xanh, positive};{food quality, Cá thu ngựa, positive}","{food quality, Sứa, positive};{food quality, Cuộn Sake, positive};{food quality, Cá thu ngựa, positive};{food quality, Cá ngừ vây xanh, positive}" +BẠN CÓ THỂ NÓI GÌ NỮA TUYỆT VỜI CON NGƯỜI TUYỆT VỜI THỨC ĂN ÔI TRỜI,"{food quality, THỨC ĂN, positive};{service general, CON NGƯỜI, positive}","{restaurant general, null, positive}" +Luôn luôn tốt.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Sau đó, miệng tôi cảm thấy rất khô và có mùi đặc trưng của bột ngọt vẫn còn đọng lại trong cổ họng sau khi tôi rời khỏi nhà hàng.","{food quality, null, negative}","{food quality, null, negative}" +Ồ vâng ... góc nhìn cũng tốt.,"{location general, góc nhìn, positive}","{location general, góc, positive}" +"Người quản lý liên tục ngắt lời bằng câu hỏi `` Tôi còn có thể làm gì khác cho anh/chị không? ``, một bình luận kỳ lạ vì cô ấy hầu như không lắng nghe, chứ đừng nói đến việc phản hồi lại biểu hiện thất vọng của chúng tôi về trải nghiệm của mình.","{service general, null, negative}","{service general, người quản lý, negative}" +dịch vụ có mức độ từ trung bình đến khó chịu.,"{service general, dịch vụ, negative}","{service general, dịch vụ, negative}" +Tươi thành phần và cực kỳ ngon.,"{food quality, thành phần, positive};{food quality, null, positive}","{food quality, null, positive}" +không gian của nhà hàng rất đẹp và thích hợp cho việc ăn uống sang trọng.,"{ambience general, không gian, positive}","{ambience general, không gian, positive}" +Và tầng trên là nơi tuyệt vời để tụ tập.,"{ambience general, tầng trên, positive}","{restaurant general, tầng, positive}" +– Không tệ .,"{restaurant general, null, neutral}","{restaurant general, null, negative}" +Tôi đã có Đĩa Kafta và nó thật hoàn hảo.,"{food quality, Đĩa Kafta, positive}","{food quality, Đĩa, positive}" +– Nơi này nổi tiếng với món bữa sáng .,"{food quality, bữa sáng, positive}","{restaurant miscellaneous, Nơi, positive}" +"Phải đợi 35 phút mới có được một bàn cho 8 người, khá ổn cho một đám đông như vậy.","{service general, null, neutral}","{service general, null, negative}" +Toàn bộ nhân viên đều vô cùng nhiệt tình và đáp ứng mọi nhu cầu của tôi.,"{service general, nhân viên, positive}","{service general, nhân viên, positive}" +"Có một cảm giác thực sự tuyệt vời không khí về nơi này... tốt âm nhạc, bầu không khí và trông vui vẻ con người.","{ambience general, âm nhạc, positive};{ambience general, bầu không khí, positive};{restaurant miscellaneous, con người, positive};{ambience general, không khí, positive}","{ambience general, không khí, positive};{ambience general, âm nhạc, positive}" +Hãy thử món Lựa chọn của đầu bếp cho món sushi vì món cá đuôi vàng hun khói rất ngon và món cuộn cũng rất ngon.,"{food quality, cuộn, positive};{food quality, cá đuôi vàng hun khói, positive};{food quality, Lựa chọn của đầu bếp cho món sushi, positive}","{food quality, Lựa chọn của đầu bếp, positive};{food quality, món cuộn, positive};{food quality, cá đuôi vàng hun khói, positive}" +"sushi tươi ngon tuyệt vời? Bạn sẽ nghĩ rằng đại dương nằm ngay trong sân sau nhà mình, không đùa đâu!","{food quality, sushi, positive}","{food quality, sushi, positive}" +"đồ ăn ổn, có một số món ngon hơn bình thường một chút nước sốt salsa.","{food quality, đồ ăn, positive};{food quality, nước sốt salsa, positive}","{food quality, đồ ăn, neutral};{food quality, nước sốt salsa, positive}" +"Đối với những người sành ăn sushi và những người đã nếm thử những món sushi ngon nhất ở New York, cá là tươi nhất và dịch vụ là tuyệt vời.","{food quality, cá, positive};{service general, dịch vụ, positive}","{food quality, sushi, positive};{service general, dịch vụ, positive}" +Cũ đáng tin cậy,"{restaurant general, null, positive}","{restaurant general, Cũ, positive}" +Một trong những nơi tốt nhất Quán Sushi trong thị trấn.,"{restaurant general, Quán Sushi, positive}","{restaurant general, Quán Sushi, positive}" +Về đồ ăn thì ổn nhưng hơi đắt so với những gì bạn nhận được vì nhà hàng không phải là nơi sang trọng.,"{restaurant prices, nhà hàng, negative};{food quality, Về đồ ăn, neutral};{ambience general, nhà hàng, neutral}","{food quality, đồ ăn, positive};{food prices, đồ ăn, negative};{ambience general, nhà hàng, negative}" +"– Thích pizza của họ, đặc biệt là món nấm pizza.","{food quality, pizza, positive};{food quality, mushroom pizza, positive}","{food quality, pizza, positive};{food quality, nấm pizza, positive}" +Chúng được đựng trong hộp đựng tiện lợi và kèm theo một ít kem phủ tự làm; rất nhẹ và không quá ngọt.,"{food quality, null, positive}","{food quality, null, positive};{food style_options, null, positive}" +Thưởng thức đồ ăn,"{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive}" +Tôi đã đến nhà hàng này hơn chục lần mà chưa có phàn nàn nào cho đến nay.,"{restaurant general, null, positive}","{restaurant general, nhà hàng, positive}" +"Tuy nhiên, tôi thích đặt hàng và đến lấy hơn vì tôi không thích người phục vụ, đặc biệt là một phụ nữ trẻ.","{service general, người phục vụ, negative};{service general, phụ nữ trẻ, negative}","{service general, phụ nữ, negative}" +phát hiện tuyệt vời,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Nó không phải là món hải sản tươi nhất hải sản nhưng hương vị và cách trình bày thì ổn.,"{food style_options, hải sản, neutral};{food quality, hải sản, neutral}","{food quality, hải sản, neutral};{food style_options, cách trình bày, positive};{food quality, hương vị, positive}" +"Tuy nhiên, giá trị và dịch vụ đều rất thiếu sót.","{restaurant prices, null, negative};{service general, dịch vụ, negative}","{service general, dịch vụ, negative};{restaurant prices, null, negative}" +"Ở Grammercy/Union Square/East Village, đây là nơi hàng xóm và cũng là nơi tôi yêu thích nhất địa điểm.","{restaurant general, địa điểm, positive}","{restaurant general, địa điểm, positive}" +"mặt khoai tây ngon tuyệt, cũng như labne (sữa chua nhúng).","{food quality, mặt khoai tây, positive};{food quality, labne (sữa chua nhúng, positive}","{food quality, labne (sữa chua, positive};{food quality, mặt khoai tây, positive}" +TUYỆT VỜI .,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Thật là một món ăn ngon và giòn tan!,"{food quality, null, positive}","{food quality, null, positive}" +"Tuyệt vời đồ ăn, ngon hơn Margaritas!","{drinks quality, Margaritas, positive};{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive};{drinks quality, Margaritas, positive}" +dịch vụ thực sự chu đáo và quyến rũ.,"{service general, dịch vụ, positive}","{service general, dịch vụ, positive}" +Quan trọng nhất là chúng tôi rất hào hứng với đồ ăn sau khi nhìn thấy thực đơn rất sáng tạo .,"{food style_options, null, positive}","{food style_options, đồ ăn, positive}" +Một chỗ ấm cúng chỗ cho 2 người,"{ambience general, chỗ, positive}","{ambience general, chỗ, positive}" +Điều tuyệt vời nhất là giá cả cũng khá hợp lý.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}" +"Cô ấy hứa sẽ nói chuyện với cô hầu bàn đã bỏ đi trong cơn giận dữ, nhưng chúng tôi khó có thể tin vào lời hứa của cô ấy một cách nghiêm túc, vì cô ấy thậm chí còn không thèm hỏi tên cô hầu bàn.","{service general, null, negative}","{service general, null, negative}" +chana masala (đậu gà) cũng rất tuyệt.,"{food quality, chana masala (đậu gà, positive}","{food quality, chana masala (gà), positive}" +"cơ sở này thực sự đã suy giảm đáng kể sau (và đây là câu chuyện thường xuyên xảy ra) khi phát sóng chương trình FOOD TELEVISIONS `` DINERS , DRIVE-INS , AND DIVES `` do Guy Fieri dẫn chương trình, trong đó có Schooner or Later.","{restaurant general, cơ sở, negative}","{restaurant general, Schooner or Later, negative}" +"Tôi thích Cua Dungeness và tại Ray, bạn có thể thưởng thức chúng theo khoảng 6 cách khác nhau!","{food style_options, Cua Dungeness, positive}","{food quality, Cua Dungeness, positive};{food style_options, Cua Dungeness, positive}" +Đồ ăn ngon và hấp dẫn.,"{food quality, Đồ ăn, positive}","{food quality, Đồ, positive}" +Thật là tuyệt vời.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Đây là nơi tuyệt vời để thưởng thức bữa ăn ngon miệng.,"{food quality, bữa ăn, positive}","{food quality, bữa ăn, positive}" +"Thêm vào đó, tôi bị dị ứng với gạo, và nhân viên phục vụ cực kỳ chu đáo -- thậm chí không hề chớp mắt!","{service general, nhân viên phục vụ, positive}","{service general, nhân viên phục vụ, positive};{food quality, gạo, negative}" +– Tôi rất thất vọng về đồ ăn ở Pagoda.,"{food quality, đồ ăn, negative}","{food quality, đồ, negative}" +Giá quá cao,"{restaurant prices, null, negative}","{restaurant prices, null, negative}" +Thật đáng buồn cho một trong những nơi từng được coi là nơi có ẩm thực tuyệt vời nhất mà bạn từng đến.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"Khi bạn vào bên trong, trải nghiệm thực sự mới bắt đầu.","{restaurant general, null, positive}","{ambience general, null, positive}" +và người phục vụ gợi ý một loại rượu sake hoàn hảo sake! !,"{drinks quality, sake, positive}","{drinks quality, sake, positive}" +chủ sở hữu có thái độ hung hăng với khách hàng có khiếu nại.,"{service general, chủ sở hữu, negative}","{service general, chủ hữu, negative}" +"Mọi thứ bạn muốn và hơn thế nữa, rất tươi mới.","{food quality, null, positive};{food style_options, null, positive}","{food quality, null, positive}" +Bạn tôi rất thích món Cá hồi vua Alaska nướng cùng với khoai tây Washington Russet nghiền nhuyễn và đậu xanh giòn.,"{food quality, Cá hồi vua Alaska nướng, positive};{food quality, đậu xanh, positive};{food quality, khoai tây Washington Russet nghiền nhuyễn, positive}","{food quality, Cá hồi vua Alaska nướng, positive};{food quality, khoai tây Washington Russet nghiền nhuyễn, positive};{food quality, đậu xanh giòn, positive}" +"đồ ăn rất ngon, thịt thăn bò có lẽ là món ngon nhất mà tôi từng thử.","{food quality, đồ ăn, positive};{food quality, thịt thăn bò, positive}","{food quality, đồ ăn, positive};{food quality, thịt thăn bò, positive}" +"– Nhà hàng Mercedes rất ngon, dịch vụ thì tuyệt vời không thể phủ nhận!","{food quality, null, positive};{service general, dịch vụ, positive}","{food quality, Nhà hàng Mercedes, positive};{service general, dịch vụ, positive}" +"Tôi thực sự muốn giới thiệu các món ăn đa dạng của họ saag, paneer và korma.","{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}","{food quality, saag, positive};{food quality, paneer, positive};{food quality, korma, positive}" +đồ ăn rất tuyệt và họ pha chế rất ngon bloody mary.,"{drinks quality, bloody mary, positive};{food quality, đồ ăn, positive}","{drinks quality, bloody mary, positive};{food quality, đồ ăn, positive}" +Ngon đồ ăn nhưng không có gia vị!,"{food quality, đồ ăn, negative};{food quality, đồ ăn, positive}","{food quality, đồ ăn, negative}" +Một điểm cộng nữa là cảm giác mở của nhà hàng với những bức tường kính ở mọi phía.,"{ambience general, cảm giác, positive}","{ambience general, nhà hàng, positive}" +Ngon quá!,"{food quality, null, positive}","{restaurant general, Ngon, positive}" +"Bản thân phòng tắm rất nhỏ với hai nhà vệ sinh và chỉ có một bồn rửa, cô gái ở lại đó và chỉ dùng khăn giấy từ máy phát.","{restaurant miscellaneous, phòng tắm, negative}","{ambience general, phòng tắm, negative}" +Thích enchiladas và súp gà - và đừng quên xem món đặc biệt của họ.,"{food quality, enchiladas, positive};{food quality, món đặc biệt, positive};{food quality, súp gà, positive}","{food quality, enchiladas, positive};{food quality, súp gà, positive};{food quality, món đặc biệt, positive}" +đồ ăn thực sự không thể nào quên!,"{food quality, đồ ăn, positive}","{food quality, đồ, positive}" +Ban quản lý thực sự nên chú ý và đào tạo nhân viên phục vụ và dạy họ một số phép lịch sự.,"{service general, nhân viên phục vụ, negative}","{service general, Ban quản lý, positive};{service general, nhân viên, positive}" +nhân viên thân thiện và trang trí đạo đức và nhiều màu sắc.,"{ambience general, trang trí, positive};{service general, nhân viên, positive}","{ambience general, trang trí, positive};{service general, nhân viên, positive}" +Món ngon nhất Chuwam Mushi mà tôi từng ăn.,"{food quality, Chuwam Mushi, positive}","{food quality, Mushi, positive}" +"Khẩu phần vừa đủ với tôi, nhưng có thể không đủ với người ăn nhiều.","{food style_options, Khẩu phần, neutral}","{food style_options, null, negative};{food quality, null, positive}" +Hãy thử Pizza Ensalata!,"{food quality, Pizza Ensalata, positive}","{food quality, Pizza, positive}" +Tôi vẫn muốn giới thiệu địa điểm này nơi.,"{restaurant general, nơi, positive}","{restaurant general, địa điểm, positive}" +"– sushi ở đây thực sự rất ngon, nhưng với giá 5 đô la một miếng, thì hoặc là các lát cá nên to hơn, hoặc không nên giả vờ rằng đây là một nhà hàng có giá cả phải chăng (ngay cả đối với NYC).","{food prices, sushi, negative};{restaurant prices, nhà hàng, negative};{food style_options, sushi, negative};{food quality, sushi, positive}","{food quality, sushi, positive};{food prices, sushi, negative};{food style_options, sushi, negative}" +Bạn chắc chắn sẽ có một khoảng thời gian rất thú vị.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Chúng tôi đã quay lại và cũng có được trải nghiệm tuyệt vời, nếm thử nhiều đĩa nhỏ hơn và nhiều loại bia lạnh và ngon.","{restaurant general, null, positive};{drinks quality, lạnh và ngon, positive}","{food quality, đĩa nhỏ, positive};{drinks quality, bia, positive}" +Tốt nhất Sushi trong thị trấn.,"{food quality, Sushi, positive}","{food quality, Sushi, positive}" +nhân viên rất tốt bụng và lịch sự và rõ ràng là người Trung Quốc.,"{service general, nhân viên, positive}","{service general, nhân viên, positive}" +"Chúng tôi đã gọi một số món ăn nhỏ, và hành tây xắt sợi, pizza phô mai dê, măng tây nướng và phô mai brie chiên với trái cây đều rất ngon.","{food quality, hành tây xắt sợi, positive};{food quality, pizza phô mai dê, positive};{food quality, măng tây nướng, positive};{food quality, phô mai brie chiên với trái cây, positive}","{food quality, hành tây xắt sợi, positive};{food quality, pizza phô mai dê, positive};{food quality, măng tây nướng, positive};{food quality, phô mai brie chiên với trái cây, positive}" +Làm tốt lắm!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Tuy nhiên, có một điều sau đó tôi nhận ra là nhà hàng đã sử dụng bột ngọt hoặc chất làm mềm thịt trên bít tết.","{food quality, bít tết, negative}","{food quality, bít tết, negative}" +Tuyệt vời lựa chọn rượu sake.,"{drinks style_options, lựa chọn rượu sake, positive}","{drinks quality, rượu, positive}" +Xin khen ngợi những anh chàng này.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Trừ khi bạn chỉ ghé vào để uống vài ly thì tôi khuyên bạn không nên đến đây.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Tuyệt vời chai rượu.,"{drinks quality, chai rượu, positive}","{drinks quality, chai, positive}" +đĩa mở mè kết hợp là một món hời cho đống thức ăn được cung cấp.,"{food style_options, đĩa mở mè kết hợp, positive};{food prices, đĩa mở mè kết hợp, positive}","{food quality, đĩa, positive}" +ĐƯỢC ĐÁNH GIÁ QUÁ CAO ! ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Đáng để chờ đợi,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Không còn gì tuyệt vời hơn thế nữa.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +món ngon nhất tôm sú mật ong mà chúng tôi từng nếm thử.,"{food quality, tôm sú mật ong, positive}","{food quality, tôm sú mịn, positive}" +Chúng đã được giới thiệu trên kênh Food Network và chúng xứng đáng được như vậy.,"{restaurant miscellaneous, null, positive}","{food quality, null, positive}" +Tôi thích sự ấm áp và thoải mái môi trường.,"{ambience general, môi trường, positive}","{ambience general, môi trường, positive}" +Thái độ khinh khỉnh,"{service general, null, negative}","{service general, Thái, positive}" +"bầu không khí đầy khát vọng, và trang trí thì lễ hội và tuyệt vời ...","{ambience general, trang trí, positive};{ambience general, bầu không khí, positive}","{ambience general, trang trí, positive};{ambience general, bầu không khí, positive}" +"món bánh mì đặc biệt của họ rất ấn tượng, mặc dù tôi không nhớ chúng tôi đã ăn những món gì.","{food quality, món bánh mì đặc biệt, positive}","{food quality, bánh mì đặc biệt, positive}" +– Tôi thích bánh ravioli bí ngô và bánh gnocchi phô mai dê (5 cái lớn trên một đĩa thay vì khoảng 20 cái bánh gnocchi nhỏ) và chị gái tôi cũng thích thịt thăn bò phủ rau bina và khoai tây nghiền.,"{food quality, bánh ravioli bí ngô, positive};{food quality, thịt thăn bò phủ rau bina và khoai tây nghiền, positive};{food quality, bánh gnocchi phô mai dê, positive};{food style_options, bánh gnocchi phô mai dê, positive}","{food quality, bánh ravioli bí ngô, positive};{food quality, gnocchi phô mai dê, positive};{food style_options, gnocchi phô mai dê, positive};{food quality, thịt thăn bò phủ rau bina, positive};{food quality, bánh gnocchi phô mai dê, positive}" +Không phải là phần lớn nhất phần nhưng cũng đủ dùng.,"{food style_options, phần, neutral}","{food style_options, null, neutral};{food quality, null, positive}" +"Hãy đi cùng một vài người bạn, đợi khoảng nửa giờ với một tách cà phê và thưởng thức nhiều hơn mức trung bình bữa sáng.","{restaurant general, null, positive};{food quality, bữa sáng, positive}","{restaurant general, null, positive}" +tuyệt vời dịch vụ .,"{service general, dịch vụ, positive}","{service general, dịch vụ, positive}" +"Sau đó, chúng tôi bị tính tiền cho loại rượu sake đắt nhất của họ (20 đô la trở lên cho mỗi suất) trong khi thực tế chúng tôi đã uống loại rượu sake có giá chưa đến một nửa số tiền đó.","{service general, null, negative}","{drinks prices, loại rượu sake, negative};{drinks quality, loại rượu sake, negative}" +Thơm ngon,"{food quality, null, positive}","{food quality, null, positive}" +cà ri gà và gà tikka masala là những món thịt tôi thích nhất.,"{food quality, cà ri gà, positive};{food quality, gà tikka masala, positive}","{food quality, cà ri gà, positive};{food quality, gà tikka masala, positive}" +"tốt nhất nhà hàng trên thế giới, tuyệt vời trang trí, tuyệt vời dịch vụ khách hàng, thân thiện người quản lý","{ambience general, trang trí, positive};{restaurant general, nhà hàng, positive};{service general, người quản lý, positive};{service general, dịch vụ khách hàng, positive}","{restaurant general, nhà hàng, positive};{service general, dịch vụ khách hàng, positive};{ambience general, trang trí, positive};{service general, người quản lý, positive}" +Đồ uống ngon.,"{drinks quality, Đồ uống, positive}","{drinks quality, Đồ, positive}" +"Việc trình bày đồ ăn là một điểm cộng nữa, trông nó cũng tuyệt vời như hương vị của nó vậy!","{food style_options, đồ ăn, positive};{food quality, đồ ăn, positive}","{food style_options, đồ ăn, positive}" +"Ngay cả khi đó, đơn hàng vẫn chưa đúng và chúng tôi vẫn phải chờ thêm một vài món nữa.","{service general, null, negative}","{service general, null, negative}" +– Có lần chúng tôi bị đối xử rất thô lỗ ở đây khi ăn sáng.,"{service general, null, negative}","{service general, null, negative}" +"Tuyệt vời đồ ăn, ngoạn mục vị trí và thân thiện dịch vụ khiến chúng tôi quay lại năm này qua năm khác.","{food quality, đồ ăn, positive};{location general, vị trí, positive};{service general, dịch vụ, positive}","{location general, vị trí, positive};{food quality, đồ ăn, positive};{service general, dịch vụ, positive}" +Ồ ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +– Tiết kiệm thời gian và KHÔNG ghé thăm.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Đồ ăn ngon và rẻ.,"{food quality, Đồ ăn, positive};{food prices, Đồ ăn, positive}","{food quality, Đồ, positive};{food prices, Đồ, positive}" +Ừm... tốt!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Thật tuyệt nếu bạn dành cả ngày ở đó và không muốn lái xe để đi ăn.,"{location general, null, positive}","{restaurant miscellaneous, null, positive}" +"Xét cho cùng, tôi phải nói rằng Ray's Boathouse xứng đáng với danh hiệu là một tổ chức của Seattle.","{restaurant general, Ray's Boathouse, positive}","{restaurant general, Ray's Boathouse, positive}" +Giá trị tuyệt vời sushi với chất lượng cao và đẹp bối cảnh.,"{ambience general, bối cảnh, positive};{food quality, sushi, positive};{food prices, sushi, positive}","{ambience general, bối cảnh, positive};{food quality, sushi, positive};{food prices, sushi, positive}" +"Tuy nhiên, nhiều đến nỗi tôi gần như không thể ăn hết, nhưng tôi vẫn ăn hết vì nó rất ngon.","{food style_options, null, neutral};{food quality, null, positive}","{food quality, null, positive};{food style_options, null, negative}" +Tôi thích điều này nhà hàng,"{restaurant general, nhà hàng, positive}","{restaurant general, nhà hàng, positive}" +Không khuyến khích ! ! !,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Chúng tôi đứng đó 10 phút trong khi nhân viên đi đi lại lại và không để ý đến chúng tôi.,"{service general, nhân viên, negative}","{service general, nhân viên, negative}" +"Tôi và bạn gái tôi đều đồng ý rằng đồ ăn ở đây rất tầm thường, đặc biệt là khi xét đến giá cả.","{food quality, đồ ăn, negative};{food prices, đồ ăn, negative}","{food quality, đồ ăn, negative};{food prices, đồ ăn, negative}" +"– đồ ăn ở đây thì tuyệt vời, mặc dù chất lượng không đồng đều trong bữa trưa.","{food quality, bữa trưa, negative};{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive};{food quality, bữa trưa, negative}" +Tôi không có điều gì để chê trách về điều này địa điểm.,"{restaurant general, địa điểm, positive}","{restaurant general, địa điểm, positive}" +"vấn đề duy nhất là bạn thực sự phải làm nóng pizza trước khi ăn được, ngay cả khi bạn đã đặt hàng trước.","{food quality, pizza, negative}","{food quality, pizza, negative}" +– Đây là nhà hàng ``phải dẫn khách nước ngoài đến`` của tôi nhà hàng và họ luôn thích và khen ngợi về nó.,"{restaurant general, nhà hàng, positive}","{restaurant general, nhà hàng, positive}" +Tôi đã ăn đĩa kafta và tôi rất thích nó.,"{food quality, đĩa kafta, positive}","{food quality, đĩa kafta, positive}" +Rõ ràng là anh ấy không thực sự quan tâm.,"{service general, null, negative}","{service general, null, negative}" +Món Salad Caesar tôi gọi có quá nhiều chanh đến nỗi tôi không thể ăn hết.,"{food quality, Salad Caesar, negative}","{food quality, Salad Caesar, negative}" +"Người phục vụ của chúng tôi vẫn rất chu đáo suốt đêm, nhưng tôi vẫn băn khoăn về một vấn đề: Ai nghĩ rằng Ray là nơi thích hợp để đưa trẻ nhỏ đi ăn tối?","{restaurant miscellaneous, Ray, neutral};{service general, null, positive}","{service general, Người phục vụ, positive}" +"Tốt Đồ ăn, Tuyệt vời Dịch vụ, Giá trung bình (Cho khu vực Strip)","{restaurant prices, null, neutral};{food quality, Đồ ăn, positive};{service general, Dịch vụ, positive}","{food quality, Đồ ăn, positive};{restaurant prices, null, positive};{service general, Dịch vụ, positive}" +6 giờ tối thứ bảy trước khi xem vở kịch trên sân khấu Broadway và chúng tôi nhanh chóng được sắp chỗ và phục vụ.,"{service general, null, positive}","{service general, null, positive}" +"Họ chú trọng đến từng chi tiết, từ súp miso đến phức tạp bánh cuốn.","{food quality, súp miso, positive};{food quality, bánh cuốn, positive}","{food quality, bánh cuốn, positive};{food quality, súp miso, positive}" +6 đô la kèm tiền boa.,"{restaurant prices, null, positive}","{restaurant prices, null, positive}" +bầu không khí thật tuyệt vời.,"{ambience general, bầu không khí, positive}","{ambience general, bầu không khí, positive}" +"Nói cách khác, nếu họ không kiếm được $ $ từ bạn thì bạn không được đánh giá cao trên thang đo 'dịch vụ' của họ.","{service general, dịch vụ, negative}","{restaurant prices, null, negative}" +– Tôi thực sự rất thích bữa ăn ở đây.,"{food quality, bữa ăn, positive}","{food quality, bữa ăn, positive}" +"nhạc phát ra rất hợp thời, khoảng 20-30 bản nhạc pop nhạc, nhưng loa siêu trầm của hệ thống âm thanh lại nằm dưới ghế của tôi, điều này trở nên khó chịu vào giữa bữa tối.","{ambience general, nhạc, positive};{ambience general, loa siêu trầm của hệ thống âm thanh, negative}","{ambience general, loa siêu trầm, negative};{ambience general, nhạc, positive}" +Thánh Hummus!,"{food quality, Hummus, positive}","{food quality, Hummus, positive}" +"Món khai vị của tôi là sò điệp biển Alaska áp chảo ăn kèm với cải cầu vồng, tim a-ti-sô, thì là và phô mai pecorino toscano.","{food quality, sò điệp biển Alaska áp chảo, positive};{food style_options, sò điệp biển Alaska áp chảo, positive}","{food quality, sò điệp biển Alaska áp chảo, positive};{food quality, tim a-ti-sô, positive};{food quality, phô mai pecorino toscano, positive};{food quality, cải cầu vồng, positive}" +"trang trí mộc mạc, truyền thống của Nhật Bản.","{ambience general, trang trí, neutral}","{ambience general, trang trí, positive}" +Không chỉ lựa chọn có thể mang tính sáng tạo mà còn có sự cân bằng tốt giữa truyền thống sushi.,"{food style_options, lựa chọn, positive};{food style_options, sushi, positive}","{food style_options, sushi, positive}" +Bạn có thể sẽ phải thất vọng.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"đồ ăn thì tuyệt vời, nhân viên pha chế thì cực kỳ tận tình.","{food quality, đồ ăn, positive};{service general, nhân viên pha chế, positive}","{service general, nhân viên, positive};{food quality, đồ ăn, positive}" +Nhà hàng cung cấp danh sách rượu vang phong phú và không gian mà bạn sẽ không thể quên!,"{ambience general, không gian, positive};{drinks style_options, danh sách rượu vang, positive}","{drinks style_options, danh sách rượu vang, positive};{ambience general, không gian, positive}" +"naan là một trong những món ngon nhất mà tôi từng ăn và tôi thực sự thích bhartha, không có quá nhiều cà chua.","{food quality, naan, positive};{food quality, bhartha, positive}","{food quality, naan, positive};{food quality, bhartha, positive}" +Gửi đến chủ sở hữu của Open Sesame ... Bravo ... Tôi rất mong được quay lại dùng bữa tại nhà hàng của các bạn!,"{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}" +"cá tươi, mặc dù nó được cắt rất mỏng.","{food quality, cá, positive};{food style_options, cá, negative}","{food quality, cá, positive};{food style_options, cá, negative}" +Tôi đã đến đó nhiều lần và lần nào cũng thấy vui.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Quán pizza yêu thích của tôi quán pizza ở Seattle,"{restaurant general, quán pizza, positive}","{restaurant general, quán, positive}" +Tôi thực sự muốn giới thiệu nơi này đến tất cả những ai muốn thử đồ ăn Ấn Độ lần đầu tiên.,"{food quality, đồ ăn Ấn Độ, positive}","{food quality, đồ ăn Ấn Độ, positive}" +Được đánh giá quá cao,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Tệ nhất Dịch vụ Tôi từng có,"{service general, Dịch vụ, positive}","{service general, Dịch vụ, negative}" +Hóa ra chủ quán ngồi ngay cạnh chúng tôi và khi anh ta đến kiểm tra vấn đề của chúng tôi thì tỏ ra rất khinh thường và đề nghị giảm giá tượng trưng 20% trên hóa đơn.,"{service general, chủ quán, negative}","{service general, chủ quán, negative}" +Một đêm nọ tôi đến đó cùng một số người bạn để chơi bingo và xem trận đấu của đội Sox và thật tuyệt vời!,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}" +ĐƯỢC ĐÁNH GIÁ QUÁ CAO!,"{restaurant general, null, negative}","{restaurant general, null, negative}" +"– Trứng, bánh kếp, khoai tây, trái cây tươi và sữa chua -- mọi thứ họ phục vụ đều ngon.","{food quality, null, positive};{food quality, Trứng, positive};{food quality, khoai tây, positive};{food quality, bánh kếp, positive};{food quality, sữa chua, positive};{food quality, trái cây tươi, positive}","{food quality, null, positive}" +– Ray's LÀ nơi lý tưởng để thưởng thức các món ăn chất lượng cao bữa tối hải sản.,"{food quality, bữa tối hải sản, positive}","{food quality, hải sản, positive}" +Tôi cũng thực sự thích sự đơn giản của trang trí và cảm giác thân mật của một nhà hàng nhỏ.,"{ambience general, trang trí, positive};{ambience general, null, positive}","{ambience general, trang trí, positive};{ambience general, null, positive}" +Chúng ta sẽ quay lại. :D,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Tôi đáng lẽ phải nghĩ đến việc nêu vấn đề này ra nhưng không ngờ thức ăn lại nhẹ nhàng đến vậy.,"{food quality, thức ăn, negative}","{food quality, thức ăn, positive}" +"Khi bước vào, tôi vô cùng kinh ngạc trước đồ trang trí bằng gỗ tuyệt đẹp của họ.","{ambience general, đồ trang trí bằng gỗ, positive}","{ambience general, trang trí, positive}" +"Đây là một nơi rất nhỏ chỗ nên nếu bạn đến đó trước 8 giờ tối vào cuối tuần (thứ năm? Chủ Nhật), bạn sẽ dễ dàng tìm được bàn hoặc chỗ ngồi tại quầy sushi.","{restaurant miscellaneous, chỗ, neutral}","{ambience general, chỗ, positive}" +Khu vực lân cận tốt nhất Dự phòng.,"{restaurant general, Dự phòng, positive}","{restaurant general, phòng, positive}" +Tôi sẽ quay lại đó ngay lập tức.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Giá cả *rất* phải chăng, đặc biệt là so với chất lượng của thức ăn.","{food prices, thức ăn, positive}","{food prices, thức ăn, negative};{food quality, thức ăn, negative}" +"rất nhiều thức ăn, tin tôi đi.","{food style_options, thức ăn, positive}","{food style_options, thức ăn, positive}" +Đây là địa điểm hoàn hảo cho một buổi hẹn hò lãng mạn dành cho 2 người hoặc một cuộc gặp gỡ bí mật!,"{ambience general, điểm, positive};{restaurant miscellaneous, điểm, positive}","{ambience general, địa điểm, positive};{restaurant miscellaneous, địa điểm, positive}" +Ngoài ra còn có rượu margarita tuyệt vời !,"{drinks quality, margaritas, positive}","{drinks quality, rượu margarita, positive}" +Nó khiêm tốn và mang tính ngầm.,"{ambience general, null, positive}","{food quality, null, negative}" +Nơi này là nơi tuyệt vời nhất tiếp theo sau món ăn mẹ tôi nấu.,"{food quality, null, positive}","{food quality, món ăn, positive}" +"Nơi tốt nhất địa điểm để thưởng thức bữa sáng Chủ Nhật nhàn nhã giữa những du thuyền, sau đó đi dạo qua Chợ Nông sản gần đó.","{restaurant miscellaneous, địa điểm, positive}","{location general, địa điểm, positive}" +"Nếu có thể, hãy đến đây bằng thuyền và ở lại đó cả buổi tối.","{restaurant miscellaneous, đây, positive}","{restaurant general, null, positive}" +món tráng miệng chúng tôi có kem xoài gừng creme brulee ... ôi la la ngon quá ! ! !,"{food quality, kem xoài gừng creme brulee, positive}","{food quality, món tráng miệng, positive}" +"Việc chờ đợi là xứng đáng, đặc biệt là khi họ sẽ gọi điện cho bạn khi bàn đã sẵn sàng.","{restaurant general, null, positive}","{service general, null, positive}" +Họ có nhiều loại cá khác nhau và thậm chí còn liệt kê chúng đến từ đại dương nào: Đại Tây Dương hay Thái Bình Dương.,"{food style_options, cá, positive}","{food style_options, cá, positive}" +"Vâng, tôi đoán là khó có thể ngồi xuống khi người ta không nhìn thấy nhân viên.","{service general, nhân viên, negative}","{service general, nhân viên, negative}" +Rất cởi mở và thân thiện không khí.,"{ambience general, không khí, positive}","{ambience general, không khí, positive}" +Cuộc trò chuyện ngắn ngủi với người quản lý vào cuối bữa ăn là sự thất vọng lớn nhất -- nói rằng chúng tôi đã bị `` phớt lờ `` thì còn quá khiêm tốn.,"{service general, người quản lý, negative}","{service general, người quản lý, negative}" +"Ray's là một tổ chức ở Seattle, nhưng xét đến vẻ đẹp tuyệt vời của nó Sound views, tôi nghi ngờ rằng lời khen ngợi này chủ yếu là do phong cảnh hơn là đồ ăn và dịch vụ.","{location general, Sound views, positive}","{location general, Sound views, positive};{restaurant general, Ray's, positive}" +Tôi thề sẽ không bao giờ quay lại để ăn đồ nóng bia và đồ ăn tầm thường bữa ăn.,"{food quality, bữa ăn, negative};{drinks quality, bia, negative}","{food quality, bữa ăn, negative};{drinks quality, bia, negative}" +"Nếu thời tiết bên ngoài đẹp, hãy yêu cầu một bàn ở ban công .","{ambience general, ban công, positive}","{ambience general, bàn ở ban công, positive}" +Tuyệt vời đồ ăn với bầu không khí tuyệt vời không khí!,"{food quality, đồ ăn, positive};{ambience general, không khí, positive}","{ambience general, không khí, positive};{food quality, đồ ăn, positive}" +Tôi kết thúc bữa ăn bằng món ăn lạ món tráng miệng là rượu vang port và nếm thử sô cô la... ngon tuyệt!,"{food quality, món tráng miệng là rượu vang port và nếm thử sô cô la, positive}","{food quality, sô cô la, positive}" +Tôi đã gọi món khai vị sò và tôm và thấy khá ổn.,"{food quality, sò và tôm, neutral}","{food quality, sò và tôm, neutral}" +pizza có đế mỏng và thực đơn cung cấp nhiều sự kết hợp và lớp phủ rất sáng tạo.,"{food style_options, pizza, positive};{food style_options, thực đơn, positive}","{food style_options, thực đơn, positive};{food quality, pizza, positive};{food quality, lớp phủ, positive}" +Đây là địa điểm tuyệt vời để thưởng thức đồ ăn và gặp gỡ bạn bè.,"{food quality, đồ ăn, positive};{restaurant miscellaneous, địa điểm, positive}","{restaurant miscellaneous, địa điểm, positive}" +"dịch vụ tuyệt vời, cà phê ngon ngay cả theo tiêu chuẩn của Starbucks và đồ ăn thì tuyệt hảo.","{food quality, đồ ăn, positive};{service general, dịch vụ, positive};{drinks quality, cà phê, positive}","{food quality, đồ, positive};{service general, dịch vụ, positive};{drinks quality, cà phê, positive}" +Đây là nơi để thư giãn và tận hưởng chất lượng tốt nhất thực phẩm mà ngành công nghiệp này có thể cung cấp.,"{ambience general, nơi, positive};{food quality, thực phẩm, positive}","{food quality, thực phẩm, positive}" +Tôi sẽ quay lại chỉ để trải nghiệm rượu.,"{drinks quality, rượu, positive}","{drinks quality, rượu, positive}" +Món ngon nhất mực ống ở Seattle!,"{food quality, mực ống, positive}","{food quality, null, positive}" +"Bài trình bày của Snooze rất tuyệt và đây là một trong những nơi khiến bạn cảm thấy mình sành điệu hơn khi đến đó; nhưng nếu bỏ qua các lớp, bạn sẽ có một nhà hàng IHOP đắt đỏ với thực đơn cao cấp.","{food style_options, thực đơn, negative};{restaurant prices, Snooze, negative};{ambience general, Snooze, positive}","{restaurant prices, Snooze, negative};{food style_options, thực đơn, positive};{restaurant general, Snooze, positive}" +"Tôi đã phàn nàn với người quản lý, nhưng anh ta thậm chí còn không xin lỗi.","{service general, người quản lý, negative}","{service general, người quản lý, negative}" +Nhiều hơn thế nữa chứ không chỉ là một lượt xem tuyệt vời!,"{location general, lượt xem, positive}","{restaurant general, null, positive}" +bầu không khí thì tạm ổn.,"{ambience general, bầu không khí, neutral}","{ambience general, bầu không khí, neutral}" +Sau khi ngồi vào bàn phải mất khoảng 30 phút mới có đồ ăn.,"{service general, null, negative}","{service general, null, negative}" +"– Trong thời đại mà chi phí nhà hàng ngày càng giảm, thật tuyệt khi thấy một nơi đi ngược lại xu hướng đó và chỉ đơn giản là cung cấp chất lượng cao thức ăn và tốt dịch vụ, chấm hết.","{food quality, thức ăn, positive};{service general, dịch vụ, positive}","{food quality, thức ăn, positive};{service general, dịch vụ, positive}" +Tôi rất thích không khí nhưng đồ ăn thì không xứng đáng với giá tiền.,"{food quality, đồ ăn, negative};{food prices, đồ ăn, negative};{ambience general, không khí, positive}","{food quality, đồ ăn, negative};{ambience general, không khí, positive};{food prices, đồ ăn, negative}" +"Quán này nằm trong một trung tâm thương mại gần Beverly Center, không phải là tuyệt vời nhất vị trí, nhưng đồ ăn khiến tôi muốn quay lại nhiều lần.","{food quality, đồ ăn, positive};{location general, vị trí, neutral}","{food quality, đồ ăn, positive};{location general, vị trí, neutral}" +"Trong bữa ăn của tôi, tôi đã phải gửi lại trứng chỉ vì một yêu cầu đơn giản là bẻ lòng đỏ trứng trước khi nấu, và tôi sẽ phải gửi lại chúng lần nữa nếu tôi không từ chối bữa ăn hoàn toàn.","{food quality, bữa ăn, negative};{food quality, trứng, negative}","{service general, null, negative}" +ban nhạc rất tuyệt và dịch vụ rất chu đáo.,"{service general, dịch vụ, positive};{ambience general, ban nhạc, positive}","{ambience general, nhạc, positive};{service general, dịch vụ, positive}" +"– Làm sao để miêu tả món ngon nhất sushi ở NYC: hmmmm, ngon, tuyệt vời, tuyệt hảo, hấp dẫn, hoàn hảo, không, tất cả những từ trên.","{food quality, sushi, positive}","{food quality, sushi, positive}" +– Sự quyến rũ của Schooner or Later vị trí dọc theo bến du thuyền ở Long Beach và mức trung bình đồ ăn không thể bù đắp cho dịch vụ khách hàng rất kém của nó dịch vụ chăm sóc khách hàng.,"{location general, vị trí dọc theo bến du thuyền ở Long Beach, positive};{food quality, đồ ăn, neutral};{service general, dịch vụ chăm sóc khách hàng, negative}","{restaurant general, Schooner or Later, negative};{food quality, đồ ăn, neutral};{location general, vị trí, positive};{service general, dịch vụ chăm sóc khách hàng, negative}" +"Chúng tôi được ngồi ngay lập tức, bàn riêng tư và đẹp.","{ambience general, null, positive}","{ambience general, bàn, positive}" +"tốt rượu sake, tốt đồ ăn – thành thật mà nói, tôi không biết nhiều về tiếng Nhật đồ ăn chút nào.","{drinks quality, rượu sake, positive};{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive};{drinks quality, rượu, positive}" +Hãy mang theo điện thoại di động vì bạn có thể phải đợi để vào được nhà hàng sushi ngon nhất thế giới: BLUE RIBBON SUSHI.,"{restaurant general, BLUE RIBBON SUSHI, positive}","{restaurant general, BLUE RIBBON SUSHI, positive}" +"Cuối cùng, hóa đơn của chúng tôi là 27 đô la cho 4 phần ăn nhỏ bánh kếp, một phần ăn bánh burrito ăn sáng, một phần ăn nước cam và một phần ăn trà đá (tôi đã uống nước lọc).","{food prices, bánh kếp, negative};{drinks prices, trà đá, negative};{drinks prices, nước cam, negative};{food prices, bánh burrito ăn sáng, negative};{food style_options, bánh kếp, negative}","{food style_options, null, negative};{food prices, null, negative};{service general, null, negative}" +Tốt đồ ăn !,"{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive}" +"dịch vụ ăn uống thật tuyệt vời, và súp gà rau Raouls làm tôi kinh ngạc! ! !","{food quality, dịch vụ ăn uống, positive};{food quality, súp gà rau Raouls, positive}","{food quality, súp gà rau Raouls, positive};{service general, dịch vụ ăn uống, positive}" +Tôi lẽ ra nên yêu cầu thanh toán khi nhìn thấy điều đó; nhưng thực đơn của họ quá độc đáo nên tôi đã tiếp tục.,"{food style_options, thực đơn, positive}","{food style_options, thực đơn, positive}" +Tuyệt vời Bữa sáng,"{food quality, Bữa sáng, positive}","{food quality, Bữa sáng, positive}" +Cá vược trên cơm thập cẩm tôm hùm là món ngon nhất.,"{food quality, Cá vược trên cơm thập cẩm tôm hùm, positive}","{food quality, cơm thập cẩm tôm hùm, positive}" +– bầu không khí thật tuyệt vời cho bất kỳ dịp đặc biệt nào mà bạn muốn ăn mừng.,"{ambience general, bầu không khí, positive}","{ambience general, bầu không khí, positive}" +"Tuyệt vời cá theo mùa và hải sản, với phong cách sang trọng khung cảnh ven sông.","{ambience general, khung cảnh ven sông, positive};{food quality, hải sản, positive};{food quality, cá theo mùa, positive}","{ambience general, khung cảnh, positive};{food quality, cá theo mùa và hải sản, positive}" +pizza không lớn và vỏ bánh mỏng ... hãy ghi nhớ điều này khi bạn gọi món.,"{food style_options, pizza, neutral};{food style_options, vỏ bánh, neutral}","{food style_options, pizza, negative}" +Điểm tích cực duy nhất về Mioposto là vị trí đẹp .,"{location general, null, positive}","{location general, vị trí, positive}" +Tôi cũng đánh giá cao cách giao hàng của họ.,"{service general, giao hàng, positive}","{service general, giao hàng, positive}" +Rất thất vọng .,"{restaurant general, null, negative}","{food quality, null, negative}" +pizza thì ngon và salad thì tuyệt vời.,"{food quality, pizza, positive};{food quality, salad, positive}","{food quality, pizza, positive};{food quality, salad, positive}" +Tươi nhất sushi – Tôi thích món này nhà hàng.,"{restaurant general, nhà hàng, positive};{food quality, sushi, positive}","{food quality, sushi, positive};{restaurant general, nhà hàng, positive}" +Món bít tết được chế biến theo đúng ý thích của tôi (vừa chín tái) và rất ngon và mọng nước.,"{food quality, bít tết, positive}","{food quality, bít tết, positive};{food style_options, bít tết, positive}" +"Nghiêm túc mà nói, bạn không thể sai lầm nếu bạn đang tìm kiếm niềm vui giản dị ở địa phương.","{ambience general, null, positive}","{restaurant general, null, positive}" +chủ sở hữu rất vui tính và lựa chọn bia rất đáng để ở lại.,"{drinks style_options, lựa chọn bia, positive};{service general, chủ sở hữu, positive}","{drinks style_options, bia, positive};{service general, chủ hữu, positive}" +Tuyệt vời lựa chọn bia tươi và bia đóng chai và pizza tuyệt vời.,"{food quality, pizza, positive};{drinks style_options, lựa chọn bia tươi và bia đóng chai, positive}","{drinks quality, bia tươi, positive};{drinks style_options, bia đóng chai, positive};{food quality, pizza, positive}" +"Tôi đảm bảo bạn sẽ không thất vọng, ở đây còn có dịch vụ đỗ xe có người phục vụ.","{restaurant general, null, positive};{restaurant miscellaneous, null, positive}","{service general, dịch vụ đỗ xe, positive}" +Ăn tối muộn với dịch vụ đặc biệt đồ ăn.,"{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive};{service general, dịch vụ, positive}" +"Tuy nhiên, khẩu phần ăn khá lớn nên bạn đừng gọi quá nhiều.","{food style_options, khẩu phần ăn, neutral}","{food style_options, khẩu phần ăn, neutral}" +Chắc chắn là một trong những thứ tốt nhất jukebox mà tôi từng thấy trong một thời gian dài.,"{ambience general, jukebox, positive}","{ambience general, jukebox, positive}" +Dịch vụ khá tốt.,"{service general, Dịch vụ, neutral}","{service general, Dịch vụ, positive}" +Thật là ngon.,"{food quality, null, positive}","{food quality, null, positive}" +"Ồ, và khoai tây chiên phô mai thì tuyệt vời!","{food quality, khoai tây chiên phô mai, positive}","{food quality, Ồ, positive};{food quality, khoai tây chiên phô mai, positive}" +Mọi người ngồi ở phía sau bên ngoài đều đồng ý rằng đây là dịch vụ tệ nhất mà chúng tôi từng nhận được.,"{service general, null, negative}","{service general, null, negative}" +Tôi có thể không phải là chuyên gia về sushi nhưng tôi có thể nói với bạn rằng đồ ăn ở đây chỉ ở mức tạm ổn và không có gì đặc biệt hơn.,"{food quality, đồ ăn, negative}","{food quality, đồ ăn, negative}" +"Tuyệt vời đồ ăn, đẹp không khí, khá đắt","{restaurant prices, null, negative};{food quality, đồ ăn, positive};{ambience general, không khí, positive}","{food quality, đồ ăn, positive};{ambience general, không khí, positive};{restaurant prices, null, negative}" +"Tan chảy trong miệng nigiri và sashmi, và cũng rất ngon cuộn.","{food quality, cuộn, positive};{food quality, nigiri, positive};{food quality, sashmi, positive}","{food quality, nigiri, positive};{food quality, sashmi, positive};{food style_options, cuộn, positive}" +Cuối cùng là một bữa ăn mà bạn sẽ nhớ mãi!,"{food quality, bữa ăn, positive}","{food quality, bữa ăn, positive}" +"Tốt nhất đồ ăn, phi thường dịch vụ","{food quality, đồ ăn, positive};{service general, dịch vụ, positive}","{food quality, đồ ăn, positive};{service general, dịch vụ, negative}" +Tôi khuyên bạn nên đến đây vào buổi tối khi bạn muốn tiêu tiền! (nó hơi đắt một chút),"{restaurant prices, null, negative};{restaurant general, null, positive}","{restaurant prices, null, negative}" +"Trong khi quán ăn này có đồ ăn khá ổn, nhân viên nhà hàng có vẻ hoàn toàn thờ ơ với sự có mặt của chúng tôi, và thái độ này thể hiện qua việc thiếu dịch vụ.","{service general, nhân viên nhà hàng, negative};{food quality, đồ ăn, positive}","{service general, nhân viên, negative};{food quality, đồ ăn, positive};{service general, thái độ, negative}" +Không có sự so sánh,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}" +"vậy thì về tôm, chúng tươi và hơi giòn, về bột chiên... ngon tuyệt... về quả óc chó được cắt thành từng miếng nhỏ hơn, rất giòn và ngon.","{food quality, tôm, positive};{food quality, quả óc chó, positive};{food quality, bột chiên, positive}","{food quality, bột chiên, positive};{food quality, quả óc chó, positive};{food quality, tôm, positive}" +Tôi rất vui khi có một nhà hàng Ý tuyệt vời ở gần nhà tôi.,"{restaurant general, nhà hàng Ý, positive}","{restaurant general, nhà hàng Ý, positive}" +Chúng tôi đã đợi một tiếng đồng hồ để có chỗ ngồi.,"{service general, null, negative}","{service general, null, negative}" +"Chúng tôi đã gọi món và mặc dù đã gọi 4 món khai vị, đồ ăn vẫn chưa được mang ra cho đến tận 45 phút sau... VỚI MÓN CHÍNH.","{service general, null, negative}","{service general, null, negative}" +Tôi rất mong được quay lại đây vào cuối tuần tới!,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Nếu bạn thích đồ ăn ngon (không có mùi hoặc vị cá), nhiều (2 phần) và sáng tạo (3 món sushi) thì đây chính là nơi dành cho bạn ...","{food quality, null, positive};{food style_options, phần, positive};{food style_options, món sushi, positive}","{food style_options, sushi, positive};{food quality, đồ ăn, positive};{food style_options, 3 món sushi, positive};{food style_options, 2 phần, positive}" +Một nơi hoàn hảo địa điểm để đưa khách ra khỏi thị trấn vào bất kỳ thời điểm nào trong năm.,"{restaurant general, địa điểm, positive}","{restaurant miscellaneous, địa điểm, positive}" +Tôi đã nếm thử cả ba món của cô ấy đĩa và chúng thật tuyệt vời.,"{food quality, đĩa, positive}","{food quality, đĩa, positive}" +Thích hợp cho việc ăn tối muộn (lên kế hoạch vào phút cuối) mà không cần đặt trước.,"{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}" +Tôi không bao giờ thất vọng với đồ ăn ở đó .,"{food quality, null, positive}","{food quality, đồ ăn, positive}" +– Quán bar tốt nhất ở phía đông bar ...,"{restaurant general, bar, positive}","{restaurant general, Quán, positive}" +Đây là nơi tuyệt vời để ngắm người.,"{restaurant miscellaneous, nơi, positive}","{restaurant miscellaneous, null, positive}" +"Không gian có hạn, nhưng thức ăn đã bù đắp lại.","{restaurant miscellaneous, Không gian, negative};{food quality, thức ăn, positive}","{food quality, thức ăn, positive};{ambience general, không gian, negative}" +"sò điệp dường như được nấu trong bơ ô liu đen, điều này thực sự làm cho chúng trở nên độc đáo (chưa kể đến việc ngon).","{food quality, sò điệp, positive};{food style_options, sò điệp, positive}","{food quality, sò điệp, positive};{food style_options, sò điệp, positive}" +Nơi này địa điểm thật quyến rũ và thư giãn.,"{ambience general, địa điểm, positive}","{ambience general, địa điểm, positive}" +không hề dai chút nào.,"{food quality, null, positive}","{restaurant general, null, negative}" +Chúng tôi chỉ ở Seattle một đêm và tôi rất vui vì đã chọn Rays để ăn tối!,"{restaurant general, Rays, positive}","{restaurant general, Rays, positive}" +"– Tôi sẽ không bao giờ quên những trải nghiệm tuyệt vời về bữa ăn, dịch vụ và không gian tại nhà hàng này.","{food quality, bữa ăn, positive};{ambience general, không gian, positive};{service general, dịch vụ, positive}","{food quality, bữa ăn, positive};{ambience general, không gian, positive};{service general, dịch vụ, positive}" +Thật tuyệt vời Món khai vị đặc biệt cá thu Tây Ban Nha và hoàn hảo sushi hộp (đó lươn với bơ -- ừm ừm ).,"{food quality, sushi hộp, positive};{food quality, Món khai vị đặc biệt cá thu Tây Ban Nha, positive};{food quality, lươn với bơ, positive}","{food quality, sushi hộp, positive};{food quality, Món khai vị đặc biệt cá thu Tây Ban Nha, positive}" +"Vào cuối tuần, bạn có thể phải đợi vài giờ.","{service general, null, neutral}","{service general, null, negative}" +– đồ ăn không ngon và người phục vụ thô lỗ.,"{service general, người phục vụ, negative};{food quality, đồ ăn, negative}","{food quality, đồ ăn, negative};{service general, người phục vụ, negative}" +"Tiếp theo là miếng bít tết 9 oz và nó có vị rất ngon, ít nhất là lúc đầu.","{food quality, 9 oz, positive}","{food quality, miếng bít tết 9 oz, positive}" +"Khi đến đó, tôi ngồi trên cầu thang, nơi có không khí ấm cúng nhưng dịch vụ thì tệ!","{service general, dịch vụ, negative};{ambience general, không khí, positive}","{ambience general, cầu thang, positive};{service general, dịch vụ, negative}" +"danh sách rượu vang thật tuyệt vời, phong phú và đa dạng, đồ ăn tất cả đều tuyệt vời và nhân viên đều rất tốt bụng, giỏi việc và có văn hóa.","{service general, nhân viên, positive};{drinks style_options, danh sách rượu vang, positive};{food quality, đồ ăn, positive}","{food quality, đồ ăn, positive};{service general, nhân viên, positive};{drinks style_options, danh sách rượu vang, positive}" +– KHÔNG THỂ TỐT HƠN NỮA! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Vào các buổi chiều chủ nhật, có một ban nhạc chơi nhạc và rất vui nhộn.","{ambience general, ban nhạc, positive}","{ambience general, nhạc, positive}" +"Mọi thứ, ý tôi là mọi thứ trong thực đơn đều ngon tuyệt.","{food quality, thực đơn, positive}","{food quality, thực đơn, positive}" +"Tôi biết nhiều người có loại pizza và địa điểm yêu thích, nhưng pizza của Mioposto thì không có chất lượng và hương vị ngon.","{food quality, pizza, negative}","{food quality, pizza, negative}" +"Chỉ có một nơi ở bờ biển phía đông có tất cả, cộng thêm nhiều thứ khác nữa.","{restaurant general, nơi, positive}","{restaurant general, null, positive}" +Luôn luôn là người chiến thắng.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Đánh giá trước đó cho biết thân thiện với trẻ em... giúp tôi có thời gian nghỉ ngơi thoải mái khi có hai đứa con nhỏ.,"{restaurant miscellaneous, null, negative}","{restaurant miscellaneous, null, positive}" +pizza nhẹ và ngon tuyệt.,"{food quality, pizza, positive}","{food quality, pizza, positive};{food style_options, pizza, positive}" +"Hãy xem tác phẩm nghệ thuật trên tường, rất nhiều màu sắc!","{ambience general, tác phẩm nghệ thuật trên tường, positive}","{ambience general, null, positive}" +Trung bình thức ăn,"{food quality, thức ăn, neutral}","{food quality, thức ăn, neutral}" +Tôi sẽ không bao giờ quay lại nữa.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +Chúng tôi đã rất khó khăn để có được sự chú ý của cô hầu bàn và cuối cùng phải đứng dậy và vào trong để nói chuyện với người quản lý.,"{service general, cô hầu bàn, negative}","{service general, hầu bàn, negative}" +Không bao giờ quá đông đúc và luôn tuyệt vời dịch vụ.,"{restaurant miscellaneous, null, positive};{service general, dịch vụ, positive}","{restaurant miscellaneous, null, positive};{service general, dịch vụ, positive}" +Bạn đang hẹn hò với một người hấp dẫn và anh ấy/cô ấy thèm ăn sushi ... thì đây có thể là nơi dành cho bạn.,"{food quality, sushi, positive}","{restaurant miscellaneous, null, positive}" +"– Tôi không thể tin Murphy đã tồn tại được hơn 25 năm, thật tuyệt vời.","{restaurant miscellaneous, Murphy, positive}","{restaurant general, Murphy, positive}" +"Có thể rất đông vào thứ sáu để tìm được bàn nhưng một khi đã ngồi vào chỗ, dịch vụ ở đây rất hiệu quả, bạn có thể vào và ra nhanh chóng.","{service general, dịch vụ, positive}","{service general, dịch vụ, positive};{restaurant miscellaneous, bàn, neutral}" +"Món này được phục vụ kèm với nước sốt tiêu hoặc nước sốt rượu vang đỏ, mặc dù cả hai đều có hương vị không thể phân biệt được.","{food quality, nước sốt rượu vang đỏ, neutral};{food quality, nước sốt tiêu, neutral}","{food quality, món, negative}" +Người phục vụ tốt bụng nhất trong thị trấn.,"{service general, Người phục vụ, positive}","{service general, Người phục vụ, positive}" +dịch vụ lịch sự và chu đáo.,"{service general, dịch vụ, positive}","{service general, dịch vụ, positive}" +"Khi viết bài này, tôi vừa thử lại liên kết tặng miễn phí của họ nhưng vẫn không được.","{restaurant miscellaneous, null, negative}","{service general, null, negative}" +bất kỳ nhu cầu nào khác của chúng tôi đều không thể được đáp ứng vì không có ai ghé qua bàn.,"{service general, null, negative}","{service general, null, negative}" +"Tốt Sushi, Giá cao","{food quality, Sushi, positive};{food prices, Sushi, negative}","{food quality, Sushi, positive};{food prices, Sushi, negative}" +Nhưng người phục vụ cực kỳ chu đáo và rất thân thiện.,"{service general, người phục vụ, positive}","{service general, người phục vụ, positive}" +"Tôi đã đến nơi này địa điểm rồi, các bạn ạ, và nó THẬT TỆ.","{restaurant general, địa điểm, negative}","{restaurant general, địa điểm, negative}" +tuyệt vời dịch vụ,"{service general, dịch vụ, positive}","{service general, dịch vụ, positive}" +Cảm giác như đang ăn tối ở một nhà hàng hoàn toàn khác vậy.,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}" +Hai ngón tay cái hướng lên!,"{food quality, null, positive}","{drinks quality, cái, positive}" +Hãy tưởng tượng sự ngạc nhiên vui mừng của tôi khi phát hiện ra rằng lượt xem chỉ là điều tốt thứ ba về Ray!,"{location general, lượt xem, positive};{restaurant general, Ray, positive}","{restaurant general, Ray, positive}" +"Không còn nghi ngờ gì nữa, đây là món ngon nhất cá ngừ mà tôi từng ăn.","{food quality, cá ngừ, positive}","{food quality, cá, positive}" +"Nếu bạn định đi xem Danny Gans hoặc chỉ ở lại Mirage, đừng bỏ lỡ chương trình này.","{restaurant general, null, positive}","{restaurant general, null, positive}" +tuyệt vời địa điểm ăn trưa,"{restaurant general, địa điểm ăn trưa, positive}","{restaurant general, địa điểm, positive}" +Tôi thích bữa sáng ở đây.,"{food quality, bữa sáng, positive}","{restaurant general, null, positive}" +sashimi là loại tươi nhất và mềm nhất mà tôi từng nếm thử.,"{food quality, sashimi, positive}","{food quality, sashimi, positive}" +Bạn sẽ không phải thất vọng với thực đơn của họ.,"{food style_options, null, positive}","{food style_options, thực đơn, positive}" +"Nhiều người nói về sự tuyệt vời pizza và sự kém cỏi dịch vụ, vì vậy không thể chỉ có lời phàn nàn của một vài khách hàng không hài lòng.","{food quality, pizza, positive};{service general, dịch vụ, negative}","{food quality, pizza, positive};{service general, dịch vụ, negative}" +Tôi sẽ không quay lại.,"{restaurant general, null, negative}","{restaurant general, null, negative}" +dịch vụ của tôi thật tuyệt vời!,"{service general, dịch vụ, positive}","{service general, dịch vụ, positive}" +chúng tôi chắc chắn sẽ quay lại đây nhà hàng.,"{restaurant general, nhà hàng, positive}","{restaurant general, nhà hàng, positive}" +Chắc chắn sẽ quay lại.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Có lẽ sẽ tốt nếu vào một đêm trăng xanh nào đó, các đầu bếp quyết định sử dụng cá mà cũng tạm ổn.","{food quality, cá, negative}","{food quality, cá, neutral}" +– Tôi mới đến Open Sesame một lần nhưng vẫn còn choáng ngợp vì trải nghiệm đó!!,"{restaurant general, Open Sesame, positive}","{restaurant general, Open Sesame, positive}" +"bánh kếp chắc chắn là sáng tạo nhưng giá 8,50 đô la cho 3 - 6 `` bánh kếp (một trong số chúng có kích thước khoảng 5 ``) trong chuyến bay bánh kếp (mẫu gồm 3 bánh kếp khác nhau) là quá đắt.","{food prices, bánh kếp, negative};{food style_options, bánh kếp, positive}","{food style_options, bánh kếp, positive};{food quality, bánh kếp, positive};{food prices, bánh kếp, negative}" +"Tuy nhiên, một buổi chiều Chủ Nhật, chồng tôi và tôi đã đi (mặc dù tôi phản đối rất gay gắt) và vô cùng ngạc nhiên và thích thú.","{restaurant general, null, positive}","{restaurant general, null, positive}" +Rất đáng giá,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Thận trọng - nó thực sự thức ăn dành cho những người yêu thích nhất.,"{food quality, thức ăn, positive}","{food quality, thức ăn, positive}" +Tôi có một điều nhưng ở đây - có một người phục vụ phòng tắm trong phòng vệ sinh điều đó thật kỳ lạ.,"{restaurant miscellaneous, phòng vệ sinh, negative}","{service general, người phục vụ, negative}" +Món ăn ngon nhất là tôm honwy óc chó -- thực sự tuyệt vời.,"{food quality, tôm honwy óc chó, positive}","{food quality, tôm honwy óc chó, positive}" +bánh kếp nên lớn hơn (ít nhất là 8``) để biện minh cho chi phí ngay cả với những sản phẩm độc đáo.,"{food style_options, bánh kếp, negative}","{food style_options, bánh kếp, positive};{food prices, bánh kếp, negative}" +– Lần đầu tiên tôi dùng bữa tại nhà hàng này nhà hàng là với con trai tôi và nó thực sự tệ!,"{restaurant general, nhà hàng, negative}","{restaurant general, nhà hàng, negative}" +Xuất sắc,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"Chỗ đậu xe khá tốt, họ có bãi đậu xe riêng và bạn có thể đậu xe ở công viên gần đó.","{restaurant miscellaneous, null, positive}","{parking general, đậu xe, positive};{parking general, bãi đậu xe, positive}" +Salad Caesar thật tuyệt vời.,"{food quality, Salad Caesar, positive}","{food quality, Salad Caesar, positive}" +"– Tôi không hiểu tại sao tôi lại xa lạ với nơi này lâu đến vậy... salad fajita, màu da cam, fajitas - MỌI THỨ đều ngon.","{food quality, màu da cam, positive};{food quality, fajitas, positive};{food quality, salad fajita, positive}","{food quality, salad fajita, positive};{food quality, fajitas, positive};{food quality, màu da cam, positive}" +món ăn ngon nhất đồ ăn Trung Quốc mà tôi đã nếm thử trong một thời gian dài,"{food quality, đồ ăn Trung Quốc, positive}","{food quality, đồ ăn Trung Quốc, positive}" +Giá cả cũng phải chăng.,"{restaurant prices, null, positive}","{restaurant prices, null, negative}" +Thơm ngon ... !,"{food quality, null, positive}","{food quality, null, positive}" +Chúng tôi ghi tên và mặc dù vẫn còn bàn trống nhưng chúng tôi được thông báo rằng phải đợi 30 phút.,"{service general, null, negative}","{service general, null, negative}" +cà phê cũng rất ngon.,"{drinks quality, cà phê, positive}","{drinks quality, cà phê, positive}" +Chúng tôi đã đợi hơn 30 phút để có đồ uống và hơn 1 tiếng rưỡi để có đồ ăn.,"{service general, null, negative}","{service general, null, negative}" +nhân viên phục vụ phía sau quầy luôn thân thiện và hữu ích.,"{service general, nhân viên phục vụ phía sau quầy, positive}","{service general, nhân viên phục vụ, positive}" +"Người phục vụ của chúng tôi không hề tồn tại và sau hơn một giờ kể từ khi chúng tôi gọi món, đồ ăn cuối cùng cũng được mang đến, chúng tôi không được phục vụ nước hoặc đồ dùng.","{service general, Người phục vụ, negative}","{service general, người phục vụ, negative}" +– Nơi này địa điểm được đánh giá quá cao một cách không thể tin được.,"{restaurant general, địa điểm, negative}","{restaurant general, địa điểm, negative}" +Rất kém dịch vụ khách hàng.,"{service general, dịch vụ khách hàng, negative}","{service general, dịch vụ khách hàng, negative}" +Chúng tôi không thể nói đủ về hương vị ngon tuyệt của họ pizza!,"{food quality, pizza, positive}","{food quality, pizza, positive}" +"Hơn nữa, trong khi cá chắc chắn là tươi thì bánh mì cuộn lại có xu hướng nhạt nhẽo một cách khó hiểu.","{food quality, cá, positive};{food quality, bánh mì cuộn, negative}","{food quality, bánh mì cuộn, negative};{food quality, cá, positive}" +Điểm trừ duy nhất là đông đúc chỗ ngồi và chậm dịch vụ.,"{service general, dịch vụ, negative};{restaurant miscellaneous, chỗ ngồi, negative}","{ambience general, chỗ, negative};{service general, dịch vụ, negative}" +"Không còn nhiều nơi hút thuốc ở New York, nhưng tôi đã tìm thấy nơi hút thuốc yêu thích của mình ban công trong thành phố.","{restaurant miscellaneous, ban công, positive}","{restaurant general, ban công, positive}" +Chúng tôi cùng chia sẻ đĩa thức ăn gia đình và tôi đặc biệt thích món cá tuyết đen ngâm sake kasu.,"{food quality, cá tuyết đen ngâm sake kasu, positive}","{food quality, món cá tuyết đen ngâm sake, positive}" +"Nhưng không gian nhỏ và đẹp, và dịch vụ thì hữu ích.","{ambience general, không gian, positive};{service general, dịch vụ, positive}","{ambience general, không gian, positive};{restaurant miscellaneous, null, positive};{ambience general, không gian, positive}" +Sự chờ đợi là xứng đáng.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +ngon .,"{food quality, null, positive}","{food quality, null, positive}" +ngon tuyệt,"{food quality, null, positive}","{food quality, null, positive}" +- Trung bình Dịch vụ / Chất lượng,"{service general, Dịch vụ, neutral}","{service general, Dịch vụ, neutral};{food quality, Chất, neutral}" +"– Đây là một trong những địa điểm ăn trưa hàng đầu của tôi, rộng rãi khẩu phần, nhanh dịch vụ và tuyệt vời rượu margarita! !","{drinks quality, rượu margarita, positive};{restaurant general, null, positive};{food style_options, khẩu phần, positive};{service general, dịch vụ, positive}","{food style_options, khẩu phần, positive};{service general, dịch vụ, positive};{drinks quality, rượu margarita, positive};{restaurant general, null, positive}" +Món ngon nhất Bánh cua trong thị trấn,"{food quality, Bánh cua, positive}","{food quality, Bánh cua, positive}" +"Mọi thứ tôi đã ăn ở đây đều ngon, salad taco, burrito, enchiladas, tôi thích nơi này địa điểm.","{food quality, null, positive};{restaurant general, địa điểm, positive};{food quality, enchiladas, positive};{food quality, salad taco, positive};{food quality, burrito, positive}","{food quality, enchiladas, positive};{food quality, burrito, positive};{food quality, salad taco, positive};{restaurant general, địa điểm, positive}" +"Tuyệt vời Pizza, Kém Dịch vụ","{food quality, Pizza, positive};{service general, Dịch vụ, negative}","{food quality, Pizza, positive};{service general, Dịch, positive" +tuyệt vời,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Bạn thân nhất của tôi đã ăn món gà shawarma và cô ấy VẪN khen ngợi rằng đây là món ngon nhất!,"{food quality, gà shawarma, positive}","{food quality, shawarma, positive}" +Chintzy phần,"{food style_options, phần, negative}","{restaurant general, null, positive}" +Tốt ăn.,"{food quality, ăn, positive}","{food quality, eat, positive}" +"Thông thường, các nơi sẽ hỏi bạn muốn nóng đến mức nào, nhưng họ không làm vậy.","{service general, null, negative}","{restaurant miscellaneous, null, negative}" +"Tôi luôn thấy nhân viên phục vụ và nếu bạn ngồi ở quầy bar, đầu bếp rất thân thiện.","{service general, đầu bếp, positive}","{service general, nhân viên, positive};{service general, đầu bếp, positive}" +Không có gì trong menu kém tuyệt vời cả.,"{food quality, null, positive}",I was pleasantly surprised to find this gem in Hoboken. +"Nhóm hai người của tôi cảm thấy đặc biệt tham vọng, và chúng tôi đã chi tiêu rất nhiều vào Shilshole Sampler ... một sự kết hợp tuyệt vời gồm tôm trắng vùng Vịnh, cá ngừ albacore hun khói, món Ray tuyệt vời nghêu Manila tẩm thì là, sò điệp trong nước sốt đậu nành ngon và một ít cua Dungeness trên một sốt bơ tuyệt hảo.","{food quality, null, positive};{food quality, sốt bơ, positive};{food style_options, Shilshole Sampler, positive};{food style_options, tôm trắng vùng Vịnh, positive};{food quality, nghêu Manila, positive}","{food quality, Shilshole Sampler, positive};{food quality, cá ngừ, positive};{food quality, tôm trắng, positive};{food quality, sò điệp, positive};{food quality, albacore, positive};{food quality, đậu nành, positive};{food quality, cua Dungeness, positive}" +"Tôi thực sự bị sốc khi đọc những đánh giá không tốt - nơi này địa điểm thật tuyệt vời; nó không làm chúng tôi thất vọng chút nào, và chúng tôi đã ăn ở đây hơn 10 lần.","{restaurant general, địa điểm, positive}","{restaurant general, địa điểm, positive};{restaurant general, địa điểm, negative}" +"Bạn là một người hâm mộ sushi, bạn thích những món ăn được cắt khéo léo cá, tuyệt vời rượu sake, hấp dẫn địa điểm SOHO, và tất nhiên là: Cá hồi, Cá ngừ, Cá bơn, Cá đuôi vàng, Cá tuyết, Cá thu, Sứa cá, Nhím biển, Tôm, Tôm hùm, Cá tráp biển, Cá hồi, Cá sữa, Cá ngừ vây xanh, Lươn, Cua, Cá mòi, Cá đuối, Trứng cá, Sò điệp, Hàu và nhiều loại Cá Toro.","{drinks quality, rượu sake, positive};{food style_options, cá, positive};{food quality, sushi, positive};{food style_options, Cá Toro, positive};{location general, địa điểm SOHO, positive}","{food quality, Cá hồi, positive};{food quality, Cá ngừ, positive};{food quality, Sứa cá, positive};{food quality, Cá bơn, positive};{food quality, Cá đuôi vàng, positive};{food quality, Cá tuyết, positive};{food quality, Cá thu, positive};{food quality, Tôm, positive};{food quality, Tôm hùm, positive};{food quality, Cá tráp biển, positive};{food quality, Cá sữa, positive};{food quality, Cá ngừ vây" +dịch vụ thật tuyệt vời ở nơi vui vẻ này địa điểm.,"{restaurant general, địa điểm, positive};{service general, dịch vụ, positive}","{service general, dịch vụ, positive}" +"Ngoài ra, chỉ có một buồng vệ sinh - có lẽ cần nhiều hơn vì có quá đông người như vậy.","{restaurant miscellaneous, buồng vệ sinh, negative}","{restaurant miscellaneous, null, negative}" +Chúng tôi rời đi mà không bao giờ nhận được dịch vụ.,"{service general, dịch vụ, negative}","{service general, dịch vụ, negative}" +Tôi thích nó .,"{restaurant general, null, positive}","{restaurant general, null, positive}" +– Tôi thực sự khuyên bạn nên dùng Mioposto.,"{restaurant general, Mioposto, positive}","{restaurant general, Miop, positive}" +"đồ ăn tuyệt vời, chính thống, ngon và rất, rất phải chăng.","{food quality, đồ ăn, positive};{food prices, đồ ăn, positive}","{food quality, đồ ăn, positive}" +Tôi đã ăn ở đây ba lần và thấy chất lượng và sự đa dạng của các món cá là tuyệt vời.,"{food quality, cá, positive};{food style_options, cá, positive}","{food quality, cá, positive};{food style_options, cá, positive}" +"Nhưng cô ấy lại rất thân thiện với một số người, khiến mọi chuyện càng trở nên khó chịu hơn.","{service general, null, negative}","{service general, null, negative}" +thực đơn thông thường ở đây hơi nhỉnh hơn mức trung bình nhưng không đáng để bạn phải nhận thái độ khinh thường.,"{food quality, thực đơn thông thường, neutral};{service general, null, negative}","{food quality, thực đơn, neutral}" +"Ngoài ra, họ còn phục vụ món hummus ngon nhất ở Mỹ, với một ít dầu ô liu thơm (tôi tin rằng đó là cách truyền thống)!","{food quality, hummus, positive};{food style_options, hummus, positive}","{food quality, hummus, positive};{food quality, dầu ô liu, positive}" +tuyệt vời bia,"{drinks quality, bia, positive}","{restaurant general, bia, positive}" +Hải sản Plus,"{food quality, Hải sản, positive}","{food quality, Hải sản, positive}" +"Thật đáng buồn khi không có nhiều người thường xuyên ăn ở những nơi như thế này, nơi có vẻ đắt tiền vì chúng nằm trong khách sạn... nhưng chúng chắc chắn là nơi bạn không muốn bỏ lỡ, đặc biệt là nếu bạn ở trung tâm thành phố San Jose.","{restaurant general, null, positive}","{restaurant prices, null, negative};{restaurant general, null, positive}" +"Họ phục vụ nó trong một chiếc cốc hình đồng hồ cát cao, gầy để che giấu sự thật rằng bạn đang nhận được một ly nước ép nhỏ với giá nửa gallon trong siêu thị.","{drinks style_options, null, negative};{drinks prices, null, negative}","{food style_options, null, negative};{food prices, null, negative}" +"đồ ăn thì ổn, nhưng dịch vụ thì tệ đến mức đồ ăn đều nguội lạnh mặc dù mọi người trong đoàn tôi đều được phục vụ.","{food quality, đồ ăn, neutral};{service general, dịch vụ, negative}","{food quality, đồ ăn, negative};{service general, dịch vụ, negative}" +tuyệt vời bữa ăn – cá trên đĩa omikase thực sự tuyệt hảo -- không hề có chút dai nào thường thấy ở sushi ngon -- món cá này thật hoàn hảo! ! ! ! !,"{food quality, bữa ăn, positive};{food quality, cá trên đĩa omikase, positive}","{food quality, bữa ăn, positive};{food quality, omikase, positive}" +"Đồ uống rất tuyệt, và tôi cảm thấy như mình đang ở một quốc gia thế giới thứ ba khi bước vào cửa.","{drinks quality, Đồ uống, positive};{ambience general, null, positive}","{drinks quality, Đồ uống, positive};{ambience general, null, positive}" +Mở & Mát Địa điểm với những món ngon nhất Pizza và Cà phê,"{ambience general, Địa điểm, positive};{drinks quality, Cà phê, positive};{food quality, Pizza, positive}","{food quality, Pizza, positive};{drinks quality, Cà phê, positive}" +Kem brulee trà xanh là món không thể bỏ qua!,"{food quality, Kem brulee trà xanh, positive}","{food quality, trà xanh, positive}" +Tôi đã tìm được một ngôi nhà mới và vừa chuyển đến đây sau khi ký hợp đồng thuê nhà dài hạn.,"{restaurant general, null, positive}","{restaurant miscellaneous, null, positive}" +"Họ không phải là những người nói nhiều, nhưng mỗi lần tôi đến đó, họ đều rất bận rộn, có lẽ điều này giải thích cho việc họ ít trò chuyện.","{service general, null, neutral}","{service general, null, negative}" +"Bản thân chiếc pizza pizza không hẳn là chiếc pizza ngon nhất mà tôi từng ăn, nhưng vẫn khá ngon.","{food quality, pizza, positive}","{food quality, pizza, positive}" +"Lần thứ hai chúng tôi cũng gặp tình trạng tương tự người phục vụ, vì vậy có thể dịch vụ không đồng đều và chúng tôi may mắn.","{service general, người phục vụ, positive}","{service general, dịch vụ, negative}" +– Đó là một tuyên bố lớn khi biết rằng tôi đã bắt cua và tự làm bánh từ khi tôi khoảng bảy tuổi - nhưng có điều gì đó ở những con quỷ nhỏ này ngày càng trở nên ngon hơn.,"{food quality, bánh, positive}","{food quality, quỷ, positive}" +Tuyệt vời Đồ ăn Ý!,"{food quality, Đồ ăn Ý, positive}","{food quality, Đồ ăn Ý, positive}" +"Tuy nhiên, nơi này địa điểm là một viên ngọc quý, và tôi sẽ không ngừng quay lại.","{restaurant general, địa điểm, positive}","{restaurant general, địa điểm, positive}" +"Quán rất đông, vì vậy hãy đến sớm để có chỗ ngồi, nếu bạn phải đợi thì cũng không sao vì dịch vụ rất nhanh!","{service general, dịch vụ, positive}","{restaurant miscellaneous, Quán, neutral};{service general, dịch vụ, positive}" +"Bữa tối chỉ kéo dài khoảng một giờ và giá cả cũng ổn so với khu vực này, gần 50 đô la/người sau thuế và tiền boa (mức trung bình).","{restaurant prices, null, neutral}","{restaurant prices, null, neutral};{restaurant general, null, neutral}" +hành tây chiên giòn thật tuyệt!,"{food quality, hành tây chiên giòn, positive}","{food quality, hành tây chiên, positive}" +Nếu bạn đang ở khu vực này thì bạn không nên thất vọng.,"{restaurant general, null, positive}","{restaurant general, null, positive}" +– Khu tài chính lớn địa điểm của Mexico.,"{restaurant general, địa điểm của Mexico, positive}","{restaurant general, địa điểm, positive}" +lượt quay đặc biệt của nhà thực sự rất tốt.,"{food quality, lượt quay đặc biệt của nhà, positive}","{food quality, lượt quay, positive}" +nhân viên phục vụ rất có kinh nghiệm và luôn sẵn lòng giúp bạn kết hợp đồ uống theo khẩu vị món ăn hoặc ngược lại.,"{service general, nhân viên phục vụ, positive}","{service general, nhân viên phục vụ, positive}" +Sự hoàn hảo .,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Kém dịch vụ khách hàng / kém pizza .,"{food quality, pizza, negative};{service general, dịch vụ khách hàng, negative}","{food quality, pizza, negative};{service general, dịch vụ khách hàng, negative}" +"Nhìn chung, tôi sẽ quay lại và ăn ở nhà hàng một lần nữa.","{restaurant general, null, positive}","{restaurant general, nhà hàng, positive}" +Người phục vụ đã đưa ra một số sake gợi ý rất hay.,"{drinks quality, sake, positive};{service general, Người phục vụ, positive}","{drinks quality, sake gợi ý, positive}" +Nhận xét tiêu cực duy nhất của tôi là tôi ước miếng lớn hơn một chút.,"{food style_options, miếng, negative}","{food style_options, null, negative}" +"Tôi đã chọn măng tây, nó thực sự rất ngon và được chế biến hoàn hảo.","{food quality, măng tây, positive}","{food quality, măng tây, positive}" +Điều có thể khiến nhiều người quan tâm là thái độ/dịch vụ tệ nhất lại đến từ chủ sở hữu của cơ sở này.,"{service general, chủ sở hữu, negative}","{service general, thái độ, negative}" +Nhược điểm duy nhất là địa điểm này thực sự đắt đỏ và khẩu phần thì khá ít.,"{restaurant prices, địa điểm, negative};{food style_options, khẩu phần, negative}","{restaurant prices, địa điểm, negative};{food style_options, khẩu phần, negative}" +"Tệ dịch vụ, đồ ăn ổn, đắt","{restaurant prices, null, negative};{food quality, đồ ăn, neutral};{service general, dịch vụ, negative}","{food quality, đồ ăn, neutral};{service general, dịch vụ, negative};{food prices, đồ ăn, negative}" +Mặc dù dịch vụ có thể được cải thiện khi xem xét đến số tiền bạn bỏ ra.,"{service general, dịch vụ, negative}","{restaurant prices, null, negative}" +"Bạn thường xuyên nhìn thấy những gia đình và bạn bè người Ấn Độ dùng bữa ở đó, đó luôn là một dấu hiệu tốt.","{restaurant miscellaneous, null, positive}","{restaurant miscellaneous, null, positive}" +"Nếu tôi muốn xếp hàng vào Chủ Nhật trong một giờ để có được mức trung bình đồ ăn sáng muộn, thì tôi sẽ đặt Murphy lên đầu danh sách.","{food quality, đồ ăn sáng muộn, neutral};{service general, null, negative}","{restaurant general, Murphy, positive}" +Với số lượng thực phẩm chúng tôi nhận được thì giá phải thấp hơn.,"{food prices, thực phẩm, negative}","{food prices, thực phẩm, negative}" +"Luôn luôn bận rộn, nhưng họ rất giỏi trong việc sắp xếp chỗ ngồi cho bạn đúng giờ và phục vụ nhanh chóng .","{service general, null, positive}","{service general, null, positive};{restaurant miscellaneous, null, neutral}" +danh sách rượu vang thật tuyệt vời và đồ ăn làm tôi nhớ đến chuyến đi Ý gần đây của tôi.,"{drinks style_options, danh sách rượu vang, positive}","{drinks style_options, danh sách rượu vang, positive}" +"đồ ăn rất tuyệt, rượu margarita cũng vậy nhưng cô hầu bàn quá bận rộn với nhóm khách lớn hơn của cô ấy mà không chăm sóc tốt hơn cho tôi và bạn tôi.","{drinks quality, rượu margarita, positive};{food quality, đồ ăn, positive};{service general, cô hầu bàn, negative}","{service general, null, negative};{drinks quality, rượu margarita, positive};{food quality, đồ ăn, positive}" +Tôi không thể nói đủ điều tốt về nhà hàng này và tôi không thể chờ đợi cho những lần ghé thăm tiếp theo của mình.,"{restaurant general, null, positive}","{restaurant general, nhà hàng, positive}" +Yêu nó mọi lúc,"{restaurant general, null, positive}","{restaurant general, null, positive}" +Chúng tôi là người địa phương và có cảm giác rằng cách duy nhất nơi này tồn tại được ở mức trung bình như vậy đồ ăn là vì hầu hết khách hàng có lẽ chỉ là khách du lịch một lần.,"{food quality, đồ ăn, negative}","{food quality, đồ ăn, negative}" +Tôi cũng thích món salad caeser của họ.,"{food quality, salad caeser, positive}","{food quality, salad caeser, positive}" +Cô ấy không làm cho bạn cảm thấy được chào đón và đối xử với bạn như một sự phiền toái.,"{service general, null, negative}","{service general, null, negative}" +Kích thước vừa phải cho thực đơn.,"{restaurant miscellaneous, null, positive}","{food style_options, thực đơn, positive}" +đồ ăn thật tuyệt vời và nhân viên phục vụ luôn hoàn hảo mỗi lần chúng tôi đến đó.,"{food quality, đồ ăn, positive};{service general, nhân viên phục vụ, positive}","{food quality, đồ ăn, positive};{service general, nhân viên, positive}" +món tráng miệng là cái kết hoàn hảo cho một bữa tối gần như hoàn hảo.,"{food quality, món tráng miệng, positive};{food quality, bữa tối, positive}","{food quality, món tráng miệng, positive}" +"Tôi đã từng đến đây, đã chi rất nhiều tiền cho một bữa tối đặc biệt đầu bếp và đó là một sự thất vọng lớn.","{food quality, đầu bếp, negative};{food prices, đầu bếp, negative}","{food quality, đầu bếp, negative};{restaurant prices, null, negative}" +TÔI ĐÃ TÌM THẤY MỘT NGÔI NHÀ MỚI TRÊN ĐƯỜNG SECOND AVENUE ! ! ! ! ! ! ! ! ! ! !,"{restaurant general, null, positive}","{restaurant general, null, positive}" +"– Phải đợi ba mươi phút để vào cửa vào sáng thứ ba, nhưng thật đáng giá.","{restaurant general, null, positive};{restaurant miscellaneous, null, negative}","{restaurant general, null, positive};{service general, null, negative}" +"– Thật buồn khi thấy một địa điểm từng là ``THÀNH PHỐ `` địa điểm để gặp gỡ và ăn sáng hoặc ăn trưa, giờ đây lại trở thành địa điểm trở thành ``ĐỪNG QUAN TÂM `` lớn.","{restaurant general, địa điểm, negative}","{restaurant general, địa điểm, negative}" +"gà chanh có vị giống như bánh rán ngọt dẻo và tôm óc chó mật ong, một số ít mà họ thực sự mang đến cho bạn ... thì không ngon.","{food quality, tôm óc chó mật ong, negative};{food style_options, tôm óc chó mật ong, negative};{food quality, gà chanh, negative}","{food quality, tôm óc chó mật ong, negative};{food quality, gà chanh, negative}" +"Thật lãng mạn - và thậm chí tuyệt vời ngay cả khi đi cùng chị gái tôi, khiến tôi nhớ đến nước Ý, và có tác phẩm nghệ thuật và âm nhạc giúp duy trì cảm giác như đang ở trong một biệt thự Địa Trung Hải.","{ambience general, âm nhạc, positive};{ambience general, null, positive};{ambience general, tác phẩm nghệ thuật, positive}","{ambience general, null, positive}" +sushi rất tuyệt vời và nhân viên phục vụ rất nhanh nhẹn.,"{service general, nhân viên phục vụ, positive};{food quality, sushi, positive}","{service general, nhân viên, positive};{food quality, sushi, positive}" +"Trên thực tế, nhiều người muốn quay lại lần thứ hai sau chuyến thăm này.","{restaurant general, null, positive}","{restaurant general, null, positive}" +– Tốt nhất Nhà hàng Mexico để ăn trưa ở khu tài chính.,"{restaurant general, Nhà hàng Mexico, positive}","{restaurant general, Nhà hàng, positive}" +tôi thích nơi này địa điểm!,"{restaurant general, địa điểm, positive}","{restaurant general, địa điểm, positive}" +bầu không khí thật tuyệt vời.,"{ambience general, bầu không khí, positive}","{ambience general, bầu không khí, positive}" +Thích hợp cho một ngày lạnh.,"{food quality, null, positive}","{restaurant general, null, positive}"