Upload tokenizer

README.md

@@ -0,0 +1,199 @@
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]

special_tokens_map.json

@@ -0,0 +1,6 @@
+{
+  "bos_token": "<s>",
+  "eos_token": "</s>",
+  "pad_token": "<pad>",
+  "unk_token": "<unk>"
+}

tokenizer.json

@@ -0,0 +1,2423 @@
+{
+  "version": "1.0",
+  "truncation": null,
+  "padding": null,
+  "added_tokens": [
+    {
+      "id": 0,
+      "content": "<unk>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 1,
+      "content": "<s>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2,
+      "content": "</s>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 3,
+      "content": "<pad>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    }
+  ],
+  "normalizer": {
+    "type": "Sequence",
+    "normalizers": [
+      {
+        "type": "Lowercase"
+      }
+    ]
+  },
+  "pre_tokenizer": null,
+  "post_processor": {
+    "type": "TemplateProcessing",
+    "single": [
+      {
+        "SpecialToken": {
+          "id": "<s>",
+          "type_id": 0
+        }
+      },
+      {
+        "Sequence": {
+          "id": "A",
+          "type_id": 0
+        }
+      },
+      {
+        "SpecialToken": {
+          "id": "</s>",
+          "type_id": 0
+        }
+      }
+    ],
+    "pair": [
+      {
+        "SpecialToken": {
+          "id": "<s>",
+          "type_id": 0
+        }
+      },
+      {
+        "Sequence": {
+          "id": "A",
+          "type_id": 0
+        }
+      },
+      {
+        "SpecialToken": {
+          "id": "</s>",
+          "type_id": 0
+        }
+      },
+      {
+        "SpecialToken": {
+          "id": "<s>",
+          "type_id": 1
+        }
+      },
+      {
+        "Sequence": {
+          "id": "B",
+          "type_id": 1
+        }
+      },
+      {
+        "SpecialToken": {
+          "id": "</s>",
+          "type_id": 1
+        }
+      }
+    ],
+    "special_tokens": {
+      "</s>": {
+        "id": "</s>",
+        "ids": [
+          2
+        ],
+        "tokens": [
+          "</s>"
+        ]
+      },
+      "<s>": {
+        "id": "<s>",
+        "ids": [
+          1
+        ],
+        "tokens": [
+          "<s>"
+        ]
+      }
+    }
+  },
+  "decoder": {
+    "type": "Sequence",
+    "decoders": []
+  },
+  "model": {
+    "type": "WordLevel",
+    "vocab": {
+      "<unk>": 0,
+      "<s>": 1,
+      "</s>": 2,
+      "<pad>": 3,
+      "'": 4,
+      " ": 5,
+      ",": 6,
+      "a": 7,
+      "n": 8,
+      "i": 9,
+      "u": 10,
+      "t": 11,
+      "e": 12,
+      "s": 13,
+      "r": 14,
+      "k": 15,
+      "g": 16,
+      "d": 17,
+      "o": 18,
+      "l": 19,
+      "m": 20,
+      "p": 21,
+      "é": 22,
+      "h": 23,
+      "b": 24,
+      "|": 25,
+      "j": 26,
+      "[": 27,
+      "]": 28,
+      "y": 29,
+      "c": 30,
+      "w": 31,
+      "\"": 32,
+      "0": 33,
+      "1": 34,
+      "f": 35,
+      "2": 36,
+      "-": 37,
+      "9": 38,
+      "v": 39,
+      "3": 40,
+      ".": 41,
+      ")": 42,
+      "(": 43,
+      "5": 44,
+      "4": 45,
+      "6": 46,
+      "8": 47,
+      "7": 48,
+      "z": 49,
+      ":": 50,
+      "/": 51,
+      "x": 52,
+      ";": 53,
+      "q": 54,
+      "�": 55,
+      "َ": 56,
+      "&": 57,
+      "–": 58,
+      "_": 59,
+      "ل": 60,
+      "ا": 61,
+      "%": 62,
+      "—": 63,
+      "ِ": 64,
+      "”": 65,
+      "ْ": 66,
+      "م": 67,
+      "=": 68,
+      "“": 69,
+      "ن": 70,
+      "ُ": 71,
+      "’": 72,
+      "+": 73,
+      "و": 74,
+      "ي": 75,
+      "ر": 76,
+      "ō": 77,
+      "ّ": 78,
+      "ه": 79,
+      "°": 80,
+      "ب": 81,
+      "ع": 82,
+      "ت": 83,
+      "*": 84,
+      "ك": 85,
+      "ف": 86,
+      "ā": 87,
+      "أ": 88,
+      "²": 89,
+      "ق": 90,
+      "د": 91,
+      "س": 92,
+      "‘": 93,
+      "ö": 94,
+      "á": 95,
+      "ح": 96,
+      "ٱ": 97,
+      "ū": 98,
+      "ج": 99,
+      "$": 100,
+      "ة": 101,
+      "!": 102,
+      "×": 103,
+      "−": 104,
+      "?": 105,
+      "ü": 106,
+      "{": 107,
+      "ə": 108,
+      "إ": 109,
+      "}": 110,
+      "α": 111,
+      "ä": 112,
+      "ذ": 113,
+      "#": 114,
+      "ص": 115,
+      "μ": 116,
+      "ى": 117,
+      "σ": 118,
+      "…": 119,
+      "±": 120,
+      "ó": 121,
+      "ī": 122,
+      "í": 123,
+      "ش": 124,
+      "→": 125,
+      "ĕ": 126,
+      "å": 127,
+      "خ": 128,
+      "\\": 129,
+      "آ": 130,
+      "ٌ": 131,
+      "·": 132,
+      "ز": 133,
+      "ً": 134,
+      "â": 135,
+      "λ": 136,
+      "а": 137,
+      "θ": 138,
+      "ٰ": 139,
+      "ض": 140,
+      "•": 141,
+      "ο": 142,
+      "ط": 143,
+      "è": 144,
+      "ᠳ": 145,
+      "ı": 146,
+      "ν": 147,
+      "ᠭ": 148,
+      "ء": 149,
+      "ς": 150,
+      "‹": 151,
+      "›": 152,
+      "ث": 153,
+      "τ": 154,
+      "ٍ": 155,
+      "ᠵ": 156,
+      "`": 157,
+      "κ": 158,
+      "ω": 159,
+      "्": 160,
+      "ι": 161,
+      "ø": 162,
+      "ḥ": 163,
+      "ě": 164,
+      "ş": 165,
+      "р": 166,
+      "ḍ": 167,
+      "и": 168,
+      "ρ": 169,
+      "ç": 170,
+      "π": 171,
+      "β": 172,
+      "~": 173,
+      "ē": 174,
+      "о": 175,
+      "غ": 176,
+      "с": 177,
+      "ﻟ": 178,
+      "γ": 179,
+      "√": 180,
+      "ː": 181,
+      "ε": 182,
+      "ė": 183,
+      "ा": 184,
+      "ã": 185,
+      "к": 186,
+      "ñ": 187,
+      "н": 188,
+      "،": 189,
+      "′": 190,
+      "ê": 191,
+      "е": 192,
+      "र": 193,
+      "ئ": 194,
+      "ظ": 195,
+      "³": 196,
+      "ᠬ": 197,
+      "ᠨ": 198,
+      "ᠯ": 199,
+      "à": 200,
+      "î": 201,
+      "≤": 202,
+      "ˈ": 203,
+      "½": 204,
+      "δ": 205,
+      "ᮂ": 206,
+      "ᠠ": 207,
+      "ᠮ": 208,
+      "ᠲ": 209,
+      "ô": 210,
+      "ー": 211,
+      "ؤ": 212,
+      "ᠥ": 213,
+      "ś": 214,
+      "£": 215,
+      "ᠰ": 216,
+      "ṁ": 217,
+      "ᠢ": 218,
+      "¥": 219,
+      "ë": 220,
+      "∫": 221,
+      "æ": 222,
+      "л": 223,
+      "ա": 224,
+      "ᠣ": 225,
+      "字": 226,
+      "ﺎ": 227,
+      "б": 228,
+      "ـ": 229,
+      "त": 230,
+      "ł": 231,
+      "ɪ": 232,
+      "η": 233,
+      "ό": 234,
+      "ᴡ": 235,
+      "ﯿ": 236,
+      "š": 237,
+      "φ": 238,
+      "い": 239,
+      "म": 240,
+      "ú": 241,
+      "т": 242,
+      "у": 243,
+      "व": 244,
+      "イ": 245,
+      "ă": 246,
+      "в": 247,
+      "ṣ": 248,
+      "ン": 249,
+      "ﱠ": 250,
+      "º": 251,
+      "ی": 252,
+      "स": 253,
+      "ᠴ": 254,
+      "の": 255,
+      "ć": 256,
+      "м": 257,
+      "«": 258,
+      "č": 259,
+      "ğ": 260,
+      "ʃ": 261,
+      "д": 262,
+      "ु": 263,
+      "ᠩ": 264,
+      "ﺮ": 265,
+      "": 266,
+      "य": 267,
+      "ᠱ": 268,
+      "ᠸ": 269,
+      "う": 270,
+      "大": 271,
+      "ﮫ": 272,
+      "ά": 273,
+      "द": 274,
+      "ि": 275,
+      "≈": 276,
+      "я": 277,
+      "न": 278,
+      "ร": 279,
+      "ṅ": 280,
+      "か": 281,
+      "ん": 282,
+      "名": 283,
+      "ﺑ": 284,
+      "ﻣ": 285,
+      "ð": 286,
+      "ɛ": 287,
+      "ʒ": 288,
+      "ʿ": 289,
+      "п": 290,
+      "ۤ": 291,
+      "ᠷ": 292,
+      "ᮦ": 293,
+      "日": 294,
+      "ꦶ": 295,
+      "ﺪ": 296,
+      "ɔ": 297,
+      "ί": 298,
+      "ᠡ": 299,
+      "ᮨ": 300,
+      "ṇ": 301,
+      "″": 302,
+      "な": 303,
+      "山": 304,
+      "本": 305,
+      "漢": 306,
+      "音": 307,
+      "µ": 308,
+      "»": 309,
+      "ï": 310,
+      "ù": 311,
+      "ţ": 312,
+      "ɡ": 313,
+      "̇": 314,
+      "υ": 315,
+      "χ": 316,
+      "क": 317,
+      "ṭ": 318,
+      "中": 319,
+      "ﻠ": 320,
+      "´": 321,
+      "ն": 322,
+      "া": 323,
+      "ာ": 324,
+      "ᠪ": 325,
+      "ᮥ": 326,
+      "ス": 327,
+      "ヴ": 328,
+      "・": 329,
+      "ﺒ": 330,
+      "ﻤ": 331,
+      "ﻨ": 332,
+      "έ": 333,
+      "ή": 334,
+      "г": 335,
+      "ध": 336,
+      "า": 337,
+      "ト": 338,
+      "ル": 339,
+      "京": 340,
+      "天": 341,
+      "子": 342,
+      "東": 343,
+      "ò": 344,
+      "ń": 345,
+      "ᠶ": 346,
+      "ィ": 347,
+      "田": 348,
+      "ﻋ": 349,
+      "ì": 350,
+      "ы": 351,
+      "ѐ": 352,
+      "ल": 353,
+      "ม": 354,
+      "‑": 355,
+      "∞": 356,
+      "●": 357,
+      "あ": 358,
+      "は": 359,
+      "カ": 360,
+      "十": 361,
+      "ﯾ": 362,
+      "ﻢ": 363,
+      "@": 364,
+      "भ": 365,
+      "ी": 366,
+      "き": 367,
+      "一": 368,
+      "木": 369,
+      "ﺤ": 370,
+      "ﻦ": 371,
+      "ﻰ": 372,
+      "û": 373,
+      "ž": 374,
+      "з": 375,
+      "й": 376,
+      "ч": 377,
+      "ो": 378,
+      "≥": 379,
+      "ず": 380,
+      "て": 381,
+      "に": 382,
+      "ア": 383,
+      "五": 384,
+      "人": 385,
+      "国": 386,
+      "花": 387,
+      "성": 388,
+      "ﷲ": 389,
+      "ﻓ": 390,
+      "ﻛ": 391,
+      "^": 392,
+      "¼": 393,
+      "́": 394,
+      "ζ": 395,
+      "х": 396,
+      "ה": 397,
+      "ण": 398,
+      "प": 399,
+      "े": 400,
+      "ย": 401,
+      "เ": 402,
+      "ა": 403,
+      "ᮀ": 404,
+      "€": 405,
+      "お": 406,
+      "じ": 407,
+      "す": 408,
+      "り": 409,
+      "ウ": 410,
+      "タ": 411,
+      "ノ": 412,
+      "ラ": 413,
+      "行": 414,
+      "김": 415,
+      "대": 416,
+      "ﻜ": 417,
+      "ﻞ": 418,
+      "ﻮ": 419,
+      "¬": 420,
+      "ß": 421,
+      "ť": 422,
+      "ǎ": 423,
+      "ɑ": 424,
+      "ʊ": 425,
+      "ր": 426,
+      "अ": 427,
+      "ল": 428,
+      "မ": 429,
+      "フ": 430,
+      "三": 431,
+      "上": 432,
+      "北": 433,
+      "和": 434,
+      "市": 435,
+      "文": 436,
+      "語": 437,
+      "金": 438,
+      "산": 439,
+      "한": 440,
+      "ﻘ": 441,
+      "ŋ": 442,
+      "י": 443,
+      "ं": 444,
+      "ह": 445,
+      "ด": 446,
+      "ล": 447,
+      "ი": 448,
+      "ら": 449,
+      "る": 450,
+      "オ": 451,
+      "二": 452,
+      "富": 453,
+      "海": 454,
+      "皇": 455,
+      "道": 456,
+      "꧀": 457,
+      "ﺘ": 458,
+      "ﻌ": 459,
+      "œ": 460,
+      "ʰ": 461,
+      "ʾ": 462,
+      "̥": 463,
+      "ύ": 464,
+      "ъ": 465,
+      "ե": 466,
+      "ו": 467,
+      "ל": 468,
+      "מ": 469,
+      "พ": 470,
+      "ิ": 471,
+      "်": 472,
+      "ἀ": 473,
+      "∈": 474,
+      "が": 475,
+      "さ": 476,
+      "つ": 477,
+      "づ": 478,
+      "み": 479,
+      "ゐ": 480,
+      "シ": 481,
+      "ド": 482,
+      "ナ": 483,
+      "リ": 484,
+      "古": 485,
+      "城": 486,
+      "平": 487,
+      "新": 488,
+      "西": 489,
+      "都": 490,
+      "ꦠ": 491,
+      "ﺗ": 492,
+      "đ": 493,
+      "ħ": 494,
+      "ſ": 495,
+      "ǐ": 496,
+      "ի": 497,
+      "ר": 498,
+      "च": 499,
+      "ज": 500,
+      "ब": 501,
+      "ব": 502,
+      "ว": 503,
+      "ṛ": 504,
+      "え": 505,
+      "こ": 506,
+      "た": 507,
+      "ち": 508,
+      "ぢ": 509,
+      "ま": 510,
+      "よ": 511,
+      "ク": 512,
+      "コ": 513,
+      "サ": 514,
+      "チ": 515,
+      "ッ": 516,
+      "テ": 517,
+      "下": 518,
+      "仁": 519,
+      "四": 520,
+      "國": 521,
+      "島": 522,
+      "川": 523,
+      "村": 524,
+      "省": 525,
+      "草": 526,
+      "郡": 527,
+      "部": 528,
+      "駅": 529,
+      "高": 530,
+      "ꦁ": 531,
+      "ꦤ": 532,
+      "동": 533,
+      "부": 534,
+      "왕": 535,
+      "ﮭ": 536,
+      "ﺳ": 537,
+      "ﻧ": 538,
+      "ﻻ": 539,
+      "）": 540,
+      "：": 541,
+      "þ": 542,
+      "ʔ": 543,
+      "ʻ": 544,
+      "͡": 545,
+      "ξ": 546,
+      "ц": 547,
+      "э": 548,
+      "յ": 549,
+      "ւ": 550,
+      "؟": 551,
+      "श": 552,
+      "อ": 553,
+      "ြ": 554,
+      "ე": 555,
+      "ṃ": 556,
+      "ẓ": 557,
+      "ẽ": 558,
+      "↔": 559,
+      "め": 560,
+      "ゅ": 561,
+      "ろ": 562,
+      "ゑ": 563,
+      "ァ": 564,
+      "ェ": 565,
+      "ハ": 566,
+      "メ": 567,
+      "万": 568,
+      "仮": 569,
+      "台": 570,
+      "士": 571,
+      "有": 572,
+      "線": 573,
+      "野": 574,
+      "長": 575,
+      "ꦮ": 576,
+      "ꦱ": 577,
+      "씨": 578,
+      "이": 579,
+      "정": 580,
+      "ﺔ": 581,
+      "ﺣ": 582,
+      "ﺴ": 583,
+      "（": 584,
+      "－": 585,
+      "ý": 586,
+      "ę": 587,
+      "ǔ": 588,
+      "ʼ": 589,
+      "ж": 590,
+      "հ": 591,
+      "տ": 592,
+      "ם": 593,
+      "ת": 594,
+      "چ": 595,
+      "ग": 596,
+      "ष": 597,
+      "॑": 598,
+      "ค": 599,
+      "ง": 600,
+      "จ": 601,
+      "ท": 602,
+      "ส": 603,
+      "ะ": 604,
+      "ุ": 605,
+      "་": 606,
+      "န": 607,
+      "း": 608,
+      "რ": 609,
+      "ữ": 610,
+      "℃": 611,
+      "№": 612,
+      "○": 613,
+      "く": 614,
+      "け": 615,
+      "っ": 616,
+      "ね": 617,
+      "ょ": 618,
+      "れ": 619,
+      "を": 620,
+      "キ": 621,
+      "ケ": 622,
+      "ジ": 623,
+      "ツ": 624,
+      "デ": 625,
+      "ブ": 626,
+      "マ": 627,
+      "ム": 628,
+      "レ": 629,
+      "ヱ": 630,
+      "ヶ": 631,
+      "之": 632,
+      "体": 633,
+      "六": 634,
+      "南": 635,
+      "地": 636,
+      "宮": 637,
+      "小": 638,
+      "屋": 639,
+      "岐": 640,
+      "年": 641,
+      "府": 642,
+      "当": 643,
+      "支": 644,
+      "月": 645,
+      "王": 646,
+      "節": 647,
+      "者": 648,
+      "耳": 649,
+      "血": 650,
+      "郎": 651,
+      "ꦂ": 652,
+      "ꦫ": 653,
+      "구": 654,
+      "비": 655,
+      "시": 656,
+      "후": 657,
+      "ﷺ": 658,
+      "ŏ": 659,
+      "ɒ": 660,
+      "ɲ": 661,
+      "ʈ": 662,
+      "ʌ": 663,
+      "˚": 664,
+      "ь": 665,
+      "і": 666,
+      "ո": 667,
+      "ռ": 668,
+      "ג": 669,
+      "כ": 670,
+      "ש": 671,
+      "پ": 672,
+      "ڠ": 673,
+      "ट": 674,
+      "थ": 675,
+      "ृ": 676,
+      "॒": 677,
+      "ি": 678,
+      "ු": 679,
+      "ก": 680,
+      "น": 681,
+      "้": 682,
+      "စ": 683,
+      "თ": 684,
+      "ს": 685,
+      "ᮤ": 686,
+      "ệ": 687,
+      "ῖ": 688,
+      "⁰": 689,
+      "〒": 690,
+      "し": 691,
+      "と": 692,
+      "ふ": 693,
+      "む": 694,
+      "も": 695,
+      "ゃ": 696,
+      "ニ": 697,
+      "ヒ": 698,
+      "九": 699,
+      "代": 700,
+      "信": 701,
+      "多": 702,
+      "太": 703,
+      "常": 704,
+      "式": 705,
+      "楽": 706,
+      "母": 707,
+      "江": 708,
+      "洲": 709,
+      "片": 710,
+      "生": 711,
+      "用": 712,
+      "県": 713,
+      "立": 714,
+      "葉": 715,
+      "藤": 716,
+      "読": 717,
+      "鉄": 718,
+      "阜": 719,
+      "龍": 720,
+      "ꦺ": 721,
+      "국": 722,
+      "민": 723,
+      "서": 724,
+      "인": 725,
+      "지": 726,
+      "현": 727,
+      "ﺟ": 728,
+      "ﺬ": 729,
+      "ﻲ": 730,
+      "ﻼ": 731,
+      "🛄": 732,
+      "¹": 733,
+      "ġ": 734,
+      "ľ": 735,
+      "ɐ": 736,
+      "ʎ": 737,
+      "ʏ": 738,
+      "ʕ": 739,
+      "ʷ": 740,
+      "ˠ": 741,
+      "̄": 742,
+      "ј": 743,
+      "қ": 744,
+      "թ": 745,
+      "ב": 746,
+      "ד": 747,
+      "ח": 748,
+      "ן": 749,
+      "ک": 750,
+      "ड": 751,
+      "ং": 752,
+      "জ": 753,
+      "ത": 754,
+      "ช": 755,
+      "บ": 756,
+      "ห": 757,
+      "ี": 758,
+      "ู": 759,
+      "็": 760,
+      "ဘ": 761,
+      "ლ": 762,
+      "ო": 763,
+      "᳂": 764,
+      "ḗ": 765,
+      "ẻ": 766,
+      "ố": 767,
+      "⅓": 768,
+      "⋅": 769,
+      "♯": 770,
+      "⚖": 771,
+      "そ": 772,
+      "ば": 773,
+      "ひ": 774,
+      "へ": 775,
+      "ゆ": 776,
+      "わ": 777,
+      "ゥ": 778,
+      "ォ": 779,
+      "ガ": 780,
+      "ゴ": 781,
+      "ネ": 782,
+      "バ": 783,
+      "モ": 784,
+      "ヨ": 785,
+      "ロ": 786,
+      "ワ": 787,
+      "井": 788,
+      "使": 789,
+      "元": 790,
+      "千": 791,
+      "华": 792,
+      "历": 793,
+      "原": 794,
+      "圓": 795,
+      "土": 796,
+      "夜": 797,
+      "急": 798,
+      "成": 799,
+      "戸": 800,
+      "手": 801,
+      "拉": 802,
+      "教": 803,
+      "方": 804,
+      "明": 805,
+      "春": 806,
+      "朗": 807,
+      "朝": 808,
+      "林": 809,
+      "楚": 810,
+      "橋": 811,
+      "民": 812,
+      "湖": 813,
+      "滅": 814,
+      "濁": 815,
+      "灣": 816,
+      "点": 817,
+      "犬": 818,
+      "申": 819,
+      "紫": 820,
+      "菜": 821,
+      "華": 822,
+      "言": 823,
+      "訓": 824,
+      "近": 825,
+      "銀": 826,
+      "黄": 827,
+      "鼻": 828,
+      "기": 829,
+      "남": 830,
+      "도": 831,
+      "면": 832,
+      "문": 833,
+      "빈": 834,
+      "스": 835,
+      "위": 836,
+      "장": 837,
+      "중": 838,
+      "해": 839,
+      "ﱡ": 840,
+      "ﱢ": 841,
+      "ﺰ": 842,
+      "®": 843,
+      "¾": 844,
+      "ĝ": 845,
+      "ř": 846,
+      "ŭ": 847,
+      "ư": 848,
+      "ƹ": 849,
+      "ȝ": 850,
+      "ɟ": 851,
+      "ɳ": 852,
+      "ʂ": 853,
+      "ʲ": 854,
+      "̀": 855,
+      "̂": 856,
+      "ψ": 857,
+      "ф": 858,
+      "ї": 859,
+      "ў": 860,
+      "ղ": 861,
+      "ս": 862,
+      "վ": 863,
+      "ք": 864,
+      "ֶ": 865,
+      "ז": 866,
+      "ע": 867,
+      "؛": 868,
+      "گ": 869,
+      "ە": 870,
+      "ः": 871,
+      "ू": 872,
+      "ौ": 873,
+      "ট": 874,
+      "স": 875,
+      "ে": 876,
+      "ி": 877,
+      "്": 878,
+      "ර": 879,
+      "්": 880,
+      "ป": 881,
+      "ศ": 882,
+      "่": 883,
+      "າ": 884,
+      "ཡ": 885,
+      "ར": 886,
+      "က": 887,
+      "သ": 888,
+      "ვ": 889,
+      "ḳ": 890,
+      "ị": 891,
+      "ọ": 892,
+      "ồ": 893,
+      "ộ": 894,
+      "ὀ": 895,
+      "ὑ": 896,
+      "ῶ": 897,
+      "ℓ": 898,
+      "←": 899,
+      "∑": 900,
+      "⊂": 901,
+      "■": 902,
+      "▲": 903,
+      "、": 904,
+      "ぁ": 905,
+      "ぃ": 906,
+      "ぐ": 907,
+      "せ": 908,
+      "ぬ": 909,
+      "や": 910,
+      "゛": 911,
+      "゜": 912,
+      "エ": 913,
+      "グ": 914,
+      "ソ": 915,
+      "パ": 916,
+      "ビ": 917,
+      "ュ": 918,
+      "ョ": 919,
+      "ヰ": 920,
+      "七": 921,
+      "不": 922,
+      "云": 923,
+      "今": 924,
+      "伊": 925,
+      "八": 926,
+      "前": 927,
+      "加": 928,
+      "化": 929,
+      "口": 930,
+      "員": 931,
+      "基": 932,
+      "外": 933,
+      "夫": 934,
+      "学": 935,
+      "安": 936,
+      "宗": 937,
+      "岩": 938,
+      "岳": 939,
+      "岸": 940,
+      "州": 941,
+      "左": 942,
+      "幹": 943,
+      "庁": 944,
+      "弘": 945,
+      "張": 946,
+      "斎": 947,
+      "時": 948,
+      "曜": 949,
+      "服": 950,
+      "李": 951,
+      "森": 952,
+      "氏": 953,
+      "水": 954,
+      "沙": 955,
+      "河": 956,
+      "波": 957,
+      "洋": 958,
+      "津": 959,
+      "清": 960,
+      "湾": 961,
+      "源": 962,
+      "準": 963,
+      "濃": 964,
+      "火": 965,
+      "無": 966,
+      "特": 967,
+      "男": 968,
+      "町": 969,
+      "白": 970,
+      "盾": 971,
+      "矛": 972,
+      "石": 973,
+      "秋": 974,
+      "科": 975,
+      "稲": 976,
+      "空": 977,
+      "竹": 978,
+      "米": 979,
+      "羅": 980,
+      "肉": 981,
+      "自": 982,
+      "與": 983,
+      "表": 984,
+      "袋": 985,
+      "谷": 986,
+      "赤": 987,
+      "配": 988,
+      "釜": 989,
+      "鈴": 990,
+      "阪": 991,
+      "陽": 992,
+      "雲": 993,
+      "雷": 994,
+      "青": 995,
+      "飛": 996,
+      "馬": 997,
+      "體": 998,
+      "鬻": 999,
+      "鳥": 1000,
+      "麻": 1001,
+      "ꦏ": 1002,
+      "ꦥ": 1003,
+      "ꦩ": 1004,
+      "ꦸ": 1005,
+      "ꦼ": 1006,
+      "가": 1007,
+      "계": 1008,
+      "공": 1009,
+      "금": 1010,
+      "다": 1011,
+      "립": 1012,
+      "말": 1013,
+      "박": 1014,
+      "선": 1015,
+      "연": 1016,
+      "요": 1017,
+      "원": 1018,
+      "윤": 1019,
+      "전": 1020,
+      "제": 1021,
+      "주": 1022,
+      "진": 1023,
+      "천": 1024,
+      "체": 1025,
+      "키": 1026,
+      "호": 1027,
+      "ﺞ": 1028,
+      "ﺠ": 1029,
+      "ﺢ": 1030,
+      "ﺻ": 1031,
+      "ﻊ": 1032,
+      "ﻔ": 1033,
+      "～": 1034,
+      "🚭": 1035,
+      "÷": 1036,
+      "ą": 1037,
+      "ő": 1038,
+      "ź": 1039,
+      "ż": 1040,
+      "ƒ": 1041,
+      "ơ": 1042,
+      "ǒ": 1043,
+      "ɕ": 1044,
+      "ɖ": 1045,
+      "ɣ": 1046,
+      "ɨ": 1047,
+      "ɫ": 1048,
+      "ɴ": 1049,
+      "ɾ": 1050,
+      "ʁ": 1051,
+      "ʋ": 1052,
+      "ˌ": 1053,
+      "̣": 1054,
+      "̩": 1055,
+      "̪": 1056,
+      "̰": 1057,
+      "ώ": 1058,
+      "ϑ": 1059,
+      "ю": 1060,
+      "ғ": 1061,
+      "һ": 1062,
+      "ә": 1063,
+      "զ": 1064,
+      "լ": 1065,
+      "ծ": 1066,
+      "մ": 1067,
+      "պ": 1068,
+      "ջ": 1069,
+      "ֹ": 1070,
+      "ּ": 1071,
+      "ט": 1072,
+      "ק": 1073,
+      "ٓ": 1074,
+      "ژ": 1075,
+      "ھ": 1076,
+      "ۇ": 1077,
+      "ۖ": 1078,
+      "इ": 1079,
+      "ख": 1080,
+      "ै": 1081,
+      "।": 1082,
+      "গ": 1083,
+      "ঙ": 1084,
+      "ভ": 1085,
+      "য": 1086,
+      "়": 1087,
+      "ী": 1088,
+      "ু": 1089,
+      "৳": 1090,
+      "ં": 1091,
+      "ત": 1092,
+      "દ": 1093,
+      "મ": 1094,
+      "ર": 1095,
+      "ા": 1096,
+      "ો": 1097,
+      "த": 1098,
+      "ப": 1099,
+      "ல": 1100,
+      "ழ": 1101,
+      "ு": 1102,
+      "்": 1103,
+      "ം": 1104,
+      "ആ": 1105,
+      "ന": 1106,
+      "പ": 1107,
+      "ක": 1108,
+      "ප": 1109,
+      "ල": 1110,
+      "ව": 1111,
+      "ෙ": 1112,
+      "ณ": 1113,
+      "ธ": 1114,
+      "ั": 1115,
+      "โ": 1116,
+      "ག": 1117,
+      "མ": 1118,
+      "ོ": 1119,
+      "ေ": 1120,
+      "ბ": 1121,
+      "მ": 1122,
+      "უ": 1123,
+      "ქ": 1124,
+      "ხ": 1125,
+      "ት": 1126,
+      "ኢ": 1127,
+      "ያ": 1128,
+      "ዮ": 1129,
+      "ጵ": 1130,
+      "ត": 1131,
+      "ᨀ": 1132,
+      "ᨔ": 1133,
+      "ᮬ": 1134,
+      "ṗ": 1135,
+      "ṯ": 1136,
+      "ạ": 1137,
+      "ả": 1138,
+      "ấ": 1139,
+      "ẹ": 1140,
+      "ế": 1141,
+      "ể": 1142,
+      "ἄ": 1143,
+      "ἡ": 1144,
+      "ἴ": 1145,
+      "ὐ": 1146,
+      "ᾶ": 1147,
+      "ῆ": 1148,
+      "ῥ": 1149,
+      "―": 1150,
+      "†": 1151,
+      "‡": 1152,
+      "⁻": 1153,
+      "℅": 1154,
+      "™": 1155,
+      "∩": 1156,
+      "≡": 1157,
+      "□": 1158,
+      "☉": 1159,
+      "♿": 1160,
+      "「": 1161,
+      "」": 1162,
+      "ぅ": 1163,
+      "ぇ": 1164,
+      "ぉ": 1165,
+      "ぎ": 1166,
+      "げ": 1167,
+      "ご": 1168,
+      "ほ": 1169,
+      "ゎ": 1170,
+      "ゲ": 1171,
+      "ズ": 1172,
+      "セ": 1173,
+      "ダ": 1174,
+      "ヌ": 1175,
+      "プ": 1176,
+      "ベ": 1177,
+      "ホ": 1178,
+      "ミ": 1179,
+      "ユ": 1180,
+      "ヲ": 1181,
+      "ㄱ": 1182,
+      "丁": 1183,
+      "乃": 1184,
+      "介": 1185,
+      "仕": 1186,
+      "仙": 1187,
+      "会": 1188,
+      "佐": 1189,
+      "俊": 1190,
+      "倶": 1191,
+      "先": 1192,
+      "光": 1193,
+      "克": 1194,
+      "出": 1195,
+      "列": 1196,
+      "区": 1197,
+      "協": 1198,
+      "叉": 1199,
+      "句": 1200,
+      "右": 1201,
+      "司": 1202,
+      "合": 1203,
+      "吉": 1204,
+      "后": 1205,
+      "君": 1206,
+      "啄": 1207,
+      "喀": 1208,
+      "喜": 1209,
+      "嘉": 1210,
+      "坂": 1211,
+      "堂": 1212,
+      "塔": 1213,
+      "夏": 1214,
+      "奈": 1215,
+      "女": 1216,
+      "妃": 1217,
+      "妻": 1218,
+      "始": 1219,
+      "嬪": 1220,
+      "孔": 1221,
+      "宇": 1222,
+      "家": 1223,
+      "宿": 1224,
+      "寧": 1225,
+      "寿": 1226,
+      "尊": 1227,
+      "尹": 1228,
+      "峰": 1229,
+      "嶽": 1230,
+      "干": 1231,
+      "幸": 1232,
+      "康": 1233,
+      "引": 1234,
+      "形": 1235,
+      "彦": 1236,
+      "後": 1237,
+      "徳": 1238,
+      "心": 1239,
+      "恵": 1240,
+      "愛": 1241,
+      "戦": 1242,
+      "摂": 1243,
+      "政": 1244,
+      "敬": 1245,
+      "星": 1246,
+      "普": 1247,
+      "景": 1248,
+      "暮": 1249,
+      "曲": 1250,
+      "會": 1251,
+      "杂": 1252,
+      "杉": 1253,
+      "条": 1254,
+      "来": 1255,
+      "松": 1256,
+      "某": 1257,
+      "柳": 1258,
+      "根": 1259,
+      "梅": 1260,
+      "條": 1261,
+      "機": 1262,
+      "次": 1263,
+      "歐": 1264,
+      "正": 1265,
+      "武": 1266,
+      "段": 1267,
+      "汉": 1268,
+      "池": 1269,
+      "沪": 1270,
+      "治": 1271,
+      "注": 1272,
+      "浅": 1273,
+      "浩": 1274,
+      "港": 1275,
+      "激": 1276,
+      "為": 1277,
+      "煙": 1278,
+      "父": 1279,
+      "物": 1280,
+      "独": 1281,
+      "獨": 1282,
+      "玉": 1283,
+      "璠": 1284,
+      "画": 1285,
+      "番": 1286,
+      "登": 1287,
+      "百": 1288,
+      "皮": 1289,
+      "盛": 1290,
+      "目": 1291,
+      "直": 1292,
+      "神": 1293,
+      "私": 1294,
+      "称": 1295,
+      "符": 1296,
+      "简": 1297,
+      "簡": 1298,
+      "紀": 1299,
+      "織": 1300,
+      "美": 1301,
+      "羽": 1302,
+      "膚": 1303,
+      "致": 1304,
+      "芝": 1305,
+      "英": 1306,
+      "菅": 1307,
+      "蒙": 1308,
+      "衍": 1309,
+      "衛": 1310,
+      "裕": 1311,
+      "見": 1312,
+      "角": 1313,
+      "護": 1314,
+      "许": 1315,
+      "语": 1316,
+      "豆": 1317,
+      "貴": 1318,
+      "身": 1319,
+      "追": 1320,
+      "送": 1321,
+      "通": 1322,
+      "那": 1323,
+      "里": 1324,
+      "重": 1325,
+      "間": 1326,
+      "阿": 1327,
+      "陸": 1328,
+      "際": 1329,
+      "難": 1330,
+      "韓": 1331,
+      "頭": 1332,
+      "頼": 1333,
+      "顯": 1334,
+      "餅": 1335,
+      "館": 1336,
+      "香": 1337,
+      "騨": 1338,
+      "鬼": 1339,
+      "魚": 1340,
+      "鯉": 1341,
+      "麿": 1342,
+      "黑": 1343,
+      "黒": 1344,
+      "龙": 1345,
+      "ꦄ": 1346,
+      "ꦒ": 1347,
+      "ꦔ": 1348,
+      "ꦕ": 1349,
+      "ꦗ": 1350,
+      "ꦢ": 1351,
+      "ꦧ": 1352,
+      "ꦭ": 1353,
+      "ꦯ": 1354,
+      "ꦲ": 1355,
+      "ꦴ": 1356,
+      "강": 1357,
+      "경": 1358,
+      "군": 1359,
+      "글": 1360,
+      "노": 1361,
+      "는": 1362,
+      "독": 1363,
+      "리": 1364,
+      "무": 1365,
+      "바": 1366,
+      "반": 1367,
+      "별": 1368,
+      "볼": 1369,
+      "봉": 1370,
+      "북": 1371,
+      "불": 1372,
+      "수": 1373,
+      "신": 1374,
+      "양": 1375,
+      "역": 1376,
+      "영": 1377,
+      "옥": 1378,
+      "울": 1379,
+      "자": 1380,
+      "재": 1381,
+      "조": 1382,
+      "찬": 1383,
+      "청": 1384,
+      "치": 1385,
+      "카": 1386,
+      "통": 1387,
+      "특": 1388,
+      "포": 1389,
+      "프": 1390,
+      "필": 1391,
+      "회": 1392,
+      "ﺄ": 1393,
+      "ﺈ": 1394,
+      "ﺋ": 1395,
+      "ﺜ": 1396,
+      "ﺧ": 1397,
+      "ﺲ": 1398,
+      "ﺷ": 1399,
+      "ﺸ": 1400,
+      "ﺿ": 1401,
+      "ﻀ": 1402,
+      "ﻗ": 1403,
+      "ﻵ": 1404,
+      "𐎠": 1405,
+      "𐎬": 1406,
+      "🚮": 1407,
+      "🚾": 1408,
+      "🛂": 1409,
+      "🛅": 1410,
+      "¡": 1411,
+      "¢": 1412,
+      "©": 1413,
+      "õ": 1414,
+      "ÿ": 1415,
+      "ċ": 1416,
+      "ď": 1417,
+      "ĩ": 1418,
+      "ĭ": 1419,
+      "ĺ": 1420,
+      "ļ": 1421,
+      "ņ": 1422,
+      "ň": 1423,
+      "ŕ": 1424,
+      "ů": 1425,
+      "ű": 1426,
+      "ŷ": 1427,
+      "ƿ": 1428,
+      "ǂ": 1429,
+      "ș": 1430,
+      "ț": 1431,
+      "ɓ": 1432,
+      "ɚ": 1433,
+      "ɤ": 1434,
+      "ɬ": 1435,
+      "ɯ": 1436,
+      "ɰ": 1437,
+      "ɱ": 1438,
+      "ɸ": 1439,
+      "ʑ": 1440,
+      "ʜ": 1441,
+      "ʝ": 1442,
+      "̃": 1443,
+      "̯": 1444,
+      "΄": 1445,
+      "ϙ": 1446,
+      "ђ": 1447,
+      "ћ": 1448,
+      "ґ": 1449,
+      "ң": 1450,
+      "ҧ": 1451,
+      "ұ": 1452,
+      "ӕ": 1453,
+      "բ": 1454,
+      "գ": 1455,
+      "ճ": 1456,
+      "և": 1457,
+      "ְ": 1458,
+      "ָ": 1459,
+      "ֻ": 1460,
+      "ׁ": 1461,
+      "ׂ": 1462,
+      "א": 1463,
+      "נ": 1464,
+      "ס": 1465,
+      "פ": 1466,
+      "ٔ": 1467,
+      "٠": 1468,
+      "١": 1469,
+      "٣": 1470,
+      "٤": 1471,
+      "ٹ": 1472,
+      "ڨ": 1473,
+      "ڬ": 1474,
+      "ێ": 1475,
+      "ۗ": 1476,
+      "ۚ": 1477,
+      "ۢ": 1478,
+      "ۥ": 1479,
+      "ँ": 1480,
+      "ए": 1481,
+      "घ": 1482,
+      "ठ": 1483,
+      "ढ": 1484,
+      "ॐ": 1485,
+      "॥": 1486,
+      "०": 1487,
+      "ঁ": 1488,
+      "ই": 1489,
+      "উ": 1490,
+      "চ": 1491,
+      "ছ": 1492,
+      "ত": 1493,
+      "দ": 1494,
+      "ন": 1495,
+      "প": 1496,
+      "র": 1497,
+      "ક": 1498,
+      "ગ": 1499,
+      "ચ": 1500,
+      "જ": 1501,
+      "ધ": 1502,
+      "ન": 1503,
+      "શ": 1504,
+      "સ": 1505,
+      "હ": 1506,
+      "ી": 1507,
+      "્": 1508,
+      "க": 1509,
+      "ட": 1510,
+      "ம": 1511,
+      "ள": 1512,
+      "வ": 1513,
+      "ீ": 1514,
+      "ை": 1515,
+      "ച": 1516,
+      "ദ": 1517,
+      "ര": 1518,
+      "ഴ": 1519,
+      "ി": 1520,
+      "ൊ": 1521,
+      "ග": 1522,
+      "ද": 1523,
+      "න": 1524,
+      "ต": 1525,
+      "ภ": 1526,
+      "ษ": 1527,
+      "ฯ": 1528,
+      "ื": 1529,
+      "ไ": 1530,
+      "ພ": 1531,
+      "ລ": 1532,
+      "ວ": 1533,
+      "ສ": 1534,
+      "ཀ": 1535,
+      "ཁ": 1536,
+      "ད": 1537,
+      "ན": 1538,
+      "བ": 1539,
+      "ས": 1540,
+      "ཨ": 1541,
+      "ི": 1542,
+      "ུ": 1543,
+      "ྔ": 1544,
+      "င": 1545,
+      "ည": 1546,
+      "ပ": 1547,
+      "ဗ": 1548,
+      "ယ": 1549,
+      "ရ": 1550,
+      "လ": 1551,
+      "ဝ": 1552,
+      "အ": 1553,
+      "ီ": 1554,
+      "ု": 1555,
+      "ူ": 1556,
+      "ზ": 1557,
+      "კ": 1558,
+      "ნ": 1559,
+      "პ": 1560,
+      "ტ": 1561,
+      "ფ": 1562,
+      "ჭ": 1563,
+      "ላ": 1564,
+      "መ": 1565,
+      "ሪ": 1566,
+      "ር": 1567,
+      "ቆ": 1568,
+      "ታ": 1569,
+      "ን": 1570,
+      "አ": 1571,
+      "ዘ": 1572,
+      "የ": 1573,
+      "ጠ": 1574,
+      "ጣ": 1575,
+      "ᐃ": 1576,
+      "ᒡ": 1577,
+      "ᓗ": 1578,
+      "ᝉ": 1579,
+      "ᝋ": 1580,
+      "ក": 1581,
+      "ង": 1582,
+      "ប": 1583,
+      "រ": 1584,
+      "ៀ": 1585,
+      "ោ": 1586,
+      "៉": 1587,
+      "្": 1588,
+      "ᨁ": 1589,
+      "ᨅ": 1590,
+      "ᨆ": 1591,
+      "ᨈ": 1592,
+      "ᨑ": 1593,
+      "ᨕ": 1594,
+      "ᨗ": 1595,
+      "ᨘ": 1596,
+      "ᨚ": 1597,
+      "ᬓ": 1598,
+      "ᬬ": 1599,
+      "ᬮ": 1600,
+      "ᬾ": 1601,
+      "᭄": 1602,
+      "ᮁ": 1603,
+      "᮪": 1604,
+      "ᮼ": 1605,
+      "ᵃ": 1606,
+      "ᵘ": 1607,
+      "ḑ": 1608,
+      "ḻ": 1609,
+      "ḿ": 1610,
+      "ṙ": 1611,
+      "ṡ": 1612,
+      "ậ": 1613,
+      "ặ": 1614,
+      "ớ": 1615,
+      "ờ": 1616,
+      "ứ": 1617,
+      "ự": 1618,
+      "ỳ": 1619,
+      "ἅ": 1620,
+      "ἰ": 1621,
+      "ὁ": 1622,
+      "ὄ": 1623,
+      "ὕ": 1624,
+      "ὖ": 1625,
+      "ὰ": 1626,
+      "ὲ": 1627,
+      "ὴ": 1628,
+      "ὶ": 1629,
+      "ᾰ": 1630,
+      "ᾱ": 1631,
+      "ῡ": 1632,
+      "ῦ": 1633,
+      "‐": 1634,
+      "‴": 1635,
+      "ⁿ": 1636,
+      "₁": 1637,
+      "℗": 1638,
+      "ℨ": 1639,
+      "ↀ": 1640,
+      "↑": 1641,
+      "⇒": 1642,
+      "∆": 1643,
+      "∉": 1644,
+      "∊": 1645,
+      "∝": 1646,
+      "≠": 1647,
+      "⊙": 1648,
+      "►": 1649,
+      "◄": 1650,
+      "☊": 1651,
+      "♀": 1652,
+      "♂": 1653,
+      "♭": 1654,
+      "⚠": 1655,
+      "✓": 1656,
+      "⟨": 1657,
+      "⟩": 1658,
+      "ⴰ": 1659,
+      "ⴱ": 1660,
+      "ⵉ": 1661,
+      "ⵍ": 1662,
+      "ⵢ": 1663,
+      "。": 1664,
+      "々": 1665,
+      "ざ": 1666,
+      "ぞ": 1667,
+      "ど": 1668,
+      "ゔ": 1669,
+      "゚": 1670,
+      "ゞ": 1671,
+      "ギ": 1672,
+      "ザ": 1673,
+      "ピ": 1674,
+      "ヘ": 1675,
+      "ペ": 1676,
+      "ボ": 1677,
+      "ポ": 1678,
+      "ャ": 1679,
+      "ヤ": 1680,
+      "ヷ": 1681,
+      "ヸ": 1682,
+      "ヹ": 1683,
+      "ヺ": 1684,
+      "ㄅ": 1685,
+      "ㄆ": 1686,
+      "ㄇ": 1687,
+      "ㄈ": 1688,
+      "ㅟ": 1689,
+      "㆑": 1690,
+      "㆒": 1691,
+      "㆓": 1692,
+      "㆖": 1693,
+      "㆘": 1694,
+      "ㇷ": 1695,
+      "㏂": 1696,
+      "世": 1697,
+      "丙": 1698,
+      "东": 1699,
+      "主": 1700,
+      "久": 1701,
+      "也": 1702,
+      "了": 1703,
+      "争": 1704,
+      "事": 1705,
+      "亚": 1706,
+      "亞": 1707,
+      "交": 1708,
+      "亨": 1709,
+      "亭": 1710,
+      "亮": 1711,
+      "令": 1712,
+      "以": 1713,
+      "仲": 1714,
+      "伸": 1715,
+      "伽": 1716,
+      "佑": 1717,
+      "作": 1718,
+      "佤": 1719,
+      "促": 1720,
+      "候": 1721,
+      "倭": 1722,
+      "備": 1723,
+      "傳": 1724,
+      "働": 1725,
+      "僚": 1726,
+      "允": 1727,
+      "兄": 1728,
+      "充": 1729,
+      "児": 1730,
+      "入": 1731,
+      "內": 1732,
+      "公": 1733,
+      "共": 1734,
+      "关": 1735,
+      "兵": 1736,
+      "具": 1737,
+      "円": 1738,
+      "农": 1739,
+      "冬": 1740,
+      "冰": 1741,
+      "刀": 1742,
+      "分": 1743,
+      "切": 1744,
+      "初": 1745,
+      "別": 1746,
+      "利": 1747,
+      "到": 1748,
+      "創": 1749,
+      "劉": 1750,
+      "力": 1751,
+      "助": 1752,
+      "勇": 1753,
+      "勉": 1754,
+      "勒": 1755,
+      "匂": 1756,
+      "區": 1757,
+      "半": 1758,
+      "卍": 1759,
+      "卐": 1760,
+      "単": 1761,
+      "博": 1762,
+      "厘": 1763,
+      "友": 1764,
+      "取": 1765,
+      "史": 1766,
+      "同": 1767,
+      "向": 1768,
+      "含": 1769,
+      "呂": 1770,
+      "呉": 1771,
+      "呼": 1772,
+      "咸": 1773,
+      "品": 1774,
+      "哉": 1775,
+      "哲": 1776,
+      "商": 1777,
+      "啓": 1778,
+      "喃": 1779,
+      "善": 1780,
+      "單": 1781,
+      "回": 1782,
+      "因": 1783,
+      "団": 1784,
+      "圆": 1785,
+      "圏": 1786,
+      "園": 1787,
+      "在": 1788,
+      "场": 1789,
+      "均": 1790,
+      "坊": 1791,
+      "堀": 1792,
+      "堅": 1793,
+      "堆": 1794,
+      "場": 1795,
+      "堺": 1796,
+      "塞": 1797,
+      "売": 1798,
+      "壽": 1799,
+      "変": 1800,
+      "夢": 1801,
+      "央": 1802,
+      "头": 1803,
+      "奉": 1804,
+      "奥": 1805,
+      "奴": 1806,
+      "好": 1807,
+      "妹": 1808,
+      "姉": 1809,
+      "姓": 1810,
+      "委": 1811,
+      "威": 1812,
+      "婦": 1813,
+      "孜": 1814,
+      "孝": 1815,
+      "孟": 1816,
+      "孫": 1817,
+      "守": 1818,
+      "完": 1819,
+      "宰": 1820,
+      "寂": 1821,
+      "密": 1822,
+      "寸": 1823,
+      "寺": 1824,
+      "將": 1825,
+      "尽": 1826,
+      "岡": 1827,
+      "峪": 1828,
+      "崇": 1829,
+      "嵐": 1830,
+      "嶋": 1831,
+      "嶺": 1832,
+      "工": 1833,
+      "已": 1834,
+      "巴": 1835,
+      "巷": 1836,
+      "希": 1837,
+      "師": 1838,
+      "帯": 1839,
+      "帶": 1840,
+      "幕": 1841,
+      "幾": 1842,
+      "广": 1843,
+      "库": 1844,
+      "庚": 1845,
+      "座": 1846,
+      "庭": 1847,
+      "廃": 1848,
+      "廣": 1849,
+      "弟": 1850,
+      "张": 1851,
+      "強": 1852,
+      "弼": 1853,
+      "彼": 1854,
+      "徐": 1855,
+      "得": 1856,
+      "德": 1857,
+      "志": 1858,
+      "忘": 1859,
+      "念": 1860,
+      "性": 1861,
+      "恋": 1862,
+      "恭": 1863,
+      "想": 1864,
+      "憶": 1865,
+      "戌": 1866,
+      "我": 1867,
+      "战": 1868,
+      "戯": 1869,
+      "戰": 1870,
+      "才": 1871,
+      "扎": 1872,
+      "投": 1873,
+      "拓": 1874,
+      "拗": 1875,
+      "持": 1876,
+      "指": 1877,
+      "振": 1878,
+      "接": 1879,
+      "推": 1880,
+      "携": 1881,
+      "放": 1882,
+      "散": 1883,
+      "数": 1884,
+      "斉": 1885,
+      "於": 1886,
+      "族": 1887,
+      "无": 1888,
+      "旧": 1889,
+      "早": 1890,
+      "昊": 1891,
+      "昏": 1892,
+      "是": 1893,
+      "晋": 1894,
+      "晚": 1895,
+      "晝": 1896,
+      "智": 1897,
+      "暁": 1898,
+      "暗": 1899,
+      "曆": 1900,
+      "書": 1901,
+      "曽": 1902,
+      "朴": 1903,
+      "杏": 1904,
+      "柱": 1905,
+      "栄": 1906,
+      "栗": 1907,
+      "校": 1908,
+      "梵": 1909,
+      "棒": 1910,
+      "植": 1911,
+      "椎": 1912,
+      "極": 1913,
+      "構": 1914,
+      "樓": 1915,
+      "樹": 1916,
+      "橘": 1917,
+      "檀": 1918,
+      "殿": 1919,
+      "毎": 1920,
+      "每": 1921,
+      "比": 1922,
+      "毛": 1923,
+      "気": 1924,
+      "氣": 1925,
+      "汁": 1926,
+      "決": 1927,
+      "沢": 1928,
+      "泉": 1929,
+      "法": 1930,
+      "泰": 1931,
+      "流": 1932,
+      "浄": 1933,
+      "浦": 1934,
+      "润": 1935,
+      "淞": 1936,
+      "渎": 1937,
+      "渕": 1938,
+      "渡": 1939,
+      "温": 1940,
+      "湛": 1941,
+      "漠": 1942,
+      "漫": 1943,
+      "潘": 1944,
+      "潤": 1945,
+      "澤": 1946,
+      "瀬": 1947,
+      "灯": 1948,
+      "炯": 1949,
+      "烈": 1950,
+      "烽": 1951,
+      "煕": 1952,
+      "熟": 1953,
+      "燕": 1954,
+      "燭": 1955,
+      "爭": 1956,
+      "爺": 1957,
+      "牛": 1958,
+      "猫": 1959,
+      "獣": 1960,
+      "玛": 1961,
+      "现": 1962,
+      "珈": 1963,
+      "珍": 1964,
+      "珠": 1965,
+      "現": 1966,
+      "球": 1967,
+      "琲": 1968,
+      "琴": 1969,
+      "瑠": 1970,
+      "瑪": 1971,
+      "璃": 1972,
+      "璧": 1973,
+      "環": 1974,
+      "瓜": 1975,
+      "甫": 1976,
+      "甲": 1977,
+      "界": 1978,
+      "留": 1979,
+      "略": 1980,
+      "異": 1981,
+      "疆": 1982,
+      "癌": 1983,
+      "的": 1984,
+      "益": 1985,
+      "盟": 1986,
+      "監": 1987,
+      "相": 1988,
+      "矢": 1989,
+      "知": 1990,
+      "砕": 1991,
+      "碌": 1992,
+      "碑": 1993,
+      "磅": 1994,
+      "礼": 1995,
+      "社": 1996,
+      "祝": 1997,
+      "禅": 1998,
+      "福": 1999,
+      "秀": 2000,
+      "秦": 2001,
+      "程": 2002,
+      "穆": 2003,
+      "突": 2004,
+      "窩": 2005,
+      "竞": 2006,
+      "笠": 2007,
+      "筆": 2008,
+      "筑": 2009,
+      "箇": 2010,
+      "箱": 2011,
+      "範": 2012,
+      "篠": 2013,
+      "籽": 2014,
+      "粉": 2015,
+      "粽": 2016,
+      "粿": 2017,
+      "糖": 2018,
+      "糰": 2019,
+      "系": 2020,
+      "約": 2021,
+      "紅": 2022,
+      "納": 2023,
+      "素": 2024,
+      "索": 2025,
+      "細": 2026,
+      "統": 2027,
+      "継": 2028,
+      "続": 2029,
+      "維": 2030,
+      "緑": 2031,
+      "締": 2032,
+      "縣": 2033,
+      "繋": 2034,
+      "红": 2035,
+      "细": 2036,
+      "置": 2037,
+      "義": 2038,
+      "聖": 2039,
+      "聞": 2040,
+      "聯": 2041,
+      "肇": 2042,
+      "股": 2043,
+      "育": 2044,
+      "背": 2045,
+      "腐": 2046,
+      "腹": 2047,
+      "腺": 2048,
+      "臣": 2049,
+      "臨": 2050,
+      "臺": 2051,
+      "舊": 2052,
+      "舎": 2053,
+      "船": 2054,
+      "良": 2055,
+      "色": 2056,
+      "芙": 2057,
+      "芦": 2058,
+      "芳": 2059,
+      "苗": 2060,
+      "茶": 2061,
+      "莨": 2062,
+      "菇": 2063,
+      "萬": 2064,
+      "葛": 2065,
+      "蒲": 2066,
+      "蓉": 2067,
+      "蓟": 2068,
+      "薊": 2069,
+      "薏": 2070,
+      "藏": 2071,
+      "藩": 2072,
+      "蘇": 2073,
+      "號": 2074,
+      "虫": 2075,
+      "蜂": 2076,
+      "蝋": 2077,
+      "蠻": 2078,
+      "街": 2079,
+      "衞": 2080,
+      "裴": 2081,
+      "製": 2082,
+      "親": 2083,
+      "註": 2084,
+      "評": 2085,
+      "詞": 2086,
+      "説": 2087,
+      "誰": 2088,
+      "諸": 2089,
+      "謙": 2090,
+      "豐": 2091,
+      "貝": 2092,
+      "貞": 2093,
+      "貫": 2094,
+      "買": 2095,
+      "贏": 2096,
+      "赛": 2097,
+      "越": 2098,
+      "趙": 2099,
+      "足": 2100,
+      "車": 2101,
+      "載": 2102,
+      "輔": 2103,
+      "輝": 2104,
+      "輪": 2105,
+      "轄": 2106,
+      "辰": 2107,
+      "返": 2108,
+      "速": 2109,
+      "連": 2110,
+      "邦": 2111,
+      "邬": 2112,
+      "郑": 2113,
+      "郷": 2114,
+      "酔": 2115,
+      "醜": 2116,
+      "銅": 2117,
+      "錢": 2118,
+      "錦": 2119,
+      "鎌": 2120,
+      "鎮": 2121,
+      "鏡": 2122,
+      "钦": 2123,
+      "银": 2124,
+      "铺": 2125,
+      "长": 2126,
+      "開": 2127,
+      "閔": 2128,
+      "関": 2129,
+      "闘": 2130,
+      "阳": 2131,
+      "阴": 2132,
+      "陆": 2133,
+      "陈": 2134,
+      "陛": 2135,
+      "院": 2136,
+      "隣": 2137,
+      "隱": 2138,
+      "雀": 2139,
+      "集": 2140,
+      "雑": 2141,
+      "雨": 2142,
+      "雪": 2143,
+      "電": 2144,
+      "非": 2145,
+      "面": 2146,
+      "順": 2147,
+      "頌": 2148,
+      "題": 2149,
+      "風": 2150,
+      "飾": 2151,
+      "饼": 2152,
+      "驒": 2153,
+      "马": 2154,
+      "魔": 2155,
+      "鲜": 2156,
+      "鳩": 2157,
+      "鳴": 2158,
+      "鴉": 2159,
+      "鸟": 2160,
+      "鸦": 2161,
+      "鹿": 2162,
+      "麩": 2163,
+      "麺": 2164,
+      "黃": 2165,
+      "ꗘ": 2166,
+      "ꦈ": 2167,
+      "ꦑ": 2168,
+      "ꦝ": 2169,
+      "ꦪ": 2170,
+      "꦳": 2171,
+      "게": 2172,
+      "고": 2173,
+      "곡": 2174,
+      "광": 2175,
+      "교": 2176,
+      "궁": 2177,
+      "그": 2178,
+      "나": 2179,
+      "넘": 2180,
+      "니": 2181,
+      "덕": 2182,
+      "데": 2183,
+      "돼": 2184,
+      "드": 2185,
+      "들": 2186,
+      "라": 2187,
+      "래": 2188,
+      "럭": 2189,
+      "레": 2190,
+      "렌": 2191,
+      "례": 2192,
+      "료": 2193,
+      "룡": 2194,
+      "릉": 2195,
+      "린": 2196,
+      "릿": 2197,
+      "마": 2198,
+      "만": 2199,
+      "맥": 2200,
+      "명": 2201,
+      "몽": 2202,
+      "미": 2203,
+      "밀": 2204,
+      "밥": 2205,
+      "배": 2206,
+      "백": 2207,
+      "버": 2208,
+      "벌": 2209,
+      "범": 2210,
+      "사": 2211,
+      "석": 2212,
+      "세": 2213,
+      "숙": 2214,
+      "순": 2215,
+      "식": 2216,
+      "악": 2217,
+      "어": 2218,
+      "에": 2219,
+      "엘": 2220,
+      "오": 2221,
+      "와": 2222,
+      "운": 2223,
+      "윗": 2224,
+      "유": 2225,
+      "율": 2226,
+      "음": 2227,
+      "읍": 2228,
+      "의": 2229,
+      "임": 2230,
+      "존": 2231,
+      "종": 2232,
+      "직": 2233,
+      "차": 2234,
+      "채": 2235,
+      "촌": 2236,
+      "최": 2237,
+      "칠": 2238,
+      "크": 2239,
+      "태": 2240,
+      "토": 2241,
+      "튀": 2242,
+      "트": 2243,
+      "파": 2244,
+      "폭": 2245,
+      "풍": 2246,
+      "하": 2247,
+      "학": 2248,
+      "할": 2249,
+      "항": 2250,
+      "행": 2251,
+      "협": 2252,
+      "형": 2253,
+      "혜": 2254,
+      "훈": 2255,
+      "흔": 2256,
+      "ﱞ": 2257,
+      "ﺆ": 2258,
+      "ﺐ": 2259,
+      "ﺨ": 2260,
+      "ﺩ": 2261,
+      "ﺭ": 2262,
+      "ﺼ": 2263,
+      "ﻄ": 2264,
+      "ﻈ": 2265,
+      "ﻐ": 2266,
+      "ﻖ": 2267,
+      "ﻚ": 2268,
+      "ﻬ": 2269,
+      "ﻴ": 2270,
+      "ﻷ": 2271,
+      "１": 2272,
+      "ｍ": 2273,
+      "｜": 2274,
+      "𐎱": 2275,
+      "𐎼": 2276,
+      "𝖟": 2277,
+      "🚹": 2278,
+      "🚻": 2279
+    },
+    "unk_token": "<unk>"
+  }
+}

tokenizer_config.json

@@ -0,0 +1,53 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": true,
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "bos_token_id": 1,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "eos_token_id": 2,
+  "legacy": true,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "pad_token_id": 3,
+  "padding_side": "right",
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "unk_token_id": 0,
+  "use_default_system_prompt": false
+}