Upload folder using huggingface_hub

README.md

@@ -0,0 +1,448 @@
+---
+license: mit
+language:
+- en
+tags:
+- llama4
+- llama4-text
+- llama4-moe
+- moe
+- mixture-of-experts
+- causal-lm
+- tinystories
+- tiny-model
+- validation
+- debug-model
+- transformers
+---
+
+# Tiny Llama4 MoE Text
+
+This repository contains a tiny Llama4 text-only Mixture-of-Experts causal language model for validation and debugging.
+
+The model is intentionally small. It is not intended to be a high-quality text generation model. Its main purpose is to provide a compact checkpoint that exercises Llama4 MoE text-model code paths in Hugging Face Transformers.
+
+This checkpoint is useful for implementation testing because it includes chunked attention, full attention, grouped-query attention, QK norm, and MoE routing with multiple experts.
+
+## Model purpose
+
+This model is designed for:
+
+* testing `Llama4ForCausalLM`
+* validating `Llama4TextConfig`
+* testing Llama4 text-only MoE model loading
+* checking model save/load behavior
+* checking tokenizer save/load behavior
+* exercising chunked attention layers
+* exercising full attention layers
+* exercising grouped-query attention
+* exercising QK norm paths
+* exercising MoE expert parameters
+* exercising top-k expert routing
+* providing a compact Llama4 MoE checkpoint for inference-engine validation
+
+It is not designed for:
+
+* high-quality story generation
+* instruction following
+* chat use
+* OCR
+* multimodal inference
+* benchmark comparison against production language models
+* production deployment
+
+## Model architecture
+
+The model uses `Llama4ForCausalLM` with a small Llama4 text MoE configuration.
+
+Representative configuration:
+
+```text
+model_type: llama4_text
+vocab_size: 1024
+
+hidden_size: 96
+intermediate_size: 192
+intermediate_size_mlp: 384
+
+num_hidden_layers: 5
+num_attention_heads: 4
+num_key_value_heads: 1
+head_dim: 24
+
+max_position_embeddings: 1024
+attention_chunk_size: 128
+
+layer_types:
+  - chunked_attention
+  - full_attention
+  - chunked_attention
+  - full_attention
+  - chunked_attention
+
+hidden_act: silu
+tie_word_embeddings: false
+attention_bias: false
+rms_norm_eps: 1e-05
+rope_theta: 500000.0
+
+use_qk_norm: true
+attn_temperature_tuning: false
+floor_scale: 8192
+attn_scale: 0.1
+
+num_local_experts: 4
+num_experts_per_tok: 2
+moe_layers:
+  - 0
+  - 1
+  - 2
+  - 3
+  - 4
+interleave_moe_layer_step: 1
+router_aux_loss_coef: 0.001
+router_jitter_noise: 0.0
+output_router_logits: false
+
+pad_token_id: 2
+bos_token_id: 0
+eos_token_id: 1
+```
+
+The attention pattern is:
+
+```text
+CFCFC
+```
+
+where `C` means `chunked_attention` and `F` means `full_attention`.
+
+This pattern was chosen for validation coverage. A full-attention-only model may be easier to train, but it would not exercise the chunked attention path.
+
+## MoE configuration
+
+This model enables Llama4 MoE blocks.
+
+```text
+num_local_experts: 4
+num_experts_per_tok: 2
+moe_layers: all layers
+interleave_moe_layer_step: 1
+router_aux_loss_coef: 0.001
+```
+
+The `num_local_experts=4` and `num_experts_per_tok=2` setting is intentional. A smaller configuration such as `num_local_experts=2, num_experts_per_tok=1` would exercise only a much simpler routing path.
+
+This checkpoint is intended to cover:
+
+```text
+router parameters
+multiple experts
+top-2 expert selection
+weighted expert combination
+MoE FFN parameters
+chunked and full attention interaction
+MoE layer execution in a small model
+```
+
+## Parameter count
+
+The exact parameter count depends on the saved checkpoint configuration. The default training script prints the parameter count at startup.
+
+For the default configuration, check the run log for:
+
+```text
+Parameter count: ...
+MoE/router/expert parameter names found: ...
+Prefix breakdown:
+  ...
+```
+
+After training, the metadata file also records the count:
+
+```text
+artifact_metadata.json
+```
+
+## Training data
+
+The model was trained on TinyStories-style English story text.
+
+The tokenizer is a small byte-level BPE tokenizer with a vocabulary size of 1024. The small vocabulary keeps the checkpoint compact, but it also limits text generation quality.
+
+## Training setup
+
+Representative training settings:
+
+```text
+num_epochs: 1
+learning_rate: 3e-4
+batch_size: 32
+block_size: 256
+
+vocab_size: 1024
+hidden_size: 96
+intermediate_size: 192
+intermediate_size_mlp: 384
+num_hidden_layers: 5
+num_attention_heads: 4
+num_key_value_heads: 1
+head_dim: 24
+
+layer_pattern: CFCFC
+attention_chunk_size: 128
+
+num_local_experts: 4
+num_experts_per_tok: 2
+moe_layers: all
+interleave_moe_layer_step: 1
+router_aux_loss_coef: 0.001
+```
+
+The reference run can be reproduced with:
+
+```bash
+python train_llama4_moe_text_tinystories_epoch.py \
+  --output-dir tinyllama4moe2m \
+  --num-epochs 1 \
+  --max-steps 0
+```
+
+A short smoke test can be run with:
+
+```bash
+python train_llama4_moe_text_tinystories_epoch.py \
+  --output-dir tinyllama4moe_smoke \
+  --max-rows 2000 \
+  --max-steps 100 \
+  --log-steps 10 \
+  --eval-steps 50
+```
+
+## Reference result
+
+The reference run completed one epoch of TinyStories-style training.
+
+```text
+Final loss: 2.458171248435974
+```
+
+Example generations from the reference checkpoint:
+
+```text
+Prompt: Once upon
+
+Once upon a time, there was a little girl named Lily. She loved to play with her toys and her friends. One day, she saw a big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big,
+```
+
+```text
+Prompt: There was a little
+
+There was a little girl named Lily. She loved to play with her toys and her friends. One day, she saw a big, big, big carrot in the park. She wanted to play with it, but she was very sad.
+
+Lily saw a big dog who was playing with a ballrot. She wanted to play with it, but she was too big to play with. She asked her mom to help her. She said, "I can't go to the park, but I
+```
+
+```text
+Prompt: One day
+
+One day, a little girl named Lily went to the park with her mom. They saw a big tree with a big bowl of cookies. Lily wanted to play with the big, but her mom said they could go to the park.
+
+Lily was very happy. She saw a big tree with a big bowl of cookies. She wanted to play with it. She asked her mom, "Why are you sad?" Her mom said, "I'm sorry
+```
+
+The model can generate TinyStories-like fragments, but repetition, template collapse, and occasional invented words are expected. This is normal for this checkpoint and is not considered a failure for its intended validation purpose.
+
+## Usage
+
+If the model files are stored under an `hf/` subdirectory, use the following example.
+
+```python
+import torch
+from transformers import PreTrainedTokenizerFast, Llama4ForCausalLM
+
+repo = "shibatch/tinyllama4moe2m"
+
+tokenizer = PreTrainedTokenizerFast.from_pretrained(repo, subfolder="hf")
+model = Llama4ForCausalLM.from_pretrained(
+    repo,
+    subfolder="hf",
+    torch_dtype=torch.float32,
+)
+model.eval()
+
+prompt = "Once upon"
+inputs = tokenizer(prompt, return_tensors="pt")
+
+with torch.no_grad():
+    output_ids = model.generate(
+        **inputs,
+        max_new_tokens=100,
+        do_sample=False,
+        pad_token_id=tokenizer.pad_token_id,
+        eos_token_id=tokenizer.eos_token_id,
+    )
+
+print(tokenizer.decode(output_ids[0], skip_special_tokens=True))
+```
+
+If the model files are stored at the repository root, remove `subfolder="hf"`:
+
+```python
+import torch
+from transformers import PreTrainedTokenizerFast, Llama4ForCausalLM
+
+repo = "shibatch/tinyllama4moe2m"
+
+tokenizer = PreTrainedTokenizerFast.from_pretrained(repo)
+model = Llama4ForCausalLM.from_pretrained(
+    repo,
+    torch_dtype=torch.float32,
+)
+model.eval()
+
+prompt = "Once upon"
+inputs = tokenizer(prompt, return_tensors="pt")
+
+with torch.no_grad():
+    output_ids = model.generate(
+        **inputs,
+        max_new_tokens=100,
+        do_sample=False,
+        pad_token_id=tokenizer.pad_token_id,
+        eos_token_id=tokenizer.eos_token_id,
+    )
+
+print(tokenizer.decode(output_ids[0], skip_special_tokens=True))
+```
+
+## Loading requirements
+
+This checkpoint requires a Transformers version that supports Llama4 and Llama4 MoE.
+
+The following imports should work:
+
+```python
+from transformers import Llama4ForCausalLM, Llama4TextConfig
+```
+
+If these imports fail, update Transformers to a version with Llama4 support.
+
+## Tokenizer note
+
+This repository uses a custom byte-level BPE tokenizer saved as a `PreTrainedTokenizerFast`.
+
+For this reason, examples use:
+
+```python
+from transformers import PreTrainedTokenizerFast
+```
+
+instead of `AutoTokenizer`.
+
+Using `AutoTokenizer` may fail in some environments if the tokenizer backend cannot be inferred automatically.
+
+The expected tokenizer files include:
+
+```text
+tokenizer.json
+tokenizer_config.json
+special_tokens_map.json
+```
+
+## Intended validation coverage
+
+This checkpoint is intended to validate support for:
+
+```text
+Llama4TextConfig
+Llama4ForCausalLM
+chunked_attention layers
+full_attention layers
+GQA with num_key_value_heads = 1
+QK norm
+Llama4 RMSNorm behavior
+Llama4 MLP activation: silu
+Llama4 MoE expert parameters
+num_local_experts = 4
+num_experts_per_tok = 2
+moe_layers
+expert routing
+expert output combination
+generate()
+save_pretrained()
+from_pretraine()
+```
+
+## Limitations
+
+This is a tiny debug model. It should not be used as a general-purpose language model.
+
+Known limitations:
+
+* frequent phrase repetition may occur
+* TinyStories template collapse may occur
+* weak long-form coherence
+* small vocabulary
+* weak semantic consistency
+* no instruction tuning
+* no chat formatting
+* no multimodal capability
+* no OCR capability
+* no production use
+
+The checkpoint is primarily intended to make Llama4 MoE text-model code paths easy to test without downloading a large model.
+
+## Why include MoE?
+
+A dense tiny Llama4 model is simpler to train, but it does not cover MoE-specific implementation paths.
+
+This checkpoint intentionally includes:
+
+```text
+num_local_experts = 4
+num_experts_per_tok = 2
+```
+
+to exercise a more realistic MoE routing path than a minimal top-1 routing configuration.
+
+## Why include chunked attention?
+
+A full-attention-only tiny model may train more cleanly, but it would not cover Llama4 chunked attention behavior.
+
+This checkpoint uses:
+
+```text
+chunked_attention
+full_attention
+chunked_attention
+full_attention
+chunked_attention
+```
+
+to cover both attention implementations.
+
+## Notes on OCR and multimodal use
+
+This repository is text-only. It does not include a vision tower, image projector, image-token alignment, or OCR training.
+
+A Llama4 OCR or Llama4 multimodal MoE validation model would be a separate project. It would require a tiny multimodal Llama4 configuration, a synthetic OCR dataset, image-token handling, vision/text alignment, OCR fine-tuning, and additional validation scripts.
+
+## Suggested repository name
+
+Suggested Hugging Face repository name:
+
+```text
+shibatch/tinyllama4moe2m
+```
+
+Alternative names:
+
+```text
+shibatch/tinyllama4moetext2m
+shibatch/tinyllama4-moe-text
+```
+
+## Citation
+
+This is a synthetic tiny validation checkpoint derived from Llama4-compatible MoE text architecture settings. It is intended for debugging and implementation testing.

artifact_metadata.json

@@ -0,0 +1,147 @@
+{
+  "model_type": "llama4_moe_text",
+  "parameter_count": 1697184,
+  "tokenizer_size": 1024,
+  "final_eval_loss": 2.458171248435974,
+  "final_eval_ppl": 11.683425908034476,
+  "args": {
+    "train_files": [
+      "data/train-00000-of-00004-2d5a1467fff1081b.parquet",
+      "data/train-00001-of-00004-5852b56a2bd28fd9.parquet",
+      "data/train-00002-of-00004-a26307300439e943.parquet",
+      "data/train-00003-of-00004-d243063613e5a057.parquet"
+    ],
+    "output_dir": "tinyllama4moe2m",
+    "max_rows": 0,
+    "vocab_size": 1024,
+    "min_frequency": 2,
+    "hidden_size": 96,
+    "intermediate_size": 192,
+    "intermediate_size_mlp": 384,
+    "num_hidden_layers": 5,
+    "num_attention_heads": 4,
+    "num_key_value_heads": 1,
+    "head_dim": 24,
+    "attention_chunk_size": 128,
+    "max_position_embeddings": 1024,
+    "layer_pattern": "CFCFC",
+    "num_local_experts": 4,
+    "num_experts_per_tok": 2,
+    "moe_layers": "all",
+    "interleave_moe_layer_step": 1,
+    "router_aux_loss_coef": 0.001,
+    "router_jitter_noise": 0.0,
+    "output_router_logits": false,
+    "use_qk_norm": true,
+    "attn_temperature_tuning": false,
+    "floor_scale": 8192,
+    "attn_scale": 0.1,
+    "rms_norm_eps": 1e-05,
+    "rope_theta": 500000.0,
+    "tie_word_embeddings": false,
+    "block_size": 256,
+    "batch_size": 32,
+    "max_steps": 76597,
+    "num_epochs": 1.0,
+    "learning_rate": 0.0003,
+    "weight_decay": 0.0,
+    "grad_clip": 1.0,
+    "log_steps": 50,
+    "eval_steps": 500,
+    "eval_batches": 20,
+    "seed": 1234,
+    "device": "auto",
+    "dtype": "auto",
+    "num_workers": 0,
+    "generate_new_tokens": 100,
+    "generate_prompts": [
+      "Once upon",
+      "There was a little",
+      "One day"
+    ]
+  },
+  "config": {
+    "transformers_version": "5.9.0",
+    "architectures": [
+      "Llama4ForCausalLM"
+    ],
+    "output_hidden_states": false,
+    "return_dict": true,
+    "dtype": "bfloat16",
+    "chunk_size_feed_forward": 0,
+    "is_encoder_decoder": false,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "problem_type": null,
+    "vocab_size": 1024,
+    "hidden_size": 96,
+    "intermediate_size": 192,
+    "intermediate_size_mlp": 384,
+    "num_hidden_layers": 5,
+    "num_attention_heads": 4,
+    "num_key_value_heads": 1,
+    "head_dim": 24,
+    "hidden_act": "silu",
+    "max_position_embeddings": 1024,
+    "initializer_range": 0.02,
+    "rms_norm_eps": 1e-05,
+    "use_cache": true,
+    "pad_token_id": 2,
+    "bos_token_id": 0,
+    "eos_token_id": 1,
+    "tie_word_embeddings": false,
+    "attention_dropout": 0.0,
+    "num_experts_per_tok": 2,
+    "num_local_experts": 4,
+    "moe_layers": [
+      0,
+      1,
+      2,
+      3,
+      4
+    ],
+    "interleave_moe_layer_step": 1,
+    "use_qk_norm": true,
+    "output_router_logits": false,
+    "router_aux_loss_coef": 0.001,
+    "router_jitter_noise": 0.0,
+    "rope_parameters": {
+      "rope_theta": 500000.0,
+      "rope_type": "default"
+    },
+    "no_rope_layers": [
+      1,
+      0,
+      1,
+      0,
+      1
+    ],
+    "no_rope_layer_interval": 4,
+    "attention_chunk_size": 128,
+    "layer_types": [
+      "chunked_attention",
+      "full_attention",
+      "chunked_attention",
+      "full_attention",
+      "chunked_attention"
+    ],
+    "attn_temperature_tuning": false,
+    "floor_scale": 8192,
+    "attn_scale": 0.1,
+    "attention_bias": false,
+    "_name_or_path": "",
+    "model_type": "llama4_text",
+    "output_attentions": false
+  },
+  "generations": {
+    "Once upon": "Once upon a time, there was a little girl named Lily. She loved to play with her toys and her friends. One day, she saw a big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big,",
+    "There was a little": "There was a little girl named Lily. She loved to play with her toys and her friends. One day, she saw a big, big, big carrot in the park. She wanted to play with it, but she was very sad.\n\nLily saw a big dog who was playing with a ballrot. She wanted to play with it, but she was too big to play with. She asked her mom to help her. She said, \"I can't go to the park, but I",
+    "One day": "One day, a little girl named Lily went to the park with her mom. They saw a big tree with a big bowl of cookies. Lily wanted to play with the big, but her mom said they could go to the park.\n\nLily was very happy. She saw a big tree with a big bowl of cookies. She wanted to play with it. She asked her mom, \"Why are you sad?\" Her mom said, \"I'm sorry"
+  }
+}

eval_text_generation.json

@@ -0,0 +1,5 @@
+{
+  "Once upon": "Once upon a time, there was a little girl named Lily. She loved to play with her toys and her friends. One day, she saw a big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big, big,",
+  "There was a little": "There was a little girl named Lily. She loved to play with her toys and her friends. One day, she saw a big, big, big carrot in the park. She wanted to play with it, but she was very sad.\n\nLily saw a big dog who was playing with a ballrot. She wanted to play with it, but she was too big to play with. She asked her mom to help her. She said, \"I can't go to the park, but I",
+  "One day": "One day, a little girl named Lily went to the park with her mom. They saw a big tree with a big bowl of cookies. Lily wanted to play with the big, but her mom said they could go to the park.\n\nLily was very happy. She saw a big tree with a big bowl of cookies. She wanted to play with it. She asked her mom, \"Why are you sad?\" Her mom said, \"I'm sorry"
+}

hf/config.json

@@ -0,0 +1,64 @@
+{
+  "architectures": [
+    "Llama4ForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_chunk_size": 128,
+  "attention_dropout": 0.0,
+  "attn_scale": 0.1,
+  "attn_temperature_tuning": false,
+  "bos_token_id": 0,
+  "dtype": "bfloat16",
+  "eos_token_id": 1,
+  "floor_scale": 8192,
+  "head_dim": 24,
+  "hidden_act": "silu",
+  "hidden_size": 96,
+  "initializer_range": 0.02,
+  "interleave_moe_layer_step": 1,
+  "intermediate_size": 192,
+  "intermediate_size_mlp": 384,
+  "layer_types": [
+    "chunked_attention",
+    "full_attention",
+    "chunked_attention",
+    "full_attention",
+    "chunked_attention"
+  ],
+  "max_position_embeddings": 1024,
+  "model_type": "llama4_text",
+  "moe_layers": [
+    0,
+    1,
+    2,
+    3,
+    4
+  ],
+  "no_rope_layer_interval": 4,
+  "no_rope_layers": [
+    1,
+    0,
+    1,
+    0,
+    1
+  ],
+  "num_attention_heads": 4,
+  "num_experts_per_tok": 2,
+  "num_hidden_layers": 5,
+  "num_key_value_heads": 1,
+  "num_local_experts": 4,
+  "output_router_logits": false,
+  "pad_token_id": 2,
+  "rms_norm_eps": 1e-05,
+  "rope_parameters": {
+    "rope_theta": 500000.0,
+    "rope_type": "default"
+  },
+  "router_aux_loss_coef": 0.001,
+  "router_jitter_noise": 0.0,
+  "tie_word_embeddings": false,
+  "transformers_version": "5.9.0",
+  "use_cache": true,
+  "use_qk_norm": true,
+  "vocab_size": 1024
+}

hf/generation_config.json

@@ -0,0 +1,10 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "eos_token_id": 1,
+  "output_attentions": false,
+  "output_hidden_states": false,
+  "pad_token_id": 2,
+  "transformers_version": "5.9.0",
+  "use_cache": true
+}

hf/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec7d3f862bb4b47e65982f3db0b8c448a5b4f3b2df04d3b11179ace160494530
+size 3401496

hf/tokenizer.json

@@ -0,0 +1,4156 @@
+{
+  "version": "1.0",
+  "truncation": null,
+  "padding": null,
+  "added_tokens": [
+    {
+      "id": 0,
+      "content": "<s>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 1,
+      "content": "</s>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2,
+      "content": "<pad>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 3,
+      "content": "<unk>",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    }
+  ],
+  "normalizer": null,
+  "pre_tokenizer": {
+    "type": "ByteLevel",
+    "add_prefix_space": false,
+    "trim_offsets": true,
+    "use_regex": true
+  },
+  "post_processor": {
+    "type": "ByteLevel",
+    "add_prefix_space": true,
+    "trim_offsets": false,
+    "use_regex": true
+  },
+  "decoder": {
+    "type": "ByteLevel",
+    "add_prefix_space": true,
+    "trim_offsets": true,
+    "use_regex": true
+  },
+  "model": {
+    "type": "BPE",
+    "dropout": null,
+    "unk_token": null,
+    "continuing_subword_prefix": null,
+    "end_of_word_suffix": null,
+    "fuse_unk": false,
+    "byte_fallback": false,
+    "ignore_merges": false,
+    "vocab": {
+      "<s>": 0,
+      "</s>": 1,
+      "<pad>": 2,
+      "<unk>": 3,
+      "!": 4,
+      "\"": 5,
+      "#": 6,
+      "$": 7,
+      "%": 8,
+      "&": 9,
+      "'": 10,
+      "(": 11,
+      ")": 12,
+      "*": 13,
+      "+": 14,
+      ",": 15,
+      "-": 16,
+      ".": 17,
+      "/": 18,
+      "0": 19,
+      "1": 20,
+      "2": 21,
+      "3": 22,
+      "4": 23,
+      "5": 24,
+      "6": 25,
+      "7": 26,
+      "8": 27,
+      "9": 28,
+      ":": 29,
+      ";": 30,
+      "<": 31,
+      "=": 32,
+      ">": 33,
+      "?": 34,
+      "@": 35,
+      "A": 36,
+      "B": 37,
+      "C": 38,
+      "D": 39,
+      "E": 40,
+      "F": 41,
+      "G": 42,
+      "H": 43,
+      "I": 44,
+      "J": 45,
+      "K": 46,
+      "L": 47,
+      "M": 48,
+      "N": 49,
+      "O": 50,
+      "P": 51,
+      "Q": 52,
+      "R": 53,
+      "S": 54,
+      "T": 55,
+      "U": 56,
+      "V": 57,
+      "W": 58,
+      "X": 59,
+      "Y": 60,
+      "Z": 61,
+      "[": 62,
+      "\\": 63,
+      "]": 64,
+      "^": 65,
+      "_": 66,
+      "`": 67,
+      "a": 68,
+      "b": 69,
+      "c": 70,
+      "d": 71,
+      "e": 72,
+      "f": 73,
+      "g": 74,
+      "h": 75,
+      "i": 76,
+      "j": 77,
+      "k": 78,
+      "l": 79,
+      "m": 80,
+      "n": 81,
+      "o": 82,
+      "p": 83,
+      "q": 84,
+      "r": 85,
+      "s": 86,
+      "t": 87,
+      "u": 88,
+      "v": 89,
+      "w": 90,
+      "x": 91,
+      "y": 92,
+      "z": 93,
+      "{": 94,
+      "|": 95,
+      "}": 96,
+      "~": 97,
+      "¡": 98,
+      "¢": 99,
+      "£": 100,
+      "¤": 101,
+      "¥": 102,
+      "¦": 103,
+      "§": 104,
+      "¨": 105,
+      "©": 106,
+      "ª": 107,
+      "«": 108,
+      "¬": 109,
+      "®": 110,
+      "¯": 111,
+      "°": 112,
+      "±": 113,
+      "²": 114,
+      "³": 115,
+      "´": 116,
+      "µ": 117,
+      "¶": 118,
+      "·": 119,
+      "¸": 120,
+      "¹": 121,
+      "º": 122,
+      "»": 123,
+      "¼": 124,
+      "½": 125,
+      "¾": 126,
+      "¿": 127,
+      "À": 128,
+      "Á": 129,
+      "Â": 130,
+      "Ã": 131,
+      "Ä": 132,
+      "Å": 133,
+      "Æ": 134,
+      "Ç": 135,
+      "È": 136,
+      "É": 137,
+      "Ê": 138,
+      "Ë": 139,
+      "Ì": 140,
+      "Í": 141,
+      "Î": 142,
+      "Ï": 143,
+      "Ð": 144,
+      "Ñ": 145,
+      "Ò": 146,
+      "Ó": 147,
+      "Ô": 148,
+      "Õ": 149,
+      "Ö": 150,
+      "×": 151,
+      "Ø": 152,
+      "Ù": 153,
+      "Ú": 154,
+      "Û": 155,
+      "Ü": 156,
+      "Ý": 157,
+      "Þ": 158,
+      "ß": 159,
+      "à": 160,
+      "á": 161,
+      "â": 162,
+      "ã": 163,
+      "ä": 164,
+      "å": 165,
+      "æ": 166,
+      "ç": 167,
+      "è": 168,
+      "é": 169,
+      "ê": 170,
+      "ë": 171,
+      "ì": 172,
+      "í": 173,
+      "î": 174,
+      "ï": 175,
+      "ð": 176,
+      "ñ": 177,
+      "ò": 178,
+      "ó": 179,
+      "ô": 180,
+      "õ": 181,
+      "ö": 182,
+      "÷": 183,
+      "ø": 184,
+      "ù": 185,
+      "ú": 186,
+      "û": 187,
+      "ü": 188,
+      "ý": 189,
+      "þ": 190,
+      "ÿ": 191,
+      "Ā": 192,
+      "ā": 193,
+      "Ă": 194,
+      "ă": 195,
+      "Ą": 196,
+      "ą": 197,
+      "Ć": 198,
+      "ć": 199,
+      "Ĉ": 200,
+      "ĉ": 201,
+      "Ċ": 202,
+      "ċ": 203,
+      "Č": 204,
+      "č": 205,
+      "Ď": 206,
+      "ď": 207,
+      "Đ": 208,
+      "đ": 209,
+      "Ē": 210,
+      "ē": 211,
+      "Ĕ": 212,
+      "ĕ": 213,
+      "Ė": 214,
+      "ė": 215,
+      "Ę": 216,
+      "ę": 217,
+      "Ě": 218,
+      "ě": 219,
+      "Ĝ": 220,
+      "ĝ": 221,
+      "Ğ": 222,
+      "ğ": 223,
+      "Ġ": 224,
+      "ġ": 225,
+      "Ģ": 226,
+      "ģ": 227,
+      "Ĥ": 228,
+      "ĥ": 229,
+      "Ħ": 230,
+      "ħ": 231,
+      "Ĩ": 232,
+      "ĩ": 233,
+      "Ī": 234,
+      "ī": 235,
+      "Ĭ": 236,
+      "ĭ": 237,
+      "Į": 238,
+      "į": 239,
+      "İ": 240,
+      "ı": 241,
+      "IJ": 242,
+      "ij": 243,
+      "Ĵ": 244,
+      "ĵ": 245,
+      "Ķ": 246,
+      "ķ": 247,
+      "ĸ": 248,
+      "Ĺ": 249,
+      "ĺ": 250,
+      "Ļ": 251,
+      "ļ": 252,
+      "Ľ": 253,
+      "ľ": 254,
+      "Ŀ": 255,
+      "ŀ": 256,
+      "Ł": 257,
+      "ł": 258,
+      "Ń": 259,
+      "he": 260,
+      "Ġt": 261,
+      "Ġa": 262,
+      "Ġs": 263,
+      "Ġw": 264,
+      "nd": 265,
+      "Ġthe": 266,
+      "ed": 267,
+      "Ġand": 268,
+      "Ġto": 269,
+      "Ġb": 270,
+      "in": 271,
+      "Ġh": 272,
+      "Ġwa": 273,
+      "re": 274,
+      "ou": 275,
+      "Ġf": 276,
+      "it": 277,
+      "Ġl": 278,
+      "Ġc": 279,
+      "Ġd": 280,
+      "er": 281,
+      "Ġhe": 282,
+      "Ġm": 283,
+      "Ġp": 284,
+      "Ġwas": 285,
+      "om": 286,
+      "ĠT": 287,
+      "Ġo": 288,
+      "ay": 289,
+      "ar": 290,
+      "is": 291,
+      "ing": 292,
+      "il": 293,
+      "Ġg": 294,
+      "id": 295,
+      "at": 296,
+      "en": 297,
+      "Ġn": 298,
+      "Ġsa": 299,
+      "Ġha": 300,
+      "ĠS": 301,
+      "ĠThe": 302,
+      "an": 303,
+      "im": 304,
+      "or": 305,
+      "on": 306,
+      "Ġit": 307,
+      "Ġth": 308,
+      "ll": 309,
+      "le": 310,
+      "ĠH": 311,
+      "Ġher": 312,
+      "ot": 313,
+      "et": 314,
+      "ir": 315,
+      "ĠShe": 316,
+      "es": 317,
+      "ĠHe": 318,
+      "Ġin": 319,
+      "ver": 320,
+      "ut": 321,
+      "ow": 322,
+      "ĠThey": 323,
+      "ck": 324,
+      "Ġe": 325,
+      "Ġu": 326,
+      "ld": 327,
+      "Ġy": 328,
+      "oo": 329,
+      "Ġsaid": 330,
+      "ig": 331,
+      "Ġ\"": 332,
+      "ily": 333,
+      "Ġr": 334,
+      "Ġbe": 335,
+      "am": 336,
+      "Ġst": 337,
+      "ĠI": 338,
+      "ce": 339,
+      "ke": 340,
+      "Ġshe": 341,
+      "ve": 342,
+      "pp": 343,
+      "ith": 344,
+      "Ġwith": 345,
+      "Lily": 346,
+      "On": 347,
+      "Ġon": 348,
+      "Ġyou": 349,
+      "Ġof": 350,
+      "ked": 351,
+      "ri": 352,
+      "Ġso": 353,
+      "nt": 354,
+      "Ġhis": 355,
+      "Ġpl": 356,
+      "ad": 357,
+      "very": 358,
+      "Ġday": 359,
+      "Ġthat": 360,
+      "Ġup": 361,
+      "Ġplay": 362,
+      "Ġhad": 363,
+      "st": 364,
+      "Ġthey": 365,
+      "Ġwe": 366,
+      "ĠLily": 367,
+      "Ġmom": 368,
+      "Ġfor": 369,
+      "ĠB": 370,
+      "el": 371,
+      "un": 372,
+      "ould": 373,
+      "'s": 374,
+      "my": 375,
+      "The": 376,
+      "Ġli": 377,
+      "ch": 378,
+      "ent": 379,
+      "Ġhapp": 380,
+      "Ġwant": 381,
+      "itt": 382,
+      "Ġsh": 383,
+      "out": 384,
+      "her": 385,
+      "Ġdo": 386,
+      "ly": 387,
+      "Ġnot": 388,
+      "ome": 389,
+      "se": 390,
+      "Ġvery": 391,
+      "ound": 392,
+      "end": 393,
+      "all": 394,
+      "Ġwh": 395,
+      "ime": 396,
+      "ittle": 397,
+      "Ġk": 398,
+      "Ġtime": 399,
+      "Ġlittle": 400,
+      "al": 401,
+      "ĠĊ": 402,
+      "Ġthere": 403,
+      "Ġne": 404,
+      "ht": 405,
+      "ĠM": 406,
+      "Ġre": 407,
+      "Ġhappy": 408,
+      "Ġsm": 409,
+      "Ġbig": 410,
+      "Ġis": 411,
+      "ĠIt": 412,
+      "Ġbut": 413,
+      "ack": 414,
+      "Ġan": 415,
+      "Ġsaw": 416,
+      "riend": 417,
+      ".\"": 418,
+      "Ġfriend": 419,
+      "ry": 420,
+      "Ġas": 421,
+      "ra": 422,
+      "One": 423,
+      "ide": 424,
+      "ake": 425,
+      "'t": 426,
+      "!\"": 427,
+      "ug": 428,
+      "Ġloo": 429,
+      "ved": 430,
+      "ter": 431,
+      "Ġwere": 432,
+      "ore": 433,
+      "Once": 434,
+      "Ġlo": 435,
+      "ec": 436,
+      "Ġhim": 437,
+      "Ġtoo": 438,
+      "Ġgo": 439,
+      "Ġbo": 440,
+      "Ġse": 441,
+      "irl": 442,
+      "Ġare": 443,
+      "Ġj": 444,
+      "ĠTim": 445,
+      "ard": 446,
+      "Ġwanted": 447,
+      "ill": 448,
+      "Ġgirl": 449,
+      "Ġupon": 450,
+      "Ġthem": 451,
+      "Ġout": 452,
+      "Ġat": 453,
+      "ur": 454,
+      "ind": 455,
+      "Ġtheir": 456,
+      "fu": 457,
+      "Ġsp": 458,
+      "way": 459,
+      "ĠA": 460,
+      "Ġsmil": 461,
+      "Ġdid": 462,
+      "Ġcould": 463,
+      "hen": 464,
+      "Ġhave": 465,
+      "ain": 466,
+      "art": 467,
+      "Ġex": 468,
+      "hed": 469,
+      "rom": 470,
+      "Ġwent": 471,
+      "Ġar": 472,
+      "ic": 473,
+      "Ġcan": 474,
+      "ĠJ": 475,
+      "lp": 476,
+      "ful": 477,
+      "ĠBen": 478,
+      "ood": 479,
+      "?\"": 480,
+      "hing": 481,
+      "Ġfriends": 482,
+      "Ġnam": 483,
+      "ight": 484,
+      "Ġall": 485,
+      "Ġhelp": 486,
+      "Ġkn": 487,
+      "um": 488,
+      "one": 489,
+      "ark": 490,
+      "Ġback": 491,
+      "Ġsay": 492,
+      "You": 493,
+      "Ġfun": 494,
+      "Ġcl": 495,
+      "ĠTom": 496,
+      "are": 497,
+      "Ġno": 498,
+      "Ġle": 499,
+      "op": 500,
+      "Ġsmiled": 501,
+      "Ġsc": 502,
+      "Ġnamed": 503,
+      "Ġal": 504,
+      "oug": 505,
+      "Ġloved": 506,
+      "side": 507,
+      "elt": 508,
+      "ĠOne": 509,
+      "Ġman": 510,
+      "Ġasked": 511,
+      "ick": 512,
+      "Ġtoy": 513,
+      "Ġlike": 514,
+      "Ġfe": 515,
+      "Ġfelt": 516,
+      "Ġlooked": 517,
+      "Ġsome": 518,
+      "Ġaround": 519,
+      "Ġsee": 520,
+      "Ġme": 521,
+      "ame": 522,
+      "omet": 523,
+      "ĠW": 524,
+      "Ġro": 525,
+      "Ġbr": 526,
+      "ure": 527,
+      "ĠTimmy": 528,
+      "Ġbir": 529,
+      "get": 530,
+      "ice": 531,
+      "Ġboy": 532,
+      "Ġwould": 533,
+      "Ġstart": 534,
+      "ong": 535,
+      "â": 536,
+      "âĤ": 537,
+      "âĤ¬": 538,
+      "ss": 539,
+      "Ġbird": 540,
+      "Ġsomet": 541,
+      "Ġfa": 542,
+      "dd": 543,
+      "ings": 544,
+      "Ġag": 545,
+      "Ġwor": 546,
+      "Ġwhat": 547,
+      "ade": 548,
+      "Ġmake": 549,
+      "king": 550,
+      ",\"": 551,
+      "ie": 552,
+      "ĠBut": 553,
+      "own": 554,
+      "Ġtre": 555,
+      "Ġran": 556,
+      "gether": 557,
+      "ĠYou": 558,
+      "Ġaway": 559,
+      "ag": 560,
+      "ared": 561,
+      "Ġsays": 562,
+      "Ġstarted": 563,
+      "oud": 564,
+      "if": 565,
+      "Ġmade": 566,
+      "Ġcar": 567,
+      "Ġsomething": 568,
+      "Ġtogether": 569,
+      "ited": 570,
+      "ther": 571,
+      "Ġpark": 572,
+      "Ġco": 573,
+      "Ġsad": 574,
+      "Ġother": 575,
+      "Ġnew": 576,
+      "Ġexc": 577,
+      "Ġput": 578,
+      "Ġfrom": 579,
+      "Ġpr": 580,
+      "ell": 581,
+      "ĠL": 582,
+      "Ġla": 583,
+      "Ġhug": 584,
+      "ble": 585,
+      "Ġmu": 586,
+      "ook": 587,
+      "ach": 588,
+      "Ġagain": 589,
+      "Ġhome": 590,
+      "Ġwhen": 591,
+      "Ġgood": 592,
+      "hat": 593,
+      "ep": 594,
+      "Ġwho": 595,
+      "est": 596,
+      "ried": 597,
+      "Ġfound": 598,
+      "Ġfl": 599,
+      "Ġthen": 600,
+      "Ġch": 601,
+      "Ġdec": 602,
+      "pped": 603,
+      "Ġwal": 604,
+      "as": 605,
+      "Ġget": 606,
+      "qu": 607,
+      "Ġplaying": 608,
+      "ought": 609,
+      "pl": 610,
+      "ĠE": 611,
+      "ally": 612,
+      "Ġsw": 613,
+      "ous": 614,
+      "nn": 615,
+      "Ġthings": 616,
+      "Ġexcited": 617,
+      "Ġliked": 618,
+      "Ġgot": 619,
+      "uck": 620,
+      "ro": 621,
+      "ided": 622,
+      "Ġdecided": 623,
+      "Ġbl": 624,
+      "ave": 625,
+      "Ġcame": 626,
+      "Ġevery": 627,
+      "ara": 628,
+      "Ġyour": 629,
+      "ĠD": 630,
+      "ĠMom": 631,
+      "ax": 632,
+      "Ġv": 633,
+      "Ġscared": 634,
+      "ust": 635,
+      "Ġone": 636,
+      "Ġdog": 637,
+      "Ġdown": 638,
+      "ouse": 639,
+      "ny": 640,
+      "Ġfind": 641,
+      "Ġcare": 642,
+      "Ġbec": 643,
+      "ist": 644,
+      "Ġthan": 645,
+      "Ġfeel": 646,
+      "ap": 647,
+      "ue": 648,
+      "udd": 649,
+      "nna": 650,
+      "Ġdad": 651,
+      "Ġab": 652,
+      "They": 653,
+      "Ġmy": 654,
+      "Ġlook": 655,
+      "Ġke": 656,
+      "our": 657,
+      "Ġwill": 658,
+      "arn": 659,
+      "Ġgr": 660,
+      "us": 661,
+      "nder": 662,
+      "Ġgra": 663,
+      "ways": 664,
+      "ess": 665,
+      "Ġdidn": 666,
+      "Ġpo": 667,
+      "fe": 668,
+      "Ġalways": 669,
+      "Ġtook": 670,
+      "Ġabout": 671,
+      "ant": 672,
+      "bb": 673,
+      "Ġlot": 674,
+      "Ġmommy": 675,
+      "Ġtoys": 676,
+      "Ġkne": 677,
+      "ers": 678,
+      "ise": 679,
+      "ite": 680,
+      "Ġoutside": 681,
+      "Ġtree": 682,
+      "Ġthought": 683,
+      "Ġball": 684,
+      "ĠF": 685,
+      "Ġmore": 686,
+      "eci": 687,
+      "ĠSam": 688,
+      "ened": 689,
+      "ched": 690,
+      "Ġta": 691,
+      "Ġold": 692,
+      "Ġho": 693,
+      "Ġlearn": 694,
+      "ret": 695,
+      "Ġint": 696,
+      "ged": 697,
+      "Ġknow": 698,
+      "Ġlaug": 699,
+      "Ġtake": 700,
+      "ecial": 701,
+      "Ġspecial": 702,
+      "Ġsor": 703,
+      "Ġcat": 704,
+      "udden": 705,
+      "Ġknew": 706,
+      "ĠMax": 707,
+      "ive": 708,
+      "ia": 709,
+      "Ġpe": 710,
+      "Ġany": 711,
+      "uddenly": 712,
+      "Ġtr": 713,
+      "fter": 714,
+      "Ġhow": 715,
+      "ma": 716,
+      "Ġshow": 717,
+      "ink": 718,
+      "Ġsorry": 719,
+      "Ġtw": 720,
+      "But": 721,
+      "Ġmuch": 722,
+      "au": 723,
+      "ish": 724,
+      "Ġrun": 725,
+      "and": 726,
+      "Ġhand": 727,
+      "Ġsl": 728,
+      "ven": 729,
+      "Ġhouse": 730,
+      "Ġor": 731,
+      "Ġop": 732,
+      "Ġsk": 733,
+      "Ġmo": 734,
+      "Ġclo": 735,
+      "Ġsun": 736,
+      "Ġinto": 737,
+      "Ġtried": 738,
+      "Ġinside": 739,
+      "ate": 740,
+      "Ġtold": 741,
+      "Ġwater": 742,
+      "Ġthis": 743,
+      "Ġen": 744,
+      "ank": 745,
+      "Ġif": 746,
+      "Ġproud": 747,
+      "ump": 748,
+      "Ġqu": 749,
+      "Ġover": 750,
+      "Ġcouldn": 751,
+      "Tom": 752,
+      "dy": 753,
+      "Ġgave": 754,
+      "Ġheard": 755,
+      "ĠSara": 756,
+      "Ġnever": 757,
+      "by": 758,
+      "Ġeach": 759,
+      "ace": 760,
+      "Ġroom": 761,
+      "ty": 762,
+      "Ġexpl": 763,
+      "ĠEvery": 764,
+      "Ġeat": 765,
+      "ĠWe": 766,
+      "other": 767,
+      "ause": 768,
+      "Ġpick": 769,
+      "ion": 770,
+      "Ġpret": 771,
+      "ĠAnna": 772,
+      "Mom": 773,
+      "Ġplayed": 774,
+      "ge": 775,
+      "etter": 776,
+      "Ġjust": 777,
+      "ak": 778,
+      "Ġhugged": 779,
+      "Ġgre": 780,
+      "here": 781,
+      "Ġoff": 782,
+      "Ġcom": 783,
+      "Ġwat": 784,
+      "oth": 785,
+      "Ġbox": 786,
+      "Ġnice": 787,
+      "'m": 788,
+      "Ġstr": 789,
+      "Ġbecause": 790,
+      "Ġneed": 791,
+      "ile": 792,
+      "Ġmany": 793,
+      "Ġfo": 794,
+      "uc": 795,
+      "Ġjo": 796,
+      "Ġbear": 797,
+      "Ġsmall": 798,
+      "iz": 799,
+      "Ġbu": 800,
+      "ving": 801,
+      "Ġlong": 802,
+      "ine": 803,
+      "gry": 804,
+      "imal": 805,
+      "ort": 806,
+      "Ġanimal": 807,
+      "Ġsn": 808,
+      "ough": 809,
+      "Ġtry": 810,
+      "Ġunt": 811,
+      "ild": 812,
+      "sel": 813,
+      "urt": 814,
+      "Ġuntil": 815,
+      "ĠJack": 816,
+      "sed": 817,
+      "Ġkind": 818,
+      "Ġlearned": 819,
+      "Ġim": 820,
+      "Ġlove": 821,
+      "Ġbetter": 822,
+      "ft": 823,
+      "Ġflow": 824,
+      "Ġcall": 825,
+      "Ġdon": 826,
+      "He": 827,
+      "ĠJo": 828,
+      "Ġend": 829,
+      "Ġad": 830,
+      "ull": 831,
+      "Ġbest": 832,
+      "vent": 833,
+      "Yes": 834,
+      "ars": 835,
+      "urp": 836,
+      "ady": 837,
+      "em": 838,
+      "ream": 839,
+      "aut": 840,
+      "urn": 841,
+      "ĠMia": 842,
+      "Ġcle": 843,
+      "ĠAnd": 844,
+      "ves": 845,
+      "Åĵ": 846,
+      "arden": 847,
+      "ĠC": 848,
+      "Ġgarden": 849,
+      "Ġfast": 850,
+      "Ġcareful": 851,
+      "ber": 852,
+      "Ġbeaut": 853,
+      "lly": 854,
+      "Th": 855,
+      "Ġeven": 856,
+      "pt": 857,
+      "Ġbra": 858,
+      "ies": 859,
+      "Ġthanked": 860,
+      "Ġfi": 861,
+      "ĠSo": 862,
+      "Ġche": 863,
+      "Ġlaughed": 864,
+      "Ġsky": 865,
+      "Ġby": 866,
+      "It": 867,
+      "ĠHer": 868,
+      "Ġjump": 869,
+      "Ġgl": 870,
+      "ase": 871,
+      "Ġte": 872,
+      "Ġloud": 873,
+      "self": 874,
+      "iny": 875,
+      "Ġway": 876,
+      "wn": 877,
+      "Ġbeauti": 878,
+      "Ġcome": 879,
+      "lew": 880,
+      "Ġlist": 881,
+      "Ġwo": 882,
+      "Ġbeautiful": 883,
+      "Ġhard": 884,
+      "Ġlots": 885,
+      "Ġra": 886,
+      "Ġstill": 887,
+      "Ġfam": 888,
+      "Ġanimals": 889,
+      "Ġâ": 890,
+      "Ġhurt": 891,
+      "Ġunder": 892,
+      "ĠThen": 893,
+      "ect": 894,
+      "Ġstay": 895,
+      "ning": 896,
+      "Ġlet": 897,
+      "ct": 898,
+      "Ġboth": 899,
+      "Ġcu": 900,
+      "ĠHis": 901,
+      "hes": 902,
+      "be": 903,
+      "Ġsafe": 904,
+      "ĠFrom": 905,
+      "ool": 906,
+      "ree": 907,
+      "Ġcol": 908,
+      "Ġtwo": 909,
+      "Ġbad": 910,
+      "Ġbook": 911,
+      "Ġimp": 912,
+      "ople": 913,
+      "Ġrem": 914,
+      "ane": 915,
+      "Ġlived": 916,
+      "kay": 917,
+      "ock": 918,
+      "ucy": 919,
+      "Ġwalked": 920,
+      "Tim": 921,
+      "ast": 922,
+      "urpr": 923,
+      "Ġbrave": 924,
+      "Ġshould": 925,
+      "Ġits": 926,
+      "ob": 927,
+      "ished": 928,
+      "Ġangry": 929,
+      "Ġsurpr": 930,
+      "Ġfamily": 931,
+      "ress": 932,
+      "igh": 933,
+      "When": 934,
+      "Ġpeople": 935,
+      "Ġflew": 936,
+      "Ġcalled": 937,
+      "No": 938,
+      "Ġred": 939,
+      "Ġstor": 940,
+      "ip": 941,
+      "Ġsoon": 942,
+      "Ġfin": 943,
+      "hn": 944,
+      "Let": 945,
+      "led": 946,
+      "Ġkept": 947,
+      "Ġfore": 948,
+      "fore": 949,
+      "Ġdan": 950,
+      "Ġshare": 951,
+      "Ġfly": 952,
+      "xt": 953,
+      "ised": 954,
+      "dded": 955,
+      "Ġpic": 956,
+      "âĤ¬â": 957,
+      "Ġdoor": 958,
+      "Ġgoing": 959,
+      "ĠP": 960,
+      "ĠWhen": 961,
+      "Ġpretty": 962,
+      "Ġkeep": 963,
+      "Ġnow": 964,
+      "Ġrock": 965,
+      "Ġclean": 966,
+      "Ġdra": 967,
+      "ary": 968,
+      "Ġadvent": 969,
+      "ummy": 970,
+      "Ġnoise": 971,
+      "Ġopened": 972,
+      "Ġshiny": 973,
+      "age": 974,
+      "Ġexplore": 975,
+      "Ġwind": 976,
+      "Ġdoll": 977,
+      "Ġcry": 978,
+      "Ġcon": 979,
+      "Ġide": 980,
+      "Ġbefore": 981,
+      "ied": 982,
+      "Ben": 983,
+      "illy": 984,
+      "Ġreal": 985,
+      "Ġsto": 986,
+      "so": 987,
+      "What": 988,
+      "Ġground": 989,
+      "Ġalso": 990,
+      "les": 991,
+      "Ġturn": 992,
+      "Ħ¢": 993,
+      "âĤ¬âĦ¢": 994,
+      "Ġey": 995,
+      "That": 996,
+      "Ġfar": 997,
+      "Ġidea": 998,
+      "Ġfr": 999,
+      "oon": 1000,
+      "Ġnodded": 1001,
+      "Ġcolor": 1002,
+      "Ġwar": 1003,
+      "oy": 1004,
+      "Ġfeeling": 1005,
+      "Ġun": 1006,
+      "Ġpicked": 1007,
+      "imb": 1008,
+      "th": 1009,
+      "ĠLucy": 1010,
+      "Ġnext": 1011,
+      "Ġwalking": 1012,
+      "thing": 1013,
+      "ture": 1014,
+      "ĠDad": 1015,
+      "Ġclimb": 1016,
+      "Ġhas": 1017,
+      "uch": 1018,
+      "Ġma": 1019,
+      "Ġthr": 1020,
+      "Ġwhile": 1021,
+      "eet": 1022,
+      "Ġbed": 1023
+    },
+    "merges": [
+      [
+        "h",
+        "e"
+      ],
+      [
+        "Ġ",
+        "t"
+      ],
+      [
+        "Ġ",
+        "a"
+      ],
+      [
+        "Ġ",
+        "s"
+      ],
+      [
+        "Ġ",
+        "w"
+      ],
+      [
+        "n",
+        "d"
+      ],
+      [
+        "Ġt",
+        "he"
+      ],
+      [
+        "e",
+        "d"
+      ],
+      [
+        "Ġa",
+        "nd"
+      ],
+      [
+        "Ġt",
+        "o"
+      ],
+      [
+        "Ġ",
+        "b"
+      ],
+      [
+        "i",
+        "n"
+      ],
+      [
+        "Ġ",
+        "h"
+      ],
+      [
+        "Ġw",
+        "a"
+      ],
+      [
+        "r",
+        "e"
+      ],
+      [
+        "o",
+        "u"
+      ],
+      [
+        "Ġ",
+        "f"
+      ],
+      [
+        "i",
+        "t"
+      ],
+      [
+        "Ġ",
+        "l"
+      ],
+      [
+        "Ġ",
+        "c"
+      ],
+      [
+        "Ġ",
+        "d"
+      ],
+      [
+        "e",
+        "r"
+      ],
+      [
+        "Ġ",
+        "he"
+      ],
+      [
+        "Ġ",
+        "m"
+      ],
+      [
+        "Ġ",
+        "p"
+      ],
+      [
+        "Ġwa",
+        "s"
+      ],
+      [
+        "o",
+        "m"
+      ],
+      [
+        "Ġ",
+        "T"
+      ],
+      [
+        "Ġ",
+        "o"
+      ],
+      [
+        "a",
+        "y"
+      ],
+      [
+        "a",
+        "r"
+      ],
+      [
+        "i",
+        "s"
+      ],
+      [
+        "in",
+        "g"
+      ],
+      [
+        "i",
+        "l"
+      ],
+      [
+        "Ġ",
+        "g"
+      ],
+      [
+        "i",
+        "d"
+      ],
+      [
+        "a",
+        "t"
+      ],
+      [
+        "e",
+        "n"
+      ],
+      [
+        "Ġ",
+        "n"
+      ],
+      [
+        "Ġs",
+        "a"
+      ],
+      [
+        "Ġh",
+        "a"
+      ],
+      [
+        "Ġ",
+        "S"
+      ],
+      [
+        "ĠT",
+        "he"
+      ],
+      [
+        "a",
+        "n"
+      ],
+      [
+        "i",
+        "m"
+      ],
+      [
+        "o",
+        "r"
+      ],
+      [
+        "o",
+        "n"
+      ],
+      [
+        "Ġ",
+        "it"
+      ],
+      [
+        "Ġt",
+        "h"
+      ],
+      [
+        "l",
+        "l"
+      ],
+      [
+        "l",
+        "e"
+      ],
+      [
+        "Ġ",
+        "H"
+      ],
+      [
+        "Ġhe",
+        "r"
+      ],
+      [
+        "o",
+        "t"
+      ],
+      [
+        "e",
+        "t"
+      ],
+      [
+        "i",
+        "r"
+      ],
+      [
+        "ĠS",
+        "he"
+      ],
+      [
+        "e",
+        "s"
+      ],
+      [
+        "ĠH",
+        "e"
+      ],
+      [
+        "Ġ",
+        "in"
+      ],
+      [
+        "v",
+        "er"
+      ],
+      [
+        "u",
+        "t"
+      ],
+      [
+        "o",
+        "w"
+      ],
+      [
+        "ĠThe",
+        "y"
+      ],
+      [
+        "c",
+        "k"
+      ],
+      [
+        "Ġ",
+        "e"
+      ],
+      [
+        "Ġ",
+        "u"
+      ],
+      [
+        "l",
+        "d"
+      ],
+      [
+        "Ġ",
+        "y"
+      ],
+      [
+        "o",
+        "o"
+      ],
+      [
+        "Ġsa",
+        "id"
+      ],
+      [
+        "i",
+        "g"
+      ],
+      [
+        "Ġ",
+        "\""
+      ],
+      [
+        "il",
+        "y"
+      ],
+      [
+        "Ġ",
+        "r"
+      ],
+      [
+        "Ġb",
+        "e"
+      ],
+      [
+        "a",
+        "m"
+      ],
+      [
+        "Ġs",
+        "t"
+      ],
+      [
+        "Ġ",
+        "I"
+      ],
+      [
+        "c",
+        "e"
+      ],
+      [
+        "k",
+        "e"
+      ],
+      [
+        "Ġs",
+        "he"
+      ],
+      [
+        "v",
+        "e"
+      ],
+      [
+        "p",
+        "p"
+      ],
+      [
+        "it",
+        "h"
+      ],
+      [
+        "Ġw",
+        "ith"
+      ],
+      [
+        "L",
+        "ily"
+      ],
+      [
+        "O",
+        "n"
+      ],
+      [
+        "Ġo",
+        "n"
+      ],
+      [
+        "Ġy",
+        "ou"
+      ],
+      [
+        "Ġo",
+        "f"
+      ],
+      [
+        "k",
+        "ed"
+      ],
+      [
+        "r",
+        "i"
+      ],
+      [
+        "Ġs",
+        "o"
+      ],
+      [
+        "n",
+        "t"
+      ],
+      [
+        "Ġh",
+        "is"
+      ],
+      [
+        "Ġp",
+        "l"
+      ],
+      [
+        "a",
+        "d"
+      ],
+      [
+        "ver",
+        "y"
+      ],
+      [
+        "Ġd",
+        "ay"
+      ],
+      [
+        "Ġth",
+        "at"
+      ],
+      [
+        "Ġu",
+        "p"
+      ],
+      [
+        "Ġpl",
+        "ay"
+      ],
+      [
+        "Ġha",
+        "d"
+      ],
+      [
+        "s",
+        "t"
+      ],
+      [
+        "Ġthe",
+        "y"
+      ],
+      [
+        "Ġw",
+        "e"
+      ],
+      [
+        "Ġ",
+        "Lily"
+      ],
+      [
+        "Ġm",
+        "om"
+      ],
+      [
+        "Ġf",
+        "or"
+      ],
+      [
+        "Ġ",
+        "B"
+      ],
+      [
+        "e",
+        "l"
+      ],
+      [
+        "u",
+        "n"
+      ],
+      [
+        "ou",
+        "ld"
+      ],
+      [
+        "'",
+        "s"
+      ],
+      [
+        "m",
+        "y"
+      ],
+      [
+        "T",
+        "he"
+      ],
+      [
+        "Ġl",
+        "i"
+      ],
+      [
+        "c",
+        "h"
+      ],
+      [
+        "en",
+        "t"
+      ],
+      [
+        "Ġha",
+        "pp"
+      ],
+      [
+        "Ġwa",
+        "nt"
+      ],
+      [
+        "it",
+        "t"
+      ],
+      [
+        "Ġs",
+        "h"
+      ],
+      [
+        "ou",
+        "t"
+      ],
+      [
+        "he",
+        "r"
+      ],
+      [
+        "Ġd",
+        "o"
+      ],
+      [
+        "l",
+        "y"
+      ],
+      [
+        "Ġn",
+        "ot"
+      ],
+      [
+        "om",
+        "e"
+      ],
+      [
+        "s",
+        "e"
+      ],
+      [
+        "Ġ",
+        "very"
+      ],
+      [
+        "ou",
+        "nd"
+      ],
+      [
+        "e",
+        "nd"
+      ],
+      [
+        "a",
+        "ll"
+      ],
+      [
+        "Ġw",
+        "h"
+      ],
+      [
+        "im",
+        "e"
+      ],
+      [
+        "itt",
+        "le"
+      ],
+      [
+        "Ġ",
+        "k"
+      ],
+      [
+        "Ġt",
+        "ime"
+      ],
+      [
+        "Ġl",
+        "ittle"
+      ],
+      [
+        "a",
+        "l"
+      ],
+      [
+        "Ġ",
+        "Ċ"
+      ],
+      [
+        "Ġthe",
+        "re"
+      ],
+      [
+        "Ġn",
+        "e"
+      ],
+      [
+        "h",
+        "t"
+      ],
+      [
+        "Ġ",
+        "M"
+      ],
+      [
+        "Ġ",
+        "re"
+      ],
+      [
+        "Ġhapp",
+        "y"
+      ],
+      [
+        "Ġs",
+        "m"
+      ],
+      [
+        "Ġb",
+        "ig"
+      ],
+      [
+        "Ġ",
+        "is"
+      ],
+      [
+        "ĠI",
+        "t"
+      ],
+      [
+        "Ġb",
+        "ut"
+      ],
+      [
+        "a",
+        "ck"
+      ],
+      [
+        "Ġa",
+        "n"
+      ],
+      [
+        "Ġsa",
+        "w"
+      ],
+      [
+        "ri",
+        "end"
+      ],
+      [
+        ".",
+        "\""
+      ],
+      [
+        "Ġf",
+        "riend"
+      ],
+      [
+        "r",
+        "y"
+      ],
+      [
+        "Ġa",
+        "s"
+      ],
+      [
+        "r",
+        "a"
+      ],
+      [
+        "On",
+        "e"
+      ],
+      [
+        "id",
+        "e"
+      ],
+      [
+        "a",
+        "ke"
+      ],
+      [
+        "'",
+        "t"
+      ],
+      [
+        "!",
+        "\""
+      ],
+      [
+        "u",
+        "g"
+      ],
+      [
+        "Ġl",
+        "oo"
+      ],
+      [
+        "v",
+        "ed"
+      ],
+      [
+        "t",
+        "er"
+      ],
+      [
+        "Ġwe",
+        "re"
+      ],
+      [
+        "o",
+        "re"
+      ],
+      [
+        "On",
+        "ce"
+      ],
+      [
+        "Ġl",
+        "o"
+      ],
+      [
+        "e",
+        "c"
+      ],
+      [
+        "Ġh",
+        "im"
+      ],
+      [
+        "Ġto",
+        "o"
+      ],
+      [
+        "Ġg",
+        "o"
+      ],
+      [
+        "Ġb",
+        "o"
+      ],
+      [
+        "Ġs",
+        "e"
+      ],
+      [
+        "ir",
+        "l"
+      ],
+      [
+        "Ġa",
+        "re"
+      ],
+      [
+        "Ġ",
+        "j"
+      ],
+      [
+        "ĠT",
+        "im"
+      ],
+      [
+        "ar",
+        "d"
+      ],
+      [
+        "Ġwant",
+        "ed"
+      ],
+      [
+        "il",
+        "l"
+      ],
+      [
+        "Ġg",
+        "irl"
+      ],
+      [
+        "Ġup",
+        "on"
+      ],
+      [
+        "Ġthe",
+        "m"
+      ],
+      [
+        "Ġ",
+        "out"
+      ],
+      [
+        "Ġa",
+        "t"
+      ],
+      [
+        "u",
+        "r"
+      ],
+      [
+        "i",
+        "nd"
+      ],
+      [
+        "Ġthe",
+        "ir"
+      ],
+      [
+        "f",
+        "u"
+      ],
+      [
+        "Ġs",
+        "p"
+      ],
+      [
+        "w",
+        "ay"
+      ],
+      [
+        "Ġ",
+        "A"
+      ],
+      [
+        "Ġsm",
+        "il"
+      ],
+      [
+        "Ġd",
+        "id"
+      ],
+      [
+        "Ġc",
+        "ould"
+      ],
+      [
+        "he",
+        "n"
+      ],
+      [
+        "Ġha",
+        "ve"
+      ],
+      [
+        "a",
+        "in"
+      ],
+      [
+        "ar",
+        "t"
+      ],
+      [
+        "Ġe",
+        "x"
+      ],
+      [
+        "he",
+        "d"
+      ],
+      [
+        "r",
+        "om"
+      ],
+      [
+        "Ġw",
+        "ent"
+      ],
+      [
+        "Ġa",
+        "r"
+      ],
+      [
+        "i",
+        "c"
+      ],
+      [
+        "Ġc",
+        "an"
+      ],
+      [
+        "Ġ",
+        "J"
+      ],
+      [
+        "l",
+        "p"
+      ],
+      [
+        "fu",
+        "l"
+      ],
+      [
+        "ĠB",
+        "en"
+      ],
+      [
+        "oo",
+        "d"
+      ],
+      [
+        "?",
+        "\""
+      ],
+      [
+        "h",
+        "ing"
+      ],
+      [
+        "Ġfriend",
+        "s"
+      ],
+      [
+        "Ġn",
+        "am"
+      ],
+      [
+        "ig",
+        "ht"
+      ],
+      [
+        "Ġa",
+        "ll"
+      ],
+      [
+        "Ġhe",
+        "lp"
+      ],
+      [
+        "Ġk",
+        "n"
+      ],
+      [
+        "u",
+        "m"
+      ],
+      [
+        "on",
+        "e"
+      ],
+      [
+        "ar",
+        "k"
+      ],
+      [
+        "Ġb",
+        "ack"
+      ],
+      [
+        "Ġs",
+        "ay"
+      ],
+      [
+        "Y",
+        "ou"
+      ],
+      [
+        "Ġf",
+        "un"
+      ],
+      [
+        "Ġc",
+        "l"
+      ],
+      [
+        "ĠT",
+        "om"
+      ],
+      [
+        "a",
+        "re"
+      ],
+      [
+        "Ġn",
+        "o"
+      ],
+      [
+        "Ġl",
+        "e"
+      ],
+      [
+        "o",
+        "p"
+      ],
+      [
+        "Ġsmil",
+        "ed"
+      ],
+      [
+        "Ġs",
+        "c"
+      ],
+      [
+        "Ġnam",
+        "ed"
+      ],
+      [
+        "Ġa",
+        "l"
+      ],
+      [
+        "ou",
+        "g"
+      ],
+      [
+        "Ġlo",
+        "ved"
+      ],
+      [
+        "s",
+        "ide"
+      ],
+      [
+        "el",
+        "t"
+      ],
+      [
+        "Ġ",
+        "One"
+      ],
+      [
+        "Ġm",
+        "an"
+      ],
+      [
+        "Ġas",
+        "ked"
+      ],
+      [
+        "i",
+        "ck"
+      ],
+      [
+        "Ġto",
+        "y"
+      ],
+      [
+        "Ġli",
+        "ke"
+      ],
+      [
+        "Ġf",
+        "e"
+      ],
+      [
+        "Ġf",
+        "elt"
+      ],
+      [
+        "Ġloo",
+        "ked"
+      ],
+      [
+        "Ġs",
+        "ome"
+      ],
+      [
+        "Ġar",
+        "ound"
+      ],
+      [
+        "Ġse",
+        "e"
+      ],
+      [
+        "Ġm",
+        "e"
+      ],
+      [
+        "am",
+        "e"
+      ],
+      [
+        "om",
+        "et"
+      ],
+      [
+        "Ġ",
+        "W"
+      ],
+      [
+        "Ġr",
+        "o"
+      ],
+      [
+        "Ġb",
+        "r"
+      ],
+      [
+        "u",
+        "re"
+      ],
+      [
+        "ĠTim",
+        "my"
+      ],
+      [
+        "Ġb",
+        "ir"
+      ],
+      [
+        "g",
+        "et"
+      ],
+      [
+        "i",
+        "ce"
+      ],
+      [
+        "Ġbo",
+        "y"
+      ],
+      [
+        "Ġw",
+        "ould"
+      ],
+      [
+        "Ġst",
+        "art"
+      ],
+      [
+        "on",
+        "g"
+      ],
+      [
+        "Ã",
+        "¢"
+      ],
+      [
+        "â",
+        "Ĥ"
+      ],
+      [
+        "âĤ",
+        "¬"
+      ],
+      [
+        "s",
+        "s"
+      ],
+      [
+        "Ġbir",
+        "d"
+      ],
+      [
+        "Ġs",
+        "omet"
+      ],
+      [
+        "Ġf",
+        "a"
+      ],
+      [
+        "d",
+        "d"
+      ],
+      [
+        "ing",
+        "s"
+      ],
+      [
+        "Ġa",
+        "g"
+      ],
+      [
+        "Ġw",
+        "or"
+      ],
+      [
+        "Ġwh",
+        "at"
+      ],
+      [
+        "ad",
+        "e"
+      ],
+      [
+        "Ġm",
+        "ake"
+      ],
+      [
+        "k",
+        "ing"
+      ],
+      [
+        ",",
+        "\""
+      ],
+      [
+        "i",
+        "e"
+      ],
+      [
+        "ĠB",
+        "ut"
+      ],
+      [
+        "ow",
+        "n"
+      ],
+      [
+        "Ġt",
+        "re"
+      ],
+      [
+        "Ġr",
+        "an"
+      ],
+      [
+        "get",
+        "her"
+      ],
+      [
+        "Ġ",
+        "You"
+      ],
+      [
+        "Ġa",
+        "way"
+      ],
+      [
+        "a",
+        "g"
+      ],
+      [
+        "ar",
+        "ed"
+      ],
+      [
+        "Ġsay",
+        "s"
+      ],
+      [
+        "Ġstart",
+        "ed"
+      ],
+      [
+        "ou",
+        "d"
+      ],
+      [
+        "i",
+        "f"
+      ],
+      [
+        "Ġm",
+        "ade"
+      ],
+      [
+        "Ġc",
+        "ar"
+      ],
+      [
+        "Ġsomet",
+        "hing"
+      ],
+      [
+        "Ġto",
+        "gether"
+      ],
+      [
+        "it",
+        "ed"
+      ],
+      [
+        "t",
+        "her"
+      ],
+      [
+        "Ġp",
+        "ark"
+      ],
+      [
+        "Ġc",
+        "o"
+      ],
+      [
+        "Ġsa",
+        "d"
+      ],
+      [
+        "Ġo",
+        "ther"
+      ],
+      [
+        "Ġne",
+        "w"
+      ],
+      [
+        "Ġex",
+        "c"
+      ],
+      [
+        "Ġp",
+        "ut"
+      ],
+      [
+        "Ġf",
+        "rom"
+      ],
+      [
+        "Ġp",
+        "r"
+      ],
+      [
+        "e",
+        "ll"
+      ],
+      [
+        "Ġ",
+        "L"
+      ],
+      [
+        "Ġl",
+        "a"
+      ],
+      [
+        "Ġh",
+        "ug"
+      ],
+      [
+        "b",
+        "le"
+      ],
+      [
+        "Ġm",
+        "u"
+      ],
+      [
+        "oo",
+        "k"
+      ],
+      [
+        "a",
+        "ch"
+      ],
+      [
+        "Ġag",
+        "ain"
+      ],
+      [
+        "Ġh",
+        "ome"
+      ],
+      [
+        "Ġw",
+        "hen"
+      ],
+      [
+        "Ġg",
+        "ood"
+      ],
+      [
+        "h",
+        "at"
+      ],
+      [
+        "e",
+        "p"
+      ],
+      [
+        "Ġwh",
+        "o"
+      ],
+      [
+        "es",
+        "t"
+      ],
+      [
+        "ri",
+        "ed"
+      ],
+      [
+        "Ġf",
+        "ound"
+      ],
+      [
+        "Ġf",
+        "l"
+      ],
+      [
+        "Ġthe",
+        "n"
+      ],
+      [
+        "Ġc",
+        "h"
+      ],
+      [
+        "Ġd",
+        "ec"
+      ],
+      [
+        "pp",
+        "ed"
+      ],
+      [
+        "Ġwa",
+        "l"
+      ],
+      [
+        "a",
+        "s"
+      ],
+      [
+        "Ġg",
+        "et"
+      ],
+      [
+        "q",
+        "u"
+      ],
+      [
+        "Ġplay",
+        "ing"
+      ],
+      [
+        "oug",
+        "ht"
+      ],
+      [
+        "p",
+        "l"
+      ],
+      [
+        "Ġ",
+        "E"
+      ],
+      [
+        "all",
+        "y"
+      ],
+      [
+        "Ġs",
+        "w"
+      ],
+      [
+        "ou",
+        "s"
+      ],
+      [
+        "n",
+        "n"
+      ],
+      [
+        "Ġth",
+        "ings"
+      ],
+      [
+        "Ġexc",
+        "ited"
+      ],
+      [
+        "Ġli",
+        "ked"
+      ],
+      [
+        "Ġg",
+        "ot"
+      ],
+      [
+        "u",
+        "ck"
+      ],
+      [
+        "r",
+        "o"
+      ],
+      [
+        "id",
+        "ed"
+      ],
+      [
+        "Ġdec",
+        "ided"
+      ],
+      [
+        "Ġb",
+        "l"
+      ],
+      [
+        "a",
+        "ve"
+      ],
+      [
+        "Ġc",
+        "ame"
+      ],
+      [
+        "Ġe",
+        "very"
+      ],
+      [
+        "ar",
+        "a"
+      ],
+      [
+        "Ġyou",
+        "r"
+      ],
+      [
+        "Ġ",
+        "D"
+      ],
+      [
+        "ĠM",
+        "om"
+      ],
+      [
+        "a",
+        "x"
+      ],
+      [
+        "Ġ",
+        "v"
+      ],
+      [
+        "Ġsc",
+        "ared"
+      ],
+      [
+        "u",
+        "st"
+      ],
+      [
+        "Ġon",
+        "e"
+      ],
+      [
+        "Ġdo",
+        "g"
+      ],
+      [
+        "Ġd",
+        "own"
+      ],
+      [
+        "ou",
+        "se"
+      ],
+      [
+        "n",
+        "y"
+      ],
+      [
+        "Ġf",
+        "ind"
+      ],
+      [
+        "Ġc",
+        "are"
+      ],
+      [
+        "Ġbe",
+        "c"
+      ],
+      [
+        "is",
+        "t"
+      ],
+      [
+        "Ġth",
+        "an"
+      ],
+      [
+        "Ġfe",
+        "el"
+      ],
+      [
+        "a",
+        "p"
+      ],
+      [
+        "u",
+        "e"
+      ],
+      [
+        "u",
+        "dd"
+      ],
+      [
+        "nn",
+        "a"
+      ],
+      [
+        "Ġd",
+        "ad"
+      ],
+      [
+        "Ġa",
+        "b"
+      ],
+      [
+        "The",
+        "y"
+      ],
+      [
+        "Ġm",
+        "y"
+      ],
+      [
+        "Ġloo",
+        "k"
+      ],
+      [
+        "Ġ",
+        "ke"
+      ],
+      [
+        "ou",
+        "r"
+      ],
+      [
+        "Ġw",
+        "ill"
+      ],
+      [
+        "ar",
+        "n"
+      ],
+      [
+        "Ġg",
+        "r"
+      ],
+      [
+        "u",
+        "s"
+      ],
+      [
+        "nd",
+        "er"
+      ],
+      [
+        "Ġg",
+        "ra"
+      ],
+      [
+        "way",
+        "s"
+      ],
+      [
+        "es",
+        "s"
+      ],
+      [
+        "Ġdid",
+        "n"
+      ],
+      [
+        "Ġp",
+        "o"
+      ],
+      [
+        "f",
+        "e"
+      ],
+      [
+        "Ġal",
+        "ways"
+      ],
+      [
+        "Ġtoo",
+        "k"
+      ],
+      [
+        "Ġab",
+        "out"
+      ],
+      [
+        "an",
+        "t"
+      ],
+      [
+        "b",
+        "b"
+      ],
+      [
+        "Ġl",
+        "ot"
+      ],
+      [
+        "Ġmom",
+        "my"
+      ],
+      [
+        "Ġtoy",
+        "s"
+      ],
+      [
+        "Ġkn",
+        "e"
+      ],
+      [
+        "er",
+        "s"
+      ],
+      [
+        "is",
+        "e"
+      ],
+      [
+        "it",
+        "e"
+      ],
+      [
+        "Ġout",
+        "side"
+      ],
+      [
+        "Ġtre",
+        "e"
+      ],
+      [
+        "Ġth",
+        "ought"
+      ],
+      [
+        "Ġb",
+        "all"
+      ],
+      [
+        "Ġ",
+        "F"
+      ],
+      [
+        "Ġm",
+        "ore"
+      ],
+      [
+        "ec",
+        "i"
+      ],
+      [
+        "ĠS",
+        "am"
+      ],
+      [
+        "en",
+        "ed"
+      ],
+      [
+        "c",
+        "hed"
+      ],
+      [
+        "Ġt",
+        "a"
+      ],
+      [
+        "Ġo",
+        "ld"
+      ],
+      [
+        "Ġh",
+        "o"
+      ],
+      [
+        "Ġle",
+        "arn"
+      ],
+      [
+        "re",
+        "t"
+      ],
+      [
+        "Ġin",
+        "t"
+      ],
+      [
+        "g",
+        "ed"
+      ],
+      [
+        "Ġkn",
+        "ow"
+      ],
+      [
+        "Ġla",
+        "ug"
+      ],
+      [
+        "Ġt",
+        "ake"
+      ],
+      [
+        "eci",
+        "al"
+      ],
+      [
+        "Ġsp",
+        "ecial"
+      ],
+      [
+        "Ġs",
+        "or"
+      ],
+      [
+        "Ġc",
+        "at"
+      ],
+      [
+        "udd",
+        "en"
+      ],
+      [
+        "Ġkne",
+        "w"
+      ],
+      [
+        "ĠM",
+        "ax"
+      ],
+      [
+        "i",
+        "ve"
+      ],
+      [
+        "i",
+        "a"
+      ],
+      [
+        "Ġp",
+        "e"
+      ],
+      [
+        "Ġan",
+        "y"
+      ],
+      [
+        "udden",
+        "ly"
+      ],
+      [
+        "Ġt",
+        "r"
+      ],
+      [
+        "f",
+        "ter"
+      ],
+      [
+        "Ġh",
+        "ow"
+      ],
+      [
+        "m",
+        "a"
+      ],
+      [
+        "Ġsh",
+        "ow"
+      ],
+      [
+        "in",
+        "k"
+      ],
+      [
+        "Ġsor",
+        "ry"
+      ],
+      [
+        "Ġt",
+        "w"
+      ],
+      [
+        "B",
+        "ut"
+      ],
+      [
+        "Ġmu",
+        "ch"
+      ],
+      [
+        "a",
+        "u"
+      ],
+      [
+        "is",
+        "h"
+      ],
+      [
+        "Ġr",
+        "un"
+      ],
+      [
+        "a",
+        "nd"
+      ],
+      [
+        "Ġha",
+        "nd"
+      ],
+      [
+        "Ġs",
+        "l"
+      ],
+      [
+        "v",
+        "en"
+      ],
+      [
+        "Ġh",
+        "ouse"
+      ],
+      [
+        "Ġo",
+        "r"
+      ],
+      [
+        "Ġo",
+        "p"
+      ],
+      [
+        "Ġs",
+        "k"
+      ],
+      [
+        "Ġm",
+        "o"
+      ],
+      [
+        "Ġcl",
+        "o"
+      ],
+      [
+        "Ġs",
+        "un"
+      ],
+      [
+        "Ġint",
+        "o"
+      ],
+      [
+        "Ġt",
+        "ried"
+      ],
+      [
+        "Ġin",
+        "side"
+      ],
+      [
+        "at",
+        "e"
+      ],
+      [
+        "Ġto",
+        "ld"
+      ],
+      [
+        "Ġwa",
+        "ter"
+      ],
+      [
+        "Ġth",
+        "is"
+      ],
+      [
+        "Ġ",
+        "en"
+      ],
+      [
+        "an",
+        "k"
+      ],
+      [
+        "Ġ",
+        "if"
+      ],
+      [
+        "Ġpr",
+        "oud"
+      ],
+      [
+        "um",
+        "p"
+      ],
+      [
+        "Ġ",
+        "qu"
+      ],
+      [
+        "Ġo",
+        "ver"
+      ],
+      [
+        "Ġcould",
+        "n"
+      ],
+      [
+        "T",
+        "om"
+      ],
+      [
+        "d",
+        "y"
+      ],
+      [
+        "Ġg",
+        "ave"
+      ],
+      [
+        "Ġhe",
+        "ard"
+      ],
+      [
+        "ĠS",
+        "ara"
+      ],
+      [
+        "Ġne",
+        "ver"
+      ],
+      [
+        "b",
+        "y"
+      ],
+      [
+        "Ġe",
+        "ach"
+      ],
+      [
+        "a",
+        "ce"
+      ],
+      [
+        "Ġro",
+        "om"
+      ],
+      [
+        "t",
+        "y"
+      ],
+      [
+        "Ġex",
+        "pl"
+      ],
+      [
+        "ĠE",
+        "very"
+      ],
+      [
+        "Ġe",
+        "at"
+      ],
+      [
+        "ĠW",
+        "e"
+      ],
+      [
+        "ot",
+        "her"
+      ],
+      [
+        "au",
+        "se"
+      ],
+      [
+        "Ġp",
+        "ick"
+      ],
+      [
+        "i",
+        "on"
+      ],
+      [
+        "Ġp",
+        "ret"
+      ],
+      [
+        "ĠA",
+        "nna"
+      ],
+      [
+        "M",
+        "om"
+      ],
+      [
+        "Ġplay",
+        "ed"
+      ],
+      [
+        "g",
+        "e"
+      ],
+      [
+        "et",
+        "ter"
+      ],
+      [
+        "Ġj",
+        "ust"
+      ],
+      [
+        "a",
+        "k"
+      ],
+      [
+        "Ġhug",
+        "ged"
+      ],
+      [
+        "Ġg",
+        "re"
+      ],
+      [
+        "he",
+        "re"
+      ],
+      [
+        "Ġof",
+        "f"
+      ],
+      [
+        "Ġc",
+        "om"
+      ],
+      [
+        "Ġwa",
+        "t"
+      ],
+      [
+        "ot",
+        "h"
+      ],
+      [
+        "Ġbo",
+        "x"
+      ],
+      [
+        "Ġn",
+        "ice"
+      ],
+      [
+        "'",
+        "m"
+      ],
+      [
+        "Ġst",
+        "r"
+      ],
+      [
+        "Ġbec",
+        "ause"
+      ],
+      [
+        "Ġne",
+        "ed"
+      ],
+      [
+        "il",
+        "e"
+      ],
+      [
+        "Ġman",
+        "y"
+      ],
+      [
+        "Ġf",
+        "o"
+      ],
+      [
+        "u",
+        "c"
+      ],
+      [
+        "Ġj",
+        "o"
+      ],
+      [
+        "Ġbe",
+        "ar"
+      ],
+      [
+        "Ġsm",
+        "all"
+      ],
+      [
+        "i",
+        "z"
+      ],
+      [
+        "Ġb",
+        "u"
+      ],
+      [
+        "v",
+        "ing"
+      ],
+      [
+        "Ġl",
+        "ong"
+      ],
+      [
+        "in",
+        "e"
+      ],
+      [
+        "g",
+        "ry"
+      ],
+      [
+        "im",
+        "al"
+      ],
+      [
+        "or",
+        "t"
+      ],
+      [
+        "Ġan",
+        "imal"
+      ],
+      [
+        "Ġs",
+        "n"
+      ],
+      [
+        "oug",
+        "h"
+      ],
+      [
+        "Ġt",
+        "ry"
+      ],
+      [
+        "Ġu",
+        "nt"
+      ],
+      [
+        "il",
+        "d"
+      ],
+      [
+        "s",
+        "el"
+      ],
+      [
+        "ur",
+        "t"
+      ],
+      [
+        "Ġunt",
+        "il"
+      ],
+      [
+        "ĠJ",
+        "ack"
+      ],
+      [
+        "s",
+        "ed"
+      ],
+      [
+        "Ġk",
+        "ind"
+      ],
+      [
+        "Ġlearn",
+        "ed"
+      ],
+      [
+        "Ġ",
+        "im"
+      ],
+      [
+        "Ġlo",
+        "ve"
+      ],
+      [
+        "Ġb",
+        "etter"
+      ],
+      [
+        "f",
+        "t"
+      ],
+      [
+        "Ġfl",
+        "ow"
+      ],
+      [
+        "Ġc",
+        "all"
+      ],
+      [
+        "Ġd",
+        "on"
+      ],
+      [
+        "H",
+        "e"
+      ],
+      [
+        "ĠJ",
+        "o"
+      ],
+      [
+        "Ġe",
+        "nd"
+      ],
+      [
+        "Ġa",
+        "d"
+      ],
+      [
+        "u",
+        "ll"
+      ],
+      [
+        "Ġb",
+        "est"
+      ],
+      [
+        "v",
+        "ent"
+      ],
+      [
+        "Y",
+        "es"
+      ],
+      [
+        "ar",
+        "s"
+      ],
+      [
+        "ur",
+        "p"
+      ],
+      [
+        "ad",
+        "y"
+      ],
+      [
+        "e",
+        "m"
+      ],
+      [
+        "re",
+        "am"
+      ],
+      [
+        "a",
+        "ut"
+      ],
+      [
+        "ur",
+        "n"
+      ],
+      [
+        "ĠM",
+        "ia"
+      ],
+      [
+        "Ġc",
+        "le"
+      ],
+      [
+        "ĠA",
+        "nd"
+      ],
+      [
+        "v",
+        "es"
+      ],
+      [
+        "Å",
+        "ĵ"
+      ],
+      [
+        "ard",
+        "en"
+      ],
+      [
+        "Ġ",
+        "C"
+      ],
+      [
+        "Ġg",
+        "arden"
+      ],
+      [
+        "Ġfa",
+        "st"
+      ],
+      [
+        "Ġcare",
+        "ful"
+      ],
+      [
+        "b",
+        "er"
+      ],
+      [
+        "Ġbe",
+        "aut"
+      ],
+      [
+        "ll",
+        "y"
+      ],
+      [
+        "T",
+        "h"
+      ],
+      [
+        "Ġe",
+        "ven"
+      ],
+      [
+        "p",
+        "t"
+      ],
+      [
+        "Ġb",
+        "ra"
+      ],
+      [
+        "i",
+        "es"
+      ],
+      [
+        "Ġthan",
+        "ked"
+      ],
+      [
+        "Ġf",
+        "i"
+      ],
+      [
+        "ĠS",
+        "o"
+      ],
+      [
+        "Ġc",
+        "he"
+      ],
+      [
+        "Ġlaug",
+        "hed"
+      ],
+      [
+        "Ġsk",
+        "y"
+      ],
+      [
+        "Ġb",
+        "y"
+      ],
+      [
+        "I",
+        "t"
+      ],
+      [
+        "ĠH",
+        "er"
+      ],
+      [
+        "Ġj",
+        "ump"
+      ],
+      [
+        "Ġg",
+        "l"
+      ],
+      [
+        "a",
+        "se"
+      ],
+      [
+        "Ġt",
+        "e"
+      ],
+      [
+        "Ġl",
+        "oud"
+      ],
+      [
+        "sel",
+        "f"
+      ],
+      [
+        "in",
+        "y"
+      ],
+      [
+        "Ġwa",
+        "y"
+      ],
+      [
+        "w",
+        "n"
+      ],
+      [
+        "Ġbeaut",
+        "i"
+      ],
+      [
+        "Ġc",
+        "ome"
+      ],
+      [
+        "le",
+        "w"
+      ],
+      [
+        "Ġl",
+        "ist"
+      ],
+      [
+        "Ġw",
+        "o"
+      ],
+      [
+        "Ġbeauti",
+        "ful"
+      ],
+      [
+        "Ġh",
+        "ard"
+      ],
+      [
+        "Ġlot",
+        "s"
+      ],
+      [
+        "Ġr",
+        "a"
+      ],
+      [
+        "Ġst",
+        "ill"
+      ],
+      [
+        "Ġf",
+        "am"
+      ],
+      [
+        "Ġanimal",
+        "s"
+      ],
+      [
+        "Ġ",
+        "â"
+      ],
+      [
+        "Ġh",
+        "urt"
+      ],
+      [
+        "Ġu",
+        "nder"
+      ],
+      [
+        "ĠThe",
+        "n"
+      ],
+      [
+        "ec",
+        "t"
+      ],
+      [
+        "Ġst",
+        "ay"
+      ],
+      [
+        "n",
+        "ing"
+      ],
+      [
+        "Ġl",
+        "et"
+      ],
+      [
+        "c",
+        "t"
+      ],
+      [
+        "Ġb",
+        "oth"
+      ],
+      [
+        "Ġc",
+        "u"
+      ],
+      [
+        "ĠH",
+        "is"
+      ],
+      [
+        "he",
+        "s"
+      ],
+      [
+        "b",
+        "e"
+      ],
+      [
+        "Ġsa",
+        "fe"
+      ],
+      [
+        "ĠF",
+        "rom"
+      ],
+      [
+        "oo",
+        "l"
+      ],
+      [
+        "re",
+        "e"
+      ],
+      [
+        "Ġco",
+        "l"
+      ],
+      [
+        "Ġtw",
+        "o"
+      ],
+      [
+        "Ġb",
+        "ad"
+      ],
+      [
+        "Ġb",
+        "ook"
+      ],
+      [
+        "Ġim",
+        "p"
+      ],
+      [
+        "op",
+        "le"
+      ],
+      [
+        "Ġre",
+        "m"
+      ],
+      [
+        "an",
+        "e"
+      ],
+      [
+        "Ġli",
+        "ved"
+      ],
+      [
+        "k",
+        "ay"
+      ],
+      [
+        "o",
+        "ck"
+      ],
+      [
+        "uc",
+        "y"
+      ],
+      [
+        "Ġwal",
+        "ked"
+      ],
+      [
+        "T",
+        "im"
+      ],
+      [
+        "a",
+        "st"
+      ],
+      [
+        "urp",
+        "r"
+      ],
+      [
+        "Ġbra",
+        "ve"
+      ],
+      [
+        "Ġsh",
+        "ould"
+      ],
+      [
+        "Ġit",
+        "s"
+      ],
+      [
+        "o",
+        "b"
+      ],
+      [
+        "is",
+        "hed"
+      ],
+      [
+        "Ġan",
+        "gry"
+      ],
+      [
+        "Ġs",
+        "urpr"
+      ],
+      [
+        "Ġfam",
+        "ily"
+      ],
+      [
+        "re",
+        "ss"
+      ],
+      [
+        "ig",
+        "h"
+      ],
+      [
+        "W",
+        "hen"
+      ],
+      [
+        "Ġpe",
+        "ople"
+      ],
+      [
+        "Ġf",
+        "lew"
+      ],
+      [
+        "Ġcall",
+        "ed"
+      ],
+      [
+        "N",
+        "o"
+      ],
+      [
+        "Ġr",
+        "ed"
+      ],
+      [
+        "Ġst",
+        "or"
+      ],
+      [
+        "i",
+        "p"
+      ],
+      [
+        "Ġso",
+        "on"
+      ],
+      [
+        "Ġf",
+        "in"
+      ],
+      [
+        "h",
+        "n"
+      ],
+      [
+        "L",
+        "et"
+      ],
+      [
+        "l",
+        "ed"
+      ],
+      [
+        "Ġke",
+        "pt"
+      ],
+      [
+        "Ġf",
+        "ore"
+      ],
+      [
+        "f",
+        "ore"
+      ],
+      [
+        "Ġd",
+        "an"
+      ],
+      [
+        "Ġsh",
+        "are"
+      ],
+      [
+        "Ġf",
+        "ly"
+      ],
+      [
+        "x",
+        "t"
+      ],
+      [
+        "is",
+        "ed"
+      ],
+      [
+        "dd",
+        "ed"
+      ],
+      [
+        "Ġp",
+        "ic"
+      ],
+      [
+        "âĤ¬",
+        "â"
+      ],
+      [
+        "Ġdo",
+        "or"
+      ],
+      [
+        "Ġgo",
+        "ing"
+      ],
+      [
+        "Ġ",
+        "P"
+      ],
+      [
+        "ĠW",
+        "hen"
+      ],
+      [
+        "Ġpret",
+        "ty"
+      ],
+      [
+        "Ġke",
+        "ep"
+      ],
+      [
+        "Ġn",
+        "ow"
+      ],
+      [
+        "Ġro",
+        "ck"
+      ],
+      [
+        "Ġcle",
+        "an"
+      ],
+      [
+        "Ġd",
+        "ra"
+      ],
+      [
+        "ar",
+        "y"
+      ],
+      [
+        "Ġad",
+        "vent"
+      ],
+      [
+        "um",
+        "my"
+      ],
+      [
+        "Ġno",
+        "ise"
+      ],
+      [
+        "Ġop",
+        "ened"
+      ],
+      [
+        "Ġsh",
+        "iny"
+      ],
+      [
+        "ag",
+        "e"
+      ],
+      [
+        "Ġexpl",
+        "ore"
+      ],
+      [
+        "Ġw",
+        "ind"
+      ],
+      [
+        "Ġdo",
+        "ll"
+      ],
+      [
+        "Ġc",
+        "ry"
+      ],
+      [
+        "Ġc",
+        "on"
+      ],
+      [
+        "Ġ",
+        "ide"
+      ],
+      [
+        "Ġbe",
+        "fore"
+      ],
+      [
+        "i",
+        "ed"
+      ],
+      [
+        "B",
+        "en"
+      ],
+      [
+        "il",
+        "ly"
+      ],
+      [
+        "Ġre",
+        "al"
+      ],
+      [
+        "Ġst",
+        "o"
+      ],
+      [
+        "s",
+        "o"
+      ],
+      [
+        "W",
+        "hat"
+      ],
+      [
+        "Ġgr",
+        "ound"
+      ],
+      [
+        "Ġal",
+        "so"
+      ],
+      [
+        "le",
+        "s"
+      ],
+      [
+        "Ġt",
+        "urn"
+      ],
+      [
+        "Ħ",
+        "¢"
+      ],
+      [
+        "âĤ¬â",
+        "Ħ¢"
+      ],
+      [
+        "Ġe",
+        "y"
+      ],
+      [
+        "T",
+        "hat"
+      ],
+      [
+        "Ġf",
+        "ar"
+      ],
+      [
+        "Ġide",
+        "a"
+      ],
+      [
+        "Ġf",
+        "r"
+      ],
+      [
+        "o",
+        "on"
+      ],
+      [
+        "Ġno",
+        "dded"
+      ],
+      [
+        "Ġcol",
+        "or"
+      ],
+      [
+        "Ġwa",
+        "r"
+      ],
+      [
+        "o",
+        "y"
+      ],
+      [
+        "Ġfeel",
+        "ing"
+      ],
+      [
+        "Ġu",
+        "n"
+      ],
+      [
+        "Ġpick",
+        "ed"
+      ],
+      [
+        "im",
+        "b"
+      ],
+      [
+        "t",
+        "h"
+      ],
+      [
+        "ĠL",
+        "ucy"
+      ],
+      [
+        "Ġne",
+        "xt"
+      ],
+      [
+        "Ġwal",
+        "king"
+      ],
+      [
+        "t",
+        "hing"
+      ],
+      [
+        "t",
+        "ure"
+      ],
+      [
+        "ĠD",
+        "ad"
+      ],
+      [
+        "Ġcl",
+        "imb"
+      ],
+      [
+        "Ġha",
+        "s"
+      ],
+      [
+        "u",
+        "ch"
+      ],
+      [
+        "Ġm",
+        "a"
+      ],
+      [
+        "Ġth",
+        "r"
+      ],
+      [
+        "Ġwh",
+        "ile"
+      ],
+      [
+        "e",
+        "et"
+      ],
+      [
+        "Ġb",
+        "ed"
+      ]
+    ]
+  }
+}

hf/tokenizer_config.json

@@ -0,0 +1,9 @@
+{
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "eos_token": "</s>",
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "tokenizer_class": "TokenizersBackend",
+  "unk_token": "<unk>"
+}

llama4_moe_text_config_dump.json

@@ -0,0 +1,77 @@
+{
+  "transformers_version": "5.9.0",
+  "architectures": null,
+  "output_hidden_states": false,
+  "return_dict": true,
+  "dtype": null,
+  "chunk_size_feed_forward": 0,
+  "is_encoder_decoder": false,
+  "id2label": {
+    "0": "LABEL_0",
+    "1": "LABEL_1"
+  },
+  "label2id": {
+    "LABEL_0": 0,
+    "LABEL_1": 1
+  },
+  "problem_type": null,
+  "vocab_size": 1024,
+  "hidden_size": 96,
+  "intermediate_size": 192,
+  "intermediate_size_mlp": 384,
+  "num_hidden_layers": 5,
+  "num_attention_heads": 4,
+  "num_key_value_heads": 1,
+  "head_dim": 24,
+  "hidden_act": "silu",
+  "max_position_embeddings": 1024,
+  "initializer_range": 0.02,
+  "rms_norm_eps": 1e-05,
+  "use_cache": true,
+  "pad_token_id": 2,
+  "bos_token_id": 0,
+  "eos_token_id": 1,
+  "tie_word_embeddings": false,
+  "attention_dropout": 0.0,
+  "num_experts_per_tok": 2,
+  "num_local_experts": 4,
+  "moe_layers": [
+    0,
+    1,
+    2,
+    3,
+    4
+  ],
+  "interleave_moe_layer_step": 1,
+  "use_qk_norm": true,
+  "output_router_logits": false,
+  "router_aux_loss_coef": 0.001,
+  "router_jitter_noise": 0.0,
+  "rope_parameters": {
+    "rope_theta": 500000.0,
+    "rope_type": "default"
+  },
+  "no_rope_layers": [
+    1,
+    0,
+    1,
+    0,
+    1
+  ],
+  "no_rope_layer_interval": 4,
+  "attention_chunk_size": 128,
+  "layer_types": [
+    "chunked_attention",
+    "full_attention",
+    "chunked_attention",
+    "full_attention",
+    "chunked_attention"
+  ],
+  "attn_temperature_tuning": false,
+  "floor_scale": 8192,
+  "attn_scale": 0.1,
+  "attention_bias": false,
+  "_name_or_path": "",
+  "model_type": "llama4_text",
+  "output_attentions": false
+}

tokenizer_train/merges.txt

@@ -0,0 +1,765 @@
+#version: 0.2
+h e
+Ġ t
+Ġ a
+Ġ s
+Ġ w
+n d
+Ġt he
+e d
+Ġa nd
+Ġt o
+Ġ b
+i n
+Ġ h
+Ġw a
+r e
+o u
+Ġ f
+i t
+Ġ l
+Ġ c
+Ġ d
+e r
+Ġ he
+Ġ m
+Ġ p
+Ġwa s
+o m
+Ġ T
+Ġ o
+a y
+a r
+i s
+in g
+i l
+Ġ g
+i d
+a t
+e n
+Ġ n
+Ġs a
+Ġh a
+Ġ S
+ĠT he
+a n
+i m
+o r
+o n
+Ġ it
+Ġt h
+l l
+l e
+Ġ H
+Ġhe r
+o t
+e t
+i r
+ĠS he
+e s
+ĠH e
+Ġ in
+v er
+u t
+o w
+ĠThe y
+c k
+Ġ e
+Ġ u
+l d
+Ġ y
+o o
+Ġsa id
+i g
+Ġ "
+il y
+Ġ r
+Ġb e
+a m
+Ġs t
+Ġ I
+c e
+k e
+Ġs he
+v e
+p p
+it h
+Ġw ith
+L ily
+O n
+Ġo n
+Ġy ou
+Ġo f
+k ed
+r i
+Ġs o
+n t
+Ġh is
+Ġp l
+a d
+ver y
+Ġd ay
+Ġth at
+Ġu p
+Ġpl ay
+Ġha d
+s t
+Ġthe y
+Ġw e
+Ġ Lily
+Ġm om
+Ġf or
+Ġ B
+e l
+u n
+ou ld
+' s
+m y
+T he
+Ġl i
+c h
+en t
+Ġha pp
+Ġwa nt
+it t
+Ġs h
+ou t
+he r
+Ġd o
+l y
+Ġn ot
+om e
+s e
+Ġ very
+ou nd
+e nd
+a ll
+Ġw h
+im e
+itt le
+Ġ k
+Ġt ime
+Ġl ittle
+a l
+Ġ Ċ
+Ġthe re
+Ġn e
+h t
+Ġ M
+Ġ re
+Ġhapp y
+Ġs m
+Ġb ig
+Ġ is
+ĠI t
+Ġb ut
+a ck
+Ġa n
+Ġsa w
+ri end
+. "
+Ġf riend
+r y
+Ġa s
+r a
+On e
+id e
+a ke
+' t
+! "
+u g
+Ġl oo
+v ed
+t er
+Ġwe re
+o re
+On ce
+Ġl o
+e c
+Ġh im
+Ġto o
+Ġg o
+Ġb o
+Ġs e
+ir l
+Ġa re
+Ġ j
+ĠT im
+ar d
+Ġwant ed
+il l
+Ġg irl
+Ġup on
+Ġthe m
+Ġ out
+Ġa t
+u r
+i nd
+Ġthe ir
+f u
+Ġs p
+w ay
+Ġ A
+Ġsm il
+Ġd id
+Ġc ould
+he n
+Ġha ve
+a in
+ar t
+Ġe x
+he d
+r om
+Ġw ent
+Ġa r
+i c
+Ġc an
+Ġ J
+l p
+fu l
+ĠB en
+oo d
+? "
+h ing
+Ġfriend s
+Ġn am
+ig ht
+Ġa ll
+Ġhe lp
+Ġk n
+u m
+on e
+ar k
+Ġb ack
+Ġs ay
+Y ou
+Ġf un
+Ġc l
+ĠT om
+a re
+Ġn o
+Ġl e
+o p
+Ġsmil ed
+Ġs c
+Ġnam ed
+Ġa l
+ou g
+Ġlo ved
+s ide
+el t
+Ġ One
+Ġm an
+Ġas ked
+i ck
+Ġto y
+Ġli ke
+Ġf e
+Ġf elt
+Ġloo ked
+Ġs ome
+Ġar ound
+Ġse e
+Ġm e
+am e
+om et
+Ġ W
+Ġr o
+Ġb r
+u re
+ĠTim my
+Ġb ir
+g et
+i ce
+Ġbo y
+Ġw ould
+Ġst art
+on g
+Ã ¢
+â Ĥ
+âĤ ¬
+s s
+Ġbir d
+Ġs omet
+Ġf a
+d d
+ing s
+Ġa g
+Ġw or
+Ġwh at
+ad e
+Ġm ake
+k ing
+, "
+i e
+ĠB ut
+ow n
+Ġt re
+Ġr an
+get her
+Ġ You
+Ġa way
+a g
+ar ed
+Ġsay s
+Ġstart ed
+ou d
+i f
+Ġm ade
+Ġc ar
+Ġsomet hing
+Ġto gether
+it ed
+t her
+Ġp ark
+Ġc o
+Ġsa d
+Ġo ther
+Ġne w
+Ġex c
+Ġp ut
+Ġf rom
+Ġp r
+e ll
+Ġ L
+Ġl a
+Ġh ug
+b le
+Ġm u
+oo k
+a ch
+Ġag ain
+Ġh ome
+Ġw hen
+Ġg ood
+h at
+e p
+Ġwh o
+es t
+ri ed
+Ġf ound
+Ġf l
+Ġthe n
+Ġc h
+Ġd ec
+pp ed
+Ġwa l
+a s
+Ġg et
+q u
+Ġplay ing
+oug ht
+p l
+Ġ E
+all y
+Ġs w
+ou s
+n n
+Ġth ings
+Ġexc ited
+Ġli ked
+Ġg ot
+u ck
+r o
+id ed
+Ġdec ided
+Ġb l
+a ve
+Ġc ame
+Ġe very
+ar a
+Ġyou r
+Ġ D
+ĠM om
+a x
+Ġ v
+Ġsc ared
+u st
+Ġon e
+Ġdo g
+Ġd own
+ou se
+n y
+Ġf ind
+Ġc are
+Ġbe c
+is t
+Ġth an
+Ġfe el
+a p
+u e
+u dd
+nn a
+Ġd ad
+Ġa b
+The y
+Ġm y
+Ġloo k
+Ġ ke
+ou r
+Ġw ill
+ar n
+Ġg r
+u s
+nd er
+Ġg ra
+way s
+es s
+Ġdid n
+Ġp o
+f e
+Ġal ways
+Ġtoo k
+Ġab out
+an t
+b b
+Ġl ot
+Ġmom my
+Ġtoy s
+Ġkn e
+er s
+is e
+it e
+Ġout side
+Ġtre e
+Ġth ought
+Ġb all
+Ġ F
+Ġm ore
+ec i
+ĠS am
+en ed
+c hed
+Ġt a
+Ġo ld
+Ġh o
+Ġle arn
+re t
+Ġin t
+g ed
+Ġkn ow
+Ġla ug
+Ġt ake
+eci al
+Ġsp ecial
+Ġs or
+Ġc at
+udd en
+Ġkne w
+ĠM ax
+i ve
+i a
+Ġp e
+Ġan y
+udden ly
+Ġt r
+f ter
+Ġh ow
+m a
+Ġsh ow
+in k
+Ġsor ry
+Ġt w
+B ut
+Ġmu ch
+a u
+is h
+Ġr un
+a nd
+Ġha nd
+Ġs l
+v en
+Ġh ouse
+Ġo r
+Ġo p
+Ġs k
+Ġm o
+Ġcl o
+Ġs un
+Ġint o
+Ġt ried
+Ġin side
+at e
+Ġto ld
+Ġwa ter
+Ġth is
+Ġ en
+an k
+Ġ if
+Ġpr oud
+um p
+Ġ qu
+Ġo ver
+Ġcould n
+T om
+d y
+Ġg ave
+Ġhe ard
+ĠS ara
+Ġne ver
+b y
+Ġe ach
+a ce
+Ġro om
+t y
+Ġex pl
+ĠE very
+Ġe at
+ĠW e
+ot her
+au se
+Ġp ick
+i on
+Ġp ret
+ĠA nna
+M om
+Ġplay ed
+g e
+et ter
+Ġj ust
+a k
+Ġhug ged
+Ġg re
+he re
+Ġof f
+Ġc om
+Ġwa t
+ot h
+Ġbo x
+Ġn ice
+' m
+Ġst r
+Ġbec ause
+Ġne ed
+il e
+Ġman y
+Ġf o
+u c
+Ġj o
+Ġbe ar
+Ġsm all
+i z
+Ġb u
+v ing
+Ġl ong
+in e
+g ry
+im al
+or t
+Ġan imal
+Ġs n
+oug h
+Ġt ry
+Ġu nt
+il d
+s el
+ur t
+Ġunt il
+ĠJ ack
+s ed
+Ġk ind
+Ġlearn ed
+Ġ im
+Ġlo ve
+Ġb etter
+f t
+Ġfl ow
+Ġc all
+Ġd on
+H e
+ĠJ o
+Ġe nd
+Ġa d
+u ll
+Ġb est
+v ent
+Y es
+ar s
+ur p
+ad y
+e m
+re am
+a ut
+ur n
+ĠM ia
+Ġc le
+ĠA nd
+v es
+Å ĵ
+ard en
+Ġ C
+Ġg arden
+Ġfa st
+Ġcare ful
+b er
+Ġbe aut
+ll y
+T h
+Ġe ven
+p t
+Ġb ra
+i es
+Ġthan ked
+Ġf i
+ĠS o
+Ġc he
+Ġlaug hed
+Ġsk y
+Ġb y
+I t
+ĠH er
+Ġj ump
+Ġg l
+a se
+Ġt e
+Ġl oud
+sel f
+in y
+Ġwa y
+w n
+Ġbeaut i
+Ġc ome
+le w
+Ġl ist
+Ġw o
+Ġbeauti ful
+Ġh ard
+Ġlot s
+Ġr a
+Ġst ill
+Ġf am
+Ġanimal s
+Ġ â
+Ġh urt
+Ġu nder
+ĠThe n
+ec t
+Ġst ay
+n ing
+Ġl et
+c t
+Ġb oth
+Ġc u
+ĠH is
+he s
+b e
+Ġsa fe
+ĠF rom
+oo l
+re e
+Ġco l
+Ġtw o
+Ġb ad
+Ġb ook
+Ġim p
+op le
+Ġre m
+an e
+Ġli ved
+k ay
+o ck
+uc y
+Ġwal ked
+T im
+a st
+urp r
+Ġbra ve
+Ġsh ould
+Ġit s
+o b
+is hed
+Ġan gry
+Ġs urpr
+Ġfam ily
+re ss
+ig h
+W hen
+Ġpe ople
+Ġf lew
+Ġcall ed
+N o
+Ġr ed
+Ġst or
+i p
+Ġso on
+Ġf in
+h n
+L et
+l ed
+Ġke pt
+Ġf ore
+f ore
+Ġd an
+Ġsh are
+Ġf ly
+x t
+is ed
+dd ed
+Ġp ic
+âĤ¬ â
+Ġdo or
+Ġgo ing
+Ġ P
+ĠW hen
+Ġpret ty
+Ġke ep
+Ġn ow
+Ġro ck
+Ġcle an
+Ġd ra
+ar y
+Ġad vent
+um my
+Ġno ise
+Ġop ened
+Ġsh iny
+ag e
+Ġexpl ore
+Ġw ind
+Ġdo ll
+Ġc ry
+Ġc on
+Ġ ide
+Ġbe fore
+i ed
+B en
+il ly
+Ġre al
+Ġst o
+s o
+W hat
+Ġgr ound
+Ġal so
+le s
+Ġt urn
+Ħ ¢
+âĤ¬â Ħ¢
+Ġe y
+T hat
+Ġf ar
+Ġide a
+Ġf r
+o on
+Ġno dded
+Ġcol or
+Ġwa r
+o y
+Ġfeel ing
+Ġu n
+Ġpick ed
+im b
+t h
+ĠL ucy
+Ġne xt
+Ġwal king
+t hing
+t ure
+ĠD ad
+Ġcl imb
+Ġha s
+u ch
+Ġm a
+Ġth r
+Ġwh ile
+e et
+Ġb ed

tokenizer_train/vocab.json

@@ -0,0 +1 @@
+{"<s>":0,"</s>":1,"<pad>":2,"<unk>":3,"!":4,"\"":5,"#":6,"$":7,"%":8,"&":9,"'":10,"(":11,")":12,"*":13,"+":14,",":15,"-":16,".":17,"/":18,"0":19,"1":20,"2":21,"3":22,"4":23,"5":24,"6":25,"7":26,"8":27,"9":28,":":29,";":30,"<":31,"=":32,">":33,"?":34,"@":35,"A":36,"B":37,"C":38,"D":39,"E":40,"F":41,"G":42,"H":43,"I":44,"J":45,"K":46,"L":47,"M":48,"N":49,"O":50,"P":51,"Q":52,"R":53,"S":54,"T":55,"U":56,"V":57,"W":58,"X":59,"Y":60,"Z":61,"[":62,"\\":63,"]":64,"^":65,"_":66,"`":67,"a":68,"b":69,"c":70,"d":71,"e":72,"f":73,"g":74,"h":75,"i":76,"j":77,"k":78,"l":79,"m":80,"n":81,"o":82,"p":83,"q":84,"r":85,"s":86,"t":87,"u":88,"v":89,"w":90,"x":91,"y":92,"z":93,"{":94,"|":95,"}":96,"~":97,"¡":98,"¢":99,"£":100,"¤":101,"¥":102,"¦":103,"§":104,"¨":105,"©":106,"ª":107,"«":108,"¬":109,"®":110,"¯":111,"°":112,"±":113,"²":114,"³":115,"´":116,"µ":117,"¶":118,"·":119,"¸":120,"¹":121,"º":122,"»":123,"¼":124,"½":125,"¾":126,"¿":127,"À":128,"Á":129,"Â":130,"Ã":131,"Ä":132,"Å":133,"Æ":134,"Ç":135,"È":136,"É":137,"Ê":138,"Ë":139,"Ì":140,"Í":141,"Î":142,"Ï":143,"Ð":144,"Ñ":145,"Ò":146,"Ó":147,"Ô":148,"Õ":149,"Ö":150,"×":151,"Ø":152,"Ù":153,"Ú":154,"Û":155,"Ü":156,"Ý":157,"Þ":158,"ß":159,"à":160,"á":161,"â":162,"ã":163,"ä":164,"å":165,"æ":166,"ç":167,"è":168,"é":169,"ê":170,"ë":171,"ì":172,"í":173,"î":174,"ï":175,"ð":176,"ñ":177,"ò":178,"ó":179,"ô":180,"õ":181,"ö":182,"÷":183,"ø":184,"ù":185,"ú":186,"û":187,"ü":188,"ý":189,"þ":190,"ÿ":191,"Ā":192,"ā":193,"Ă":194,"ă":195,"Ą":196,"ą":197,"Ć":198,"ć":199,"Ĉ":200,"ĉ":201,"Ċ":202,"ċ":203,"Č":204,"č":205,"Ď":206,"ď":207,"Đ":208,"đ":209,"Ē":210,"ē":211,"Ĕ":212,"ĕ":213,"Ė":214,"ė":215,"Ę":216,"ę":217,"Ě":218,"ě":219,"Ĝ":220,"ĝ":221,"Ğ":222,"ğ":223,"Ġ":224,"ġ":225,"Ģ":226,"ģ":227,"Ĥ":228,"ĥ":229,"Ħ":230,"ħ":231,"Ĩ":232,"ĩ":233,"Ī":234,"ī":235,"Ĭ":236,"ĭ":237,"Į":238,"į":239,"İ":240,"ı":241,"IJ":242,"ij":243,"Ĵ":244,"ĵ":245,"Ķ":246,"ķ":247,"ĸ":248,"Ĺ":249,"ĺ":250,"Ļ":251,"ļ":252,"Ľ":253,"ľ":254,"Ŀ":255,"ŀ":256,"Ł":257,"ł":258,"Ń":259,"he":260,"Ġt":261,"Ġa":262,"Ġs":263,"Ġw":264,"nd":265,"Ġthe":266,"ed":267,"Ġand":268,"Ġto":269,"Ġb":270,"in":271,"Ġh":272,"Ġwa":273,"re":274,"ou":275,"Ġf":276,"it":277,"Ġl":278,"Ġc":279,"Ġd":280,"er":281,"Ġhe":282,"Ġm":283,"Ġp":284,"Ġwas":285,"om":286,"ĠT":287,"Ġo":288,"ay":289,"ar":290,"is":291,"ing":292,"il":293,"Ġg":294,"id":295,"at":296,"en":297,"Ġn":298,"Ġsa":299,"Ġha":300,"ĠS":301,"ĠThe":302,"an":303,"im":304,"or":305,"on":306,"Ġit":307,"Ġth":308,"ll":309,"le":310,"ĠH":311,"Ġher":312,"ot":313,"et":314,"ir":315,"ĠShe":316,"es":317,"ĠHe":318,"Ġin":319,"ver":320,"ut":321,"ow":322,"ĠThey":323,"ck":324,"Ġe":325,"Ġu":326,"ld":327,"Ġy":328,"oo":329,"Ġsaid":330,"ig":331,"Ġ\"":332,"ily":333,"Ġr":334,"Ġbe":335,"am":336,"Ġst":337,"ĠI":338,"ce":339,"ke":340,"Ġshe":341,"ve":342,"pp":343,"ith":344,"Ġwith":345,"Lily":346,"On":347,"Ġon":348,"Ġyou":349,"Ġof":350,"ked":351,"ri":352,"Ġso":353,"nt":354,"Ġhis":355,"Ġpl":356,"ad":357,"very":358,"Ġday":359,"Ġthat":360,"Ġup":361,"Ġplay":362,"Ġhad":363,"st":364,"Ġthey":365,"Ġwe":366,"ĠLily":367,"Ġmom":368,"Ġfor":369,"ĠB":370,"el":371,"un":372,"ould":373,"'s":374,"my":375,"The":376,"Ġli":377,"ch":378,"ent":379,"Ġhapp":380,"Ġwant":381,"itt":382,"Ġsh":383,"out":384,"her":385,"Ġdo":386,"ly":387,"Ġnot":388,"ome":389,"se":390,"Ġvery":391,"ound":392,"end":393,"all":394,"Ġwh":395,"ime":396,"ittle":397,"Ġk":398,"Ġtime":399,"Ġlittle":400,"al":401,"ĠĊ":402,"Ġthere":403,"Ġne":404,"ht":405,"ĠM":406,"Ġre":407,"Ġhappy":408,"Ġsm":409,"Ġbig":410,"Ġis":411,"ĠIt":412,"Ġbut":413,"ack":414,"Ġan":415,"Ġsaw":416,"riend":417,".\"":418,"Ġfriend":419,"ry":420,"Ġas":421,"ra":422,"One":423,"ide":424,"ake":425,"'t":426,"!\"":427,"ug":428,"Ġloo":429,"ved":430,"ter":431,"Ġwere":432,"ore":433,"Once":434,"Ġlo":435,"ec":436,"Ġhim":437,"Ġtoo":438,"Ġgo":439,"Ġbo":440,"Ġse":441,"irl":442,"Ġare":443,"Ġj":444,"ĠTim":445,"ard":446,"Ġwanted":447,"ill":448,"Ġgirl":449,"Ġupon":450,"Ġthem":451,"Ġout":452,"Ġat":453,"ur":454,"ind":455,"Ġtheir":456,"fu":457,"Ġsp":458,"way":459,"ĠA":460,"Ġsmil":461,"Ġdid":462,"Ġcould":463,"hen":464,"Ġhave":465,"ain":466,"art":467,"Ġex":468,"hed":469,"rom":470,"Ġwent":471,"Ġar":472,"ic":473,"Ġcan":474,"ĠJ":475,"lp":476,"ful":477,"ĠBen":478,"ood":479,"?\"":480,"hing":481,"Ġfriends":482,"Ġnam":483,"ight":484,"Ġall":485,"Ġhelp":486,"Ġkn":487,"um":488,"one":489,"ark":490,"Ġback":491,"Ġsay":492,"You":493,"Ġfun":494,"Ġcl":495,"ĠTom":496,"are":497,"Ġno":498,"Ġle":499,"op":500,"Ġsmiled":501,"Ġsc":502,"Ġnamed":503,"Ġal":504,"oug":505,"Ġloved":506,"side":507,"elt":508,"ĠOne":509,"Ġman":510,"Ġasked":511,"ick":512,"Ġtoy":513,"Ġlike":514,"Ġfe":515,"Ġfelt":516,"Ġlooked":517,"Ġsome":518,"Ġaround":519,"Ġsee":520,"Ġme":521,"ame":522,"omet":523,"ĠW":524,"Ġro":525,"Ġbr":526,"ure":527,"ĠTimmy":528,"Ġbir":529,"get":530,"ice":531,"Ġboy":532,"Ġwould":533,"Ġstart":534,"ong":535,"â":536,"âĤ":537,"âĤ¬":538,"ss":539,"Ġbird":540,"Ġsomet":541,"Ġfa":542,"dd":543,"ings":544,"Ġag":545,"Ġwor":546,"Ġwhat":547,"ade":548,"Ġmake":549,"king":550,",\"":551,"ie":552,"ĠBut":553,"own":554,"Ġtre":555,"Ġran":556,"gether":557,"ĠYou":558,"Ġaway":559,"ag":560,"ared":561,"Ġsays":562,"Ġstarted":563,"oud":564,"if":565,"Ġmade":566,"Ġcar":567,"Ġsomething":568,"Ġtogether":569,"ited":570,"ther":571,"Ġpark":572,"Ġco":573,"Ġsad":574,"Ġother":575,"Ġnew":576,"Ġexc":577,"Ġput":578,"Ġfrom":579,"Ġpr":580,"ell":581,"ĠL":582,"Ġla":583,"Ġhug":584,"ble":585,"Ġmu":586,"ook":587,"ach":588,"Ġagain":589,"Ġhome":590,"Ġwhen":591,"Ġgood":592,"hat":593,"ep":594,"Ġwho":595,"est":596,"ried":597,"Ġfound":598,"Ġfl":599,"Ġthen":600,"Ġch":601,"Ġdec":602,"pped":603,"Ġwal":604,"as":605,"Ġget":606,"qu":607,"Ġplaying":608,"ought":609,"pl":610,"ĠE":611,"ally":612,"Ġsw":613,"ous":614,"nn":615,"Ġthings":616,"Ġexcited":617,"Ġliked":618,"Ġgot":619,"uck":620,"ro":621,"ided":622,"Ġdecided":623,"Ġbl":624,"ave":625,"Ġcame":626,"Ġevery":627,"ara":628,"Ġyour":629,"ĠD":630,"ĠMom":631,"ax":632,"Ġv":633,"Ġscared":634,"ust":635,"Ġone":636,"Ġdog":637,"Ġdown":638,"ouse":639,"ny":640,"Ġfind":641,"Ġcare":642,"Ġbec":643,"ist":644,"Ġthan":645,"Ġfeel":646,"ap":647,"ue":648,"udd":649,"nna":650,"Ġdad":651,"Ġab":652,"They":653,"Ġmy":654,"Ġlook":655,"Ġke":656,"our":657,"Ġwill":658,"arn":659,"Ġgr":660,"us":661,"nder":662,"Ġgra":663,"ways":664,"ess":665,"Ġdidn":666,"Ġpo":667,"fe":668,"Ġalways":669,"Ġtook":670,"Ġabout":671,"ant":672,"bb":673,"Ġlot":674,"Ġmommy":675,"Ġtoys":676,"Ġkne":677,"ers":678,"ise":679,"ite":680,"Ġoutside":681,"Ġtree":682,"Ġthought":683,"Ġball":684,"ĠF":685,"Ġmore":686,"eci":687,"ĠSam":688,"ened":689,"ched":690,"Ġta":691,"Ġold":692,"Ġho":693,"Ġlearn":694,"ret":695,"Ġint":696,"ged":697,"Ġknow":698,"Ġlaug":699,"Ġtake":700,"ecial":701,"Ġspecial":702,"Ġsor":703,"Ġcat":704,"udden":705,"Ġknew":706,"ĠMax":707,"ive":708,"ia":709,"Ġpe":710,"Ġany":711,"uddenly":712,"Ġtr":713,"fter":714,"Ġhow":715,"ma":716,"Ġshow":717,"ink":718,"Ġsorry":719,"Ġtw":720,"But":721,"Ġmuch":722,"au":723,"ish":724,"Ġrun":725,"and":726,"Ġhand":727,"Ġsl":728,"ven":729,"Ġhouse":730,"Ġor":731,"Ġop":732,"Ġsk":733,"Ġmo":734,"Ġclo":735,"Ġsun":736,"Ġinto":737,"Ġtried":738,"Ġinside":739,"ate":740,"Ġtold":741,"Ġwater":742,"Ġthis":743,"Ġen":744,"ank":745,"Ġif":746,"Ġproud":747,"ump":748,"Ġqu":749,"Ġover":750,"Ġcouldn":751,"Tom":752,"dy":753,"Ġgave":754,"Ġheard":755,"ĠSara":756,"Ġnever":757,"by":758,"Ġeach":759,"ace":760,"Ġroom":761,"ty":762,"Ġexpl":763,"ĠEvery":764,"Ġeat":765,"ĠWe":766,"other":767,"ause":768,"Ġpick":769,"ion":770,"Ġpret":771,"ĠAnna":772,"Mom":773,"Ġplayed":774,"ge":775,"etter":776,"Ġjust":777,"ak":778,"Ġhugged":779,"Ġgre":780,"here":781,"Ġoff":782,"Ġcom":783,"Ġwat":784,"oth":785,"Ġbox":786,"Ġnice":787,"'m":788,"Ġstr":789,"Ġbecause":790,"Ġneed":791,"ile":792,"Ġmany":793,"Ġfo":794,"uc":795,"Ġjo":796,"Ġbear":797,"Ġsmall":798,"iz":799,"Ġbu":800,"ving":801,"Ġlong":802,"ine":803,"gry":804,"imal":805,"ort":806,"Ġanimal":807,"Ġsn":808,"ough":809,"Ġtry":810,"Ġunt":811,"ild":812,"sel":813,"urt":814,"Ġuntil":815,"ĠJack":816,"sed":817,"Ġkind":818,"Ġlearned":819,"Ġim":820,"Ġlove":821,"Ġbetter":822,"ft":823,"Ġflow":824,"Ġcall":825,"Ġdon":826,"He":827,"ĠJo":828,"Ġend":829,"Ġad":830,"ull":831,"Ġbest":832,"vent":833,"Yes":834,"ars":835,"urp":836,"ady":837,"em":838,"ream":839,"aut":840,"urn":841,"ĠMia":842,"Ġcle":843,"ĠAnd":844,"ves":845,"Åĵ":846,"arden":847,"ĠC":848,"Ġgarden":849,"Ġfast":850,"Ġcareful":851,"ber":852,"Ġbeaut":853,"lly":854,"Th":855,"Ġeven":856,"pt":857,"Ġbra":858,"ies":859,"Ġthanked":860,"Ġfi":861,"ĠSo":862,"Ġche":863,"Ġlaughed":864,"Ġsky":865,"Ġby":866,"It":867,"ĠHer":868,"Ġjump":869,"Ġgl":870,"ase":871,"Ġte":872,"Ġloud":873,"self":874,"iny":875,"Ġway":876,"wn":877,"Ġbeauti":878,"Ġcome":879,"lew":880,"Ġlist":881,"Ġwo":882,"Ġbeautiful":883,"Ġhard":884,"Ġlots":885,"Ġra":886,"Ġstill":887,"Ġfam":888,"Ġanimals":889,"Ġâ":890,"Ġhurt":891,"Ġunder":892,"ĠThen":893,"ect":894,"Ġstay":895,"ning":896,"Ġlet":897,"ct":898,"Ġboth":899,"Ġcu":900,"ĠHis":901,"hes":902,"be":903,"Ġsafe":904,"ĠFrom":905,"ool":906,"ree":907,"Ġcol":908,"Ġtwo":909,"Ġbad":910,"Ġbook":911,"Ġimp":912,"ople":913,"Ġrem":914,"ane":915,"Ġlived":916,"kay":917,"ock":918,"ucy":919,"Ġwalked":920,"Tim":921,"ast":922,"urpr":923,"Ġbrave":924,"Ġshould":925,"Ġits":926,"ob":927,"ished":928,"Ġangry":929,"Ġsurpr":930,"Ġfamily":931,"ress":932,"igh":933,"When":934,"Ġpeople":935,"Ġflew":936,"Ġcalled":937,"No":938,"Ġred":939,"Ġstor":940,"ip":941,"Ġsoon":942,"Ġfin":943,"hn":944,"Let":945,"led":946,"Ġkept":947,"Ġfore":948,"fore":949,"Ġdan":950,"Ġshare":951,"Ġfly":952,"xt":953,"ised":954,"dded":955,"Ġpic":956,"âĤ¬â":957,"Ġdoor":958,"Ġgoing":959,"ĠP":960,"ĠWhen":961,"Ġpretty":962,"Ġkeep":963,"Ġnow":964,"Ġrock":965,"Ġclean":966,"Ġdra":967,"ary":968,"Ġadvent":969,"ummy":970,"Ġnoise":971,"Ġopened":972,"Ġshiny":973,"age":974,"Ġexplore":975,"Ġwind":976,"Ġdoll":977,"Ġcry":978,"Ġcon":979,"Ġide":980,"Ġbefore":981,"ied":982,"Ben":983,"illy":984,"Ġreal":985,"Ġsto":986,"so":987,"What":988,"Ġground":989,"Ġalso":990,"les":991,"Ġturn":992,"Ħ¢":993,"âĤ¬âĦ¢":994,"Ġey":995,"That":996,"Ġfar":997,"Ġidea":998,"Ġfr":999,"oon":1000,"Ġnodded":1001,"Ġcolor":1002,"Ġwar":1003,"oy":1004,"Ġfeeling":1005,"Ġun":1006,"Ġpicked":1007,"imb":1008,"th":1009,"ĠLucy":1010,"Ġnext":1011,"Ġwalking":1012,"thing":1013,"ture":1014,"ĠDad":1015,"Ġclimb":1016,"Ġhas":1017,"uch":1018,"Ġma":1019,"Ġthr":1020,"Ġwhile":1021,"eet":1022,"Ġbed":1023}