Hugging Face's logo

melihcatal
/
codedp-cpt-models

Text Generation
PEFT
TensorBoard
Safetensors
code
differential-privacy
code-generation
continued-pretraining
lora
dp-sgd
opacus
privacy
Model card Files
xet
 Metrics Community
melihcatal commited on
Commit
f075ba4
·
verified ·
1 Parent(s): d320fa8

Upload folder using huggingface_hub

Browse files
Files changed (38) hide show
  1. granite-4.0-h-tiny/dp8/adapter/README.md +207 -0
  2. granite-4.0-h-tiny/dp8/adapter/adapter_config.json +46 -0
  3. granite-4.0-h-tiny/dp8/adapter/adapter_model.safetensors +3 -0
  4. granite-4.0-h-tiny/dp8/adapter/added_tokens.json +502 -0
  5. granite-4.0-h-tiny/dp8/adapter/chat_template.jinja +118 -0
  6. granite-4.0-h-tiny/dp8/adapter/merges.txt +0 -0
  7. granite-4.0-h-tiny/dp8/adapter/special_tokens_map.json +3532 -0
  8. granite-4.0-h-tiny/dp8/adapter/tokenizer.json +0 -0
  9. granite-4.0-h-tiny/dp8/adapter/tokenizer_config.json +0 -0
  10. granite-4.0-h-tiny/dp8/adapter/vocab.json +0 -0
  11. granite-4.0-h-tiny/dp8/audit_results.json +137 -0
  12. granite-4.0-h-tiny/dp8/audit_scores.npz +3 -0
  13. granite-4.0-h-tiny/dp8/canary_meta.json +0 -0
  14. granite-4.0-h-tiny/dp8/codecarbon.csv +2 -0
  15. granite-4.0-h-tiny/dp8/epochs/epoch_001/adapter/README.md +207 -0
  16. granite-4.0-h-tiny/dp8/epochs/epoch_001/adapter/adapter_config.json +46 -0
  17. granite-4.0-h-tiny/dp8/epochs/epoch_001/adapter/adapter_model.safetensors +3 -0
  18. granite-4.0-h-tiny/dp8/epochs/epoch_001/audit_results.json +137 -0
  19. granite-4.0-h-tiny/dp8/epochs/epoch_001/audit_scores.npz +3 -0
  20. granite-4.0-h-tiny/dp8/epochs/epoch_002/adapter/README.md +207 -0
  21. granite-4.0-h-tiny/dp8/epochs/epoch_002/adapter/adapter_config.json +46 -0
  22. granite-4.0-h-tiny/dp8/epochs/epoch_002/adapter/adapter_model.safetensors +3 -0
  23. granite-4.0-h-tiny/dp8/epochs/epoch_002/audit_results.json +137 -0
  24. granite-4.0-h-tiny/dp8/epochs/epoch_002/audit_scores.npz +3 -0
  25. granite-4.0-h-tiny/dp8/metrics.jsonl +27 -0
  26. granite-4.0-h-tiny/dp8/pretrain_lm_head.pt +3 -0
  27. granite-4.0-h-tiny/dp8/resolved_config.yaml +110 -0
  28. granite-4.0-h-tiny/dp8/scalars.csv +358 -0
  29. granite-4.0-h-tiny/dp8/summary.json +72 -0
  30. granite-4.0-h-tiny/dp8/tensorboard/events.out.tfevents.1773852132.u24-chaihm0-651.65597.0 +3 -0
  31. granite-4.0-h-tiny/dp8/tokenizer/added_tokens.json +502 -0
  32. granite-4.0-h-tiny/dp8/tokenizer/chat_template.jinja +118 -0
  33. granite-4.0-h-tiny/dp8/tokenizer/merges.txt +0 -0
  34. granite-4.0-h-tiny/dp8/tokenizer/special_tokens_map.json +3532 -0
  35. granite-4.0-h-tiny/dp8/tokenizer/tokenizer.json +0 -0
  36. granite-4.0-h-tiny/dp8/tokenizer/tokenizer_config.json +0 -0
  37. granite-4.0-h-tiny/dp8/tokenizer/vocab.json +0 -0
  38. granite-4.0-h-tiny/dp8/train.log +21 -0
granite-4.0-h-tiny/dp8/adapter/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: ibm-granite/granite-4.0-h-tiny
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:ibm-granite/granite-4.0-h-tiny
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.18.1
granite-4.0-h-tiny/dp8/adapter/adapter_config.json ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": null,
6
+ "base_model_name_or_path": "ibm-granite/granite-4.0-h-tiny",
7
+ "bias": "none",
8
+ "corda_config": null,
9
+ "ensure_weight_tying": true,
10
+ "eva_config": null,
11
+ "exclude_modules": null,
12
+ "fan_in_fan_out": false,
13
+ "inference_mode": true,
14
+ "init_lora_weights": true,
15
+ "layer_replication": null,
16
+ "layers_pattern": null,
17
+ "layers_to_transform": null,
18
+ "loftq_config": {},
19
+ "lora_alpha": 32,
20
+ "lora_bias": false,
21
+ "lora_dropout": 0.05,
22
+ "megatron_config": null,
23
+ "megatron_core": "megatron.core",
24
+ "modules_to_save": [
25
+ "lm_head",
26
+ "embed_tokens"
27
+ ],
28
+ "peft_type": "LORA",
29
+ "peft_version": "0.18.1",
30
+ "qalora_group_size": 16,
31
+ "r": 16,
32
+ "rank_pattern": {},
33
+ "revision": null,
34
+ "target_modules": [
35
+ "v_proj",
36
+ "q_proj",
37
+ "k_proj",
38
+ "o_proj"
39
+ ],
40
+ "target_parameters": null,
41
+ "task_type": "CAUSAL_LM",
42
+ "trainable_token_indices": null,
43
+ "use_dora": false,
44
+ "use_qalora": false,
45
+ "use_rslora": false
46
+ }
granite-4.0-h-tiny/dp8/adapter/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1df8b34daafd4be1c1d8ca607ea1423807fb29d5cf57ff5dff30585a50fc02a
3
+ size 1861530512
granite-4.0-h-tiny/dp8/adapter/added_tokens.json ADDED
@@ -0,0 +1,502 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "114848338811": 100360,
3
+ "116427191984": 100714,
4
+ "116639746413": 100686,
5
+ "117298239631": 100576,
6
+ "117657531962": 100633,
7
+ "117783274348": 100650,
8
+ "119342152414": 100723,
9
+ "121557291859": 100582,
10
+ "123741461297": 100491,
11
+ "124589118494": 100487,
12
+ "125866399464": 100596,
13
+ "126574388585": 100538,
14
+ "129693547287": 100472,
15
+ "133373659361": 100667,
16
+ "135441121756": 100355,
17
+ "136931728327": 100457,
18
+ "138154781148": 100767,
19
+ "138218735276": 100651,
20
+ "141499982867": 100745,
21
+ "142526557681": 100845,
22
+ "142799718159": 100709,
23
+ "143182978129": 100671,
24
+ "143777992227": 100366,
25
+ "144373897488": 100777,
26
+ "145669731981": 100581,
27
+ "147444452794": 100830,
28
+ "147541537162": 100775,
29
+ "151859598873": 100547,
30
+ "152676556624": 100682,
31
+ "154962668224": 100696,
32
+ "158142752582": 100577,
33
+ "158929292238": 100587,
34
+ "159337222655": 100422,
35
+ "161238482259": 100790,
36
+ "161588262349": 100437,
37
+ "163165456396": 100788,
38
+ "163497196769": 100820,
39
+ "165429152138": 100717,
40
+ "172599315861": 100371,
41
+ "173781362446": 100423,
42
+ "175469284871": 100515,
43
+ "175528632226": 100833,
44
+ "178478368922": 100762,
45
+ "179386156569": 100804,
46
+ "179564995814": 100697,
47
+ "181233596124": 100782,
48
+ "181439694557": 100398,
49
+ "182345464792": 100442,
50
+ "182782912224": 100624,
51
+ "183368827562": 100551,
52
+ "185438575221": 100537,
53
+ "186198784585": 100598,
54
+ "186872457894": 100835,
55
+ "191887635211": 100721,
56
+ "195388849133": 100792,
57
+ "195792996468": 100546,
58
+ "196119929397": 100611,
59
+ "196735786156": 100493,
60
+ "198462689911": 100428,
61
+ "211411365397": 100377,
62
+ "211662639865": 100706,
63
+ "212985874612": 100720,
64
+ "214193645583": 100802,
65
+ "215671314196": 100602,
66
+ "215826764872": 100756,
67
+ "216667245274": 100484,
68
+ "217756494954": 100648,
69
+ "218391991184": 100679,
70
+ "218784516525": 100707,
71
+ "221762325616": 100678,
72
+ "225164373623": 100439,
73
+ "228358422847": 100669,
74
+ "228565148417": 100726,
75
+ "229775525672": 100793,
76
+ "231853711778": 100516,
77
+ "232776999554": 100443,
78
+ "232787996724": 100601,
79
+ "232896526252": 100489,
80
+ "233795848681": 100507,
81
+ "234316622259": 100625,
82
+ "242851284913": 100435,
83
+ "243165586174": 100784,
84
+ "244371196654": 100615,
85
+ "244885399387": 100533,
86
+ "245416776926": 100583,
87
+ "251789649997": 100613,
88
+ "252867443568": 100578,
89
+ "256497188281": 100735,
90
+ "259533577263": 100458,
91
+ "259666844669": 100434,
92
+ "262296912232": 100481,
93
+ "262437452884": 100794,
94
+ "264259917554": 100413,
95
+ "265847332563": 100818,
96
+ "267514771964": 100574,
97
+ "267954879268": 100646,
98
+ "268433315926": 100822,
99
+ "268921994538": 100715,
100
+ "272362973463": 100406,
101
+ "275597777299": 100565,
102
+ "281673864127": 100408,
103
+ "282322838685": 100373,
104
+ "284445431422": 100664,
105
+ "284776712475": 100780,
106
+ "286173241916": 100603,
107
+ "291762694874": 100670,
108
+ "293847485454": 100760,
109
+ "295118729589": 100609,
110
+ "295448593321": 100490,
111
+ "296953381169": 100479,
112
+ "298464134954": 100483,
113
+ "311632789559": 100391,
114
+ "313145133463": 100773,
115
+ "313313831273": 100815,
116
+ "314697386682": 100449,
117
+ "315534574435": 100754,
118
+ "319584985416": 100570,
119
+ "322589379462": 100680,
120
+ "322683334381": 100668,
121
+ "325196781219": 100844,
122
+ "327158398268": 100673,
123
+ "327491773134": 100387,
124
+ "328552864359": 100705,
125
+ "331369926711": 100731,
126
+ "332234613346": 100843,
127
+ "332522971941": 100683,
128
+ "334513529294": 100662,
129
+ "336813343298": 100747,
130
+ "337326533813": 100444,
131
+ "339882449689": 100597,
132
+ "342221452223": 100742,
133
+ "345271433112": 100657,
134
+ "349249721685": 100751,
135
+ "351885857332": 100426,
136
+ "353755529131": 100753,
137
+ "355977139358": 100379,
138
+ "356722692178": 100846,
139
+ "357299947518": 100832,
140
+ "357621613582": 100738,
141
+ "363214487524": 100532,
142
+ "364196983365": 100545,
143
+ "364492359246": 100695,
144
+ "364947325679": 100618,
145
+ "367459894796": 100356,
146
+ "367968398551": 100757,
147
+ "368763327262": 100799,
148
+ "371496153876": 100816,
149
+ "374327157578": 100390,
150
+ "374439448821": 100468,
151
+ "374598961236": 100512,
152
+ "375429755114": 100781,
153
+ "377273562477": 100480,
154
+ "377338713663": 100494,
155
+ "378749551722": 100789,
156
+ "379557332953": 100451,
157
+ "379571934299": 100612,
158
+ "383837596997": 100381,
159
+ "384598329253": 100616,
160
+ "387763951128": 100730,
161
+ "389715484387": 100759,
162
+ "393741199486": 100704,
163
+ "396521188476": 100665,
164
+ "396847976144": 100785,
165
+ "398549545767": 100502,
166
+ "399223169721": 100548,
167
+ "399749397872": 100471,
168
+ "412843856172": 100803,
169
+ "415956914763": 100629,
170
+ "417668946583": 100737,
171
+ "418412875665": 100698,
172
+ "421369185549": 100626,
173
+ "421435255895": 100666,
174
+ "425949483533": 100368,
175
+ "429781429464": 100453,
176
+ "431149748713": 100594,
177
+ "431751228368": 100534,
178
+ "433581868192": 100535,
179
+ "434632855397": 100627,
180
+ "438124184139": 100812,
181
+ "438435178228": 100739,
182
+ "438745114173": 100690,
183
+ "441373944925": 100463,
184
+ "441377892146": 100795,
185
+ "445925149649": 100364,
186
+ "447445629421": 100396,
187
+ "449318681694": 100847,
188
+ "449549215429": 100819,
189
+ "451161679736": 100676,
190
+ "451885565366": 100796,
191
+ "454164859837": 100656,
192
+ "454244839926": 100503,
193
+ "455423278865": 100703,
194
+ "457919547633": 100358,
195
+ "462294118988": 100658,
196
+ "467893531755": 100465,
197
+ "472129283475": 100749,
198
+ "473822473819": 100397,
199
+ "475794684356": 100556,
200
+ "476969195485": 100772,
201
+ "479227349997": 100456,
202
+ "479676316326": 100409,
203
+ "481884157827": 100416,
204
+ "482829231639": 100828,
205
+ "484489193824": 100529,
206
+ "484773717614": 100497,
207
+ "485177821815": 100354,
208
+ "485692541169": 100740,
209
+ "486391569221": 100536,
210
+ "488496781997": 100826,
211
+ "488538864842": 100459,
212
+ "489562189822": 100530,
213
+ "489991411364": 100461,
214
+ "492373714791": 100590,
215
+ "492516914298": 100769,
216
+ "497294727353": 100660,
217
+ "499148455254": 100462,
218
+ "499156317423": 100654,
219
+ "499444466686": 100448,
220
+ "511785788222": 100659,
221
+ "511923256573": 100672,
222
+ "512659818733": 100591,
223
+ "513349618943": 100685,
224
+ "513361312532": 100520,
225
+ "514354144759": 100750,
226
+ "514532995959": 100436,
227
+ "515856611931": 100655,
228
+ "516968424863": 100476,
229
+ "517379856925": 100450,
230
+ "517778845323": 100431,
231
+ "522515164754": 100778,
232
+ "523723475786": 100755,
233
+ "523918658846": 100392,
234
+ "523937669294": 100716,
235
+ "524444658383": 100649,
236
+ "527117488925": 100466,
237
+ "527874729936": 100728,
238
+ "529455466433": 100610,
239
+ "529679678956": 100420,
240
+ "529854679937": 100540,
241
+ "532833541879": 100642,
242
+ "533417736566": 100552,
243
+ "535787224917": 100425,
244
+ "538631466654": 100677,
245
+ "545512344383": 100447,
246
+ "546276298359": 100752,
247
+ "547149832394": 100482,
248
+ "547563892268": 100813,
249
+ "549946382131": 100663,
250
+ "552738847828": 100836,
251
+ "556814553861": 100827,
252
+ "556976448182": 100605,
253
+ "557163366873": 100776,
254
+ "557533689478": 100527,
255
+ "558837194455": 100787,
256
+ "562389434565": 100734,
257
+ "562716493614": 100732,
258
+ "563117729724": 100510,
259
+ "563365646341": 100571,
260
+ "564395222747": 100675,
261
+ "564544131355": 100614,
262
+ "569765693871": 100353,
263
+ "569853653352": 100758,
264
+ "571317457151": 100712,
265
+ "572154333646": 100486,
266
+ "578827344666": 100427,
267
+ "579184949249": 100418,
268
+ "581493616981": 100763,
269
+ "581976444672": 100588,
270
+ "582471228164": 100525,
271
+ "583527834464": 100825,
272
+ "585544633356": 100524,
273
+ "586855179568": 100496,
274
+ "587541149322": 100817,
275
+ "587787496812": 100417,
276
+ "589439538674": 100764,
277
+ "589547936288": 100531,
278
+ "591464355756": 100719,
279
+ "592538279337": 100399,
280
+ "594688742928": 100748,
281
+ "598916996413": 100630,
282
+ "599961512792": 100606,
283
+ "612128769512": 100389,
284
+ "612788593128": 100580,
285
+ "614583493135": 100841,
286
+ "614797267726": 100452,
287
+ "616248973917": 100542,
288
+ "618423867817": 100725,
289
+ "618878266619": 100829,
290
+ "619454958782": 100593,
291
+ "622553389126": 100693,
292
+ "624221476921": 100595,
293
+ "624266421831": 100701,
294
+ "625334487352": 100807,
295
+ "626748382482": 100837,
296
+ "632962475133": 100528,
297
+ "635127952696": 100713,
298
+ "635185846287": 100687,
299
+ "636324136426": 100801,
300
+ "637551427887": 100647,
301
+ "643489267333": 100372,
302
+ "643692393748": 100401,
303
+ "644234165531": 100623,
304
+ "645527857972": 100834,
305
+ "646979124677": 100410,
306
+ "649291669397": 100362,
307
+ "649516938598": 100810,
308
+ "652154162978": 100557,
309
+ "653573457168": 100492,
310
+ "655517954651": 100619,
311
+ "658481324922": 100415,
312
+ "661436365453": 100433,
313
+ "662426712668": 100517,
314
+ "664847713559": 100637,
315
+ "665661658354": 100554,
316
+ "668134915514": 100400,
317
+ "668514843129": 100559,
318
+ "669183782449": 100643,
319
+ "669689115557": 100386,
320
+ "673948786567": 100620,
321
+ "676539973863": 100440,
322
+ "676676697292": 100445,
323
+ "677896358599": 100499,
324
+ "678666359123": 100526,
325
+ "682564697312": 100380,
326
+ "687284547244": 100848,
327
+ "689285841825": 100473,
328
+ "689362171782": 100382,
329
+ "691315125346": 100635,
330
+ "691587454538": 100365,
331
+ "693281533643": 100555,
332
+ "694235616268": 100407,
333
+ "696651276628": 100402,
334
+ "697747991249": 100743,
335
+ "698218415444": 100378,
336
+ "699446724178": 100700,
337
+ "711412347158": 100518,
338
+ "711641973413": 100653,
339
+ "712992815957": 100521,
340
+ "714738141818": 100761,
341
+ "716763689965": 100744,
342
+ "717628619782": 100811,
343
+ "718726519731": 100370,
344
+ "718951851413": 100699,
345
+ "721737645236": 100455,
346
+ "722339992679": 100766,
347
+ "722618266242": 100429,
348
+ "724492262421": 100692,
349
+ "724883568652": 100475,
350
+ "724964923582": 100779,
351
+ "729116422489": 100727,
352
+ "729825168745": 100634,
353
+ "731681792655": 100566,
354
+ "733737988257": 100477,
355
+ "739246183345": 100718,
356
+ "739394546916": 100645,
357
+ "739667844957": 100733,
358
+ "739784153482": 100729,
359
+ "741757479784": 100539,
360
+ "742765629356": 100438,
361
+ "745977673725": 100604,
362
+ "746285987371": 100361,
363
+ "749665846687": 100432,
364
+ "749966767285": 100383,
365
+ "752644929761": 100563,
366
+ "753159165157": 100384,
367
+ "753233719644": 100558,
368
+ "753466987363": 100519,
369
+ "754978243758": 100791,
370
+ "756916173536": 100805,
371
+ "757422791351": 100800,
372
+ "757785319772": 100768,
373
+ "758963111966": 100774,
374
+ "762486672996": 100708,
375
+ "762495822823": 100798,
376
+ "763531783491": 100543,
377
+ "765474393376": 100359,
378
+ "765737843639": 100514,
379
+ "765981581453": 100393,
380
+ "766294538337": 100607,
381
+ "767858144912": 100711,
382
+ "768461952319": 100636,
383
+ "771619544974": 100474,
384
+ "773671349113": 100631,
385
+ "773687856563": 100424,
386
+ "774679513717": 100823,
387
+ "778466723723": 100404,
388
+ "781653545886": 100374,
389
+ "786391632558": 100553,
390
+ "794825141891": 100394,
391
+ "795693824762": 100385,
392
+ "795838284624": 100421,
393
+ "796415361892": 100375,
394
+ "797238311233": 100851,
395
+ "799364566435": 100504,
396
+ "799417897197": 100584,
397
+ "811371928234": 100572,
398
+ "813981174797": 100689,
399
+ "814611949491": 100652,
400
+ "815458725125": 100702,
401
+ "816115936673": 100622,
402
+ "817378986438": 100506,
403
+ "818479319499": 100746,
404
+ "819162623892": 100560,
405
+ "824387273757": 100508,
406
+ "824488329416": 100640,
407
+ "825815739116": 100741,
408
+ "826214551218": 100441,
409
+ "829235161526": 100523,
410
+ "836746273134": 100414,
411
+ "837131396371": 100573,
412
+ "837873762491": 100641,
413
+ "839269684865": 100579,
414
+ "841824384614": 100488,
415
+ "841991688488": 100376,
416
+ "843998562287": 100485,
417
+ "846657726193": 100765,
418
+ "848845611563": 100500,
419
+ "851254219729": 100824,
420
+ "851852651677": 100501,
421
+ "852347289392": 100478,
422
+ "853859348234": 100403,
423
+ "856317483891": 100814,
424
+ "857231548835": 100621,
425
+ "858146415154": 100710,
426
+ "859289776479": 100840,
427
+ "859927364588": 100736,
428
+ "861342291298": 100821,
429
+ "864718285734": 100568,
430
+ "865331112869": 100352,
431
+ "866519986723": 100661,
432
+ "867678158885": 100470,
433
+ "873898736873": 100395,
434
+ "876537814263": 100681,
435
+ "877385381798": 100562,
436
+ "877482678543": 100357,
437
+ "879425227932": 100469,
438
+ "879764613759": 100674,
439
+ "881112998642": 100592,
440
+ "881136466196": 100564,
441
+ "883685933161": 100412,
442
+ "884354318946": 100684,
443
+ "886464195129": 100639,
444
+ "887417525236": 100809,
445
+ "887753195844": 100617,
446
+ "889965243135": 100694,
447
+ "892336777248": 100586,
448
+ "892697125149": 100806,
449
+ "893974619684": 100850,
450
+ "894885246797": 100498,
451
+ "897784492783": 100589,
452
+ "899151413682": 100464,
453
+ "912193598348": 100419,
454
+ "916198946615": 100509,
455
+ "919181521716": 100770,
456
+ "921889371893": 100628,
457
+ "921894985642": 100838,
458
+ "922327493433": 100411,
459
+ "922466849763": 100454,
460
+ "922867396683": 100513,
461
+ "927914615679": 100363,
462
+ "928335588653": 100467,
463
+ "929185622831": 100446,
464
+ "929826356991": 100405,
465
+ "933775286797": 100842,
466
+ "934912591213": 100608,
467
+ "937495658852": 100460,
468
+ "938488813964": 100549,
469
+ "941169431859": 100561,
470
+ "941861857715": 100808,
471
+ "941976537588": 100644,
472
+ "943193294691": 100599,
473
+ "943878645871": 100839,
474
+ "944513428457": 100575,
475
+ "946444632795": 100724,
476
+ "947262995132": 100849,
477
+ "948585673431": 100783,
478
+ "949235426629": 100831,
479
+ "951794811935": 100511,
480
+ "952465217972": 100632,
481
+ "952872416512": 100430,
482
+ "953267689786": 100638,
483
+ "955456118295": 100544,
484
+ "955668961269": 100600,
485
+ "961133895172": 100567,
486
+ "961981959227": 100550,
487
+ "963852916563": 100569,
488
+ "964342468552": 100495,
489
+ "967114116556": 100505,
490
+ "967214577653": 100722,
491
+ "971621888444": 100522,
492
+ "981277526855": 100797,
493
+ "982993456429": 100369,
494
+ "983493951323": 100691,
495
+ "983569279932": 100388,
496
+ "985781138935": 100771,
497
+ "993832498489": 100688,
498
+ "996116119839": 100541,
499
+ "997724962668": 100786,
500
+ "997958836435": 100585,
501
+ "997981281989": 100367
502
+ }
granite-4.0-h-tiny/dp8/adapter/chat_template.jinja ADDED
@@ -0,0 +1,118 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- set tools_system_message_prefix = 'You are a helpful assistant with access to the following tools. You may call one or more tools to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>' %}
2
+ {%- set tools_system_message_suffix = '\n</tools>\n\nFor each tool call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call>. If a tool does not exist in the provided list of tools, notify the user that you do not have the ability to fulfill the request.' %}
3
+ {%- set documents_system_message_prefix = 'You are a helpful assistant with access to the following documents. You may use one or more documents to assist with the user query.\n\nYou are given a list of documents within <documents></documents> XML tags:\n<documents>' %}
4
+ {%- set documents_system_message_suffix = '\n</documents>\n\nWrite the response to the user\'s input by strictly aligning with the facts in the provided documents. If the information needed to answer the question is not available in the documents, inform the user that the question cannot be answered based on the available data.' %}
5
+ {%- set g4_default_system_message = 'You are a helpful assistant. Please ensure responses are professional, accurate, and safe.' %}
6
+ {%- if available_tools is defined and available_tools %}
7
+ {%- set tools = available_tools %}
8
+ {%- endif %}
9
+ {%- set ns = namespace(tools_system_message=tools_system_message_prefix,
10
+ documents_system_message=documents_system_message_prefix,
11
+ default_system_message=g4_default_system_message,
12
+ system_message=''
13
+ ) %}
14
+ {%- if tools %}
15
+ {%- for tool in tools %}
16
+ {%- set ns.tools_system_message = ns.tools_system_message + '\n' + (tool | tojson) %}
17
+ {%- endfor %}
18
+ {%- set ns.tools_system_message = ns.tools_system_message + tools_system_message_suffix %}
19
+ {%- else %}
20
+ {%- set ns.tools_system_message = '' %}
21
+ {%- endif %}
22
+ {%- if documents %}
23
+ {%- for document in documents %}
24
+ {%- set ns.documents_system_message = ns.documents_system_message + '\n' + (document | tojson) %}
25
+ {%- endfor %}
26
+ {%- set ns.documents_system_message = ns.documents_system_message + documents_system_message_suffix %}
27
+ {%- else %}
28
+ {%- set ns.documents_system_message = '' %}
29
+ {%- endif %}
30
+ {%- if messages[0].role == 'system' %}
31
+ {%- if messages[0].content is string %}
32
+ {%- set ns.system_message = messages[0].content %}
33
+ {%- elif messages[0].content is iterable %}
34
+ {%- for entry in messages[0].content %}
35
+ {%- if entry.type== 'text' %}
36
+ {%- if ns.system_message != '' %}
37
+ {%- set ns.system_message = ns.system_message + '\n' %}
38
+ {%- endif %}
39
+ {%- set ns.system_message = ns.system_message + entry.text %}
40
+ {%- endif %}
41
+ {%- endfor %}
42
+ {%- endif %}
43
+ {%- if tools and documents %}
44
+ {%- set ns.system_message = ns.system_message + '\n\n' + ns.tools_system_message + '\n\n' + ns.documents_system_message %}
45
+ {%- elif tools %}
46
+ {%- set ns.system_message = ns.system_message + '\n\n' + ns.tools_system_message %}
47
+ {%- elif documents %}
48
+ {%- set ns.system_message = ns.system_message + '\n\n' + ns.documents_system_message %}
49
+ {%- endif %}
50
+ {%- else %}
51
+ {%- if tools and documents %}
52
+ {%- set ns.system_message = ns.tools_system_message + '\n\n' + ns.documents_system_message %}
53
+ {%- elif tools %}
54
+ {%- set ns.system_message = ns.tools_system_message %}
55
+ {%- elif documents %}
56
+ {%- set ns.system_message = ns.documents_system_message %}
57
+ {%- endif %}
58
+ {%- endif %}
59
+ {%- if ns.system_message %}
60
+ {{- '<|start_of_role|>system<|end_of_role|>' + ns.system_message + '<|end_of_text|>\n' }}
61
+ {%- else %}
62
+ {{- '<|start_of_role|>system<|end_of_role|>' + ns.default_system_message + '<|end_of_text|>\n' }}
63
+ {%- endif %}
64
+ {%- for message in messages %}
65
+ {%- set content = namespace(val='') %}
66
+ {%- if message.content is string %}
67
+ {%- set content.val = message.content %}
68
+ {%- else %}
69
+ {%- if message.content is iterable %}
70
+ {%- for entry in message.content %}
71
+ {%- if entry.type== 'text' %}
72
+ {%- if content.val != '' %}
73
+ {%- set content.val = content.val + '\n' %}
74
+ {%- endif %}
75
+ {%- set content.val = content.val + entry.text %}
76
+ {%- endif %}
77
+ {%- endfor %}
78
+ {%- endif %}
79
+ {%- endif %}
80
+ {%- if (message.role == 'user') or (message.role == 'system' and not loop.first) %}
81
+ {{- '<|start_of_role|>' + message.role + '<|end_of_role|>' + content.val + '<|end_of_text|>\n' }}
82
+ {%- elif message.role == 'assistant' %}
83
+ {{- '<|start_of_role|>' + message.role + '<|end_of_role|>' + content.val }}
84
+ {%- if message.tool_calls %}
85
+ {%- for tool_call in message.tool_calls %}
86
+ {%- if (loop.first and content.val) or (not loop.first) %}
87
+ {{- '\n' }}
88
+ {%- endif %}
89
+ {%- if tool_call.function %}
90
+ {%- set tool_call = tool_call.function %}
91
+ {%- endif %}
92
+ {{- '<tool_call>\n{"name": "' }}
93
+ {{- tool_call.name }}
94
+ {{- '", "arguments": ' }}
95
+ {%- if tool_call.arguments is string %}
96
+ {{- tool_call.arguments }}
97
+ {%- else %}
98
+ {{- tool_call.arguments | tojson }}
99
+ {%- endif %}
100
+ {{- '}\n</tool_call>' }}
101
+ {%- endfor %}
102
+ {%- endif %}
103
+ {{- '<|end_of_text|>\n' }}
104
+ {%- elif message.role == 'tool' %}
105
+ {%- if loop.first or (messages[loop.index0 - 1].role != 'tool') %}
106
+ {{- '<|start_of_role|>user<|end_of_role|>' }}
107
+ {%- endif %}
108
+ {{- '\n<tool_response>\n' }}
109
+ {{- content.val }}
110
+ {{- '\n</tool_response>' }}
111
+ {%- if loop.last or (messages[loop.index0 + 1].role != 'tool') %}
112
+ {{- '<|end_of_text|>\n' }}
113
+ {%- endif %}
114
+ {%- endif %}
115
+ {%- endfor %}
116
+ {%- if add_generation_prompt %}
117
+ {{- '<|start_of_role|>assistant<|end_of_role|>' }}
118
+ {%- endif %}
granite-4.0-h-tiny/dp8/adapter/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/adapter/special_tokens_map.json ADDED
@@ -0,0 +1,3532 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ {
4
+ "content": "865331112869",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false
9
+ },
10
+ {
11
+ "content": "569765693871",
12
+ "lstrip": false,
13
+ "normalized": false,
14
+ "rstrip": false,
15
+ "single_word": false
16
+ },
17
+ {
18
+ "content": "485177821815",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ {
25
+ "content": "135441121756",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ },
31
+ {
32
+ "content": "367459894796",
33
+ "lstrip": false,
34
+ "normalized": false,
35
+ "rstrip": false,
36
+ "single_word": false
37
+ },
38
+ {
39
+ "content": "877482678543",
40
+ "lstrip": false,
41
+ "normalized": false,
42
+ "rstrip": false,
43
+ "single_word": false
44
+ },
45
+ {
46
+ "content": "457919547633",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false
51
+ },
52
+ {
53
+ "content": "765474393376",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false
58
+ },
59
+ {
60
+ "content": "114848338811",
61
+ "lstrip": false,
62
+ "normalized": false,
63
+ "rstrip": false,
64
+ "single_word": false
65
+ },
66
+ {
67
+ "content": "746285987371",
68
+ "lstrip": false,
69
+ "normalized": false,
70
+ "rstrip": false,
71
+ "single_word": false
72
+ },
73
+ {
74
+ "content": "649291669397",
75
+ "lstrip": false,
76
+ "normalized": false,
77
+ "rstrip": false,
78
+ "single_word": false
79
+ },
80
+ {
81
+ "content": "927914615679",
82
+ "lstrip": false,
83
+ "normalized": false,
84
+ "rstrip": false,
85
+ "single_word": false
86
+ },
87
+ {
88
+ "content": "445925149649",
89
+ "lstrip": false,
90
+ "normalized": false,
91
+ "rstrip": false,
92
+ "single_word": false
93
+ },
94
+ {
95
+ "content": "691587454538",
96
+ "lstrip": false,
97
+ "normalized": false,
98
+ "rstrip": false,
99
+ "single_word": false
100
+ },
101
+ {
102
+ "content": "143777992227",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false
107
+ },
108
+ {
109
+ "content": "997981281989",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false
114
+ },
115
+ {
116
+ "content": "425949483533",
117
+ "lstrip": false,
118
+ "normalized": false,
119
+ "rstrip": false,
120
+ "single_word": false
121
+ },
122
+ {
123
+ "content": "982993456429",
124
+ "lstrip": false,
125
+ "normalized": false,
126
+ "rstrip": false,
127
+ "single_word": false
128
+ },
129
+ {
130
+ "content": "718726519731",
131
+ "lstrip": false,
132
+ "normalized": false,
133
+ "rstrip": false,
134
+ "single_word": false
135
+ },
136
+ {
137
+ "content": "172599315861",
138
+ "lstrip": false,
139
+ "normalized": false,
140
+ "rstrip": false,
141
+ "single_word": false
142
+ },
143
+ {
144
+ "content": "643489267333",
145
+ "lstrip": false,
146
+ "normalized": false,
147
+ "rstrip": false,
148
+ "single_word": false
149
+ },
150
+ {
151
+ "content": "282322838685",
152
+ "lstrip": false,
153
+ "normalized": false,
154
+ "rstrip": false,
155
+ "single_word": false
156
+ },
157
+ {
158
+ "content": "781653545886",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false
163
+ },
164
+ {
165
+ "content": "796415361892",
166
+ "lstrip": false,
167
+ "normalized": false,
168
+ "rstrip": false,
169
+ "single_word": false
170
+ },
171
+ {
172
+ "content": "841991688488",
173
+ "lstrip": false,
174
+ "normalized": false,
175
+ "rstrip": false,
176
+ "single_word": false
177
+ },
178
+ {
179
+ "content": "211411365397",
180
+ "lstrip": false,
181
+ "normalized": false,
182
+ "rstrip": false,
183
+ "single_word": false
184
+ },
185
+ {
186
+ "content": "698218415444",
187
+ "lstrip": false,
188
+ "normalized": false,
189
+ "rstrip": false,
190
+ "single_word": false
191
+ },
192
+ {
193
+ "content": "355977139358",
194
+ "lstrip": false,
195
+ "normalized": false,
196
+ "rstrip": false,
197
+ "single_word": false
198
+ },
199
+ {
200
+ "content": "682564697312",
201
+ "lstrip": false,
202
+ "normalized": false,
203
+ "rstrip": false,
204
+ "single_word": false
205
+ },
206
+ {
207
+ "content": "383837596997",
208
+ "lstrip": false,
209
+ "normalized": false,
210
+ "rstrip": false,
211
+ "single_word": false
212
+ },
213
+ {
214
+ "content": "689362171782",
215
+ "lstrip": false,
216
+ "normalized": false,
217
+ "rstrip": false,
218
+ "single_word": false
219
+ },
220
+ {
221
+ "content": "749966767285",
222
+ "lstrip": false,
223
+ "normalized": false,
224
+ "rstrip": false,
225
+ "single_word": false
226
+ },
227
+ {
228
+ "content": "753159165157",
229
+ "lstrip": false,
230
+ "normalized": false,
231
+ "rstrip": false,
232
+ "single_word": false
233
+ },
234
+ {
235
+ "content": "795693824762",
236
+ "lstrip": false,
237
+ "normalized": false,
238
+ "rstrip": false,
239
+ "single_word": false
240
+ },
241
+ {
242
+ "content": "669689115557",
243
+ "lstrip": false,
244
+ "normalized": false,
245
+ "rstrip": false,
246
+ "single_word": false
247
+ },
248
+ {
249
+ "content": "327491773134",
250
+ "lstrip": false,
251
+ "normalized": false,
252
+ "rstrip": false,
253
+ "single_word": false
254
+ },
255
+ {
256
+ "content": "983569279932",
257
+ "lstrip": false,
258
+ "normalized": false,
259
+ "rstrip": false,
260
+ "single_word": false
261
+ },
262
+ {
263
+ "content": "612128769512",
264
+ "lstrip": false,
265
+ "normalized": false,
266
+ "rstrip": false,
267
+ "single_word": false
268
+ },
269
+ {
270
+ "content": "374327157578",
271
+ "lstrip": false,
272
+ "normalized": false,
273
+ "rstrip": false,
274
+ "single_word": false
275
+ },
276
+ {
277
+ "content": "311632789559",
278
+ "lstrip": false,
279
+ "normalized": false,
280
+ "rstrip": false,
281
+ "single_word": false
282
+ },
283
+ {
284
+ "content": "523918658846",
285
+ "lstrip": false,
286
+ "normalized": false,
287
+ "rstrip": false,
288
+ "single_word": false
289
+ },
290
+ {
291
+ "content": "765981581453",
292
+ "lstrip": false,
293
+ "normalized": false,
294
+ "rstrip": false,
295
+ "single_word": false
296
+ },
297
+ {
298
+ "content": "794825141891",
299
+ "lstrip": false,
300
+ "normalized": false,
301
+ "rstrip": false,
302
+ "single_word": false
303
+ },
304
+ {
305
+ "content": "873898736873",
306
+ "lstrip": false,
307
+ "normalized": false,
308
+ "rstrip": false,
309
+ "single_word": false
310
+ },
311
+ {
312
+ "content": "447445629421",
313
+ "lstrip": false,
314
+ "normalized": false,
315
+ "rstrip": false,
316
+ "single_word": false
317
+ },
318
+ {
319
+ "content": "473822473819",
320
+ "lstrip": false,
321
+ "normalized": false,
322
+ "rstrip": false,
323
+ "single_word": false
324
+ },
325
+ {
326
+ "content": "181439694557",
327
+ "lstrip": false,
328
+ "normalized": false,
329
+ "rstrip": false,
330
+ "single_word": false
331
+ },
332
+ {
333
+ "content": "592538279337",
334
+ "lstrip": false,
335
+ "normalized": false,
336
+ "rstrip": false,
337
+ "single_word": false
338
+ },
339
+ {
340
+ "content": "668134915514",
341
+ "lstrip": false,
342
+ "normalized": false,
343
+ "rstrip": false,
344
+ "single_word": false
345
+ },
346
+ {
347
+ "content": "643692393748",
348
+ "lstrip": false,
349
+ "normalized": false,
350
+ "rstrip": false,
351
+ "single_word": false
352
+ },
353
+ {
354
+ "content": "696651276628",
355
+ "lstrip": false,
356
+ "normalized": false,
357
+ "rstrip": false,
358
+ "single_word": false
359
+ },
360
+ {
361
+ "content": "853859348234",
362
+ "lstrip": false,
363
+ "normalized": false,
364
+ "rstrip": false,
365
+ "single_word": false
366
+ },
367
+ {
368
+ "content": "778466723723",
369
+ "lstrip": false,
370
+ "normalized": false,
371
+ "rstrip": false,
372
+ "single_word": false
373
+ },
374
+ {
375
+ "content": "929826356991",
376
+ "lstrip": false,
377
+ "normalized": false,
378
+ "rstrip": false,
379
+ "single_word": false
380
+ },
381
+ {
382
+ "content": "272362973463",
383
+ "lstrip": false,
384
+ "normalized": false,
385
+ "rstrip": false,
386
+ "single_word": false
387
+ },
388
+ {
389
+ "content": "694235616268",
390
+ "lstrip": false,
391
+ "normalized": false,
392
+ "rstrip": false,
393
+ "single_word": false
394
+ },
395
+ {
396
+ "content": "281673864127",
397
+ "lstrip": false,
398
+ "normalized": false,
399
+ "rstrip": false,
400
+ "single_word": false
401
+ },
402
+ {
403
+ "content": "479676316326",
404
+ "lstrip": false,
405
+ "normalized": false,
406
+ "rstrip": false,
407
+ "single_word": false
408
+ },
409
+ {
410
+ "content": "646979124677",
411
+ "lstrip": false,
412
+ "normalized": false,
413
+ "rstrip": false,
414
+ "single_word": false
415
+ },
416
+ {
417
+ "content": "922327493433",
418
+ "lstrip": false,
419
+ "normalized": false,
420
+ "rstrip": false,
421
+ "single_word": false
422
+ },
423
+ {
424
+ "content": "883685933161",
425
+ "lstrip": false,
426
+ "normalized": false,
427
+ "rstrip": false,
428
+ "single_word": false
429
+ },
430
+ {
431
+ "content": "264259917554",
432
+ "lstrip": false,
433
+ "normalized": false,
434
+ "rstrip": false,
435
+ "single_word": false
436
+ },
437
+ {
438
+ "content": "836746273134",
439
+ "lstrip": false,
440
+ "normalized": false,
441
+ "rstrip": false,
442
+ "single_word": false
443
+ },
444
+ {
445
+ "content": "658481324922",
446
+ "lstrip": false,
447
+ "normalized": false,
448
+ "rstrip": false,
449
+ "single_word": false
450
+ },
451
+ {
452
+ "content": "481884157827",
453
+ "lstrip": false,
454
+ "normalized": false,
455
+ "rstrip": false,
456
+ "single_word": false
457
+ },
458
+ {
459
+ "content": "587787496812",
460
+ "lstrip": false,
461
+ "normalized": false,
462
+ "rstrip": false,
463
+ "single_word": false
464
+ },
465
+ {
466
+ "content": "579184949249",
467
+ "lstrip": false,
468
+ "normalized": false,
469
+ "rstrip": false,
470
+ "single_word": false
471
+ },
472
+ {
473
+ "content": "912193598348",
474
+ "lstrip": false,
475
+ "normalized": false,
476
+ "rstrip": false,
477
+ "single_word": false
478
+ },
479
+ {
480
+ "content": "529679678956",
481
+ "lstrip": false,
482
+ "normalized": false,
483
+ "rstrip": false,
484
+ "single_word": false
485
+ },
486
+ {
487
+ "content": "795838284624",
488
+ "lstrip": false,
489
+ "normalized": false,
490
+ "rstrip": false,
491
+ "single_word": false
492
+ },
493
+ {
494
+ "content": "159337222655",
495
+ "lstrip": false,
496
+ "normalized": false,
497
+ "rstrip": false,
498
+ "single_word": false
499
+ },
500
+ {
501
+ "content": "173781362446",
502
+ "lstrip": false,
503
+ "normalized": false,
504
+ "rstrip": false,
505
+ "single_word": false
506
+ },
507
+ {
508
+ "content": "773687856563",
509
+ "lstrip": false,
510
+ "normalized": false,
511
+ "rstrip": false,
512
+ "single_word": false
513
+ },
514
+ {
515
+ "content": "535787224917",
516
+ "lstrip": false,
517
+ "normalized": false,
518
+ "rstrip": false,
519
+ "single_word": false
520
+ },
521
+ {
522
+ "content": "351885857332",
523
+ "lstrip": false,
524
+ "normalized": false,
525
+ "rstrip": false,
526
+ "single_word": false
527
+ },
528
+ {
529
+ "content": "578827344666",
530
+ "lstrip": false,
531
+ "normalized": false,
532
+ "rstrip": false,
533
+ "single_word": false
534
+ },
535
+ {
536
+ "content": "198462689911",
537
+ "lstrip": false,
538
+ "normalized": false,
539
+ "rstrip": false,
540
+ "single_word": false
541
+ },
542
+ {
543
+ "content": "722618266242",
544
+ "lstrip": false,
545
+ "normalized": false,
546
+ "rstrip": false,
547
+ "single_word": false
548
+ },
549
+ {
550
+ "content": "952872416512",
551
+ "lstrip": false,
552
+ "normalized": false,
553
+ "rstrip": false,
554
+ "single_word": false
555
+ },
556
+ {
557
+ "content": "517778845323",
558
+ "lstrip": false,
559
+ "normalized": false,
560
+ "rstrip": false,
561
+ "single_word": false
562
+ },
563
+ {
564
+ "content": "749665846687",
565
+ "lstrip": false,
566
+ "normalized": false,
567
+ "rstrip": false,
568
+ "single_word": false
569
+ },
570
+ {
571
+ "content": "661436365453",
572
+ "lstrip": false,
573
+ "normalized": false,
574
+ "rstrip": false,
575
+ "single_word": false
576
+ },
577
+ {
578
+ "content": "259666844669",
579
+ "lstrip": false,
580
+ "normalized": false,
581
+ "rstrip": false,
582
+ "single_word": false
583
+ },
584
+ {
585
+ "content": "242851284913",
586
+ "lstrip": false,
587
+ "normalized": false,
588
+ "rstrip": false,
589
+ "single_word": false
590
+ },
591
+ {
592
+ "content": "514532995959",
593
+ "lstrip": false,
594
+ "normalized": false,
595
+ "rstrip": false,
596
+ "single_word": false
597
+ },
598
+ {
599
+ "content": "161588262349",
600
+ "lstrip": false,
601
+ "normalized": false,
602
+ "rstrip": false,
603
+ "single_word": false
604
+ },
605
+ {
606
+ "content": "742765629356",
607
+ "lstrip": false,
608
+ "normalized": false,
609
+ "rstrip": false,
610
+ "single_word": false
611
+ },
612
+ {
613
+ "content": "225164373623",
614
+ "lstrip": false,
615
+ "normalized": false,
616
+ "rstrip": false,
617
+ "single_word": false
618
+ },
619
+ {
620
+ "content": "676539973863",
621
+ "lstrip": false,
622
+ "normalized": false,
623
+ "rstrip": false,
624
+ "single_word": false
625
+ },
626
+ {
627
+ "content": "826214551218",
628
+ "lstrip": false,
629
+ "normalized": false,
630
+ "rstrip": false,
631
+ "single_word": false
632
+ },
633
+ {
634
+ "content": "182345464792",
635
+ "lstrip": false,
636
+ "normalized": false,
637
+ "rstrip": false,
638
+ "single_word": false
639
+ },
640
+ {
641
+ "content": "232776999554",
642
+ "lstrip": false,
643
+ "normalized": false,
644
+ "rstrip": false,
645
+ "single_word": false
646
+ },
647
+ {
648
+ "content": "337326533813",
649
+ "lstrip": false,
650
+ "normalized": false,
651
+ "rstrip": false,
652
+ "single_word": false
653
+ },
654
+ {
655
+ "content": "676676697292",
656
+ "lstrip": false,
657
+ "normalized": false,
658
+ "rstrip": false,
659
+ "single_word": false
660
+ },
661
+ {
662
+ "content": "929185622831",
663
+ "lstrip": false,
664
+ "normalized": false,
665
+ "rstrip": false,
666
+ "single_word": false
667
+ },
668
+ {
669
+ "content": "545512344383",
670
+ "lstrip": false,
671
+ "normalized": false,
672
+ "rstrip": false,
673
+ "single_word": false
674
+ },
675
+ {
676
+ "content": "499444466686",
677
+ "lstrip": false,
678
+ "normalized": false,
679
+ "rstrip": false,
680
+ "single_word": false
681
+ },
682
+ {
683
+ "content": "314697386682",
684
+ "lstrip": false,
685
+ "normalized": false,
686
+ "rstrip": false,
687
+ "single_word": false
688
+ },
689
+ {
690
+ "content": "517379856925",
691
+ "lstrip": false,
692
+ "normalized": false,
693
+ "rstrip": false,
694
+ "single_word": false
695
+ },
696
+ {
697
+ "content": "379557332953",
698
+ "lstrip": false,
699
+ "normalized": false,
700
+ "rstrip": false,
701
+ "single_word": false
702
+ },
703
+ {
704
+ "content": "614797267726",
705
+ "lstrip": false,
706
+ "normalized": false,
707
+ "rstrip": false,
708
+ "single_word": false
709
+ },
710
+ {
711
+ "content": "429781429464",
712
+ "lstrip": false,
713
+ "normalized": false,
714
+ "rstrip": false,
715
+ "single_word": false
716
+ },
717
+ {
718
+ "content": "922466849763",
719
+ "lstrip": false,
720
+ "normalized": false,
721
+ "rstrip": false,
722
+ "single_word": false
723
+ },
724
+ {
725
+ "content": "721737645236",
726
+ "lstrip": false,
727
+ "normalized": false,
728
+ "rstrip": false,
729
+ "single_word": false
730
+ },
731
+ {
732
+ "content": "479227349997",
733
+ "lstrip": false,
734
+ "normalized": false,
735
+ "rstrip": false,
736
+ "single_word": false
737
+ },
738
+ {
739
+ "content": "136931728327",
740
+ "lstrip": false,
741
+ "normalized": false,
742
+ "rstrip": false,
743
+ "single_word": false
744
+ },
745
+ {
746
+ "content": "259533577263",
747
+ "lstrip": false,
748
+ "normalized": false,
749
+ "rstrip": false,
750
+ "single_word": false
751
+ },
752
+ {
753
+ "content": "488538864842",
754
+ "lstrip": false,
755
+ "normalized": false,
756
+ "rstrip": false,
757
+ "single_word": false
758
+ },
759
+ {
760
+ "content": "937495658852",
761
+ "lstrip": false,
762
+ "normalized": false,
763
+ "rstrip": false,
764
+ "single_word": false
765
+ },
766
+ {
767
+ "content": "489991411364",
768
+ "lstrip": false,
769
+ "normalized": false,
770
+ "rstrip": false,
771
+ "single_word": false
772
+ },
773
+ {
774
+ "content": "499148455254",
775
+ "lstrip": false,
776
+ "normalized": false,
777
+ "rstrip": false,
778
+ "single_word": false
779
+ },
780
+ {
781
+ "content": "441373944925",
782
+ "lstrip": false,
783
+ "normalized": false,
784
+ "rstrip": false,
785
+ "single_word": false
786
+ },
787
+ {
788
+ "content": "899151413682",
789
+ "lstrip": false,
790
+ "normalized": false,
791
+ "rstrip": false,
792
+ "single_word": false
793
+ },
794
+ {
795
+ "content": "467893531755",
796
+ "lstrip": false,
797
+ "normalized": false,
798
+ "rstrip": false,
799
+ "single_word": false
800
+ },
801
+ {
802
+ "content": "527117488925",
803
+ "lstrip": false,
804
+ "normalized": false,
805
+ "rstrip": false,
806
+ "single_word": false
807
+ },
808
+ {
809
+ "content": "928335588653",
810
+ "lstrip": false,
811
+ "normalized": false,
812
+ "rstrip": false,
813
+ "single_word": false
814
+ },
815
+ {
816
+ "content": "374439448821",
817
+ "lstrip": false,
818
+ "normalized": false,
819
+ "rstrip": false,
820
+ "single_word": false
821
+ },
822
+ {
823
+ "content": "879425227932",
824
+ "lstrip": false,
825
+ "normalized": false,
826
+ "rstrip": false,
827
+ "single_word": false
828
+ },
829
+ {
830
+ "content": "867678158885",
831
+ "lstrip": false,
832
+ "normalized": false,
833
+ "rstrip": false,
834
+ "single_word": false
835
+ },
836
+ {
837
+ "content": "399749397872",
838
+ "lstrip": false,
839
+ "normalized": false,
840
+ "rstrip": false,
841
+ "single_word": false
842
+ },
843
+ {
844
+ "content": "129693547287",
845
+ "lstrip": false,
846
+ "normalized": false,
847
+ "rstrip": false,
848
+ "single_word": false
849
+ },
850
+ {
851
+ "content": "689285841825",
852
+ "lstrip": false,
853
+ "normalized": false,
854
+ "rstrip": false,
855
+ "single_word": false
856
+ },
857
+ {
858
+ "content": "771619544974",
859
+ "lstrip": false,
860
+ "normalized": false,
861
+ "rstrip": false,
862
+ "single_word": false
863
+ },
864
+ {
865
+ "content": "724883568652",
866
+ "lstrip": false,
867
+ "normalized": false,
868
+ "rstrip": false,
869
+ "single_word": false
870
+ },
871
+ {
872
+ "content": "516968424863",
873
+ "lstrip": false,
874
+ "normalized": false,
875
+ "rstrip": false,
876
+ "single_word": false
877
+ },
878
+ {
879
+ "content": "733737988257",
880
+ "lstrip": false,
881
+ "normalized": false,
882
+ "rstrip": false,
883
+ "single_word": false
884
+ },
885
+ {
886
+ "content": "852347289392",
887
+ "lstrip": false,
888
+ "normalized": false,
889
+ "rstrip": false,
890
+ "single_word": false
891
+ },
892
+ {
893
+ "content": "296953381169",
894
+ "lstrip": false,
895
+ "normalized": false,
896
+ "rstrip": false,
897
+ "single_word": false
898
+ },
899
+ {
900
+ "content": "377273562477",
901
+ "lstrip": false,
902
+ "normalized": false,
903
+ "rstrip": false,
904
+ "single_word": false
905
+ },
906
+ {
907
+ "content": "262296912232",
908
+ "lstrip": false,
909
+ "normalized": false,
910
+ "rstrip": false,
911
+ "single_word": false
912
+ },
913
+ {
914
+ "content": "547149832394",
915
+ "lstrip": false,
916
+ "normalized": false,
917
+ "rstrip": false,
918
+ "single_word": false
919
+ },
920
+ {
921
+ "content": "298464134954",
922
+ "lstrip": false,
923
+ "normalized": false,
924
+ "rstrip": false,
925
+ "single_word": false
926
+ },
927
+ {
928
+ "content": "216667245274",
929
+ "lstrip": false,
930
+ "normalized": false,
931
+ "rstrip": false,
932
+ "single_word": false
933
+ },
934
+ {
935
+ "content": "843998562287",
936
+ "lstrip": false,
937
+ "normalized": false,
938
+ "rstrip": false,
939
+ "single_word": false
940
+ },
941
+ {
942
+ "content": "572154333646",
943
+ "lstrip": false,
944
+ "normalized": false,
945
+ "rstrip": false,
946
+ "single_word": false
947
+ },
948
+ {
949
+ "content": "124589118494",
950
+ "lstrip": false,
951
+ "normalized": false,
952
+ "rstrip": false,
953
+ "single_word": false
954
+ },
955
+ {
956
+ "content": "841824384614",
957
+ "lstrip": false,
958
+ "normalized": false,
959
+ "rstrip": false,
960
+ "single_word": false
961
+ },
962
+ {
963
+ "content": "232896526252",
964
+ "lstrip": false,
965
+ "normalized": false,
966
+ "rstrip": false,
967
+ "single_word": false
968
+ },
969
+ {
970
+ "content": "295448593321",
971
+ "lstrip": false,
972
+ "normalized": false,
973
+ "rstrip": false,
974
+ "single_word": false
975
+ },
976
+ {
977
+ "content": "123741461297",
978
+ "lstrip": false,
979
+ "normalized": false,
980
+ "rstrip": false,
981
+ "single_word": false
982
+ },
983
+ {
984
+ "content": "653573457168",
985
+ "lstrip": false,
986
+ "normalized": false,
987
+ "rstrip": false,
988
+ "single_word": false
989
+ },
990
+ {
991
+ "content": "196735786156",
992
+ "lstrip": false,
993
+ "normalized": false,
994
+ "rstrip": false,
995
+ "single_word": false
996
+ },
997
+ {
998
+ "content": "377338713663",
999
+ "lstrip": false,
1000
+ "normalized": false,
1001
+ "rstrip": false,
1002
+ "single_word": false
1003
+ },
1004
+ {
1005
+ "content": "964342468552",
1006
+ "lstrip": false,
1007
+ "normalized": false,
1008
+ "rstrip": false,
1009
+ "single_word": false
1010
+ },
1011
+ {
1012
+ "content": "586855179568",
1013
+ "lstrip": false,
1014
+ "normalized": false,
1015
+ "rstrip": false,
1016
+ "single_word": false
1017
+ },
1018
+ {
1019
+ "content": "484773717614",
1020
+ "lstrip": false,
1021
+ "normalized": false,
1022
+ "rstrip": false,
1023
+ "single_word": false
1024
+ },
1025
+ {
1026
+ "content": "894885246797",
1027
+ "lstrip": false,
1028
+ "normalized": false,
1029
+ "rstrip": false,
1030
+ "single_word": false
1031
+ },
1032
+ {
1033
+ "content": "677896358599",
1034
+ "lstrip": false,
1035
+ "normalized": false,
1036
+ "rstrip": false,
1037
+ "single_word": false
1038
+ },
1039
+ {
1040
+ "content": "848845611563",
1041
+ "lstrip": false,
1042
+ "normalized": false,
1043
+ "rstrip": false,
1044
+ "single_word": false
1045
+ },
1046
+ {
1047
+ "content": "851852651677",
1048
+ "lstrip": false,
1049
+ "normalized": false,
1050
+ "rstrip": false,
1051
+ "single_word": false
1052
+ },
1053
+ {
1054
+ "content": "398549545767",
1055
+ "lstrip": false,
1056
+ "normalized": false,
1057
+ "rstrip": false,
1058
+ "single_word": false
1059
+ },
1060
+ {
1061
+ "content": "454244839926",
1062
+ "lstrip": false,
1063
+ "normalized": false,
1064
+ "rstrip": false,
1065
+ "single_word": false
1066
+ },
1067
+ {
1068
+ "content": "799364566435",
1069
+ "lstrip": false,
1070
+ "normalized": false,
1071
+ "rstrip": false,
1072
+ "single_word": false
1073
+ },
1074
+ {
1075
+ "content": "967114116556",
1076
+ "lstrip": false,
1077
+ "normalized": false,
1078
+ "rstrip": false,
1079
+ "single_word": false
1080
+ },
1081
+ {
1082
+ "content": "817378986438",
1083
+ "lstrip": false,
1084
+ "normalized": false,
1085
+ "rstrip": false,
1086
+ "single_word": false
1087
+ },
1088
+ {
1089
+ "content": "233795848681",
1090
+ "lstrip": false,
1091
+ "normalized": false,
1092
+ "rstrip": false,
1093
+ "single_word": false
1094
+ },
1095
+ {
1096
+ "content": "824387273757",
1097
+ "lstrip": false,
1098
+ "normalized": false,
1099
+ "rstrip": false,
1100
+ "single_word": false
1101
+ },
1102
+ {
1103
+ "content": "916198946615",
1104
+ "lstrip": false,
1105
+ "normalized": false,
1106
+ "rstrip": false,
1107
+ "single_word": false
1108
+ },
1109
+ {
1110
+ "content": "563117729724",
1111
+ "lstrip": false,
1112
+ "normalized": false,
1113
+ "rstrip": false,
1114
+ "single_word": false
1115
+ },
1116
+ {
1117
+ "content": "951794811935",
1118
+ "lstrip": false,
1119
+ "normalized": false,
1120
+ "rstrip": false,
1121
+ "single_word": false
1122
+ },
1123
+ {
1124
+ "content": "374598961236",
1125
+ "lstrip": false,
1126
+ "normalized": false,
1127
+ "rstrip": false,
1128
+ "single_word": false
1129
+ },
1130
+ {
1131
+ "content": "922867396683",
1132
+ "lstrip": false,
1133
+ "normalized": false,
1134
+ "rstrip": false,
1135
+ "single_word": false
1136
+ },
1137
+ {
1138
+ "content": "765737843639",
1139
+ "lstrip": false,
1140
+ "normalized": false,
1141
+ "rstrip": false,
1142
+ "single_word": false
1143
+ },
1144
+ {
1145
+ "content": "175469284871",
1146
+ "lstrip": false,
1147
+ "normalized": false,
1148
+ "rstrip": false,
1149
+ "single_word": false
1150
+ },
1151
+ {
1152
+ "content": "231853711778",
1153
+ "lstrip": false,
1154
+ "normalized": false,
1155
+ "rstrip": false,
1156
+ "single_word": false
1157
+ },
1158
+ {
1159
+ "content": "662426712668",
1160
+ "lstrip": false,
1161
+ "normalized": false,
1162
+ "rstrip": false,
1163
+ "single_word": false
1164
+ },
1165
+ {
1166
+ "content": "711412347158",
1167
+ "lstrip": false,
1168
+ "normalized": false,
1169
+ "rstrip": false,
1170
+ "single_word": false
1171
+ },
1172
+ {
1173
+ "content": "753466987363",
1174
+ "lstrip": false,
1175
+ "normalized": false,
1176
+ "rstrip": false,
1177
+ "single_word": false
1178
+ },
1179
+ {
1180
+ "content": "513361312532",
1181
+ "lstrip": false,
1182
+ "normalized": false,
1183
+ "rstrip": false,
1184
+ "single_word": false
1185
+ },
1186
+ {
1187
+ "content": "712992815957",
1188
+ "lstrip": false,
1189
+ "normalized": false,
1190
+ "rstrip": false,
1191
+ "single_word": false
1192
+ },
1193
+ {
1194
+ "content": "971621888444",
1195
+ "lstrip": false,
1196
+ "normalized": false,
1197
+ "rstrip": false,
1198
+ "single_word": false
1199
+ },
1200
+ {
1201
+ "content": "829235161526",
1202
+ "lstrip": false,
1203
+ "normalized": false,
1204
+ "rstrip": false,
1205
+ "single_word": false
1206
+ },
1207
+ {
1208
+ "content": "585544633356",
1209
+ "lstrip": false,
1210
+ "normalized": false,
1211
+ "rstrip": false,
1212
+ "single_word": false
1213
+ },
1214
+ {
1215
+ "content": "582471228164",
1216
+ "lstrip": false,
1217
+ "normalized": false,
1218
+ "rstrip": false,
1219
+ "single_word": false
1220
+ },
1221
+ {
1222
+ "content": "678666359123",
1223
+ "lstrip": false,
1224
+ "normalized": false,
1225
+ "rstrip": false,
1226
+ "single_word": false
1227
+ },
1228
+ {
1229
+ "content": "557533689478",
1230
+ "lstrip": false,
1231
+ "normalized": false,
1232
+ "rstrip": false,
1233
+ "single_word": false
1234
+ },
1235
+ {
1236
+ "content": "632962475133",
1237
+ "lstrip": false,
1238
+ "normalized": false,
1239
+ "rstrip": false,
1240
+ "single_word": false
1241
+ },
1242
+ {
1243
+ "content": "484489193824",
1244
+ "lstrip": false,
1245
+ "normalized": false,
1246
+ "rstrip": false,
1247
+ "single_word": false
1248
+ },
1249
+ {
1250
+ "content": "489562189822",
1251
+ "lstrip": false,
1252
+ "normalized": false,
1253
+ "rstrip": false,
1254
+ "single_word": false
1255
+ },
1256
+ {
1257
+ "content": "589547936288",
1258
+ "lstrip": false,
1259
+ "normalized": false,
1260
+ "rstrip": false,
1261
+ "single_word": false
1262
+ },
1263
+ {
1264
+ "content": "363214487524",
1265
+ "lstrip": false,
1266
+ "normalized": false,
1267
+ "rstrip": false,
1268
+ "single_word": false
1269
+ },
1270
+ {
1271
+ "content": "244885399387",
1272
+ "lstrip": false,
1273
+ "normalized": false,
1274
+ "rstrip": false,
1275
+ "single_word": false
1276
+ },
1277
+ {
1278
+ "content": "431751228368",
1279
+ "lstrip": false,
1280
+ "normalized": false,
1281
+ "rstrip": false,
1282
+ "single_word": false
1283
+ },
1284
+ {
1285
+ "content": "433581868192",
1286
+ "lstrip": false,
1287
+ "normalized": false,
1288
+ "rstrip": false,
1289
+ "single_word": false
1290
+ },
1291
+ {
1292
+ "content": "486391569221",
1293
+ "lstrip": false,
1294
+ "normalized": false,
1295
+ "rstrip": false,
1296
+ "single_word": false
1297
+ },
1298
+ {
1299
+ "content": "185438575221",
1300
+ "lstrip": false,
1301
+ "normalized": false,
1302
+ "rstrip": false,
1303
+ "single_word": false
1304
+ },
1305
+ {
1306
+ "content": "126574388585",
1307
+ "lstrip": false,
1308
+ "normalized": false,
1309
+ "rstrip": false,
1310
+ "single_word": false
1311
+ },
1312
+ {
1313
+ "content": "741757479784",
1314
+ "lstrip": false,
1315
+ "normalized": false,
1316
+ "rstrip": false,
1317
+ "single_word": false
1318
+ },
1319
+ {
1320
+ "content": "529854679937",
1321
+ "lstrip": false,
1322
+ "normalized": false,
1323
+ "rstrip": false,
1324
+ "single_word": false
1325
+ },
1326
+ {
1327
+ "content": "996116119839",
1328
+ "lstrip": false,
1329
+ "normalized": false,
1330
+ "rstrip": false,
1331
+ "single_word": false
1332
+ },
1333
+ {
1334
+ "content": "616248973917",
1335
+ "lstrip": false,
1336
+ "normalized": false,
1337
+ "rstrip": false,
1338
+ "single_word": false
1339
+ },
1340
+ {
1341
+ "content": "763531783491",
1342
+ "lstrip": false,
1343
+ "normalized": false,
1344
+ "rstrip": false,
1345
+ "single_word": false
1346
+ },
1347
+ {
1348
+ "content": "955456118295",
1349
+ "lstrip": false,
1350
+ "normalized": false,
1351
+ "rstrip": false,
1352
+ "single_word": false
1353
+ },
1354
+ {
1355
+ "content": "364196983365",
1356
+ "lstrip": false,
1357
+ "normalized": false,
1358
+ "rstrip": false,
1359
+ "single_word": false
1360
+ },
1361
+ {
1362
+ "content": "195792996468",
1363
+ "lstrip": false,
1364
+ "normalized": false,
1365
+ "rstrip": false,
1366
+ "single_word": false
1367
+ },
1368
+ {
1369
+ "content": "151859598873",
1370
+ "lstrip": false,
1371
+ "normalized": false,
1372
+ "rstrip": false,
1373
+ "single_word": false
1374
+ },
1375
+ {
1376
+ "content": "399223169721",
1377
+ "lstrip": false,
1378
+ "normalized": false,
1379
+ "rstrip": false,
1380
+ "single_word": false
1381
+ },
1382
+ {
1383
+ "content": "938488813964",
1384
+ "lstrip": false,
1385
+ "normalized": false,
1386
+ "rstrip": false,
1387
+ "single_word": false
1388
+ },
1389
+ {
1390
+ "content": "961981959227",
1391
+ "lstrip": false,
1392
+ "normalized": false,
1393
+ "rstrip": false,
1394
+ "single_word": false
1395
+ },
1396
+ {
1397
+ "content": "183368827562",
1398
+ "lstrip": false,
1399
+ "normalized": false,
1400
+ "rstrip": false,
1401
+ "single_word": false
1402
+ },
1403
+ {
1404
+ "content": "533417736566",
1405
+ "lstrip": false,
1406
+ "normalized": false,
1407
+ "rstrip": false,
1408
+ "single_word": false
1409
+ },
1410
+ {
1411
+ "content": "786391632558",
1412
+ "lstrip": false,
1413
+ "normalized": false,
1414
+ "rstrip": false,
1415
+ "single_word": false
1416
+ },
1417
+ {
1418
+ "content": "665661658354",
1419
+ "lstrip": false,
1420
+ "normalized": false,
1421
+ "rstrip": false,
1422
+ "single_word": false
1423
+ },
1424
+ {
1425
+ "content": "693281533643",
1426
+ "lstrip": false,
1427
+ "normalized": false,
1428
+ "rstrip": false,
1429
+ "single_word": false
1430
+ },
1431
+ {
1432
+ "content": "475794684356",
1433
+ "lstrip": false,
1434
+ "normalized": false,
1435
+ "rstrip": false,
1436
+ "single_word": false
1437
+ },
1438
+ {
1439
+ "content": "652154162978",
1440
+ "lstrip": false,
1441
+ "normalized": false,
1442
+ "rstrip": false,
1443
+ "single_word": false
1444
+ },
1445
+ {
1446
+ "content": "753233719644",
1447
+ "lstrip": false,
1448
+ "normalized": false,
1449
+ "rstrip": false,
1450
+ "single_word": false
1451
+ },
1452
+ {
1453
+ "content": "668514843129",
1454
+ "lstrip": false,
1455
+ "normalized": false,
1456
+ "rstrip": false,
1457
+ "single_word": false
1458
+ },
1459
+ {
1460
+ "content": "819162623892",
1461
+ "lstrip": false,
1462
+ "normalized": false,
1463
+ "rstrip": false,
1464
+ "single_word": false
1465
+ },
1466
+ {
1467
+ "content": "941169431859",
1468
+ "lstrip": false,
1469
+ "normalized": false,
1470
+ "rstrip": false,
1471
+ "single_word": false
1472
+ },
1473
+ {
1474
+ "content": "877385381798",
1475
+ "lstrip": false,
1476
+ "normalized": false,
1477
+ "rstrip": false,
1478
+ "single_word": false
1479
+ },
1480
+ {
1481
+ "content": "752644929761",
1482
+ "lstrip": false,
1483
+ "normalized": false,
1484
+ "rstrip": false,
1485
+ "single_word": false
1486
+ },
1487
+ {
1488
+ "content": "881136466196",
1489
+ "lstrip": false,
1490
+ "normalized": false,
1491
+ "rstrip": false,
1492
+ "single_word": false
1493
+ },
1494
+ {
1495
+ "content": "275597777299",
1496
+ "lstrip": false,
1497
+ "normalized": false,
1498
+ "rstrip": false,
1499
+ "single_word": false
1500
+ },
1501
+ {
1502
+ "content": "731681792655",
1503
+ "lstrip": false,
1504
+ "normalized": false,
1505
+ "rstrip": false,
1506
+ "single_word": false
1507
+ },
1508
+ {
1509
+ "content": "961133895172",
1510
+ "lstrip": false,
1511
+ "normalized": false,
1512
+ "rstrip": false,
1513
+ "single_word": false
1514
+ },
1515
+ {
1516
+ "content": "864718285734",
1517
+ "lstrip": false,
1518
+ "normalized": false,
1519
+ "rstrip": false,
1520
+ "single_word": false
1521
+ },
1522
+ {
1523
+ "content": "963852916563",
1524
+ "lstrip": false,
1525
+ "normalized": false,
1526
+ "rstrip": false,
1527
+ "single_word": false
1528
+ },
1529
+ {
1530
+ "content": "319584985416",
1531
+ "lstrip": false,
1532
+ "normalized": false,
1533
+ "rstrip": false,
1534
+ "single_word": false
1535
+ },
1536
+ {
1537
+ "content": "563365646341",
1538
+ "lstrip": false,
1539
+ "normalized": false,
1540
+ "rstrip": false,
1541
+ "single_word": false
1542
+ },
1543
+ {
1544
+ "content": "811371928234",
1545
+ "lstrip": false,
1546
+ "normalized": false,
1547
+ "rstrip": false,
1548
+ "single_word": false
1549
+ },
1550
+ {
1551
+ "content": "837131396371",
1552
+ "lstrip": false,
1553
+ "normalized": false,
1554
+ "rstrip": false,
1555
+ "single_word": false
1556
+ },
1557
+ {
1558
+ "content": "267514771964",
1559
+ "lstrip": false,
1560
+ "normalized": false,
1561
+ "rstrip": false,
1562
+ "single_word": false
1563
+ },
1564
+ {
1565
+ "content": "944513428457",
1566
+ "lstrip": false,
1567
+ "normalized": false,
1568
+ "rstrip": false,
1569
+ "single_word": false
1570
+ },
1571
+ {
1572
+ "content": "117298239631",
1573
+ "lstrip": false,
1574
+ "normalized": false,
1575
+ "rstrip": false,
1576
+ "single_word": false
1577
+ },
1578
+ {
1579
+ "content": "158142752582",
1580
+ "lstrip": false,
1581
+ "normalized": false,
1582
+ "rstrip": false,
1583
+ "single_word": false
1584
+ },
1585
+ {
1586
+ "content": "252867443568",
1587
+ "lstrip": false,
1588
+ "normalized": false,
1589
+ "rstrip": false,
1590
+ "single_word": false
1591
+ },
1592
+ {
1593
+ "content": "839269684865",
1594
+ "lstrip": false,
1595
+ "normalized": false,
1596
+ "rstrip": false,
1597
+ "single_word": false
1598
+ },
1599
+ {
1600
+ "content": "612788593128",
1601
+ "lstrip": false,
1602
+ "normalized": false,
1603
+ "rstrip": false,
1604
+ "single_word": false
1605
+ },
1606
+ {
1607
+ "content": "145669731981",
1608
+ "lstrip": false,
1609
+ "normalized": false,
1610
+ "rstrip": false,
1611
+ "single_word": false
1612
+ },
1613
+ {
1614
+ "content": "121557291859",
1615
+ "lstrip": false,
1616
+ "normalized": false,
1617
+ "rstrip": false,
1618
+ "single_word": false
1619
+ },
1620
+ {
1621
+ "content": "245416776926",
1622
+ "lstrip": false,
1623
+ "normalized": false,
1624
+ "rstrip": false,
1625
+ "single_word": false
1626
+ },
1627
+ {
1628
+ "content": "799417897197",
1629
+ "lstrip": false,
1630
+ "normalized": false,
1631
+ "rstrip": false,
1632
+ "single_word": false
1633
+ },
1634
+ {
1635
+ "content": "997958836435",
1636
+ "lstrip": false,
1637
+ "normalized": false,
1638
+ "rstrip": false,
1639
+ "single_word": false
1640
+ },
1641
+ {
1642
+ "content": "892336777248",
1643
+ "lstrip": false,
1644
+ "normalized": false,
1645
+ "rstrip": false,
1646
+ "single_word": false
1647
+ },
1648
+ {
1649
+ "content": "158929292238",
1650
+ "lstrip": false,
1651
+ "normalized": false,
1652
+ "rstrip": false,
1653
+ "single_word": false
1654
+ },
1655
+ {
1656
+ "content": "581976444672",
1657
+ "lstrip": false,
1658
+ "normalized": false,
1659
+ "rstrip": false,
1660
+ "single_word": false
1661
+ },
1662
+ {
1663
+ "content": "897784492783",
1664
+ "lstrip": false,
1665
+ "normalized": false,
1666
+ "rstrip": false,
1667
+ "single_word": false
1668
+ },
1669
+ {
1670
+ "content": "492373714791",
1671
+ "lstrip": false,
1672
+ "normalized": false,
1673
+ "rstrip": false,
1674
+ "single_word": false
1675
+ },
1676
+ {
1677
+ "content": "512659818733",
1678
+ "lstrip": false,
1679
+ "normalized": false,
1680
+ "rstrip": false,
1681
+ "single_word": false
1682
+ },
1683
+ {
1684
+ "content": "881112998642",
1685
+ "lstrip": false,
1686
+ "normalized": false,
1687
+ "rstrip": false,
1688
+ "single_word": false
1689
+ },
1690
+ {
1691
+ "content": "619454958782",
1692
+ "lstrip": false,
1693
+ "normalized": false,
1694
+ "rstrip": false,
1695
+ "single_word": false
1696
+ },
1697
+ {
1698
+ "content": "431149748713",
1699
+ "lstrip": false,
1700
+ "normalized": false,
1701
+ "rstrip": false,
1702
+ "single_word": false
1703
+ },
1704
+ {
1705
+ "content": "624221476921",
1706
+ "lstrip": false,
1707
+ "normalized": false,
1708
+ "rstrip": false,
1709
+ "single_word": false
1710
+ },
1711
+ {
1712
+ "content": "125866399464",
1713
+ "lstrip": false,
1714
+ "normalized": false,
1715
+ "rstrip": false,
1716
+ "single_word": false
1717
+ },
1718
+ {
1719
+ "content": "339882449689",
1720
+ "lstrip": false,
1721
+ "normalized": false,
1722
+ "rstrip": false,
1723
+ "single_word": false
1724
+ },
1725
+ {
1726
+ "content": "186198784585",
1727
+ "lstrip": false,
1728
+ "normalized": false,
1729
+ "rstrip": false,
1730
+ "single_word": false
1731
+ },
1732
+ {
1733
+ "content": "943193294691",
1734
+ "lstrip": false,
1735
+ "normalized": false,
1736
+ "rstrip": false,
1737
+ "single_word": false
1738
+ },
1739
+ {
1740
+ "content": "955668961269",
1741
+ "lstrip": false,
1742
+ "normalized": false,
1743
+ "rstrip": false,
1744
+ "single_word": false
1745
+ },
1746
+ {
1747
+ "content": "232787996724",
1748
+ "lstrip": false,
1749
+ "normalized": false,
1750
+ "rstrip": false,
1751
+ "single_word": false
1752
+ },
1753
+ {
1754
+ "content": "215671314196",
1755
+ "lstrip": false,
1756
+ "normalized": false,
1757
+ "rstrip": false,
1758
+ "single_word": false
1759
+ },
1760
+ {
1761
+ "content": "286173241916",
1762
+ "lstrip": false,
1763
+ "normalized": false,
1764
+ "rstrip": false,
1765
+ "single_word": false
1766
+ },
1767
+ {
1768
+ "content": "745977673725",
1769
+ "lstrip": false,
1770
+ "normalized": false,
1771
+ "rstrip": false,
1772
+ "single_word": false
1773
+ },
1774
+ {
1775
+ "content": "556976448182",
1776
+ "lstrip": false,
1777
+ "normalized": false,
1778
+ "rstrip": false,
1779
+ "single_word": false
1780
+ },
1781
+ {
1782
+ "content": "599961512792",
1783
+ "lstrip": false,
1784
+ "normalized": false,
1785
+ "rstrip": false,
1786
+ "single_word": false
1787
+ },
1788
+ {
1789
+ "content": "766294538337",
1790
+ "lstrip": false,
1791
+ "normalized": false,
1792
+ "rstrip": false,
1793
+ "single_word": false
1794
+ },
1795
+ {
1796
+ "content": "934912591213",
1797
+ "lstrip": false,
1798
+ "normalized": false,
1799
+ "rstrip": false,
1800
+ "single_word": false
1801
+ },
1802
+ {
1803
+ "content": "295118729589",
1804
+ "lstrip": false,
1805
+ "normalized": false,
1806
+ "rstrip": false,
1807
+ "single_word": false
1808
+ },
1809
+ {
1810
+ "content": "529455466433",
1811
+ "lstrip": false,
1812
+ "normalized": false,
1813
+ "rstrip": false,
1814
+ "single_word": false
1815
+ },
1816
+ {
1817
+ "content": "196119929397",
1818
+ "lstrip": false,
1819
+ "normalized": false,
1820
+ "rstrip": false,
1821
+ "single_word": false
1822
+ },
1823
+ {
1824
+ "content": "379571934299",
1825
+ "lstrip": false,
1826
+ "normalized": false,
1827
+ "rstrip": false,
1828
+ "single_word": false
1829
+ },
1830
+ {
1831
+ "content": "251789649997",
1832
+ "lstrip": false,
1833
+ "normalized": false,
1834
+ "rstrip": false,
1835
+ "single_word": false
1836
+ },
1837
+ {
1838
+ "content": "564544131355",
1839
+ "lstrip": false,
1840
+ "normalized": false,
1841
+ "rstrip": false,
1842
+ "single_word": false
1843
+ },
1844
+ {
1845
+ "content": "244371196654",
1846
+ "lstrip": false,
1847
+ "normalized": false,
1848
+ "rstrip": false,
1849
+ "single_word": false
1850
+ },
1851
+ {
1852
+ "content": "384598329253",
1853
+ "lstrip": false,
1854
+ "normalized": false,
1855
+ "rstrip": false,
1856
+ "single_word": false
1857
+ },
1858
+ {
1859
+ "content": "887753195844",
1860
+ "lstrip": false,
1861
+ "normalized": false,
1862
+ "rstrip": false,
1863
+ "single_word": false
1864
+ },
1865
+ {
1866
+ "content": "364947325679",
1867
+ "lstrip": false,
1868
+ "normalized": false,
1869
+ "rstrip": false,
1870
+ "single_word": false
1871
+ },
1872
+ {
1873
+ "content": "655517954651",
1874
+ "lstrip": false,
1875
+ "normalized": false,
1876
+ "rstrip": false,
1877
+ "single_word": false
1878
+ },
1879
+ {
1880
+ "content": "673948786567",
1881
+ "lstrip": false,
1882
+ "normalized": false,
1883
+ "rstrip": false,
1884
+ "single_word": false
1885
+ },
1886
+ {
1887
+ "content": "857231548835",
1888
+ "lstrip": false,
1889
+ "normalized": false,
1890
+ "rstrip": false,
1891
+ "single_word": false
1892
+ },
1893
+ {
1894
+ "content": "816115936673",
1895
+ "lstrip": false,
1896
+ "normalized": false,
1897
+ "rstrip": false,
1898
+ "single_word": false
1899
+ },
1900
+ {
1901
+ "content": "644234165531",
1902
+ "lstrip": false,
1903
+ "normalized": false,
1904
+ "rstrip": false,
1905
+ "single_word": false
1906
+ },
1907
+ {
1908
+ "content": "182782912224",
1909
+ "lstrip": false,
1910
+ "normalized": false,
1911
+ "rstrip": false,
1912
+ "single_word": false
1913
+ },
1914
+ {
1915
+ "content": "234316622259",
1916
+ "lstrip": false,
1917
+ "normalized": false,
1918
+ "rstrip": false,
1919
+ "single_word": false
1920
+ },
1921
+ {
1922
+ "content": "421369185549",
1923
+ "lstrip": false,
1924
+ "normalized": false,
1925
+ "rstrip": false,
1926
+ "single_word": false
1927
+ },
1928
+ {
1929
+ "content": "434632855397",
1930
+ "lstrip": false,
1931
+ "normalized": false,
1932
+ "rstrip": false,
1933
+ "single_word": false
1934
+ },
1935
+ {
1936
+ "content": "921889371893",
1937
+ "lstrip": false,
1938
+ "normalized": false,
1939
+ "rstrip": false,
1940
+ "single_word": false
1941
+ },
1942
+ {
1943
+ "content": "415956914763",
1944
+ "lstrip": false,
1945
+ "normalized": false,
1946
+ "rstrip": false,
1947
+ "single_word": false
1948
+ },
1949
+ {
1950
+ "content": "598916996413",
1951
+ "lstrip": false,
1952
+ "normalized": false,
1953
+ "rstrip": false,
1954
+ "single_word": false
1955
+ },
1956
+ {
1957
+ "content": "773671349113",
1958
+ "lstrip": false,
1959
+ "normalized": false,
1960
+ "rstrip": false,
1961
+ "single_word": false
1962
+ },
1963
+ {
1964
+ "content": "952465217972",
1965
+ "lstrip": false,
1966
+ "normalized": false,
1967
+ "rstrip": false,
1968
+ "single_word": false
1969
+ },
1970
+ {
1971
+ "content": "117657531962",
1972
+ "lstrip": false,
1973
+ "normalized": false,
1974
+ "rstrip": false,
1975
+ "single_word": false
1976
+ },
1977
+ {
1978
+ "content": "729825168745",
1979
+ "lstrip": false,
1980
+ "normalized": false,
1981
+ "rstrip": false,
1982
+ "single_word": false
1983
+ },
1984
+ {
1985
+ "content": "691315125346",
1986
+ "lstrip": false,
1987
+ "normalized": false,
1988
+ "rstrip": false,
1989
+ "single_word": false
1990
+ },
1991
+ {
1992
+ "content": "768461952319",
1993
+ "lstrip": false,
1994
+ "normalized": false,
1995
+ "rstrip": false,
1996
+ "single_word": false
1997
+ },
1998
+ {
1999
+ "content": "664847713559",
2000
+ "lstrip": false,
2001
+ "normalized": false,
2002
+ "rstrip": false,
2003
+ "single_word": false
2004
+ },
2005
+ {
2006
+ "content": "953267689786",
2007
+ "lstrip": false,
2008
+ "normalized": false,
2009
+ "rstrip": false,
2010
+ "single_word": false
2011
+ },
2012
+ {
2013
+ "content": "886464195129",
2014
+ "lstrip": false,
2015
+ "normalized": false,
2016
+ "rstrip": false,
2017
+ "single_word": false
2018
+ },
2019
+ {
2020
+ "content": "824488329416",
2021
+ "lstrip": false,
2022
+ "normalized": false,
2023
+ "rstrip": false,
2024
+ "single_word": false
2025
+ },
2026
+ {
2027
+ "content": "837873762491",
2028
+ "lstrip": false,
2029
+ "normalized": false,
2030
+ "rstrip": false,
2031
+ "single_word": false
2032
+ },
2033
+ {
2034
+ "content": "532833541879",
2035
+ "lstrip": false,
2036
+ "normalized": false,
2037
+ "rstrip": false,
2038
+ "single_word": false
2039
+ },
2040
+ {
2041
+ "content": "669183782449",
2042
+ "lstrip": false,
2043
+ "normalized": false,
2044
+ "rstrip": false,
2045
+ "single_word": false
2046
+ },
2047
+ {
2048
+ "content": "941976537588",
2049
+ "lstrip": false,
2050
+ "normalized": false,
2051
+ "rstrip": false,
2052
+ "single_word": false
2053
+ },
2054
+ {
2055
+ "content": "739394546916",
2056
+ "lstrip": false,
2057
+ "normalized": false,
2058
+ "rstrip": false,
2059
+ "single_word": false
2060
+ },
2061
+ {
2062
+ "content": "267954879268",
2063
+ "lstrip": false,
2064
+ "normalized": false,
2065
+ "rstrip": false,
2066
+ "single_word": false
2067
+ },
2068
+ {
2069
+ "content": "637551427887",
2070
+ "lstrip": false,
2071
+ "normalized": false,
2072
+ "rstrip": false,
2073
+ "single_word": false
2074
+ },
2075
+ {
2076
+ "content": "217756494954",
2077
+ "lstrip": false,
2078
+ "normalized": false,
2079
+ "rstrip": false,
2080
+ "single_word": false
2081
+ },
2082
+ {
2083
+ "content": "524444658383",
2084
+ "lstrip": false,
2085
+ "normalized": false,
2086
+ "rstrip": false,
2087
+ "single_word": false
2088
+ },
2089
+ {
2090
+ "content": "117783274348",
2091
+ "lstrip": false,
2092
+ "normalized": false,
2093
+ "rstrip": false,
2094
+ "single_word": false
2095
+ },
2096
+ {
2097
+ "content": "138218735276",
2098
+ "lstrip": false,
2099
+ "normalized": false,
2100
+ "rstrip": false,
2101
+ "single_word": false
2102
+ },
2103
+ {
2104
+ "content": "814611949491",
2105
+ "lstrip": false,
2106
+ "normalized": false,
2107
+ "rstrip": false,
2108
+ "single_word": false
2109
+ },
2110
+ {
2111
+ "content": "711641973413",
2112
+ "lstrip": false,
2113
+ "normalized": false,
2114
+ "rstrip": false,
2115
+ "single_word": false
2116
+ },
2117
+ {
2118
+ "content": "499156317423",
2119
+ "lstrip": false,
2120
+ "normalized": false,
2121
+ "rstrip": false,
2122
+ "single_word": false
2123
+ },
2124
+ {
2125
+ "content": "515856611931",
2126
+ "lstrip": false,
2127
+ "normalized": false,
2128
+ "rstrip": false,
2129
+ "single_word": false
2130
+ },
2131
+ {
2132
+ "content": "454164859837",
2133
+ "lstrip": false,
2134
+ "normalized": false,
2135
+ "rstrip": false,
2136
+ "single_word": false
2137
+ },
2138
+ {
2139
+ "content": "345271433112",
2140
+ "lstrip": false,
2141
+ "normalized": false,
2142
+ "rstrip": false,
2143
+ "single_word": false
2144
+ },
2145
+ {
2146
+ "content": "462294118988",
2147
+ "lstrip": false,
2148
+ "normalized": false,
2149
+ "rstrip": false,
2150
+ "single_word": false
2151
+ },
2152
+ {
2153
+ "content": "511785788222",
2154
+ "lstrip": false,
2155
+ "normalized": false,
2156
+ "rstrip": false,
2157
+ "single_word": false
2158
+ },
2159
+ {
2160
+ "content": "497294727353",
2161
+ "lstrip": false,
2162
+ "normalized": false,
2163
+ "rstrip": false,
2164
+ "single_word": false
2165
+ },
2166
+ {
2167
+ "content": "866519986723",
2168
+ "lstrip": false,
2169
+ "normalized": false,
2170
+ "rstrip": false,
2171
+ "single_word": false
2172
+ },
2173
+ {
2174
+ "content": "334513529294",
2175
+ "lstrip": false,
2176
+ "normalized": false,
2177
+ "rstrip": false,
2178
+ "single_word": false
2179
+ },
2180
+ {
2181
+ "content": "549946382131",
2182
+ "lstrip": false,
2183
+ "normalized": false,
2184
+ "rstrip": false,
2185
+ "single_word": false
2186
+ },
2187
+ {
2188
+ "content": "284445431422",
2189
+ "lstrip": false,
2190
+ "normalized": false,
2191
+ "rstrip": false,
2192
+ "single_word": false
2193
+ },
2194
+ {
2195
+ "content": "396521188476",
2196
+ "lstrip": false,
2197
+ "normalized": false,
2198
+ "rstrip": false,
2199
+ "single_word": false
2200
+ },
2201
+ {
2202
+ "content": "421435255895",
2203
+ "lstrip": false,
2204
+ "normalized": false,
2205
+ "rstrip": false,
2206
+ "single_word": false
2207
+ },
2208
+ {
2209
+ "content": "133373659361",
2210
+ "lstrip": false,
2211
+ "normalized": false,
2212
+ "rstrip": false,
2213
+ "single_word": false
2214
+ },
2215
+ {
2216
+ "content": "322683334381",
2217
+ "lstrip": false,
2218
+ "normalized": false,
2219
+ "rstrip": false,
2220
+ "single_word": false
2221
+ },
2222
+ {
2223
+ "content": "228358422847",
2224
+ "lstrip": false,
2225
+ "normalized": false,
2226
+ "rstrip": false,
2227
+ "single_word": false
2228
+ },
2229
+ {
2230
+ "content": "291762694874",
2231
+ "lstrip": false,
2232
+ "normalized": false,
2233
+ "rstrip": false,
2234
+ "single_word": false
2235
+ },
2236
+ {
2237
+ "content": "143182978129",
2238
+ "lstrip": false,
2239
+ "normalized": false,
2240
+ "rstrip": false,
2241
+ "single_word": false
2242
+ },
2243
+ {
2244
+ "content": "511923256573",
2245
+ "lstrip": false,
2246
+ "normalized": false,
2247
+ "rstrip": false,
2248
+ "single_word": false
2249
+ },
2250
+ {
2251
+ "content": "327158398268",
2252
+ "lstrip": false,
2253
+ "normalized": false,
2254
+ "rstrip": false,
2255
+ "single_word": false
2256
+ },
2257
+ {
2258
+ "content": "879764613759",
2259
+ "lstrip": false,
2260
+ "normalized": false,
2261
+ "rstrip": false,
2262
+ "single_word": false
2263
+ },
2264
+ {
2265
+ "content": "564395222747",
2266
+ "lstrip": false,
2267
+ "normalized": false,
2268
+ "rstrip": false,
2269
+ "single_word": false
2270
+ },
2271
+ {
2272
+ "content": "451161679736",
2273
+ "lstrip": false,
2274
+ "normalized": false,
2275
+ "rstrip": false,
2276
+ "single_word": false
2277
+ },
2278
+ {
2279
+ "content": "538631466654",
2280
+ "lstrip": false,
2281
+ "normalized": false,
2282
+ "rstrip": false,
2283
+ "single_word": false
2284
+ },
2285
+ {
2286
+ "content": "221762325616",
2287
+ "lstrip": false,
2288
+ "normalized": false,
2289
+ "rstrip": false,
2290
+ "single_word": false
2291
+ },
2292
+ {
2293
+ "content": "218391991184",
2294
+ "lstrip": false,
2295
+ "normalized": false,
2296
+ "rstrip": false,
2297
+ "single_word": false
2298
+ },
2299
+ {
2300
+ "content": "322589379462",
2301
+ "lstrip": false,
2302
+ "normalized": false,
2303
+ "rstrip": false,
2304
+ "single_word": false
2305
+ },
2306
+ {
2307
+ "content": "876537814263",
2308
+ "lstrip": false,
2309
+ "normalized": false,
2310
+ "rstrip": false,
2311
+ "single_word": false
2312
+ },
2313
+ {
2314
+ "content": "152676556624",
2315
+ "lstrip": false,
2316
+ "normalized": false,
2317
+ "rstrip": false,
2318
+ "single_word": false
2319
+ },
2320
+ {
2321
+ "content": "332522971941",
2322
+ "lstrip": false,
2323
+ "normalized": false,
2324
+ "rstrip": false,
2325
+ "single_word": false
2326
+ },
2327
+ {
2328
+ "content": "884354318946",
2329
+ "lstrip": false,
2330
+ "normalized": false,
2331
+ "rstrip": false,
2332
+ "single_word": false
2333
+ },
2334
+ {
2335
+ "content": "513349618943",
2336
+ "lstrip": false,
2337
+ "normalized": false,
2338
+ "rstrip": false,
2339
+ "single_word": false
2340
+ },
2341
+ {
2342
+ "content": "116639746413",
2343
+ "lstrip": false,
2344
+ "normalized": false,
2345
+ "rstrip": false,
2346
+ "single_word": false
2347
+ },
2348
+ {
2349
+ "content": "635185846287",
2350
+ "lstrip": false,
2351
+ "normalized": false,
2352
+ "rstrip": false,
2353
+ "single_word": false
2354
+ },
2355
+ {
2356
+ "content": "993832498489",
2357
+ "lstrip": false,
2358
+ "normalized": false,
2359
+ "rstrip": false,
2360
+ "single_word": false
2361
+ },
2362
+ {
2363
+ "content": "813981174797",
2364
+ "lstrip": false,
2365
+ "normalized": false,
2366
+ "rstrip": false,
2367
+ "single_word": false
2368
+ },
2369
+ {
2370
+ "content": "438745114173",
2371
+ "lstrip": false,
2372
+ "normalized": false,
2373
+ "rstrip": false,
2374
+ "single_word": false
2375
+ },
2376
+ {
2377
+ "content": "983493951323",
2378
+ "lstrip": false,
2379
+ "normalized": false,
2380
+ "rstrip": false,
2381
+ "single_word": false
2382
+ },
2383
+ {
2384
+ "content": "724492262421",
2385
+ "lstrip": false,
2386
+ "normalized": false,
2387
+ "rstrip": false,
2388
+ "single_word": false
2389
+ },
2390
+ {
2391
+ "content": "622553389126",
2392
+ "lstrip": false,
2393
+ "normalized": false,
2394
+ "rstrip": false,
2395
+ "single_word": false
2396
+ },
2397
+ {
2398
+ "content": "889965243135",
2399
+ "lstrip": false,
2400
+ "normalized": false,
2401
+ "rstrip": false,
2402
+ "single_word": false
2403
+ },
2404
+ {
2405
+ "content": "364492359246",
2406
+ "lstrip": false,
2407
+ "normalized": false,
2408
+ "rstrip": false,
2409
+ "single_word": false
2410
+ },
2411
+ {
2412
+ "content": "154962668224",
2413
+ "lstrip": false,
2414
+ "normalized": false,
2415
+ "rstrip": false,
2416
+ "single_word": false
2417
+ },
2418
+ {
2419
+ "content": "179564995814",
2420
+ "lstrip": false,
2421
+ "normalized": false,
2422
+ "rstrip": false,
2423
+ "single_word": false
2424
+ },
2425
+ {
2426
+ "content": "418412875665",
2427
+ "lstrip": false,
2428
+ "normalized": false,
2429
+ "rstrip": false,
2430
+ "single_word": false
2431
+ },
2432
+ {
2433
+ "content": "718951851413",
2434
+ "lstrip": false,
2435
+ "normalized": false,
2436
+ "rstrip": false,
2437
+ "single_word": false
2438
+ },
2439
+ {
2440
+ "content": "699446724178",
2441
+ "lstrip": false,
2442
+ "normalized": false,
2443
+ "rstrip": false,
2444
+ "single_word": false
2445
+ },
2446
+ {
2447
+ "content": "624266421831",
2448
+ "lstrip": false,
2449
+ "normalized": false,
2450
+ "rstrip": false,
2451
+ "single_word": false
2452
+ },
2453
+ {
2454
+ "content": "815458725125",
2455
+ "lstrip": false,
2456
+ "normalized": false,
2457
+ "rstrip": false,
2458
+ "single_word": false
2459
+ },
2460
+ {
2461
+ "content": "455423278865",
2462
+ "lstrip": false,
2463
+ "normalized": false,
2464
+ "rstrip": false,
2465
+ "single_word": false
2466
+ },
2467
+ {
2468
+ "content": "393741199486",
2469
+ "lstrip": false,
2470
+ "normalized": false,
2471
+ "rstrip": false,
2472
+ "single_word": false
2473
+ },
2474
+ {
2475
+ "content": "328552864359",
2476
+ "lstrip": false,
2477
+ "normalized": false,
2478
+ "rstrip": false,
2479
+ "single_word": false
2480
+ },
2481
+ {
2482
+ "content": "211662639865",
2483
+ "lstrip": false,
2484
+ "normalized": false,
2485
+ "rstrip": false,
2486
+ "single_word": false
2487
+ },
2488
+ {
2489
+ "content": "218784516525",
2490
+ "lstrip": false,
2491
+ "normalized": false,
2492
+ "rstrip": false,
2493
+ "single_word": false
2494
+ },
2495
+ {
2496
+ "content": "762486672996",
2497
+ "lstrip": false,
2498
+ "normalized": false,
2499
+ "rstrip": false,
2500
+ "single_word": false
2501
+ },
2502
+ {
2503
+ "content": "142799718159",
2504
+ "lstrip": false,
2505
+ "normalized": false,
2506
+ "rstrip": false,
2507
+ "single_word": false
2508
+ },
2509
+ {
2510
+ "content": "858146415154",
2511
+ "lstrip": false,
2512
+ "normalized": false,
2513
+ "rstrip": false,
2514
+ "single_word": false
2515
+ },
2516
+ {
2517
+ "content": "767858144912",
2518
+ "lstrip": false,
2519
+ "normalized": false,
2520
+ "rstrip": false,
2521
+ "single_word": false
2522
+ },
2523
+ {
2524
+ "content": "571317457151",
2525
+ "lstrip": false,
2526
+ "normalized": false,
2527
+ "rstrip": false,
2528
+ "single_word": false
2529
+ },
2530
+ {
2531
+ "content": "635127952696",
2532
+ "lstrip": false,
2533
+ "normalized": false,
2534
+ "rstrip": false,
2535
+ "single_word": false
2536
+ },
2537
+ {
2538
+ "content": "116427191984",
2539
+ "lstrip": false,
2540
+ "normalized": false,
2541
+ "rstrip": false,
2542
+ "single_word": false
2543
+ },
2544
+ {
2545
+ "content": "268921994538",
2546
+ "lstrip": false,
2547
+ "normalized": false,
2548
+ "rstrip": false,
2549
+ "single_word": false
2550
+ },
2551
+ {
2552
+ "content": "523937669294",
2553
+ "lstrip": false,
2554
+ "normalized": false,
2555
+ "rstrip": false,
2556
+ "single_word": false
2557
+ },
2558
+ {
2559
+ "content": "165429152138",
2560
+ "lstrip": false,
2561
+ "normalized": false,
2562
+ "rstrip": false,
2563
+ "single_word": false
2564
+ },
2565
+ {
2566
+ "content": "739246183345",
2567
+ "lstrip": false,
2568
+ "normalized": false,
2569
+ "rstrip": false,
2570
+ "single_word": false
2571
+ },
2572
+ {
2573
+ "content": "591464355756",
2574
+ "lstrip": false,
2575
+ "normalized": false,
2576
+ "rstrip": false,
2577
+ "single_word": false
2578
+ },
2579
+ {
2580
+ "content": "212985874612",
2581
+ "lstrip": false,
2582
+ "normalized": false,
2583
+ "rstrip": false,
2584
+ "single_word": false
2585
+ },
2586
+ {
2587
+ "content": "191887635211",
2588
+ "lstrip": false,
2589
+ "normalized": false,
2590
+ "rstrip": false,
2591
+ "single_word": false
2592
+ },
2593
+ {
2594
+ "content": "967214577653",
2595
+ "lstrip": false,
2596
+ "normalized": false,
2597
+ "rstrip": false,
2598
+ "single_word": false
2599
+ },
2600
+ {
2601
+ "content": "119342152414",
2602
+ "lstrip": false,
2603
+ "normalized": false,
2604
+ "rstrip": false,
2605
+ "single_word": false
2606
+ },
2607
+ {
2608
+ "content": "946444632795",
2609
+ "lstrip": false,
2610
+ "normalized": false,
2611
+ "rstrip": false,
2612
+ "single_word": false
2613
+ },
2614
+ {
2615
+ "content": "618423867817",
2616
+ "lstrip": false,
2617
+ "normalized": false,
2618
+ "rstrip": false,
2619
+ "single_word": false
2620
+ },
2621
+ {
2622
+ "content": "228565148417",
2623
+ "lstrip": false,
2624
+ "normalized": false,
2625
+ "rstrip": false,
2626
+ "single_word": false
2627
+ },
2628
+ {
2629
+ "content": "729116422489",
2630
+ "lstrip": false,
2631
+ "normalized": false,
2632
+ "rstrip": false,
2633
+ "single_word": false
2634
+ },
2635
+ {
2636
+ "content": "527874729936",
2637
+ "lstrip": false,
2638
+ "normalized": false,
2639
+ "rstrip": false,
2640
+ "single_word": false
2641
+ },
2642
+ {
2643
+ "content": "739784153482",
2644
+ "lstrip": false,
2645
+ "normalized": false,
2646
+ "rstrip": false,
2647
+ "single_word": false
2648
+ },
2649
+ {
2650
+ "content": "387763951128",
2651
+ "lstrip": false,
2652
+ "normalized": false,
2653
+ "rstrip": false,
2654
+ "single_word": false
2655
+ },
2656
+ {
2657
+ "content": "331369926711",
2658
+ "lstrip": false,
2659
+ "normalized": false,
2660
+ "rstrip": false,
2661
+ "single_word": false
2662
+ },
2663
+ {
2664
+ "content": "562716493614",
2665
+ "lstrip": false,
2666
+ "normalized": false,
2667
+ "rstrip": false,
2668
+ "single_word": false
2669
+ },
2670
+ {
2671
+ "content": "739667844957",
2672
+ "lstrip": false,
2673
+ "normalized": false,
2674
+ "rstrip": false,
2675
+ "single_word": false
2676
+ },
2677
+ {
2678
+ "content": "562389434565",
2679
+ "lstrip": false,
2680
+ "normalized": false,
2681
+ "rstrip": false,
2682
+ "single_word": false
2683
+ },
2684
+ {
2685
+ "content": "256497188281",
2686
+ "lstrip": false,
2687
+ "normalized": false,
2688
+ "rstrip": false,
2689
+ "single_word": false
2690
+ },
2691
+ {
2692
+ "content": "859927364588",
2693
+ "lstrip": false,
2694
+ "normalized": false,
2695
+ "rstrip": false,
2696
+ "single_word": false
2697
+ },
2698
+ {
2699
+ "content": "417668946583",
2700
+ "lstrip": false,
2701
+ "normalized": false,
2702
+ "rstrip": false,
2703
+ "single_word": false
2704
+ },
2705
+ {
2706
+ "content": "357621613582",
2707
+ "lstrip": false,
2708
+ "normalized": false,
2709
+ "rstrip": false,
2710
+ "single_word": false
2711
+ },
2712
+ {
2713
+ "content": "438435178228",
2714
+ "lstrip": false,
2715
+ "normalized": false,
2716
+ "rstrip": false,
2717
+ "single_word": false
2718
+ },
2719
+ {
2720
+ "content": "485692541169",
2721
+ "lstrip": false,
2722
+ "normalized": false,
2723
+ "rstrip": false,
2724
+ "single_word": false
2725
+ },
2726
+ {
2727
+ "content": "825815739116",
2728
+ "lstrip": false,
2729
+ "normalized": false,
2730
+ "rstrip": false,
2731
+ "single_word": false
2732
+ },
2733
+ {
2734
+ "content": "342221452223",
2735
+ "lstrip": false,
2736
+ "normalized": false,
2737
+ "rstrip": false,
2738
+ "single_word": false
2739
+ },
2740
+ {
2741
+ "content": "697747991249",
2742
+ "lstrip": false,
2743
+ "normalized": false,
2744
+ "rstrip": false,
2745
+ "single_word": false
2746
+ },
2747
+ {
2748
+ "content": "716763689965",
2749
+ "lstrip": false,
2750
+ "normalized": false,
2751
+ "rstrip": false,
2752
+ "single_word": false
2753
+ },
2754
+ {
2755
+ "content": "141499982867",
2756
+ "lstrip": false,
2757
+ "normalized": false,
2758
+ "rstrip": false,
2759
+ "single_word": false
2760
+ },
2761
+ {
2762
+ "content": "818479319499",
2763
+ "lstrip": false,
2764
+ "normalized": false,
2765
+ "rstrip": false,
2766
+ "single_word": false
2767
+ },
2768
+ {
2769
+ "content": "336813343298",
2770
+ "lstrip": false,
2771
+ "normalized": false,
2772
+ "rstrip": false,
2773
+ "single_word": false
2774
+ },
2775
+ {
2776
+ "content": "594688742928",
2777
+ "lstrip": false,
2778
+ "normalized": false,
2779
+ "rstrip": false,
2780
+ "single_word": false
2781
+ },
2782
+ {
2783
+ "content": "472129283475",
2784
+ "lstrip": false,
2785
+ "normalized": false,
2786
+ "rstrip": false,
2787
+ "single_word": false
2788
+ },
2789
+ {
2790
+ "content": "514354144759",
2791
+ "lstrip": false,
2792
+ "normalized": false,
2793
+ "rstrip": false,
2794
+ "single_word": false
2795
+ },
2796
+ {
2797
+ "content": "349249721685",
2798
+ "lstrip": false,
2799
+ "normalized": false,
2800
+ "rstrip": false,
2801
+ "single_word": false
2802
+ },
2803
+ {
2804
+ "content": "546276298359",
2805
+ "lstrip": false,
2806
+ "normalized": false,
2807
+ "rstrip": false,
2808
+ "single_word": false
2809
+ },
2810
+ {
2811
+ "content": "353755529131",
2812
+ "lstrip": false,
2813
+ "normalized": false,
2814
+ "rstrip": false,
2815
+ "single_word": false
2816
+ },
2817
+ {
2818
+ "content": "315534574435",
2819
+ "lstrip": false,
2820
+ "normalized": false,
2821
+ "rstrip": false,
2822
+ "single_word": false
2823
+ },
2824
+ {
2825
+ "content": "523723475786",
2826
+ "lstrip": false,
2827
+ "normalized": false,
2828
+ "rstrip": false,
2829
+ "single_word": false
2830
+ },
2831
+ {
2832
+ "content": "215826764872",
2833
+ "lstrip": false,
2834
+ "normalized": false,
2835
+ "rstrip": false,
2836
+ "single_word": false
2837
+ },
2838
+ {
2839
+ "content": "367968398551",
2840
+ "lstrip": false,
2841
+ "normalized": false,
2842
+ "rstrip": false,
2843
+ "single_word": false
2844
+ },
2845
+ {
2846
+ "content": "569853653352",
2847
+ "lstrip": false,
2848
+ "normalized": false,
2849
+ "rstrip": false,
2850
+ "single_word": false
2851
+ },
2852
+ {
2853
+ "content": "389715484387",
2854
+ "lstrip": false,
2855
+ "normalized": false,
2856
+ "rstrip": false,
2857
+ "single_word": false
2858
+ },
2859
+ {
2860
+ "content": "293847485454",
2861
+ "lstrip": false,
2862
+ "normalized": false,
2863
+ "rstrip": false,
2864
+ "single_word": false
2865
+ },
2866
+ {
2867
+ "content": "714738141818",
2868
+ "lstrip": false,
2869
+ "normalized": false,
2870
+ "rstrip": false,
2871
+ "single_word": false
2872
+ },
2873
+ {
2874
+ "content": "178478368922",
2875
+ "lstrip": false,
2876
+ "normalized": false,
2877
+ "rstrip": false,
2878
+ "single_word": false
2879
+ },
2880
+ {
2881
+ "content": "581493616981",
2882
+ "lstrip": false,
2883
+ "normalized": false,
2884
+ "rstrip": false,
2885
+ "single_word": false
2886
+ },
2887
+ {
2888
+ "content": "589439538674",
2889
+ "lstrip": false,
2890
+ "normalized": false,
2891
+ "rstrip": false,
2892
+ "single_word": false
2893
+ },
2894
+ {
2895
+ "content": "846657726193",
2896
+ "lstrip": false,
2897
+ "normalized": false,
2898
+ "rstrip": false,
2899
+ "single_word": false
2900
+ },
2901
+ {
2902
+ "content": "722339992679",
2903
+ "lstrip": false,
2904
+ "normalized": false,
2905
+ "rstrip": false,
2906
+ "single_word": false
2907
+ },
2908
+ {
2909
+ "content": "138154781148",
2910
+ "lstrip": false,
2911
+ "normalized": false,
2912
+ "rstrip": false,
2913
+ "single_word": false
2914
+ },
2915
+ {
2916
+ "content": "757785319772",
2917
+ "lstrip": false,
2918
+ "normalized": false,
2919
+ "rstrip": false,
2920
+ "single_word": false
2921
+ },
2922
+ {
2923
+ "content": "492516914298",
2924
+ "lstrip": false,
2925
+ "normalized": false,
2926
+ "rstrip": false,
2927
+ "single_word": false
2928
+ },
2929
+ {
2930
+ "content": "919181521716",
2931
+ "lstrip": false,
2932
+ "normalized": false,
2933
+ "rstrip": false,
2934
+ "single_word": false
2935
+ },
2936
+ {
2937
+ "content": "985781138935",
2938
+ "lstrip": false,
2939
+ "normalized": false,
2940
+ "rstrip": false,
2941
+ "single_word": false
2942
+ },
2943
+ {
2944
+ "content": "476969195485",
2945
+ "lstrip": false,
2946
+ "normalized": false,
2947
+ "rstrip": false,
2948
+ "single_word": false
2949
+ },
2950
+ {
2951
+ "content": "313145133463",
2952
+ "lstrip": false,
2953
+ "normalized": false,
2954
+ "rstrip": false,
2955
+ "single_word": false
2956
+ },
2957
+ {
2958
+ "content": "758963111966",
2959
+ "lstrip": false,
2960
+ "normalized": false,
2961
+ "rstrip": false,
2962
+ "single_word": false
2963
+ },
2964
+ {
2965
+ "content": "147541537162",
2966
+ "lstrip": false,
2967
+ "normalized": false,
2968
+ "rstrip": false,
2969
+ "single_word": false
2970
+ },
2971
+ {
2972
+ "content": "557163366873",
2973
+ "lstrip": false,
2974
+ "normalized": false,
2975
+ "rstrip": false,
2976
+ "single_word": false
2977
+ },
2978
+ {
2979
+ "content": "144373897488",
2980
+ "lstrip": false,
2981
+ "normalized": false,
2982
+ "rstrip": false,
2983
+ "single_word": false
2984
+ },
2985
+ {
2986
+ "content": "522515164754",
2987
+ "lstrip": false,
2988
+ "normalized": false,
2989
+ "rstrip": false,
2990
+ "single_word": false
2991
+ },
2992
+ {
2993
+ "content": "724964923582",
2994
+ "lstrip": false,
2995
+ "normalized": false,
2996
+ "rstrip": false,
2997
+ "single_word": false
2998
+ },
2999
+ {
3000
+ "content": "284776712475",
3001
+ "lstrip": false,
3002
+ "normalized": false,
3003
+ "rstrip": false,
3004
+ "single_word": false
3005
+ },
3006
+ {
3007
+ "content": "375429755114",
3008
+ "lstrip": false,
3009
+ "normalized": false,
3010
+ "rstrip": false,
3011
+ "single_word": false
3012
+ },
3013
+ {
3014
+ "content": "181233596124",
3015
+ "lstrip": false,
3016
+ "normalized": false,
3017
+ "rstrip": false,
3018
+ "single_word": false
3019
+ },
3020
+ {
3021
+ "content": "948585673431",
3022
+ "lstrip": false,
3023
+ "normalized": false,
3024
+ "rstrip": false,
3025
+ "single_word": false
3026
+ },
3027
+ {
3028
+ "content": "243165586174",
3029
+ "lstrip": false,
3030
+ "normalized": false,
3031
+ "rstrip": false,
3032
+ "single_word": false
3033
+ },
3034
+ {
3035
+ "content": "396847976144",
3036
+ "lstrip": false,
3037
+ "normalized": false,
3038
+ "rstrip": false,
3039
+ "single_word": false
3040
+ },
3041
+ {
3042
+ "content": "997724962668",
3043
+ "lstrip": false,
3044
+ "normalized": false,
3045
+ "rstrip": false,
3046
+ "single_word": false
3047
+ },
3048
+ {
3049
+ "content": "558837194455",
3050
+ "lstrip": false,
3051
+ "normalized": false,
3052
+ "rstrip": false,
3053
+ "single_word": false
3054
+ },
3055
+ {
3056
+ "content": "163165456396",
3057
+ "lstrip": false,
3058
+ "normalized": false,
3059
+ "rstrip": false,
3060
+ "single_word": false
3061
+ },
3062
+ {
3063
+ "content": "378749551722",
3064
+ "lstrip": false,
3065
+ "normalized": false,
3066
+ "rstrip": false,
3067
+ "single_word": false
3068
+ },
3069
+ {
3070
+ "content": "161238482259",
3071
+ "lstrip": false,
3072
+ "normalized": false,
3073
+ "rstrip": false,
3074
+ "single_word": false
3075
+ },
3076
+ {
3077
+ "content": "754978243758",
3078
+ "lstrip": false,
3079
+ "normalized": false,
3080
+ "rstrip": false,
3081
+ "single_word": false
3082
+ },
3083
+ {
3084
+ "content": "195388849133",
3085
+ "lstrip": false,
3086
+ "normalized": false,
3087
+ "rstrip": false,
3088
+ "single_word": false
3089
+ },
3090
+ {
3091
+ "content": "229775525672",
3092
+ "lstrip": false,
3093
+ "normalized": false,
3094
+ "rstrip": false,
3095
+ "single_word": false
3096
+ },
3097
+ {
3098
+ "content": "262437452884",
3099
+ "lstrip": false,
3100
+ "normalized": false,
3101
+ "rstrip": false,
3102
+ "single_word": false
3103
+ },
3104
+ {
3105
+ "content": "441377892146",
3106
+ "lstrip": false,
3107
+ "normalized": false,
3108
+ "rstrip": false,
3109
+ "single_word": false
3110
+ },
3111
+ {
3112
+ "content": "451885565366",
3113
+ "lstrip": false,
3114
+ "normalized": false,
3115
+ "rstrip": false,
3116
+ "single_word": false
3117
+ },
3118
+ {
3119
+ "content": "981277526855",
3120
+ "lstrip": false,
3121
+ "normalized": false,
3122
+ "rstrip": false,
3123
+ "single_word": false
3124
+ },
3125
+ {
3126
+ "content": "762495822823",
3127
+ "lstrip": false,
3128
+ "normalized": false,
3129
+ "rstrip": false,
3130
+ "single_word": false
3131
+ },
3132
+ {
3133
+ "content": "368763327262",
3134
+ "lstrip": false,
3135
+ "normalized": false,
3136
+ "rstrip": false,
3137
+ "single_word": false
3138
+ },
3139
+ {
3140
+ "content": "757422791351",
3141
+ "lstrip": false,
3142
+ "normalized": false,
3143
+ "rstrip": false,
3144
+ "single_word": false
3145
+ },
3146
+ {
3147
+ "content": "636324136426",
3148
+ "lstrip": false,
3149
+ "normalized": false,
3150
+ "rstrip": false,
3151
+ "single_word": false
3152
+ },
3153
+ {
3154
+ "content": "214193645583",
3155
+ "lstrip": false,
3156
+ "normalized": false,
3157
+ "rstrip": false,
3158
+ "single_word": false
3159
+ },
3160
+ {
3161
+ "content": "412843856172",
3162
+ "lstrip": false,
3163
+ "normalized": false,
3164
+ "rstrip": false,
3165
+ "single_word": false
3166
+ },
3167
+ {
3168
+ "content": "179386156569",
3169
+ "lstrip": false,
3170
+ "normalized": false,
3171
+ "rstrip": false,
3172
+ "single_word": false
3173
+ },
3174
+ {
3175
+ "content": "756916173536",
3176
+ "lstrip": false,
3177
+ "normalized": false,
3178
+ "rstrip": false,
3179
+ "single_word": false
3180
+ },
3181
+ {
3182
+ "content": "892697125149",
3183
+ "lstrip": false,
3184
+ "normalized": false,
3185
+ "rstrip": false,
3186
+ "single_word": false
3187
+ },
3188
+ {
3189
+ "content": "625334487352",
3190
+ "lstrip": false,
3191
+ "normalized": false,
3192
+ "rstrip": false,
3193
+ "single_word": false
3194
+ },
3195
+ {
3196
+ "content": "941861857715",
3197
+ "lstrip": false,
3198
+ "normalized": false,
3199
+ "rstrip": false,
3200
+ "single_word": false
3201
+ },
3202
+ {
3203
+ "content": "887417525236",
3204
+ "lstrip": false,
3205
+ "normalized": false,
3206
+ "rstrip": false,
3207
+ "single_word": false
3208
+ },
3209
+ {
3210
+ "content": "649516938598",
3211
+ "lstrip": false,
3212
+ "normalized": false,
3213
+ "rstrip": false,
3214
+ "single_word": false
3215
+ },
3216
+ {
3217
+ "content": "717628619782",
3218
+ "lstrip": false,
3219
+ "normalized": false,
3220
+ "rstrip": false,
3221
+ "single_word": false
3222
+ },
3223
+ {
3224
+ "content": "438124184139",
3225
+ "lstrip": false,
3226
+ "normalized": false,
3227
+ "rstrip": false,
3228
+ "single_word": false
3229
+ },
3230
+ {
3231
+ "content": "547563892268",
3232
+ "lstrip": false,
3233
+ "normalized": false,
3234
+ "rstrip": false,
3235
+ "single_word": false
3236
+ },
3237
+ {
3238
+ "content": "856317483891",
3239
+ "lstrip": false,
3240
+ "normalized": false,
3241
+ "rstrip": false,
3242
+ "single_word": false
3243
+ },
3244
+ {
3245
+ "content": "313313831273",
3246
+ "lstrip": false,
3247
+ "normalized": false,
3248
+ "rstrip": false,
3249
+ "single_word": false
3250
+ },
3251
+ {
3252
+ "content": "371496153876",
3253
+ "lstrip": false,
3254
+ "normalized": false,
3255
+ "rstrip": false,
3256
+ "single_word": false
3257
+ },
3258
+ {
3259
+ "content": "587541149322",
3260
+ "lstrip": false,
3261
+ "normalized": false,
3262
+ "rstrip": false,
3263
+ "single_word": false
3264
+ },
3265
+ {
3266
+ "content": "265847332563",
3267
+ "lstrip": false,
3268
+ "normalized": false,
3269
+ "rstrip": false,
3270
+ "single_word": false
3271
+ },
3272
+ {
3273
+ "content": "449549215429",
3274
+ "lstrip": false,
3275
+ "normalized": false,
3276
+ "rstrip": false,
3277
+ "single_word": false
3278
+ },
3279
+ {
3280
+ "content": "163497196769",
3281
+ "lstrip": false,
3282
+ "normalized": false,
3283
+ "rstrip": false,
3284
+ "single_word": false
3285
+ },
3286
+ {
3287
+ "content": "861342291298",
3288
+ "lstrip": false,
3289
+ "normalized": false,
3290
+ "rstrip": false,
3291
+ "single_word": false
3292
+ },
3293
+ {
3294
+ "content": "268433315926",
3295
+ "lstrip": false,
3296
+ "normalized": false,
3297
+ "rstrip": false,
3298
+ "single_word": false
3299
+ },
3300
+ {
3301
+ "content": "774679513717",
3302
+ "lstrip": false,
3303
+ "normalized": false,
3304
+ "rstrip": false,
3305
+ "single_word": false
3306
+ },
3307
+ {
3308
+ "content": "851254219729",
3309
+ "lstrip": false,
3310
+ "normalized": false,
3311
+ "rstrip": false,
3312
+ "single_word": false
3313
+ },
3314
+ {
3315
+ "content": "583527834464",
3316
+ "lstrip": false,
3317
+ "normalized": false,
3318
+ "rstrip": false,
3319
+ "single_word": false
3320
+ },
3321
+ {
3322
+ "content": "488496781997",
3323
+ "lstrip": false,
3324
+ "normalized": false,
3325
+ "rstrip": false,
3326
+ "single_word": false
3327
+ },
3328
+ {
3329
+ "content": "556814553861",
3330
+ "lstrip": false,
3331
+ "normalized": false,
3332
+ "rstrip": false,
3333
+ "single_word": false
3334
+ },
3335
+ {
3336
+ "content": "482829231639",
3337
+ "lstrip": false,
3338
+ "normalized": false,
3339
+ "rstrip": false,
3340
+ "single_word": false
3341
+ },
3342
+ {
3343
+ "content": "618878266619",
3344
+ "lstrip": false,
3345
+ "normalized": false,
3346
+ "rstrip": false,
3347
+ "single_word": false
3348
+ },
3349
+ {
3350
+ "content": "147444452794",
3351
+ "lstrip": false,
3352
+ "normalized": false,
3353
+ "rstrip": false,
3354
+ "single_word": false
3355
+ },
3356
+ {
3357
+ "content": "949235426629",
3358
+ "lstrip": false,
3359
+ "normalized": false,
3360
+ "rstrip": false,
3361
+ "single_word": false
3362
+ },
3363
+ {
3364
+ "content": "357299947518",
3365
+ "lstrip": false,
3366
+ "normalized": false,
3367
+ "rstrip": false,
3368
+ "single_word": false
3369
+ },
3370
+ {
3371
+ "content": "175528632226",
3372
+ "lstrip": false,
3373
+ "normalized": false,
3374
+ "rstrip": false,
3375
+ "single_word": false
3376
+ },
3377
+ {
3378
+ "content": "645527857972",
3379
+ "lstrip": false,
3380
+ "normalized": false,
3381
+ "rstrip": false,
3382
+ "single_word": false
3383
+ },
3384
+ {
3385
+ "content": "186872457894",
3386
+ "lstrip": false,
3387
+ "normalized": false,
3388
+ "rstrip": false,
3389
+ "single_word": false
3390
+ },
3391
+ {
3392
+ "content": "552738847828",
3393
+ "lstrip": false,
3394
+ "normalized": false,
3395
+ "rstrip": false,
3396
+ "single_word": false
3397
+ },
3398
+ {
3399
+ "content": "626748382482",
3400
+ "lstrip": false,
3401
+ "normalized": false,
3402
+ "rstrip": false,
3403
+ "single_word": false
3404
+ },
3405
+ {
3406
+ "content": "921894985642",
3407
+ "lstrip": false,
3408
+ "normalized": false,
3409
+ "rstrip": false,
3410
+ "single_word": false
3411
+ },
3412
+ {
3413
+ "content": "943878645871",
3414
+ "lstrip": false,
3415
+ "normalized": false,
3416
+ "rstrip": false,
3417
+ "single_word": false
3418
+ },
3419
+ {
3420
+ "content": "859289776479",
3421
+ "lstrip": false,
3422
+ "normalized": false,
3423
+ "rstrip": false,
3424
+ "single_word": false
3425
+ },
3426
+ {
3427
+ "content": "614583493135",
3428
+ "lstrip": false,
3429
+ "normalized": false,
3430
+ "rstrip": false,
3431
+ "single_word": false
3432
+ },
3433
+ {
3434
+ "content": "933775286797",
3435
+ "lstrip": false,
3436
+ "normalized": false,
3437
+ "rstrip": false,
3438
+ "single_word": false
3439
+ },
3440
+ {
3441
+ "content": "332234613346",
3442
+ "lstrip": false,
3443
+ "normalized": false,
3444
+ "rstrip": false,
3445
+ "single_word": false
3446
+ },
3447
+ {
3448
+ "content": "325196781219",
3449
+ "lstrip": false,
3450
+ "normalized": false,
3451
+ "rstrip": false,
3452
+ "single_word": false
3453
+ },
3454
+ {
3455
+ "content": "142526557681",
3456
+ "lstrip": false,
3457
+ "normalized": false,
3458
+ "rstrip": false,
3459
+ "single_word": false
3460
+ },
3461
+ {
3462
+ "content": "356722692178",
3463
+ "lstrip": false,
3464
+ "normalized": false,
3465
+ "rstrip": false,
3466
+ "single_word": false
3467
+ },
3468
+ {
3469
+ "content": "449318681694",
3470
+ "lstrip": false,
3471
+ "normalized": false,
3472
+ "rstrip": false,
3473
+ "single_word": false
3474
+ },
3475
+ {
3476
+ "content": "687284547244",
3477
+ "lstrip": false,
3478
+ "normalized": false,
3479
+ "rstrip": false,
3480
+ "single_word": false
3481
+ },
3482
+ {
3483
+ "content": "947262995132",
3484
+ "lstrip": false,
3485
+ "normalized": false,
3486
+ "rstrip": false,
3487
+ "single_word": false
3488
+ },
3489
+ {
3490
+ "content": "893974619684",
3491
+ "lstrip": false,
3492
+ "normalized": false,
3493
+ "rstrip": false,
3494
+ "single_word": false
3495
+ },
3496
+ {
3497
+ "content": "797238311233",
3498
+ "lstrip": false,
3499
+ "normalized": false,
3500
+ "rstrip": false,
3501
+ "single_word": false
3502
+ }
3503
+ ],
3504
+ "bos_token": {
3505
+ "content": "<|end_of_text|>",
3506
+ "lstrip": false,
3507
+ "normalized": false,
3508
+ "rstrip": false,
3509
+ "single_word": false
3510
+ },
3511
+ "eos_token": {
3512
+ "content": "<|end_of_text|>",
3513
+ "lstrip": false,
3514
+ "normalized": false,
3515
+ "rstrip": false,
3516
+ "single_word": false
3517
+ },
3518
+ "pad_token": {
3519
+ "content": "<|pad|>",
3520
+ "lstrip": false,
3521
+ "normalized": false,
3522
+ "rstrip": false,
3523
+ "single_word": false
3524
+ },
3525
+ "unk_token": {
3526
+ "content": "<|unk|>",
3527
+ "lstrip": false,
3528
+ "normalized": false,
3529
+ "rstrip": false,
3530
+ "single_word": false
3531
+ }
3532
+ }
granite-4.0-h-tiny/dp8/adapter/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/adapter/tokenizer_config.json ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/adapter/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/audit_results.json ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "delta": 1e-05,
3
+ "num_canaries": 500,
4
+ "num_members": 250,
5
+ "paper_guess_fraction": 0.2,
6
+ "paper_guess_steps": 20,
7
+ "loss": {
8
+ "auc": 0.563808,
9
+ "empirical_epsilon": {
10
+ "0.05": 0.42648759204894304,
11
+ "0.01": 0.16005427204072475
12
+ },
13
+ "empirical_epsilon_details": {
14
+ "0.05": {
15
+ "epsilon": 0.42648759204894304,
16
+ "num_guesses": 30,
17
+ "correct_guesses": 23,
18
+ "candidate_num_guesses": [
19
+ 5,
20
+ 10,
21
+ 15,
22
+ 20,
23
+ 25,
24
+ 30,
25
+ 35,
26
+ 40,
27
+ 45,
28
+ 50,
29
+ 55,
30
+ 60,
31
+ 65,
32
+ 70,
33
+ 75,
34
+ 80,
35
+ 85,
36
+ 90,
37
+ 95,
38
+ 100
39
+ ],
40
+ "direction": "lower"
41
+ },
42
+ "0.01": {
43
+ "epsilon": 0.16005427204072475,
44
+ "num_guesses": 30,
45
+ "correct_guesses": 23,
46
+ "candidate_num_guesses": [
47
+ 5,
48
+ 10,
49
+ 15,
50
+ 20,
51
+ 25,
52
+ 30,
53
+ 35,
54
+ 40,
55
+ 45,
56
+ 50,
57
+ 55,
58
+ 60,
59
+ 65,
60
+ 70,
61
+ 75,
62
+ 80,
63
+ 85,
64
+ 90,
65
+ 95,
66
+ 100
67
+ ],
68
+ "direction": "lower"
69
+ }
70
+ }
71
+ },
72
+ "embedding": {
73
+ "auc": 0.50796,
74
+ "empirical_epsilon": {
75
+ "0.05": 0.0,
76
+ "0.01": 0.0
77
+ },
78
+ "empirical_epsilon_details": {
79
+ "0.05": {
80
+ "epsilon": 0.0,
81
+ "num_guesses": 0,
82
+ "correct_guesses": 0,
83
+ "candidate_num_guesses": [
84
+ 5,
85
+ 10,
86
+ 15,
87
+ 20,
88
+ 25,
89
+ 30,
90
+ 35,
91
+ 40,
92
+ 45,
93
+ 50,
94
+ 55,
95
+ 60,
96
+ 65,
97
+ 70,
98
+ 75,
99
+ 80,
100
+ 85,
101
+ 90,
102
+ 95,
103
+ 100
104
+ ],
105
+ "direction": "lower"
106
+ },
107
+ "0.01": {
108
+ "epsilon": 0.0,
109
+ "num_guesses": 0,
110
+ "correct_guesses": 0,
111
+ "candidate_num_guesses": [
112
+ 5,
113
+ 10,
114
+ 15,
115
+ 20,
116
+ 25,
117
+ 30,
118
+ 35,
119
+ 40,
120
+ 45,
121
+ 50,
122
+ 55,
123
+ 60,
124
+ 65,
125
+ 70,
126
+ 75,
127
+ 80,
128
+ 85,
129
+ 90,
130
+ 95,
131
+ 100
132
+ ],
133
+ "direction": "lower"
134
+ }
135
+ }
136
+ }
137
+ }
granite-4.0-h-tiny/dp8/audit_scores.npz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52e08b98c87cf9bd7c0fdd1f773abaf145d93b0a97c31a3548073c17ee744905
3
+ size 12784
granite-4.0-h-tiny/dp8/canary_meta.json ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/codecarbon.csv ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ timestamp,project_name,run_id,experiment_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,water_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,cpu_utilization_percent,gpu_utilization_percent,ram_utilization_percent,ram_used_gb,on_cloud,pue,wue
2
+ 2026-03-18T18:31:13,codedp-granite-4.0-h-tiny-cpt-dp8,b3a5a3a3-5dc9-4396-9d6c-92f45f9faa57,5b0fa12a-3dd7-45bb-9766-cc326314d9f1,2940.2213213280775,0.04336494635667721,1.4748871468318434e-05,82.44163995833674,1409.9170137162785,38.0,0.06497743055379518,1.1496539994446735,0.029949873467856485,1.2445813034663262,0.0,Switzerland,CHE,aargau,,,Linux-6.8.0-100-generic-x86_64-with-glibc2.39,3.11.0,3.2.3,8,AMD EPYC 9565 72-Core Processor,5,5 x NVIDIA H200,8.212,47.4843,128,machine,12.307671326287071,66.43163995908625,8.260415956358626,166.47142205691932,N,1.0,0.0
granite-4.0-h-tiny/dp8/epochs/epoch_001/adapter/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: ibm-granite/granite-4.0-h-tiny
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:ibm-granite/granite-4.0-h-tiny
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.18.1
granite-4.0-h-tiny/dp8/epochs/epoch_001/adapter/adapter_config.json ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": null,
6
+ "base_model_name_or_path": "ibm-granite/granite-4.0-h-tiny",
7
+ "bias": "none",
8
+ "corda_config": null,
9
+ "ensure_weight_tying": true,
10
+ "eva_config": null,
11
+ "exclude_modules": null,
12
+ "fan_in_fan_out": false,
13
+ "inference_mode": true,
14
+ "init_lora_weights": true,
15
+ "layer_replication": null,
16
+ "layers_pattern": null,
17
+ "layers_to_transform": null,
18
+ "loftq_config": {},
19
+ "lora_alpha": 32,
20
+ "lora_bias": false,
21
+ "lora_dropout": 0.05,
22
+ "megatron_config": null,
23
+ "megatron_core": "megatron.core",
24
+ "modules_to_save": [
25
+ "lm_head",
26
+ "embed_tokens"
27
+ ],
28
+ "peft_type": "LORA",
29
+ "peft_version": "0.18.1",
30
+ "qalora_group_size": 16,
31
+ "r": 16,
32
+ "rank_pattern": {},
33
+ "revision": null,
34
+ "target_modules": [
35
+ "v_proj",
36
+ "q_proj",
37
+ "k_proj",
38
+ "o_proj"
39
+ ],
40
+ "target_parameters": null,
41
+ "task_type": "CAUSAL_LM",
42
+ "trainable_token_indices": null,
43
+ "use_dora": false,
44
+ "use_qalora": false,
45
+ "use_rslora": false
46
+ }
granite-4.0-h-tiny/dp8/epochs/epoch_001/adapter/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b550bc9a422020f72cf6050c4c6aeddc055e74e5d313dc8ef6dfb3479087920d
3
+ size 1861530512
granite-4.0-h-tiny/dp8/epochs/epoch_001/audit_results.json ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "delta": 1e-05,
3
+ "num_canaries": 500,
4
+ "num_members": 250,
5
+ "paper_guess_fraction": 0.2,
6
+ "paper_guess_steps": 20,
7
+ "loss": {
8
+ "auc": 0.552536,
9
+ "empirical_epsilon": {
10
+ "0.05": 0.3197584319859743,
11
+ "0.01": 0.030605491250753403
12
+ },
13
+ "empirical_epsilon_details": {
14
+ "0.05": {
15
+ "epsilon": 0.3197584319859743,
16
+ "num_guesses": 25,
17
+ "correct_guesses": 19,
18
+ "candidate_num_guesses": [
19
+ 5,
20
+ 10,
21
+ 15,
22
+ 20,
23
+ 25,
24
+ 30,
25
+ 35,
26
+ 40,
27
+ 45,
28
+ 50,
29
+ 55,
30
+ 60,
31
+ 65,
32
+ 70,
33
+ 75,
34
+ 80,
35
+ 85,
36
+ 90,
37
+ 95,
38
+ 100
39
+ ],
40
+ "direction": "lower"
41
+ },
42
+ "0.01": {
43
+ "epsilon": 0.030605491250753403,
44
+ "num_guesses": 25,
45
+ "correct_guesses": 19,
46
+ "candidate_num_guesses": [
47
+ 5,
48
+ 10,
49
+ 15,
50
+ 20,
51
+ 25,
52
+ 30,
53
+ 35,
54
+ 40,
55
+ 45,
56
+ 50,
57
+ 55,
58
+ 60,
59
+ 65,
60
+ 70,
61
+ 75,
62
+ 80,
63
+ 85,
64
+ 90,
65
+ 95,
66
+ 100
67
+ ],
68
+ "direction": "lower"
69
+ }
70
+ }
71
+ },
72
+ "embedding": {
73
+ "auc": 0.507808,
74
+ "empirical_epsilon": {
75
+ "0.05": 0.0,
76
+ "0.01": 0.0
77
+ },
78
+ "empirical_epsilon_details": {
79
+ "0.05": {
80
+ "epsilon": 0.0,
81
+ "num_guesses": 0,
82
+ "correct_guesses": 0,
83
+ "candidate_num_guesses": [
84
+ 5,
85
+ 10,
86
+ 15,
87
+ 20,
88
+ 25,
89
+ 30,
90
+ 35,
91
+ 40,
92
+ 45,
93
+ 50,
94
+ 55,
95
+ 60,
96
+ 65,
97
+ 70,
98
+ 75,
99
+ 80,
100
+ 85,
101
+ 90,
102
+ 95,
103
+ 100
104
+ ],
105
+ "direction": "lower"
106
+ },
107
+ "0.01": {
108
+ "epsilon": 0.0,
109
+ "num_guesses": 0,
110
+ "correct_guesses": 0,
111
+ "candidate_num_guesses": [
112
+ 5,
113
+ 10,
114
+ 15,
115
+ 20,
116
+ 25,
117
+ 30,
118
+ 35,
119
+ 40,
120
+ 45,
121
+ 50,
122
+ 55,
123
+ 60,
124
+ 65,
125
+ 70,
126
+ 75,
127
+ 80,
128
+ 85,
129
+ 90,
130
+ 95,
131
+ 100
132
+ ],
133
+ "direction": "lower"
134
+ }
135
+ }
136
+ }
137
+ }
granite-4.0-h-tiny/dp8/epochs/epoch_001/audit_scores.npz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99118d99407ff32d113ffe7edd7058eebd58237733694a86511e4abbd985087a
3
+ size 12784
granite-4.0-h-tiny/dp8/epochs/epoch_002/adapter/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: ibm-granite/granite-4.0-h-tiny
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:ibm-granite/granite-4.0-h-tiny
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.18.1
granite-4.0-h-tiny/dp8/epochs/epoch_002/adapter/adapter_config.json ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": null,
6
+ "base_model_name_or_path": "ibm-granite/granite-4.0-h-tiny",
7
+ "bias": "none",
8
+ "corda_config": null,
9
+ "ensure_weight_tying": true,
10
+ "eva_config": null,
11
+ "exclude_modules": null,
12
+ "fan_in_fan_out": false,
13
+ "inference_mode": true,
14
+ "init_lora_weights": true,
15
+ "layer_replication": null,
16
+ "layers_pattern": null,
17
+ "layers_to_transform": null,
18
+ "loftq_config": {},
19
+ "lora_alpha": 32,
20
+ "lora_bias": false,
21
+ "lora_dropout": 0.05,
22
+ "megatron_config": null,
23
+ "megatron_core": "megatron.core",
24
+ "modules_to_save": [
25
+ "lm_head",
26
+ "embed_tokens"
27
+ ],
28
+ "peft_type": "LORA",
29
+ "peft_version": "0.18.1",
30
+ "qalora_group_size": 16,
31
+ "r": 16,
32
+ "rank_pattern": {},
33
+ "revision": null,
34
+ "target_modules": [
35
+ "v_proj",
36
+ "q_proj",
37
+ "k_proj",
38
+ "o_proj"
39
+ ],
40
+ "target_parameters": null,
41
+ "task_type": "CAUSAL_LM",
42
+ "trainable_token_indices": null,
43
+ "use_dora": false,
44
+ "use_qalora": false,
45
+ "use_rslora": false
46
+ }
granite-4.0-h-tiny/dp8/epochs/epoch_002/adapter/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1df8b34daafd4be1c1d8ca607ea1423807fb29d5cf57ff5dff30585a50fc02a
3
+ size 1861530512
granite-4.0-h-tiny/dp8/epochs/epoch_002/audit_results.json ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "delta": 1e-05,
3
+ "num_canaries": 500,
4
+ "num_members": 250,
5
+ "paper_guess_fraction": 0.2,
6
+ "paper_guess_steps": 20,
7
+ "loss": {
8
+ "auc": 0.562848,
9
+ "empirical_epsilon": {
10
+ "0.05": 0.42648759204894304,
11
+ "0.01": 0.16005427204072475
12
+ },
13
+ "empirical_epsilon_details": {
14
+ "0.05": {
15
+ "epsilon": 0.42648759204894304,
16
+ "num_guesses": 30,
17
+ "correct_guesses": 23,
18
+ "candidate_num_guesses": [
19
+ 5,
20
+ 10,
21
+ 15,
22
+ 20,
23
+ 25,
24
+ 30,
25
+ 35,
26
+ 40,
27
+ 45,
28
+ 50,
29
+ 55,
30
+ 60,
31
+ 65,
32
+ 70,
33
+ 75,
34
+ 80,
35
+ 85,
36
+ 90,
37
+ 95,
38
+ 100
39
+ ],
40
+ "direction": "lower"
41
+ },
42
+ "0.01": {
43
+ "epsilon": 0.16005427204072475,
44
+ "num_guesses": 30,
45
+ "correct_guesses": 23,
46
+ "candidate_num_guesses": [
47
+ 5,
48
+ 10,
49
+ 15,
50
+ 20,
51
+ 25,
52
+ 30,
53
+ 35,
54
+ 40,
55
+ 45,
56
+ 50,
57
+ 55,
58
+ 60,
59
+ 65,
60
+ 70,
61
+ 75,
62
+ 80,
63
+ 85,
64
+ 90,
65
+ 95,
66
+ 100
67
+ ],
68
+ "direction": "lower"
69
+ }
70
+ }
71
+ },
72
+ "embedding": {
73
+ "auc": 0.50796,
74
+ "empirical_epsilon": {
75
+ "0.05": 0.0,
76
+ "0.01": 0.0
77
+ },
78
+ "empirical_epsilon_details": {
79
+ "0.05": {
80
+ "epsilon": 0.0,
81
+ "num_guesses": 0,
82
+ "correct_guesses": 0,
83
+ "candidate_num_guesses": [
84
+ 5,
85
+ 10,
86
+ 15,
87
+ 20,
88
+ 25,
89
+ 30,
90
+ 35,
91
+ 40,
92
+ 45,
93
+ 50,
94
+ 55,
95
+ 60,
96
+ 65,
97
+ 70,
98
+ 75,
99
+ 80,
100
+ 85,
101
+ 90,
102
+ 95,
103
+ 100
104
+ ],
105
+ "direction": "lower"
106
+ },
107
+ "0.01": {
108
+ "epsilon": 0.0,
109
+ "num_guesses": 0,
110
+ "correct_guesses": 0,
111
+ "candidate_num_guesses": [
112
+ 5,
113
+ 10,
114
+ 15,
115
+ 20,
116
+ 25,
117
+ 30,
118
+ 35,
119
+ 40,
120
+ 45,
121
+ 50,
122
+ 55,
123
+ 60,
124
+ 65,
125
+ 70,
126
+ 75,
127
+ 80,
128
+ 85,
129
+ 90,
130
+ 95,
131
+ 100
132
+ ],
133
+ "direction": "lower"
134
+ }
135
+ }
136
+ }
137
+ }
granite-4.0-h-tiny/dp8/epochs/epoch_002/audit_scores.npz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8088e007bf0e20bd55c9c5f497f74361c1aabc33b815e3668dd1aa0a4610df2
3
+ size 12784
granite-4.0-h-tiny/dp8/metrics.jsonl ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"timestamp": 1773852387.8640254, "event": "train_step", "step": 10, "epoch": 1, "metrics": {"train/step_loss": 1.6353936302128123, "train/step_real_loss": 1.1510175429284573, "train/lr": 0.0002, "train/step_canary_loss": 11.968750158945719, "perf/step_duration_sec": 14.872664371039718, "perf/samples_per_sec": 8.94258060842008, "perf/tokens_per_sec": 6777.198589666931, "perf/logical_batch_size": 133.0, "perf/logical_token_count": 100795.0, "perf/physical_batches": 18.0, "privacy/epsilon": 2.524123361583601, "system/cuda_memory_allocated_gb": 15.702028751373291, "system/cuda_max_memory_allocated_gb": 54.06287908554077}}
2
+ {"timestamp": 1773852537.5150325, "event": "train_step", "step": 20, "epoch": 1, "metrics": {"train/step_loss": 1.857343329130298, "train/step_real_loss": 1.114402625709772, "train/lr": 0.00019837448439320027, "train/step_canary_loss": 12.42361111111111, "perf/step_duration_sec": 15.259514638921246, "perf/samples_per_sec": 8.91247219968029, "perf/tokens_per_sec": 7023.880020837742, "perf/logical_batch_size": 136.0, "perf/logical_token_count": 107181.0, "perf/physical_batches": 18.0, "privacy/epsilon": 3.1196418977343887, "system/cuda_memory_allocated_gb": 16.279295921325684, "system/cuda_max_memory_allocated_gb": 54.062880516052246}}
3
+ {"timestamp": 1773852684.6348226, "event": "train_step", "step": 30, "epoch": 1, "metrics": {"train/step_loss": 1.4355280977306943, "train/step_real_loss": 1.148357093334198, "train/lr": 0.0001935507835925601, "train/step_canary_loss": 10.625000238418579, "perf/step_duration_sec": 14.81383830588311, "perf/samples_per_sec": 8.84308288608599, "perf/tokens_per_sec": 6924.876448749963, "perf/logical_batch_size": 131.0, "perf/logical_token_count": 102584.0, "perf/physical_batches": 18.0, "privacy/epsilon": 3.599257677191776, "system/cuda_memory_allocated_gb": 15.317307472229004, "system/cuda_max_memory_allocated_gb": 54.062880516052246}}
4
+ {"timestamp": 1773852833.9397993, "event": "train_step", "step": 40, "epoch": 1, "metrics": {"train/step_loss": 1.6915703279000742, "train/step_real_loss": 1.1175741739571095, "train/lr": 0.00018568571761675893, "train/step_canary_loss": 12.1875, "perf/step_duration_sec": 14.987364898901433, "perf/samples_per_sec": 8.940864581860026, "perf/tokens_per_sec": 6826.283385380117, "perf/logical_batch_size": 134.0, "perf/logical_token_count": 102308.0, "perf/physical_batches": 18.0, "privacy/epsilon": 4.0171270793767535, "system/cuda_memory_allocated_gb": 15.894390106201172, "system/cuda_max_memory_allocated_gb": 54.062883377075195}}
5
+ {"timestamp": 1773852981.6699533, "event": "train_step", "step": 50, "epoch": 1, "metrics": {"train/step_loss": 1.730209876872875, "train/step_real_loss": 1.1695572771131992, "train/lr": 0.00017503498221564025, "train/step_canary_loss": 11.982143129621234, "perf/step_duration_sec": 15.535889676073566, "perf/samples_per_sec": 8.625189982287917, "perf/tokens_per_sec": 6820.401162038881, "perf/logical_batch_size": 134.0, "perf/logical_token_count": 105961.0, "perf/physical_batches": 18.0, "privacy/epsilon": 4.394850417905478, "system/cuda_memory_allocated_gb": 15.894390106201172, "system/cuda_max_memory_allocated_gb": 54.062883377075195}}
6
+ {"timestamp": 1773853001.9967575, "event": "eval_step", "step": 50, "epoch": 1, "metrics": {"eval/loss": 1.0429061587367738, "eval/duration_sec": 20.30736266821623}}
7
+ {"timestamp": 1773853155.8696322, "event": "train_step", "step": 60, "epoch": 1, "metrics": {"train/step_loss": 1.5988739917152806, "train/step_real_loss": 1.106154203414917, "train/lr": 0.0001619448361215723, "train/step_canary_loss": 14.21250057220459, "perf/step_duration_sec": 14.15656855283305, "perf/samples_per_sec": 9.3949320771935, "perf/tokens_per_sec": 7349.238596324901, "perf/logical_batch_size": 133.0, "perf/logical_token_count": 104040.0, "perf/physical_batches": 17.0, "privacy/epsilon": 4.743740138692227, "system/cuda_memory_allocated_gb": 15.702028751373291, "system/cuda_max_memory_allocated_gb": 54.062886238098145}}
8
+ {"timestamp": 1773853298.6477532, "event": "train_step", "step": 70, "epoch": 1, "metrics": {"train/step_loss": 1.5077286886446404, "train/step_real_loss": 1.1227163039147854, "train/lr": 0.00014684084406997903, "train/step_canary_loss": 13.828125, "perf/step_duration_sec": 14.256150827044621, "perf/samples_per_sec": 9.25916129826499, "perf/tokens_per_sec": 6918.066538192309, "perf/logical_batch_size": 132.0, "perf/logical_token_count": 98625.0, "perf/physical_batches": 17.0, "privacy/epsilon": 5.069830876941064, "system/cuda_memory_allocated_gb": 15.509668827056885, "system/cuda_max_memory_allocated_gb": 54.062886238098145}}
9
+ {"timestamp": 1773853446.331358, "event": "train_step", "step": 80, "epoch": 1, "metrics": {"train/step_loss": 1.611925903119539, "train/step_real_loss": 1.1202042661607265, "train/lr": 0.00013021404155695725, "train/step_canary_loss": 14.199999809265137, "perf/step_duration_sec": 14.11704233684577, "perf/samples_per_sec": 9.421236887054398, "perf/tokens_per_sec": 7214.046509883511, "perf/logical_batch_size": 133.0, "perf/logical_token_count": 101841.0, "perf/physical_batches": 17.0, "privacy/epsilon": 5.377982250509876, "system/cuda_memory_allocated_gb": 15.702028751373291, "system/cuda_max_memory_allocated_gb": 54.062886238098145}}
10
+ {"timestamp": 1773853593.7571762, "event": "train_step", "step": 90, "epoch": 1, "metrics": {"train/step_loss": 1.8932846375625498, "train/step_real_loss": 1.1377343386411667, "train/lr": 0.00011260497112202895, "train/step_canary_loss": 12.63888888888889, "perf/step_duration_sec": 14.762270654086024, "perf/samples_per_sec": 9.21267487819408, "perf/tokens_per_sec": 6934.841014560594, "perf/logical_batch_size": 136.0, "perf/logical_token_count": 102374.0, "perf/physical_batches": 18.0, "privacy/epsilon": 5.671744621870462, "system/cuda_memory_allocated_gb": 16.279295921325684, "system/cuda_max_memory_allocated_gb": 54.062886238098145}}
11
+ {"timestamp": 1773853638.1426697, "event": "train_epoch", "step": 92, "epoch": 1, "metrics": {"train/epoch_loss": 1.7500966633389758, "train/epoch_real_loss": 1.133818452948967, "train/epoch_canary_loss": 13.288580806015256, "perf/epoch_duration_sec": 1412.2077000171412, "perf/epoch_samples_per_sec": 34.83623549099956, "perf/epoch_tokens_per_sec": 26418.67269208853, "perf/epoch_samples": 49196.0, "perf/epoch_tokens": 37308653.0, "system/cuda_epoch_peak_memory_gb": 54.062886238098145, "eval/loss": 1.03997564451261, "eval/duration_sec": 20.698376037878916, "privacy/epsilon": 5.729164243937991}}
12
+ {"timestamp": 1773853645.390464, "event": "audit_epoch", "step": 92, "epoch": 1, "metrics": {"audit/delta": 1e-05, "audit/num_canaries": 500.0, "audit/num_members": 250.0, "audit/paper_guess_fraction": 0.2, "audit/paper_guess_steps": 20.0, "audit/loss/auc": 0.552536, "audit/loss/empirical_epsilon/0.05": 0.3197584319859743, "audit/loss/empirical_epsilon/0.01": 0.030605491250753403, "audit/loss/empirical_epsilon_details/0.05/epsilon": 0.3197584319859743, "audit/loss/empirical_epsilon_details/0.05/num_guesses": 25.0, "audit/loss/empirical_epsilon_details/0.05/correct_guesses": 19.0, "audit/loss/empirical_epsilon_details/0.01/epsilon": 0.030605491250753403, "audit/loss/empirical_epsilon_details/0.01/num_guesses": 25.0, "audit/loss/empirical_epsilon_details/0.01/correct_guesses": 19.0, "audit/embedding/auc": 0.507808, "audit/embedding/empirical_epsilon/0.05": 0.0, "audit/embedding/empirical_epsilon/0.01": 0.0, "audit/embedding/empirical_epsilon_details/0.05/epsilon": 0.0, "audit/embedding/empirical_epsilon_details/0.05/num_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.05/correct_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.01/epsilon": 0.0, "audit/embedding/empirical_epsilon_details/0.01/num_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.01/correct_guesses": 0.0, "perf/audit_duration_sec": 5.064277199096978}}
13
+ {"timestamp": 1773853767.2709792, "event": "train_step", "step": 100, "epoch": 2, "metrics": {"train/step_loss": 2.0532480357349785, "train/step_real_loss": 1.1272322572767735, "train/lr": 9.458610914145826e-05, "train/step_canary_loss": 13.90625, "perf/step_duration_sec": 14.751106533920392, "perf/samples_per_sec": 9.355230381033918, "perf/tokens_per_sec": 7110.44963025728, "perf/logical_batch_size": 138.0, "perf/logical_token_count": 104887.0, "perf/physical_batches": 18.0, "privacy/epsilon": 5.953156126903914, "system/cuda_memory_allocated_gb": 15.12495470046997, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
14
+ {"timestamp": 1773853787.107858, "event": "eval_step", "step": 100, "epoch": 2, "metrics": {"eval/loss": 1.0396132693662272, "eval/duration_sec": 19.829364891862497}}
15
+ {"timestamp": 1773853935.771681, "event": "train_step", "step": 110, "epoch": 2, "metrics": {"train/step_loss": 1.647982077812081, "train/step_real_loss": 1.1710320189595222, "train/lr": 7.674325444256899e-05, "train/step_canary_loss": 11.822916666666666, "perf/step_duration_sec": 14.729006989859045, "perf/samples_per_sec": 9.029800861087974, "perf/tokens_per_sec": 6888.787551656326, "perf/logical_batch_size": 133.0, "perf/logical_token_count": 101465.0, "perf/physical_batches": 18.0, "privacy/epsilon": 6.2242325072714415, "system/cuda_memory_allocated_gb": 15.702028751373291, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
16
+ {"timestamp": 1773854082.9588912, "event": "train_step", "step": 120, "epoch": 2, "metrics": {"train/step_loss": 1.8470192860512837, "train/step_real_loss": 1.1087237671017647, "train/lr": 5.965648380101916e-05, "train/step_canary_loss": 12.347222222222221, "perf/step_duration_sec": 14.77171956608072, "perf/samples_per_sec": 9.206781877465872, "perf/tokens_per_sec": 6978.266784640144, "perf/logical_batch_size": 136.0, "perf/logical_token_count": 103081.0, "perf/physical_batches": 18.0, "privacy/epsilon": 6.487004247951293, "system/cuda_memory_allocated_gb": 16.279295921325684, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
17
+ {"timestamp": 1773854228.6299124, "event": "train_step", "step": 130, "epoch": 2, "metrics": {"train/step_loss": 1.4841852043614243, "train/step_real_loss": 1.1038081794977188, "train/lr": 4.388129346376178e-05, "train/step_canary_loss": 13.65625, "perf/step_duration_sec": 14.138089621905237, "perf/samples_per_sec": 9.336480637064444, "perf/tokens_per_sec": 7087.591229068504, "perf/logical_batch_size": 132.0, "perf/logical_token_count": 100205.0, "perf/physical_batches": 17.0, "privacy/epsilon": 6.738888126040064, "system/cuda_memory_allocated_gb": 15.509668827056885, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
18
+ {"timestamp": 1773854374.1609344, "event": "train_step", "step": 140, "epoch": 2, "metrics": {"train/step_loss": 1.2703148426900384, "train/step_real_loss": 1.083779253065586, "train/lr": 2.993053979266577e-05, "train/step_canary_loss": 9.229166666666666, "perf/step_duration_sec": 14.757511151023209, "perf/samples_per_sec": 8.809073472459241, "perf/tokens_per_sec": 6979.293388022188, "perf/logical_batch_size": 130.0, "perf/logical_token_count": 102997.0, "perf/physical_batches": 18.0, "privacy/epsilon": 6.9846017598599595, "system/cuda_memory_allocated_gb": 15.124946117401123, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
19
+ {"timestamp": 1773854520.2708924, "event": "train_step", "step": 150, "epoch": 2, "metrics": {"train/step_loss": 1.4772591663680914, "train/step_real_loss": 1.1925464905798435, "train/lr": 1.825776614411082e-05, "train/step_canary_loss": 13.625, "perf/step_duration_sec": 14.719724283087999, "perf/samples_per_sec": 8.899623218521182, "perf/tokens_per_sec": 6637.556391749427, "perf/logical_batch_size": 131.0, "perf/logical_token_count": 97703.0, "perf/physical_batches": 17.0, "privacy/epsilon": 7.225647671872536, "system/cuda_memory_allocated_gb": 15.317307472229004, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
20
+ {"timestamp": 1773854538.402299, "event": "eval_step", "step": 150, "epoch": 2, "metrics": {"eval/loss": 1.0383169391712586, "eval/duration_sec": 18.111375170992687}}
21
+ {"timestamp": 1773854691.1560457, "event": "train_step", "step": 160, "epoch": 2, "metrics": {"train/step_loss": 1.6241072825531462, "train/step_real_loss": 1.152385726571083, "train/lr": 9.242458032904311e-06, "train/step_canary_loss": 11.687500476837158, "perf/step_duration_sec": 14.878075499087572, "perf/samples_per_sec": 8.93932820868912, "perf/tokens_per_sec": 6843.62705420095, "perf/logical_batch_size": 133.0, "perf/logical_token_count": 101820.0, "perf/physical_batches": 18.0, "privacy/epsilon": 7.457279858735506, "system/cuda_memory_allocated_gb": 15.702028751373291, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
22
+ {"timestamp": 1773854837.3778715, "event": "train_step", "step": 170, "epoch": 2, "metrics": {"train/step_loss": 1.382974067717108, "train/step_real_loss": 1.0921453274786472, "train/lr": 3.1777059397436692e-06, "train/step_canary_loss": 13.791666984558105, "perf/step_duration_sec": 14.022617863025516, "perf/samples_per_sec": 9.342050199158423, "perf/tokens_per_sec": 7510.50916660128, "perf/logical_batch_size": 131.0, "perf/logical_token_count": 105317.0, "perf/physical_batches": 17.0, "privacy/epsilon": 7.687885302283429, "system/cuda_memory_allocated_gb": 15.317307472229004, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
23
+ {"timestamp": 1773854982.5852828, "event": "train_step", "step": 180, "epoch": 2, "metrics": {"train/step_loss": 1.7006171685677987, "train/step_real_loss": 1.1432290449738503, "train/lr": 2.606768482050215e-07, "train/step_canary_loss": 11.892857142857142, "perf/step_duration_sec": 14.94509603898041, "perf/samples_per_sec": 8.966151816655827, "perf/tokens_per_sec": 6624.1795798291805, "perf/logical_batch_size": 134.0, "perf/logical_token_count": 98999.0, "perf/physical_batches": 18.0, "privacy/epsilon": 7.908478086773533, "system/cuda_memory_allocated_gb": 15.894390106201172, "system/cuda_max_memory_allocated_gb": 54.06288194656372}}
24
+ {"timestamp": 1773855055.0742006, "event": "train_epoch", "step": 184, "epoch": 2, "metrics": {"train/epoch_loss": 1.7304604712060176, "train/epoch_real_loss": 1.1275523616137826, "train/epoch_canary_loss": 13.386261670760845, "perf/epoch_duration_sec": 1389.9474938560743, "perf/epoch_samples_per_sec": 35.36968138531038, "perf/epoch_tokens_per_sec": 26840.30811588557, "perf/epoch_samples": 49162.0, "perf/epoch_tokens": 37306619.0, "system/cuda_epoch_peak_memory_gb": 54.06288194656372, "eval/loss": 1.0382178419983232, "eval/duration_sec": 19.597126913955435, "privacy/epsilon": 7.99669228530272}}
25
+ {"timestamp": 1773855064.748227, "event": "audit_epoch", "step": 184, "epoch": 2, "metrics": {"audit/delta": 1e-05, "audit/num_canaries": 500.0, "audit/num_members": 250.0, "audit/paper_guess_fraction": 0.2, "audit/paper_guess_steps": 20.0, "audit/loss/auc": 0.562848, "audit/loss/empirical_epsilon/0.05": 0.42648759204894304, "audit/loss/empirical_epsilon/0.01": 0.16005427204072475, "audit/loss/empirical_epsilon_details/0.05/epsilon": 0.42648759204894304, "audit/loss/empirical_epsilon_details/0.05/num_guesses": 30.0, "audit/loss/empirical_epsilon_details/0.05/correct_guesses": 23.0, "audit/loss/empirical_epsilon_details/0.01/epsilon": 0.16005427204072475, "audit/loss/empirical_epsilon_details/0.01/num_guesses": 30.0, "audit/loss/empirical_epsilon_details/0.01/correct_guesses": 23.0, "audit/embedding/auc": 0.50796, "audit/embedding/empirical_epsilon/0.05": 0.0, "audit/embedding/empirical_epsilon/0.01": 0.0, "audit/embedding/empirical_epsilon_details/0.05/epsilon": 0.0, "audit/embedding/empirical_epsilon_details/0.05/num_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.05/correct_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.01/epsilon": 0.0, "audit/embedding/empirical_epsilon_details/0.01/num_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.01/correct_guesses": 0.0, "perf/audit_duration_sec": 7.245345794828609}}
26
+ {"timestamp": 1773855072.9264297, "event": "audit_final", "step": 184, "epoch": 2, "metrics": {"audit/delta": 1e-05, "audit/num_canaries": 500.0, "audit/num_members": 250.0, "audit/paper_guess_fraction": 0.2, "audit/paper_guess_steps": 20.0, "audit/loss/auc": 0.563808, "audit/loss/empirical_epsilon/0.05": 0.42648759204894304, "audit/loss/empirical_epsilon/0.01": 0.16005427204072475, "audit/loss/empirical_epsilon_details/0.05/epsilon": 0.42648759204894304, "audit/loss/empirical_epsilon_details/0.05/num_guesses": 30.0, "audit/loss/empirical_epsilon_details/0.05/correct_guesses": 23.0, "audit/loss/empirical_epsilon_details/0.01/epsilon": 0.16005427204072475, "audit/loss/empirical_epsilon_details/0.01/num_guesses": 30.0, "audit/loss/empirical_epsilon_details/0.01/correct_guesses": 23.0, "audit/embedding/auc": 0.50796, "audit/embedding/empirical_epsilon/0.05": 0.0, "audit/embedding/empirical_epsilon/0.01": 0.0, "audit/embedding/empirical_epsilon_details/0.05/epsilon": 0.0, "audit/embedding/empirical_epsilon_details/0.05/num_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.05/correct_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.01/epsilon": 0.0, "audit/embedding/empirical_epsilon_details/0.01/num_guesses": 0.0, "audit/embedding/empirical_epsilon_details/0.01/correct_guesses": 0.0}}
27
+ {"timestamp": 1773855073.4648237, "event": "energy_final", "step": 184, "epoch": null, "metrics": {"energy/codecarbon/duration": 2940.2213213280775, "energy/codecarbon/emissions": 0.04336494635667721, "energy/codecarbon/emissions_rate": 1.4748871468318434e-05, "energy/codecarbon/cpu_power": 82.44163995833674, "energy/codecarbon/gpu_power": 1409.9170137162785, "energy/codecarbon/ram_power": 38.0, "energy/codecarbon/cpu_energy": 0.06497743055379518, "energy/codecarbon/gpu_energy": 1.1496539994446735, "energy/codecarbon/ram_energy": 0.029949873467856485, "energy/codecarbon/energy_consumed": 1.2445813034663262, "energy/codecarbon/water_consumed": 0.0, "energy/codecarbon/cpu_count": 8.0, "energy/codecarbon/gpu_count": 5.0, "energy/codecarbon/longitude": 8.212, "energy/codecarbon/latitude": 47.4843, "energy/codecarbon/ram_total_size": 128.0, "energy/codecarbon/cpu_utilization_percent": 12.307671326287071, "energy/codecarbon/gpu_utilization_percent": 66.43163995908625, "energy/codecarbon/ram_utilization_percent": 8.260415956358626, "energy/codecarbon/ram_used_gb": 166.47142205691932, "energy/codecarbon/pue": 1.0, "energy/codecarbon/wue": 0.0}}
granite-4.0-h-tiny/dp8/pretrain_lm_head.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23d4c2cffb51b108b4c377ffa44775b5e654a4b01b09c46ca4e90494d144fd82
3
+ size 309818984
granite-4.0-h-tiny/dp8/resolved_config.yaml ADDED
@@ -0,0 +1,110 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ model:
2
+ name: ibm-granite/granite-4.0-h-tiny
3
+ tokenizer_name: ibm-granite/granite-4.0-h-tiny
4
+ max_length: 1024
5
+ dtype: bfloat16
6
+ trust_remote_code: true
7
+ use_fast_tokenizer: true
8
+ cache_dir: null
9
+ local_files_only: false
10
+ low_cpu_mem_usage: true
11
+ tie_word_embeddings: true
12
+ gradient_checkpointing: false
13
+ use_chat_template: false
14
+ dataset:
15
+ name: melihcatal/codedp-cpt
16
+ split: train
17
+ mode: cpt
18
+ text_column: text
19
+ validation_ratio: 0.05
20
+ max_samples: -1
21
+ lora:
22
+ enabled: true
23
+ r: 16
24
+ alpha: 32
25
+ dropout: 0.05
26
+ target_modules:
27
+ - q_proj
28
+ - k_proj
29
+ - v_proj
30
+ - o_proj
31
+ modules_to_save:
32
+ - lm_head
33
+ bias: none
34
+ training:
35
+ seed: 42
36
+ epochs: 2
37
+ warmup_steps: null
38
+ warmup_ratio: 0.05
39
+ mixed_precision: false
40
+ mixed_precision_dtype: bfloat16
41
+ batch_size: 8
42
+ eval_batch_size: 8
43
+ eval_every_steps: 50
44
+ eval_every_epochs: 1
45
+ learning_rate: 0.0002
46
+ optimizer: adamw
47
+ lr_scheduler: cosine
48
+ adam_beta1: 0.9
49
+ adam_beta2: 0.999
50
+ adam_epsilon: 1.0e-08
51
+ sgd_momentum: 0.9
52
+ weight_decay: 0.01
53
+ max_grad_norm: 1.0
54
+ log_every: 10
55
+ gradient_accumulation_steps: 16
56
+ num_workers: 4
57
+ output_dir: runs/cpt/granite-4.0-h-tiny/dp8
58
+ distributed:
59
+ strategy: dpddp
60
+ backend: nccl
61
+ devices: null
62
+ dp:
63
+ module_validator: auto
64
+ target_delta: 1.0e-05
65
+ noise_multiplier: null
66
+ max_grad_norm: 1.0
67
+ grad_sample_mode: hooks
68
+ clipping: flat
69
+ secure_mode: false
70
+ enabled: true
71
+ target_epsilon: 8.0
72
+ audit:
73
+ enabled: true
74
+ run_every_epoch: true
75
+ epoch_device: cuda
76
+ q_canary: auto
77
+ num_canaries: 500
78
+ prefix_length: 49
79
+ num_digits: 12
80
+ batch_size: 32
81
+ delta: 1.0e-05
82
+ p_values:
83
+ - 0.05
84
+ - 0.01
85
+ paper_guess_fraction: 0.2
86
+ paper_guess_steps: 20
87
+ enable_holdout_empirical_epsilon: false
88
+ holdout_seed: 42
89
+ tie_seed: 42
90
+ tracking:
91
+ enabled: true
92
+ tensorboard: true
93
+ wandb: false
94
+ wandb_project: codedp-finetune-h200-audit
95
+ wandb_run_name: granite-4.0-h-tiny-cpt-dp8
96
+ wandb_mode: online
97
+ codecarbon: true
98
+ codecarbon_output_file: codecarbon.csv
99
+ codecarbon_measure_power_secs: 15
100
+ codecarbon_country_iso_code: null
101
+ codecarbon_project_name: codedp-granite-4.0-h-tiny-cpt-dp8
102
+ moe:
103
+ output_router_logits: false
104
+ router_aux_loss_coef: 0.0
105
+ freeze_router: true
106
+ profile:
107
+ enabled: false
108
+ num_batches: 8
109
+ top_experts: 8
110
+ output_file: moe_expert_profile.json
granite-4.0-h-tiny/dp8/scalars.csv ADDED
@@ -0,0 +1,358 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ timestamp,event,step,epoch,key,value
2
+ 1773852387.8640254,train_step,10,1,train/step_loss,1.6353936302128123
3
+ 1773852387.8640254,train_step,10,1,train/step_real_loss,1.1510175429284573
4
+ 1773852387.8640254,train_step,10,1,train/lr,0.0002
5
+ 1773852387.8640254,train_step,10,1,train/step_canary_loss,11.968750158945719
6
+ 1773852387.8640254,train_step,10,1,perf/step_duration_sec,14.872664371039718
7
+ 1773852387.8640254,train_step,10,1,perf/samples_per_sec,8.94258060842008
8
+ 1773852387.8640254,train_step,10,1,perf/tokens_per_sec,6777.198589666931
9
+ 1773852387.8640254,train_step,10,1,perf/logical_batch_size,133.0
10
+ 1773852387.8640254,train_step,10,1,perf/logical_token_count,100795.0
11
+ 1773852387.8640254,train_step,10,1,perf/physical_batches,18.0
12
+ 1773852387.8640254,train_step,10,1,privacy/epsilon,2.524123361583601
13
+ 1773852387.8640254,train_step,10,1,system/cuda_memory_allocated_gb,15.702028751373291
14
+ 1773852387.8640254,train_step,10,1,system/cuda_max_memory_allocated_gb,54.06287908554077
15
+ 1773852537.5150325,train_step,20,1,train/step_loss,1.857343329130298
16
+ 1773852537.5150325,train_step,20,1,train/step_real_loss,1.114402625709772
17
+ 1773852537.5150325,train_step,20,1,train/lr,0.00019837448439320027
18
+ 1773852537.5150325,train_step,20,1,train/step_canary_loss,12.42361111111111
19
+ 1773852537.5150325,train_step,20,1,perf/step_duration_sec,15.259514638921246
20
+ 1773852537.5150325,train_step,20,1,perf/samples_per_sec,8.91247219968029
21
+ 1773852537.5150325,train_step,20,1,perf/tokens_per_sec,7023.880020837742
22
+ 1773852537.5150325,train_step,20,1,perf/logical_batch_size,136.0
23
+ 1773852537.5150325,train_step,20,1,perf/logical_token_count,107181.0
24
+ 1773852537.5150325,train_step,20,1,perf/physical_batches,18.0
25
+ 1773852537.5150325,train_step,20,1,privacy/epsilon,3.1196418977343887
26
+ 1773852537.5150325,train_step,20,1,system/cuda_memory_allocated_gb,16.279295921325684
27
+ 1773852537.5150325,train_step,20,1,system/cuda_max_memory_allocated_gb,54.062880516052246
28
+ 1773852684.6348226,train_step,30,1,train/step_loss,1.4355280977306943
29
+ 1773852684.6348226,train_step,30,1,train/step_real_loss,1.148357093334198
30
+ 1773852684.6348226,train_step,30,1,train/lr,0.0001935507835925601
31
+ 1773852684.6348226,train_step,30,1,train/step_canary_loss,10.625000238418579
32
+ 1773852684.6348226,train_step,30,1,perf/step_duration_sec,14.81383830588311
33
+ 1773852684.6348226,train_step,30,1,perf/samples_per_sec,8.84308288608599
34
+ 1773852684.6348226,train_step,30,1,perf/tokens_per_sec,6924.876448749963
35
+ 1773852684.6348226,train_step,30,1,perf/logical_batch_size,131.0
36
+ 1773852684.6348226,train_step,30,1,perf/logical_token_count,102584.0
37
+ 1773852684.6348226,train_step,30,1,perf/physical_batches,18.0
38
+ 1773852684.6348226,train_step,30,1,privacy/epsilon,3.599257677191776
39
+ 1773852684.6348226,train_step,30,1,system/cuda_memory_allocated_gb,15.317307472229004
40
+ 1773852684.6348226,train_step,30,1,system/cuda_max_memory_allocated_gb,54.062880516052246
41
+ 1773852833.9397993,train_step,40,1,train/step_loss,1.6915703279000742
42
+ 1773852833.9397993,train_step,40,1,train/step_real_loss,1.1175741739571095
43
+ 1773852833.9397993,train_step,40,1,train/lr,0.00018568571761675893
44
+ 1773852833.9397993,train_step,40,1,train/step_canary_loss,12.1875
45
+ 1773852833.9397993,train_step,40,1,perf/step_duration_sec,14.987364898901433
46
+ 1773852833.9397993,train_step,40,1,perf/samples_per_sec,8.940864581860026
47
+ 1773852833.9397993,train_step,40,1,perf/tokens_per_sec,6826.283385380117
48
+ 1773852833.9397993,train_step,40,1,perf/logical_batch_size,134.0
49
+ 1773852833.9397993,train_step,40,1,perf/logical_token_count,102308.0
50
+ 1773852833.9397993,train_step,40,1,perf/physical_batches,18.0
51
+ 1773852833.9397993,train_step,40,1,privacy/epsilon,4.0171270793767535
52
+ 1773852833.9397993,train_step,40,1,system/cuda_memory_allocated_gb,15.894390106201172
53
+ 1773852833.9397993,train_step,40,1,system/cuda_max_memory_allocated_gb,54.062883377075195
54
+ 1773852981.6699533,train_step,50,1,train/step_loss,1.730209876872875
55
+ 1773852981.6699533,train_step,50,1,train/step_real_loss,1.1695572771131992
56
+ 1773852981.6699533,train_step,50,1,train/lr,0.00017503498221564025
57
+ 1773852981.6699533,train_step,50,1,train/step_canary_loss,11.982143129621234
58
+ 1773852981.6699533,train_step,50,1,perf/step_duration_sec,15.535889676073566
59
+ 1773852981.6699533,train_step,50,1,perf/samples_per_sec,8.625189982287917
60
+ 1773852981.6699533,train_step,50,1,perf/tokens_per_sec,6820.401162038881
61
+ 1773852981.6699533,train_step,50,1,perf/logical_batch_size,134.0
62
+ 1773852981.6699533,train_step,50,1,perf/logical_token_count,105961.0
63
+ 1773852981.6699533,train_step,50,1,perf/physical_batches,18.0
64
+ 1773852981.6699533,train_step,50,1,privacy/epsilon,4.394850417905478
65
+ 1773852981.6699533,train_step,50,1,system/cuda_memory_allocated_gb,15.894390106201172
66
+ 1773852981.6699533,train_step,50,1,system/cuda_max_memory_allocated_gb,54.062883377075195
67
+ 1773853001.9967575,eval_step,50,1,eval/loss,1.0429061587367738
68
+ 1773853001.9967575,eval_step,50,1,eval/duration_sec,20.30736266821623
69
+ 1773853155.8696322,train_step,60,1,train/step_loss,1.5988739917152806
70
+ 1773853155.8696322,train_step,60,1,train/step_real_loss,1.106154203414917
71
+ 1773853155.8696322,train_step,60,1,train/lr,0.0001619448361215723
72
+ 1773853155.8696322,train_step,60,1,train/step_canary_loss,14.21250057220459
73
+ 1773853155.8696322,train_step,60,1,perf/step_duration_sec,14.15656855283305
74
+ 1773853155.8696322,train_step,60,1,perf/samples_per_sec,9.3949320771935
75
+ 1773853155.8696322,train_step,60,1,perf/tokens_per_sec,7349.238596324901
76
+ 1773853155.8696322,train_step,60,1,perf/logical_batch_size,133.0
77
+ 1773853155.8696322,train_step,60,1,perf/logical_token_count,104040.0
78
+ 1773853155.8696322,train_step,60,1,perf/physical_batches,17.0
79
+ 1773853155.8696322,train_step,60,1,privacy/epsilon,4.743740138692227
80
+ 1773853155.8696322,train_step,60,1,system/cuda_memory_allocated_gb,15.702028751373291
81
+ 1773853155.8696322,train_step,60,1,system/cuda_max_memory_allocated_gb,54.062886238098145
82
+ 1773853298.6477532,train_step,70,1,train/step_loss,1.5077286886446404
83
+ 1773853298.6477532,train_step,70,1,train/step_real_loss,1.1227163039147854
84
+ 1773853298.6477532,train_step,70,1,train/lr,0.00014684084406997903
85
+ 1773853298.6477532,train_step,70,1,train/step_canary_loss,13.828125
86
+ 1773853298.6477532,train_step,70,1,perf/step_duration_sec,14.256150827044621
87
+ 1773853298.6477532,train_step,70,1,perf/samples_per_sec,9.25916129826499
88
+ 1773853298.6477532,train_step,70,1,perf/tokens_per_sec,6918.066538192309
89
+ 1773853298.6477532,train_step,70,1,perf/logical_batch_size,132.0
90
+ 1773853298.6477532,train_step,70,1,perf/logical_token_count,98625.0
91
+ 1773853298.6477532,train_step,70,1,perf/physical_batches,17.0
92
+ 1773853298.6477532,train_step,70,1,privacy/epsilon,5.069830876941064
93
+ 1773853298.6477532,train_step,70,1,system/cuda_memory_allocated_gb,15.509668827056885
94
+ 1773853298.6477532,train_step,70,1,system/cuda_max_memory_allocated_gb,54.062886238098145
95
+ 1773853446.331358,train_step,80,1,train/step_loss,1.611925903119539
96
+ 1773853446.331358,train_step,80,1,train/step_real_loss,1.1202042661607265
97
+ 1773853446.331358,train_step,80,1,train/lr,0.00013021404155695725
98
+ 1773853446.331358,train_step,80,1,train/step_canary_loss,14.199999809265137
99
+ 1773853446.331358,train_step,80,1,perf/step_duration_sec,14.11704233684577
100
+ 1773853446.331358,train_step,80,1,perf/samples_per_sec,9.421236887054398
101
+ 1773853446.331358,train_step,80,1,perf/tokens_per_sec,7214.046509883511
102
+ 1773853446.331358,train_step,80,1,perf/logical_batch_size,133.0
103
+ 1773853446.331358,train_step,80,1,perf/logical_token_count,101841.0
104
+ 1773853446.331358,train_step,80,1,perf/physical_batches,17.0
105
+ 1773853446.331358,train_step,80,1,privacy/epsilon,5.377982250509876
106
+ 1773853446.331358,train_step,80,1,system/cuda_memory_allocated_gb,15.702028751373291
107
+ 1773853446.331358,train_step,80,1,system/cuda_max_memory_allocated_gb,54.062886238098145
108
+ 1773853593.7571762,train_step,90,1,train/step_loss,1.8932846375625498
109
+ 1773853593.7571762,train_step,90,1,train/step_real_loss,1.1377343386411667
110
+ 1773853593.7571762,train_step,90,1,train/lr,0.00011260497112202895
111
+ 1773853593.7571762,train_step,90,1,train/step_canary_loss,12.63888888888889
112
+ 1773853593.7571762,train_step,90,1,perf/step_duration_sec,14.762270654086024
113
+ 1773853593.7571762,train_step,90,1,perf/samples_per_sec,9.21267487819408
114
+ 1773853593.7571762,train_step,90,1,perf/tokens_per_sec,6934.841014560594
115
+ 1773853593.7571762,train_step,90,1,perf/logical_batch_size,136.0
116
+ 1773853593.7571762,train_step,90,1,perf/logical_token_count,102374.0
117
+ 1773853593.7571762,train_step,90,1,perf/physical_batches,18.0
118
+ 1773853593.7571762,train_step,90,1,privacy/epsilon,5.671744621870462
119
+ 1773853593.7571762,train_step,90,1,system/cuda_memory_allocated_gb,16.279295921325684
120
+ 1773853593.7571762,train_step,90,1,system/cuda_max_memory_allocated_gb,54.062886238098145
121
+ 1773853638.1426697,train_epoch,92,1,train/epoch_loss,1.7500966633389758
122
+ 1773853638.1426697,train_epoch,92,1,train/epoch_real_loss,1.133818452948967
123
+ 1773853638.1426697,train_epoch,92,1,train/epoch_canary_loss,13.288580806015256
124
+ 1773853638.1426697,train_epoch,92,1,perf/epoch_duration_sec,1412.2077000171412
125
+ 1773853638.1426697,train_epoch,92,1,perf/epoch_samples_per_sec,34.83623549099956
126
+ 1773853638.1426697,train_epoch,92,1,perf/epoch_tokens_per_sec,26418.67269208853
127
+ 1773853638.1426697,train_epoch,92,1,perf/epoch_samples,49196.0
128
+ 1773853638.1426697,train_epoch,92,1,perf/epoch_tokens,37308653.0
129
+ 1773853638.1426697,train_epoch,92,1,system/cuda_epoch_peak_memory_gb,54.062886238098145
130
+ 1773853638.1426697,train_epoch,92,1,eval/loss,1.03997564451261
131
+ 1773853638.1426697,train_epoch,92,1,eval/duration_sec,20.698376037878916
132
+ 1773853638.1426697,train_epoch,92,1,privacy/epsilon,5.729164243937991
133
+ 1773853645.390464,audit_epoch,92,1,audit/delta,1e-05
134
+ 1773853645.390464,audit_epoch,92,1,audit/num_canaries,500.0
135
+ 1773853645.390464,audit_epoch,92,1,audit/num_members,250.0
136
+ 1773853645.390464,audit_epoch,92,1,audit/paper_guess_fraction,0.2
137
+ 1773853645.390464,audit_epoch,92,1,audit/paper_guess_steps,20.0
138
+ 1773853645.390464,audit_epoch,92,1,audit/loss/auc,0.552536
139
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon/0.05,0.3197584319859743
140
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon/0.01,0.030605491250753403
141
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon_details/0.05/epsilon,0.3197584319859743
142
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon_details/0.05/num_guesses,25.0
143
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon_details/0.05/correct_guesses,19.0
144
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon_details/0.01/epsilon,0.030605491250753403
145
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon_details/0.01/num_guesses,25.0
146
+ 1773853645.390464,audit_epoch,92,1,audit/loss/empirical_epsilon_details/0.01/correct_guesses,19.0
147
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/auc,0.507808
148
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon/0.05,0.0
149
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon/0.01,0.0
150
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon_details/0.05/epsilon,0.0
151
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon_details/0.05/num_guesses,0.0
152
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon_details/0.05/correct_guesses,0.0
153
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon_details/0.01/epsilon,0.0
154
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon_details/0.01/num_guesses,0.0
155
+ 1773853645.390464,audit_epoch,92,1,audit/embedding/empirical_epsilon_details/0.01/correct_guesses,0.0
156
+ 1773853645.390464,audit_epoch,92,1,perf/audit_duration_sec,5.064277199096978
157
+ 1773853767.2709792,train_step,100,2,train/step_loss,2.0532480357349785
158
+ 1773853767.2709792,train_step,100,2,train/step_real_loss,1.1272322572767735
159
+ 1773853767.2709792,train_step,100,2,train/lr,9.458610914145826e-05
160
+ 1773853767.2709792,train_step,100,2,train/step_canary_loss,13.90625
161
+ 1773853767.2709792,train_step,100,2,perf/step_duration_sec,14.751106533920392
162
+ 1773853767.2709792,train_step,100,2,perf/samples_per_sec,9.355230381033918
163
+ 1773853767.2709792,train_step,100,2,perf/tokens_per_sec,7110.44963025728
164
+ 1773853767.2709792,train_step,100,2,perf/logical_batch_size,138.0
165
+ 1773853767.2709792,train_step,100,2,perf/logical_token_count,104887.0
166
+ 1773853767.2709792,train_step,100,2,perf/physical_batches,18.0
167
+ 1773853767.2709792,train_step,100,2,privacy/epsilon,5.953156126903914
168
+ 1773853767.2709792,train_step,100,2,system/cuda_memory_allocated_gb,15.12495470046997
169
+ 1773853767.2709792,train_step,100,2,system/cuda_max_memory_allocated_gb,54.06288194656372
170
+ 1773853787.107858,eval_step,100,2,eval/loss,1.0396132693662272
171
+ 1773853787.107858,eval_step,100,2,eval/duration_sec,19.829364891862497
172
+ 1773853935.771681,train_step,110,2,train/step_loss,1.647982077812081
173
+ 1773853935.771681,train_step,110,2,train/step_real_loss,1.1710320189595222
174
+ 1773853935.771681,train_step,110,2,train/lr,7.674325444256899e-05
175
+ 1773853935.771681,train_step,110,2,train/step_canary_loss,11.822916666666666
176
+ 1773853935.771681,train_step,110,2,perf/step_duration_sec,14.729006989859045
177
+ 1773853935.771681,train_step,110,2,perf/samples_per_sec,9.029800861087974
178
+ 1773853935.771681,train_step,110,2,perf/tokens_per_sec,6888.787551656326
179
+ 1773853935.771681,train_step,110,2,perf/logical_batch_size,133.0
180
+ 1773853935.771681,train_step,110,2,perf/logical_token_count,101465.0
181
+ 1773853935.771681,train_step,110,2,perf/physical_batches,18.0
182
+ 1773853935.771681,train_step,110,2,privacy/epsilon,6.2242325072714415
183
+ 1773853935.771681,train_step,110,2,system/cuda_memory_allocated_gb,15.702028751373291
184
+ 1773853935.771681,train_step,110,2,system/cuda_max_memory_allocated_gb,54.06288194656372
185
+ 1773854082.9588912,train_step,120,2,train/step_loss,1.8470192860512837
186
+ 1773854082.9588912,train_step,120,2,train/step_real_loss,1.1087237671017647
187
+ 1773854082.9588912,train_step,120,2,train/lr,5.965648380101916e-05
188
+ 1773854082.9588912,train_step,120,2,train/step_canary_loss,12.347222222222221
189
+ 1773854082.9588912,train_step,120,2,perf/step_duration_sec,14.77171956608072
190
+ 1773854082.9588912,train_step,120,2,perf/samples_per_sec,9.206781877465872
191
+ 1773854082.9588912,train_step,120,2,perf/tokens_per_sec,6978.266784640144
192
+ 1773854082.9588912,train_step,120,2,perf/logical_batch_size,136.0
193
+ 1773854082.9588912,train_step,120,2,perf/logical_token_count,103081.0
194
+ 1773854082.9588912,train_step,120,2,perf/physical_batches,18.0
195
+ 1773854082.9588912,train_step,120,2,privacy/epsilon,6.487004247951293
196
+ 1773854082.9588912,train_step,120,2,system/cuda_memory_allocated_gb,16.279295921325684
197
+ 1773854082.9588912,train_step,120,2,system/cuda_max_memory_allocated_gb,54.06288194656372
198
+ 1773854228.6299124,train_step,130,2,train/step_loss,1.4841852043614243
199
+ 1773854228.6299124,train_step,130,2,train/step_real_loss,1.1038081794977188
200
+ 1773854228.6299124,train_step,130,2,train/lr,4.388129346376178e-05
201
+ 1773854228.6299124,train_step,130,2,train/step_canary_loss,13.65625
202
+ 1773854228.6299124,train_step,130,2,perf/step_duration_sec,14.138089621905237
203
+ 1773854228.6299124,train_step,130,2,perf/samples_per_sec,9.336480637064444
204
+ 1773854228.6299124,train_step,130,2,perf/tokens_per_sec,7087.591229068504
205
+ 1773854228.6299124,train_step,130,2,perf/logical_batch_size,132.0
206
+ 1773854228.6299124,train_step,130,2,perf/logical_token_count,100205.0
207
+ 1773854228.6299124,train_step,130,2,perf/physical_batches,17.0
208
+ 1773854228.6299124,train_step,130,2,privacy/epsilon,6.738888126040064
209
+ 1773854228.6299124,train_step,130,2,system/cuda_memory_allocated_gb,15.509668827056885
210
+ 1773854228.6299124,train_step,130,2,system/cuda_max_memory_allocated_gb,54.06288194656372
211
+ 1773854374.1609344,train_step,140,2,train/step_loss,1.2703148426900384
212
+ 1773854374.1609344,train_step,140,2,train/step_real_loss,1.083779253065586
213
+ 1773854374.1609344,train_step,140,2,train/lr,2.993053979266577e-05
214
+ 1773854374.1609344,train_step,140,2,train/step_canary_loss,9.229166666666666
215
+ 1773854374.1609344,train_step,140,2,perf/step_duration_sec,14.757511151023209
216
+ 1773854374.1609344,train_step,140,2,perf/samples_per_sec,8.809073472459241
217
+ 1773854374.1609344,train_step,140,2,perf/tokens_per_sec,6979.293388022188
218
+ 1773854374.1609344,train_step,140,2,perf/logical_batch_size,130.0
219
+ 1773854374.1609344,train_step,140,2,perf/logical_token_count,102997.0
220
+ 1773854374.1609344,train_step,140,2,perf/physical_batches,18.0
221
+ 1773854374.1609344,train_step,140,2,privacy/epsilon,6.9846017598599595
222
+ 1773854374.1609344,train_step,140,2,system/cuda_memory_allocated_gb,15.124946117401123
223
+ 1773854374.1609344,train_step,140,2,system/cuda_max_memory_allocated_gb,54.06288194656372
224
+ 1773854520.2708924,train_step,150,2,train/step_loss,1.4772591663680914
225
+ 1773854520.2708924,train_step,150,2,train/step_real_loss,1.1925464905798435
226
+ 1773854520.2708924,train_step,150,2,train/lr,1.825776614411082e-05
227
+ 1773854520.2708924,train_step,150,2,train/step_canary_loss,13.625
228
+ 1773854520.2708924,train_step,150,2,perf/step_duration_sec,14.719724283087999
229
+ 1773854520.2708924,train_step,150,2,perf/samples_per_sec,8.899623218521182
230
+ 1773854520.2708924,train_step,150,2,perf/tokens_per_sec,6637.556391749427
231
+ 1773854520.2708924,train_step,150,2,perf/logical_batch_size,131.0
232
+ 1773854520.2708924,train_step,150,2,perf/logical_token_count,97703.0
233
+ 1773854520.2708924,train_step,150,2,perf/physical_batches,17.0
234
+ 1773854520.2708924,train_step,150,2,privacy/epsilon,7.225647671872536
235
+ 1773854520.2708924,train_step,150,2,system/cuda_memory_allocated_gb,15.317307472229004
236
+ 1773854520.2708924,train_step,150,2,system/cuda_max_memory_allocated_gb,54.06288194656372
237
+ 1773854538.402299,eval_step,150,2,eval/loss,1.0383169391712586
238
+ 1773854538.402299,eval_step,150,2,eval/duration_sec,18.111375170992687
239
+ 1773854691.1560457,train_step,160,2,train/step_loss,1.6241072825531462
240
+ 1773854691.1560457,train_step,160,2,train/step_real_loss,1.152385726571083
241
+ 1773854691.1560457,train_step,160,2,train/lr,9.242458032904311e-06
242
+ 1773854691.1560457,train_step,160,2,train/step_canary_loss,11.687500476837158
243
+ 1773854691.1560457,train_step,160,2,perf/step_duration_sec,14.878075499087572
244
+ 1773854691.1560457,train_step,160,2,perf/samples_per_sec,8.93932820868912
245
+ 1773854691.1560457,train_step,160,2,perf/tokens_per_sec,6843.62705420095
246
+ 1773854691.1560457,train_step,160,2,perf/logical_batch_size,133.0
247
+ 1773854691.1560457,train_step,160,2,perf/logical_token_count,101820.0
248
+ 1773854691.1560457,train_step,160,2,perf/physical_batches,18.0
249
+ 1773854691.1560457,train_step,160,2,privacy/epsilon,7.457279858735506
250
+ 1773854691.1560457,train_step,160,2,system/cuda_memory_allocated_gb,15.702028751373291
251
+ 1773854691.1560457,train_step,160,2,system/cuda_max_memory_allocated_gb,54.06288194656372
252
+ 1773854837.3778715,train_step,170,2,train/step_loss,1.382974067717108
253
+ 1773854837.3778715,train_step,170,2,train/step_real_loss,1.0921453274786472
254
+ 1773854837.3778715,train_step,170,2,train/lr,3.1777059397436692e-06
255
+ 1773854837.3778715,train_step,170,2,train/step_canary_loss,13.791666984558105
256
+ 1773854837.3778715,train_step,170,2,perf/step_duration_sec,14.022617863025516
257
+ 1773854837.3778715,train_step,170,2,perf/samples_per_sec,9.342050199158423
258
+ 1773854837.3778715,train_step,170,2,perf/tokens_per_sec,7510.50916660128
259
+ 1773854837.3778715,train_step,170,2,perf/logical_batch_size,131.0
260
+ 1773854837.3778715,train_step,170,2,perf/logical_token_count,105317.0
261
+ 1773854837.3778715,train_step,170,2,perf/physical_batches,17.0
262
+ 1773854837.3778715,train_step,170,2,privacy/epsilon,7.687885302283429
263
+ 1773854837.3778715,train_step,170,2,system/cuda_memory_allocated_gb,15.317307472229004
264
+ 1773854837.3778715,train_step,170,2,system/cuda_max_memory_allocated_gb,54.06288194656372
265
+ 1773854982.5852828,train_step,180,2,train/step_loss,1.7006171685677987
266
+ 1773854982.5852828,train_step,180,2,train/step_real_loss,1.1432290449738503
267
+ 1773854982.5852828,train_step,180,2,train/lr,2.606768482050215e-07
268
+ 1773854982.5852828,train_step,180,2,train/step_canary_loss,11.892857142857142
269
+ 1773854982.5852828,train_step,180,2,perf/step_duration_sec,14.94509603898041
270
+ 1773854982.5852828,train_step,180,2,perf/samples_per_sec,8.966151816655827
271
+ 1773854982.5852828,train_step,180,2,perf/tokens_per_sec,6624.1795798291805
272
+ 1773854982.5852828,train_step,180,2,perf/logical_batch_size,134.0
273
+ 1773854982.5852828,train_step,180,2,perf/logical_token_count,98999.0
274
+ 1773854982.5852828,train_step,180,2,perf/physical_batches,18.0
275
+ 1773854982.5852828,train_step,180,2,privacy/epsilon,7.908478086773533
276
+ 1773854982.5852828,train_step,180,2,system/cuda_memory_allocated_gb,15.894390106201172
277
+ 1773854982.5852828,train_step,180,2,system/cuda_max_memory_allocated_gb,54.06288194656372
278
+ 1773855055.0742006,train_epoch,184,2,train/epoch_loss,1.7304604712060176
279
+ 1773855055.0742006,train_epoch,184,2,train/epoch_real_loss,1.1275523616137826
280
+ 1773855055.0742006,train_epoch,184,2,train/epoch_canary_loss,13.386261670760845
281
+ 1773855055.0742006,train_epoch,184,2,perf/epoch_duration_sec,1389.9474938560743
282
+ 1773855055.0742006,train_epoch,184,2,perf/epoch_samples_per_sec,35.36968138531038
283
+ 1773855055.0742006,train_epoch,184,2,perf/epoch_tokens_per_sec,26840.30811588557
284
+ 1773855055.0742006,train_epoch,184,2,perf/epoch_samples,49162.0
285
+ 1773855055.0742006,train_epoch,184,2,perf/epoch_tokens,37306619.0
286
+ 1773855055.0742006,train_epoch,184,2,system/cuda_epoch_peak_memory_gb,54.06288194656372
287
+ 1773855055.0742006,train_epoch,184,2,eval/loss,1.0382178419983232
288
+ 1773855055.0742006,train_epoch,184,2,eval/duration_sec,19.597126913955435
289
+ 1773855055.0742006,train_epoch,184,2,privacy/epsilon,7.99669228530272
290
+ 1773855064.748227,audit_epoch,184,2,audit/delta,1e-05
291
+ 1773855064.748227,audit_epoch,184,2,audit/num_canaries,500.0
292
+ 1773855064.748227,audit_epoch,184,2,audit/num_members,250.0
293
+ 1773855064.748227,audit_epoch,184,2,audit/paper_guess_fraction,0.2
294
+ 1773855064.748227,audit_epoch,184,2,audit/paper_guess_steps,20.0
295
+ 1773855064.748227,audit_epoch,184,2,audit/loss/auc,0.562848
296
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon/0.05,0.42648759204894304
297
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon/0.01,0.16005427204072475
298
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon_details/0.05/epsilon,0.42648759204894304
299
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon_details/0.05/num_guesses,30.0
300
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon_details/0.05/correct_guesses,23.0
301
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon_details/0.01/epsilon,0.16005427204072475
302
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon_details/0.01/num_guesses,30.0
303
+ 1773855064.748227,audit_epoch,184,2,audit/loss/empirical_epsilon_details/0.01/correct_guesses,23.0
304
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/auc,0.50796
305
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon/0.05,0.0
306
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon/0.01,0.0
307
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon_details/0.05/epsilon,0.0
308
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon_details/0.05/num_guesses,0.0
309
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon_details/0.05/correct_guesses,0.0
310
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon_details/0.01/epsilon,0.0
311
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon_details/0.01/num_guesses,0.0
312
+ 1773855064.748227,audit_epoch,184,2,audit/embedding/empirical_epsilon_details/0.01/correct_guesses,0.0
313
+ 1773855064.748227,audit_epoch,184,2,perf/audit_duration_sec,7.245345794828609
314
+ 1773855072.9264297,audit_final,184,2,audit/delta,1e-05
315
+ 1773855072.9264297,audit_final,184,2,audit/num_canaries,500.0
316
+ 1773855072.9264297,audit_final,184,2,audit/num_members,250.0
317
+ 1773855072.9264297,audit_final,184,2,audit/paper_guess_fraction,0.2
318
+ 1773855072.9264297,audit_final,184,2,audit/paper_guess_steps,20.0
319
+ 1773855072.9264297,audit_final,184,2,audit/loss/auc,0.563808
320
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon/0.05,0.42648759204894304
321
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon/0.01,0.16005427204072475
322
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon_details/0.05/epsilon,0.42648759204894304
323
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon_details/0.05/num_guesses,30.0
324
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon_details/0.05/correct_guesses,23.0
325
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon_details/0.01/epsilon,0.16005427204072475
326
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon_details/0.01/num_guesses,30.0
327
+ 1773855072.9264297,audit_final,184,2,audit/loss/empirical_epsilon_details/0.01/correct_guesses,23.0
328
+ 1773855072.9264297,audit_final,184,2,audit/embedding/auc,0.50796
329
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon/0.05,0.0
330
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon/0.01,0.0
331
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon_details/0.05/epsilon,0.0
332
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon_details/0.05/num_guesses,0.0
333
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon_details/0.05/correct_guesses,0.0
334
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon_details/0.01/epsilon,0.0
335
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon_details/0.01/num_guesses,0.0
336
+ 1773855072.9264297,audit_final,184,2,audit/embedding/empirical_epsilon_details/0.01/correct_guesses,0.0
337
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/duration,2940.2213213280775
338
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/emissions,0.04336494635667721
339
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/emissions_rate,1.4748871468318434e-05
340
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/cpu_power,82.44163995833674
341
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/gpu_power,1409.9170137162785
342
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/ram_power,38.0
343
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/cpu_energy,0.06497743055379518
344
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/gpu_energy,1.1496539994446735
345
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/ram_energy,0.029949873467856485
346
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/energy_consumed,1.2445813034663262
347
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/water_consumed,0.0
348
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/cpu_count,8.0
349
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/gpu_count,5.0
350
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/longitude,8.212
351
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/latitude,47.4843
352
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/ram_total_size,128.0
353
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/cpu_utilization_percent,12.307671326287071
354
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/gpu_utilization_percent,66.43163995908625
355
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/ram_utilization_percent,8.260415956358626
356
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/ram_used_gb,166.47142205691932
357
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/pue,1.0
358
+ 1773855073.4648237,energy_final,184,,energy/codecarbon/wue,0.0
granite-4.0-h-tiny/dp8/summary.json ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "audit/delta": 1e-05,
3
+ "audit/embedding/auc": 0.50796,
4
+ "audit/embedding/empirical_epsilon/0.01": 0.0,
5
+ "audit/embedding/empirical_epsilon/0.05": 0.0,
6
+ "audit/embedding/empirical_epsilon_details/0.01/correct_guesses": 0.0,
7
+ "audit/embedding/empirical_epsilon_details/0.01/epsilon": 0.0,
8
+ "audit/embedding/empirical_epsilon_details/0.01/num_guesses": 0.0,
9
+ "audit/embedding/empirical_epsilon_details/0.05/correct_guesses": 0.0,
10
+ "audit/embedding/empirical_epsilon_details/0.05/epsilon": 0.0,
11
+ "audit/embedding/empirical_epsilon_details/0.05/num_guesses": 0.0,
12
+ "audit/loss/auc": 0.563808,
13
+ "audit/loss/empirical_epsilon/0.01": 0.16005427204072475,
14
+ "audit/loss/empirical_epsilon/0.05": 0.42648759204894304,
15
+ "audit/loss/empirical_epsilon_details/0.01/correct_guesses": 23.0,
16
+ "audit/loss/empirical_epsilon_details/0.01/epsilon": 0.16005427204072475,
17
+ "audit/loss/empirical_epsilon_details/0.01/num_guesses": 30.0,
18
+ "audit/loss/empirical_epsilon_details/0.05/correct_guesses": 23.0,
19
+ "audit/loss/empirical_epsilon_details/0.05/epsilon": 0.42648759204894304,
20
+ "audit/loss/empirical_epsilon_details/0.05/num_guesses": 30.0,
21
+ "audit/num_canaries": 500.0,
22
+ "audit/num_members": 250.0,
23
+ "audit/paper_guess_fraction": 0.2,
24
+ "audit/paper_guess_steps": 20.0,
25
+ "energy/codecarbon/cpu_count": 8.0,
26
+ "energy/codecarbon/cpu_energy": 0.06497743055379518,
27
+ "energy/codecarbon/cpu_power": 82.44163995833674,
28
+ "energy/codecarbon/cpu_utilization_percent": 12.307671326287071,
29
+ "energy/codecarbon/duration": 2940.2213213280775,
30
+ "energy/codecarbon/emissions": 0.04336494635667721,
31
+ "energy/codecarbon/emissions_rate": 1.4748871468318434e-05,
32
+ "energy/codecarbon/energy_consumed": 1.2445813034663262,
33
+ "energy/codecarbon/gpu_count": 5.0,
34
+ "energy/codecarbon/gpu_energy": 1.1496539994446735,
35
+ "energy/codecarbon/gpu_power": 1409.9170137162785,
36
+ "energy/codecarbon/gpu_utilization_percent": 66.43163995908625,
37
+ "energy/codecarbon/latitude": 47.4843,
38
+ "energy/codecarbon/longitude": 8.212,
39
+ "energy/codecarbon/pue": 1.0,
40
+ "energy/codecarbon/ram_energy": 0.029949873467856485,
41
+ "energy/codecarbon/ram_power": 38.0,
42
+ "energy/codecarbon/ram_total_size": 128.0,
43
+ "energy/codecarbon/ram_used_gb": 166.47142205691932,
44
+ "energy/codecarbon/ram_utilization_percent": 8.260415956358626,
45
+ "energy/codecarbon/water_consumed": 0.0,
46
+ "energy/codecarbon/wue": 0.0,
47
+ "eval/duration_sec": 19.597126913955435,
48
+ "eval/loss": 1.0382178419983232,
49
+ "perf/audit_duration_sec": 7.245345794828609,
50
+ "perf/epoch_duration_sec": 1389.9474938560743,
51
+ "perf/epoch_samples": 49162.0,
52
+ "perf/epoch_samples_per_sec": 35.36968138531038,
53
+ "perf/epoch_tokens": 37306619.0,
54
+ "perf/epoch_tokens_per_sec": 26840.30811588557,
55
+ "perf/logical_batch_size": 134.0,
56
+ "perf/logical_token_count": 98999.0,
57
+ "perf/physical_batches": 18.0,
58
+ "perf/samples_per_sec": 8.966151816655827,
59
+ "perf/step_duration_sec": 14.94509603898041,
60
+ "perf/tokens_per_sec": 6624.1795798291805,
61
+ "privacy/epsilon": 7.99669228530272,
62
+ "system/cuda_epoch_peak_memory_gb": 54.06288194656372,
63
+ "system/cuda_max_memory_allocated_gb": 54.06288194656372,
64
+ "system/cuda_memory_allocated_gb": 15.894390106201172,
65
+ "train/epoch_canary_loss": 13.386261670760845,
66
+ "train/epoch_loss": 1.7304604712060176,
67
+ "train/epoch_real_loss": 1.1275523616137826,
68
+ "train/lr": 2.606768482050215e-07,
69
+ "train/step_canary_loss": 11.892857142857142,
70
+ "train/step_loss": 1.7006171685677987,
71
+ "train/step_real_loss": 1.1432290449738503
72
+ }
granite-4.0-h-tiny/dp8/tensorboard/events.out.tfevents.1773852132.u24-chaihm0-651.65597.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0c02ab1cf4f214cced72970a2efc91e916c38126e6490ba8a757a4e829da894
3
+ size 25230
granite-4.0-h-tiny/dp8/tokenizer/added_tokens.json ADDED
@@ -0,0 +1,502 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "114848338811": 100360,
3
+ "116427191984": 100714,
4
+ "116639746413": 100686,
5
+ "117298239631": 100576,
6
+ "117657531962": 100633,
7
+ "117783274348": 100650,
8
+ "119342152414": 100723,
9
+ "121557291859": 100582,
10
+ "123741461297": 100491,
11
+ "124589118494": 100487,
12
+ "125866399464": 100596,
13
+ "126574388585": 100538,
14
+ "129693547287": 100472,
15
+ "133373659361": 100667,
16
+ "135441121756": 100355,
17
+ "136931728327": 100457,
18
+ "138154781148": 100767,
19
+ "138218735276": 100651,
20
+ "141499982867": 100745,
21
+ "142526557681": 100845,
22
+ "142799718159": 100709,
23
+ "143182978129": 100671,
24
+ "143777992227": 100366,
25
+ "144373897488": 100777,
26
+ "145669731981": 100581,
27
+ "147444452794": 100830,
28
+ "147541537162": 100775,
29
+ "151859598873": 100547,
30
+ "152676556624": 100682,
31
+ "154962668224": 100696,
32
+ "158142752582": 100577,
33
+ "158929292238": 100587,
34
+ "159337222655": 100422,
35
+ "161238482259": 100790,
36
+ "161588262349": 100437,
37
+ "163165456396": 100788,
38
+ "163497196769": 100820,
39
+ "165429152138": 100717,
40
+ "172599315861": 100371,
41
+ "173781362446": 100423,
42
+ "175469284871": 100515,
43
+ "175528632226": 100833,
44
+ "178478368922": 100762,
45
+ "179386156569": 100804,
46
+ "179564995814": 100697,
47
+ "181233596124": 100782,
48
+ "181439694557": 100398,
49
+ "182345464792": 100442,
50
+ "182782912224": 100624,
51
+ "183368827562": 100551,
52
+ "185438575221": 100537,
53
+ "186198784585": 100598,
54
+ "186872457894": 100835,
55
+ "191887635211": 100721,
56
+ "195388849133": 100792,
57
+ "195792996468": 100546,
58
+ "196119929397": 100611,
59
+ "196735786156": 100493,
60
+ "198462689911": 100428,
61
+ "211411365397": 100377,
62
+ "211662639865": 100706,
63
+ "212985874612": 100720,
64
+ "214193645583": 100802,
65
+ "215671314196": 100602,
66
+ "215826764872": 100756,
67
+ "216667245274": 100484,
68
+ "217756494954": 100648,
69
+ "218391991184": 100679,
70
+ "218784516525": 100707,
71
+ "221762325616": 100678,
72
+ "225164373623": 100439,
73
+ "228358422847": 100669,
74
+ "228565148417": 100726,
75
+ "229775525672": 100793,
76
+ "231853711778": 100516,
77
+ "232776999554": 100443,
78
+ "232787996724": 100601,
79
+ "232896526252": 100489,
80
+ "233795848681": 100507,
81
+ "234316622259": 100625,
82
+ "242851284913": 100435,
83
+ "243165586174": 100784,
84
+ "244371196654": 100615,
85
+ "244885399387": 100533,
86
+ "245416776926": 100583,
87
+ "251789649997": 100613,
88
+ "252867443568": 100578,
89
+ "256497188281": 100735,
90
+ "259533577263": 100458,
91
+ "259666844669": 100434,
92
+ "262296912232": 100481,
93
+ "262437452884": 100794,
94
+ "264259917554": 100413,
95
+ "265847332563": 100818,
96
+ "267514771964": 100574,
97
+ "267954879268": 100646,
98
+ "268433315926": 100822,
99
+ "268921994538": 100715,
100
+ "272362973463": 100406,
101
+ "275597777299": 100565,
102
+ "281673864127": 100408,
103
+ "282322838685": 100373,
104
+ "284445431422": 100664,
105
+ "284776712475": 100780,
106
+ "286173241916": 100603,
107
+ "291762694874": 100670,
108
+ "293847485454": 100760,
109
+ "295118729589": 100609,
110
+ "295448593321": 100490,
111
+ "296953381169": 100479,
112
+ "298464134954": 100483,
113
+ "311632789559": 100391,
114
+ "313145133463": 100773,
115
+ "313313831273": 100815,
116
+ "314697386682": 100449,
117
+ "315534574435": 100754,
118
+ "319584985416": 100570,
119
+ "322589379462": 100680,
120
+ "322683334381": 100668,
121
+ "325196781219": 100844,
122
+ "327158398268": 100673,
123
+ "327491773134": 100387,
124
+ "328552864359": 100705,
125
+ "331369926711": 100731,
126
+ "332234613346": 100843,
127
+ "332522971941": 100683,
128
+ "334513529294": 100662,
129
+ "336813343298": 100747,
130
+ "337326533813": 100444,
131
+ "339882449689": 100597,
132
+ "342221452223": 100742,
133
+ "345271433112": 100657,
134
+ "349249721685": 100751,
135
+ "351885857332": 100426,
136
+ "353755529131": 100753,
137
+ "355977139358": 100379,
138
+ "356722692178": 100846,
139
+ "357299947518": 100832,
140
+ "357621613582": 100738,
141
+ "363214487524": 100532,
142
+ "364196983365": 100545,
143
+ "364492359246": 100695,
144
+ "364947325679": 100618,
145
+ "367459894796": 100356,
146
+ "367968398551": 100757,
147
+ "368763327262": 100799,
148
+ "371496153876": 100816,
149
+ "374327157578": 100390,
150
+ "374439448821": 100468,
151
+ "374598961236": 100512,
152
+ "375429755114": 100781,
153
+ "377273562477": 100480,
154
+ "377338713663": 100494,
155
+ "378749551722": 100789,
156
+ "379557332953": 100451,
157
+ "379571934299": 100612,
158
+ "383837596997": 100381,
159
+ "384598329253": 100616,
160
+ "387763951128": 100730,
161
+ "389715484387": 100759,
162
+ "393741199486": 100704,
163
+ "396521188476": 100665,
164
+ "396847976144": 100785,
165
+ "398549545767": 100502,
166
+ "399223169721": 100548,
167
+ "399749397872": 100471,
168
+ "412843856172": 100803,
169
+ "415956914763": 100629,
170
+ "417668946583": 100737,
171
+ "418412875665": 100698,
172
+ "421369185549": 100626,
173
+ "421435255895": 100666,
174
+ "425949483533": 100368,
175
+ "429781429464": 100453,
176
+ "431149748713": 100594,
177
+ "431751228368": 100534,
178
+ "433581868192": 100535,
179
+ "434632855397": 100627,
180
+ "438124184139": 100812,
181
+ "438435178228": 100739,
182
+ "438745114173": 100690,
183
+ "441373944925": 100463,
184
+ "441377892146": 100795,
185
+ "445925149649": 100364,
186
+ "447445629421": 100396,
187
+ "449318681694": 100847,
188
+ "449549215429": 100819,
189
+ "451161679736": 100676,
190
+ "451885565366": 100796,
191
+ "454164859837": 100656,
192
+ "454244839926": 100503,
193
+ "455423278865": 100703,
194
+ "457919547633": 100358,
195
+ "462294118988": 100658,
196
+ "467893531755": 100465,
197
+ "472129283475": 100749,
198
+ "473822473819": 100397,
199
+ "475794684356": 100556,
200
+ "476969195485": 100772,
201
+ "479227349997": 100456,
202
+ "479676316326": 100409,
203
+ "481884157827": 100416,
204
+ "482829231639": 100828,
205
+ "484489193824": 100529,
206
+ "484773717614": 100497,
207
+ "485177821815": 100354,
208
+ "485692541169": 100740,
209
+ "486391569221": 100536,
210
+ "488496781997": 100826,
211
+ "488538864842": 100459,
212
+ "489562189822": 100530,
213
+ "489991411364": 100461,
214
+ "492373714791": 100590,
215
+ "492516914298": 100769,
216
+ "497294727353": 100660,
217
+ "499148455254": 100462,
218
+ "499156317423": 100654,
219
+ "499444466686": 100448,
220
+ "511785788222": 100659,
221
+ "511923256573": 100672,
222
+ "512659818733": 100591,
223
+ "513349618943": 100685,
224
+ "513361312532": 100520,
225
+ "514354144759": 100750,
226
+ "514532995959": 100436,
227
+ "515856611931": 100655,
228
+ "516968424863": 100476,
229
+ "517379856925": 100450,
230
+ "517778845323": 100431,
231
+ "522515164754": 100778,
232
+ "523723475786": 100755,
233
+ "523918658846": 100392,
234
+ "523937669294": 100716,
235
+ "524444658383": 100649,
236
+ "527117488925": 100466,
237
+ "527874729936": 100728,
238
+ "529455466433": 100610,
239
+ "529679678956": 100420,
240
+ "529854679937": 100540,
241
+ "532833541879": 100642,
242
+ "533417736566": 100552,
243
+ "535787224917": 100425,
244
+ "538631466654": 100677,
245
+ "545512344383": 100447,
246
+ "546276298359": 100752,
247
+ "547149832394": 100482,
248
+ "547563892268": 100813,
249
+ "549946382131": 100663,
250
+ "552738847828": 100836,
251
+ "556814553861": 100827,
252
+ "556976448182": 100605,
253
+ "557163366873": 100776,
254
+ "557533689478": 100527,
255
+ "558837194455": 100787,
256
+ "562389434565": 100734,
257
+ "562716493614": 100732,
258
+ "563117729724": 100510,
259
+ "563365646341": 100571,
260
+ "564395222747": 100675,
261
+ "564544131355": 100614,
262
+ "569765693871": 100353,
263
+ "569853653352": 100758,
264
+ "571317457151": 100712,
265
+ "572154333646": 100486,
266
+ "578827344666": 100427,
267
+ "579184949249": 100418,
268
+ "581493616981": 100763,
269
+ "581976444672": 100588,
270
+ "582471228164": 100525,
271
+ "583527834464": 100825,
272
+ "585544633356": 100524,
273
+ "586855179568": 100496,
274
+ "587541149322": 100817,
275
+ "587787496812": 100417,
276
+ "589439538674": 100764,
277
+ "589547936288": 100531,
278
+ "591464355756": 100719,
279
+ "592538279337": 100399,
280
+ "594688742928": 100748,
281
+ "598916996413": 100630,
282
+ "599961512792": 100606,
283
+ "612128769512": 100389,
284
+ "612788593128": 100580,
285
+ "614583493135": 100841,
286
+ "614797267726": 100452,
287
+ "616248973917": 100542,
288
+ "618423867817": 100725,
289
+ "618878266619": 100829,
290
+ "619454958782": 100593,
291
+ "622553389126": 100693,
292
+ "624221476921": 100595,
293
+ "624266421831": 100701,
294
+ "625334487352": 100807,
295
+ "626748382482": 100837,
296
+ "632962475133": 100528,
297
+ "635127952696": 100713,
298
+ "635185846287": 100687,
299
+ "636324136426": 100801,
300
+ "637551427887": 100647,
301
+ "643489267333": 100372,
302
+ "643692393748": 100401,
303
+ "644234165531": 100623,
304
+ "645527857972": 100834,
305
+ "646979124677": 100410,
306
+ "649291669397": 100362,
307
+ "649516938598": 100810,
308
+ "652154162978": 100557,
309
+ "653573457168": 100492,
310
+ "655517954651": 100619,
311
+ "658481324922": 100415,
312
+ "661436365453": 100433,
313
+ "662426712668": 100517,
314
+ "664847713559": 100637,
315
+ "665661658354": 100554,
316
+ "668134915514": 100400,
317
+ "668514843129": 100559,
318
+ "669183782449": 100643,
319
+ "669689115557": 100386,
320
+ "673948786567": 100620,
321
+ "676539973863": 100440,
322
+ "676676697292": 100445,
323
+ "677896358599": 100499,
324
+ "678666359123": 100526,
325
+ "682564697312": 100380,
326
+ "687284547244": 100848,
327
+ "689285841825": 100473,
328
+ "689362171782": 100382,
329
+ "691315125346": 100635,
330
+ "691587454538": 100365,
331
+ "693281533643": 100555,
332
+ "694235616268": 100407,
333
+ "696651276628": 100402,
334
+ "697747991249": 100743,
335
+ "698218415444": 100378,
336
+ "699446724178": 100700,
337
+ "711412347158": 100518,
338
+ "711641973413": 100653,
339
+ "712992815957": 100521,
340
+ "714738141818": 100761,
341
+ "716763689965": 100744,
342
+ "717628619782": 100811,
343
+ "718726519731": 100370,
344
+ "718951851413": 100699,
345
+ "721737645236": 100455,
346
+ "722339992679": 100766,
347
+ "722618266242": 100429,
348
+ "724492262421": 100692,
349
+ "724883568652": 100475,
350
+ "724964923582": 100779,
351
+ "729116422489": 100727,
352
+ "729825168745": 100634,
353
+ "731681792655": 100566,
354
+ "733737988257": 100477,
355
+ "739246183345": 100718,
356
+ "739394546916": 100645,
357
+ "739667844957": 100733,
358
+ "739784153482": 100729,
359
+ "741757479784": 100539,
360
+ "742765629356": 100438,
361
+ "745977673725": 100604,
362
+ "746285987371": 100361,
363
+ "749665846687": 100432,
364
+ "749966767285": 100383,
365
+ "752644929761": 100563,
366
+ "753159165157": 100384,
367
+ "753233719644": 100558,
368
+ "753466987363": 100519,
369
+ "754978243758": 100791,
370
+ "756916173536": 100805,
371
+ "757422791351": 100800,
372
+ "757785319772": 100768,
373
+ "758963111966": 100774,
374
+ "762486672996": 100708,
375
+ "762495822823": 100798,
376
+ "763531783491": 100543,
377
+ "765474393376": 100359,
378
+ "765737843639": 100514,
379
+ "765981581453": 100393,
380
+ "766294538337": 100607,
381
+ "767858144912": 100711,
382
+ "768461952319": 100636,
383
+ "771619544974": 100474,
384
+ "773671349113": 100631,
385
+ "773687856563": 100424,
386
+ "774679513717": 100823,
387
+ "778466723723": 100404,
388
+ "781653545886": 100374,
389
+ "786391632558": 100553,
390
+ "794825141891": 100394,
391
+ "795693824762": 100385,
392
+ "795838284624": 100421,
393
+ "796415361892": 100375,
394
+ "797238311233": 100851,
395
+ "799364566435": 100504,
396
+ "799417897197": 100584,
397
+ "811371928234": 100572,
398
+ "813981174797": 100689,
399
+ "814611949491": 100652,
400
+ "815458725125": 100702,
401
+ "816115936673": 100622,
402
+ "817378986438": 100506,
403
+ "818479319499": 100746,
404
+ "819162623892": 100560,
405
+ "824387273757": 100508,
406
+ "824488329416": 100640,
407
+ "825815739116": 100741,
408
+ "826214551218": 100441,
409
+ "829235161526": 100523,
410
+ "836746273134": 100414,
411
+ "837131396371": 100573,
412
+ "837873762491": 100641,
413
+ "839269684865": 100579,
414
+ "841824384614": 100488,
415
+ "841991688488": 100376,
416
+ "843998562287": 100485,
417
+ "846657726193": 100765,
418
+ "848845611563": 100500,
419
+ "851254219729": 100824,
420
+ "851852651677": 100501,
421
+ "852347289392": 100478,
422
+ "853859348234": 100403,
423
+ "856317483891": 100814,
424
+ "857231548835": 100621,
425
+ "858146415154": 100710,
426
+ "859289776479": 100840,
427
+ "859927364588": 100736,
428
+ "861342291298": 100821,
429
+ "864718285734": 100568,
430
+ "865331112869": 100352,
431
+ "866519986723": 100661,
432
+ "867678158885": 100470,
433
+ "873898736873": 100395,
434
+ "876537814263": 100681,
435
+ "877385381798": 100562,
436
+ "877482678543": 100357,
437
+ "879425227932": 100469,
438
+ "879764613759": 100674,
439
+ "881112998642": 100592,
440
+ "881136466196": 100564,
441
+ "883685933161": 100412,
442
+ "884354318946": 100684,
443
+ "886464195129": 100639,
444
+ "887417525236": 100809,
445
+ "887753195844": 100617,
446
+ "889965243135": 100694,
447
+ "892336777248": 100586,
448
+ "892697125149": 100806,
449
+ "893974619684": 100850,
450
+ "894885246797": 100498,
451
+ "897784492783": 100589,
452
+ "899151413682": 100464,
453
+ "912193598348": 100419,
454
+ "916198946615": 100509,
455
+ "919181521716": 100770,
456
+ "921889371893": 100628,
457
+ "921894985642": 100838,
458
+ "922327493433": 100411,
459
+ "922466849763": 100454,
460
+ "922867396683": 100513,
461
+ "927914615679": 100363,
462
+ "928335588653": 100467,
463
+ "929185622831": 100446,
464
+ "929826356991": 100405,
465
+ "933775286797": 100842,
466
+ "934912591213": 100608,
467
+ "937495658852": 100460,
468
+ "938488813964": 100549,
469
+ "941169431859": 100561,
470
+ "941861857715": 100808,
471
+ "941976537588": 100644,
472
+ "943193294691": 100599,
473
+ "943878645871": 100839,
474
+ "944513428457": 100575,
475
+ "946444632795": 100724,
476
+ "947262995132": 100849,
477
+ "948585673431": 100783,
478
+ "949235426629": 100831,
479
+ "951794811935": 100511,
480
+ "952465217972": 100632,
481
+ "952872416512": 100430,
482
+ "953267689786": 100638,
483
+ "955456118295": 100544,
484
+ "955668961269": 100600,
485
+ "961133895172": 100567,
486
+ "961981959227": 100550,
487
+ "963852916563": 100569,
488
+ "964342468552": 100495,
489
+ "967114116556": 100505,
490
+ "967214577653": 100722,
491
+ "971621888444": 100522,
492
+ "981277526855": 100797,
493
+ "982993456429": 100369,
494
+ "983493951323": 100691,
495
+ "983569279932": 100388,
496
+ "985781138935": 100771,
497
+ "993832498489": 100688,
498
+ "996116119839": 100541,
499
+ "997724962668": 100786,
500
+ "997958836435": 100585,
501
+ "997981281989": 100367
502
+ }
granite-4.0-h-tiny/dp8/tokenizer/chat_template.jinja ADDED
@@ -0,0 +1,118 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- set tools_system_message_prefix = 'You are a helpful assistant with access to the following tools. You may call one or more tools to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>' %}
2
+ {%- set tools_system_message_suffix = '\n</tools>\n\nFor each tool call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call>. If a tool does not exist in the provided list of tools, notify the user that you do not have the ability to fulfill the request.' %}
3
+ {%- set documents_system_message_prefix = 'You are a helpful assistant with access to the following documents. You may use one or more documents to assist with the user query.\n\nYou are given a list of documents within <documents></documents> XML tags:\n<documents>' %}
4
+ {%- set documents_system_message_suffix = '\n</documents>\n\nWrite the response to the user\'s input by strictly aligning with the facts in the provided documents. If the information needed to answer the question is not available in the documents, inform the user that the question cannot be answered based on the available data.' %}
5
+ {%- set g4_default_system_message = 'You are a helpful assistant. Please ensure responses are professional, accurate, and safe.' %}
6
+ {%- if available_tools is defined and available_tools %}
7
+ {%- set tools = available_tools %}
8
+ {%- endif %}
9
+ {%- set ns = namespace(tools_system_message=tools_system_message_prefix,
10
+ documents_system_message=documents_system_message_prefix,
11
+ default_system_message=g4_default_system_message,
12
+ system_message=''
13
+ ) %}
14
+ {%- if tools %}
15
+ {%- for tool in tools %}
16
+ {%- set ns.tools_system_message = ns.tools_system_message + '\n' + (tool | tojson) %}
17
+ {%- endfor %}
18
+ {%- set ns.tools_system_message = ns.tools_system_message + tools_system_message_suffix %}
19
+ {%- else %}
20
+ {%- set ns.tools_system_message = '' %}
21
+ {%- endif %}
22
+ {%- if documents %}
23
+ {%- for document in documents %}
24
+ {%- set ns.documents_system_message = ns.documents_system_message + '\n' + (document | tojson) %}
25
+ {%- endfor %}
26
+ {%- set ns.documents_system_message = ns.documents_system_message + documents_system_message_suffix %}
27
+ {%- else %}
28
+ {%- set ns.documents_system_message = '' %}
29
+ {%- endif %}
30
+ {%- if messages[0].role == 'system' %}
31
+ {%- if messages[0].content is string %}
32
+ {%- set ns.system_message = messages[0].content %}
33
+ {%- elif messages[0].content is iterable %}
34
+ {%- for entry in messages[0].content %}
35
+ {%- if entry.type== 'text' %}
36
+ {%- if ns.system_message != '' %}
37
+ {%- set ns.system_message = ns.system_message + '\n' %}
38
+ {%- endif %}
39
+ {%- set ns.system_message = ns.system_message + entry.text %}
40
+ {%- endif %}
41
+ {%- endfor %}
42
+ {%- endif %}
43
+ {%- if tools and documents %}
44
+ {%- set ns.system_message = ns.system_message + '\n\n' + ns.tools_system_message + '\n\n' + ns.documents_system_message %}
45
+ {%- elif tools %}
46
+ {%- set ns.system_message = ns.system_message + '\n\n' + ns.tools_system_message %}
47
+ {%- elif documents %}
48
+ {%- set ns.system_message = ns.system_message + '\n\n' + ns.documents_system_message %}
49
+ {%- endif %}
50
+ {%- else %}
51
+ {%- if tools and documents %}
52
+ {%- set ns.system_message = ns.tools_system_message + '\n\n' + ns.documents_system_message %}
53
+ {%- elif tools %}
54
+ {%- set ns.system_message = ns.tools_system_message %}
55
+ {%- elif documents %}
56
+ {%- set ns.system_message = ns.documents_system_message %}
57
+ {%- endif %}
58
+ {%- endif %}
59
+ {%- if ns.system_message %}
60
+ {{- '<|start_of_role|>system<|end_of_role|>' + ns.system_message + '<|end_of_text|>\n' }}
61
+ {%- else %}
62
+ {{- '<|start_of_role|>system<|end_of_role|>' + ns.default_system_message + '<|end_of_text|>\n' }}
63
+ {%- endif %}
64
+ {%- for message in messages %}
65
+ {%- set content = namespace(val='') %}
66
+ {%- if message.content is string %}
67
+ {%- set content.val = message.content %}
68
+ {%- else %}
69
+ {%- if message.content is iterable %}
70
+ {%- for entry in message.content %}
71
+ {%- if entry.type== 'text' %}
72
+ {%- if content.val != '' %}
73
+ {%- set content.val = content.val + '\n' %}
74
+ {%- endif %}
75
+ {%- set content.val = content.val + entry.text %}
76
+ {%- endif %}
77
+ {%- endfor %}
78
+ {%- endif %}
79
+ {%- endif %}
80
+ {%- if (message.role == 'user') or (message.role == 'system' and not loop.first) %}
81
+ {{- '<|start_of_role|>' + message.role + '<|end_of_role|>' + content.val + '<|end_of_text|>\n' }}
82
+ {%- elif message.role == 'assistant' %}
83
+ {{- '<|start_of_role|>' + message.role + '<|end_of_role|>' + content.val }}
84
+ {%- if message.tool_calls %}
85
+ {%- for tool_call in message.tool_calls %}
86
+ {%- if (loop.first and content.val) or (not loop.first) %}
87
+ {{- '\n' }}
88
+ {%- endif %}
89
+ {%- if tool_call.function %}
90
+ {%- set tool_call = tool_call.function %}
91
+ {%- endif %}
92
+ {{- '<tool_call>\n{"name": "' }}
93
+ {{- tool_call.name }}
94
+ {{- '", "arguments": ' }}
95
+ {%- if tool_call.arguments is string %}
96
+ {{- tool_call.arguments }}
97
+ {%- else %}
98
+ {{- tool_call.arguments | tojson }}
99
+ {%- endif %}
100
+ {{- '}\n</tool_call>' }}
101
+ {%- endfor %}
102
+ {%- endif %}
103
+ {{- '<|end_of_text|>\n' }}
104
+ {%- elif message.role == 'tool' %}
105
+ {%- if loop.first or (messages[loop.index0 - 1].role != 'tool') %}
106
+ {{- '<|start_of_role|>user<|end_of_role|>' }}
107
+ {%- endif %}
108
+ {{- '\n<tool_response>\n' }}
109
+ {{- content.val }}
110
+ {{- '\n</tool_response>' }}
111
+ {%- if loop.last or (messages[loop.index0 + 1].role != 'tool') %}
112
+ {{- '<|end_of_text|>\n' }}
113
+ {%- endif %}
114
+ {%- endif %}
115
+ {%- endfor %}
116
+ {%- if add_generation_prompt %}
117
+ {{- '<|start_of_role|>assistant<|end_of_role|>' }}
118
+ {%- endif %}
granite-4.0-h-tiny/dp8/tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,3532 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ {
4
+ "content": "865331112869",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false
9
+ },
10
+ {
11
+ "content": "569765693871",
12
+ "lstrip": false,
13
+ "normalized": false,
14
+ "rstrip": false,
15
+ "single_word": false
16
+ },
17
+ {
18
+ "content": "485177821815",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ {
25
+ "content": "135441121756",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ },
31
+ {
32
+ "content": "367459894796",
33
+ "lstrip": false,
34
+ "normalized": false,
35
+ "rstrip": false,
36
+ "single_word": false
37
+ },
38
+ {
39
+ "content": "877482678543",
40
+ "lstrip": false,
41
+ "normalized": false,
42
+ "rstrip": false,
43
+ "single_word": false
44
+ },
45
+ {
46
+ "content": "457919547633",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false
51
+ },
52
+ {
53
+ "content": "765474393376",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false
58
+ },
59
+ {
60
+ "content": "114848338811",
61
+ "lstrip": false,
62
+ "normalized": false,
63
+ "rstrip": false,
64
+ "single_word": false
65
+ },
66
+ {
67
+ "content": "746285987371",
68
+ "lstrip": false,
69
+ "normalized": false,
70
+ "rstrip": false,
71
+ "single_word": false
72
+ },
73
+ {
74
+ "content": "649291669397",
75
+ "lstrip": false,
76
+ "normalized": false,
77
+ "rstrip": false,
78
+ "single_word": false
79
+ },
80
+ {
81
+ "content": "927914615679",
82
+ "lstrip": false,
83
+ "normalized": false,
84
+ "rstrip": false,
85
+ "single_word": false
86
+ },
87
+ {
88
+ "content": "445925149649",
89
+ "lstrip": false,
90
+ "normalized": false,
91
+ "rstrip": false,
92
+ "single_word": false
93
+ },
94
+ {
95
+ "content": "691587454538",
96
+ "lstrip": false,
97
+ "normalized": false,
98
+ "rstrip": false,
99
+ "single_word": false
100
+ },
101
+ {
102
+ "content": "143777992227",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false
107
+ },
108
+ {
109
+ "content": "997981281989",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false
114
+ },
115
+ {
116
+ "content": "425949483533",
117
+ "lstrip": false,
118
+ "normalized": false,
119
+ "rstrip": false,
120
+ "single_word": false
121
+ },
122
+ {
123
+ "content": "982993456429",
124
+ "lstrip": false,
125
+ "normalized": false,
126
+ "rstrip": false,
127
+ "single_word": false
128
+ },
129
+ {
130
+ "content": "718726519731",
131
+ "lstrip": false,
132
+ "normalized": false,
133
+ "rstrip": false,
134
+ "single_word": false
135
+ },
136
+ {
137
+ "content": "172599315861",
138
+ "lstrip": false,
139
+ "normalized": false,
140
+ "rstrip": false,
141
+ "single_word": false
142
+ },
143
+ {
144
+ "content": "643489267333",
145
+ "lstrip": false,
146
+ "normalized": false,
147
+ "rstrip": false,
148
+ "single_word": false
149
+ },
150
+ {
151
+ "content": "282322838685",
152
+ "lstrip": false,
153
+ "normalized": false,
154
+ "rstrip": false,
155
+ "single_word": false
156
+ },
157
+ {
158
+ "content": "781653545886",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false
163
+ },
164
+ {
165
+ "content": "796415361892",
166
+ "lstrip": false,
167
+ "normalized": false,
168
+ "rstrip": false,
169
+ "single_word": false
170
+ },
171
+ {
172
+ "content": "841991688488",
173
+ "lstrip": false,
174
+ "normalized": false,
175
+ "rstrip": false,
176
+ "single_word": false
177
+ },
178
+ {
179
+ "content": "211411365397",
180
+ "lstrip": false,
181
+ "normalized": false,
182
+ "rstrip": false,
183
+ "single_word": false
184
+ },
185
+ {
186
+ "content": "698218415444",
187
+ "lstrip": false,
188
+ "normalized": false,
189
+ "rstrip": false,
190
+ "single_word": false
191
+ },
192
+ {
193
+ "content": "355977139358",
194
+ "lstrip": false,
195
+ "normalized": false,
196
+ "rstrip": false,
197
+ "single_word": false
198
+ },
199
+ {
200
+ "content": "682564697312",
201
+ "lstrip": false,
202
+ "normalized": false,
203
+ "rstrip": false,
204
+ "single_word": false
205
+ },
206
+ {
207
+ "content": "383837596997",
208
+ "lstrip": false,
209
+ "normalized": false,
210
+ "rstrip": false,
211
+ "single_word": false
212
+ },
213
+ {
214
+ "content": "689362171782",
215
+ "lstrip": false,
216
+ "normalized": false,
217
+ "rstrip": false,
218
+ "single_word": false
219
+ },
220
+ {
221
+ "content": "749966767285",
222
+ "lstrip": false,
223
+ "normalized": false,
224
+ "rstrip": false,
225
+ "single_word": false
226
+ },
227
+ {
228
+ "content": "753159165157",
229
+ "lstrip": false,
230
+ "normalized": false,
231
+ "rstrip": false,
232
+ "single_word": false
233
+ },
234
+ {
235
+ "content": "795693824762",
236
+ "lstrip": false,
237
+ "normalized": false,
238
+ "rstrip": false,
239
+ "single_word": false
240
+ },
241
+ {
242
+ "content": "669689115557",
243
+ "lstrip": false,
244
+ "normalized": false,
245
+ "rstrip": false,
246
+ "single_word": false
247
+ },
248
+ {
249
+ "content": "327491773134",
250
+ "lstrip": false,
251
+ "normalized": false,
252
+ "rstrip": false,
253
+ "single_word": false
254
+ },
255
+ {
256
+ "content": "983569279932",
257
+ "lstrip": false,
258
+ "normalized": false,
259
+ "rstrip": false,
260
+ "single_word": false
261
+ },
262
+ {
263
+ "content": "612128769512",
264
+ "lstrip": false,
265
+ "normalized": false,
266
+ "rstrip": false,
267
+ "single_word": false
268
+ },
269
+ {
270
+ "content": "374327157578",
271
+ "lstrip": false,
272
+ "normalized": false,
273
+ "rstrip": false,
274
+ "single_word": false
275
+ },
276
+ {
277
+ "content": "311632789559",
278
+ "lstrip": false,
279
+ "normalized": false,
280
+ "rstrip": false,
281
+ "single_word": false
282
+ },
283
+ {
284
+ "content": "523918658846",
285
+ "lstrip": false,
286
+ "normalized": false,
287
+ "rstrip": false,
288
+ "single_word": false
289
+ },
290
+ {
291
+ "content": "765981581453",
292
+ "lstrip": false,
293
+ "normalized": false,
294
+ "rstrip": false,
295
+ "single_word": false
296
+ },
297
+ {
298
+ "content": "794825141891",
299
+ "lstrip": false,
300
+ "normalized": false,
301
+ "rstrip": false,
302
+ "single_word": false
303
+ },
304
+ {
305
+ "content": "873898736873",
306
+ "lstrip": false,
307
+ "normalized": false,
308
+ "rstrip": false,
309
+ "single_word": false
310
+ },
311
+ {
312
+ "content": "447445629421",
313
+ "lstrip": false,
314
+ "normalized": false,
315
+ "rstrip": false,
316
+ "single_word": false
317
+ },
318
+ {
319
+ "content": "473822473819",
320
+ "lstrip": false,
321
+ "normalized": false,
322
+ "rstrip": false,
323
+ "single_word": false
324
+ },
325
+ {
326
+ "content": "181439694557",
327
+ "lstrip": false,
328
+ "normalized": false,
329
+ "rstrip": false,
330
+ "single_word": false
331
+ },
332
+ {
333
+ "content": "592538279337",
334
+ "lstrip": false,
335
+ "normalized": false,
336
+ "rstrip": false,
337
+ "single_word": false
338
+ },
339
+ {
340
+ "content": "668134915514",
341
+ "lstrip": false,
342
+ "normalized": false,
343
+ "rstrip": false,
344
+ "single_word": false
345
+ },
346
+ {
347
+ "content": "643692393748",
348
+ "lstrip": false,
349
+ "normalized": false,
350
+ "rstrip": false,
351
+ "single_word": false
352
+ },
353
+ {
354
+ "content": "696651276628",
355
+ "lstrip": false,
356
+ "normalized": false,
357
+ "rstrip": false,
358
+ "single_word": false
359
+ },
360
+ {
361
+ "content": "853859348234",
362
+ "lstrip": false,
363
+ "normalized": false,
364
+ "rstrip": false,
365
+ "single_word": false
366
+ },
367
+ {
368
+ "content": "778466723723",
369
+ "lstrip": false,
370
+ "normalized": false,
371
+ "rstrip": false,
372
+ "single_word": false
373
+ },
374
+ {
375
+ "content": "929826356991",
376
+ "lstrip": false,
377
+ "normalized": false,
378
+ "rstrip": false,
379
+ "single_word": false
380
+ },
381
+ {
382
+ "content": "272362973463",
383
+ "lstrip": false,
384
+ "normalized": false,
385
+ "rstrip": false,
386
+ "single_word": false
387
+ },
388
+ {
389
+ "content": "694235616268",
390
+ "lstrip": false,
391
+ "normalized": false,
392
+ "rstrip": false,
393
+ "single_word": false
394
+ },
395
+ {
396
+ "content": "281673864127",
397
+ "lstrip": false,
398
+ "normalized": false,
399
+ "rstrip": false,
400
+ "single_word": false
401
+ },
402
+ {
403
+ "content": "479676316326",
404
+ "lstrip": false,
405
+ "normalized": false,
406
+ "rstrip": false,
407
+ "single_word": false
408
+ },
409
+ {
410
+ "content": "646979124677",
411
+ "lstrip": false,
412
+ "normalized": false,
413
+ "rstrip": false,
414
+ "single_word": false
415
+ },
416
+ {
417
+ "content": "922327493433",
418
+ "lstrip": false,
419
+ "normalized": false,
420
+ "rstrip": false,
421
+ "single_word": false
422
+ },
423
+ {
424
+ "content": "883685933161",
425
+ "lstrip": false,
426
+ "normalized": false,
427
+ "rstrip": false,
428
+ "single_word": false
429
+ },
430
+ {
431
+ "content": "264259917554",
432
+ "lstrip": false,
433
+ "normalized": false,
434
+ "rstrip": false,
435
+ "single_word": false
436
+ },
437
+ {
438
+ "content": "836746273134",
439
+ "lstrip": false,
440
+ "normalized": false,
441
+ "rstrip": false,
442
+ "single_word": false
443
+ },
444
+ {
445
+ "content": "658481324922",
446
+ "lstrip": false,
447
+ "normalized": false,
448
+ "rstrip": false,
449
+ "single_word": false
450
+ },
451
+ {
452
+ "content": "481884157827",
453
+ "lstrip": false,
454
+ "normalized": false,
455
+ "rstrip": false,
456
+ "single_word": false
457
+ },
458
+ {
459
+ "content": "587787496812",
460
+ "lstrip": false,
461
+ "normalized": false,
462
+ "rstrip": false,
463
+ "single_word": false
464
+ },
465
+ {
466
+ "content": "579184949249",
467
+ "lstrip": false,
468
+ "normalized": false,
469
+ "rstrip": false,
470
+ "single_word": false
471
+ },
472
+ {
473
+ "content": "912193598348",
474
+ "lstrip": false,
475
+ "normalized": false,
476
+ "rstrip": false,
477
+ "single_word": false
478
+ },
479
+ {
480
+ "content": "529679678956",
481
+ "lstrip": false,
482
+ "normalized": false,
483
+ "rstrip": false,
484
+ "single_word": false
485
+ },
486
+ {
487
+ "content": "795838284624",
488
+ "lstrip": false,
489
+ "normalized": false,
490
+ "rstrip": false,
491
+ "single_word": false
492
+ },
493
+ {
494
+ "content": "159337222655",
495
+ "lstrip": false,
496
+ "normalized": false,
497
+ "rstrip": false,
498
+ "single_word": false
499
+ },
500
+ {
501
+ "content": "173781362446",
502
+ "lstrip": false,
503
+ "normalized": false,
504
+ "rstrip": false,
505
+ "single_word": false
506
+ },
507
+ {
508
+ "content": "773687856563",
509
+ "lstrip": false,
510
+ "normalized": false,
511
+ "rstrip": false,
512
+ "single_word": false
513
+ },
514
+ {
515
+ "content": "535787224917",
516
+ "lstrip": false,
517
+ "normalized": false,
518
+ "rstrip": false,
519
+ "single_word": false
520
+ },
521
+ {
522
+ "content": "351885857332",
523
+ "lstrip": false,
524
+ "normalized": false,
525
+ "rstrip": false,
526
+ "single_word": false
527
+ },
528
+ {
529
+ "content": "578827344666",
530
+ "lstrip": false,
531
+ "normalized": false,
532
+ "rstrip": false,
533
+ "single_word": false
534
+ },
535
+ {
536
+ "content": "198462689911",
537
+ "lstrip": false,
538
+ "normalized": false,
539
+ "rstrip": false,
540
+ "single_word": false
541
+ },
542
+ {
543
+ "content": "722618266242",
544
+ "lstrip": false,
545
+ "normalized": false,
546
+ "rstrip": false,
547
+ "single_word": false
548
+ },
549
+ {
550
+ "content": "952872416512",
551
+ "lstrip": false,
552
+ "normalized": false,
553
+ "rstrip": false,
554
+ "single_word": false
555
+ },
556
+ {
557
+ "content": "517778845323",
558
+ "lstrip": false,
559
+ "normalized": false,
560
+ "rstrip": false,
561
+ "single_word": false
562
+ },
563
+ {
564
+ "content": "749665846687",
565
+ "lstrip": false,
566
+ "normalized": false,
567
+ "rstrip": false,
568
+ "single_word": false
569
+ },
570
+ {
571
+ "content": "661436365453",
572
+ "lstrip": false,
573
+ "normalized": false,
574
+ "rstrip": false,
575
+ "single_word": false
576
+ },
577
+ {
578
+ "content": "259666844669",
579
+ "lstrip": false,
580
+ "normalized": false,
581
+ "rstrip": false,
582
+ "single_word": false
583
+ },
584
+ {
585
+ "content": "242851284913",
586
+ "lstrip": false,
587
+ "normalized": false,
588
+ "rstrip": false,
589
+ "single_word": false
590
+ },
591
+ {
592
+ "content": "514532995959",
593
+ "lstrip": false,
594
+ "normalized": false,
595
+ "rstrip": false,
596
+ "single_word": false
597
+ },
598
+ {
599
+ "content": "161588262349",
600
+ "lstrip": false,
601
+ "normalized": false,
602
+ "rstrip": false,
603
+ "single_word": false
604
+ },
605
+ {
606
+ "content": "742765629356",
607
+ "lstrip": false,
608
+ "normalized": false,
609
+ "rstrip": false,
610
+ "single_word": false
611
+ },
612
+ {
613
+ "content": "225164373623",
614
+ "lstrip": false,
615
+ "normalized": false,
616
+ "rstrip": false,
617
+ "single_word": false
618
+ },
619
+ {
620
+ "content": "676539973863",
621
+ "lstrip": false,
622
+ "normalized": false,
623
+ "rstrip": false,
624
+ "single_word": false
625
+ },
626
+ {
627
+ "content": "826214551218",
628
+ "lstrip": false,
629
+ "normalized": false,
630
+ "rstrip": false,
631
+ "single_word": false
632
+ },
633
+ {
634
+ "content": "182345464792",
635
+ "lstrip": false,
636
+ "normalized": false,
637
+ "rstrip": false,
638
+ "single_word": false
639
+ },
640
+ {
641
+ "content": "232776999554",
642
+ "lstrip": false,
643
+ "normalized": false,
644
+ "rstrip": false,
645
+ "single_word": false
646
+ },
647
+ {
648
+ "content": "337326533813",
649
+ "lstrip": false,
650
+ "normalized": false,
651
+ "rstrip": false,
652
+ "single_word": false
653
+ },
654
+ {
655
+ "content": "676676697292",
656
+ "lstrip": false,
657
+ "normalized": false,
658
+ "rstrip": false,
659
+ "single_word": false
660
+ },
661
+ {
662
+ "content": "929185622831",
663
+ "lstrip": false,
664
+ "normalized": false,
665
+ "rstrip": false,
666
+ "single_word": false
667
+ },
668
+ {
669
+ "content": "545512344383",
670
+ "lstrip": false,
671
+ "normalized": false,
672
+ "rstrip": false,
673
+ "single_word": false
674
+ },
675
+ {
676
+ "content": "499444466686",
677
+ "lstrip": false,
678
+ "normalized": false,
679
+ "rstrip": false,
680
+ "single_word": false
681
+ },
682
+ {
683
+ "content": "314697386682",
684
+ "lstrip": false,
685
+ "normalized": false,
686
+ "rstrip": false,
687
+ "single_word": false
688
+ },
689
+ {
690
+ "content": "517379856925",
691
+ "lstrip": false,
692
+ "normalized": false,
693
+ "rstrip": false,
694
+ "single_word": false
695
+ },
696
+ {
697
+ "content": "379557332953",
698
+ "lstrip": false,
699
+ "normalized": false,
700
+ "rstrip": false,
701
+ "single_word": false
702
+ },
703
+ {
704
+ "content": "614797267726",
705
+ "lstrip": false,
706
+ "normalized": false,
707
+ "rstrip": false,
708
+ "single_word": false
709
+ },
710
+ {
711
+ "content": "429781429464",
712
+ "lstrip": false,
713
+ "normalized": false,
714
+ "rstrip": false,
715
+ "single_word": false
716
+ },
717
+ {
718
+ "content": "922466849763",
719
+ "lstrip": false,
720
+ "normalized": false,
721
+ "rstrip": false,
722
+ "single_word": false
723
+ },
724
+ {
725
+ "content": "721737645236",
726
+ "lstrip": false,
727
+ "normalized": false,
728
+ "rstrip": false,
729
+ "single_word": false
730
+ },
731
+ {
732
+ "content": "479227349997",
733
+ "lstrip": false,
734
+ "normalized": false,
735
+ "rstrip": false,
736
+ "single_word": false
737
+ },
738
+ {
739
+ "content": "136931728327",
740
+ "lstrip": false,
741
+ "normalized": false,
742
+ "rstrip": false,
743
+ "single_word": false
744
+ },
745
+ {
746
+ "content": "259533577263",
747
+ "lstrip": false,
748
+ "normalized": false,
749
+ "rstrip": false,
750
+ "single_word": false
751
+ },
752
+ {
753
+ "content": "488538864842",
754
+ "lstrip": false,
755
+ "normalized": false,
756
+ "rstrip": false,
757
+ "single_word": false
758
+ },
759
+ {
760
+ "content": "937495658852",
761
+ "lstrip": false,
762
+ "normalized": false,
763
+ "rstrip": false,
764
+ "single_word": false
765
+ },
766
+ {
767
+ "content": "489991411364",
768
+ "lstrip": false,
769
+ "normalized": false,
770
+ "rstrip": false,
771
+ "single_word": false
772
+ },
773
+ {
774
+ "content": "499148455254",
775
+ "lstrip": false,
776
+ "normalized": false,
777
+ "rstrip": false,
778
+ "single_word": false
779
+ },
780
+ {
781
+ "content": "441373944925",
782
+ "lstrip": false,
783
+ "normalized": false,
784
+ "rstrip": false,
785
+ "single_word": false
786
+ },
787
+ {
788
+ "content": "899151413682",
789
+ "lstrip": false,
790
+ "normalized": false,
791
+ "rstrip": false,
792
+ "single_word": false
793
+ },
794
+ {
795
+ "content": "467893531755",
796
+ "lstrip": false,
797
+ "normalized": false,
798
+ "rstrip": false,
799
+ "single_word": false
800
+ },
801
+ {
802
+ "content": "527117488925",
803
+ "lstrip": false,
804
+ "normalized": false,
805
+ "rstrip": false,
806
+ "single_word": false
807
+ },
808
+ {
809
+ "content": "928335588653",
810
+ "lstrip": false,
811
+ "normalized": false,
812
+ "rstrip": false,
813
+ "single_word": false
814
+ },
815
+ {
816
+ "content": "374439448821",
817
+ "lstrip": false,
818
+ "normalized": false,
819
+ "rstrip": false,
820
+ "single_word": false
821
+ },
822
+ {
823
+ "content": "879425227932",
824
+ "lstrip": false,
825
+ "normalized": false,
826
+ "rstrip": false,
827
+ "single_word": false
828
+ },
829
+ {
830
+ "content": "867678158885",
831
+ "lstrip": false,
832
+ "normalized": false,
833
+ "rstrip": false,
834
+ "single_word": false
835
+ },
836
+ {
837
+ "content": "399749397872",
838
+ "lstrip": false,
839
+ "normalized": false,
840
+ "rstrip": false,
841
+ "single_word": false
842
+ },
843
+ {
844
+ "content": "129693547287",
845
+ "lstrip": false,
846
+ "normalized": false,
847
+ "rstrip": false,
848
+ "single_word": false
849
+ },
850
+ {
851
+ "content": "689285841825",
852
+ "lstrip": false,
853
+ "normalized": false,
854
+ "rstrip": false,
855
+ "single_word": false
856
+ },
857
+ {
858
+ "content": "771619544974",
859
+ "lstrip": false,
860
+ "normalized": false,
861
+ "rstrip": false,
862
+ "single_word": false
863
+ },
864
+ {
865
+ "content": "724883568652",
866
+ "lstrip": false,
867
+ "normalized": false,
868
+ "rstrip": false,
869
+ "single_word": false
870
+ },
871
+ {
872
+ "content": "516968424863",
873
+ "lstrip": false,
874
+ "normalized": false,
875
+ "rstrip": false,
876
+ "single_word": false
877
+ },
878
+ {
879
+ "content": "733737988257",
880
+ "lstrip": false,
881
+ "normalized": false,
882
+ "rstrip": false,
883
+ "single_word": false
884
+ },
885
+ {
886
+ "content": "852347289392",
887
+ "lstrip": false,
888
+ "normalized": false,
889
+ "rstrip": false,
890
+ "single_word": false
891
+ },
892
+ {
893
+ "content": "296953381169",
894
+ "lstrip": false,
895
+ "normalized": false,
896
+ "rstrip": false,
897
+ "single_word": false
898
+ },
899
+ {
900
+ "content": "377273562477",
901
+ "lstrip": false,
902
+ "normalized": false,
903
+ "rstrip": false,
904
+ "single_word": false
905
+ },
906
+ {
907
+ "content": "262296912232",
908
+ "lstrip": false,
909
+ "normalized": false,
910
+ "rstrip": false,
911
+ "single_word": false
912
+ },
913
+ {
914
+ "content": "547149832394",
915
+ "lstrip": false,
916
+ "normalized": false,
917
+ "rstrip": false,
918
+ "single_word": false
919
+ },
920
+ {
921
+ "content": "298464134954",
922
+ "lstrip": false,
923
+ "normalized": false,
924
+ "rstrip": false,
925
+ "single_word": false
926
+ },
927
+ {
928
+ "content": "216667245274",
929
+ "lstrip": false,
930
+ "normalized": false,
931
+ "rstrip": false,
932
+ "single_word": false
933
+ },
934
+ {
935
+ "content": "843998562287",
936
+ "lstrip": false,
937
+ "normalized": false,
938
+ "rstrip": false,
939
+ "single_word": false
940
+ },
941
+ {
942
+ "content": "572154333646",
943
+ "lstrip": false,
944
+ "normalized": false,
945
+ "rstrip": false,
946
+ "single_word": false
947
+ },
948
+ {
949
+ "content": "124589118494",
950
+ "lstrip": false,
951
+ "normalized": false,
952
+ "rstrip": false,
953
+ "single_word": false
954
+ },
955
+ {
956
+ "content": "841824384614",
957
+ "lstrip": false,
958
+ "normalized": false,
959
+ "rstrip": false,
960
+ "single_word": false
961
+ },
962
+ {
963
+ "content": "232896526252",
964
+ "lstrip": false,
965
+ "normalized": false,
966
+ "rstrip": false,
967
+ "single_word": false
968
+ },
969
+ {
970
+ "content": "295448593321",
971
+ "lstrip": false,
972
+ "normalized": false,
973
+ "rstrip": false,
974
+ "single_word": false
975
+ },
976
+ {
977
+ "content": "123741461297",
978
+ "lstrip": false,
979
+ "normalized": false,
980
+ "rstrip": false,
981
+ "single_word": false
982
+ },
983
+ {
984
+ "content": "653573457168",
985
+ "lstrip": false,
986
+ "normalized": false,
987
+ "rstrip": false,
988
+ "single_word": false
989
+ },
990
+ {
991
+ "content": "196735786156",
992
+ "lstrip": false,
993
+ "normalized": false,
994
+ "rstrip": false,
995
+ "single_word": false
996
+ },
997
+ {
998
+ "content": "377338713663",
999
+ "lstrip": false,
1000
+ "normalized": false,
1001
+ "rstrip": false,
1002
+ "single_word": false
1003
+ },
1004
+ {
1005
+ "content": "964342468552",
1006
+ "lstrip": false,
1007
+ "normalized": false,
1008
+ "rstrip": false,
1009
+ "single_word": false
1010
+ },
1011
+ {
1012
+ "content": "586855179568",
1013
+ "lstrip": false,
1014
+ "normalized": false,
1015
+ "rstrip": false,
1016
+ "single_word": false
1017
+ },
1018
+ {
1019
+ "content": "484773717614",
1020
+ "lstrip": false,
1021
+ "normalized": false,
1022
+ "rstrip": false,
1023
+ "single_word": false
1024
+ },
1025
+ {
1026
+ "content": "894885246797",
1027
+ "lstrip": false,
1028
+ "normalized": false,
1029
+ "rstrip": false,
1030
+ "single_word": false
1031
+ },
1032
+ {
1033
+ "content": "677896358599",
1034
+ "lstrip": false,
1035
+ "normalized": false,
1036
+ "rstrip": false,
1037
+ "single_word": false
1038
+ },
1039
+ {
1040
+ "content": "848845611563",
1041
+ "lstrip": false,
1042
+ "normalized": false,
1043
+ "rstrip": false,
1044
+ "single_word": false
1045
+ },
1046
+ {
1047
+ "content": "851852651677",
1048
+ "lstrip": false,
1049
+ "normalized": false,
1050
+ "rstrip": false,
1051
+ "single_word": false
1052
+ },
1053
+ {
1054
+ "content": "398549545767",
1055
+ "lstrip": false,
1056
+ "normalized": false,
1057
+ "rstrip": false,
1058
+ "single_word": false
1059
+ },
1060
+ {
1061
+ "content": "454244839926",
1062
+ "lstrip": false,
1063
+ "normalized": false,
1064
+ "rstrip": false,
1065
+ "single_word": false
1066
+ },
1067
+ {
1068
+ "content": "799364566435",
1069
+ "lstrip": false,
1070
+ "normalized": false,
1071
+ "rstrip": false,
1072
+ "single_word": false
1073
+ },
1074
+ {
1075
+ "content": "967114116556",
1076
+ "lstrip": false,
1077
+ "normalized": false,
1078
+ "rstrip": false,
1079
+ "single_word": false
1080
+ },
1081
+ {
1082
+ "content": "817378986438",
1083
+ "lstrip": false,
1084
+ "normalized": false,
1085
+ "rstrip": false,
1086
+ "single_word": false
1087
+ },
1088
+ {
1089
+ "content": "233795848681",
1090
+ "lstrip": false,
1091
+ "normalized": false,
1092
+ "rstrip": false,
1093
+ "single_word": false
1094
+ },
1095
+ {
1096
+ "content": "824387273757",
1097
+ "lstrip": false,
1098
+ "normalized": false,
1099
+ "rstrip": false,
1100
+ "single_word": false
1101
+ },
1102
+ {
1103
+ "content": "916198946615",
1104
+ "lstrip": false,
1105
+ "normalized": false,
1106
+ "rstrip": false,
1107
+ "single_word": false
1108
+ },
1109
+ {
1110
+ "content": "563117729724",
1111
+ "lstrip": false,
1112
+ "normalized": false,
1113
+ "rstrip": false,
1114
+ "single_word": false
1115
+ },
1116
+ {
1117
+ "content": "951794811935",
1118
+ "lstrip": false,
1119
+ "normalized": false,
1120
+ "rstrip": false,
1121
+ "single_word": false
1122
+ },
1123
+ {
1124
+ "content": "374598961236",
1125
+ "lstrip": false,
1126
+ "normalized": false,
1127
+ "rstrip": false,
1128
+ "single_word": false
1129
+ },
1130
+ {
1131
+ "content": "922867396683",
1132
+ "lstrip": false,
1133
+ "normalized": false,
1134
+ "rstrip": false,
1135
+ "single_word": false
1136
+ },
1137
+ {
1138
+ "content": "765737843639",
1139
+ "lstrip": false,
1140
+ "normalized": false,
1141
+ "rstrip": false,
1142
+ "single_word": false
1143
+ },
1144
+ {
1145
+ "content": "175469284871",
1146
+ "lstrip": false,
1147
+ "normalized": false,
1148
+ "rstrip": false,
1149
+ "single_word": false
1150
+ },
1151
+ {
1152
+ "content": "231853711778",
1153
+ "lstrip": false,
1154
+ "normalized": false,
1155
+ "rstrip": false,
1156
+ "single_word": false
1157
+ },
1158
+ {
1159
+ "content": "662426712668",
1160
+ "lstrip": false,
1161
+ "normalized": false,
1162
+ "rstrip": false,
1163
+ "single_word": false
1164
+ },
1165
+ {
1166
+ "content": "711412347158",
1167
+ "lstrip": false,
1168
+ "normalized": false,
1169
+ "rstrip": false,
1170
+ "single_word": false
1171
+ },
1172
+ {
1173
+ "content": "753466987363",
1174
+ "lstrip": false,
1175
+ "normalized": false,
1176
+ "rstrip": false,
1177
+ "single_word": false
1178
+ },
1179
+ {
1180
+ "content": "513361312532",
1181
+ "lstrip": false,
1182
+ "normalized": false,
1183
+ "rstrip": false,
1184
+ "single_word": false
1185
+ },
1186
+ {
1187
+ "content": "712992815957",
1188
+ "lstrip": false,
1189
+ "normalized": false,
1190
+ "rstrip": false,
1191
+ "single_word": false
1192
+ },
1193
+ {
1194
+ "content": "971621888444",
1195
+ "lstrip": false,
1196
+ "normalized": false,
1197
+ "rstrip": false,
1198
+ "single_word": false
1199
+ },
1200
+ {
1201
+ "content": "829235161526",
1202
+ "lstrip": false,
1203
+ "normalized": false,
1204
+ "rstrip": false,
1205
+ "single_word": false
1206
+ },
1207
+ {
1208
+ "content": "585544633356",
1209
+ "lstrip": false,
1210
+ "normalized": false,
1211
+ "rstrip": false,
1212
+ "single_word": false
1213
+ },
1214
+ {
1215
+ "content": "582471228164",
1216
+ "lstrip": false,
1217
+ "normalized": false,
1218
+ "rstrip": false,
1219
+ "single_word": false
1220
+ },
1221
+ {
1222
+ "content": "678666359123",
1223
+ "lstrip": false,
1224
+ "normalized": false,
1225
+ "rstrip": false,
1226
+ "single_word": false
1227
+ },
1228
+ {
1229
+ "content": "557533689478",
1230
+ "lstrip": false,
1231
+ "normalized": false,
1232
+ "rstrip": false,
1233
+ "single_word": false
1234
+ },
1235
+ {
1236
+ "content": "632962475133",
1237
+ "lstrip": false,
1238
+ "normalized": false,
1239
+ "rstrip": false,
1240
+ "single_word": false
1241
+ },
1242
+ {
1243
+ "content": "484489193824",
1244
+ "lstrip": false,
1245
+ "normalized": false,
1246
+ "rstrip": false,
1247
+ "single_word": false
1248
+ },
1249
+ {
1250
+ "content": "489562189822",
1251
+ "lstrip": false,
1252
+ "normalized": false,
1253
+ "rstrip": false,
1254
+ "single_word": false
1255
+ },
1256
+ {
1257
+ "content": "589547936288",
1258
+ "lstrip": false,
1259
+ "normalized": false,
1260
+ "rstrip": false,
1261
+ "single_word": false
1262
+ },
1263
+ {
1264
+ "content": "363214487524",
1265
+ "lstrip": false,
1266
+ "normalized": false,
1267
+ "rstrip": false,
1268
+ "single_word": false
1269
+ },
1270
+ {
1271
+ "content": "244885399387",
1272
+ "lstrip": false,
1273
+ "normalized": false,
1274
+ "rstrip": false,
1275
+ "single_word": false
1276
+ },
1277
+ {
1278
+ "content": "431751228368",
1279
+ "lstrip": false,
1280
+ "normalized": false,
1281
+ "rstrip": false,
1282
+ "single_word": false
1283
+ },
1284
+ {
1285
+ "content": "433581868192",
1286
+ "lstrip": false,
1287
+ "normalized": false,
1288
+ "rstrip": false,
1289
+ "single_word": false
1290
+ },
1291
+ {
1292
+ "content": "486391569221",
1293
+ "lstrip": false,
1294
+ "normalized": false,
1295
+ "rstrip": false,
1296
+ "single_word": false
1297
+ },
1298
+ {
1299
+ "content": "185438575221",
1300
+ "lstrip": false,
1301
+ "normalized": false,
1302
+ "rstrip": false,
1303
+ "single_word": false
1304
+ },
1305
+ {
1306
+ "content": "126574388585",
1307
+ "lstrip": false,
1308
+ "normalized": false,
1309
+ "rstrip": false,
1310
+ "single_word": false
1311
+ },
1312
+ {
1313
+ "content": "741757479784",
1314
+ "lstrip": false,
1315
+ "normalized": false,
1316
+ "rstrip": false,
1317
+ "single_word": false
1318
+ },
1319
+ {
1320
+ "content": "529854679937",
1321
+ "lstrip": false,
1322
+ "normalized": false,
1323
+ "rstrip": false,
1324
+ "single_word": false
1325
+ },
1326
+ {
1327
+ "content": "996116119839",
1328
+ "lstrip": false,
1329
+ "normalized": false,
1330
+ "rstrip": false,
1331
+ "single_word": false
1332
+ },
1333
+ {
1334
+ "content": "616248973917",
1335
+ "lstrip": false,
1336
+ "normalized": false,
1337
+ "rstrip": false,
1338
+ "single_word": false
1339
+ },
1340
+ {
1341
+ "content": "763531783491",
1342
+ "lstrip": false,
1343
+ "normalized": false,
1344
+ "rstrip": false,
1345
+ "single_word": false
1346
+ },
1347
+ {
1348
+ "content": "955456118295",
1349
+ "lstrip": false,
1350
+ "normalized": false,
1351
+ "rstrip": false,
1352
+ "single_word": false
1353
+ },
1354
+ {
1355
+ "content": "364196983365",
1356
+ "lstrip": false,
1357
+ "normalized": false,
1358
+ "rstrip": false,
1359
+ "single_word": false
1360
+ },
1361
+ {
1362
+ "content": "195792996468",
1363
+ "lstrip": false,
1364
+ "normalized": false,
1365
+ "rstrip": false,
1366
+ "single_word": false
1367
+ },
1368
+ {
1369
+ "content": "151859598873",
1370
+ "lstrip": false,
1371
+ "normalized": false,
1372
+ "rstrip": false,
1373
+ "single_word": false
1374
+ },
1375
+ {
1376
+ "content": "399223169721",
1377
+ "lstrip": false,
1378
+ "normalized": false,
1379
+ "rstrip": false,
1380
+ "single_word": false
1381
+ },
1382
+ {
1383
+ "content": "938488813964",
1384
+ "lstrip": false,
1385
+ "normalized": false,
1386
+ "rstrip": false,
1387
+ "single_word": false
1388
+ },
1389
+ {
1390
+ "content": "961981959227",
1391
+ "lstrip": false,
1392
+ "normalized": false,
1393
+ "rstrip": false,
1394
+ "single_word": false
1395
+ },
1396
+ {
1397
+ "content": "183368827562",
1398
+ "lstrip": false,
1399
+ "normalized": false,
1400
+ "rstrip": false,
1401
+ "single_word": false
1402
+ },
1403
+ {
1404
+ "content": "533417736566",
1405
+ "lstrip": false,
1406
+ "normalized": false,
1407
+ "rstrip": false,
1408
+ "single_word": false
1409
+ },
1410
+ {
1411
+ "content": "786391632558",
1412
+ "lstrip": false,
1413
+ "normalized": false,
1414
+ "rstrip": false,
1415
+ "single_word": false
1416
+ },
1417
+ {
1418
+ "content": "665661658354",
1419
+ "lstrip": false,
1420
+ "normalized": false,
1421
+ "rstrip": false,
1422
+ "single_word": false
1423
+ },
1424
+ {
1425
+ "content": "693281533643",
1426
+ "lstrip": false,
1427
+ "normalized": false,
1428
+ "rstrip": false,
1429
+ "single_word": false
1430
+ },
1431
+ {
1432
+ "content": "475794684356",
1433
+ "lstrip": false,
1434
+ "normalized": false,
1435
+ "rstrip": false,
1436
+ "single_word": false
1437
+ },
1438
+ {
1439
+ "content": "652154162978",
1440
+ "lstrip": false,
1441
+ "normalized": false,
1442
+ "rstrip": false,
1443
+ "single_word": false
1444
+ },
1445
+ {
1446
+ "content": "753233719644",
1447
+ "lstrip": false,
1448
+ "normalized": false,
1449
+ "rstrip": false,
1450
+ "single_word": false
1451
+ },
1452
+ {
1453
+ "content": "668514843129",
1454
+ "lstrip": false,
1455
+ "normalized": false,
1456
+ "rstrip": false,
1457
+ "single_word": false
1458
+ },
1459
+ {
1460
+ "content": "819162623892",
1461
+ "lstrip": false,
1462
+ "normalized": false,
1463
+ "rstrip": false,
1464
+ "single_word": false
1465
+ },
1466
+ {
1467
+ "content": "941169431859",
1468
+ "lstrip": false,
1469
+ "normalized": false,
1470
+ "rstrip": false,
1471
+ "single_word": false
1472
+ },
1473
+ {
1474
+ "content": "877385381798",
1475
+ "lstrip": false,
1476
+ "normalized": false,
1477
+ "rstrip": false,
1478
+ "single_word": false
1479
+ },
1480
+ {
1481
+ "content": "752644929761",
1482
+ "lstrip": false,
1483
+ "normalized": false,
1484
+ "rstrip": false,
1485
+ "single_word": false
1486
+ },
1487
+ {
1488
+ "content": "881136466196",
1489
+ "lstrip": false,
1490
+ "normalized": false,
1491
+ "rstrip": false,
1492
+ "single_word": false
1493
+ },
1494
+ {
1495
+ "content": "275597777299",
1496
+ "lstrip": false,
1497
+ "normalized": false,
1498
+ "rstrip": false,
1499
+ "single_word": false
1500
+ },
1501
+ {
1502
+ "content": "731681792655",
1503
+ "lstrip": false,
1504
+ "normalized": false,
1505
+ "rstrip": false,
1506
+ "single_word": false
1507
+ },
1508
+ {
1509
+ "content": "961133895172",
1510
+ "lstrip": false,
1511
+ "normalized": false,
1512
+ "rstrip": false,
1513
+ "single_word": false
1514
+ },
1515
+ {
1516
+ "content": "864718285734",
1517
+ "lstrip": false,
1518
+ "normalized": false,
1519
+ "rstrip": false,
1520
+ "single_word": false
1521
+ },
1522
+ {
1523
+ "content": "963852916563",
1524
+ "lstrip": false,
1525
+ "normalized": false,
1526
+ "rstrip": false,
1527
+ "single_word": false
1528
+ },
1529
+ {
1530
+ "content": "319584985416",
1531
+ "lstrip": false,
1532
+ "normalized": false,
1533
+ "rstrip": false,
1534
+ "single_word": false
1535
+ },
1536
+ {
1537
+ "content": "563365646341",
1538
+ "lstrip": false,
1539
+ "normalized": false,
1540
+ "rstrip": false,
1541
+ "single_word": false
1542
+ },
1543
+ {
1544
+ "content": "811371928234",
1545
+ "lstrip": false,
1546
+ "normalized": false,
1547
+ "rstrip": false,
1548
+ "single_word": false
1549
+ },
1550
+ {
1551
+ "content": "837131396371",
1552
+ "lstrip": false,
1553
+ "normalized": false,
1554
+ "rstrip": false,
1555
+ "single_word": false
1556
+ },
1557
+ {
1558
+ "content": "267514771964",
1559
+ "lstrip": false,
1560
+ "normalized": false,
1561
+ "rstrip": false,
1562
+ "single_word": false
1563
+ },
1564
+ {
1565
+ "content": "944513428457",
1566
+ "lstrip": false,
1567
+ "normalized": false,
1568
+ "rstrip": false,
1569
+ "single_word": false
1570
+ },
1571
+ {
1572
+ "content": "117298239631",
1573
+ "lstrip": false,
1574
+ "normalized": false,
1575
+ "rstrip": false,
1576
+ "single_word": false
1577
+ },
1578
+ {
1579
+ "content": "158142752582",
1580
+ "lstrip": false,
1581
+ "normalized": false,
1582
+ "rstrip": false,
1583
+ "single_word": false
1584
+ },
1585
+ {
1586
+ "content": "252867443568",
1587
+ "lstrip": false,
1588
+ "normalized": false,
1589
+ "rstrip": false,
1590
+ "single_word": false
1591
+ },
1592
+ {
1593
+ "content": "839269684865",
1594
+ "lstrip": false,
1595
+ "normalized": false,
1596
+ "rstrip": false,
1597
+ "single_word": false
1598
+ },
1599
+ {
1600
+ "content": "612788593128",
1601
+ "lstrip": false,
1602
+ "normalized": false,
1603
+ "rstrip": false,
1604
+ "single_word": false
1605
+ },
1606
+ {
1607
+ "content": "145669731981",
1608
+ "lstrip": false,
1609
+ "normalized": false,
1610
+ "rstrip": false,
1611
+ "single_word": false
1612
+ },
1613
+ {
1614
+ "content": "121557291859",
1615
+ "lstrip": false,
1616
+ "normalized": false,
1617
+ "rstrip": false,
1618
+ "single_word": false
1619
+ },
1620
+ {
1621
+ "content": "245416776926",
1622
+ "lstrip": false,
1623
+ "normalized": false,
1624
+ "rstrip": false,
1625
+ "single_word": false
1626
+ },
1627
+ {
1628
+ "content": "799417897197",
1629
+ "lstrip": false,
1630
+ "normalized": false,
1631
+ "rstrip": false,
1632
+ "single_word": false
1633
+ },
1634
+ {
1635
+ "content": "997958836435",
1636
+ "lstrip": false,
1637
+ "normalized": false,
1638
+ "rstrip": false,
1639
+ "single_word": false
1640
+ },
1641
+ {
1642
+ "content": "892336777248",
1643
+ "lstrip": false,
1644
+ "normalized": false,
1645
+ "rstrip": false,
1646
+ "single_word": false
1647
+ },
1648
+ {
1649
+ "content": "158929292238",
1650
+ "lstrip": false,
1651
+ "normalized": false,
1652
+ "rstrip": false,
1653
+ "single_word": false
1654
+ },
1655
+ {
1656
+ "content": "581976444672",
1657
+ "lstrip": false,
1658
+ "normalized": false,
1659
+ "rstrip": false,
1660
+ "single_word": false
1661
+ },
1662
+ {
1663
+ "content": "897784492783",
1664
+ "lstrip": false,
1665
+ "normalized": false,
1666
+ "rstrip": false,
1667
+ "single_word": false
1668
+ },
1669
+ {
1670
+ "content": "492373714791",
1671
+ "lstrip": false,
1672
+ "normalized": false,
1673
+ "rstrip": false,
1674
+ "single_word": false
1675
+ },
1676
+ {
1677
+ "content": "512659818733",
1678
+ "lstrip": false,
1679
+ "normalized": false,
1680
+ "rstrip": false,
1681
+ "single_word": false
1682
+ },
1683
+ {
1684
+ "content": "881112998642",
1685
+ "lstrip": false,
1686
+ "normalized": false,
1687
+ "rstrip": false,
1688
+ "single_word": false
1689
+ },
1690
+ {
1691
+ "content": "619454958782",
1692
+ "lstrip": false,
1693
+ "normalized": false,
1694
+ "rstrip": false,
1695
+ "single_word": false
1696
+ },
1697
+ {
1698
+ "content": "431149748713",
1699
+ "lstrip": false,
1700
+ "normalized": false,
1701
+ "rstrip": false,
1702
+ "single_word": false
1703
+ },
1704
+ {
1705
+ "content": "624221476921",
1706
+ "lstrip": false,
1707
+ "normalized": false,
1708
+ "rstrip": false,
1709
+ "single_word": false
1710
+ },
1711
+ {
1712
+ "content": "125866399464",
1713
+ "lstrip": false,
1714
+ "normalized": false,
1715
+ "rstrip": false,
1716
+ "single_word": false
1717
+ },
1718
+ {
1719
+ "content": "339882449689",
1720
+ "lstrip": false,
1721
+ "normalized": false,
1722
+ "rstrip": false,
1723
+ "single_word": false
1724
+ },
1725
+ {
1726
+ "content": "186198784585",
1727
+ "lstrip": false,
1728
+ "normalized": false,
1729
+ "rstrip": false,
1730
+ "single_word": false
1731
+ },
1732
+ {
1733
+ "content": "943193294691",
1734
+ "lstrip": false,
1735
+ "normalized": false,
1736
+ "rstrip": false,
1737
+ "single_word": false
1738
+ },
1739
+ {
1740
+ "content": "955668961269",
1741
+ "lstrip": false,
1742
+ "normalized": false,
1743
+ "rstrip": false,
1744
+ "single_word": false
1745
+ },
1746
+ {
1747
+ "content": "232787996724",
1748
+ "lstrip": false,
1749
+ "normalized": false,
1750
+ "rstrip": false,
1751
+ "single_word": false
1752
+ },
1753
+ {
1754
+ "content": "215671314196",
1755
+ "lstrip": false,
1756
+ "normalized": false,
1757
+ "rstrip": false,
1758
+ "single_word": false
1759
+ },
1760
+ {
1761
+ "content": "286173241916",
1762
+ "lstrip": false,
1763
+ "normalized": false,
1764
+ "rstrip": false,
1765
+ "single_word": false
1766
+ },
1767
+ {
1768
+ "content": "745977673725",
1769
+ "lstrip": false,
1770
+ "normalized": false,
1771
+ "rstrip": false,
1772
+ "single_word": false
1773
+ },
1774
+ {
1775
+ "content": "556976448182",
1776
+ "lstrip": false,
1777
+ "normalized": false,
1778
+ "rstrip": false,
1779
+ "single_word": false
1780
+ },
1781
+ {
1782
+ "content": "599961512792",
1783
+ "lstrip": false,
1784
+ "normalized": false,
1785
+ "rstrip": false,
1786
+ "single_word": false
1787
+ },
1788
+ {
1789
+ "content": "766294538337",
1790
+ "lstrip": false,
1791
+ "normalized": false,
1792
+ "rstrip": false,
1793
+ "single_word": false
1794
+ },
1795
+ {
1796
+ "content": "934912591213",
1797
+ "lstrip": false,
1798
+ "normalized": false,
1799
+ "rstrip": false,
1800
+ "single_word": false
1801
+ },
1802
+ {
1803
+ "content": "295118729589",
1804
+ "lstrip": false,
1805
+ "normalized": false,
1806
+ "rstrip": false,
1807
+ "single_word": false
1808
+ },
1809
+ {
1810
+ "content": "529455466433",
1811
+ "lstrip": false,
1812
+ "normalized": false,
1813
+ "rstrip": false,
1814
+ "single_word": false
1815
+ },
1816
+ {
1817
+ "content": "196119929397",
1818
+ "lstrip": false,
1819
+ "normalized": false,
1820
+ "rstrip": false,
1821
+ "single_word": false
1822
+ },
1823
+ {
1824
+ "content": "379571934299",
1825
+ "lstrip": false,
1826
+ "normalized": false,
1827
+ "rstrip": false,
1828
+ "single_word": false
1829
+ },
1830
+ {
1831
+ "content": "251789649997",
1832
+ "lstrip": false,
1833
+ "normalized": false,
1834
+ "rstrip": false,
1835
+ "single_word": false
1836
+ },
1837
+ {
1838
+ "content": "564544131355",
1839
+ "lstrip": false,
1840
+ "normalized": false,
1841
+ "rstrip": false,
1842
+ "single_word": false
1843
+ },
1844
+ {
1845
+ "content": "244371196654",
1846
+ "lstrip": false,
1847
+ "normalized": false,
1848
+ "rstrip": false,
1849
+ "single_word": false
1850
+ },
1851
+ {
1852
+ "content": "384598329253",
1853
+ "lstrip": false,
1854
+ "normalized": false,
1855
+ "rstrip": false,
1856
+ "single_word": false
1857
+ },
1858
+ {
1859
+ "content": "887753195844",
1860
+ "lstrip": false,
1861
+ "normalized": false,
1862
+ "rstrip": false,
1863
+ "single_word": false
1864
+ },
1865
+ {
1866
+ "content": "364947325679",
1867
+ "lstrip": false,
1868
+ "normalized": false,
1869
+ "rstrip": false,
1870
+ "single_word": false
1871
+ },
1872
+ {
1873
+ "content": "655517954651",
1874
+ "lstrip": false,
1875
+ "normalized": false,
1876
+ "rstrip": false,
1877
+ "single_word": false
1878
+ },
1879
+ {
1880
+ "content": "673948786567",
1881
+ "lstrip": false,
1882
+ "normalized": false,
1883
+ "rstrip": false,
1884
+ "single_word": false
1885
+ },
1886
+ {
1887
+ "content": "857231548835",
1888
+ "lstrip": false,
1889
+ "normalized": false,
1890
+ "rstrip": false,
1891
+ "single_word": false
1892
+ },
1893
+ {
1894
+ "content": "816115936673",
1895
+ "lstrip": false,
1896
+ "normalized": false,
1897
+ "rstrip": false,
1898
+ "single_word": false
1899
+ },
1900
+ {
1901
+ "content": "644234165531",
1902
+ "lstrip": false,
1903
+ "normalized": false,
1904
+ "rstrip": false,
1905
+ "single_word": false
1906
+ },
1907
+ {
1908
+ "content": "182782912224",
1909
+ "lstrip": false,
1910
+ "normalized": false,
1911
+ "rstrip": false,
1912
+ "single_word": false
1913
+ },
1914
+ {
1915
+ "content": "234316622259",
1916
+ "lstrip": false,
1917
+ "normalized": false,
1918
+ "rstrip": false,
1919
+ "single_word": false
1920
+ },
1921
+ {
1922
+ "content": "421369185549",
1923
+ "lstrip": false,
1924
+ "normalized": false,
1925
+ "rstrip": false,
1926
+ "single_word": false
1927
+ },
1928
+ {
1929
+ "content": "434632855397",
1930
+ "lstrip": false,
1931
+ "normalized": false,
1932
+ "rstrip": false,
1933
+ "single_word": false
1934
+ },
1935
+ {
1936
+ "content": "921889371893",
1937
+ "lstrip": false,
1938
+ "normalized": false,
1939
+ "rstrip": false,
1940
+ "single_word": false
1941
+ },
1942
+ {
1943
+ "content": "415956914763",
1944
+ "lstrip": false,
1945
+ "normalized": false,
1946
+ "rstrip": false,
1947
+ "single_word": false
1948
+ },
1949
+ {
1950
+ "content": "598916996413",
1951
+ "lstrip": false,
1952
+ "normalized": false,
1953
+ "rstrip": false,
1954
+ "single_word": false
1955
+ },
1956
+ {
1957
+ "content": "773671349113",
1958
+ "lstrip": false,
1959
+ "normalized": false,
1960
+ "rstrip": false,
1961
+ "single_word": false
1962
+ },
1963
+ {
1964
+ "content": "952465217972",
1965
+ "lstrip": false,
1966
+ "normalized": false,
1967
+ "rstrip": false,
1968
+ "single_word": false
1969
+ },
1970
+ {
1971
+ "content": "117657531962",
1972
+ "lstrip": false,
1973
+ "normalized": false,
1974
+ "rstrip": false,
1975
+ "single_word": false
1976
+ },
1977
+ {
1978
+ "content": "729825168745",
1979
+ "lstrip": false,
1980
+ "normalized": false,
1981
+ "rstrip": false,
1982
+ "single_word": false
1983
+ },
1984
+ {
1985
+ "content": "691315125346",
1986
+ "lstrip": false,
1987
+ "normalized": false,
1988
+ "rstrip": false,
1989
+ "single_word": false
1990
+ },
1991
+ {
1992
+ "content": "768461952319",
1993
+ "lstrip": false,
1994
+ "normalized": false,
1995
+ "rstrip": false,
1996
+ "single_word": false
1997
+ },
1998
+ {
1999
+ "content": "664847713559",
2000
+ "lstrip": false,
2001
+ "normalized": false,
2002
+ "rstrip": false,
2003
+ "single_word": false
2004
+ },
2005
+ {
2006
+ "content": "953267689786",
2007
+ "lstrip": false,
2008
+ "normalized": false,
2009
+ "rstrip": false,
2010
+ "single_word": false
2011
+ },
2012
+ {
2013
+ "content": "886464195129",
2014
+ "lstrip": false,
2015
+ "normalized": false,
2016
+ "rstrip": false,
2017
+ "single_word": false
2018
+ },
2019
+ {
2020
+ "content": "824488329416",
2021
+ "lstrip": false,
2022
+ "normalized": false,
2023
+ "rstrip": false,
2024
+ "single_word": false
2025
+ },
2026
+ {
2027
+ "content": "837873762491",
2028
+ "lstrip": false,
2029
+ "normalized": false,
2030
+ "rstrip": false,
2031
+ "single_word": false
2032
+ },
2033
+ {
2034
+ "content": "532833541879",
2035
+ "lstrip": false,
2036
+ "normalized": false,
2037
+ "rstrip": false,
2038
+ "single_word": false
2039
+ },
2040
+ {
2041
+ "content": "669183782449",
2042
+ "lstrip": false,
2043
+ "normalized": false,
2044
+ "rstrip": false,
2045
+ "single_word": false
2046
+ },
2047
+ {
2048
+ "content": "941976537588",
2049
+ "lstrip": false,
2050
+ "normalized": false,
2051
+ "rstrip": false,
2052
+ "single_word": false
2053
+ },
2054
+ {
2055
+ "content": "739394546916",
2056
+ "lstrip": false,
2057
+ "normalized": false,
2058
+ "rstrip": false,
2059
+ "single_word": false
2060
+ },
2061
+ {
2062
+ "content": "267954879268",
2063
+ "lstrip": false,
2064
+ "normalized": false,
2065
+ "rstrip": false,
2066
+ "single_word": false
2067
+ },
2068
+ {
2069
+ "content": "637551427887",
2070
+ "lstrip": false,
2071
+ "normalized": false,
2072
+ "rstrip": false,
2073
+ "single_word": false
2074
+ },
2075
+ {
2076
+ "content": "217756494954",
2077
+ "lstrip": false,
2078
+ "normalized": false,
2079
+ "rstrip": false,
2080
+ "single_word": false
2081
+ },
2082
+ {
2083
+ "content": "524444658383",
2084
+ "lstrip": false,
2085
+ "normalized": false,
2086
+ "rstrip": false,
2087
+ "single_word": false
2088
+ },
2089
+ {
2090
+ "content": "117783274348",
2091
+ "lstrip": false,
2092
+ "normalized": false,
2093
+ "rstrip": false,
2094
+ "single_word": false
2095
+ },
2096
+ {
2097
+ "content": "138218735276",
2098
+ "lstrip": false,
2099
+ "normalized": false,
2100
+ "rstrip": false,
2101
+ "single_word": false
2102
+ },
2103
+ {
2104
+ "content": "814611949491",
2105
+ "lstrip": false,
2106
+ "normalized": false,
2107
+ "rstrip": false,
2108
+ "single_word": false
2109
+ },
2110
+ {
2111
+ "content": "711641973413",
2112
+ "lstrip": false,
2113
+ "normalized": false,
2114
+ "rstrip": false,
2115
+ "single_word": false
2116
+ },
2117
+ {
2118
+ "content": "499156317423",
2119
+ "lstrip": false,
2120
+ "normalized": false,
2121
+ "rstrip": false,
2122
+ "single_word": false
2123
+ },
2124
+ {
2125
+ "content": "515856611931",
2126
+ "lstrip": false,
2127
+ "normalized": false,
2128
+ "rstrip": false,
2129
+ "single_word": false
2130
+ },
2131
+ {
2132
+ "content": "454164859837",
2133
+ "lstrip": false,
2134
+ "normalized": false,
2135
+ "rstrip": false,
2136
+ "single_word": false
2137
+ },
2138
+ {
2139
+ "content": "345271433112",
2140
+ "lstrip": false,
2141
+ "normalized": false,
2142
+ "rstrip": false,
2143
+ "single_word": false
2144
+ },
2145
+ {
2146
+ "content": "462294118988",
2147
+ "lstrip": false,
2148
+ "normalized": false,
2149
+ "rstrip": false,
2150
+ "single_word": false
2151
+ },
2152
+ {
2153
+ "content": "511785788222",
2154
+ "lstrip": false,
2155
+ "normalized": false,
2156
+ "rstrip": false,
2157
+ "single_word": false
2158
+ },
2159
+ {
2160
+ "content": "497294727353",
2161
+ "lstrip": false,
2162
+ "normalized": false,
2163
+ "rstrip": false,
2164
+ "single_word": false
2165
+ },
2166
+ {
2167
+ "content": "866519986723",
2168
+ "lstrip": false,
2169
+ "normalized": false,
2170
+ "rstrip": false,
2171
+ "single_word": false
2172
+ },
2173
+ {
2174
+ "content": "334513529294",
2175
+ "lstrip": false,
2176
+ "normalized": false,
2177
+ "rstrip": false,
2178
+ "single_word": false
2179
+ },
2180
+ {
2181
+ "content": "549946382131",
2182
+ "lstrip": false,
2183
+ "normalized": false,
2184
+ "rstrip": false,
2185
+ "single_word": false
2186
+ },
2187
+ {
2188
+ "content": "284445431422",
2189
+ "lstrip": false,
2190
+ "normalized": false,
2191
+ "rstrip": false,
2192
+ "single_word": false
2193
+ },
2194
+ {
2195
+ "content": "396521188476",
2196
+ "lstrip": false,
2197
+ "normalized": false,
2198
+ "rstrip": false,
2199
+ "single_word": false
2200
+ },
2201
+ {
2202
+ "content": "421435255895",
2203
+ "lstrip": false,
2204
+ "normalized": false,
2205
+ "rstrip": false,
2206
+ "single_word": false
2207
+ },
2208
+ {
2209
+ "content": "133373659361",
2210
+ "lstrip": false,
2211
+ "normalized": false,
2212
+ "rstrip": false,
2213
+ "single_word": false
2214
+ },
2215
+ {
2216
+ "content": "322683334381",
2217
+ "lstrip": false,
2218
+ "normalized": false,
2219
+ "rstrip": false,
2220
+ "single_word": false
2221
+ },
2222
+ {
2223
+ "content": "228358422847",
2224
+ "lstrip": false,
2225
+ "normalized": false,
2226
+ "rstrip": false,
2227
+ "single_word": false
2228
+ },
2229
+ {
2230
+ "content": "291762694874",
2231
+ "lstrip": false,
2232
+ "normalized": false,
2233
+ "rstrip": false,
2234
+ "single_word": false
2235
+ },
2236
+ {
2237
+ "content": "143182978129",
2238
+ "lstrip": false,
2239
+ "normalized": false,
2240
+ "rstrip": false,
2241
+ "single_word": false
2242
+ },
2243
+ {
2244
+ "content": "511923256573",
2245
+ "lstrip": false,
2246
+ "normalized": false,
2247
+ "rstrip": false,
2248
+ "single_word": false
2249
+ },
2250
+ {
2251
+ "content": "327158398268",
2252
+ "lstrip": false,
2253
+ "normalized": false,
2254
+ "rstrip": false,
2255
+ "single_word": false
2256
+ },
2257
+ {
2258
+ "content": "879764613759",
2259
+ "lstrip": false,
2260
+ "normalized": false,
2261
+ "rstrip": false,
2262
+ "single_word": false
2263
+ },
2264
+ {
2265
+ "content": "564395222747",
2266
+ "lstrip": false,
2267
+ "normalized": false,
2268
+ "rstrip": false,
2269
+ "single_word": false
2270
+ },
2271
+ {
2272
+ "content": "451161679736",
2273
+ "lstrip": false,
2274
+ "normalized": false,
2275
+ "rstrip": false,
2276
+ "single_word": false
2277
+ },
2278
+ {
2279
+ "content": "538631466654",
2280
+ "lstrip": false,
2281
+ "normalized": false,
2282
+ "rstrip": false,
2283
+ "single_word": false
2284
+ },
2285
+ {
2286
+ "content": "221762325616",
2287
+ "lstrip": false,
2288
+ "normalized": false,
2289
+ "rstrip": false,
2290
+ "single_word": false
2291
+ },
2292
+ {
2293
+ "content": "218391991184",
2294
+ "lstrip": false,
2295
+ "normalized": false,
2296
+ "rstrip": false,
2297
+ "single_word": false
2298
+ },
2299
+ {
2300
+ "content": "322589379462",
2301
+ "lstrip": false,
2302
+ "normalized": false,
2303
+ "rstrip": false,
2304
+ "single_word": false
2305
+ },
2306
+ {
2307
+ "content": "876537814263",
2308
+ "lstrip": false,
2309
+ "normalized": false,
2310
+ "rstrip": false,
2311
+ "single_word": false
2312
+ },
2313
+ {
2314
+ "content": "152676556624",
2315
+ "lstrip": false,
2316
+ "normalized": false,
2317
+ "rstrip": false,
2318
+ "single_word": false
2319
+ },
2320
+ {
2321
+ "content": "332522971941",
2322
+ "lstrip": false,
2323
+ "normalized": false,
2324
+ "rstrip": false,
2325
+ "single_word": false
2326
+ },
2327
+ {
2328
+ "content": "884354318946",
2329
+ "lstrip": false,
2330
+ "normalized": false,
2331
+ "rstrip": false,
2332
+ "single_word": false
2333
+ },
2334
+ {
2335
+ "content": "513349618943",
2336
+ "lstrip": false,
2337
+ "normalized": false,
2338
+ "rstrip": false,
2339
+ "single_word": false
2340
+ },
2341
+ {
2342
+ "content": "116639746413",
2343
+ "lstrip": false,
2344
+ "normalized": false,
2345
+ "rstrip": false,
2346
+ "single_word": false
2347
+ },
2348
+ {
2349
+ "content": "635185846287",
2350
+ "lstrip": false,
2351
+ "normalized": false,
2352
+ "rstrip": false,
2353
+ "single_word": false
2354
+ },
2355
+ {
2356
+ "content": "993832498489",
2357
+ "lstrip": false,
2358
+ "normalized": false,
2359
+ "rstrip": false,
2360
+ "single_word": false
2361
+ },
2362
+ {
2363
+ "content": "813981174797",
2364
+ "lstrip": false,
2365
+ "normalized": false,
2366
+ "rstrip": false,
2367
+ "single_word": false
2368
+ },
2369
+ {
2370
+ "content": "438745114173",
2371
+ "lstrip": false,
2372
+ "normalized": false,
2373
+ "rstrip": false,
2374
+ "single_word": false
2375
+ },
2376
+ {
2377
+ "content": "983493951323",
2378
+ "lstrip": false,
2379
+ "normalized": false,
2380
+ "rstrip": false,
2381
+ "single_word": false
2382
+ },
2383
+ {
2384
+ "content": "724492262421",
2385
+ "lstrip": false,
2386
+ "normalized": false,
2387
+ "rstrip": false,
2388
+ "single_word": false
2389
+ },
2390
+ {
2391
+ "content": "622553389126",
2392
+ "lstrip": false,
2393
+ "normalized": false,
2394
+ "rstrip": false,
2395
+ "single_word": false
2396
+ },
2397
+ {
2398
+ "content": "889965243135",
2399
+ "lstrip": false,
2400
+ "normalized": false,
2401
+ "rstrip": false,
2402
+ "single_word": false
2403
+ },
2404
+ {
2405
+ "content": "364492359246",
2406
+ "lstrip": false,
2407
+ "normalized": false,
2408
+ "rstrip": false,
2409
+ "single_word": false
2410
+ },
2411
+ {
2412
+ "content": "154962668224",
2413
+ "lstrip": false,
2414
+ "normalized": false,
2415
+ "rstrip": false,
2416
+ "single_word": false
2417
+ },
2418
+ {
2419
+ "content": "179564995814",
2420
+ "lstrip": false,
2421
+ "normalized": false,
2422
+ "rstrip": false,
2423
+ "single_word": false
2424
+ },
2425
+ {
2426
+ "content": "418412875665",
2427
+ "lstrip": false,
2428
+ "normalized": false,
2429
+ "rstrip": false,
2430
+ "single_word": false
2431
+ },
2432
+ {
2433
+ "content": "718951851413",
2434
+ "lstrip": false,
2435
+ "normalized": false,
2436
+ "rstrip": false,
2437
+ "single_word": false
2438
+ },
2439
+ {
2440
+ "content": "699446724178",
2441
+ "lstrip": false,
2442
+ "normalized": false,
2443
+ "rstrip": false,
2444
+ "single_word": false
2445
+ },
2446
+ {
2447
+ "content": "624266421831",
2448
+ "lstrip": false,
2449
+ "normalized": false,
2450
+ "rstrip": false,
2451
+ "single_word": false
2452
+ },
2453
+ {
2454
+ "content": "815458725125",
2455
+ "lstrip": false,
2456
+ "normalized": false,
2457
+ "rstrip": false,
2458
+ "single_word": false
2459
+ },
2460
+ {
2461
+ "content": "455423278865",
2462
+ "lstrip": false,
2463
+ "normalized": false,
2464
+ "rstrip": false,
2465
+ "single_word": false
2466
+ },
2467
+ {
2468
+ "content": "393741199486",
2469
+ "lstrip": false,
2470
+ "normalized": false,
2471
+ "rstrip": false,
2472
+ "single_word": false
2473
+ },
2474
+ {
2475
+ "content": "328552864359",
2476
+ "lstrip": false,
2477
+ "normalized": false,
2478
+ "rstrip": false,
2479
+ "single_word": false
2480
+ },
2481
+ {
2482
+ "content": "211662639865",
2483
+ "lstrip": false,
2484
+ "normalized": false,
2485
+ "rstrip": false,
2486
+ "single_word": false
2487
+ },
2488
+ {
2489
+ "content": "218784516525",
2490
+ "lstrip": false,
2491
+ "normalized": false,
2492
+ "rstrip": false,
2493
+ "single_word": false
2494
+ },
2495
+ {
2496
+ "content": "762486672996",
2497
+ "lstrip": false,
2498
+ "normalized": false,
2499
+ "rstrip": false,
2500
+ "single_word": false
2501
+ },
2502
+ {
2503
+ "content": "142799718159",
2504
+ "lstrip": false,
2505
+ "normalized": false,
2506
+ "rstrip": false,
2507
+ "single_word": false
2508
+ },
2509
+ {
2510
+ "content": "858146415154",
2511
+ "lstrip": false,
2512
+ "normalized": false,
2513
+ "rstrip": false,
2514
+ "single_word": false
2515
+ },
2516
+ {
2517
+ "content": "767858144912",
2518
+ "lstrip": false,
2519
+ "normalized": false,
2520
+ "rstrip": false,
2521
+ "single_word": false
2522
+ },
2523
+ {
2524
+ "content": "571317457151",
2525
+ "lstrip": false,
2526
+ "normalized": false,
2527
+ "rstrip": false,
2528
+ "single_word": false
2529
+ },
2530
+ {
2531
+ "content": "635127952696",
2532
+ "lstrip": false,
2533
+ "normalized": false,
2534
+ "rstrip": false,
2535
+ "single_word": false
2536
+ },
2537
+ {
2538
+ "content": "116427191984",
2539
+ "lstrip": false,
2540
+ "normalized": false,
2541
+ "rstrip": false,
2542
+ "single_word": false
2543
+ },
2544
+ {
2545
+ "content": "268921994538",
2546
+ "lstrip": false,
2547
+ "normalized": false,
2548
+ "rstrip": false,
2549
+ "single_word": false
2550
+ },
2551
+ {
2552
+ "content": "523937669294",
2553
+ "lstrip": false,
2554
+ "normalized": false,
2555
+ "rstrip": false,
2556
+ "single_word": false
2557
+ },
2558
+ {
2559
+ "content": "165429152138",
2560
+ "lstrip": false,
2561
+ "normalized": false,
2562
+ "rstrip": false,
2563
+ "single_word": false
2564
+ },
2565
+ {
2566
+ "content": "739246183345",
2567
+ "lstrip": false,
2568
+ "normalized": false,
2569
+ "rstrip": false,
2570
+ "single_word": false
2571
+ },
2572
+ {
2573
+ "content": "591464355756",
2574
+ "lstrip": false,
2575
+ "normalized": false,
2576
+ "rstrip": false,
2577
+ "single_word": false
2578
+ },
2579
+ {
2580
+ "content": "212985874612",
2581
+ "lstrip": false,
2582
+ "normalized": false,
2583
+ "rstrip": false,
2584
+ "single_word": false
2585
+ },
2586
+ {
2587
+ "content": "191887635211",
2588
+ "lstrip": false,
2589
+ "normalized": false,
2590
+ "rstrip": false,
2591
+ "single_word": false
2592
+ },
2593
+ {
2594
+ "content": "967214577653",
2595
+ "lstrip": false,
2596
+ "normalized": false,
2597
+ "rstrip": false,
2598
+ "single_word": false
2599
+ },
2600
+ {
2601
+ "content": "119342152414",
2602
+ "lstrip": false,
2603
+ "normalized": false,
2604
+ "rstrip": false,
2605
+ "single_word": false
2606
+ },
2607
+ {
2608
+ "content": "946444632795",
2609
+ "lstrip": false,
2610
+ "normalized": false,
2611
+ "rstrip": false,
2612
+ "single_word": false
2613
+ },
2614
+ {
2615
+ "content": "618423867817",
2616
+ "lstrip": false,
2617
+ "normalized": false,
2618
+ "rstrip": false,
2619
+ "single_word": false
2620
+ },
2621
+ {
2622
+ "content": "228565148417",
2623
+ "lstrip": false,
2624
+ "normalized": false,
2625
+ "rstrip": false,
2626
+ "single_word": false
2627
+ },
2628
+ {
2629
+ "content": "729116422489",
2630
+ "lstrip": false,
2631
+ "normalized": false,
2632
+ "rstrip": false,
2633
+ "single_word": false
2634
+ },
2635
+ {
2636
+ "content": "527874729936",
2637
+ "lstrip": false,
2638
+ "normalized": false,
2639
+ "rstrip": false,
2640
+ "single_word": false
2641
+ },
2642
+ {
2643
+ "content": "739784153482",
2644
+ "lstrip": false,
2645
+ "normalized": false,
2646
+ "rstrip": false,
2647
+ "single_word": false
2648
+ },
2649
+ {
2650
+ "content": "387763951128",
2651
+ "lstrip": false,
2652
+ "normalized": false,
2653
+ "rstrip": false,
2654
+ "single_word": false
2655
+ },
2656
+ {
2657
+ "content": "331369926711",
2658
+ "lstrip": false,
2659
+ "normalized": false,
2660
+ "rstrip": false,
2661
+ "single_word": false
2662
+ },
2663
+ {
2664
+ "content": "562716493614",
2665
+ "lstrip": false,
2666
+ "normalized": false,
2667
+ "rstrip": false,
2668
+ "single_word": false
2669
+ },
2670
+ {
2671
+ "content": "739667844957",
2672
+ "lstrip": false,
2673
+ "normalized": false,
2674
+ "rstrip": false,
2675
+ "single_word": false
2676
+ },
2677
+ {
2678
+ "content": "562389434565",
2679
+ "lstrip": false,
2680
+ "normalized": false,
2681
+ "rstrip": false,
2682
+ "single_word": false
2683
+ },
2684
+ {
2685
+ "content": "256497188281",
2686
+ "lstrip": false,
2687
+ "normalized": false,
2688
+ "rstrip": false,
2689
+ "single_word": false
2690
+ },
2691
+ {
2692
+ "content": "859927364588",
2693
+ "lstrip": false,
2694
+ "normalized": false,
2695
+ "rstrip": false,
2696
+ "single_word": false
2697
+ },
2698
+ {
2699
+ "content": "417668946583",
2700
+ "lstrip": false,
2701
+ "normalized": false,
2702
+ "rstrip": false,
2703
+ "single_word": false
2704
+ },
2705
+ {
2706
+ "content": "357621613582",
2707
+ "lstrip": false,
2708
+ "normalized": false,
2709
+ "rstrip": false,
2710
+ "single_word": false
2711
+ },
2712
+ {
2713
+ "content": "438435178228",
2714
+ "lstrip": false,
2715
+ "normalized": false,
2716
+ "rstrip": false,
2717
+ "single_word": false
2718
+ },
2719
+ {
2720
+ "content": "485692541169",
2721
+ "lstrip": false,
2722
+ "normalized": false,
2723
+ "rstrip": false,
2724
+ "single_word": false
2725
+ },
2726
+ {
2727
+ "content": "825815739116",
2728
+ "lstrip": false,
2729
+ "normalized": false,
2730
+ "rstrip": false,
2731
+ "single_word": false
2732
+ },
2733
+ {
2734
+ "content": "342221452223",
2735
+ "lstrip": false,
2736
+ "normalized": false,
2737
+ "rstrip": false,
2738
+ "single_word": false
2739
+ },
2740
+ {
2741
+ "content": "697747991249",
2742
+ "lstrip": false,
2743
+ "normalized": false,
2744
+ "rstrip": false,
2745
+ "single_word": false
2746
+ },
2747
+ {
2748
+ "content": "716763689965",
2749
+ "lstrip": false,
2750
+ "normalized": false,
2751
+ "rstrip": false,
2752
+ "single_word": false
2753
+ },
2754
+ {
2755
+ "content": "141499982867",
2756
+ "lstrip": false,
2757
+ "normalized": false,
2758
+ "rstrip": false,
2759
+ "single_word": false
2760
+ },
2761
+ {
2762
+ "content": "818479319499",
2763
+ "lstrip": false,
2764
+ "normalized": false,
2765
+ "rstrip": false,
2766
+ "single_word": false
2767
+ },
2768
+ {
2769
+ "content": "336813343298",
2770
+ "lstrip": false,
2771
+ "normalized": false,
2772
+ "rstrip": false,
2773
+ "single_word": false
2774
+ },
2775
+ {
2776
+ "content": "594688742928",
2777
+ "lstrip": false,
2778
+ "normalized": false,
2779
+ "rstrip": false,
2780
+ "single_word": false
2781
+ },
2782
+ {
2783
+ "content": "472129283475",
2784
+ "lstrip": false,
2785
+ "normalized": false,
2786
+ "rstrip": false,
2787
+ "single_word": false
2788
+ },
2789
+ {
2790
+ "content": "514354144759",
2791
+ "lstrip": false,
2792
+ "normalized": false,
2793
+ "rstrip": false,
2794
+ "single_word": false
2795
+ },
2796
+ {
2797
+ "content": "349249721685",
2798
+ "lstrip": false,
2799
+ "normalized": false,
2800
+ "rstrip": false,
2801
+ "single_word": false
2802
+ },
2803
+ {
2804
+ "content": "546276298359",
2805
+ "lstrip": false,
2806
+ "normalized": false,
2807
+ "rstrip": false,
2808
+ "single_word": false
2809
+ },
2810
+ {
2811
+ "content": "353755529131",
2812
+ "lstrip": false,
2813
+ "normalized": false,
2814
+ "rstrip": false,
2815
+ "single_word": false
2816
+ },
2817
+ {
2818
+ "content": "315534574435",
2819
+ "lstrip": false,
2820
+ "normalized": false,
2821
+ "rstrip": false,
2822
+ "single_word": false
2823
+ },
2824
+ {
2825
+ "content": "523723475786",
2826
+ "lstrip": false,
2827
+ "normalized": false,
2828
+ "rstrip": false,
2829
+ "single_word": false
2830
+ },
2831
+ {
2832
+ "content": "215826764872",
2833
+ "lstrip": false,
2834
+ "normalized": false,
2835
+ "rstrip": false,
2836
+ "single_word": false
2837
+ },
2838
+ {
2839
+ "content": "367968398551",
2840
+ "lstrip": false,
2841
+ "normalized": false,
2842
+ "rstrip": false,
2843
+ "single_word": false
2844
+ },
2845
+ {
2846
+ "content": "569853653352",
2847
+ "lstrip": false,
2848
+ "normalized": false,
2849
+ "rstrip": false,
2850
+ "single_word": false
2851
+ },
2852
+ {
2853
+ "content": "389715484387",
2854
+ "lstrip": false,
2855
+ "normalized": false,
2856
+ "rstrip": false,
2857
+ "single_word": false
2858
+ },
2859
+ {
2860
+ "content": "293847485454",
2861
+ "lstrip": false,
2862
+ "normalized": false,
2863
+ "rstrip": false,
2864
+ "single_word": false
2865
+ },
2866
+ {
2867
+ "content": "714738141818",
2868
+ "lstrip": false,
2869
+ "normalized": false,
2870
+ "rstrip": false,
2871
+ "single_word": false
2872
+ },
2873
+ {
2874
+ "content": "178478368922",
2875
+ "lstrip": false,
2876
+ "normalized": false,
2877
+ "rstrip": false,
2878
+ "single_word": false
2879
+ },
2880
+ {
2881
+ "content": "581493616981",
2882
+ "lstrip": false,
2883
+ "normalized": false,
2884
+ "rstrip": false,
2885
+ "single_word": false
2886
+ },
2887
+ {
2888
+ "content": "589439538674",
2889
+ "lstrip": false,
2890
+ "normalized": false,
2891
+ "rstrip": false,
2892
+ "single_word": false
2893
+ },
2894
+ {
2895
+ "content": "846657726193",
2896
+ "lstrip": false,
2897
+ "normalized": false,
2898
+ "rstrip": false,
2899
+ "single_word": false
2900
+ },
2901
+ {
2902
+ "content": "722339992679",
2903
+ "lstrip": false,
2904
+ "normalized": false,
2905
+ "rstrip": false,
2906
+ "single_word": false
2907
+ },
2908
+ {
2909
+ "content": "138154781148",
2910
+ "lstrip": false,
2911
+ "normalized": false,
2912
+ "rstrip": false,
2913
+ "single_word": false
2914
+ },
2915
+ {
2916
+ "content": "757785319772",
2917
+ "lstrip": false,
2918
+ "normalized": false,
2919
+ "rstrip": false,
2920
+ "single_word": false
2921
+ },
2922
+ {
2923
+ "content": "492516914298",
2924
+ "lstrip": false,
2925
+ "normalized": false,
2926
+ "rstrip": false,
2927
+ "single_word": false
2928
+ },
2929
+ {
2930
+ "content": "919181521716",
2931
+ "lstrip": false,
2932
+ "normalized": false,
2933
+ "rstrip": false,
2934
+ "single_word": false
2935
+ },
2936
+ {
2937
+ "content": "985781138935",
2938
+ "lstrip": false,
2939
+ "normalized": false,
2940
+ "rstrip": false,
2941
+ "single_word": false
2942
+ },
2943
+ {
2944
+ "content": "476969195485",
2945
+ "lstrip": false,
2946
+ "normalized": false,
2947
+ "rstrip": false,
2948
+ "single_word": false
2949
+ },
2950
+ {
2951
+ "content": "313145133463",
2952
+ "lstrip": false,
2953
+ "normalized": false,
2954
+ "rstrip": false,
2955
+ "single_word": false
2956
+ },
2957
+ {
2958
+ "content": "758963111966",
2959
+ "lstrip": false,
2960
+ "normalized": false,
2961
+ "rstrip": false,
2962
+ "single_word": false
2963
+ },
2964
+ {
2965
+ "content": "147541537162",
2966
+ "lstrip": false,
2967
+ "normalized": false,
2968
+ "rstrip": false,
2969
+ "single_word": false
2970
+ },
2971
+ {
2972
+ "content": "557163366873",
2973
+ "lstrip": false,
2974
+ "normalized": false,
2975
+ "rstrip": false,
2976
+ "single_word": false
2977
+ },
2978
+ {
2979
+ "content": "144373897488",
2980
+ "lstrip": false,
2981
+ "normalized": false,
2982
+ "rstrip": false,
2983
+ "single_word": false
2984
+ },
2985
+ {
2986
+ "content": "522515164754",
2987
+ "lstrip": false,
2988
+ "normalized": false,
2989
+ "rstrip": false,
2990
+ "single_word": false
2991
+ },
2992
+ {
2993
+ "content": "724964923582",
2994
+ "lstrip": false,
2995
+ "normalized": false,
2996
+ "rstrip": false,
2997
+ "single_word": false
2998
+ },
2999
+ {
3000
+ "content": "284776712475",
3001
+ "lstrip": false,
3002
+ "normalized": false,
3003
+ "rstrip": false,
3004
+ "single_word": false
3005
+ },
3006
+ {
3007
+ "content": "375429755114",
3008
+ "lstrip": false,
3009
+ "normalized": false,
3010
+ "rstrip": false,
3011
+ "single_word": false
3012
+ },
3013
+ {
3014
+ "content": "181233596124",
3015
+ "lstrip": false,
3016
+ "normalized": false,
3017
+ "rstrip": false,
3018
+ "single_word": false
3019
+ },
3020
+ {
3021
+ "content": "948585673431",
3022
+ "lstrip": false,
3023
+ "normalized": false,
3024
+ "rstrip": false,
3025
+ "single_word": false
3026
+ },
3027
+ {
3028
+ "content": "243165586174",
3029
+ "lstrip": false,
3030
+ "normalized": false,
3031
+ "rstrip": false,
3032
+ "single_word": false
3033
+ },
3034
+ {
3035
+ "content": "396847976144",
3036
+ "lstrip": false,
3037
+ "normalized": false,
3038
+ "rstrip": false,
3039
+ "single_word": false
3040
+ },
3041
+ {
3042
+ "content": "997724962668",
3043
+ "lstrip": false,
3044
+ "normalized": false,
3045
+ "rstrip": false,
3046
+ "single_word": false
3047
+ },
3048
+ {
3049
+ "content": "558837194455",
3050
+ "lstrip": false,
3051
+ "normalized": false,
3052
+ "rstrip": false,
3053
+ "single_word": false
3054
+ },
3055
+ {
3056
+ "content": "163165456396",
3057
+ "lstrip": false,
3058
+ "normalized": false,
3059
+ "rstrip": false,
3060
+ "single_word": false
3061
+ },
3062
+ {
3063
+ "content": "378749551722",
3064
+ "lstrip": false,
3065
+ "normalized": false,
3066
+ "rstrip": false,
3067
+ "single_word": false
3068
+ },
3069
+ {
3070
+ "content": "161238482259",
3071
+ "lstrip": false,
3072
+ "normalized": false,
3073
+ "rstrip": false,
3074
+ "single_word": false
3075
+ },
3076
+ {
3077
+ "content": "754978243758",
3078
+ "lstrip": false,
3079
+ "normalized": false,
3080
+ "rstrip": false,
3081
+ "single_word": false
3082
+ },
3083
+ {
3084
+ "content": "195388849133",
3085
+ "lstrip": false,
3086
+ "normalized": false,
3087
+ "rstrip": false,
3088
+ "single_word": false
3089
+ },
3090
+ {
3091
+ "content": "229775525672",
3092
+ "lstrip": false,
3093
+ "normalized": false,
3094
+ "rstrip": false,
3095
+ "single_word": false
3096
+ },
3097
+ {
3098
+ "content": "262437452884",
3099
+ "lstrip": false,
3100
+ "normalized": false,
3101
+ "rstrip": false,
3102
+ "single_word": false
3103
+ },
3104
+ {
3105
+ "content": "441377892146",
3106
+ "lstrip": false,
3107
+ "normalized": false,
3108
+ "rstrip": false,
3109
+ "single_word": false
3110
+ },
3111
+ {
3112
+ "content": "451885565366",
3113
+ "lstrip": false,
3114
+ "normalized": false,
3115
+ "rstrip": false,
3116
+ "single_word": false
3117
+ },
3118
+ {
3119
+ "content": "981277526855",
3120
+ "lstrip": false,
3121
+ "normalized": false,
3122
+ "rstrip": false,
3123
+ "single_word": false
3124
+ },
3125
+ {
3126
+ "content": "762495822823",
3127
+ "lstrip": false,
3128
+ "normalized": false,
3129
+ "rstrip": false,
3130
+ "single_word": false
3131
+ },
3132
+ {
3133
+ "content": "368763327262",
3134
+ "lstrip": false,
3135
+ "normalized": false,
3136
+ "rstrip": false,
3137
+ "single_word": false
3138
+ },
3139
+ {
3140
+ "content": "757422791351",
3141
+ "lstrip": false,
3142
+ "normalized": false,
3143
+ "rstrip": false,
3144
+ "single_word": false
3145
+ },
3146
+ {
3147
+ "content": "636324136426",
3148
+ "lstrip": false,
3149
+ "normalized": false,
3150
+ "rstrip": false,
3151
+ "single_word": false
3152
+ },
3153
+ {
3154
+ "content": "214193645583",
3155
+ "lstrip": false,
3156
+ "normalized": false,
3157
+ "rstrip": false,
3158
+ "single_word": false
3159
+ },
3160
+ {
3161
+ "content": "412843856172",
3162
+ "lstrip": false,
3163
+ "normalized": false,
3164
+ "rstrip": false,
3165
+ "single_word": false
3166
+ },
3167
+ {
3168
+ "content": "179386156569",
3169
+ "lstrip": false,
3170
+ "normalized": false,
3171
+ "rstrip": false,
3172
+ "single_word": false
3173
+ },
3174
+ {
3175
+ "content": "756916173536",
3176
+ "lstrip": false,
3177
+ "normalized": false,
3178
+ "rstrip": false,
3179
+ "single_word": false
3180
+ },
3181
+ {
3182
+ "content": "892697125149",
3183
+ "lstrip": false,
3184
+ "normalized": false,
3185
+ "rstrip": false,
3186
+ "single_word": false
3187
+ },
3188
+ {
3189
+ "content": "625334487352",
3190
+ "lstrip": false,
3191
+ "normalized": false,
3192
+ "rstrip": false,
3193
+ "single_word": false
3194
+ },
3195
+ {
3196
+ "content": "941861857715",
3197
+ "lstrip": false,
3198
+ "normalized": false,
3199
+ "rstrip": false,
3200
+ "single_word": false
3201
+ },
3202
+ {
3203
+ "content": "887417525236",
3204
+ "lstrip": false,
3205
+ "normalized": false,
3206
+ "rstrip": false,
3207
+ "single_word": false
3208
+ },
3209
+ {
3210
+ "content": "649516938598",
3211
+ "lstrip": false,
3212
+ "normalized": false,
3213
+ "rstrip": false,
3214
+ "single_word": false
3215
+ },
3216
+ {
3217
+ "content": "717628619782",
3218
+ "lstrip": false,
3219
+ "normalized": false,
3220
+ "rstrip": false,
3221
+ "single_word": false
3222
+ },
3223
+ {
3224
+ "content": "438124184139",
3225
+ "lstrip": false,
3226
+ "normalized": false,
3227
+ "rstrip": false,
3228
+ "single_word": false
3229
+ },
3230
+ {
3231
+ "content": "547563892268",
3232
+ "lstrip": false,
3233
+ "normalized": false,
3234
+ "rstrip": false,
3235
+ "single_word": false
3236
+ },
3237
+ {
3238
+ "content": "856317483891",
3239
+ "lstrip": false,
3240
+ "normalized": false,
3241
+ "rstrip": false,
3242
+ "single_word": false
3243
+ },
3244
+ {
3245
+ "content": "313313831273",
3246
+ "lstrip": false,
3247
+ "normalized": false,
3248
+ "rstrip": false,
3249
+ "single_word": false
3250
+ },
3251
+ {
3252
+ "content": "371496153876",
3253
+ "lstrip": false,
3254
+ "normalized": false,
3255
+ "rstrip": false,
3256
+ "single_word": false
3257
+ },
3258
+ {
3259
+ "content": "587541149322",
3260
+ "lstrip": false,
3261
+ "normalized": false,
3262
+ "rstrip": false,
3263
+ "single_word": false
3264
+ },
3265
+ {
3266
+ "content": "265847332563",
3267
+ "lstrip": false,
3268
+ "normalized": false,
3269
+ "rstrip": false,
3270
+ "single_word": false
3271
+ },
3272
+ {
3273
+ "content": "449549215429",
3274
+ "lstrip": false,
3275
+ "normalized": false,
3276
+ "rstrip": false,
3277
+ "single_word": false
3278
+ },
3279
+ {
3280
+ "content": "163497196769",
3281
+ "lstrip": false,
3282
+ "normalized": false,
3283
+ "rstrip": false,
3284
+ "single_word": false
3285
+ },
3286
+ {
3287
+ "content": "861342291298",
3288
+ "lstrip": false,
3289
+ "normalized": false,
3290
+ "rstrip": false,
3291
+ "single_word": false
3292
+ },
3293
+ {
3294
+ "content": "268433315926",
3295
+ "lstrip": false,
3296
+ "normalized": false,
3297
+ "rstrip": false,
3298
+ "single_word": false
3299
+ },
3300
+ {
3301
+ "content": "774679513717",
3302
+ "lstrip": false,
3303
+ "normalized": false,
3304
+ "rstrip": false,
3305
+ "single_word": false
3306
+ },
3307
+ {
3308
+ "content": "851254219729",
3309
+ "lstrip": false,
3310
+ "normalized": false,
3311
+ "rstrip": false,
3312
+ "single_word": false
3313
+ },
3314
+ {
3315
+ "content": "583527834464",
3316
+ "lstrip": false,
3317
+ "normalized": false,
3318
+ "rstrip": false,
3319
+ "single_word": false
3320
+ },
3321
+ {
3322
+ "content": "488496781997",
3323
+ "lstrip": false,
3324
+ "normalized": false,
3325
+ "rstrip": false,
3326
+ "single_word": false
3327
+ },
3328
+ {
3329
+ "content": "556814553861",
3330
+ "lstrip": false,
3331
+ "normalized": false,
3332
+ "rstrip": false,
3333
+ "single_word": false
3334
+ },
3335
+ {
3336
+ "content": "482829231639",
3337
+ "lstrip": false,
3338
+ "normalized": false,
3339
+ "rstrip": false,
3340
+ "single_word": false
3341
+ },
3342
+ {
3343
+ "content": "618878266619",
3344
+ "lstrip": false,
3345
+ "normalized": false,
3346
+ "rstrip": false,
3347
+ "single_word": false
3348
+ },
3349
+ {
3350
+ "content": "147444452794",
3351
+ "lstrip": false,
3352
+ "normalized": false,
3353
+ "rstrip": false,
3354
+ "single_word": false
3355
+ },
3356
+ {
3357
+ "content": "949235426629",
3358
+ "lstrip": false,
3359
+ "normalized": false,
3360
+ "rstrip": false,
3361
+ "single_word": false
3362
+ },
3363
+ {
3364
+ "content": "357299947518",
3365
+ "lstrip": false,
3366
+ "normalized": false,
3367
+ "rstrip": false,
3368
+ "single_word": false
3369
+ },
3370
+ {
3371
+ "content": "175528632226",
3372
+ "lstrip": false,
3373
+ "normalized": false,
3374
+ "rstrip": false,
3375
+ "single_word": false
3376
+ },
3377
+ {
3378
+ "content": "645527857972",
3379
+ "lstrip": false,
3380
+ "normalized": false,
3381
+ "rstrip": false,
3382
+ "single_word": false
3383
+ },
3384
+ {
3385
+ "content": "186872457894",
3386
+ "lstrip": false,
3387
+ "normalized": false,
3388
+ "rstrip": false,
3389
+ "single_word": false
3390
+ },
3391
+ {
3392
+ "content": "552738847828",
3393
+ "lstrip": false,
3394
+ "normalized": false,
3395
+ "rstrip": false,
3396
+ "single_word": false
3397
+ },
3398
+ {
3399
+ "content": "626748382482",
3400
+ "lstrip": false,
3401
+ "normalized": false,
3402
+ "rstrip": false,
3403
+ "single_word": false
3404
+ },
3405
+ {
3406
+ "content": "921894985642",
3407
+ "lstrip": false,
3408
+ "normalized": false,
3409
+ "rstrip": false,
3410
+ "single_word": false
3411
+ },
3412
+ {
3413
+ "content": "943878645871",
3414
+ "lstrip": false,
3415
+ "normalized": false,
3416
+ "rstrip": false,
3417
+ "single_word": false
3418
+ },
3419
+ {
3420
+ "content": "859289776479",
3421
+ "lstrip": false,
3422
+ "normalized": false,
3423
+ "rstrip": false,
3424
+ "single_word": false
3425
+ },
3426
+ {
3427
+ "content": "614583493135",
3428
+ "lstrip": false,
3429
+ "normalized": false,
3430
+ "rstrip": false,
3431
+ "single_word": false
3432
+ },
3433
+ {
3434
+ "content": "933775286797",
3435
+ "lstrip": false,
3436
+ "normalized": false,
3437
+ "rstrip": false,
3438
+ "single_word": false
3439
+ },
3440
+ {
3441
+ "content": "332234613346",
3442
+ "lstrip": false,
3443
+ "normalized": false,
3444
+ "rstrip": false,
3445
+ "single_word": false
3446
+ },
3447
+ {
3448
+ "content": "325196781219",
3449
+ "lstrip": false,
3450
+ "normalized": false,
3451
+ "rstrip": false,
3452
+ "single_word": false
3453
+ },
3454
+ {
3455
+ "content": "142526557681",
3456
+ "lstrip": false,
3457
+ "normalized": false,
3458
+ "rstrip": false,
3459
+ "single_word": false
3460
+ },
3461
+ {
3462
+ "content": "356722692178",
3463
+ "lstrip": false,
3464
+ "normalized": false,
3465
+ "rstrip": false,
3466
+ "single_word": false
3467
+ },
3468
+ {
3469
+ "content": "449318681694",
3470
+ "lstrip": false,
3471
+ "normalized": false,
3472
+ "rstrip": false,
3473
+ "single_word": false
3474
+ },
3475
+ {
3476
+ "content": "687284547244",
3477
+ "lstrip": false,
3478
+ "normalized": false,
3479
+ "rstrip": false,
3480
+ "single_word": false
3481
+ },
3482
+ {
3483
+ "content": "947262995132",
3484
+ "lstrip": false,
3485
+ "normalized": false,
3486
+ "rstrip": false,
3487
+ "single_word": false
3488
+ },
3489
+ {
3490
+ "content": "893974619684",
3491
+ "lstrip": false,
3492
+ "normalized": false,
3493
+ "rstrip": false,
3494
+ "single_word": false
3495
+ },
3496
+ {
3497
+ "content": "797238311233",
3498
+ "lstrip": false,
3499
+ "normalized": false,
3500
+ "rstrip": false,
3501
+ "single_word": false
3502
+ }
3503
+ ],
3504
+ "bos_token": {
3505
+ "content": "<|end_of_text|>",
3506
+ "lstrip": false,
3507
+ "normalized": false,
3508
+ "rstrip": false,
3509
+ "single_word": false
3510
+ },
3511
+ "eos_token": {
3512
+ "content": "<|end_of_text|>",
3513
+ "lstrip": false,
3514
+ "normalized": false,
3515
+ "rstrip": false,
3516
+ "single_word": false
3517
+ },
3518
+ "pad_token": {
3519
+ "content": "<|pad|>",
3520
+ "lstrip": false,
3521
+ "normalized": false,
3522
+ "rstrip": false,
3523
+ "single_word": false
3524
+ },
3525
+ "unk_token": {
3526
+ "content": "<|unk|>",
3527
+ "lstrip": false,
3528
+ "normalized": false,
3529
+ "rstrip": false,
3530
+ "single_word": false
3531
+ }
3532
+ }
granite-4.0-h-tiny/dp8/tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/tokenizer/tokenizer_config.json ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/tokenizer/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
granite-4.0-h-tiny/dp8/train.log ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2026-03-18 17:46:27,856 [INFO] new_opacus_codex.train_steps: epoch=1 step=10 loss=1.7025
2
+ 2026-03-18 17:48:57,509 [INFO] new_opacus_codex.train_steps: epoch=1 step=20 loss=1.7367
3
+ 2026-03-18 17:51:24,630 [INFO] new_opacus_codex.train_steps: epoch=1 step=30 loss=1.6388
4
+ 2026-03-18 17:53:53,934 [INFO] new_opacus_codex.train_steps: epoch=1 step=40 loss=1.8660
5
+ 2026-03-18 17:56:21,665 [INFO] new_opacus_codex.train_steps: epoch=1 step=50 loss=1.7009
6
+ 2026-03-18 17:56:41,996 [INFO] new_opacus_codex.train_steps: eval event=eval_step epoch=1 step=50 eval_loss=1.0429 duration_sec=20.31
7
+ 2026-03-18 17:59:15,864 [INFO] new_opacus_codex.train_steps: epoch=1 step=60 loss=1.8303
8
+ 2026-03-18 18:01:38,641 [INFO] new_opacus_codex.train_steps: epoch=1 step=70 loss=1.7401
9
+ 2026-03-18 18:04:06,325 [INFO] new_opacus_codex.train_steps: epoch=1 step=80 loss=1.6352
10
+ 2026-03-18 18:06:33,752 [INFO] new_opacus_codex.train_steps: epoch=1 step=90 loss=1.7086
11
+ 2026-03-18 18:09:27,268 [INFO] new_opacus_codex.train_steps: epoch=2 step=100 loss=1.8389
12
+ 2026-03-18 18:09:47,107 [INFO] new_opacus_codex.train_steps: eval event=eval_step epoch=2 step=100 eval_loss=1.0396 duration_sec=19.83
13
+ 2026-03-18 18:12:15,765 [INFO] new_opacus_codex.train_steps: epoch=2 step=110 loss=1.6207
14
+ 2026-03-18 18:14:42,958 [INFO] new_opacus_codex.train_steps: epoch=2 step=120 loss=1.7350
15
+ 2026-03-18 18:17:08,626 [INFO] new_opacus_codex.train_steps: epoch=2 step=130 loss=1.6695
16
+ 2026-03-18 18:19:34,150 [INFO] new_opacus_codex.train_steps: epoch=2 step=140 loss=1.6365
17
+ 2026-03-18 18:22:00,265 [INFO] new_opacus_codex.train_steps: epoch=2 step=150 loss=1.7209
18
+ 2026-03-18 18:22:18,401 [INFO] new_opacus_codex.train_steps: eval event=eval_step epoch=2 step=150 eval_loss=1.0383 duration_sec=18.11
19
+ 2026-03-18 18:24:51,149 [INFO] new_opacus_codex.train_steps: epoch=2 step=160 loss=1.8450
20
+ 2026-03-18 18:27:17,368 [INFO] new_opacus_codex.train_steps: epoch=2 step=170 loss=1.7316
21
+ 2026-03-18 18:29:42,579 [INFO] new_opacus_codex.train_steps: epoch=2 step=180 loss=1.6399