Hugging Face's logo

Spaces:
MartinHummel
/
Udemy-Generative-AI-with-LLMs
No application file

App Files Community
MartinHummel commited on
Commit
80e1a2e
·
1 Parent(s): 7e8f2a1

examples

Browse files
Files changed (2) hide show
  1. Accessing_Pre_Trained_Models.ipynb +2462 -0
  2. How_To_Use_Transformers.ipynb +0 -0
Accessing_Pre_Trained_Models.ipynb ADDED
@@ -0,0 +1,2462 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "nbformat": 4,
3
+ "nbformat_minor": 0,
4
+ "metadata": {
5
+ "colab": {
6
+ "provenance": [],
7
+ "gpuType": "T4"
8
+ },
9
+ "kernelspec": {
10
+ "name": "python3",
11
+ "display_name": "Python 3"
12
+ },
13
+ "language_info": {
14
+ "name": "python"
15
+ },
16
+ "widgets": {
17
+ "application/vnd.jupyter.widget-state+json": {
18
+ "e6801b9d36904ac6b648423f46d95709": {
19
+ "model_module": "@jupyter-widgets/controls",
20
+ "model_name": "HBoxModel",
21
+ "model_module_version": "1.5.0",
22
+ "state": {
23
+ "_dom_classes": [],
24
+ "_model_module": "@jupyter-widgets/controls",
25
+ "_model_module_version": "1.5.0",
26
+ "_model_name": "HBoxModel",
27
+ "_view_count": null,
28
+ "_view_module": "@jupyter-widgets/controls",
29
+ "_view_module_version": "1.5.0",
30
+ "_view_name": "HBoxView",
31
+ "box_style": "",
32
+ "children": [
33
+ "IPY_MODEL_c4ec646582c947f68fdcee06e450e156",
34
+ "IPY_MODEL_0241857b008c41dc8cdc103887020635",
35
+ "IPY_MODEL_871b1e8da915424fa13752d766d04100"
36
+ ],
37
+ "layout": "IPY_MODEL_713cd7fa524c40d2b3d41a5c65055c08"
38
+ }
39
+ },
40
+ "c4ec646582c947f68fdcee06e450e156": {
41
+ "model_module": "@jupyter-widgets/controls",
42
+ "model_name": "HTMLModel",
43
+ "model_module_version": "1.5.0",
44
+ "state": {
45
+ "_dom_classes": [],
46
+ "_model_module": "@jupyter-widgets/controls",
47
+ "_model_module_version": "1.5.0",
48
+ "_model_name": "HTMLModel",
49
+ "_view_count": null,
50
+ "_view_module": "@jupyter-widgets/controls",
51
+ "_view_module_version": "1.5.0",
52
+ "_view_name": "HTMLView",
53
+ "description": "",
54
+ "description_tooltip": null,
55
+ "layout": "IPY_MODEL_5d336f1585b84fe38fc75907a49df55f",
56
+ "placeholder": "​",
57
+ "style": "IPY_MODEL_abdcbc3895944ee7a5d9fbda9bf2936c",
58
+ "value": "Downloading (…)lve/main/config.json: 100%"
59
+ }
60
+ },
61
+ "0241857b008c41dc8cdc103887020635": {
62
+ "model_module": "@jupyter-widgets/controls",
63
+ "model_name": "FloatProgressModel",
64
+ "model_module_version": "1.5.0",
65
+ "state": {
66
+ "_dom_classes": [],
67
+ "_model_module": "@jupyter-widgets/controls",
68
+ "_model_module_version": "1.5.0",
69
+ "_model_name": "FloatProgressModel",
70
+ "_view_count": null,
71
+ "_view_module": "@jupyter-widgets/controls",
72
+ "_view_module_version": "1.5.0",
73
+ "_view_name": "ProgressView",
74
+ "bar_style": "success",
75
+ "description": "",
76
+ "description_tooltip": null,
77
+ "layout": "IPY_MODEL_8536535613744a889ce6236d896b9bf1",
78
+ "max": 665,
79
+ "min": 0,
80
+ "orientation": "horizontal",
81
+ "style": "IPY_MODEL_932c4a6e0ea444308247e1509ef2ca71",
82
+ "value": 665
83
+ }
84
+ },
85
+ "871b1e8da915424fa13752d766d04100": {
86
+ "model_module": "@jupyter-widgets/controls",
87
+ "model_name": "HTMLModel",
88
+ "model_module_version": "1.5.0",
89
+ "state": {
90
+ "_dom_classes": [],
91
+ "_model_module": "@jupyter-widgets/controls",
92
+ "_model_module_version": "1.5.0",
93
+ "_model_name": "HTMLModel",
94
+ "_view_count": null,
95
+ "_view_module": "@jupyter-widgets/controls",
96
+ "_view_module_version": "1.5.0",
97
+ "_view_name": "HTMLView",
98
+ "description": "",
99
+ "description_tooltip": null,
100
+ "layout": "IPY_MODEL_2ff5223453f54d0faa3ebd91f6429005",
101
+ "placeholder": "​",
102
+ "style": "IPY_MODEL_14b2d8f86632413f9a31add6fe7d8f6e",
103
+ "value": " 665/665 [00:00<00:00, 35.9kB/s]"
104
+ }
105
+ },
106
+ "713cd7fa524c40d2b3d41a5c65055c08": {
107
+ "model_module": "@jupyter-widgets/base",
108
+ "model_name": "LayoutModel",
109
+ "model_module_version": "1.2.0",
110
+ "state": {
111
+ "_model_module": "@jupyter-widgets/base",
112
+ "_model_module_version": "1.2.0",
113
+ "_model_name": "LayoutModel",
114
+ "_view_count": null,
115
+ "_view_module": "@jupyter-widgets/base",
116
+ "_view_module_version": "1.2.0",
117
+ "_view_name": "LayoutView",
118
+ "align_content": null,
119
+ "align_items": null,
120
+ "align_self": null,
121
+ "border": null,
122
+ "bottom": null,
123
+ "display": null,
124
+ "flex": null,
125
+ "flex_flow": null,
126
+ "grid_area": null,
127
+ "grid_auto_columns": null,
128
+ "grid_auto_flow": null,
129
+ "grid_auto_rows": null,
130
+ "grid_column": null,
131
+ "grid_gap": null,
132
+ "grid_row": null,
133
+ "grid_template_areas": null,
134
+ "grid_template_columns": null,
135
+ "grid_template_rows": null,
136
+ "height": null,
137
+ "justify_content": null,
138
+ "justify_items": null,
139
+ "left": null,
140
+ "margin": null,
141
+ "max_height": null,
142
+ "max_width": null,
143
+ "min_height": null,
144
+ "min_width": null,
145
+ "object_fit": null,
146
+ "object_position": null,
147
+ "order": null,
148
+ "overflow": null,
149
+ "overflow_x": null,
150
+ "overflow_y": null,
151
+ "padding": null,
152
+ "right": null,
153
+ "top": null,
154
+ "visibility": null,
155
+ "width": null
156
+ }
157
+ },
158
+ "5d336f1585b84fe38fc75907a49df55f": {
159
+ "model_module": "@jupyter-widgets/base",
160
+ "model_name": "LayoutModel",
161
+ "model_module_version": "1.2.0",
162
+ "state": {
163
+ "_model_module": "@jupyter-widgets/base",
164
+ "_model_module_version": "1.2.0",
165
+ "_model_name": "LayoutModel",
166
+ "_view_count": null,
167
+ "_view_module": "@jupyter-widgets/base",
168
+ "_view_module_version": "1.2.0",
169
+ "_view_name": "LayoutView",
170
+ "align_content": null,
171
+ "align_items": null,
172
+ "align_self": null,
173
+ "border": null,
174
+ "bottom": null,
175
+ "display": null,
176
+ "flex": null,
177
+ "flex_flow": null,
178
+ "grid_area": null,
179
+ "grid_auto_columns": null,
180
+ "grid_auto_flow": null,
181
+ "grid_auto_rows": null,
182
+ "grid_column": null,
183
+ "grid_gap": null,
184
+ "grid_row": null,
185
+ "grid_template_areas": null,
186
+ "grid_template_columns": null,
187
+ "grid_template_rows": null,
188
+ "height": null,
189
+ "justify_content": null,
190
+ "justify_items": null,
191
+ "left": null,
192
+ "margin": null,
193
+ "max_height": null,
194
+ "max_width": null,
195
+ "min_height": null,
196
+ "min_width": null,
197
+ "object_fit": null,
198
+ "object_position": null,
199
+ "order": null,
200
+ "overflow": null,
201
+ "overflow_x": null,
202
+ "overflow_y": null,
203
+ "padding": null,
204
+ "right": null,
205
+ "top": null,
206
+ "visibility": null,
207
+ "width": null
208
+ }
209
+ },
210
+ "abdcbc3895944ee7a5d9fbda9bf2936c": {
211
+ "model_module": "@jupyter-widgets/controls",
212
+ "model_name": "DescriptionStyleModel",
213
+ "model_module_version": "1.5.0",
214
+ "state": {
215
+ "_model_module": "@jupyter-widgets/controls",
216
+ "_model_module_version": "1.5.0",
217
+ "_model_name": "DescriptionStyleModel",
218
+ "_view_count": null,
219
+ "_view_module": "@jupyter-widgets/base",
220
+ "_view_module_version": "1.2.0",
221
+ "_view_name": "StyleView",
222
+ "description_width": ""
223
+ }
224
+ },
225
+ "8536535613744a889ce6236d896b9bf1": {
226
+ "model_module": "@jupyter-widgets/base",
227
+ "model_name": "LayoutModel",
228
+ "model_module_version": "1.2.0",
229
+ "state": {
230
+ "_model_module": "@jupyter-widgets/base",
231
+ "_model_module_version": "1.2.0",
232
+ "_model_name": "LayoutModel",
233
+ "_view_count": null,
234
+ "_view_module": "@jupyter-widgets/base",
235
+ "_view_module_version": "1.2.0",
236
+ "_view_name": "LayoutView",
237
+ "align_content": null,
238
+ "align_items": null,
239
+ "align_self": null,
240
+ "border": null,
241
+ "bottom": null,
242
+ "display": null,
243
+ "flex": null,
244
+ "flex_flow": null,
245
+ "grid_area": null,
246
+ "grid_auto_columns": null,
247
+ "grid_auto_flow": null,
248
+ "grid_auto_rows": null,
249
+ "grid_column": null,
250
+ "grid_gap": null,
251
+ "grid_row": null,
252
+ "grid_template_areas": null,
253
+ "grid_template_columns": null,
254
+ "grid_template_rows": null,
255
+ "height": null,
256
+ "justify_content": null,
257
+ "justify_items": null,
258
+ "left": null,
259
+ "margin": null,
260
+ "max_height": null,
261
+ "max_width": null,
262
+ "min_height": null,
263
+ "min_width": null,
264
+ "object_fit": null,
265
+ "object_position": null,
266
+ "order": null,
267
+ "overflow": null,
268
+ "overflow_x": null,
269
+ "overflow_y": null,
270
+ "padding": null,
271
+ "right": null,
272
+ "top": null,
273
+ "visibility": null,
274
+ "width": null
275
+ }
276
+ },
277
+ "932c4a6e0ea444308247e1509ef2ca71": {
278
+ "model_module": "@jupyter-widgets/controls",
279
+ "model_name": "ProgressStyleModel",
280
+ "model_module_version": "1.5.0",
281
+ "state": {
282
+ "_model_module": "@jupyter-widgets/controls",
283
+ "_model_module_version": "1.5.0",
284
+ "_model_name": "ProgressStyleModel",
285
+ "_view_count": null,
286
+ "_view_module": "@jupyter-widgets/base",
287
+ "_view_module_version": "1.2.0",
288
+ "_view_name": "StyleView",
289
+ "bar_color": null,
290
+ "description_width": ""
291
+ }
292
+ },
293
+ "2ff5223453f54d0faa3ebd91f6429005": {
294
+ "model_module": "@jupyter-widgets/base",
295
+ "model_name": "LayoutModel",
296
+ "model_module_version": "1.2.0",
297
+ "state": {
298
+ "_model_module": "@jupyter-widgets/base",
299
+ "_model_module_version": "1.2.0",
300
+ "_model_name": "LayoutModel",
301
+ "_view_count": null,
302
+ "_view_module": "@jupyter-widgets/base",
303
+ "_view_module_version": "1.2.0",
304
+ "_view_name": "LayoutView",
305
+ "align_content": null,
306
+ "align_items": null,
307
+ "align_self": null,
308
+ "border": null,
309
+ "bottom": null,
310
+ "display": null,
311
+ "flex": null,
312
+ "flex_flow": null,
313
+ "grid_area": null,
314
+ "grid_auto_columns": null,
315
+ "grid_auto_flow": null,
316
+ "grid_auto_rows": null,
317
+ "grid_column": null,
318
+ "grid_gap": null,
319
+ "grid_row": null,
320
+ "grid_template_areas": null,
321
+ "grid_template_columns": null,
322
+ "grid_template_rows": null,
323
+ "height": null,
324
+ "justify_content": null,
325
+ "justify_items": null,
326
+ "left": null,
327
+ "margin": null,
328
+ "max_height": null,
329
+ "max_width": null,
330
+ "min_height": null,
331
+ "min_width": null,
332
+ "object_fit": null,
333
+ "object_position": null,
334
+ "order": null,
335
+ "overflow": null,
336
+ "overflow_x": null,
337
+ "overflow_y": null,
338
+ "padding": null,
339
+ "right": null,
340
+ "top": null,
341
+ "visibility": null,
342
+ "width": null
343
+ }
344
+ },
345
+ "14b2d8f86632413f9a31add6fe7d8f6e": {
346
+ "model_module": "@jupyter-widgets/controls",
347
+ "model_name": "DescriptionStyleModel",
348
+ "model_module_version": "1.5.0",
349
+ "state": {
350
+ "_model_module": "@jupyter-widgets/controls",
351
+ "_model_module_version": "1.5.0",
352
+ "_model_name": "DescriptionStyleModel",
353
+ "_view_count": null,
354
+ "_view_module": "@jupyter-widgets/base",
355
+ "_view_module_version": "1.2.0",
356
+ "_view_name": "StyleView",
357
+ "description_width": ""
358
+ }
359
+ },
360
+ "022eb2ccabcc43468ce3fdf3fca35b6c": {
361
+ "model_module": "@jupyter-widgets/controls",
362
+ "model_name": "HBoxModel",
363
+ "model_module_version": "1.5.0",
364
+ "state": {
365
+ "_dom_classes": [],
366
+ "_model_module": "@jupyter-widgets/controls",
367
+ "_model_module_version": "1.5.0",
368
+ "_model_name": "HBoxModel",
369
+ "_view_count": null,
370
+ "_view_module": "@jupyter-widgets/controls",
371
+ "_view_module_version": "1.5.0",
372
+ "_view_name": "HBoxView",
373
+ "box_style": "",
374
+ "children": [
375
+ "IPY_MODEL_f107439c62984501951f360f740af61b",
376
+ "IPY_MODEL_a0eff8bee17747db932034defac49a05",
377
+ "IPY_MODEL_51a30585335d44ecbf0f7d27905915b2"
378
+ ],
379
+ "layout": "IPY_MODEL_48de897e4783451b89183e8f9c414761"
380
+ }
381
+ },
382
+ "f107439c62984501951f360f740af61b": {
383
+ "model_module": "@jupyter-widgets/controls",
384
+ "model_name": "HTMLModel",
385
+ "model_module_version": "1.5.0",
386
+ "state": {
387
+ "_dom_classes": [],
388
+ "_model_module": "@jupyter-widgets/controls",
389
+ "_model_module_version": "1.5.0",
390
+ "_model_name": "HTMLModel",
391
+ "_view_count": null,
392
+ "_view_module": "@jupyter-widgets/controls",
393
+ "_view_module_version": "1.5.0",
394
+ "_view_name": "HTMLView",
395
+ "description": "",
396
+ "description_tooltip": null,
397
+ "layout": "IPY_MODEL_b70d9069401a449bbad18fd9cafc814e",
398
+ "placeholder": "​",
399
+ "style": "IPY_MODEL_2b842ffef24c41219ceb63cfd92fac00",
400
+ "value": "Downloading (…)olve/main/vocab.json: 100%"
401
+ }
402
+ },
403
+ "a0eff8bee17747db932034defac49a05": {
404
+ "model_module": "@jupyter-widgets/controls",
405
+ "model_name": "FloatProgressModel",
406
+ "model_module_version": "1.5.0",
407
+ "state": {
408
+ "_dom_classes": [],
409
+ "_model_module": "@jupyter-widgets/controls",
410
+ "_model_module_version": "1.5.0",
411
+ "_model_name": "FloatProgressModel",
412
+ "_view_count": null,
413
+ "_view_module": "@jupyter-widgets/controls",
414
+ "_view_module_version": "1.5.0",
415
+ "_view_name": "ProgressView",
416
+ "bar_style": "success",
417
+ "description": "",
418
+ "description_tooltip": null,
419
+ "layout": "IPY_MODEL_32169bbbbe154b6dac5ad0fc863871ff",
420
+ "max": 1042301,
421
+ "min": 0,
422
+ "orientation": "horizontal",
423
+ "style": "IPY_MODEL_f3ede63320be4b26a3251b1a3ff4c6d7",
424
+ "value": 1042301
425
+ }
426
+ },
427
+ "51a30585335d44ecbf0f7d27905915b2": {
428
+ "model_module": "@jupyter-widgets/controls",
429
+ "model_name": "HTMLModel",
430
+ "model_module_version": "1.5.0",
431
+ "state": {
432
+ "_dom_classes": [],
433
+ "_model_module": "@jupyter-widgets/controls",
434
+ "_model_module_version": "1.5.0",
435
+ "_model_name": "HTMLModel",
436
+ "_view_count": null,
437
+ "_view_module": "@jupyter-widgets/controls",
438
+ "_view_module_version": "1.5.0",
439
+ "_view_name": "HTMLView",
440
+ "description": "",
441
+ "description_tooltip": null,
442
+ "layout": "IPY_MODEL_56e9148ced5b4f1d87442edea24c3c3c",
443
+ "placeholder": "​",
444
+ "style": "IPY_MODEL_d39c918ac66744f0aeb158cae6c165e3",
445
+ "value": " 1.04M/1.04M [00:00<00:00, 5.25MB/s]"
446
+ }
447
+ },
448
+ "48de897e4783451b89183e8f9c414761": {
449
+ "model_module": "@jupyter-widgets/base",
450
+ "model_name": "LayoutModel",
451
+ "model_module_version": "1.2.0",
452
+ "state": {
453
+ "_model_module": "@jupyter-widgets/base",
454
+ "_model_module_version": "1.2.0",
455
+ "_model_name": "LayoutModel",
456
+ "_view_count": null,
457
+ "_view_module": "@jupyter-widgets/base",
458
+ "_view_module_version": "1.2.0",
459
+ "_view_name": "LayoutView",
460
+ "align_content": null,
461
+ "align_items": null,
462
+ "align_self": null,
463
+ "border": null,
464
+ "bottom": null,
465
+ "display": null,
466
+ "flex": null,
467
+ "flex_flow": null,
468
+ "grid_area": null,
469
+ "grid_auto_columns": null,
470
+ "grid_auto_flow": null,
471
+ "grid_auto_rows": null,
472
+ "grid_column": null,
473
+ "grid_gap": null,
474
+ "grid_row": null,
475
+ "grid_template_areas": null,
476
+ "grid_template_columns": null,
477
+ "grid_template_rows": null,
478
+ "height": null,
479
+ "justify_content": null,
480
+ "justify_items": null,
481
+ "left": null,
482
+ "margin": null,
483
+ "max_height": null,
484
+ "max_width": null,
485
+ "min_height": null,
486
+ "min_width": null,
487
+ "object_fit": null,
488
+ "object_position": null,
489
+ "order": null,
490
+ "overflow": null,
491
+ "overflow_x": null,
492
+ "overflow_y": null,
493
+ "padding": null,
494
+ "right": null,
495
+ "top": null,
496
+ "visibility": null,
497
+ "width": null
498
+ }
499
+ },
500
+ "b70d9069401a449bbad18fd9cafc814e": {
501
+ "model_module": "@jupyter-widgets/base",
502
+ "model_name": "LayoutModel",
503
+ "model_module_version": "1.2.0",
504
+ "state": {
505
+ "_model_module": "@jupyter-widgets/base",
506
+ "_model_module_version": "1.2.0",
507
+ "_model_name": "LayoutModel",
508
+ "_view_count": null,
509
+ "_view_module": "@jupyter-widgets/base",
510
+ "_view_module_version": "1.2.0",
511
+ "_view_name": "LayoutView",
512
+ "align_content": null,
513
+ "align_items": null,
514
+ "align_self": null,
515
+ "border": null,
516
+ "bottom": null,
517
+ "display": null,
518
+ "flex": null,
519
+ "flex_flow": null,
520
+ "grid_area": null,
521
+ "grid_auto_columns": null,
522
+ "grid_auto_flow": null,
523
+ "grid_auto_rows": null,
524
+ "grid_column": null,
525
+ "grid_gap": null,
526
+ "grid_row": null,
527
+ "grid_template_areas": null,
528
+ "grid_template_columns": null,
529
+ "grid_template_rows": null,
530
+ "height": null,
531
+ "justify_content": null,
532
+ "justify_items": null,
533
+ "left": null,
534
+ "margin": null,
535
+ "max_height": null,
536
+ "max_width": null,
537
+ "min_height": null,
538
+ "min_width": null,
539
+ "object_fit": null,
540
+ "object_position": null,
541
+ "order": null,
542
+ "overflow": null,
543
+ "overflow_x": null,
544
+ "overflow_y": null,
545
+ "padding": null,
546
+ "right": null,
547
+ "top": null,
548
+ "visibility": null,
549
+ "width": null
550
+ }
551
+ },
552
+ "2b842ffef24c41219ceb63cfd92fac00": {
553
+ "model_module": "@jupyter-widgets/controls",
554
+ "model_name": "DescriptionStyleModel",
555
+ "model_module_version": "1.5.0",
556
+ "state": {
557
+ "_model_module": "@jupyter-widgets/controls",
558
+ "_model_module_version": "1.5.0",
559
+ "_model_name": "DescriptionStyleModel",
560
+ "_view_count": null,
561
+ "_view_module": "@jupyter-widgets/base",
562
+ "_view_module_version": "1.2.0",
563
+ "_view_name": "StyleView",
564
+ "description_width": ""
565
+ }
566
+ },
567
+ "32169bbbbe154b6dac5ad0fc863871ff": {
568
+ "model_module": "@jupyter-widgets/base",
569
+ "model_name": "LayoutModel",
570
+ "model_module_version": "1.2.0",
571
+ "state": {
572
+ "_model_module": "@jupyter-widgets/base",
573
+ "_model_module_version": "1.2.0",
574
+ "_model_name": "LayoutModel",
575
+ "_view_count": null,
576
+ "_view_module": "@jupyter-widgets/base",
577
+ "_view_module_version": "1.2.0",
578
+ "_view_name": "LayoutView",
579
+ "align_content": null,
580
+ "align_items": null,
581
+ "align_self": null,
582
+ "border": null,
583
+ "bottom": null,
584
+ "display": null,
585
+ "flex": null,
586
+ "flex_flow": null,
587
+ "grid_area": null,
588
+ "grid_auto_columns": null,
589
+ "grid_auto_flow": null,
590
+ "grid_auto_rows": null,
591
+ "grid_column": null,
592
+ "grid_gap": null,
593
+ "grid_row": null,
594
+ "grid_template_areas": null,
595
+ "grid_template_columns": null,
596
+ "grid_template_rows": null,
597
+ "height": null,
598
+ "justify_content": null,
599
+ "justify_items": null,
600
+ "left": null,
601
+ "margin": null,
602
+ "max_height": null,
603
+ "max_width": null,
604
+ "min_height": null,
605
+ "min_width": null,
606
+ "object_fit": null,
607
+ "object_position": null,
608
+ "order": null,
609
+ "overflow": null,
610
+ "overflow_x": null,
611
+ "overflow_y": null,
612
+ "padding": null,
613
+ "right": null,
614
+ "top": null,
615
+ "visibility": null,
616
+ "width": null
617
+ }
618
+ },
619
+ "f3ede63320be4b26a3251b1a3ff4c6d7": {
620
+ "model_module": "@jupyter-widgets/controls",
621
+ "model_name": "ProgressStyleModel",
622
+ "model_module_version": "1.5.0",
623
+ "state": {
624
+ "_model_module": "@jupyter-widgets/controls",
625
+ "_model_module_version": "1.5.0",
626
+ "_model_name": "ProgressStyleModel",
627
+ "_view_count": null,
628
+ "_view_module": "@jupyter-widgets/base",
629
+ "_view_module_version": "1.2.0",
630
+ "_view_name": "StyleView",
631
+ "bar_color": null,
632
+ "description_width": ""
633
+ }
634
+ },
635
+ "56e9148ced5b4f1d87442edea24c3c3c": {
636
+ "model_module": "@jupyter-widgets/base",
637
+ "model_name": "LayoutModel",
638
+ "model_module_version": "1.2.0",
639
+ "state": {
640
+ "_model_module": "@jupyter-widgets/base",
641
+ "_model_module_version": "1.2.0",
642
+ "_model_name": "LayoutModel",
643
+ "_view_count": null,
644
+ "_view_module": "@jupyter-widgets/base",
645
+ "_view_module_version": "1.2.0",
646
+ "_view_name": "LayoutView",
647
+ "align_content": null,
648
+ "align_items": null,
649
+ "align_self": null,
650
+ "border": null,
651
+ "bottom": null,
652
+ "display": null,
653
+ "flex": null,
654
+ "flex_flow": null,
655
+ "grid_area": null,
656
+ "grid_auto_columns": null,
657
+ "grid_auto_flow": null,
658
+ "grid_auto_rows": null,
659
+ "grid_column": null,
660
+ "grid_gap": null,
661
+ "grid_row": null,
662
+ "grid_template_areas": null,
663
+ "grid_template_columns": null,
664
+ "grid_template_rows": null,
665
+ "height": null,
666
+ "justify_content": null,
667
+ "justify_items": null,
668
+ "left": null,
669
+ "margin": null,
670
+ "max_height": null,
671
+ "max_width": null,
672
+ "min_height": null,
673
+ "min_width": null,
674
+ "object_fit": null,
675
+ "object_position": null,
676
+ "order": null,
677
+ "overflow": null,
678
+ "overflow_x": null,
679
+ "overflow_y": null,
680
+ "padding": null,
681
+ "right": null,
682
+ "top": null,
683
+ "visibility": null,
684
+ "width": null
685
+ }
686
+ },
687
+ "d39c918ac66744f0aeb158cae6c165e3": {
688
+ "model_module": "@jupyter-widgets/controls",
689
+ "model_name": "DescriptionStyleModel",
690
+ "model_module_version": "1.5.0",
691
+ "state": {
692
+ "_model_module": "@jupyter-widgets/controls",
693
+ "_model_module_version": "1.5.0",
694
+ "_model_name": "DescriptionStyleModel",
695
+ "_view_count": null,
696
+ "_view_module": "@jupyter-widgets/base",
697
+ "_view_module_version": "1.2.0",
698
+ "_view_name": "StyleView",
699
+ "description_width": ""
700
+ }
701
+ },
702
+ "2c79133c83314171a837de2fd222e48f": {
703
+ "model_module": "@jupyter-widgets/controls",
704
+ "model_name": "HBoxModel",
705
+ "model_module_version": "1.5.0",
706
+ "state": {
707
+ "_dom_classes": [],
708
+ "_model_module": "@jupyter-widgets/controls",
709
+ "_model_module_version": "1.5.0",
710
+ "_model_name": "HBoxModel",
711
+ "_view_count": null,
712
+ "_view_module": "@jupyter-widgets/controls",
713
+ "_view_module_version": "1.5.0",
714
+ "_view_name": "HBoxView",
715
+ "box_style": "",
716
+ "children": [
717
+ "IPY_MODEL_54323992c04a4db9a7f68027c14ca3ab",
718
+ "IPY_MODEL_a6726218400d45189e7876b62a3e26ce",
719
+ "IPY_MODEL_2713c8e0f7c142bd9a8105f2ae76c8c5"
720
+ ],
721
+ "layout": "IPY_MODEL_cf423d5fd0a34aafbc01511a08e45478"
722
+ }
723
+ },
724
+ "54323992c04a4db9a7f68027c14ca3ab": {
725
+ "model_module": "@jupyter-widgets/controls",
726
+ "model_name": "HTMLModel",
727
+ "model_module_version": "1.5.0",
728
+ "state": {
729
+ "_dom_classes": [],
730
+ "_model_module": "@jupyter-widgets/controls",
731
+ "_model_module_version": "1.5.0",
732
+ "_model_name": "HTMLModel",
733
+ "_view_count": null,
734
+ "_view_module": "@jupyter-widgets/controls",
735
+ "_view_module_version": "1.5.0",
736
+ "_view_name": "HTMLView",
737
+ "description": "",
738
+ "description_tooltip": null,
739
+ "layout": "IPY_MODEL_4584a40d5e894d3ba3b1d5d0aa498f5c",
740
+ "placeholder": "​",
741
+ "style": "IPY_MODEL_9a009d1138794009be8f56005d76507d",
742
+ "value": "Downloading (…)olve/main/merges.txt: 100%"
743
+ }
744
+ },
745
+ "a6726218400d45189e7876b62a3e26ce": {
746
+ "model_module": "@jupyter-widgets/controls",
747
+ "model_name": "FloatProgressModel",
748
+ "model_module_version": "1.5.0",
749
+ "state": {
750
+ "_dom_classes": [],
751
+ "_model_module": "@jupyter-widgets/controls",
752
+ "_model_module_version": "1.5.0",
753
+ "_model_name": "FloatProgressModel",
754
+ "_view_count": null,
755
+ "_view_module": "@jupyter-widgets/controls",
756
+ "_view_module_version": "1.5.0",
757
+ "_view_name": "ProgressView",
758
+ "bar_style": "success",
759
+ "description": "",
760
+ "description_tooltip": null,
761
+ "layout": "IPY_MODEL_b0bb742eb65b4fbb9bbe2f1b45387383",
762
+ "max": 456318,
763
+ "min": 0,
764
+ "orientation": "horizontal",
765
+ "style": "IPY_MODEL_1a1f113e47524855a608b9bc55eac66d",
766
+ "value": 456318
767
+ }
768
+ },
769
+ "2713c8e0f7c142bd9a8105f2ae76c8c5": {
770
+ "model_module": "@jupyter-widgets/controls",
771
+ "model_name": "HTMLModel",
772
+ "model_module_version": "1.5.0",
773
+ "state": {
774
+ "_dom_classes": [],
775
+ "_model_module": "@jupyter-widgets/controls",
776
+ "_model_module_version": "1.5.0",
777
+ "_model_name": "HTMLModel",
778
+ "_view_count": null,
779
+ "_view_module": "@jupyter-widgets/controls",
780
+ "_view_module_version": "1.5.0",
781
+ "_view_name": "HTMLView",
782
+ "description": "",
783
+ "description_tooltip": null,
784
+ "layout": "IPY_MODEL_61a8f372679549f993bd6c76c1221d59",
785
+ "placeholder": "​",
786
+ "style": "IPY_MODEL_5262cbb56d1e4b05a249f66aa5c59d70",
787
+ "value": " 456k/456k [00:00<00:00, 3.52MB/s]"
788
+ }
789
+ },
790
+ "cf423d5fd0a34aafbc01511a08e45478": {
791
+ "model_module": "@jupyter-widgets/base",
792
+ "model_name": "LayoutModel",
793
+ "model_module_version": "1.2.0",
794
+ "state": {
795
+ "_model_module": "@jupyter-widgets/base",
796
+ "_model_module_version": "1.2.0",
797
+ "_model_name": "LayoutModel",
798
+ "_view_count": null,
799
+ "_view_module": "@jupyter-widgets/base",
800
+ "_view_module_version": "1.2.0",
801
+ "_view_name": "LayoutView",
802
+ "align_content": null,
803
+ "align_items": null,
804
+ "align_self": null,
805
+ "border": null,
806
+ "bottom": null,
807
+ "display": null,
808
+ "flex": null,
809
+ "flex_flow": null,
810
+ "grid_area": null,
811
+ "grid_auto_columns": null,
812
+ "grid_auto_flow": null,
813
+ "grid_auto_rows": null,
814
+ "grid_column": null,
815
+ "grid_gap": null,
816
+ "grid_row": null,
817
+ "grid_template_areas": null,
818
+ "grid_template_columns": null,
819
+ "grid_template_rows": null,
820
+ "height": null,
821
+ "justify_content": null,
822
+ "justify_items": null,
823
+ "left": null,
824
+ "margin": null,
825
+ "max_height": null,
826
+ "max_width": null,
827
+ "min_height": null,
828
+ "min_width": null,
829
+ "object_fit": null,
830
+ "object_position": null,
831
+ "order": null,
832
+ "overflow": null,
833
+ "overflow_x": null,
834
+ "overflow_y": null,
835
+ "padding": null,
836
+ "right": null,
837
+ "top": null,
838
+ "visibility": null,
839
+ "width": null
840
+ }
841
+ },
842
+ "4584a40d5e894d3ba3b1d5d0aa498f5c": {
843
+ "model_module": "@jupyter-widgets/base",
844
+ "model_name": "LayoutModel",
845
+ "model_module_version": "1.2.0",
846
+ "state": {
847
+ "_model_module": "@jupyter-widgets/base",
848
+ "_model_module_version": "1.2.0",
849
+ "_model_name": "LayoutModel",
850
+ "_view_count": null,
851
+ "_view_module": "@jupyter-widgets/base",
852
+ "_view_module_version": "1.2.0",
853
+ "_view_name": "LayoutView",
854
+ "align_content": null,
855
+ "align_items": null,
856
+ "align_self": null,
857
+ "border": null,
858
+ "bottom": null,
859
+ "display": null,
860
+ "flex": null,
861
+ "flex_flow": null,
862
+ "grid_area": null,
863
+ "grid_auto_columns": null,
864
+ "grid_auto_flow": null,
865
+ "grid_auto_rows": null,
866
+ "grid_column": null,
867
+ "grid_gap": null,
868
+ "grid_row": null,
869
+ "grid_template_areas": null,
870
+ "grid_template_columns": null,
871
+ "grid_template_rows": null,
872
+ "height": null,
873
+ "justify_content": null,
874
+ "justify_items": null,
875
+ "left": null,
876
+ "margin": null,
877
+ "max_height": null,
878
+ "max_width": null,
879
+ "min_height": null,
880
+ "min_width": null,
881
+ "object_fit": null,
882
+ "object_position": null,
883
+ "order": null,
884
+ "overflow": null,
885
+ "overflow_x": null,
886
+ "overflow_y": null,
887
+ "padding": null,
888
+ "right": null,
889
+ "top": null,
890
+ "visibility": null,
891
+ "width": null
892
+ }
893
+ },
894
+ "9a009d1138794009be8f56005d76507d": {
895
+ "model_module": "@jupyter-widgets/controls",
896
+ "model_name": "DescriptionStyleModel",
897
+ "model_module_version": "1.5.0",
898
+ "state": {
899
+ "_model_module": "@jupyter-widgets/controls",
900
+ "_model_module_version": "1.5.0",
901
+ "_model_name": "DescriptionStyleModel",
902
+ "_view_count": null,
903
+ "_view_module": "@jupyter-widgets/base",
904
+ "_view_module_version": "1.2.0",
905
+ "_view_name": "StyleView",
906
+ "description_width": ""
907
+ }
908
+ },
909
+ "b0bb742eb65b4fbb9bbe2f1b45387383": {
910
+ "model_module": "@jupyter-widgets/base",
911
+ "model_name": "LayoutModel",
912
+ "model_module_version": "1.2.0",
913
+ "state": {
914
+ "_model_module": "@jupyter-widgets/base",
915
+ "_model_module_version": "1.2.0",
916
+ "_model_name": "LayoutModel",
917
+ "_view_count": null,
918
+ "_view_module": "@jupyter-widgets/base",
919
+ "_view_module_version": "1.2.0",
920
+ "_view_name": "LayoutView",
921
+ "align_content": null,
922
+ "align_items": null,
923
+ "align_self": null,
924
+ "border": null,
925
+ "bottom": null,
926
+ "display": null,
927
+ "flex": null,
928
+ "flex_flow": null,
929
+ "grid_area": null,
930
+ "grid_auto_columns": null,
931
+ "grid_auto_flow": null,
932
+ "grid_auto_rows": null,
933
+ "grid_column": null,
934
+ "grid_gap": null,
935
+ "grid_row": null,
936
+ "grid_template_areas": null,
937
+ "grid_template_columns": null,
938
+ "grid_template_rows": null,
939
+ "height": null,
940
+ "justify_content": null,
941
+ "justify_items": null,
942
+ "left": null,
943
+ "margin": null,
944
+ "max_height": null,
945
+ "max_width": null,
946
+ "min_height": null,
947
+ "min_width": null,
948
+ "object_fit": null,
949
+ "object_position": null,
950
+ "order": null,
951
+ "overflow": null,
952
+ "overflow_x": null,
953
+ "overflow_y": null,
954
+ "padding": null,
955
+ "right": null,
956
+ "top": null,
957
+ "visibility": null,
958
+ "width": null
959
+ }
960
+ },
961
+ "1a1f113e47524855a608b9bc55eac66d": {
962
+ "model_module": "@jupyter-widgets/controls",
963
+ "model_name": "ProgressStyleModel",
964
+ "model_module_version": "1.5.0",
965
+ "state": {
966
+ "_model_module": "@jupyter-widgets/controls",
967
+ "_model_module_version": "1.5.0",
968
+ "_model_name": "ProgressStyleModel",
969
+ "_view_count": null,
970
+ "_view_module": "@jupyter-widgets/base",
971
+ "_view_module_version": "1.2.0",
972
+ "_view_name": "StyleView",
973
+ "bar_color": null,
974
+ "description_width": ""
975
+ }
976
+ },
977
+ "61a8f372679549f993bd6c76c1221d59": {
978
+ "model_module": "@jupyter-widgets/base",
979
+ "model_name": "LayoutModel",
980
+ "model_module_version": "1.2.0",
981
+ "state": {
982
+ "_model_module": "@jupyter-widgets/base",
983
+ "_model_module_version": "1.2.0",
984
+ "_model_name": "LayoutModel",
985
+ "_view_count": null,
986
+ "_view_module": "@jupyter-widgets/base",
987
+ "_view_module_version": "1.2.0",
988
+ "_view_name": "LayoutView",
989
+ "align_content": null,
990
+ "align_items": null,
991
+ "align_self": null,
992
+ "border": null,
993
+ "bottom": null,
994
+ "display": null,
995
+ "flex": null,
996
+ "flex_flow": null,
997
+ "grid_area": null,
998
+ "grid_auto_columns": null,
999
+ "grid_auto_flow": null,
1000
+ "grid_auto_rows": null,
1001
+ "grid_column": null,
1002
+ "grid_gap": null,
1003
+ "grid_row": null,
1004
+ "grid_template_areas": null,
1005
+ "grid_template_columns": null,
1006
+ "grid_template_rows": null,
1007
+ "height": null,
1008
+ "justify_content": null,
1009
+ "justify_items": null,
1010
+ "left": null,
1011
+ "margin": null,
1012
+ "max_height": null,
1013
+ "max_width": null,
1014
+ "min_height": null,
1015
+ "min_width": null,
1016
+ "object_fit": null,
1017
+ "object_position": null,
1018
+ "order": null,
1019
+ "overflow": null,
1020
+ "overflow_x": null,
1021
+ "overflow_y": null,
1022
+ "padding": null,
1023
+ "right": null,
1024
+ "top": null,
1025
+ "visibility": null,
1026
+ "width": null
1027
+ }
1028
+ },
1029
+ "5262cbb56d1e4b05a249f66aa5c59d70": {
1030
+ "model_module": "@jupyter-widgets/controls",
1031
+ "model_name": "DescriptionStyleModel",
1032
+ "model_module_version": "1.5.0",
1033
+ "state": {
1034
+ "_model_module": "@jupyter-widgets/controls",
1035
+ "_model_module_version": "1.5.0",
1036
+ "_model_name": "DescriptionStyleModel",
1037
+ "_view_count": null,
1038
+ "_view_module": "@jupyter-widgets/base",
1039
+ "_view_module_version": "1.2.0",
1040
+ "_view_name": "StyleView",
1041
+ "description_width": ""
1042
+ }
1043
+ },
1044
+ "c3b4e690b58e4fc3bb6d32ec113a9938": {
1045
+ "model_module": "@jupyter-widgets/controls",
1046
+ "model_name": "HBoxModel",
1047
+ "model_module_version": "1.5.0",
1048
+ "state": {
1049
+ "_dom_classes": [],
1050
+ "_model_module": "@jupyter-widgets/controls",
1051
+ "_model_module_version": "1.5.0",
1052
+ "_model_name": "HBoxModel",
1053
+ "_view_count": null,
1054
+ "_view_module": "@jupyter-widgets/controls",
1055
+ "_view_module_version": "1.5.0",
1056
+ "_view_name": "HBoxView",
1057
+ "box_style": "",
1058
+ "children": [
1059
+ "IPY_MODEL_75ec6b53aa224705b9de577d947545f1",
1060
+ "IPY_MODEL_cdcf3d005e1249508c1fbeed03923a31",
1061
+ "IPY_MODEL_6777cda95c7c4bb89e72bc4b4f2f2b11"
1062
+ ],
1063
+ "layout": "IPY_MODEL_19fa6b959f5a4b72928c7e2535499ac2"
1064
+ }
1065
+ },
1066
+ "75ec6b53aa224705b9de577d947545f1": {
1067
+ "model_module": "@jupyter-widgets/controls",
1068
+ "model_name": "HTMLModel",
1069
+ "model_module_version": "1.5.0",
1070
+ "state": {
1071
+ "_dom_classes": [],
1072
+ "_model_module": "@jupyter-widgets/controls",
1073
+ "_model_module_version": "1.5.0",
1074
+ "_model_name": "HTMLModel",
1075
+ "_view_count": null,
1076
+ "_view_module": "@jupyter-widgets/controls",
1077
+ "_view_module_version": "1.5.0",
1078
+ "_view_name": "HTMLView",
1079
+ "description": "",
1080
+ "description_tooltip": null,
1081
+ "layout": "IPY_MODEL_d451a7f45ab74005a01dc60b78b26495",
1082
+ "placeholder": "​",
1083
+ "style": "IPY_MODEL_6695c5802c5749328a530760bd226cda",
1084
+ "value": "Downloading (…)/main/tokenizer.json: 100%"
1085
+ }
1086
+ },
1087
+ "cdcf3d005e1249508c1fbeed03923a31": {
1088
+ "model_module": "@jupyter-widgets/controls",
1089
+ "model_name": "FloatProgressModel",
1090
+ "model_module_version": "1.5.0",
1091
+ "state": {
1092
+ "_dom_classes": [],
1093
+ "_model_module": "@jupyter-widgets/controls",
1094
+ "_model_module_version": "1.5.0",
1095
+ "_model_name": "FloatProgressModel",
1096
+ "_view_count": null,
1097
+ "_view_module": "@jupyter-widgets/controls",
1098
+ "_view_module_version": "1.5.0",
1099
+ "_view_name": "ProgressView",
1100
+ "bar_style": "success",
1101
+ "description": "",
1102
+ "description_tooltip": null,
1103
+ "layout": "IPY_MODEL_efb6e80fac4543f1a0067f06c0b85008",
1104
+ "max": 1355256,
1105
+ "min": 0,
1106
+ "orientation": "horizontal",
1107
+ "style": "IPY_MODEL_87824fee0180474ca3fc9a61348c11d4",
1108
+ "value": 1355256
1109
+ }
1110
+ },
1111
+ "6777cda95c7c4bb89e72bc4b4f2f2b11": {
1112
+ "model_module": "@jupyter-widgets/controls",
1113
+ "model_name": "HTMLModel",
1114
+ "model_module_version": "1.5.0",
1115
+ "state": {
1116
+ "_dom_classes": [],
1117
+ "_model_module": "@jupyter-widgets/controls",
1118
+ "_model_module_version": "1.5.0",
1119
+ "_model_name": "HTMLModel",
1120
+ "_view_count": null,
1121
+ "_view_module": "@jupyter-widgets/controls",
1122
+ "_view_module_version": "1.5.0",
1123
+ "_view_name": "HTMLView",
1124
+ "description": "",
1125
+ "description_tooltip": null,
1126
+ "layout": "IPY_MODEL_a7be0a30edaa4d46b1bc5386d1db37b8",
1127
+ "placeholder": "​",
1128
+ "style": "IPY_MODEL_d61ad8013d2e4199853f64131a3d3bab",
1129
+ "value": " 1.36M/1.36M [00:00<00:00, 6.92MB/s]"
1130
+ }
1131
+ },
1132
+ "19fa6b959f5a4b72928c7e2535499ac2": {
1133
+ "model_module": "@jupyter-widgets/base",
1134
+ "model_name": "LayoutModel",
1135
+ "model_module_version": "1.2.0",
1136
+ "state": {
1137
+ "_model_module": "@jupyter-widgets/base",
1138
+ "_model_module_version": "1.2.0",
1139
+ "_model_name": "LayoutModel",
1140
+ "_view_count": null,
1141
+ "_view_module": "@jupyter-widgets/base",
1142
+ "_view_module_version": "1.2.0",
1143
+ "_view_name": "LayoutView",
1144
+ "align_content": null,
1145
+ "align_items": null,
1146
+ "align_self": null,
1147
+ "border": null,
1148
+ "bottom": null,
1149
+ "display": null,
1150
+ "flex": null,
1151
+ "flex_flow": null,
1152
+ "grid_area": null,
1153
+ "grid_auto_columns": null,
1154
+ "grid_auto_flow": null,
1155
+ "grid_auto_rows": null,
1156
+ "grid_column": null,
1157
+ "grid_gap": null,
1158
+ "grid_row": null,
1159
+ "grid_template_areas": null,
1160
+ "grid_template_columns": null,
1161
+ "grid_template_rows": null,
1162
+ "height": null,
1163
+ "justify_content": null,
1164
+ "justify_items": null,
1165
+ "left": null,
1166
+ "margin": null,
1167
+ "max_height": null,
1168
+ "max_width": null,
1169
+ "min_height": null,
1170
+ "min_width": null,
1171
+ "object_fit": null,
1172
+ "object_position": null,
1173
+ "order": null,
1174
+ "overflow": null,
1175
+ "overflow_x": null,
1176
+ "overflow_y": null,
1177
+ "padding": null,
1178
+ "right": null,
1179
+ "top": null,
1180
+ "visibility": null,
1181
+ "width": null
1182
+ }
1183
+ },
1184
+ "d451a7f45ab74005a01dc60b78b26495": {
1185
+ "model_module": "@jupyter-widgets/base",
1186
+ "model_name": "LayoutModel",
1187
+ "model_module_version": "1.2.0",
1188
+ "state": {
1189
+ "_model_module": "@jupyter-widgets/base",
1190
+ "_model_module_version": "1.2.0",
1191
+ "_model_name": "LayoutModel",
1192
+ "_view_count": null,
1193
+ "_view_module": "@jupyter-widgets/base",
1194
+ "_view_module_version": "1.2.0",
1195
+ "_view_name": "LayoutView",
1196
+ "align_content": null,
1197
+ "align_items": null,
1198
+ "align_self": null,
1199
+ "border": null,
1200
+ "bottom": null,
1201
+ "display": null,
1202
+ "flex": null,
1203
+ "flex_flow": null,
1204
+ "grid_area": null,
1205
+ "grid_auto_columns": null,
1206
+ "grid_auto_flow": null,
1207
+ "grid_auto_rows": null,
1208
+ "grid_column": null,
1209
+ "grid_gap": null,
1210
+ "grid_row": null,
1211
+ "grid_template_areas": null,
1212
+ "grid_template_columns": null,
1213
+ "grid_template_rows": null,
1214
+ "height": null,
1215
+ "justify_content": null,
1216
+ "justify_items": null,
1217
+ "left": null,
1218
+ "margin": null,
1219
+ "max_height": null,
1220
+ "max_width": null,
1221
+ "min_height": null,
1222
+ "min_width": null,
1223
+ "object_fit": null,
1224
+ "object_position": null,
1225
+ "order": null,
1226
+ "overflow": null,
1227
+ "overflow_x": null,
1228
+ "overflow_y": null,
1229
+ "padding": null,
1230
+ "right": null,
1231
+ "top": null,
1232
+ "visibility": null,
1233
+ "width": null
1234
+ }
1235
+ },
1236
+ "6695c5802c5749328a530760bd226cda": {
1237
+ "model_module": "@jupyter-widgets/controls",
1238
+ "model_name": "DescriptionStyleModel",
1239
+ "model_module_version": "1.5.0",
1240
+ "state": {
1241
+ "_model_module": "@jupyter-widgets/controls",
1242
+ "_model_module_version": "1.5.0",
1243
+ "_model_name": "DescriptionStyleModel",
1244
+ "_view_count": null,
1245
+ "_view_module": "@jupyter-widgets/base",
1246
+ "_view_module_version": "1.2.0",
1247
+ "_view_name": "StyleView",
1248
+ "description_width": ""
1249
+ }
1250
+ },
1251
+ "efb6e80fac4543f1a0067f06c0b85008": {
1252
+ "model_module": "@jupyter-widgets/base",
1253
+ "model_name": "LayoutModel",
1254
+ "model_module_version": "1.2.0",
1255
+ "state": {
1256
+ "_model_module": "@jupyter-widgets/base",
1257
+ "_model_module_version": "1.2.0",
1258
+ "_model_name": "LayoutModel",
1259
+ "_view_count": null,
1260
+ "_view_module": "@jupyter-widgets/base",
1261
+ "_view_module_version": "1.2.0",
1262
+ "_view_name": "LayoutView",
1263
+ "align_content": null,
1264
+ "align_items": null,
1265
+ "align_self": null,
1266
+ "border": null,
1267
+ "bottom": null,
1268
+ "display": null,
1269
+ "flex": null,
1270
+ "flex_flow": null,
1271
+ "grid_area": null,
1272
+ "grid_auto_columns": null,
1273
+ "grid_auto_flow": null,
1274
+ "grid_auto_rows": null,
1275
+ "grid_column": null,
1276
+ "grid_gap": null,
1277
+ "grid_row": null,
1278
+ "grid_template_areas": null,
1279
+ "grid_template_columns": null,
1280
+ "grid_template_rows": null,
1281
+ "height": null,
1282
+ "justify_content": null,
1283
+ "justify_items": null,
1284
+ "left": null,
1285
+ "margin": null,
1286
+ "max_height": null,
1287
+ "max_width": null,
1288
+ "min_height": null,
1289
+ "min_width": null,
1290
+ "object_fit": null,
1291
+ "object_position": null,
1292
+ "order": null,
1293
+ "overflow": null,
1294
+ "overflow_x": null,
1295
+ "overflow_y": null,
1296
+ "padding": null,
1297
+ "right": null,
1298
+ "top": null,
1299
+ "visibility": null,
1300
+ "width": null
1301
+ }
1302
+ },
1303
+ "87824fee0180474ca3fc9a61348c11d4": {
1304
+ "model_module": "@jupyter-widgets/controls",
1305
+ "model_name": "ProgressStyleModel",
1306
+ "model_module_version": "1.5.0",
1307
+ "state": {
1308
+ "_model_module": "@jupyter-widgets/controls",
1309
+ "_model_module_version": "1.5.0",
1310
+ "_model_name": "ProgressStyleModel",
1311
+ "_view_count": null,
1312
+ "_view_module": "@jupyter-widgets/base",
1313
+ "_view_module_version": "1.2.0",
1314
+ "_view_name": "StyleView",
1315
+ "bar_color": null,
1316
+ "description_width": ""
1317
+ }
1318
+ },
1319
+ "a7be0a30edaa4d46b1bc5386d1db37b8": {
1320
+ "model_module": "@jupyter-widgets/base",
1321
+ "model_name": "LayoutModel",
1322
+ "model_module_version": "1.2.0",
1323
+ "state": {
1324
+ "_model_module": "@jupyter-widgets/base",
1325
+ "_model_module_version": "1.2.0",
1326
+ "_model_name": "LayoutModel",
1327
+ "_view_count": null,
1328
+ "_view_module": "@jupyter-widgets/base",
1329
+ "_view_module_version": "1.2.0",
1330
+ "_view_name": "LayoutView",
1331
+ "align_content": null,
1332
+ "align_items": null,
1333
+ "align_self": null,
1334
+ "border": null,
1335
+ "bottom": null,
1336
+ "display": null,
1337
+ "flex": null,
1338
+ "flex_flow": null,
1339
+ "grid_area": null,
1340
+ "grid_auto_columns": null,
1341
+ "grid_auto_flow": null,
1342
+ "grid_auto_rows": null,
1343
+ "grid_column": null,
1344
+ "grid_gap": null,
1345
+ "grid_row": null,
1346
+ "grid_template_areas": null,
1347
+ "grid_template_columns": null,
1348
+ "grid_template_rows": null,
1349
+ "height": null,
1350
+ "justify_content": null,
1351
+ "justify_items": null,
1352
+ "left": null,
1353
+ "margin": null,
1354
+ "max_height": null,
1355
+ "max_width": null,
1356
+ "min_height": null,
1357
+ "min_width": null,
1358
+ "object_fit": null,
1359
+ "object_position": null,
1360
+ "order": null,
1361
+ "overflow": null,
1362
+ "overflow_x": null,
1363
+ "overflow_y": null,
1364
+ "padding": null,
1365
+ "right": null,
1366
+ "top": null,
1367
+ "visibility": null,
1368
+ "width": null
1369
+ }
1370
+ },
1371
+ "d61ad8013d2e4199853f64131a3d3bab": {
1372
+ "model_module": "@jupyter-widgets/controls",
1373
+ "model_name": "DescriptionStyleModel",
1374
+ "model_module_version": "1.5.0",
1375
+ "state": {
1376
+ "_model_module": "@jupyter-widgets/controls",
1377
+ "_model_module_version": "1.5.0",
1378
+ "_model_name": "DescriptionStyleModel",
1379
+ "_view_count": null,
1380
+ "_view_module": "@jupyter-widgets/base",
1381
+ "_view_module_version": "1.2.0",
1382
+ "_view_name": "StyleView",
1383
+ "description_width": ""
1384
+ }
1385
+ },
1386
+ "752efce61c5a441789840b07b91d713c": {
1387
+ "model_module": "@jupyter-widgets/controls",
1388
+ "model_name": "HBoxModel",
1389
+ "model_module_version": "1.5.0",
1390
+ "state": {
1391
+ "_dom_classes": [],
1392
+ "_model_module": "@jupyter-widgets/controls",
1393
+ "_model_module_version": "1.5.0",
1394
+ "_model_name": "HBoxModel",
1395
+ "_view_count": null,
1396
+ "_view_module": "@jupyter-widgets/controls",
1397
+ "_view_module_version": "1.5.0",
1398
+ "_view_name": "HBoxView",
1399
+ "box_style": "",
1400
+ "children": [
1401
+ "IPY_MODEL_c6083d100b59438c9d65bca2dde2804f",
1402
+ "IPY_MODEL_1ccb86fc61c04c188588540011fd0bb9",
1403
+ "IPY_MODEL_d70c709e8d844dba974faaf7ae8912fc"
1404
+ ],
1405
+ "layout": "IPY_MODEL_b0869d4542fe48d6877f5c52922d60e8"
1406
+ }
1407
+ },
1408
+ "c6083d100b59438c9d65bca2dde2804f": {
1409
+ "model_module": "@jupyter-widgets/controls",
1410
+ "model_name": "HTMLModel",
1411
+ "model_module_version": "1.5.0",
1412
+ "state": {
1413
+ "_dom_classes": [],
1414
+ "_model_module": "@jupyter-widgets/controls",
1415
+ "_model_module_version": "1.5.0",
1416
+ "_model_name": "HTMLModel",
1417
+ "_view_count": null,
1418
+ "_view_module": "@jupyter-widgets/controls",
1419
+ "_view_module_version": "1.5.0",
1420
+ "_view_name": "HTMLView",
1421
+ "description": "",
1422
+ "description_tooltip": null,
1423
+ "layout": "IPY_MODEL_7e19ec7ac1434eb69f3b1a3bc3609942",
1424
+ "placeholder": "​",
1425
+ "style": "IPY_MODEL_55bcbec8446e41a18570ab8e1ae10394",
1426
+ "value": "Downloading model.safetensors: 100%"
1427
+ }
1428
+ },
1429
+ "1ccb86fc61c04c188588540011fd0bb9": {
1430
+ "model_module": "@jupyter-widgets/controls",
1431
+ "model_name": "FloatProgressModel",
1432
+ "model_module_version": "1.5.0",
1433
+ "state": {
1434
+ "_dom_classes": [],
1435
+ "_model_module": "@jupyter-widgets/controls",
1436
+ "_model_module_version": "1.5.0",
1437
+ "_model_name": "FloatProgressModel",
1438
+ "_view_count": null,
1439
+ "_view_module": "@jupyter-widgets/controls",
1440
+ "_view_module_version": "1.5.0",
1441
+ "_view_name": "ProgressView",
1442
+ "bar_style": "success",
1443
+ "description": "",
1444
+ "description_tooltip": null,
1445
+ "layout": "IPY_MODEL_eb329e18cec2402ab92985637e6046a9",
1446
+ "max": 548105171,
1447
+ "min": 0,
1448
+ "orientation": "horizontal",
1449
+ "style": "IPY_MODEL_7d864c973c924f89a529a05d04518dea",
1450
+ "value": 548105171
1451
+ }
1452
+ },
1453
+ "d70c709e8d844dba974faaf7ae8912fc": {
1454
+ "model_module": "@jupyter-widgets/controls",
1455
+ "model_name": "HTMLModel",
1456
+ "model_module_version": "1.5.0",
1457
+ "state": {
1458
+ "_dom_classes": [],
1459
+ "_model_module": "@jupyter-widgets/controls",
1460
+ "_model_module_version": "1.5.0",
1461
+ "_model_name": "HTMLModel",
1462
+ "_view_count": null,
1463
+ "_view_module": "@jupyter-widgets/controls",
1464
+ "_view_module_version": "1.5.0",
1465
+ "_view_name": "HTMLView",
1466
+ "description": "",
1467
+ "description_tooltip": null,
1468
+ "layout": "IPY_MODEL_31d062138ced4e9caff5b0998c902336",
1469
+ "placeholder": "​",
1470
+ "style": "IPY_MODEL_17d2934bc72542739bceabd1f37cccdc",
1471
+ "value": " 548M/548M [00:02<00:00, 237MB/s]"
1472
+ }
1473
+ },
1474
+ "b0869d4542fe48d6877f5c52922d60e8": {
1475
+ "model_module": "@jupyter-widgets/base",
1476
+ "model_name": "LayoutModel",
1477
+ "model_module_version": "1.2.0",
1478
+ "state": {
1479
+ "_model_module": "@jupyter-widgets/base",
1480
+ "_model_module_version": "1.2.0",
1481
+ "_model_name": "LayoutModel",
1482
+ "_view_count": null,
1483
+ "_view_module": "@jupyter-widgets/base",
1484
+ "_view_module_version": "1.2.0",
1485
+ "_view_name": "LayoutView",
1486
+ "align_content": null,
1487
+ "align_items": null,
1488
+ "align_self": null,
1489
+ "border": null,
1490
+ "bottom": null,
1491
+ "display": null,
1492
+ "flex": null,
1493
+ "flex_flow": null,
1494
+ "grid_area": null,
1495
+ "grid_auto_columns": null,
1496
+ "grid_auto_flow": null,
1497
+ "grid_auto_rows": null,
1498
+ "grid_column": null,
1499
+ "grid_gap": null,
1500
+ "grid_row": null,
1501
+ "grid_template_areas": null,
1502
+ "grid_template_columns": null,
1503
+ "grid_template_rows": null,
1504
+ "height": null,
1505
+ "justify_content": null,
1506
+ "justify_items": null,
1507
+ "left": null,
1508
+ "margin": null,
1509
+ "max_height": null,
1510
+ "max_width": null,
1511
+ "min_height": null,
1512
+ "min_width": null,
1513
+ "object_fit": null,
1514
+ "object_position": null,
1515
+ "order": null,
1516
+ "overflow": null,
1517
+ "overflow_x": null,
1518
+ "overflow_y": null,
1519
+ "padding": null,
1520
+ "right": null,
1521
+ "top": null,
1522
+ "visibility": null,
1523
+ "width": null
1524
+ }
1525
+ },
1526
+ "7e19ec7ac1434eb69f3b1a3bc3609942": {
1527
+ "model_module": "@jupyter-widgets/base",
1528
+ "model_name": "LayoutModel",
1529
+ "model_module_version": "1.2.0",
1530
+ "state": {
1531
+ "_model_module": "@jupyter-widgets/base",
1532
+ "_model_module_version": "1.2.0",
1533
+ "_model_name": "LayoutModel",
1534
+ "_view_count": null,
1535
+ "_view_module": "@jupyter-widgets/base",
1536
+ "_view_module_version": "1.2.0",
1537
+ "_view_name": "LayoutView",
1538
+ "align_content": null,
1539
+ "align_items": null,
1540
+ "align_self": null,
1541
+ "border": null,
1542
+ "bottom": null,
1543
+ "display": null,
1544
+ "flex": null,
1545
+ "flex_flow": null,
1546
+ "grid_area": null,
1547
+ "grid_auto_columns": null,
1548
+ "grid_auto_flow": null,
1549
+ "grid_auto_rows": null,
1550
+ "grid_column": null,
1551
+ "grid_gap": null,
1552
+ "grid_row": null,
1553
+ "grid_template_areas": null,
1554
+ "grid_template_columns": null,
1555
+ "grid_template_rows": null,
1556
+ "height": null,
1557
+ "justify_content": null,
1558
+ "justify_items": null,
1559
+ "left": null,
1560
+ "margin": null,
1561
+ "max_height": null,
1562
+ "max_width": null,
1563
+ "min_height": null,
1564
+ "min_width": null,
1565
+ "object_fit": null,
1566
+ "object_position": null,
1567
+ "order": null,
1568
+ "overflow": null,
1569
+ "overflow_x": null,
1570
+ "overflow_y": null,
1571
+ "padding": null,
1572
+ "right": null,
1573
+ "top": null,
1574
+ "visibility": null,
1575
+ "width": null
1576
+ }
1577
+ },
1578
+ "55bcbec8446e41a18570ab8e1ae10394": {
1579
+ "model_module": "@jupyter-widgets/controls",
1580
+ "model_name": "DescriptionStyleModel",
1581
+ "model_module_version": "1.5.0",
1582
+ "state": {
1583
+ "_model_module": "@jupyter-widgets/controls",
1584
+ "_model_module_version": "1.5.0",
1585
+ "_model_name": "DescriptionStyleModel",
1586
+ "_view_count": null,
1587
+ "_view_module": "@jupyter-widgets/base",
1588
+ "_view_module_version": "1.2.0",
1589
+ "_view_name": "StyleView",
1590
+ "description_width": ""
1591
+ }
1592
+ },
1593
+ "eb329e18cec2402ab92985637e6046a9": {
1594
+ "model_module": "@jupyter-widgets/base",
1595
+ "model_name": "LayoutModel",
1596
+ "model_module_version": "1.2.0",
1597
+ "state": {
1598
+ "_model_module": "@jupyter-widgets/base",
1599
+ "_model_module_version": "1.2.0",
1600
+ "_model_name": "LayoutModel",
1601
+ "_view_count": null,
1602
+ "_view_module": "@jupyter-widgets/base",
1603
+ "_view_module_version": "1.2.0",
1604
+ "_view_name": "LayoutView",
1605
+ "align_content": null,
1606
+ "align_items": null,
1607
+ "align_self": null,
1608
+ "border": null,
1609
+ "bottom": null,
1610
+ "display": null,
1611
+ "flex": null,
1612
+ "flex_flow": null,
1613
+ "grid_area": null,
1614
+ "grid_auto_columns": null,
1615
+ "grid_auto_flow": null,
1616
+ "grid_auto_rows": null,
1617
+ "grid_column": null,
1618
+ "grid_gap": null,
1619
+ "grid_row": null,
1620
+ "grid_template_areas": null,
1621
+ "grid_template_columns": null,
1622
+ "grid_template_rows": null,
1623
+ "height": null,
1624
+ "justify_content": null,
1625
+ "justify_items": null,
1626
+ "left": null,
1627
+ "margin": null,
1628
+ "max_height": null,
1629
+ "max_width": null,
1630
+ "min_height": null,
1631
+ "min_width": null,
1632
+ "object_fit": null,
1633
+ "object_position": null,
1634
+ "order": null,
1635
+ "overflow": null,
1636
+ "overflow_x": null,
1637
+ "overflow_y": null,
1638
+ "padding": null,
1639
+ "right": null,
1640
+ "top": null,
1641
+ "visibility": null,
1642
+ "width": null
1643
+ }
1644
+ },
1645
+ "7d864c973c924f89a529a05d04518dea": {
1646
+ "model_module": "@jupyter-widgets/controls",
1647
+ "model_name": "ProgressStyleModel",
1648
+ "model_module_version": "1.5.0",
1649
+ "state": {
1650
+ "_model_module": "@jupyter-widgets/controls",
1651
+ "_model_module_version": "1.5.0",
1652
+ "_model_name": "ProgressStyleModel",
1653
+ "_view_count": null,
1654
+ "_view_module": "@jupyter-widgets/base",
1655
+ "_view_module_version": "1.2.0",
1656
+ "_view_name": "StyleView",
1657
+ "bar_color": null,
1658
+ "description_width": ""
1659
+ }
1660
+ },
1661
+ "31d062138ced4e9caff5b0998c902336": {
1662
+ "model_module": "@jupyter-widgets/base",
1663
+ "model_name": "LayoutModel",
1664
+ "model_module_version": "1.2.0",
1665
+ "state": {
1666
+ "_model_module": "@jupyter-widgets/base",
1667
+ "_model_module_version": "1.2.0",
1668
+ "_model_name": "LayoutModel",
1669
+ "_view_count": null,
1670
+ "_view_module": "@jupyter-widgets/base",
1671
+ "_view_module_version": "1.2.0",
1672
+ "_view_name": "LayoutView",
1673
+ "align_content": null,
1674
+ "align_items": null,
1675
+ "align_self": null,
1676
+ "border": null,
1677
+ "bottom": null,
1678
+ "display": null,
1679
+ "flex": null,
1680
+ "flex_flow": null,
1681
+ "grid_area": null,
1682
+ "grid_auto_columns": null,
1683
+ "grid_auto_flow": null,
1684
+ "grid_auto_rows": null,
1685
+ "grid_column": null,
1686
+ "grid_gap": null,
1687
+ "grid_row": null,
1688
+ "grid_template_areas": null,
1689
+ "grid_template_columns": null,
1690
+ "grid_template_rows": null,
1691
+ "height": null,
1692
+ "justify_content": null,
1693
+ "justify_items": null,
1694
+ "left": null,
1695
+ "margin": null,
1696
+ "max_height": null,
1697
+ "max_width": null,
1698
+ "min_height": null,
1699
+ "min_width": null,
1700
+ "object_fit": null,
1701
+ "object_position": null,
1702
+ "order": null,
1703
+ "overflow": null,
1704
+ "overflow_x": null,
1705
+ "overflow_y": null,
1706
+ "padding": null,
1707
+ "right": null,
1708
+ "top": null,
1709
+ "visibility": null,
1710
+ "width": null
1711
+ }
1712
+ },
1713
+ "17d2934bc72542739bceabd1f37cccdc": {
1714
+ "model_module": "@jupyter-widgets/controls",
1715
+ "model_name": "DescriptionStyleModel",
1716
+ "model_module_version": "1.5.0",
1717
+ "state": {
1718
+ "_model_module": "@jupyter-widgets/controls",
1719
+ "_model_module_version": "1.5.0",
1720
+ "_model_name": "DescriptionStyleModel",
1721
+ "_view_count": null,
1722
+ "_view_module": "@jupyter-widgets/base",
1723
+ "_view_module_version": "1.2.0",
1724
+ "_view_name": "StyleView",
1725
+ "description_width": ""
1726
+ }
1727
+ },
1728
+ "bb35b990bdd249fbb7524f3344a15667": {
1729
+ "model_module": "@jupyter-widgets/controls",
1730
+ "model_name": "HBoxModel",
1731
+ "model_module_version": "1.5.0",
1732
+ "state": {
1733
+ "_dom_classes": [],
1734
+ "_model_module": "@jupyter-widgets/controls",
1735
+ "_model_module_version": "1.5.0",
1736
+ "_model_name": "HBoxModel",
1737
+ "_view_count": null,
1738
+ "_view_module": "@jupyter-widgets/controls",
1739
+ "_view_module_version": "1.5.0",
1740
+ "_view_name": "HBoxView",
1741
+ "box_style": "",
1742
+ "children": [
1743
+ "IPY_MODEL_6dcd9aa35ccd4001a3d22b6a031a6f32",
1744
+ "IPY_MODEL_ce97fe761f1548fa91bca8a92985e19e",
1745
+ "IPY_MODEL_aa520e4c88054630863e4c52c94da7a7"
1746
+ ],
1747
+ "layout": "IPY_MODEL_eeeb7c0e8729434f898429f67a0f12a0"
1748
+ }
1749
+ },
1750
+ "6dcd9aa35ccd4001a3d22b6a031a6f32": {
1751
+ "model_module": "@jupyter-widgets/controls",
1752
+ "model_name": "HTMLModel",
1753
+ "model_module_version": "1.5.0",
1754
+ "state": {
1755
+ "_dom_classes": [],
1756
+ "_model_module": "@jupyter-widgets/controls",
1757
+ "_model_module_version": "1.5.0",
1758
+ "_model_name": "HTMLModel",
1759
+ "_view_count": null,
1760
+ "_view_module": "@jupyter-widgets/controls",
1761
+ "_view_module_version": "1.5.0",
1762
+ "_view_name": "HTMLView",
1763
+ "description": "",
1764
+ "description_tooltip": null,
1765
+ "layout": "IPY_MODEL_95798b51596941dcad2419415f922328",
1766
+ "placeholder": "​",
1767
+ "style": "IPY_MODEL_61469ecd3ecd4b0f9dbdb4a7bf256d54",
1768
+ "value": "Downloading (…)neration_config.json: 100%"
1769
+ }
1770
+ },
1771
+ "ce97fe761f1548fa91bca8a92985e19e": {
1772
+ "model_module": "@jupyter-widgets/controls",
1773
+ "model_name": "FloatProgressModel",
1774
+ "model_module_version": "1.5.0",
1775
+ "state": {
1776
+ "_dom_classes": [],
1777
+ "_model_module": "@jupyter-widgets/controls",
1778
+ "_model_module_version": "1.5.0",
1779
+ "_model_name": "FloatProgressModel",
1780
+ "_view_count": null,
1781
+ "_view_module": "@jupyter-widgets/controls",
1782
+ "_view_module_version": "1.5.0",
1783
+ "_view_name": "ProgressView",
1784
+ "bar_style": "success",
1785
+ "description": "",
1786
+ "description_tooltip": null,
1787
+ "layout": "IPY_MODEL_ed6919866c334fa48031e6257b87053c",
1788
+ "max": 124,
1789
+ "min": 0,
1790
+ "orientation": "horizontal",
1791
+ "style": "IPY_MODEL_59b0e1e2411b43f796783ed8605aaebb",
1792
+ "value": 124
1793
+ }
1794
+ },
1795
+ "aa520e4c88054630863e4c52c94da7a7": {
1796
+ "model_module": "@jupyter-widgets/controls",
1797
+ "model_name": "HTMLModel",
1798
+ "model_module_version": "1.5.0",
1799
+ "state": {
1800
+ "_dom_classes": [],
1801
+ "_model_module": "@jupyter-widgets/controls",
1802
+ "_model_module_version": "1.5.0",
1803
+ "_model_name": "HTMLModel",
1804
+ "_view_count": null,
1805
+ "_view_module": "@jupyter-widgets/controls",
1806
+ "_view_module_version": "1.5.0",
1807
+ "_view_name": "HTMLView",
1808
+ "description": "",
1809
+ "description_tooltip": null,
1810
+ "layout": "IPY_MODEL_7fae11ab09744381940ad404e86bb97b",
1811
+ "placeholder": "​",
1812
+ "style": "IPY_MODEL_db9e64cbd6cf4479bf0d966ab1a6e801",
1813
+ "value": " 124/124 [00:00<00:00, 7.33kB/s]"
1814
+ }
1815
+ },
1816
+ "eeeb7c0e8729434f898429f67a0f12a0": {
1817
+ "model_module": "@jupyter-widgets/base",
1818
+ "model_name": "LayoutModel",
1819
+ "model_module_version": "1.2.0",
1820
+ "state": {
1821
+ "_model_module": "@jupyter-widgets/base",
1822
+ "_model_module_version": "1.2.0",
1823
+ "_model_name": "LayoutModel",
1824
+ "_view_count": null,
1825
+ "_view_module": "@jupyter-widgets/base",
1826
+ "_view_module_version": "1.2.0",
1827
+ "_view_name": "LayoutView",
1828
+ "align_content": null,
1829
+ "align_items": null,
1830
+ "align_self": null,
1831
+ "border": null,
1832
+ "bottom": null,
1833
+ "display": null,
1834
+ "flex": null,
1835
+ "flex_flow": null,
1836
+ "grid_area": null,
1837
+ "grid_auto_columns": null,
1838
+ "grid_auto_flow": null,
1839
+ "grid_auto_rows": null,
1840
+ "grid_column": null,
1841
+ "grid_gap": null,
1842
+ "grid_row": null,
1843
+ "grid_template_areas": null,
1844
+ "grid_template_columns": null,
1845
+ "grid_template_rows": null,
1846
+ "height": null,
1847
+ "justify_content": null,
1848
+ "justify_items": null,
1849
+ "left": null,
1850
+ "margin": null,
1851
+ "max_height": null,
1852
+ "max_width": null,
1853
+ "min_height": null,
1854
+ "min_width": null,
1855
+ "object_fit": null,
1856
+ "object_position": null,
1857
+ "order": null,
1858
+ "overflow": null,
1859
+ "overflow_x": null,
1860
+ "overflow_y": null,
1861
+ "padding": null,
1862
+ "right": null,
1863
+ "top": null,
1864
+ "visibility": null,
1865
+ "width": null
1866
+ }
1867
+ },
1868
+ "95798b51596941dcad2419415f922328": {
1869
+ "model_module": "@jupyter-widgets/base",
1870
+ "model_name": "LayoutModel",
1871
+ "model_module_version": "1.2.0",
1872
+ "state": {
1873
+ "_model_module": "@jupyter-widgets/base",
1874
+ "_model_module_version": "1.2.0",
1875
+ "_model_name": "LayoutModel",
1876
+ "_view_count": null,
1877
+ "_view_module": "@jupyter-widgets/base",
1878
+ "_view_module_version": "1.2.0",
1879
+ "_view_name": "LayoutView",
1880
+ "align_content": null,
1881
+ "align_items": null,
1882
+ "align_self": null,
1883
+ "border": null,
1884
+ "bottom": null,
1885
+ "display": null,
1886
+ "flex": null,
1887
+ "flex_flow": null,
1888
+ "grid_area": null,
1889
+ "grid_auto_columns": null,
1890
+ "grid_auto_flow": null,
1891
+ "grid_auto_rows": null,
1892
+ "grid_column": null,
1893
+ "grid_gap": null,
1894
+ "grid_row": null,
1895
+ "grid_template_areas": null,
1896
+ "grid_template_columns": null,
1897
+ "grid_template_rows": null,
1898
+ "height": null,
1899
+ "justify_content": null,
1900
+ "justify_items": null,
1901
+ "left": null,
1902
+ "margin": null,
1903
+ "max_height": null,
1904
+ "max_width": null,
1905
+ "min_height": null,
1906
+ "min_width": null,
1907
+ "object_fit": null,
1908
+ "object_position": null,
1909
+ "order": null,
1910
+ "overflow": null,
1911
+ "overflow_x": null,
1912
+ "overflow_y": null,
1913
+ "padding": null,
1914
+ "right": null,
1915
+ "top": null,
1916
+ "visibility": null,
1917
+ "width": null
1918
+ }
1919
+ },
1920
+ "61469ecd3ecd4b0f9dbdb4a7bf256d54": {
1921
+ "model_module": "@jupyter-widgets/controls",
1922
+ "model_name": "DescriptionStyleModel",
1923
+ "model_module_version": "1.5.0",
1924
+ "state": {
1925
+ "_model_module": "@jupyter-widgets/controls",
1926
+ "_model_module_version": "1.5.0",
1927
+ "_model_name": "DescriptionStyleModel",
1928
+ "_view_count": null,
1929
+ "_view_module": "@jupyter-widgets/base",
1930
+ "_view_module_version": "1.2.0",
1931
+ "_view_name": "StyleView",
1932
+ "description_width": ""
1933
+ }
1934
+ },
1935
+ "ed6919866c334fa48031e6257b87053c": {
1936
+ "model_module": "@jupyter-widgets/base",
1937
+ "model_name": "LayoutModel",
1938
+ "model_module_version": "1.2.0",
1939
+ "state": {
1940
+ "_model_module": "@jupyter-widgets/base",
1941
+ "_model_module_version": "1.2.0",
1942
+ "_model_name": "LayoutModel",
1943
+ "_view_count": null,
1944
+ "_view_module": "@jupyter-widgets/base",
1945
+ "_view_module_version": "1.2.0",
1946
+ "_view_name": "LayoutView",
1947
+ "align_content": null,
1948
+ "align_items": null,
1949
+ "align_self": null,
1950
+ "border": null,
1951
+ "bottom": null,
1952
+ "display": null,
1953
+ "flex": null,
1954
+ "flex_flow": null,
1955
+ "grid_area": null,
1956
+ "grid_auto_columns": null,
1957
+ "grid_auto_flow": null,
1958
+ "grid_auto_rows": null,
1959
+ "grid_column": null,
1960
+ "grid_gap": null,
1961
+ "grid_row": null,
1962
+ "grid_template_areas": null,
1963
+ "grid_template_columns": null,
1964
+ "grid_template_rows": null,
1965
+ "height": null,
1966
+ "justify_content": null,
1967
+ "justify_items": null,
1968
+ "left": null,
1969
+ "margin": null,
1970
+ "max_height": null,
1971
+ "max_width": null,
1972
+ "min_height": null,
1973
+ "min_width": null,
1974
+ "object_fit": null,
1975
+ "object_position": null,
1976
+ "order": null,
1977
+ "overflow": null,
1978
+ "overflow_x": null,
1979
+ "overflow_y": null,
1980
+ "padding": null,
1981
+ "right": null,
1982
+ "top": null,
1983
+ "visibility": null,
1984
+ "width": null
1985
+ }
1986
+ },
1987
+ "59b0e1e2411b43f796783ed8605aaebb": {
1988
+ "model_module": "@jupyter-widgets/controls",
1989
+ "model_name": "ProgressStyleModel",
1990
+ "model_module_version": "1.5.0",
1991
+ "state": {
1992
+ "_model_module": "@jupyter-widgets/controls",
1993
+ "_model_module_version": "1.5.0",
1994
+ "_model_name": "ProgressStyleModel",
1995
+ "_view_count": null,
1996
+ "_view_module": "@jupyter-widgets/base",
1997
+ "_view_module_version": "1.2.0",
1998
+ "_view_name": "StyleView",
1999
+ "bar_color": null,
2000
+ "description_width": ""
2001
+ }
2002
+ },
2003
+ "7fae11ab09744381940ad404e86bb97b": {
2004
+ "model_module": "@jupyter-widgets/base",
2005
+ "model_name": "LayoutModel",
2006
+ "model_module_version": "1.2.0",
2007
+ "state": {
2008
+ "_model_module": "@jupyter-widgets/base",
2009
+ "_model_module_version": "1.2.0",
2010
+ "_model_name": "LayoutModel",
2011
+ "_view_count": null,
2012
+ "_view_module": "@jupyter-widgets/base",
2013
+ "_view_module_version": "1.2.0",
2014
+ "_view_name": "LayoutView",
2015
+ "align_content": null,
2016
+ "align_items": null,
2017
+ "align_self": null,
2018
+ "border": null,
2019
+ "bottom": null,
2020
+ "display": null,
2021
+ "flex": null,
2022
+ "flex_flow": null,
2023
+ "grid_area": null,
2024
+ "grid_auto_columns": null,
2025
+ "grid_auto_flow": null,
2026
+ "grid_auto_rows": null,
2027
+ "grid_column": null,
2028
+ "grid_gap": null,
2029
+ "grid_row": null,
2030
+ "grid_template_areas": null,
2031
+ "grid_template_columns": null,
2032
+ "grid_template_rows": null,
2033
+ "height": null,
2034
+ "justify_content": null,
2035
+ "justify_items": null,
2036
+ "left": null,
2037
+ "margin": null,
2038
+ "max_height": null,
2039
+ "max_width": null,
2040
+ "min_height": null,
2041
+ "min_width": null,
2042
+ "object_fit": null,
2043
+ "object_position": null,
2044
+ "order": null,
2045
+ "overflow": null,
2046
+ "overflow_x": null,
2047
+ "overflow_y": null,
2048
+ "padding": null,
2049
+ "right": null,
2050
+ "top": null,
2051
+ "visibility": null,
2052
+ "width": null
2053
+ }
2054
+ },
2055
+ "db9e64cbd6cf4479bf0d966ab1a6e801": {
2056
+ "model_module": "@jupyter-widgets/controls",
2057
+ "model_name": "DescriptionStyleModel",
2058
+ "model_module_version": "1.5.0",
2059
+ "state": {
2060
+ "_model_module": "@jupyter-widgets/controls",
2061
+ "_model_module_version": "1.5.0",
2062
+ "_model_name": "DescriptionStyleModel",
2063
+ "_view_count": null,
2064
+ "_view_module": "@jupyter-widgets/base",
2065
+ "_view_module_version": "1.2.0",
2066
+ "_view_name": "StyleView",
2067
+ "description_width": ""
2068
+ }
2069
+ }
2070
+ }
2071
+ },
2072
+ "accelerator": "GPU"
2073
+ },
2074
+ "cells": [
2075
+ {
2076
+ "cell_type": "code",
2077
+ "execution_count": null,
2078
+ "metadata": {
2079
+ "colab": {
2080
+ "base_uri": "https://localhost:8080/"
2081
+ },
2082
+ "id": "Csvam2nOBEgO",
2083
+ "outputId": "fef3a603-10d5-4502-d040-cc66ce23b439"
2084
+ },
2085
+ "outputs": [
2086
+ {
2087
+ "output_type": "stream",
2088
+ "name": "stdout",
2089
+ "text": [
2090
+ "Collecting transformers\n",
2091
+ " Downloading transformers-4.33.1-py3-none-any.whl (7.6 MB)\n",
2092
+ "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m7.6/7.6 MB\u001b[0m \u001b[31m21.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
2093
+ "\u001b[?25hRequirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers) (3.12.2)\n",
2094
+ "Collecting huggingface-hub<1.0,>=0.15.1 (from transformers)\n",
2095
+ " Downloading huggingface_hub-0.17.1-py3-none-any.whl (294 kB)\n",
2096
+ "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m294.8/294.8 kB\u001b[0m \u001b[31m35.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
2097
+ "\u001b[?25hRequirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from transformers) (1.23.5)\n",
2098
+ "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.10/dist-packages (from transformers) (23.1)\n",
2099
+ "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from transformers) (6.0.1)\n",
2100
+ "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers) (2023.6.3)\n",
2101
+ "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers) (2.31.0)\n",
2102
+ "Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers)\n",
2103
+ " Downloading tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)\n",
2104
+ "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m7.8/7.8 MB\u001b[0m \u001b[31m59.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
2105
+ "\u001b[?25hCollecting safetensors>=0.3.1 (from transformers)\n",
2106
+ " Downloading safetensors-0.3.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)\n",
2107
+ "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.3/1.3 MB\u001b[0m \u001b[31m63.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
2108
+ "\u001b[?25hRequirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers) (4.66.1)\n",
2109
+ "Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers) (2023.6.0)\n",
2110
+ "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers) (4.5.0)\n",
2111
+ "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers) (3.2.0)\n",
2112
+ "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->transformers) (3.4)\n",
2113
+ "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->transformers) (2.0.4)\n",
2114
+ "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->transformers) (2023.7.22)\n",
2115
+ "Installing collected packages: tokenizers, safetensors, huggingface-hub, transformers\n",
2116
+ "Successfully installed huggingface-hub-0.17.1 safetensors-0.3.3 tokenizers-0.13.3 transformers-4.33.1\n"
2117
+ ]
2118
+ }
2119
+ ],
2120
+ "source": [
2121
+ "!pip install transformers"
2122
+ ]
2123
+ },
2124
+ {
2125
+ "cell_type": "markdown",
2126
+ "source": [
2127
+ "### Accessing Pre-Trained Models Directly\n",
2128
+ "\n",
2129
+ "\n",
2130
+ "Model Card: https://huggingface.co/gpt2"
2131
+ ],
2132
+ "metadata": {
2133
+ "id": "TzGAX8ZlH6f6"
2134
+ }
2135
+ },
2136
+ {
2137
+ "cell_type": "code",
2138
+ "source": [
2139
+ "from transformers import AutoModelForCausalLM, AutoTokenizer\n",
2140
+ "\n",
2141
+ "tokenizer = AutoTokenizer.from_pretrained(\"gpt2\")\n",
2142
+ "\n",
2143
+ "# add the EOS token as PAD token to avoid warnings\n",
2144
+ "model = AutoModelForCausalLM.from_pretrained(\"gpt2\", pad_token_id=tokenizer.eos_token_id)"
2145
+ ],
2146
+ "metadata": {
2147
+ "colab": {
2148
+ "base_uri": "https://localhost:8080/",
2149
+ "height": 209,
2150
+ "referenced_widgets": [
2151
+ "e6801b9d36904ac6b648423f46d95709",
2152
+ "c4ec646582c947f68fdcee06e450e156",
2153
+ "0241857b008c41dc8cdc103887020635",
2154
+ "871b1e8da915424fa13752d766d04100",
2155
+ "713cd7fa524c40d2b3d41a5c65055c08",
2156
+ "5d336f1585b84fe38fc75907a49df55f",
2157
+ "abdcbc3895944ee7a5d9fbda9bf2936c",
2158
+ "8536535613744a889ce6236d896b9bf1",
2159
+ "932c4a6e0ea444308247e1509ef2ca71",
2160
+ "2ff5223453f54d0faa3ebd91f6429005",
2161
+ "14b2d8f86632413f9a31add6fe7d8f6e",
2162
+ "022eb2ccabcc43468ce3fdf3fca35b6c",
2163
+ "f107439c62984501951f360f740af61b",
2164
+ "a0eff8bee17747db932034defac49a05",
2165
+ "51a30585335d44ecbf0f7d27905915b2",
2166
+ "48de897e4783451b89183e8f9c414761",
2167
+ "b70d9069401a449bbad18fd9cafc814e",
2168
+ "2b842ffef24c41219ceb63cfd92fac00",
2169
+ "32169bbbbe154b6dac5ad0fc863871ff",
2170
+ "f3ede63320be4b26a3251b1a3ff4c6d7",
2171
+ "56e9148ced5b4f1d87442edea24c3c3c",
2172
+ "d39c918ac66744f0aeb158cae6c165e3",
2173
+ "2c79133c83314171a837de2fd222e48f",
2174
+ "54323992c04a4db9a7f68027c14ca3ab",
2175
+ "a6726218400d45189e7876b62a3e26ce",
2176
+ "2713c8e0f7c142bd9a8105f2ae76c8c5",
2177
+ "cf423d5fd0a34aafbc01511a08e45478",
2178
+ "4584a40d5e894d3ba3b1d5d0aa498f5c",
2179
+ "9a009d1138794009be8f56005d76507d",
2180
+ "b0bb742eb65b4fbb9bbe2f1b45387383",
2181
+ "1a1f113e47524855a608b9bc55eac66d",
2182
+ "61a8f372679549f993bd6c76c1221d59",
2183
+ "5262cbb56d1e4b05a249f66aa5c59d70",
2184
+ "c3b4e690b58e4fc3bb6d32ec113a9938",
2185
+ "75ec6b53aa224705b9de577d947545f1",
2186
+ "cdcf3d005e1249508c1fbeed03923a31",
2187
+ "6777cda95c7c4bb89e72bc4b4f2f2b11",
2188
+ "19fa6b959f5a4b72928c7e2535499ac2",
2189
+ "d451a7f45ab74005a01dc60b78b26495",
2190
+ "6695c5802c5749328a530760bd226cda",
2191
+ "efb6e80fac4543f1a0067f06c0b85008",
2192
+ "87824fee0180474ca3fc9a61348c11d4",
2193
+ "a7be0a30edaa4d46b1bc5386d1db37b8",
2194
+ "d61ad8013d2e4199853f64131a3d3bab",
2195
+ "752efce61c5a441789840b07b91d713c",
2196
+ "c6083d100b59438c9d65bca2dde2804f",
2197
+ "1ccb86fc61c04c188588540011fd0bb9",
2198
+ "d70c709e8d844dba974faaf7ae8912fc",
2199
+ "b0869d4542fe48d6877f5c52922d60e8",
2200
+ "7e19ec7ac1434eb69f3b1a3bc3609942",
2201
+ "55bcbec8446e41a18570ab8e1ae10394",
2202
+ "eb329e18cec2402ab92985637e6046a9",
2203
+ "7d864c973c924f89a529a05d04518dea",
2204
+ "31d062138ced4e9caff5b0998c902336",
2205
+ "17d2934bc72542739bceabd1f37cccdc",
2206
+ "bb35b990bdd249fbb7524f3344a15667",
2207
+ "6dcd9aa35ccd4001a3d22b6a031a6f32",
2208
+ "ce97fe761f1548fa91bca8a92985e19e",
2209
+ "aa520e4c88054630863e4c52c94da7a7",
2210
+ "eeeb7c0e8729434f898429f67a0f12a0",
2211
+ "95798b51596941dcad2419415f922328",
2212
+ "61469ecd3ecd4b0f9dbdb4a7bf256d54",
2213
+ "ed6919866c334fa48031e6257b87053c",
2214
+ "59b0e1e2411b43f796783ed8605aaebb",
2215
+ "7fae11ab09744381940ad404e86bb97b",
2216
+ "db9e64cbd6cf4479bf0d966ab1a6e801"
2217
+ ]
2218
+ },
2219
+ "id": "DX-MZyASHi6y",
2220
+ "outputId": "4c58f697-9dfc-4907-92e5-102ce1648f3e"
2221
+ },
2222
+ "execution_count": null,
2223
+ "outputs": [
2224
+ {
2225
+ "output_type": "display_data",
2226
+ "data": {
2227
+ "text/plain": [
2228
+ "Downloading (…)lve/main/config.json: 0%| | 0.00/665 [00:00<?, ?B/s]"
2229
+ ],
2230
+ "application/vnd.jupyter.widget-view+json": {
2231
+ "version_major": 2,
2232
+ "version_minor": 0,
2233
+ "model_id": "e6801b9d36904ac6b648423f46d95709"
2234
+ }
2235
+ },
2236
+ "metadata": {}
2237
+ },
2238
+ {
2239
+ "output_type": "display_data",
2240
+ "data": {
2241
+ "text/plain": [
2242
+ "Downloading (…)olve/main/vocab.json: 0%| | 0.00/1.04M [00:00<?, ?B/s]"
2243
+ ],
2244
+ "application/vnd.jupyter.widget-view+json": {
2245
+ "version_major": 2,
2246
+ "version_minor": 0,
2247
+ "model_id": "022eb2ccabcc43468ce3fdf3fca35b6c"
2248
+ }
2249
+ },
2250
+ "metadata": {}
2251
+ },
2252
+ {
2253
+ "output_type": "display_data",
2254
+ "data": {
2255
+ "text/plain": [
2256
+ "Downloading (…)olve/main/merges.txt: 0%| | 0.00/456k [00:00<?, ?B/s]"
2257
+ ],
2258
+ "application/vnd.jupyter.widget-view+json": {
2259
+ "version_major": 2,
2260
+ "version_minor": 0,
2261
+ "model_id": "2c79133c83314171a837de2fd222e48f"
2262
+ }
2263
+ },
2264
+ "metadata": {}
2265
+ },
2266
+ {
2267
+ "output_type": "display_data",
2268
+ "data": {
2269
+ "text/plain": [
2270
+ "Downloading (…)/main/tokenizer.json: 0%| | 0.00/1.36M [00:00<?, ?B/s]"
2271
+ ],
2272
+ "application/vnd.jupyter.widget-view+json": {
2273
+ "version_major": 2,
2274
+ "version_minor": 0,
2275
+ "model_id": "c3b4e690b58e4fc3bb6d32ec113a9938"
2276
+ }
2277
+ },
2278
+ "metadata": {}
2279
+ },
2280
+ {
2281
+ "output_type": "display_data",
2282
+ "data": {
2283
+ "text/plain": [
2284
+ "Downloading model.safetensors: 0%| | 0.00/548M [00:00<?, ?B/s]"
2285
+ ],
2286
+ "application/vnd.jupyter.widget-view+json": {
2287
+ "version_major": 2,
2288
+ "version_minor": 0,
2289
+ "model_id": "752efce61c5a441789840b07b91d713c"
2290
+ }
2291
+ },
2292
+ "metadata": {}
2293
+ },
2294
+ {
2295
+ "output_type": "display_data",
2296
+ "data": {
2297
+ "text/plain": [
2298
+ "Downloading (…)neration_config.json: 0%| | 0.00/124 [00:00<?, ?B/s]"
2299
+ ],
2300
+ "application/vnd.jupyter.widget-view+json": {
2301
+ "version_major": 2,
2302
+ "version_minor": 0,
2303
+ "model_id": "bb35b990bdd249fbb7524f3344a15667"
2304
+ }
2305
+ },
2306
+ "metadata": {}
2307
+ }
2308
+ ]
2309
+ },
2310
+ {
2311
+ "cell_type": "code",
2312
+ "source": [
2313
+ "# encode context the generation is conditioned on\n",
2314
+ "model_inputs = tokenizer('I enjoy walking with my cute dog', return_tensors='pt')\n",
2315
+ "\n",
2316
+ "# generate 40 new tokens\n",
2317
+ "greedy_output = model.generate(**model_inputs, max_new_tokens=40)\n",
2318
+ "\n",
2319
+ "print(\"Output:\\n\" + 100 * '-')\n",
2320
+ "print(tokenizer.decode(greedy_output[0], skip_special_tokens=True))"
2321
+ ],
2322
+ "metadata": {
2323
+ "colab": {
2324
+ "base_uri": "https://localhost:8080/"
2325
+ },
2326
+ "id": "tALfu1FBHq3y",
2327
+ "outputId": "72b288c6-7db0-4a3f-872a-8e484596beee"
2328
+ },
2329
+ "execution_count": null,
2330
+ "outputs": [
2331
+ {
2332
+ "output_type": "stream",
2333
+ "name": "stderr",
2334
+ "text": [
2335
+ "/usr/local/lib/python3.10/dist-packages/transformers/generation/utils.py:1417: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation )\n",
2336
+ " warnings.warn(\n"
2337
+ ]
2338
+ },
2339
+ {
2340
+ "output_type": "stream",
2341
+ "name": "stdout",
2342
+ "text": [
2343
+ "Output:\n",
2344
+ "----------------------------------------------------------------------------------------------------\n",
2345
+ "I enjoy walking with my cute dog, but I'm not sure if I'll ever be able to walk with my dog. I'm not sure if I'll ever be able to walk with my dog.\n",
2346
+ "\n",
2347
+ "I'm not sure\n"
2348
+ ]
2349
+ }
2350
+ ]
2351
+ },
2352
+ {
2353
+ "cell_type": "markdown",
2354
+ "source": [
2355
+ "### Accessing Pre-trained Models Using Pipeline\n",
2356
+ "\n",
2357
+ "\n",
2358
+ "A Hugging Face **pipeline** is a high-level abstraction for running inference on models from the Hugging Face Model Hub. It simplifies the process of using pre-trained models for various tasks such as language understanding, computer vision, and speech recognition.\n",
2359
+ "\n",
2360
+ "With the `pipeline()` function, users can easily load models and tokenizers, and perform inference without requiring expertise in the underlying models. Users can specify an inference task, provide input data, and the pipeline will automatically handle pre-processing, model inference, and post-processing.\n",
2361
+ "\n",
2362
+ "**Pipeline** supports multiple modalities including text, audio, and vision, and allows users to easily switch between different models for improved results."
2363
+ ],
2364
+ "metadata": {
2365
+ "id": "sPYf9kKKIB0x"
2366
+ }
2367
+ },
2368
+ {
2369
+ "cell_type": "code",
2370
+ "source": [
2371
+ "# Use a pipeline as a high-level helper\n",
2372
+ "from transformers import pipeline\n",
2373
+ "\n",
2374
+ "pipe = pipeline(\"text-generation\", model=\"gpt2\")"
2375
+ ],
2376
+ "metadata": {
2377
+ "id": "ejt0nCeqHxov"
2378
+ },
2379
+ "execution_count": null,
2380
+ "outputs": []
2381
+ },
2382
+ {
2383
+ "cell_type": "code",
2384
+ "source": [
2385
+ "pipe('I enjoy walking with my cute dog', max_length=30, num_return_sequences=1)"
2386
+ ],
2387
+ "metadata": {
2388
+ "colab": {
2389
+ "base_uri": "https://localhost:8080/"
2390
+ },
2391
+ "id": "WPRA6cX_IXNP",
2392
+ "outputId": "a14166e3-1a3e-4575-f69e-395a92477d7b"
2393
+ },
2394
+ "execution_count": null,
2395
+ "outputs": [
2396
+ {
2397
+ "output_type": "stream",
2398
+ "name": "stderr",
2399
+ "text": [
2400
+ "Setting `pad_token_id` to `eos_token_id`:50256 for open-end generation.\n"
2401
+ ]
2402
+ },
2403
+ {
2404
+ "output_type": "execute_result",
2405
+ "data": {
2406
+ "text/plain": [
2407
+ "[{'generated_text': 'I enjoy walking with my cute dog as a special treat,\" said Taylor.\\n\\nTaylor was one of more than 20,000 registered dogs in the'}]"
2408
+ ]
2409
+ },
2410
+ "metadata": {},
2411
+ "execution_count": 5
2412
+ }
2413
+ ]
2414
+ },
2415
+ {
2416
+ "cell_type": "code",
2417
+ "source": [
2418
+ "pipe('I enjoy walking with my cute dog', max_length=30, num_return_sequences=5)"
2419
+ ],
2420
+ "metadata": {
2421
+ "colab": {
2422
+ "base_uri": "https://localhost:8080/"
2423
+ },
2424
+ "id": "eGj4y116IadD",
2425
+ "outputId": "d52638e6-41bc-4c4d-d4bb-de46eca81928"
2426
+ },
2427
+ "execution_count": null,
2428
+ "outputs": [
2429
+ {
2430
+ "output_type": "stream",
2431
+ "name": "stderr",
2432
+ "text": [
2433
+ "Setting `pad_token_id` to `eos_token_id`:50256 for open-end generation.\n"
2434
+ ]
2435
+ },
2436
+ {
2437
+ "output_type": "execute_result",
2438
+ "data": {
2439
+ "text/plain": [
2440
+ "[{'generated_text': 'I enjoy walking with my cute dog at the local pet store and seeing my new pup,\" Gail explained in an interview for the book. \"I'},\n",
2441
+ " {'generated_text': 'I enjoy walking with my cute dog and he loves being in our backyard. All he wants is something to make sure all his dogs are safe. That'},\n",
2442
+ " {'generated_text': \"I enjoy walking with my cute dog, who loves me, she's just a bit shy...but not quite shy enough to notice who my wife is\"},\n",
2443
+ " {'generated_text': \"I enjoy walking with my cute dog, a brownie. He gets to run around and has a very high IQ. When I'm with him,\"},\n",
2444
+ " {'generated_text': 'I enjoy walking with my cute dog. I love the way the dog likes to lay down on the bed next to me. His eyes are open,'}]"
2445
+ ]
2446
+ },
2447
+ "metadata": {},
2448
+ "execution_count": 6
2449
+ }
2450
+ ]
2451
+ },
2452
+ {
2453
+ "cell_type": "code",
2454
+ "source": [],
2455
+ "metadata": {
2456
+ "id": "yAK64PYHI_yr"
2457
+ },
2458
+ "execution_count": null,
2459
+ "outputs": []
2460
+ }
2461
+ ]
2462
+ }
How_To_Use_Transformers.ipynb ADDED
The diff for this file is too large to render. See raw diff