Hugging Face's logo

smithblack-0
/
stage-one-v2

Model card Files
xet
 Community
smithblack-0 commited on
Commit
dff673c
·
verified ·
1 Parent(s): 140d04a

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. uniform_42/epoch3/metadata.json +6 -0
  2. uniform_42/epoch3/metrics.json +1668 -0
  3. uniform_42/epoch3/model.pt +3 -0
  4. uniform_42/epoch3/optimizer.pt +3 -0
  5. uniform_42/epoch3/scheduler.pt +3 -0
  6. uniform_42/epoch3/tokenizer/merges.txt +0 -0
  7. uniform_42/epoch3/tokenizer/special_tokens_map.json +6 -0
  8. uniform_42/epoch3/tokenizer/tokenizer.json +0 -0
  9. uniform_42/epoch3/tokenizer/tokenizer_config.json +21 -0
  10. uniform_42/epoch3/tokenizer/vocab.json +0 -0
uniform_42/epoch3/metadata.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "epoch_num": 3,
3
+ "global_batch_num": 536,
4
+ "device": "cuda",
5
+ "dtype": "bfloat16"
6
+ }
uniform_42/epoch3/metrics.json ADDED
@@ -0,0 +1,1668 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "training": {
3
+ "effective_batch_nums": [
4
+ 1,
5
+ 2,
6
+ 3,
7
+ 4,
8
+ 5,
9
+ 6,
10
+ 7,
11
+ 8,
12
+ 9,
13
+ 10,
14
+ 11,
15
+ 12,
16
+ 13,
17
+ 14,
18
+ 15,
19
+ 16,
20
+ 17,
21
+ 18,
22
+ 19,
23
+ 20,
24
+ 21,
25
+ 22,
26
+ 23,
27
+ 24,
28
+ 25,
29
+ 26,
30
+ 27,
31
+ 28,
32
+ 29,
33
+ 30,
34
+ 31,
35
+ 32,
36
+ 33,
37
+ 34,
38
+ 35,
39
+ 36,
40
+ 37,
41
+ 38,
42
+ 39,
43
+ 40,
44
+ 41,
45
+ 42,
46
+ 43,
47
+ 44,
48
+ 45,
49
+ 46,
50
+ 47,
51
+ 48,
52
+ 49,
53
+ 50,
54
+ 51,
55
+ 52,
56
+ 53,
57
+ 54,
58
+ 55,
59
+ 56,
60
+ 57,
61
+ 58,
62
+ 59,
63
+ 60,
64
+ 61,
65
+ 62,
66
+ 63,
67
+ 64,
68
+ 65,
69
+ 66,
70
+ 67,
71
+ 68,
72
+ 69,
73
+ 70,
74
+ 71,
75
+ 72,
76
+ 73,
77
+ 74,
78
+ 75,
79
+ 76,
80
+ 77,
81
+ 78,
82
+ 79,
83
+ 80,
84
+ 81,
85
+ 82,
86
+ 83,
87
+ 84,
88
+ 85,
89
+ 86,
90
+ 87,
91
+ 88,
92
+ 89,
93
+ 90,
94
+ 91,
95
+ 92,
96
+ 93,
97
+ 94,
98
+ 95,
99
+ 96,
100
+ 97,
101
+ 98,
102
+ 99,
103
+ 100,
104
+ 101,
105
+ 102,
106
+ 103,
107
+ 104,
108
+ 105,
109
+ 106,
110
+ 107,
111
+ 108,
112
+ 109,
113
+ 110,
114
+ 111,
115
+ 112,
116
+ 113,
117
+ 114,
118
+ 115,
119
+ 116,
120
+ 117,
121
+ 118,
122
+ 119,
123
+ 120,
124
+ 121,
125
+ 122,
126
+ 123,
127
+ 124,
128
+ 125,
129
+ 126,
130
+ 127,
131
+ 128,
132
+ 129,
133
+ 130,
134
+ 131,
135
+ 132,
136
+ 133,
137
+ 134,
138
+ 135,
139
+ 136,
140
+ 137,
141
+ 138,
142
+ 139,
143
+ 140,
144
+ 141,
145
+ 142,
146
+ 143,
147
+ 144,
148
+ 145,
149
+ 146,
150
+ 147,
151
+ 148,
152
+ 149,
153
+ 150,
154
+ 151,
155
+ 152,
156
+ 153,
157
+ 154,
158
+ 155,
159
+ 156,
160
+ 157,
161
+ 158,
162
+ 159,
163
+ 160,
164
+ 161,
165
+ 162,
166
+ 163,
167
+ 164,
168
+ 165,
169
+ 166,
170
+ 167,
171
+ 168,
172
+ 169,
173
+ 170,
174
+ 171,
175
+ 172,
176
+ 173,
177
+ 174,
178
+ 175,
179
+ 176,
180
+ 177,
181
+ 178,
182
+ 179,
183
+ 180,
184
+ 181,
185
+ 182,
186
+ 183,
187
+ 184,
188
+ 185,
189
+ 186,
190
+ 187,
191
+ 188,
192
+ 189,
193
+ 190,
194
+ 191,
195
+ 192,
196
+ 193,
197
+ 194,
198
+ 195,
199
+ 196,
200
+ 197,
201
+ 198,
202
+ 199,
203
+ 200,
204
+ 201,
205
+ 202,
206
+ 203,
207
+ 204,
208
+ 205,
209
+ 206,
210
+ 207,
211
+ 208,
212
+ 209,
213
+ 210,
214
+ 211,
215
+ 212,
216
+ 213,
217
+ 214,
218
+ 215,
219
+ 216,
220
+ 217,
221
+ 218,
222
+ 219,
223
+ 220,
224
+ 221,
225
+ 222,
226
+ 223,
227
+ 224,
228
+ 225,
229
+ 226,
230
+ 227,
231
+ 228,
232
+ 229,
233
+ 230,
234
+ 231,
235
+ 232,
236
+ 233,
237
+ 234,
238
+ 235,
239
+ 236,
240
+ 237,
241
+ 238,
242
+ 239,
243
+ 240,
244
+ 241,
245
+ 242,
246
+ 243,
247
+ 244,
248
+ 245,
249
+ 246,
250
+ 247,
251
+ 248,
252
+ 249,
253
+ 250,
254
+ 251,
255
+ 252,
256
+ 253,
257
+ 254,
258
+ 255,
259
+ 256,
260
+ 257,
261
+ 258,
262
+ 259,
263
+ 260,
264
+ 261,
265
+ 262,
266
+ 263,
267
+ 264,
268
+ 265,
269
+ 266,
270
+ 267,
271
+ 268,
272
+ 269,
273
+ 270,
274
+ 271,
275
+ 272,
276
+ 273,
277
+ 274,
278
+ 275,
279
+ 276,
280
+ 277,
281
+ 278,
282
+ 279,
283
+ 280,
284
+ 281,
285
+ 282,
286
+ 283,
287
+ 284,
288
+ 285,
289
+ 286,
290
+ 287,
291
+ 288,
292
+ 289,
293
+ 290,
294
+ 291,
295
+ 292,
296
+ 293,
297
+ 294,
298
+ 295,
299
+ 296,
300
+ 297,
301
+ 298,
302
+ 299,
303
+ 300,
304
+ 301,
305
+ 302,
306
+ 303,
307
+ 304,
308
+ 305,
309
+ 306,
310
+ 307,
311
+ 308,
312
+ 309,
313
+ 310,
314
+ 311,
315
+ 312,
316
+ 313,
317
+ 314,
318
+ 315,
319
+ 316,
320
+ 317,
321
+ 318,
322
+ 319,
323
+ 320,
324
+ 321,
325
+ 322,
326
+ 323,
327
+ 324,
328
+ 325,
329
+ 326,
330
+ 327,
331
+ 328,
332
+ 329,
333
+ 330,
334
+ 331,
335
+ 332,
336
+ 333,
337
+ 334,
338
+ 335,
339
+ 336,
340
+ 337,
341
+ 338,
342
+ 339,
343
+ 340,
344
+ 341,
345
+ 342,
346
+ 343,
347
+ 344,
348
+ 345,
349
+ 346,
350
+ 347,
351
+ 348,
352
+ 349,
353
+ 350,
354
+ 351,
355
+ 352,
356
+ 353,
357
+ 354,
358
+ 355,
359
+ 356,
360
+ 357,
361
+ 358,
362
+ 359,
363
+ 360,
364
+ 361,
365
+ 362,
366
+ 363,
367
+ 364,
368
+ 365,
369
+ 366,
370
+ 367,
371
+ 368,
372
+ 369,
373
+ 370,
374
+ 371,
375
+ 372,
376
+ 373,
377
+ 374,
378
+ 375,
379
+ 376,
380
+ 377,
381
+ 378,
382
+ 379,
383
+ 380,
384
+ 381,
385
+ 382,
386
+ 383,
387
+ 384,
388
+ 385,
389
+ 386,
390
+ 387,
391
+ 388,
392
+ 389,
393
+ 390,
394
+ 391,
395
+ 392,
396
+ 393,
397
+ 394,
398
+ 395,
399
+ 396,
400
+ 397,
401
+ 398,
402
+ 399,
403
+ 400,
404
+ 401,
405
+ 402,
406
+ 403,
407
+ 404,
408
+ 405,
409
+ 406,
410
+ 407,
411
+ 408,
412
+ 409,
413
+ 410,
414
+ 411,
415
+ 412,
416
+ 413,
417
+ 414,
418
+ 415,
419
+ 416,
420
+ 417,
421
+ 418,
422
+ 419,
423
+ 420,
424
+ 421,
425
+ 422,
426
+ 423,
427
+ 424,
428
+ 425,
429
+ 426,
430
+ 427,
431
+ 428,
432
+ 429,
433
+ 430,
434
+ 431,
435
+ 432,
436
+ 433,
437
+ 434,
438
+ 435,
439
+ 436,
440
+ 437,
441
+ 438,
442
+ 439,
443
+ 440,
444
+ 441,
445
+ 442,
446
+ 443,
447
+ 444,
448
+ 445,
449
+ 446,
450
+ 447,
451
+ 448,
452
+ 449,
453
+ 450,
454
+ 451,
455
+ 452,
456
+ 453,
457
+ 454,
458
+ 455,
459
+ 456,
460
+ 457,
461
+ 458,
462
+ 459,
463
+ 460,
464
+ 461,
465
+ 462,
466
+ 463,
467
+ 464,
468
+ 465,
469
+ 466,
470
+ 467,
471
+ 468,
472
+ 469,
473
+ 470,
474
+ 471,
475
+ 472,
476
+ 473,
477
+ 474,
478
+ 475,
479
+ 476,
480
+ 477,
481
+ 478,
482
+ 479,
483
+ 480,
484
+ 481,
485
+ 482,
486
+ 483,
487
+ 484,
488
+ 485,
489
+ 486,
490
+ 487,
491
+ 488,
492
+ 489,
493
+ 490,
494
+ 491,
495
+ 492,
496
+ 493,
497
+ 494,
498
+ 495,
499
+ 496,
500
+ 497,
501
+ 498,
502
+ 499,
503
+ 500,
504
+ 501,
505
+ 502,
506
+ 503,
507
+ 504,
508
+ 505,
509
+ 506,
510
+ 507,
511
+ 508,
512
+ 509,
513
+ 510,
514
+ 511,
515
+ 512,
516
+ 513,
517
+ 514,
518
+ 515,
519
+ 516,
520
+ 517,
521
+ 518,
522
+ 519,
523
+ 520,
524
+ 521,
525
+ 522,
526
+ 523,
527
+ 524,
528
+ 525,
529
+ 526,
530
+ 527,
531
+ 528,
532
+ 529,
533
+ 530,
534
+ 531,
535
+ 532,
536
+ 533,
537
+ 534,
538
+ 535,
539
+ 536
540
+ ],
541
+ "losses": [
542
+ 116.5,
543
+ 51.0,
544
+ 52.75,
545
+ 39.0,
546
+ 31.25,
547
+ 24.25,
548
+ 18.625,
549
+ 14.6875,
550
+ 12.25,
551
+ 11.125,
552
+ 10.4375,
553
+ 10.25,
554
+ 9.875,
555
+ 9.9375,
556
+ 9.8125,
557
+ 9.6875,
558
+ 9.5,
559
+ 9.375,
560
+ 9.25,
561
+ 9.125,
562
+ 9.125,
563
+ 9.0,
564
+ 9.0,
565
+ 8.875,
566
+ 8.875,
567
+ 8.875,
568
+ 8.8125,
569
+ 8.8125,
570
+ 8.8125,
571
+ 8.75,
572
+ 8.75,
573
+ 8.75,
574
+ 8.6875,
575
+ 8.6875,
576
+ 8.6875,
577
+ 8.6875,
578
+ 8.625,
579
+ 8.625,
580
+ 8.5625,
581
+ 8.625,
582
+ 8.5625,
583
+ 8.5625,
584
+ 8.5625,
585
+ 8.5,
586
+ 8.5,
587
+ 8.5,
588
+ 8.5625,
589
+ 8.5,
590
+ 8.5,
591
+ 8.5,
592
+ 8.5625,
593
+ 8.5,
594
+ 8.5625,
595
+ 8.5,
596
+ 8.5625,
597
+ 8.5,
598
+ 8.5,
599
+ 8.5,
600
+ 8.5,
601
+ 8.4375,
602
+ 8.5,
603
+ 8.5,
604
+ 8.4375,
605
+ 8.5,
606
+ 8.5,
607
+ 8.4375,
608
+ 8.5,
609
+ 8.5,
610
+ 8.4375,
611
+ 8.5,
612
+ 8.5,
613
+ 8.4375,
614
+ 8.5,
615
+ 8.4375,
616
+ 8.4375,
617
+ 8.5,
618
+ 8.5,
619
+ 8.4375,
620
+ 8.5,
621
+ 8.5,
622
+ 8.4375,
623
+ 8.4375,
624
+ 8.4375,
625
+ 8.5,
626
+ 8.5,
627
+ 8.5,
628
+ 8.5,
629
+ 8.5,
630
+ 8.5,
631
+ 8.5,
632
+ 8.5,
633
+ 8.4375,
634
+ 8.5,
635
+ 8.5,
636
+ 8.4375,
637
+ 8.4375,
638
+ 8.4375,
639
+ 8.4375,
640
+ 8.4375,
641
+ 8.4375,
642
+ 8.5,
643
+ 8.4375,
644
+ 8.5,
645
+ 8.4375,
646
+ 8.5,
647
+ 8.5,
648
+ 8.4375,
649
+ 8.5,
650
+ 8.5,
651
+ 8.5,
652
+ 8.5,
653
+ 8.4375,
654
+ 8.4375,
655
+ 8.5,
656
+ 8.4375,
657
+ 8.5,
658
+ 8.4375,
659
+ 8.5,
660
+ 8.4375,
661
+ 8.4375,
662
+ 8.5,
663
+ 8.5,
664
+ 8.5,
665
+ 8.4375,
666
+ 8.4375,
667
+ 8.5,
668
+ 8.4375,
669
+ 8.5,
670
+ 8.5,
671
+ 8.4375,
672
+ 8.5,
673
+ 8.4375,
674
+ 8.5,
675
+ 8.4375,
676
+ 8.4375,
677
+ 8.4375,
678
+ 8.4375,
679
+ 8.4375,
680
+ 8.5,
681
+ 8.5,
682
+ 8.4375,
683
+ 8.4375,
684
+ 8.5,
685
+ 8.5,
686
+ 8.5,
687
+ 8.4375,
688
+ 8.5,
689
+ 8.4375,
690
+ 8.5,
691
+ 8.5,
692
+ 8.4375,
693
+ 8.4375,
694
+ 8.5,
695
+ 8.4375,
696
+ 8.5,
697
+ 8.4375,
698
+ 8.4375,
699
+ 8.4375,
700
+ 8.4375,
701
+ 8.5,
702
+ 8.4375,
703
+ 8.4375,
704
+ 8.4375,
705
+ 8.5,
706
+ 8.4375,
707
+ 8.4375,
708
+ 8.4375,
709
+ 8.4375,
710
+ 8.4375,
711
+ 8.4375,
712
+ 8.4375,
713
+ 8.4375,
714
+ 8.4375,
715
+ 8.4375,
716
+ 8.4375,
717
+ 8.5,
718
+ 8.5,
719
+ 8.4375,
720
+ 8.4375,
721
+ 8.4375,
722
+ 8.5,
723
+ 8.4375,
724
+ 8.4375,
725
+ 8.4375,
726
+ 8.4375,
727
+ 8.5,
728
+ 8.5,
729
+ 8.5,
730
+ 8.4375,
731
+ 8.4375,
732
+ 8.5,
733
+ 8.5,
734
+ 8.4375,
735
+ 8.4375,
736
+ 8.4375,
737
+ 8.5,
738
+ 8.4375,
739
+ 8.4375,
740
+ 8.4375,
741
+ 8.4375,
742
+ 8.4375,
743
+ 8.4375,
744
+ 8.5,
745
+ 8.5,
746
+ 8.5,
747
+ 8.4375,
748
+ 8.4375,
749
+ 8.4375,
750
+ 8.4375,
751
+ 8.5,
752
+ 8.4375,
753
+ 8.5,
754
+ 8.4375,
755
+ 8.5,
756
+ 8.5,
757
+ 8.4375,
758
+ 8.5,
759
+ 8.4375,
760
+ 8.4375,
761
+ 8.4375,
762
+ 8.4375,
763
+ 8.375,
764
+ 8.4375,
765
+ 8.4375,
766
+ 8.4375,
767
+ 8.4375,
768
+ 8.4375,
769
+ 8.5,
770
+ 8.4375,
771
+ 8.4375,
772
+ 8.5,
773
+ 8.5,
774
+ 8.4375,
775
+ 8.4375,
776
+ 8.5,
777
+ 8.5,
778
+ 8.5,
779
+ 8.5,
780
+ 8.4375,
781
+ 8.5,
782
+ 8.5,
783
+ 8.4375,
784
+ 8.4375,
785
+ 8.4375,
786
+ 8.5,
787
+ 8.5,
788
+ 8.4375,
789
+ 8.4375,
790
+ 8.4375,
791
+ 8.4375,
792
+ 8.4375,
793
+ 8.5,
794
+ 8.5,
795
+ 8.5,
796
+ 8.4375,
797
+ 8.4375,
798
+ 8.4375,
799
+ 8.4375,
800
+ 8.4375,
801
+ 8.4375,
802
+ 8.4375,
803
+ 8.4375,
804
+ 8.4375,
805
+ 8.375,
806
+ 8.4375,
807
+ 8.4375,
808
+ 8.4375,
809
+ 8.4375,
810
+ 8.4375,
811
+ 8.5,
812
+ 8.4375,
813
+ 8.4375,
814
+ 8.4375,
815
+ 8.4375,
816
+ 8.4375,
817
+ 8.4375,
818
+ 8.4375,
819
+ 8.4375,
820
+ 8.4375,
821
+ 8.4375,
822
+ 8.5,
823
+ 8.4375,
824
+ 8.4375,
825
+ 8.4375,
826
+ 8.4375,
827
+ 8.5,
828
+ 8.4375,
829
+ 8.4375,
830
+ 8.4375,
831
+ 8.4375,
832
+ 8.4375,
833
+ 8.5,
834
+ 8.4375,
835
+ 8.4375,
836
+ 8.4375,
837
+ 8.4375,
838
+ 8.4375,
839
+ 8.4375,
840
+ 8.4375,
841
+ 8.4375,
842
+ 8.4375,
843
+ 8.5,
844
+ 8.4375,
845
+ 8.375,
846
+ 8.4375,
847
+ 8.375,
848
+ 8.4375,
849
+ 8.5,
850
+ 8.4375,
851
+ 8.4375,
852
+ 8.4375,
853
+ 8.5,
854
+ 8.4375,
855
+ 8.4375,
856
+ 8.4375,
857
+ 8.4375,
858
+ 8.4375,
859
+ 8.4375,
860
+ 8.4375,
861
+ 8.375,
862
+ 8.4375,
863
+ 8.4375,
864
+ 8.5,
865
+ 8.4375,
866
+ 8.5,
867
+ 8.4375,
868
+ 8.4375,
869
+ 8.4375,
870
+ 8.4375,
871
+ 8.4375,
872
+ 8.4375,
873
+ 8.375,
874
+ 8.5,
875
+ 8.375,
876
+ 8.375,
877
+ 8.5,
878
+ 8.4375,
879
+ 8.4375,
880
+ 8.4375,
881
+ 8.5,
882
+ 8.4375,
883
+ 8.5,
884
+ 8.4375,
885
+ 8.4375,
886
+ 8.4375,
887
+ 8.4375,
888
+ 8.375,
889
+ 8.5,
890
+ 8.4375,
891
+ 8.4375,
892
+ 8.4375,
893
+ 8.4375,
894
+ 8.4375,
895
+ 8.4375,
896
+ 8.4375,
897
+ 8.4375,
898
+ 8.4375,
899
+ 8.4375,
900
+ 8.4375,
901
+ 8.4375,
902
+ 8.375,
903
+ 8.4375,
904
+ 8.4375,
905
+ 8.4375,
906
+ 8.4375,
907
+ 8.5,
908
+ 8.4375,
909
+ 8.4375,
910
+ 8.4375,
911
+ 8.4375,
912
+ 8.4375,
913
+ 8.4375,
914
+ 8.4375,
915
+ 8.4375,
916
+ 8.5,
917
+ 8.4375,
918
+ 8.5,
919
+ 8.4375,
920
+ 8.4375,
921
+ 8.4375,
922
+ 8.4375,
923
+ 8.4375,
924
+ 8.4375,
925
+ 8.4375,
926
+ 8.5,
927
+ 8.4375,
928
+ 8.375,
929
+ 8.4375,
930
+ 8.5,
931
+ 8.4375,
932
+ 8.5,
933
+ 8.4375,
934
+ 8.4375,
935
+ 8.4375,
936
+ 8.4375,
937
+ 8.4375,
938
+ 8.4375,
939
+ 8.5,
940
+ 8.375,
941
+ 8.4375,
942
+ 8.4375,
943
+ 8.5,
944
+ 8.4375,
945
+ 8.4375,
946
+ 8.4375,
947
+ 8.4375,
948
+ 8.4375,
949
+ 8.4375,
950
+ 8.375,
951
+ 8.375,
952
+ 8.4375,
953
+ 8.4375,
954
+ 8.4375,
955
+ 8.4375,
956
+ 8.4375,
957
+ 8.4375,
958
+ 8.4375,
959
+ 8.375,
960
+ 8.4375,
961
+ 8.4375,
962
+ 8.4375,
963
+ 8.4375,
964
+ 8.4375,
965
+ 8.4375,
966
+ 8.4375,
967
+ 8.4375,
968
+ 8.4375,
969
+ 8.4375,
970
+ 8.4375,
971
+ 8.4375,
972
+ 8.4375,
973
+ 8.375,
974
+ 8.4375,
975
+ 8.375,
976
+ 8.4375,
977
+ 8.4375,
978
+ 8.375,
979
+ 8.4375,
980
+ 8.4375,
981
+ 8.4375,
982
+ 8.4375,
983
+ 8.4375,
984
+ 8.375,
985
+ 8.4375,
986
+ 8.4375,
987
+ 8.5,
988
+ 8.375,
989
+ 8.4375,
990
+ 8.4375,
991
+ 8.375,
992
+ 8.4375,
993
+ 8.375,
994
+ 8.4375,
995
+ 8.4375,
996
+ 8.4375,
997
+ 8.4375,
998
+ 8.4375,
999
+ 8.4375,
1000
+ 8.4375,
1001
+ 8.4375,
1002
+ 8.4375,
1003
+ 8.4375,
1004
+ 8.375,
1005
+ 8.4375,
1006
+ 8.4375,
1007
+ 8.4375,
1008
+ 8.4375,
1009
+ 8.4375,
1010
+ 8.4375,
1011
+ 8.4375,
1012
+ 8.4375,
1013
+ 8.4375,
1014
+ 8.4375,
1015
+ 8.4375,
1016
+ 8.4375,
1017
+ 8.4375,
1018
+ 8.4375,
1019
+ 8.4375,
1020
+ 8.4375,
1021
+ 8.375,
1022
+ 8.4375,
1023
+ 8.4375,
1024
+ 8.4375,
1025
+ 8.4375,
1026
+ 8.4375,
1027
+ 8.4375,
1028
+ 8.5,
1029
+ 8.4375,
1030
+ 8.375,
1031
+ 8.375,
1032
+ 8.4375,
1033
+ 8.4375,
1034
+ 8.4375,
1035
+ 8.4375,
1036
+ 8.4375,
1037
+ 8.4375,
1038
+ 8.4375,
1039
+ 8.4375,
1040
+ 8.4375,
1041
+ 8.4375,
1042
+ 8.4375,
1043
+ 8.4375,
1044
+ 8.4375,
1045
+ 8.4375,
1046
+ 8.4375,
1047
+ 8.375,
1048
+ 8.4375,
1049
+ 8.375,
1050
+ 8.4375,
1051
+ 8.4375,
1052
+ 8.4375,
1053
+ 8.4375,
1054
+ 8.4375,
1055
+ 8.4375,
1056
+ 8.375,
1057
+ 8.5,
1058
+ 8.4375,
1059
+ 8.4375,
1060
+ 8.4375,
1061
+ 8.4375,
1062
+ 8.4375,
1063
+ 8.4375,
1064
+ 8.375,
1065
+ 8.4375,
1066
+ 8.4375,
1067
+ 8.4375,
1068
+ 8.4375,
1069
+ 8.4375,
1070
+ 8.375,
1071
+ 8.4375,
1072
+ 8.4375,
1073
+ 8.375,
1074
+ 8.4375,
1075
+ 8.4375,
1076
+ 8.4375,
1077
+ 8.4375
1078
+ ],
1079
+ "grad_norms": [
1080
+ 28.5,
1081
+ 22.125,
1082
+ 22.75,
1083
+ 10.9375,
1084
+ 7.3125,
1085
+ 4.625,
1086
+ 3.171875,
1087
+ 1.9765625,
1088
+ 2.4375,
1089
+ 2.28125,
1090
+ 1.9765625,
1091
+ 1.71875,
1092
+ 1.5703125,
1093
+ 1.3984375,
1094
+ 1.296875,
1095
+ 1.0859375,
1096
+ 1.1015625,
1097
+ 0.94140625,
1098
+ 0.64453125,
1099
+ 0.6015625,
1100
+ 0.63671875,
1101
+ 0.64453125,
1102
+ 0.55859375,
1103
+ 0.59765625,
1104
+ 0.55078125,
1105
+ 0.53125,
1106
+ 0.498046875,
1107
+ 0.51953125,
1108
+ 0.423828125,
1109
+ 0.47265625,
1110
+ 0.390625,
1111
+ 0.330078125,
1112
+ 0.34765625,
1113
+ 0.408203125,
1114
+ 0.39453125,
1115
+ 0.318359375,
1116
+ 0.298828125,
1117
+ 0.2236328125,
1118
+ 0.275390625,
1119
+ 0.30859375,
1120
+ 0.26171875,
1121
+ 0.3125,
1122
+ 0.26171875,
1123
+ 0.275390625,
1124
+ 0.240234375,
1125
+ 0.2109375,
1126
+ 0.25,
1127
+ 0.302734375,
1128
+ 0.189453125,
1129
+ 0.2333984375,
1130
+ 0.2265625,
1131
+ 0.26953125,
1132
+ 0.21875,
1133
+ 0.21875,
1134
+ 0.26953125,
1135
+ 0.291015625,
1136
+ 0.2451171875,
1137
+ 0.451171875,
1138
+ 0.224609375,
1139
+ 0.3828125,
1140
+ 0.220703125,
1141
+ 0.2431640625,
1142
+ 0.2099609375,
1143
+ 0.19140625,
1144
+ 0.29296875,
1145
+ 0.26171875,
1146
+ 0.271484375,
1147
+ 0.201171875,
1148
+ 0.2158203125,
1149
+ 0.302734375,
1150
+ 0.2392578125,
1151
+ 0.19140625,
1152
+ 0.208984375,
1153
+ 0.28515625,
1154
+ 0.29296875,
1155
+ 0.2578125,
1156
+ 0.1796875,
1157
+ 0.388671875,
1158
+ 0.294921875,
1159
+ 0.1435546875,
1160
+ 0.2734375,
1161
+ 0.3046875,
1162
+ 0.2451171875,
1163
+ 0.232421875,
1164
+ 0.150390625,
1165
+ 0.259765625,
1166
+ 0.21875,
1167
+ 0.173828125,
1168
+ 0.2060546875,
1169
+ 0.1650390625,
1170
+ 0.2451171875,
1171
+ 0.1953125,
1172
+ 0.1875,
1173
+ 0.17578125,
1174
+ 0.1591796875,
1175
+ 0.138671875,
1176
+ 0.14453125,
1177
+ 0.208984375,
1178
+ 0.19140625,
1179
+ 0.26953125,
1180
+ 0.234375,
1181
+ 0.154296875,
1182
+ 0.2265625,
1183
+ 0.21875,
1184
+ 0.138671875,
1185
+ 0.2314453125,
1186
+ 0.400390625,
1187
+ 0.27734375,
1188
+ 0.2109375,
1189
+ 0.29296875,
1190
+ 0.1650390625,
1191
+ 0.1904296875,
1192
+ 0.19140625,
1193
+ 0.373046875,
1194
+ 0.1689453125,
1195
+ 0.365234375,
1196
+ 0.2392578125,
1197
+ 0.3671875,
1198
+ 0.2138671875,
1199
+ 0.451171875,
1200
+ 0.373046875,
1201
+ 0.287109375,
1202
+ 0.396484375,
1203
+ 0.1982421875,
1204
+ 0.337890625,
1205
+ 0.2158203125,
1206
+ 0.4609375,
1207
+ 0.431640625,
1208
+ 0.205078125,
1209
+ 0.51953125,
1210
+ 0.359375,
1211
+ 0.36328125,
1212
+ 0.359375,
1213
+ 0.251953125,
1214
+ 0.40625,
1215
+ 0.28125,
1216
+ 0.458984375,
1217
+ 0.3125,
1218
+ 0.54296875,
1219
+ 0.1845703125,
1220
+ 0.54296875,
1221
+ 0.2138671875,
1222
+ 0.6796875,
1223
+ 0.177734375,
1224
+ 0.64453125,
1225
+ 0.28515625,
1226
+ 0.498046875,
1227
+ 0.333984375,
1228
+ 0.41015625,
1229
+ 0.3359375,
1230
+ 0.337890625,
1231
+ 0.341796875,
1232
+ 0.2158203125,
1233
+ 0.22265625,
1234
+ 0.2373046875,
1235
+ 0.287109375,
1236
+ 0.2080078125,
1237
+ 0.1484375,
1238
+ 0.2373046875,
1239
+ 0.21484375,
1240
+ 0.1572265625,
1241
+ 0.2734375,
1242
+ 0.154296875,
1243
+ 0.193359375,
1244
+ 0.26953125,
1245
+ 0.232421875,
1246
+ 0.1552734375,
1247
+ 0.23046875,
1248
+ 0.265625,
1249
+ 0.2255859375,
1250
+ 0.1875,
1251
+ 0.275390625,
1252
+ 0.220703125,
1253
+ 0.251953125,
1254
+ 0.3984375,
1255
+ 0.291015625,
1256
+ 0.1806640625,
1257
+ 0.248046875,
1258
+ 0.267578125,
1259
+ 0.1826171875,
1260
+ 0.25,
1261
+ 0.2099609375,
1262
+ 0.203125,
1263
+ 0.1728515625,
1264
+ 0.2158203125,
1265
+ 0.1748046875,
1266
+ 0.203125,
1267
+ 0.2412109375,
1268
+ 0.21875,
1269
+ 0.2041015625,
1270
+ 0.1748046875,
1271
+ 0.259765625,
1272
+ 0.310546875,
1273
+ 0.373046875,
1274
+ 0.1884765625,
1275
+ 0.28515625,
1276
+ 0.19140625,
1277
+ 0.41015625,
1278
+ 0.3671875,
1279
+ 0.27734375,
1280
+ 0.5078125,
1281
+ 0.2236328125,
1282
+ 0.2158203125,
1283
+ 0.205078125,
1284
+ 0.23046875,
1285
+ 0.171875,
1286
+ 0.203125,
1287
+ 0.2470703125,
1288
+ 0.2119140625,
1289
+ 0.2431640625,
1290
+ 0.1767578125,
1291
+ 0.1806640625,
1292
+ 0.244140625,
1293
+ 0.2431640625,
1294
+ 0.1884765625,
1295
+ 0.359375,
1296
+ 0.6875,
1297
+ 0.345703125,
1298
+ 0.458984375,
1299
+ 0.7109375,
1300
+ 0.30078125,
1301
+ 0.466796875,
1302
+ 0.609375,
1303
+ 0.22265625,
1304
+ 0.53125,
1305
+ 0.37109375,
1306
+ 0.181640625,
1307
+ 0.306640625,
1308
+ 0.228515625,
1309
+ 0.357421875,
1310
+ 0.1865234375,
1311
+ 0.4609375,
1312
+ 0.2060546875,
1313
+ 0.60546875,
1314
+ 0.55078125,
1315
+ 0.271484375,
1316
+ 0.828125,
1317
+ 0.68359375,
1318
+ 0.2734375,
1319
+ 0.859375,
1320
+ 0.63671875,
1321
+ 0.34375,
1322
+ 0.671875,
1323
+ 0.228515625,
1324
+ 0.546875,
1325
+ 0.458984375,
1326
+ 0.279296875,
1327
+ 0.5078125,
1328
+ 0.41796875,
1329
+ 0.302734375,
1330
+ 0.53515625,
1331
+ 0.341796875,
1332
+ 0.2138671875,
1333
+ 0.376953125,
1334
+ 0.30078125,
1335
+ 0.31640625,
1336
+ 0.345703125,
1337
+ 0.251953125,
1338
+ 0.23046875,
1339
+ 0.314453125,
1340
+ 0.220703125,
1341
+ 0.27734375,
1342
+ 0.333984375,
1343
+ 0.306640625,
1344
+ 0.2578125,
1345
+ 0.244140625,
1346
+ 0.162109375,
1347
+ 0.330078125,
1348
+ 0.4296875,
1349
+ 0.208984375,
1350
+ 0.240234375,
1351
+ 0.1923828125,
1352
+ 0.1923828125,
1353
+ 0.1669921875,
1354
+ 0.220703125,
1355
+ 0.2158203125,
1356
+ 0.18359375,
1357
+ 0.1298828125,
1358
+ 0.25,
1359
+ 0.19921875,
1360
+ 0.33203125,
1361
+ 0.1865234375,
1362
+ 0.2890625,
1363
+ 0.177734375,
1364
+ 0.283203125,
1365
+ 0.2119140625,
1366
+ 0.392578125,
1367
+ 0.267578125,
1368
+ 0.41015625,
1369
+ 0.1923828125,
1370
+ 0.328125,
1371
+ 0.294921875,
1372
+ 0.1943359375,
1373
+ 0.19140625,
1374
+ 0.205078125,
1375
+ 0.1796875,
1376
+ 0.251953125,
1377
+ 0.1708984375,
1378
+ 0.248046875,
1379
+ 0.1923828125,
1380
+ 0.265625,
1381
+ 0.33203125,
1382
+ 0.185546875,
1383
+ 0.30859375,
1384
+ 0.34375,
1385
+ 0.205078125,
1386
+ 0.26953125,
1387
+ 0.2578125,
1388
+ 0.24609375,
1389
+ 0.19140625,
1390
+ 0.455078125,
1391
+ 0.21484375,
1392
+ 0.31640625,
1393
+ 0.3359375,
1394
+ 0.251953125,
1395
+ 0.359375,
1396
+ 0.203125,
1397
+ 0.302734375,
1398
+ 0.1953125,
1399
+ 0.28515625,
1400
+ 0.2119140625,
1401
+ 0.259765625,
1402
+ 0.2431640625,
1403
+ 0.30078125,
1404
+ 0.2578125,
1405
+ 0.271484375,
1406
+ 0.1904296875,
1407
+ 0.265625,
1408
+ 0.25,
1409
+ 0.244140625,
1410
+ 0.1875,
1411
+ 0.302734375,
1412
+ 0.400390625,
1413
+ 0.201171875,
1414
+ 0.310546875,
1415
+ 0.271484375,
1416
+ 0.2294921875,
1417
+ 0.1533203125,
1418
+ 0.265625,
1419
+ 0.1875,
1420
+ 0.33984375,
1421
+ 0.361328125,
1422
+ 0.341796875,
1423
+ 0.33984375,
1424
+ 0.283203125,
1425
+ 0.306640625,
1426
+ 0.2041015625,
1427
+ 0.306640625,
1428
+ 0.2080078125,
1429
+ 0.1552734375,
1430
+ 0.1796875,
1431
+ 0.1953125,
1432
+ 0.2138671875,
1433
+ 0.27734375,
1434
+ 0.1669921875,
1435
+ 0.3359375,
1436
+ 0.1572265625,
1437
+ 0.3046875,
1438
+ 0.1767578125,
1439
+ 0.4140625,
1440
+ 0.2001953125,
1441
+ 0.3828125,
1442
+ 0.2373046875,
1443
+ 0.396484375,
1444
+ 0.2265625,
1445
+ 0.3203125,
1446
+ 0.263671875,
1447
+ 0.1943359375,
1448
+ 0.443359375,
1449
+ 0.3046875,
1450
+ 0.35546875,
1451
+ 0.1923828125,
1452
+ 0.408203125,
1453
+ 0.2294921875,
1454
+ 0.388671875,
1455
+ 0.1748046875,
1456
+ 0.294921875,
1457
+ 0.171875,
1458
+ 0.29296875,
1459
+ 0.263671875,
1460
+ 0.306640625,
1461
+ 0.16015625,
1462
+ 0.34375,
1463
+ 0.228515625,
1464
+ 0.2236328125,
1465
+ 0.1435546875,
1466
+ 0.265625,
1467
+ 0.19921875,
1468
+ 0.2109375,
1469
+ 0.1533203125,
1470
+ 0.423828125,
1471
+ 0.365234375,
1472
+ 0.2314453125,
1473
+ 0.39453125,
1474
+ 0.1708984375,
1475
+ 0.396484375,
1476
+ 0.173828125,
1477
+ 0.380859375,
1478
+ 0.30859375,
1479
+ 0.197265625,
1480
+ 0.26171875,
1481
+ 0.287109375,
1482
+ 0.3046875,
1483
+ 0.318359375,
1484
+ 0.173828125,
1485
+ 0.1806640625,
1486
+ 0.27734375,
1487
+ 0.2119140625,
1488
+ 0.1748046875,
1489
+ 0.21875,
1490
+ 0.1806640625,
1491
+ 0.1708984375,
1492
+ 0.16015625,
1493
+ 0.1279296875,
1494
+ 0.1943359375,
1495
+ 0.169921875,
1496
+ 0.1259765625,
1497
+ 0.2080078125,
1498
+ 0.1337890625,
1499
+ 0.1474609375,
1500
+ 0.162109375,
1501
+ 0.154296875,
1502
+ 0.12353515625,
1503
+ 0.1572265625,
1504
+ 0.1396484375,
1505
+ 0.1484375,
1506
+ 0.1455078125,
1507
+ 0.1474609375,
1508
+ 0.2373046875,
1509
+ 0.2080078125,
1510
+ 0.265625,
1511
+ 0.26171875,
1512
+ 0.17578125,
1513
+ 0.146484375,
1514
+ 0.287109375,
1515
+ 0.177734375,
1516
+ 0.2099609375,
1517
+ 0.15234375,
1518
+ 0.197265625,
1519
+ 0.1806640625,
1520
+ 0.13671875,
1521
+ 0.126953125,
1522
+ 0.15234375,
1523
+ 0.18359375,
1524
+ 0.11279296875,
1525
+ 0.255859375,
1526
+ 0.142578125,
1527
+ 0.2060546875,
1528
+ 0.1982421875,
1529
+ 0.1826171875,
1530
+ 0.154296875,
1531
+ 0.177734375,
1532
+ 0.2060546875,
1533
+ 0.15625,
1534
+ 0.1416015625,
1535
+ 0.1533203125,
1536
+ 0.201171875,
1537
+ 0.1533203125,
1538
+ 0.158203125,
1539
+ 0.181640625,
1540
+ 0.1748046875,
1541
+ 0.1455078125,
1542
+ 0.123046875,
1543
+ 0.130859375,
1544
+ 0.14453125,
1545
+ 0.12109375,
1546
+ 0.1552734375,
1547
+ 0.0986328125,
1548
+ 0.16796875,
1549
+ 0.2373046875,
1550
+ 0.1630859375,
1551
+ 0.1826171875,
1552
+ 0.15234375,
1553
+ 0.17578125,
1554
+ 0.1640625,
1555
+ 0.1826171875,
1556
+ 0.11767578125,
1557
+ 0.17578125,
1558
+ 0.1689453125,
1559
+ 0.2490234375,
1560
+ 0.1904296875,
1561
+ 0.150390625,
1562
+ 0.2255859375,
1563
+ 0.1611328125,
1564
+ 0.1826171875,
1565
+ 0.1669921875,
1566
+ 0.1953125,
1567
+ 0.2353515625,
1568
+ 0.2109375,
1569
+ 0.189453125,
1570
+ 0.240234375,
1571
+ 0.251953125,
1572
+ 0.1474609375,
1573
+ 0.1376953125,
1574
+ 0.158203125,
1575
+ 0.2294921875,
1576
+ 0.119140625,
1577
+ 0.125,
1578
+ 0.1953125,
1579
+ 0.15625,
1580
+ 0.189453125,
1581
+ 0.162109375,
1582
+ 0.13671875,
1583
+ 0.18359375,
1584
+ 0.1982421875,
1585
+ 0.173828125,
1586
+ 0.1279296875,
1587
+ 0.134765625,
1588
+ 0.1708984375,
1589
+ 0.1201171875,
1590
+ 0.11474609375,
1591
+ 0.21875,
1592
+ 0.19140625,
1593
+ 0.1767578125,
1594
+ 0.17578125,
1595
+ 0.2294921875,
1596
+ 0.1708984375,
1597
+ 0.2431640625,
1598
+ 0.15625,
1599
+ 0.2177734375,
1600
+ 0.1669921875,
1601
+ 0.2041015625,
1602
+ 0.12353515625,
1603
+ 0.19140625,
1604
+ 0.18359375,
1605
+ 0.15625,
1606
+ 0.2275390625,
1607
+ 0.177734375,
1608
+ 0.150390625,
1609
+ 0.236328125,
1610
+ 0.1728515625,
1611
+ 0.205078125,
1612
+ 0.1884765625,
1613
+ 0.294921875,
1614
+ 0.2578125,
1615
+ 0.1689453125
1616
+ ]
1617
+ },
1618
+ "eval": {
1619
+ "effective_batch_nums": [
1620
+ 50,
1621
+ 100,
1622
+ 150,
1623
+ 200,
1624
+ 250,
1625
+ 300,
1626
+ 350,
1627
+ 400,
1628
+ 450,
1629
+ 500
1630
+ ],
1631
+ "losses": [
1632
+ 8.551470588235293,
1633
+ 8.496323529411764,
1634
+ 8.485294117647058,
1635
+ 8.485294117647058,
1636
+ 8.503676470588236,
1637
+ 8.481617647058824,
1638
+ 8.485294117647058,
1639
+ 8.492647058823529,
1640
+ 8.474264705882353,
1641
+ 8.466911764705882
1642
+ ],
1643
+ "perplexities": [
1644
+ 5199.058823529412,
1645
+ 4911.058823529412,
1646
+ 4856.470588235294,
1647
+ 4856.470588235294,
1648
+ 4950.588235294118,
1649
+ 4839.529411764706,
1650
+ 4856.470588235294,
1651
+ 4890.35294117647,
1652
+ 4805.64705882353,
1653
+ 4769.882352941177
1654
+ ],
1655
+ "accuracies": [
1656
+ 0.050909109305596306,
1657
+ 0.050909109305596306,
1658
+ 0.050909109305596306,
1659
+ 0.050909109305596306,
1660
+ 0.050909109305596306,
1661
+ 0.050909109305596306,
1662
+ 0.050909109305596306,
1663
+ 0.050909109305596306,
1664
+ 0.050767456214017584,
1665
+ 0.050909109305596306
1666
+ ]
1667
+ }
1668
+ }
uniform_42/epoch3/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17fa3f4090e918d4ae746052b3d2e2a0a0acdef1060677e920fefba065199a97
3
+ size 18206151
uniform_42/epoch3/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5555f26ac9720528bd8ed9887ab9a55bb18f9331b664860a7de89596dba0cac
3
+ size 36464267
uniform_42/epoch3/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:193854f81a2c85e3920a63dceadeb449822d3cb2a7f6eaeed9b1a17143624b89
3
+ size 1465
uniform_42/epoch3/tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
uniform_42/epoch3/tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": "<|endoftext|>",
3
+ "eos_token": "<|endoftext|>",
4
+ "pad_token": "<|endoftext|>",
5
+ "unk_token": "<|endoftext|>"
6
+ }
uniform_42/epoch3/tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
uniform_42/epoch3/tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "50256": {
5
+ "content": "<|endoftext|>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ }
12
+ },
13
+ "bos_token": "<|endoftext|>",
14
+ "clean_up_tokenization_spaces": false,
15
+ "eos_token": "<|endoftext|>",
16
+ "extra_special_tokens": {},
17
+ "model_max_length": 1024,
18
+ "pad_token": "<|endoftext|>",
19
+ "tokenizer_class": "GPT2Tokenizer",
20
+ "unk_token": "<|endoftext|>"
21
+ }
uniform_42/epoch3/tokenizer/vocab.json ADDED
The diff for this file is too large to render. See raw diff