Hugging Face's logo

smithblack-0
/
stage-one-v2

Model card Files
xet
 Community
smithblack-0 commited on
Commit
4e982f1
·
verified ·
1 Parent(s): f23f1d4

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. expdecayforward_123/epoch3/metadata.json +6 -0
  2. expdecayforward_123/epoch3/metrics.json +1668 -0
  3. expdecayforward_123/epoch3/model.pt +3 -0
  4. expdecayforward_123/epoch3/optimizer.pt +3 -0
  5. expdecayforward_123/epoch3/scheduler.pt +3 -0
  6. expdecayforward_123/epoch3/tokenizer/merges.txt +0 -0
  7. expdecayforward_123/epoch3/tokenizer/special_tokens_map.json +6 -0
  8. expdecayforward_123/epoch3/tokenizer/tokenizer.json +0 -0
  9. expdecayforward_123/epoch3/tokenizer/tokenizer_config.json +21 -0
  10. expdecayforward_123/epoch3/tokenizer/vocab.json +0 -0
expdecayforward_123/epoch3/metadata.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "epoch_num": 3,
3
+ "global_batch_num": 536,
4
+ "device": "cuda",
5
+ "dtype": "bfloat16"
6
+ }
expdecayforward_123/epoch3/metrics.json ADDED
@@ -0,0 +1,1668 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "training": {
3
+ "effective_batch_nums": [
4
+ 1,
5
+ 2,
6
+ 3,
7
+ 4,
8
+ 5,
9
+ 6,
10
+ 7,
11
+ 8,
12
+ 9,
13
+ 10,
14
+ 11,
15
+ 12,
16
+ 13,
17
+ 14,
18
+ 15,
19
+ 16,
20
+ 17,
21
+ 18,
22
+ 19,
23
+ 20,
24
+ 21,
25
+ 22,
26
+ 23,
27
+ 24,
28
+ 25,
29
+ 26,
30
+ 27,
31
+ 28,
32
+ 29,
33
+ 30,
34
+ 31,
35
+ 32,
36
+ 33,
37
+ 34,
38
+ 35,
39
+ 36,
40
+ 37,
41
+ 38,
42
+ 39,
43
+ 40,
44
+ 41,
45
+ 42,
46
+ 43,
47
+ 44,
48
+ 45,
49
+ 46,
50
+ 47,
51
+ 48,
52
+ 49,
53
+ 50,
54
+ 51,
55
+ 52,
56
+ 53,
57
+ 54,
58
+ 55,
59
+ 56,
60
+ 57,
61
+ 58,
62
+ 59,
63
+ 60,
64
+ 61,
65
+ 62,
66
+ 63,
67
+ 64,
68
+ 65,
69
+ 66,
70
+ 67,
71
+ 68,
72
+ 69,
73
+ 70,
74
+ 71,
75
+ 72,
76
+ 73,
77
+ 74,
78
+ 75,
79
+ 76,
80
+ 77,
81
+ 78,
82
+ 79,
83
+ 80,
84
+ 81,
85
+ 82,
86
+ 83,
87
+ 84,
88
+ 85,
89
+ 86,
90
+ 87,
91
+ 88,
92
+ 89,
93
+ 90,
94
+ 91,
95
+ 92,
96
+ 93,
97
+ 94,
98
+ 95,
99
+ 96,
100
+ 97,
101
+ 98,
102
+ 99,
103
+ 100,
104
+ 101,
105
+ 102,
106
+ 103,
107
+ 104,
108
+ 105,
109
+ 106,
110
+ 107,
111
+ 108,
112
+ 109,
113
+ 110,
114
+ 111,
115
+ 112,
116
+ 113,
117
+ 114,
118
+ 115,
119
+ 116,
120
+ 117,
121
+ 118,
122
+ 119,
123
+ 120,
124
+ 121,
125
+ 122,
126
+ 123,
127
+ 124,
128
+ 125,
129
+ 126,
130
+ 127,
131
+ 128,
132
+ 129,
133
+ 130,
134
+ 131,
135
+ 132,
136
+ 133,
137
+ 134,
138
+ 135,
139
+ 136,
140
+ 137,
141
+ 138,
142
+ 139,
143
+ 140,
144
+ 141,
145
+ 142,
146
+ 143,
147
+ 144,
148
+ 145,
149
+ 146,
150
+ 147,
151
+ 148,
152
+ 149,
153
+ 150,
154
+ 151,
155
+ 152,
156
+ 153,
157
+ 154,
158
+ 155,
159
+ 156,
160
+ 157,
161
+ 158,
162
+ 159,
163
+ 160,
164
+ 161,
165
+ 162,
166
+ 163,
167
+ 164,
168
+ 165,
169
+ 166,
170
+ 167,
171
+ 168,
172
+ 169,
173
+ 170,
174
+ 171,
175
+ 172,
176
+ 173,
177
+ 174,
178
+ 175,
179
+ 176,
180
+ 177,
181
+ 178,
182
+ 179,
183
+ 180,
184
+ 181,
185
+ 182,
186
+ 183,
187
+ 184,
188
+ 185,
189
+ 186,
190
+ 187,
191
+ 188,
192
+ 189,
193
+ 190,
194
+ 191,
195
+ 192,
196
+ 193,
197
+ 194,
198
+ 195,
199
+ 196,
200
+ 197,
201
+ 198,
202
+ 199,
203
+ 200,
204
+ 201,
205
+ 202,
206
+ 203,
207
+ 204,
208
+ 205,
209
+ 206,
210
+ 207,
211
+ 208,
212
+ 209,
213
+ 210,
214
+ 211,
215
+ 212,
216
+ 213,
217
+ 214,
218
+ 215,
219
+ 216,
220
+ 217,
221
+ 218,
222
+ 219,
223
+ 220,
224
+ 221,
225
+ 222,
226
+ 223,
227
+ 224,
228
+ 225,
229
+ 226,
230
+ 227,
231
+ 228,
232
+ 229,
233
+ 230,
234
+ 231,
235
+ 232,
236
+ 233,
237
+ 234,
238
+ 235,
239
+ 236,
240
+ 237,
241
+ 238,
242
+ 239,
243
+ 240,
244
+ 241,
245
+ 242,
246
+ 243,
247
+ 244,
248
+ 245,
249
+ 246,
250
+ 247,
251
+ 248,
252
+ 249,
253
+ 250,
254
+ 251,
255
+ 252,
256
+ 253,
257
+ 254,
258
+ 255,
259
+ 256,
260
+ 257,
261
+ 258,
262
+ 259,
263
+ 260,
264
+ 261,
265
+ 262,
266
+ 263,
267
+ 264,
268
+ 265,
269
+ 266,
270
+ 267,
271
+ 268,
272
+ 269,
273
+ 270,
274
+ 271,
275
+ 272,
276
+ 273,
277
+ 274,
278
+ 275,
279
+ 276,
280
+ 277,
281
+ 278,
282
+ 279,
283
+ 280,
284
+ 281,
285
+ 282,
286
+ 283,
287
+ 284,
288
+ 285,
289
+ 286,
290
+ 287,
291
+ 288,
292
+ 289,
293
+ 290,
294
+ 291,
295
+ 292,
296
+ 293,
297
+ 294,
298
+ 295,
299
+ 296,
300
+ 297,
301
+ 298,
302
+ 299,
303
+ 300,
304
+ 301,
305
+ 302,
306
+ 303,
307
+ 304,
308
+ 305,
309
+ 306,
310
+ 307,
311
+ 308,
312
+ 309,
313
+ 310,
314
+ 311,
315
+ 312,
316
+ 313,
317
+ 314,
318
+ 315,
319
+ 316,
320
+ 317,
321
+ 318,
322
+ 319,
323
+ 320,
324
+ 321,
325
+ 322,
326
+ 323,
327
+ 324,
328
+ 325,
329
+ 326,
330
+ 327,
331
+ 328,
332
+ 329,
333
+ 330,
334
+ 331,
335
+ 332,
336
+ 333,
337
+ 334,
338
+ 335,
339
+ 336,
340
+ 337,
341
+ 338,
342
+ 339,
343
+ 340,
344
+ 341,
345
+ 342,
346
+ 343,
347
+ 344,
348
+ 345,
349
+ 346,
350
+ 347,
351
+ 348,
352
+ 349,
353
+ 350,
354
+ 351,
355
+ 352,
356
+ 353,
357
+ 354,
358
+ 355,
359
+ 356,
360
+ 357,
361
+ 358,
362
+ 359,
363
+ 360,
364
+ 361,
365
+ 362,
366
+ 363,
367
+ 364,
368
+ 365,
369
+ 366,
370
+ 367,
371
+ 368,
372
+ 369,
373
+ 370,
374
+ 371,
375
+ 372,
376
+ 373,
377
+ 374,
378
+ 375,
379
+ 376,
380
+ 377,
381
+ 378,
382
+ 379,
383
+ 380,
384
+ 381,
385
+ 382,
386
+ 383,
387
+ 384,
388
+ 385,
389
+ 386,
390
+ 387,
391
+ 388,
392
+ 389,
393
+ 390,
394
+ 391,
395
+ 392,
396
+ 393,
397
+ 394,
398
+ 395,
399
+ 396,
400
+ 397,
401
+ 398,
402
+ 399,
403
+ 400,
404
+ 401,
405
+ 402,
406
+ 403,
407
+ 404,
408
+ 405,
409
+ 406,
410
+ 407,
411
+ 408,
412
+ 409,
413
+ 410,
414
+ 411,
415
+ 412,
416
+ 413,
417
+ 414,
418
+ 415,
419
+ 416,
420
+ 417,
421
+ 418,
422
+ 419,
423
+ 420,
424
+ 421,
425
+ 422,
426
+ 423,
427
+ 424,
428
+ 425,
429
+ 426,
430
+ 427,
431
+ 428,
432
+ 429,
433
+ 430,
434
+ 431,
435
+ 432,
436
+ 433,
437
+ 434,
438
+ 435,
439
+ 436,
440
+ 437,
441
+ 438,
442
+ 439,
443
+ 440,
444
+ 441,
445
+ 442,
446
+ 443,
447
+ 444,
448
+ 445,
449
+ 446,
450
+ 447,
451
+ 448,
452
+ 449,
453
+ 450,
454
+ 451,
455
+ 452,
456
+ 453,
457
+ 454,
458
+ 455,
459
+ 456,
460
+ 457,
461
+ 458,
462
+ 459,
463
+ 460,
464
+ 461,
465
+ 462,
466
+ 463,
467
+ 464,
468
+ 465,
469
+ 466,
470
+ 467,
471
+ 468,
472
+ 469,
473
+ 470,
474
+ 471,
475
+ 472,
476
+ 473,
477
+ 474,
478
+ 475,
479
+ 476,
480
+ 477,
481
+ 478,
482
+ 479,
483
+ 480,
484
+ 481,
485
+ 482,
486
+ 483,
487
+ 484,
488
+ 485,
489
+ 486,
490
+ 487,
491
+ 488,
492
+ 489,
493
+ 490,
494
+ 491,
495
+ 492,
496
+ 493,
497
+ 494,
498
+ 495,
499
+ 496,
500
+ 497,
501
+ 498,
502
+ 499,
503
+ 500,
504
+ 501,
505
+ 502,
506
+ 503,
507
+ 504,
508
+ 505,
509
+ 506,
510
+ 507,
511
+ 508,
512
+ 509,
513
+ 510,
514
+ 511,
515
+ 512,
516
+ 513,
517
+ 514,
518
+ 515,
519
+ 516,
520
+ 517,
521
+ 518,
522
+ 519,
523
+ 520,
524
+ 521,
525
+ 522,
526
+ 523,
527
+ 524,
528
+ 525,
529
+ 526,
530
+ 527,
531
+ 528,
532
+ 529,
533
+ 530,
534
+ 531,
535
+ 532,
536
+ 533,
537
+ 534,
538
+ 535,
539
+ 536
540
+ ],
541
+ "losses": [
542
+ 127.5,
543
+ 39.0,
544
+ 40.5,
545
+ 34.25,
546
+ 28.25,
547
+ 21.375,
548
+ 16.0,
549
+ 13.25,
550
+ 11.9375,
551
+ 11.625,
552
+ 11.3125,
553
+ 10.5,
554
+ 9.9375,
555
+ 9.5625,
556
+ 9.5,
557
+ 9.375,
558
+ 9.3125,
559
+ 9.375,
560
+ 9.3125,
561
+ 9.25,
562
+ 9.125,
563
+ 9.0625,
564
+ 8.9375,
565
+ 8.875,
566
+ 8.8125,
567
+ 8.8125,
568
+ 8.75,
569
+ 8.6875,
570
+ 8.75,
571
+ 8.6875,
572
+ 8.6875,
573
+ 8.625,
574
+ 8.625,
575
+ 8.625,
576
+ 8.5625,
577
+ 8.625,
578
+ 8.5625,
579
+ 8.5625,
580
+ 8.625,
581
+ 8.5625,
582
+ 8.5,
583
+ 8.5625,
584
+ 8.5,
585
+ 8.5,
586
+ 8.5,
587
+ 8.5625,
588
+ 8.5,
589
+ 8.5,
590
+ 8.5,
591
+ 8.5,
592
+ 8.5625,
593
+ 8.5,
594
+ 8.5,
595
+ 8.5,
596
+ 8.5,
597
+ 8.4375,
598
+ 8.5,
599
+ 8.5,
600
+ 8.5,
601
+ 8.5,
602
+ 8.4375,
603
+ 8.5,
604
+ 8.5,
605
+ 8.5,
606
+ 8.4375,
607
+ 8.4375,
608
+ 8.5,
609
+ 8.4375,
610
+ 8.5,
611
+ 8.5,
612
+ 8.5,
613
+ 8.4375,
614
+ 8.5,
615
+ 8.4375,
616
+ 8.4375,
617
+ 8.5,
618
+ 8.5,
619
+ 8.5,
620
+ 8.4375,
621
+ 8.4375,
622
+ 8.5,
623
+ 8.5,
624
+ 8.4375,
625
+ 8.5,
626
+ 8.5,
627
+ 8.4375,
628
+ 8.5,
629
+ 8.5,
630
+ 8.4375,
631
+ 8.4375,
632
+ 8.4375,
633
+ 8.5,
634
+ 8.5,
635
+ 8.4375,
636
+ 8.5,
637
+ 8.4375,
638
+ 8.5,
639
+ 8.5,
640
+ 8.5,
641
+ 8.5,
642
+ 8.5,
643
+ 8.4375,
644
+ 8.5,
645
+ 8.5,
646
+ 8.4375,
647
+ 8.5,
648
+ 8.5,
649
+ 8.5,
650
+ 8.4375,
651
+ 8.4375,
652
+ 8.5,
653
+ 8.4375,
654
+ 8.4375,
655
+ 8.4375,
656
+ 8.4375,
657
+ 8.5,
658
+ 8.5,
659
+ 8.4375,
660
+ 8.4375,
661
+ 8.4375,
662
+ 8.5,
663
+ 8.4375,
664
+ 8.4375,
665
+ 8.4375,
666
+ 8.4375,
667
+ 8.4375,
668
+ 8.5,
669
+ 8.5,
670
+ 8.4375,
671
+ 8.5,
672
+ 8.5,
673
+ 8.4375,
674
+ 8.4375,
675
+ 8.4375,
676
+ 8.4375,
677
+ 8.4375,
678
+ 8.4375,
679
+ 8.4375,
680
+ 8.375,
681
+ 8.4375,
682
+ 8.4375,
683
+ 8.5,
684
+ 8.375,
685
+ 8.4375,
686
+ 8.4375,
687
+ 8.5,
688
+ 8.5,
689
+ 8.4375,
690
+ 8.4375,
691
+ 8.4375,
692
+ 8.4375,
693
+ 8.4375,
694
+ 8.5,
695
+ 8.4375,
696
+ 8.4375,
697
+ 8.4375,
698
+ 8.5,
699
+ 8.4375,
700
+ 8.5,
701
+ 8.4375,
702
+ 8.4375,
703
+ 8.4375,
704
+ 8.5,
705
+ 8.5,
706
+ 8.4375,
707
+ 8.4375,
708
+ 8.4375,
709
+ 8.4375,
710
+ 8.4375,
711
+ 8.5,
712
+ 8.4375,
713
+ 8.375,
714
+ 8.4375,
715
+ 8.4375,
716
+ 8.5,
717
+ 8.4375,
718
+ 8.4375,
719
+ 8.4375,
720
+ 8.5,
721
+ 8.5,
722
+ 8.5,
723
+ 8.4375,
724
+ 8.4375,
725
+ 8.4375,
726
+ 8.5,
727
+ 8.5,
728
+ 8.4375,
729
+ 8.5,
730
+ 8.5,
731
+ 8.4375,
732
+ 8.5625,
733
+ 8.5,
734
+ 8.5,
735
+ 8.4375,
736
+ 8.5,
737
+ 8.4375,
738
+ 8.5,
739
+ 8.4375,
740
+ 8.375,
741
+ 8.4375,
742
+ 8.4375,
743
+ 8.5,
744
+ 8.4375,
745
+ 8.4375,
746
+ 8.4375,
747
+ 8.4375,
748
+ 8.5,
749
+ 8.4375,
750
+ 8.4375,
751
+ 8.4375,
752
+ 8.5,
753
+ 8.4375,
754
+ 8.5,
755
+ 8.4375,
756
+ 8.4375,
757
+ 8.4375,
758
+ 8.4375,
759
+ 8.4375,
760
+ 8.4375,
761
+ 8.4375,
762
+ 8.4375,
763
+ 8.375,
764
+ 8.4375,
765
+ 8.4375,
766
+ 8.5,
767
+ 8.4375,
768
+ 8.4375,
769
+ 8.4375,
770
+ 8.5,
771
+ 8.4375,
772
+ 8.4375,
773
+ 8.4375,
774
+ 8.4375,
775
+ 8.4375,
776
+ 8.4375,
777
+ 8.4375,
778
+ 8.4375,
779
+ 8.4375,
780
+ 8.5,
781
+ 8.4375,
782
+ 8.4375,
783
+ 8.4375,
784
+ 8.5,
785
+ 8.4375,
786
+ 8.4375,
787
+ 8.375,
788
+ 8.4375,
789
+ 8.4375,
790
+ 8.4375,
791
+ 8.4375,
792
+ 8.375,
793
+ 8.4375,
794
+ 8.4375,
795
+ 8.4375,
796
+ 8.4375,
797
+ 8.4375,
798
+ 8.4375,
799
+ 8.5,
800
+ 8.5,
801
+ 8.4375,
802
+ 8.4375,
803
+ 8.5,
804
+ 8.4375,
805
+ 8.5,
806
+ 8.5,
807
+ 8.4375,
808
+ 8.4375,
809
+ 8.5,
810
+ 8.375,
811
+ 8.375,
812
+ 8.4375,
813
+ 8.4375,
814
+ 8.4375,
815
+ 8.4375,
816
+ 8.4375,
817
+ 8.4375,
818
+ 8.5,
819
+ 8.4375,
820
+ 8.4375,
821
+ 8.4375,
822
+ 8.375,
823
+ 8.4375,
824
+ 8.375,
825
+ 8.4375,
826
+ 8.4375,
827
+ 8.5,
828
+ 8.4375,
829
+ 8.4375,
830
+ 8.4375,
831
+ 8.4375,
832
+ 8.375,
833
+ 8.4375,
834
+ 8.4375,
835
+ 8.4375,
836
+ 8.4375,
837
+ 8.4375,
838
+ 8.4375,
839
+ 8.375,
840
+ 8.375,
841
+ 8.375,
842
+ 8.375,
843
+ 8.375,
844
+ 8.4375,
845
+ 8.4375,
846
+ 8.4375,
847
+ 8.375,
848
+ 8.375,
849
+ 8.4375,
850
+ 8.4375,
851
+ 8.375,
852
+ 8.375,
853
+ 8.375,
854
+ 8.4375,
855
+ 8.4375,
856
+ 8.375,
857
+ 8.4375,
858
+ 8.4375,
859
+ 8.4375,
860
+ 8.3125,
861
+ 8.375,
862
+ 8.4375,
863
+ 8.4375,
864
+ 8.4375,
865
+ 8.375,
866
+ 8.375,
867
+ 8.4375,
868
+ 8.375,
869
+ 8.4375,
870
+ 8.375,
871
+ 8.4375,
872
+ 8.4375,
873
+ 8.4375,
874
+ 8.375,
875
+ 8.4375,
876
+ 8.4375,
877
+ 8.4375,
878
+ 8.4375,
879
+ 8.4375,
880
+ 8.375,
881
+ 8.4375,
882
+ 8.4375,
883
+ 8.5,
884
+ 8.5,
885
+ 8.4375,
886
+ 8.4375,
887
+ 8.5,
888
+ 8.5,
889
+ 8.4375,
890
+ 8.5,
891
+ 8.5,
892
+ 9.25,
893
+ 10.625,
894
+ 9.625,
895
+ 9.625,
896
+ 10.1875,
897
+ 9.5,
898
+ 9.9375,
899
+ 8.75,
900
+ 10.5625,
901
+ 8.75,
902
+ 9.75,
903
+ 9.25,
904
+ 8.875,
905
+ 9.5,
906
+ 8.75,
907
+ 9.375,
908
+ 10.0625,
909
+ 8.6875,
910
+ 10.1875,
911
+ 9.3125,
912
+ 9.5,
913
+ 9.25,
914
+ 9.0,
915
+ 9.1875,
916
+ 8.875,
917
+ 9.0,
918
+ 8.8125,
919
+ 8.75,
920
+ 8.875,
921
+ 8.6875,
922
+ 8.875,
923
+ 8.625,
924
+ 8.625,
925
+ 8.625,
926
+ 8.5625,
927
+ 8.5625,
928
+ 8.5,
929
+ 8.625,
930
+ 8.5,
931
+ 8.4375,
932
+ 8.5625,
933
+ 8.5625,
934
+ 8.5625,
935
+ 8.4375,
936
+ 8.5625,
937
+ 8.5625,
938
+ 8.5,
939
+ 8.5625,
940
+ 8.4375,
941
+ 8.4375,
942
+ 8.4375,
943
+ 8.375,
944
+ 8.4375,
945
+ 8.375,
946
+ 8.375,
947
+ 8.375,
948
+ 8.375,
949
+ 8.4375,
950
+ 8.375,
951
+ 8.4375,
952
+ 8.4375,
953
+ 8.4375,
954
+ 8.375,
955
+ 8.4375,
956
+ 8.375,
957
+ 8.3125,
958
+ 8.4375,
959
+ 8.4375,
960
+ 8.3125,
961
+ 8.375,
962
+ 8.4375,
963
+ 8.375,
964
+ 8.375,
965
+ 8.375,
966
+ 8.375,
967
+ 8.4375,
968
+ 8.4375,
969
+ 8.375,
970
+ 8.375,
971
+ 8.375,
972
+ 8.375,
973
+ 8.375,
974
+ 8.375,
975
+ 8.375,
976
+ 8.3125,
977
+ 8.3125,
978
+ 8.3125,
979
+ 8.3125,
980
+ 8.375,
981
+ 8.375,
982
+ 8.3125,
983
+ 8.3125,
984
+ 8.375,
985
+ 8.375,
986
+ 8.375,
987
+ 8.375,
988
+ 8.3125,
989
+ 8.375,
990
+ 8.3125,
991
+ 8.3125,
992
+ 8.3125,
993
+ 8.25,
994
+ 8.375,
995
+ 8.3125,
996
+ 8.375,
997
+ 8.3125,
998
+ 8.3125,
999
+ 8.3125,
1000
+ 8.3125,
1001
+ 8.3125,
1002
+ 8.3125,
1003
+ 8.375,
1004
+ 8.3125,
1005
+ 8.375,
1006
+ 8.3125,
1007
+ 8.3125,
1008
+ 8.25,
1009
+ 8.3125,
1010
+ 8.3125,
1011
+ 8.3125,
1012
+ 8.3125,
1013
+ 8.3125,
1014
+ 8.3125,
1015
+ 8.3125,
1016
+ 8.3125,
1017
+ 8.3125,
1018
+ 8.375,
1019
+ 8.3125,
1020
+ 8.3125,
1021
+ 8.3125,
1022
+ 8.3125,
1023
+ 8.3125,
1024
+ 8.3125,
1025
+ 8.3125,
1026
+ 8.3125,
1027
+ 8.25,
1028
+ 8.3125,
1029
+ 8.3125,
1030
+ 8.3125,
1031
+ 8.3125,
1032
+ 8.25,
1033
+ 8.3125,
1034
+ 8.3125,
1035
+ 8.25,
1036
+ 8.3125,
1037
+ 8.3125,
1038
+ 8.3125,
1039
+ 8.3125,
1040
+ 8.3125,
1041
+ 8.3125,
1042
+ 8.3125,
1043
+ 8.25,
1044
+ 8.3125,
1045
+ 8.3125,
1046
+ 8.25,
1047
+ 8.3125,
1048
+ 8.3125,
1049
+ 8.25,
1050
+ 8.375,
1051
+ 8.3125,
1052
+ 8.3125,
1053
+ 8.3125,
1054
+ 8.3125,
1055
+ 8.3125,
1056
+ 8.25,
1057
+ 8.25,
1058
+ 8.25,
1059
+ 8.3125,
1060
+ 8.3125,
1061
+ 8.3125,
1062
+ 8.3125,
1063
+ 8.25,
1064
+ 8.25,
1065
+ 8.3125,
1066
+ 8.3125,
1067
+ 8.25,
1068
+ 8.25,
1069
+ 8.25,
1070
+ 8.3125,
1071
+ 8.3125,
1072
+ 8.25,
1073
+ 8.3125,
1074
+ 8.25,
1075
+ 8.3125,
1076
+ 8.3125,
1077
+ 8.25
1078
+ ],
1079
+ "grad_norms": [
1080
+ 11.5,
1081
+ 16.0,
1082
+ 17.25,
1083
+ 11.25,
1084
+ 10.8125,
1085
+ 6.1875,
1086
+ 2.96875,
1087
+ 1.796875,
1088
+ 3.1875,
1089
+ 4.75,
1090
+ 4.5625,
1091
+ 2.578125,
1092
+ 1.0546875,
1093
+ 1.1328125,
1094
+ 2.046875,
1095
+ 1.46875,
1096
+ 1.234375,
1097
+ 1.375,
1098
+ 1.7734375,
1099
+ 1.390625,
1100
+ 0.75390625,
1101
+ 0.84375,
1102
+ 0.6015625,
1103
+ 0.48828125,
1104
+ 0.5234375,
1105
+ 0.419921875,
1106
+ 0.388671875,
1107
+ 0.43359375,
1108
+ 0.4296875,
1109
+ 0.34375,
1110
+ 0.48828125,
1111
+ 0.39453125,
1112
+ 0.310546875,
1113
+ 0.421875,
1114
+ 0.333984375,
1115
+ 0.275390625,
1116
+ 0.29296875,
1117
+ 0.34375,
1118
+ 0.2314453125,
1119
+ 0.2470703125,
1120
+ 0.212890625,
1121
+ 0.171875,
1122
+ 0.349609375,
1123
+ 0.23828125,
1124
+ 0.421875,
1125
+ 0.189453125,
1126
+ 0.314453125,
1127
+ 0.263671875,
1128
+ 0.240234375,
1129
+ 0.25,
1130
+ 0.1689453125,
1131
+ 0.2314453125,
1132
+ 0.208984375,
1133
+ 0.21875,
1134
+ 0.25390625,
1135
+ 0.224609375,
1136
+ 0.1904296875,
1137
+ 0.1396484375,
1138
+ 0.25,
1139
+ 0.1796875,
1140
+ 0.1650390625,
1141
+ 0.1337890625,
1142
+ 0.1787109375,
1143
+ 0.1689453125,
1144
+ 0.2353515625,
1145
+ 0.17578125,
1146
+ 0.2197265625,
1147
+ 0.208984375,
1148
+ 0.1552734375,
1149
+ 0.1474609375,
1150
+ 0.1904296875,
1151
+ 0.1923828125,
1152
+ 0.1748046875,
1153
+ 0.158203125,
1154
+ 0.2138671875,
1155
+ 0.2734375,
1156
+ 0.1572265625,
1157
+ 0.2119140625,
1158
+ 0.2109375,
1159
+ 0.2255859375,
1160
+ 0.19921875,
1161
+ 0.1865234375,
1162
+ 0.244140625,
1163
+ 0.228515625,
1164
+ 0.1884765625,
1165
+ 0.1962890625,
1166
+ 0.2099609375,
1167
+ 0.173828125,
1168
+ 0.203125,
1169
+ 0.2275390625,
1170
+ 0.18359375,
1171
+ 0.384765625,
1172
+ 0.27734375,
1173
+ 0.408203125,
1174
+ 0.373046875,
1175
+ 0.306640625,
1176
+ 0.263671875,
1177
+ 0.365234375,
1178
+ 0.2578125,
1179
+ 0.41796875,
1180
+ 0.462890625,
1181
+ 0.255859375,
1182
+ 0.453125,
1183
+ 0.1875,
1184
+ 0.236328125,
1185
+ 0.216796875,
1186
+ 0.1806640625,
1187
+ 0.1806640625,
1188
+ 0.326171875,
1189
+ 0.2236328125,
1190
+ 0.1787109375,
1191
+ 0.228515625,
1192
+ 0.1875,
1193
+ 0.1923828125,
1194
+ 0.236328125,
1195
+ 0.2255859375,
1196
+ 0.1884765625,
1197
+ 0.1962890625,
1198
+ 0.1943359375,
1199
+ 0.1728515625,
1200
+ 0.1845703125,
1201
+ 0.19140625,
1202
+ 0.177734375,
1203
+ 0.162109375,
1204
+ 0.2490234375,
1205
+ 0.19921875,
1206
+ 0.220703125,
1207
+ 0.251953125,
1208
+ 0.2197265625,
1209
+ 0.216796875,
1210
+ 0.123046875,
1211
+ 0.42578125,
1212
+ 0.396484375,
1213
+ 0.435546875,
1214
+ 0.609375,
1215
+ 0.166015625,
1216
+ 0.55078125,
1217
+ 0.2890625,
1218
+ 0.6640625,
1219
+ 0.18359375,
1220
+ 0.5625,
1221
+ 0.1611328125,
1222
+ 0.671875,
1223
+ 0.384765625,
1224
+ 0.37109375,
1225
+ 0.251953125,
1226
+ 0.263671875,
1227
+ 0.1650390625,
1228
+ 0.3671875,
1229
+ 0.162109375,
1230
+ 0.322265625,
1231
+ 0.19140625,
1232
+ 0.25,
1233
+ 0.177734375,
1234
+ 0.271484375,
1235
+ 0.26953125,
1236
+ 0.26953125,
1237
+ 0.466796875,
1238
+ 0.16796875,
1239
+ 0.4453125,
1240
+ 0.26171875,
1241
+ 0.27734375,
1242
+ 0.3984375,
1243
+ 0.1728515625,
1244
+ 0.48046875,
1245
+ 0.2392578125,
1246
+ 0.482421875,
1247
+ 0.3046875,
1248
+ 0.388671875,
1249
+ 0.5078125,
1250
+ 0.212890625,
1251
+ 0.384765625,
1252
+ 0.1669921875,
1253
+ 0.337890625,
1254
+ 0.2578125,
1255
+ 0.390625,
1256
+ 0.41796875,
1257
+ 0.3203125,
1258
+ 0.3203125,
1259
+ 0.326171875,
1260
+ 0.4609375,
1261
+ 0.3203125,
1262
+ 0.40234375,
1263
+ 0.267578125,
1264
+ 0.490234375,
1265
+ 0.625,
1266
+ 0.2314453125,
1267
+ 0.6953125,
1268
+ 0.32421875,
1269
+ 0.62109375,
1270
+ 0.765625,
1271
+ 0.173828125,
1272
+ 0.62890625,
1273
+ 0.427734375,
1274
+ 0.51171875,
1275
+ 0.875,
1276
+ 0.30078125,
1277
+ 0.427734375,
1278
+ 0.498046875,
1279
+ 0.2255859375,
1280
+ 0.3515625,
1281
+ 0.3125,
1282
+ 0.2421875,
1283
+ 0.41796875,
1284
+ 0.2001953125,
1285
+ 0.36328125,
1286
+ 0.287109375,
1287
+ 0.279296875,
1288
+ 0.310546875,
1289
+ 0.18359375,
1290
+ 0.3984375,
1291
+ 0.251953125,
1292
+ 0.25390625,
1293
+ 0.40234375,
1294
+ 0.259765625,
1295
+ 0.37109375,
1296
+ 0.2353515625,
1297
+ 0.28515625,
1298
+ 0.263671875,
1299
+ 0.333984375,
1300
+ 0.3125,
1301
+ 0.388671875,
1302
+ 0.412109375,
1303
+ 0.326171875,
1304
+ 0.412109375,
1305
+ 0.373046875,
1306
+ 0.6171875,
1307
+ 0.3515625,
1308
+ 0.349609375,
1309
+ 0.451171875,
1310
+ 0.1630859375,
1311
+ 0.486328125,
1312
+ 0.30078125,
1313
+ 0.31640625,
1314
+ 0.453125,
1315
+ 0.1943359375,
1316
+ 0.515625,
1317
+ 0.53515625,
1318
+ 0.310546875,
1319
+ 0.3515625,
1320
+ 0.236328125,
1321
+ 0.365234375,
1322
+ 0.40234375,
1323
+ 0.271484375,
1324
+ 0.396484375,
1325
+ 0.341796875,
1326
+ 0.265625,
1327
+ 0.53125,
1328
+ 0.408203125,
1329
+ 0.32421875,
1330
+ 0.490234375,
1331
+ 0.5546875,
1332
+ 0.248046875,
1333
+ 0.388671875,
1334
+ 0.466796875,
1335
+ 0.2041015625,
1336
+ 0.431640625,
1337
+ 0.482421875,
1338
+ 0.306640625,
1339
+ 0.384765625,
1340
+ 0.51171875,
1341
+ 0.419921875,
1342
+ 0.462890625,
1343
+ 0.62890625,
1344
+ 0.36328125,
1345
+ 0.404296875,
1346
+ 0.69140625,
1347
+ 0.279296875,
1348
+ 0.6328125,
1349
+ 0.326171875,
1350
+ 0.71875,
1351
+ 0.357421875,
1352
+ 0.7734375,
1353
+ 0.32421875,
1354
+ 0.6328125,
1355
+ 0.275390625,
1356
+ 0.578125,
1357
+ 0.29296875,
1358
+ 0.66796875,
1359
+ 0.353515625,
1360
+ 0.65234375,
1361
+ 0.294921875,
1362
+ 0.482421875,
1363
+ 0.380859375,
1364
+ 0.61328125,
1365
+ 0.28125,
1366
+ 0.373046875,
1367
+ 0.37109375,
1368
+ 0.28515625,
1369
+ 0.46875,
1370
+ 0.2451171875,
1371
+ 0.462890625,
1372
+ 0.279296875,
1373
+ 0.3984375,
1374
+ 0.2333984375,
1375
+ 0.41015625,
1376
+ 0.2734375,
1377
+ 0.52734375,
1378
+ 0.3515625,
1379
+ 0.345703125,
1380
+ 0.26171875,
1381
+ 0.3984375,
1382
+ 0.53125,
1383
+ 0.318359375,
1384
+ 0.484375,
1385
+ 0.48828125,
1386
+ 0.5546875,
1387
+ 0.5390625,
1388
+ 0.474609375,
1389
+ 0.6484375,
1390
+ 0.76171875,
1391
+ 0.3515625,
1392
+ 0.53125,
1393
+ 0.419921875,
1394
+ 0.83203125,
1395
+ 0.462890625,
1396
+ 0.9296875,
1397
+ 0.95703125,
1398
+ 1.0390625,
1399
+ 1.171875,
1400
+ 1.234375,
1401
+ 0.9921875,
1402
+ 1.203125,
1403
+ 1.6796875,
1404
+ 2.578125,
1405
+ 3.21875,
1406
+ 3.734375,
1407
+ 6.53125,
1408
+ 5.125,
1409
+ 4.28125,
1410
+ 5.5625,
1411
+ 6.71875,
1412
+ 4.21875,
1413
+ 17.75,
1414
+ 4.59375,
1415
+ 3.859375,
1416
+ 4.375,
1417
+ 3.0,
1418
+ 7.1875,
1419
+ 35.25,
1420
+ 3.546875,
1421
+ 4.78125,
1422
+ 8.4375,
1423
+ 7.4375,
1424
+ 6.25,
1425
+ 158.0,
1426
+ 121.5,
1427
+ 6.53125,
1428
+ 27.875,
1429
+ 35.0,
1430
+ 16.375,
1431
+ 15.9375,
1432
+ 15.25,
1433
+ 124.0,
1434
+ 19.25,
1435
+ 24.125,
1436
+ 14.625,
1437
+ 28.625,
1438
+ 18.125,
1439
+ 6.375,
1440
+ 12.9375,
1441
+ 11.0,
1442
+ 9.8125,
1443
+ 53.0,
1444
+ 7.875,
1445
+ 504.0,
1446
+ 19.25,
1447
+ 8.5625,
1448
+ 69.5,
1449
+ 25.0,
1450
+ 10.9375,
1451
+ 8.5625,
1452
+ 8.6875,
1453
+ 12.1875,
1454
+ 8.875,
1455
+ 13.0625,
1456
+ 21.875,
1457
+ 15.375,
1458
+ 32.25,
1459
+ 11.625,
1460
+ 12.5,
1461
+ 15.75,
1462
+ 14.4375,
1463
+ 11.3125,
1464
+ 22.625,
1465
+ 18.375,
1466
+ 27.625,
1467
+ 31.0,
1468
+ 28.125,
1469
+ 14.5625,
1470
+ 14.0625,
1471
+ 12.3125,
1472
+ 17.75,
1473
+ 13.8125,
1474
+ 60.25,
1475
+ 12.9375,
1476
+ 18.625,
1477
+ 27.5,
1478
+ 14.5,
1479
+ 18.375,
1480
+ 17.875,
1481
+ 22.125,
1482
+ 15.0,
1483
+ 52.25,
1484
+ 22.625,
1485
+ 17.375,
1486
+ 16.125,
1487
+ 41.75,
1488
+ 25.25,
1489
+ 31.25,
1490
+ 23.375,
1491
+ 16.5,
1492
+ 30.875,
1493
+ 13.8125,
1494
+ 34.0,
1495
+ 17.25,
1496
+ 37.5,
1497
+ 13.75,
1498
+ 17.125,
1499
+ 17.625,
1500
+ 18.875,
1501
+ 59.5,
1502
+ 19.625,
1503
+ 11.125,
1504
+ 17.625,
1505
+ 16.125,
1506
+ 13.625,
1507
+ 27.75,
1508
+ 19.875,
1509
+ 12.125,
1510
+ 23.75,
1511
+ 16.875,
1512
+ 12.75,
1513
+ 15.875,
1514
+ 10.875,
1515
+ 13.625,
1516
+ 25.75,
1517
+ 43.75,
1518
+ 44.25,
1519
+ 13.5625,
1520
+ 34.75,
1521
+ 25.625,
1522
+ 28.25,
1523
+ 51.0,
1524
+ 21.25,
1525
+ 17.75,
1526
+ 20.5,
1527
+ 32.25,
1528
+ 25.125,
1529
+ 20.75,
1530
+ 19.875,
1531
+ 15.6875,
1532
+ 17.625,
1533
+ 32.75,
1534
+ 19.25,
1535
+ 20.5,
1536
+ 14.4375,
1537
+ 12.625,
1538
+ 14.75,
1539
+ 13.3125,
1540
+ 15.5625,
1541
+ 33.25,
1542
+ 13.0,
1543
+ 17.875,
1544
+ 22.75,
1545
+ 25.5,
1546
+ 25.875,
1547
+ 18.75,
1548
+ 13.875,
1549
+ 22.25,
1550
+ 22.75,
1551
+ 19.375,
1552
+ 29.5,
1553
+ 24.0,
1554
+ 25.125,
1555
+ 25.875,
1556
+ 20.375,
1557
+ 48.0,
1558
+ 25.375,
1559
+ 44.25,
1560
+ 28.75,
1561
+ 17.375,
1562
+ 18.875,
1563
+ 26.125,
1564
+ 38.5,
1565
+ 27.125,
1566
+ 15.75,
1567
+ 30.625,
1568
+ 27.125,
1569
+ 53.5,
1570
+ 41.5,
1571
+ 23.75,
1572
+ 37.0,
1573
+ 45.0,
1574
+ 31.0,
1575
+ 24.875,
1576
+ 28.75,
1577
+ 33.25,
1578
+ 40.75,
1579
+ 20.75,
1580
+ 20.0,
1581
+ 38.5,
1582
+ 45.0,
1583
+ 27.75,
1584
+ 36.75,
1585
+ 101.5,
1586
+ 35.25,
1587
+ 34.0,
1588
+ 29.0,
1589
+ 28.25,
1590
+ 24.5,
1591
+ 39.5,
1592
+ 24.5,
1593
+ 27.125,
1594
+ 21.125,
1595
+ 20.375,
1596
+ 19.25,
1597
+ 27.625,
1598
+ 30.75,
1599
+ 20.375,
1600
+ 29.125,
1601
+ 12.5,
1602
+ 32.25,
1603
+ 17.625,
1604
+ 27.375,
1605
+ 29.75,
1606
+ 25.0,
1607
+ 28.875,
1608
+ 31.625,
1609
+ 24.125,
1610
+ 43.25,
1611
+ 32.75,
1612
+ 28.875,
1613
+ 38.0,
1614
+ 28.375,
1615
+ 26.875
1616
+ ]
1617
+ },
1618
+ "eval": {
1619
+ "effective_batch_nums": [
1620
+ 50,
1621
+ 100,
1622
+ 150,
1623
+ 200,
1624
+ 250,
1625
+ 300,
1626
+ 350,
1627
+ 400,
1628
+ 450,
1629
+ 500
1630
+ ],
1631
+ "losses": [
1632
+ 8.511029411764707,
1633
+ 8.503676470588236,
1634
+ 8.496323529411764,
1635
+ 8.488970588235293,
1636
+ 8.492647058823529,
1637
+ 8.441176470588236,
1638
+ 9.183823529411764,
1639
+ 8.481617647058824,
1640
+ 8.375,
1641
+ 8.338235294117647
1642
+ ],
1643
+ "perplexities": [
1644
+ 4988.235294117647,
1645
+ 4950.588235294118,
1646
+ 4912.941176470588,
1647
+ 4882.823529411765,
1648
+ 4901.64705882353,
1649
+ 4660.705882352941,
1650
+ 9788.235294117647,
1651
+ 4841.411764705882,
1652
+ 4361.411764705882,
1653
+ 4198.588235294118
1654
+ ],
1655
+ "accuracies": [
1656
+ 0.04597654629526575,
1657
+ 0.050909109305596306,
1658
+ 0.050909109305596306,
1659
+ 0.050909109305596306,
1660
+ 0.050909109305596306,
1661
+ 0.0672245100320743,
1662
+ 0.059873726386935534,
1663
+ 0.06636953244361701,
1664
+ 0.07729705665111855,
1665
+ 0.0785567573583722
1666
+ ]
1667
+ }
1668
+ }
expdecayforward_123/epoch3/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1667ed95629f8e7748aee98318a1405e1537617ca28015f3ddc7473c32a7e4e
3
+ size 18206151
expdecayforward_123/epoch3/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2be3bf1a59ed4a35c455723fd8d9d48bd5629d8b7867b6df1b30e6ae5b901b3d
3
+ size 36464267
expdecayforward_123/epoch3/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fb52c4f2c1b084572e55f1ef8aaec826674c68259526f7f9b6960d5364d5713
3
+ size 1465
expdecayforward_123/epoch3/tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
expdecayforward_123/epoch3/tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": "<|endoftext|>",
3
+ "eos_token": "<|endoftext|>",
4
+ "pad_token": "<|endoftext|>",
5
+ "unk_token": "<|endoftext|>"
6
+ }
expdecayforward_123/epoch3/tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
expdecayforward_123/epoch3/tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "50256": {
5
+ "content": "<|endoftext|>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ }
12
+ },
13
+ "bos_token": "<|endoftext|>",
14
+ "clean_up_tokenization_spaces": false,
15
+ "eos_token": "<|endoftext|>",
16
+ "extra_special_tokens": {},
17
+ "model_max_length": 1024,
18
+ "pad_token": "<|endoftext|>",
19
+ "tokenizer_class": "GPT2Tokenizer",
20
+ "unk_token": "<|endoftext|>"
21
+ }
expdecayforward_123/epoch3/tokenizer/vocab.json ADDED
The diff for this file is too large to render. See raw diff