File size: 46,279 Bytes
14305d2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204
1205
1206
1207
1208
step,tag,value
1,train/loss,0.459199994802475
2,train/loss,0.763700008392334
3,train/loss,0.7735999822616577
4,train/loss,0.40299999713897705
5,train/loss,0.4090000092983246
6,train/loss,0.39559999108314514
7,train/loss,0.5562000274658203
8,train/loss,0.43369999527931213
9,train/loss,0.45249998569488525
10,train/loss,0.48030000925064087
11,train/loss,0.48019999265670776
12,train/loss,0.4740000069141388
13,train/loss,0.47600001096725464
14,train/loss,0.2630999982357025
15,train/loss,0.27880001068115234
16,train/loss,0.3481999933719635
17,train/loss,0.22059999406337738
18,train/loss,0.29840001463890076
19,train/loss,0.373199999332428
20,train/loss,0.2134000062942505
21,train/loss,0.3206999897956848
22,train/loss,0.2475000023841858
23,train/loss,0.2198999971151352
24,train/loss,0.25270000100135803
25,train/loss,0.21070000529289246
26,train/loss,0.16439999639987946
27,train/loss,0.19979999959468842
28,train/loss,0.37950000166893005
29,train/loss,0.11980000138282776
30,train/loss,0.15240000188350677
31,train/loss,0.19619999825954437
32,train/loss,0.14429999887943268
33,train/loss,0.21310000121593475
34,train/loss,0.18150000274181366
35,train/loss,0.1518000066280365
36,train/loss,0.13490000367164612
37,train/loss,0.13699999451637268
38,train/loss,0.17980000376701355
39,train/loss,0.23909999430179596
40,train/loss,0.0851999968290329
41,train/loss,0.1242000013589859
42,train/loss,0.14970000088214874
43,train/loss,0.08560000360012054
44,train/loss,0.23100000619888306
45,train/loss,0.3122999966144562
46,train/loss,0.06199999898672104
47,train/loss,0.17759999632835388
48,train/loss,0.09989999979734421
49,train/loss,0.07490000128746033
50,train/loss,0.08219999819993973
51,train/loss,0.13449999690055847
52,train/loss,0.07360000163316727
53,train/loss,0.06830000132322311
54,train/loss,0.07360000163316727
55,train/loss,0.08659999817609787
56,train/loss,0.06700000166893005
57,train/loss,0.2705000042915344
58,train/loss,0.05950000137090683
59,train/loss,0.16619999706745148
60,train/loss,0.06260000169277191
61,train/loss,0.09160000085830688
62,train/loss,0.04439999908208847
63,train/loss,0.04879999905824661
64,train/loss,0.04740000143647194
65,train/loss,0.06679999828338623
66,train/loss,0.26919999718666077
67,train/loss,0.09839999675750732
68,train/loss,0.14550000429153442
69,train/loss,0.05649999901652336
70,train/loss,0.16910000145435333
71,train/loss,0.1378999948501587
72,train/loss,0.08219999819993973
73,train/loss,0.06080000102519989
74,train/loss,0.048700001090765
75,train/loss,0.08510000258684158
76,train/loss,0.07100000232458115
77,train/loss,0.03660000115633011
78,train/loss,0.08009999990463257
79,train/loss,0.155799999833107
80,train/loss,0.13330000638961792
81,train/loss,0.2955000102519989
82,train/loss,0.0714000016450882
83,train/loss,0.07829999923706055
84,train/loss,0.04340000078082085
85,train/loss,0.2800000011920929
86,train/loss,0.08619999885559082
87,train/loss,0.04170000180602074
88,train/loss,0.2084999978542328
89,train/loss,0.06350000202655792
90,train/loss,0.04170000180602074
91,train/loss,0.03869999945163727
92,train/loss,0.06599999964237213
93,train/loss,0.3264000117778778
94,train/loss,0.24709999561309814
95,train/loss,0.11999999731779099
96,train/loss,0.04479999840259552
97,train/loss,0.12929999828338623
98,train/loss,0.21879999339580536
99,train/loss,0.11020000278949738
100,train/loss,0.15629999339580536
101,train/loss,0.03739999979734421
102,train/loss,0.06440000236034393
103,train/loss,0.14219999313354492
104,train/loss,0.18799999356269836
105,train/loss,0.08229999989271164
106,train/loss,0.1111999973654747
107,train/loss,0.1898999959230423
108,train/loss,0.06040000170469284
109,train/loss,0.2687999904155731
110,train/loss,0.09390000253915787
111,train/loss,0.07119999825954437
112,train/loss,0.0406000018119812
113,train/loss,0.1762000024318695
114,train/loss,0.05689999833703041
115,train/loss,0.12970000505447388
116,train/loss,0.29440000653266907
117,train/loss,0.12470000237226486
118,train/loss,0.02979999966919422
119,train/loss,0.06239999830722809
120,train/loss,0.23989999294281006
121,train/loss,0.07479999959468842
122,train/loss,0.02630000002682209
123,train/loss,0.03530000150203705
124,train/loss,0.06710000336170197
125,train/loss,0.023499999195337296
126,train/loss,0.042899999767541885
127,train/loss,0.07159999758005142
128,train/loss,0.049400001764297485
129,train/loss,0.07349999994039536
130,train/loss,0.12430000305175781
131,train/loss,0.07609999924898148
132,train/loss,0.026799999177455902
133,train/loss,0.14350000023841858
134,train/loss,0.03799999877810478
135,train/loss,0.13660000264644623
136,train/loss,0.10300000011920929
137,train/loss,0.02199999988079071
138,train/loss,0.021299999207258224
139,train/loss,0.065700002014637
140,train/loss,0.14300000667572021
141,train/loss,0.12280000001192093
142,train/loss,0.11800000071525574
143,train/loss,0.25130000710487366
144,train/loss,0.03680000081658363
145,train/loss,0.29589998722076416
146,train/loss,0.09939999878406525
147,train/loss,0.04439999908208847
148,train/loss,0.2558000087738037
149,train/loss,0.07010000199079514
150,train/loss,0.11400000005960464
151,train/loss,0.04859999939799309
152,train/loss,0.06480000168085098
153,train/loss,0.02759999968111515
154,train/loss,0.06620000302791595
155,train/loss,0.023600000888109207
156,train/loss,0.07090000063180923
157,train/loss,0.08810000121593475
158,train/loss,0.02539999969303608
159,train/loss,0.03280000016093254
160,train/loss,0.038600001484155655
161,train/loss,0.05649999901652336
162,train/loss,0.07670000195503235
163,train/loss,0.04410000145435333
164,train/loss,0.16189999878406525
165,train/loss,0.0731000006198883
166,train/loss,0.04729999974370003
167,train/loss,0.04320000112056732
168,train/loss,0.18440000712871552
169,train/loss,0.13500000536441803
170,train/loss,0.054099999368190765
171,train/loss,0.06669999659061432
172,train/loss,0.06809999793767929
173,train/loss,0.0348999984562397
174,train/loss,0.20329999923706055
175,train/loss,0.09730000048875809
176,train/loss,0.15379999577999115
177,train/loss,0.08789999783039093
178,train/loss,0.12950000166893005
179,train/loss,0.060499999672174454
180,train/loss,0.037700001150369644
181,train/loss,0.22210000455379486
182,train/loss,0.09939999878406525
183,train/loss,0.03530000150203705
184,train/loss,0.04019999876618385
185,train/loss,0.035599999129772186
186,train/loss,0.05640000104904175
187,train/loss,0.02319999970495701
188,train/loss,0.22840000689029694
189,train/loss,0.09480000287294388
190,train/loss,0.12600000202655792
191,train/loss,0.05339999869465828
192,train/loss,0.03970000147819519
193,train/loss,0.06509999930858612
194,train/loss,0.20880000293254852
195,train/loss,0.04540000110864639
196,train/loss,0.13660000264644623
197,train/loss,0.03999999910593033
198,train/loss,0.03400000184774399
199,train/loss,0.04569999873638153
200,train/loss,0.024299999698996544
201,train/loss,0.08829999715089798
202,train/loss,0.057100001722574234
203,train/loss,0.07739999890327454
204,train/loss,0.020800000056624413
205,train/loss,0.02979999966919422
206,train/loss,0.03909999877214432
207,train/loss,0.0632999986410141
208,train/loss,0.08969999849796295
209,train/loss,0.10930000245571136
210,train/loss,0.06849999725818634
211,train/loss,0.07779999822378159
212,train/loss,0.10639999806880951
213,train/loss,0.15649999678134918
214,train/loss,0.03970000147819519
215,train/loss,0.28279998898506165
216,train/loss,0.04800000041723251
217,train/loss,0.11779999732971191
218,train/loss,0.16850000619888306
219,train/loss,0.08760000020265579
220,train/loss,0.21050000190734863
221,train/loss,0.06650000065565109
222,train/loss,0.043699998408555984
223,train/loss,0.038100000470876694
224,train/loss,0.04670000076293945
225,train/loss,0.026499999687075615
226,train/loss,0.11599999666213989
227,train/loss,0.019700000062584877
228,train/loss,0.12210000306367874
229,train/loss,0.019200000911951065
230,train/loss,0.032600000500679016
231,train/loss,0.17020000517368317
232,train/loss,0.034299999475479126
233,train/loss,0.040300000458955765
234,train/loss,0.0203000009059906
235,train/loss,0.06430000066757202
236,train/loss,0.03359999880194664
237,train/loss,0.023399999365210533
238,train/loss,0.21960000693798065
239,train/loss,0.08959999680519104
240,train/loss,0.015799999237060547
241,train/loss,0.1225999966263771
242,train/loss,0.19529999792575836
243,train/loss,0.0340999998152256
244,train/loss,0.02539999969303608
245,train/loss,0.03180000185966492
246,train/loss,0.02850000001490116
247,train/loss,0.05090000107884407
248,train/loss,0.042100001126527786
249,train/loss,0.1111999973654747
250,train/loss,0.22550000250339508
251,train/loss,0.13259999454021454
252,train/loss,0.19099999964237213
253,train/loss,0.037700001150369644
254,train/loss,0.10769999772310257
255,train/loss,0.10890000313520432
256,train/loss,0.02539999969303608
257,train/loss,0.2759000062942505
258,train/loss,0.14550000429153442
259,train/loss,0.014299999922513962
260,train/loss,0.06520000100135803
261,train/loss,0.02810000069439411
262,train/loss,0.05909999832510948
263,train/loss,0.053300000727176666
264,train/loss,0.17159999907016754
265,train/loss,0.03500000014901161
266,train/loss,0.01720000058412552
267,train/loss,0.08160000294446945
268,train/loss,0.12520000338554382
269,train/loss,0.03880000114440918
270,train/loss,0.03099999949336052
271,train/loss,0.02199999988079071
272,train/loss,0.029100000858306885
273,train/loss,0.04899999871850014
274,train/loss,0.0272000003606081
275,train/loss,0.03280000016093254
276,train/loss,0.02979999966919422
277,train/loss,0.027699999511241913
278,train/loss,0.12630000710487366
279,train/loss,0.02290000021457672
280,train/loss,0.04089999943971634
281,train/loss,0.11630000174045563
282,train/loss,0.040300000458955765
283,train/loss,0.05620000138878822
284,train/loss,0.05900000035762787
285,train/loss,0.03280000016093254
286,train/loss,0.07840000092983246
287,train/loss,0.05260000005364418
288,train/loss,0.06310000270605087
289,train/loss,0.025599999353289604
290,train/loss,0.1615000069141388
291,train/loss,0.05609999969601631
292,train/loss,0.12309999763965607
293,train/loss,0.06499999761581421
294,train/loss,0.25290000438690186
295,train/loss,0.2467000037431717
296,train/loss,0.024399999529123306
297,train/loss,0.019899999722838402
298,train/loss,0.026000000536441803
299,train/loss,0.05050000175833702
300,train/loss,0.23579999804496765
1,train/grad_norm,1.310157060623169
2,train/grad_norm,0.8762294054031372
3,train/grad_norm,1.103123426437378
4,train/grad_norm,0.4031705856323242
5,train/grad_norm,0.3687038719654083
6,train/grad_norm,0.4420192837715149
7,train/grad_norm,0.7848347425460815
8,train/grad_norm,0.6714547872543335
9,train/grad_norm,0.5485823154449463
10,train/grad_norm,0.7380051016807556
11,train/grad_norm,1.0762314796447754
12,train/grad_norm,1.0206518173217773
13,train/grad_norm,0.9150661826133728
14,train/grad_norm,0.3120920956134796
15,train/grad_norm,0.4578137695789337
16,train/grad_norm,1.086075782775879
17,train/grad_norm,0.38811028003692627
18,train/grad_norm,0.8870437741279602
19,train/grad_norm,0.4862920343875885
20,train/grad_norm,0.6127243638038635
21,train/grad_norm,0.9206817746162415
22,train/grad_norm,0.9547386169433594
23,train/grad_norm,1.0457606315612793
24,train/grad_norm,0.5537106394767761
25,train/grad_norm,0.355974406003952
26,train/grad_norm,0.8184528946876526
27,train/grad_norm,0.6951289772987366
28,train/grad_norm,0.5465867519378662
29,train/grad_norm,0.500764787197113
30,train/grad_norm,0.6057891249656677
31,train/grad_norm,0.4612881541252136
32,train/grad_norm,0.5472504496574402
33,train/grad_norm,0.34735357761383057
34,train/grad_norm,0.42485132813453674
35,train/grad_norm,0.3333168923854828
36,train/grad_norm,0.6150598526000977
37,train/grad_norm,0.686758279800415
38,train/grad_norm,0.5442423224449158
39,train/grad_norm,0.6166243553161621
40,train/grad_norm,0.6964560151100159
41,train/grad_norm,0.3167784512042999
42,train/grad_norm,0.26461735367774963
43,train/grad_norm,0.7432738542556763
44,train/grad_norm,0.5962894558906555
45,train/grad_norm,0.47073256969451904
46,train/grad_norm,0.468975692987442
47,train/grad_norm,0.407836377620697
48,train/grad_norm,0.28007858991622925
49,train/grad_norm,0.4901421070098877
50,train/grad_norm,0.3457321226596832
51,train/grad_norm,0.46761858463287354
52,train/grad_norm,0.3640773296356201
53,train/grad_norm,0.5866361856460571
54,train/grad_norm,0.6063798666000366
55,train/grad_norm,0.715307354927063
56,train/grad_norm,0.5923500657081604
57,train/grad_norm,0.3122275471687317
58,train/grad_norm,0.41443800926208496
59,train/grad_norm,0.44836553931236267
60,train/grad_norm,0.5269849300384521
61,train/grad_norm,0.48071831464767456
62,train/grad_norm,0.5031229853630066
63,train/grad_norm,0.40218788385391235
64,train/grad_norm,0.3493518829345703
65,train/grad_norm,0.773249089717865
66,train/grad_norm,0.4527949392795563
67,train/grad_norm,0.44552892446517944
68,train/grad_norm,0.3015994429588318
69,train/grad_norm,0.5849971771240234
70,train/grad_norm,0.4137493669986725
71,train/grad_norm,0.38918811082839966
72,train/grad_norm,0.2537709176540375
73,train/grad_norm,0.40932586789131165
74,train/grad_norm,1.0400447845458984
75,train/grad_norm,0.40044084191322327
76,train/grad_norm,0.476725697517395
77,train/grad_norm,0.5216559171676636
78,train/grad_norm,0.4120185375213623
79,train/grad_norm,0.7670368552207947
80,train/grad_norm,1.0645334720611572
81,train/grad_norm,0.4198255240917206
82,train/grad_norm,0.3559492528438568
83,train/grad_norm,0.3995186686515808
84,train/grad_norm,0.49759089946746826
85,train/grad_norm,0.30664777755737305
86,train/grad_norm,0.2356589138507843
87,train/grad_norm,0.3434542417526245
88,train/grad_norm,0.34894606471061707
89,train/grad_norm,0.5416489839553833
90,train/grad_norm,0.47014451026916504
91,train/grad_norm,0.6770207285881042
92,train/grad_norm,0.5331751704216003
93,train/grad_norm,0.3618960976600647
94,train/grad_norm,0.3579338788986206
95,train/grad_norm,0.4588044285774231
96,train/grad_norm,0.3162519633769989
97,train/grad_norm,0.3362411856651306
98,train/grad_norm,0.3062322437763214
99,train/grad_norm,0.22108927369117737
100,train/grad_norm,0.3751974403858185
101,train/grad_norm,0.29529809951782227
102,train/grad_norm,0.3138989508152008
103,train/grad_norm,0.2436351627111435
104,train/grad_norm,0.2646130323410034
105,train/grad_norm,0.4096413850784302
106,train/grad_norm,0.3745691776275635
107,train/grad_norm,0.25477102398872375
108,train/grad_norm,0.2848750352859497
109,train/grad_norm,0.25531402230262756
110,train/grad_norm,0.29235339164733887
111,train/grad_norm,0.1634378880262375
112,train/grad_norm,0.4769761264324188
113,train/grad_norm,0.35936713218688965
114,train/grad_norm,0.5061909556388855
115,train/grad_norm,0.23281969130039215
116,train/grad_norm,0.3547874987125397
117,train/grad_norm,0.18354934453964233
118,train/grad_norm,0.4450552463531494
119,train/grad_norm,0.26105719804763794
120,train/grad_norm,0.30695024132728577
121,train/grad_norm,0.31565091013908386
122,train/grad_norm,0.27315640449523926
123,train/grad_norm,0.22795669734477997
124,train/grad_norm,0.40067094564437866
125,train/grad_norm,0.4020497500896454
126,train/grad_norm,0.25916874408721924
127,train/grad_norm,0.29697248339653015
128,train/grad_norm,0.21390436589717865
129,train/grad_norm,0.3923981785774231
130,train/grad_norm,0.22433459758758545
131,train/grad_norm,0.2440398782491684
132,train/grad_norm,0.30074676871299744
133,train/grad_norm,0.43313542008399963
134,train/grad_norm,0.2762071192264557
135,train/grad_norm,0.2730065882205963
136,train/grad_norm,0.28885164856910706
137,train/grad_norm,0.2609165608882904
138,train/grad_norm,0.20484726130962372
139,train/grad_norm,0.3910365104675293
140,train/grad_norm,0.19921422004699707
141,train/grad_norm,0.2130604237318039
142,train/grad_norm,0.1976860910654068
143,train/grad_norm,0.25066858530044556
144,train/grad_norm,0.316147118806839
145,train/grad_norm,0.3024340271949768
146,train/grad_norm,0.2881547212600708
147,train/grad_norm,0.2918285131454468
148,train/grad_norm,0.24371275305747986
149,train/grad_norm,0.24641819298267365
150,train/grad_norm,0.21392391622066498
151,train/grad_norm,0.2348633110523224
152,train/grad_norm,0.1527775228023529
153,train/grad_norm,0.208322674036026
154,train/grad_norm,0.4359774887561798
155,train/grad_norm,0.23503901064395905
156,train/grad_norm,0.23023517429828644
157,train/grad_norm,0.2223680466413498
158,train/grad_norm,0.19923770427703857
159,train/grad_norm,0.21595212817192078
160,train/grad_norm,0.27023494243621826
161,train/grad_norm,0.2985682785511017
162,train/grad_norm,0.5191012024879456
163,train/grad_norm,0.23385347425937653
164,train/grad_norm,0.22168700397014618
165,train/grad_norm,0.2124481350183487
166,train/grad_norm,0.3224635124206543
167,train/grad_norm,0.3050574064254761
168,train/grad_norm,0.5026931166648865
169,train/grad_norm,0.4003990590572357
170,train/grad_norm,0.338453471660614
171,train/grad_norm,0.38701218366622925
172,train/grad_norm,0.3195878863334656
173,train/grad_norm,0.2898041903972626
174,train/grad_norm,0.21800963580608368
175,train/grad_norm,0.35008659958839417
176,train/grad_norm,0.2521171569824219
177,train/grad_norm,0.33528992533683777
178,train/grad_norm,0.32698383927345276
179,train/grad_norm,0.19511686265468597
180,train/grad_norm,0.19939309358596802
181,train/grad_norm,0.20869013667106628
182,train/grad_norm,0.2498246133327484
183,train/grad_norm,0.22440896928310394
184,train/grad_norm,0.22702176868915558
185,train/grad_norm,0.20608901977539062
186,train/grad_norm,0.1938130259513855
187,train/grad_norm,0.2032405585050583
188,train/grad_norm,0.20689493417739868
189,train/grad_norm,0.3271888196468353
190,train/grad_norm,0.22711876034736633
191,train/grad_norm,0.24756121635437012
192,train/grad_norm,0.3257841169834137
193,train/grad_norm,0.2042284607887268
194,train/grad_norm,0.3497464656829834
195,train/grad_norm,0.28205013275146484
196,train/grad_norm,0.3080623149871826
197,train/grad_norm,0.2046324908733368
198,train/grad_norm,0.1902780383825302
199,train/grad_norm,0.46449410915374756
200,train/grad_norm,0.19420555233955383
201,train/grad_norm,0.31131359934806824
202,train/grad_norm,0.4071738123893738
203,train/grad_norm,0.33250248432159424
204,train/grad_norm,0.14547620713710785
205,train/grad_norm,0.24527162313461304
206,train/grad_norm,0.2907760739326477
207,train/grad_norm,0.23702549934387207
208,train/grad_norm,0.35554951429367065
209,train/grad_norm,0.21560780704021454
210,train/grad_norm,0.3574792444705963
211,train/grad_norm,0.3570261597633362
212,train/grad_norm,0.2681679129600525
213,train/grad_norm,0.20723576843738556
214,train/grad_norm,0.2754095792770386
215,train/grad_norm,0.44821158051490784
216,train/grad_norm,0.2490222454071045
217,train/grad_norm,0.2037418633699417
218,train/grad_norm,0.294144868850708
219,train/grad_norm,0.33180510997772217
220,train/grad_norm,0.3020341396331787
221,train/grad_norm,0.19687941670417786
222,train/grad_norm,0.34413403272628784
223,train/grad_norm,0.19745755195617676
224,train/grad_norm,0.24508166313171387
225,train/grad_norm,0.2732453942298889
226,train/grad_norm,0.19976098835468292
227,train/grad_norm,0.20760135352611542
228,train/grad_norm,0.26166555285453796
229,train/grad_norm,0.1838250458240509
230,train/grad_norm,0.22971545159816742
231,train/grad_norm,0.3511541187763214
232,train/grad_norm,0.19890530407428741
233,train/grad_norm,0.3590972423553467
234,train/grad_norm,0.21345409750938416
235,train/grad_norm,0.24919423460960388
236,train/grad_norm,0.34685665369033813
237,train/grad_norm,0.2332027703523636
238,train/grad_norm,0.2665364444255829
239,train/grad_norm,0.23730438947677612
240,train/grad_norm,0.4134034216403961
241,train/grad_norm,0.3299880623817444
242,train/grad_norm,0.22120164334774017
243,train/grad_norm,0.33758851885795593
244,train/grad_norm,0.24564582109451294
245,train/grad_norm,0.2612188458442688
246,train/grad_norm,0.3086516261100769
247,train/grad_norm,0.26228097081184387
248,train/grad_norm,0.2885100543498993
249,train/grad_norm,0.36718347668647766
250,train/grad_norm,0.2514599561691284
251,train/grad_norm,0.17893268167972565
252,train/grad_norm,0.2774317264556885
253,train/grad_norm,0.26615163683891296
254,train/grad_norm,0.18792612850666046
255,train/grad_norm,0.3804665505886078
256,train/grad_norm,0.2213275134563446
257,train/grad_norm,0.30594292283058167
258,train/grad_norm,0.281750351190567
259,train/grad_norm,0.19826941192150116
260,train/grad_norm,0.2275124043226242
261,train/grad_norm,0.3804418444633484
262,train/grad_norm,0.28934434056282043
263,train/grad_norm,0.23434607684612274
264,train/grad_norm,0.2864968180656433
265,train/grad_norm,0.2831440269947052
266,train/grad_norm,0.2557048201560974
267,train/grad_norm,0.3298698961734772
268,train/grad_norm,0.24779868125915527
269,train/grad_norm,0.26481810212135315
270,train/grad_norm,0.26402294635772705
271,train/grad_norm,0.23054324090480804
272,train/grad_norm,0.3294547200202942
273,train/grad_norm,0.2804708480834961
274,train/grad_norm,0.18468128144741058
275,train/grad_norm,0.2634130120277405
276,train/grad_norm,0.32066068053245544
277,train/grad_norm,0.2752625644207001
278,train/grad_norm,0.32916873693466187
279,train/grad_norm,0.3011398911476135
280,train/grad_norm,0.22506611049175262
281,train/grad_norm,0.27051204442977905
282,train/grad_norm,0.3347536325454712
283,train/grad_norm,0.16855281591415405
284,train/grad_norm,0.22908349335193634
285,train/grad_norm,0.25859981775283813
286,train/grad_norm,0.2758595049381256
287,train/grad_norm,0.38509222865104675
288,train/grad_norm,0.2811231017112732
289,train/grad_norm,0.27060815691947937
290,train/grad_norm,0.4892803132534027
291,train/grad_norm,0.21792785823345184
292,train/grad_norm,0.25555869936943054
293,train/grad_norm,0.1847299188375473
294,train/grad_norm,0.27924594283103943
295,train/grad_norm,0.32620444893836975
296,train/grad_norm,0.2931174635887146
297,train/grad_norm,0.22610945999622345
298,train/grad_norm,0.22942282259464264
299,train/grad_norm,0.24946831166744232
300,train/grad_norm,0.27229440212249756
1,train/learning_rate,9.999999747378752e-05
2,train/learning_rate,9.966666402760893e-05
3,train/learning_rate,9.933333058143035e-05
4,train/learning_rate,9.899999713525176e-05
5,train/learning_rate,9.866666368907318e-05
6,train/learning_rate,9.833333024289459e-05
7,train/learning_rate,9.7999996796716e-05
8,train/learning_rate,9.766666335053742e-05
9,train/learning_rate,9.733332990435883e-05
10,train/learning_rate,9.699999645818025e-05
11,train/learning_rate,9.666667028795928e-05
12,train/learning_rate,9.633333684178069e-05
13,train/learning_rate,9.600000339560211e-05
14,train/learning_rate,9.566666994942352e-05
15,train/learning_rate,9.533333650324494e-05
16,train/learning_rate,9.500000305706635e-05
17,train/learning_rate,9.466666961088777e-05
18,train/learning_rate,9.433333616470918e-05
19,train/learning_rate,9.40000027185306e-05
20,train/learning_rate,9.366666927235201e-05
21,train/learning_rate,9.333333582617342e-05
22,train/learning_rate,9.300000237999484e-05
23,train/learning_rate,9.266666893381625e-05
24,train/learning_rate,9.233333548763767e-05
25,train/learning_rate,9.200000204145908e-05
26,train/learning_rate,9.16666685952805e-05
27,train/learning_rate,9.133333514910191e-05
28,train/learning_rate,9.100000170292333e-05
29,train/learning_rate,9.066666825674474e-05
30,train/learning_rate,9.033333481056616e-05
31,train/learning_rate,9.000000136438757e-05
32,train/learning_rate,8.966666791820899e-05
33,train/learning_rate,8.93333344720304e-05
34,train/learning_rate,8.900000102585182e-05
35,train/learning_rate,8.866666757967323e-05
36,train/learning_rate,8.833333413349465e-05
37,train/learning_rate,8.800000068731606e-05
38,train/learning_rate,8.766666724113747e-05
39,train/learning_rate,8.733333379495889e-05
40,train/learning_rate,8.70000003487803e-05
41,train/learning_rate,8.666666690260172e-05
42,train/learning_rate,8.633333345642313e-05
43,train/learning_rate,8.600000001024455e-05
44,train/learning_rate,8.566666656406596e-05
45,train/learning_rate,8.533333311788738e-05
46,train/learning_rate,8.499999967170879e-05
47,train/learning_rate,8.466666622553021e-05
48,train/learning_rate,8.433333277935162e-05
49,train/learning_rate,8.399999933317304e-05
50,train/learning_rate,8.366666588699445e-05
51,train/learning_rate,8.333333244081587e-05
52,train/learning_rate,8.299999899463728e-05
53,train/learning_rate,8.26666655484587e-05
54,train/learning_rate,8.233333210228011e-05
55,train/learning_rate,8.199999865610152e-05
56,train/learning_rate,8.166666520992294e-05
57,train/learning_rate,8.133333176374435e-05
58,train/learning_rate,8.099999831756577e-05
59,train/learning_rate,8.066666487138718e-05
60,train/learning_rate,8.03333314252086e-05
61,train/learning_rate,7.999999797903001e-05
62,train/learning_rate,7.966666453285143e-05
63,train/learning_rate,7.933333108667284e-05
64,train/learning_rate,7.899999764049426e-05
65,train/learning_rate,7.866666419431567e-05
66,train/learning_rate,7.833333074813709e-05
67,train/learning_rate,7.79999973019585e-05
68,train/learning_rate,7.766666385577992e-05
69,train/learning_rate,7.733333040960133e-05
70,train/learning_rate,7.699999696342275e-05
71,train/learning_rate,7.666666351724416e-05
72,train/learning_rate,7.633333007106557e-05
73,train/learning_rate,7.599999662488699e-05
74,train/learning_rate,7.56666631787084e-05
75,train/learning_rate,7.533332973252982e-05
76,train/learning_rate,7.500000356230885e-05
77,train/learning_rate,7.466667011613026e-05
78,train/learning_rate,7.433333666995168e-05
79,train/learning_rate,7.400000322377309e-05
80,train/learning_rate,7.36666697775945e-05
81,train/learning_rate,7.333333633141592e-05
82,train/learning_rate,7.300000288523734e-05
83,train/learning_rate,7.266666943905875e-05
84,train/learning_rate,7.233333599288017e-05
85,train/learning_rate,7.200000254670158e-05
86,train/learning_rate,7.1666669100523e-05
87,train/learning_rate,7.133333565434441e-05
88,train/learning_rate,7.100000220816582e-05
89,train/learning_rate,7.066666876198724e-05
90,train/learning_rate,7.033333531580865e-05
91,train/learning_rate,7.000000186963007e-05
92,train/learning_rate,6.966666842345148e-05
93,train/learning_rate,6.93333349772729e-05
94,train/learning_rate,6.900000153109431e-05
95,train/learning_rate,6.866666808491573e-05
96,train/learning_rate,6.833333463873714e-05
97,train/learning_rate,6.800000119255856e-05
98,train/learning_rate,6.766666774637997e-05
99,train/learning_rate,6.733333430020139e-05
100,train/learning_rate,6.70000008540228e-05
101,train/learning_rate,6.666666740784422e-05
102,train/learning_rate,6.633333396166563e-05
103,train/learning_rate,6.600000051548705e-05
104,train/learning_rate,6.566666706930846e-05
105,train/learning_rate,6.533333362312987e-05
106,train/learning_rate,6.500000017695129e-05
107,train/learning_rate,6.46666667307727e-05
108,train/learning_rate,6.433333328459412e-05
109,train/learning_rate,6.399999983841553e-05
110,train/learning_rate,6.366666639223695e-05
111,train/learning_rate,6.333333294605836e-05
112,train/learning_rate,6.299999949987978e-05
113,train/learning_rate,6.266666605370119e-05
114,train/learning_rate,6.233333260752261e-05
115,train/learning_rate,6.199999916134402e-05
116,train/learning_rate,6.166666571516544e-05
117,train/learning_rate,6.133333226898685e-05
118,train/learning_rate,6.0999998822808266e-05
119,train/learning_rate,6.066666537662968e-05
120,train/learning_rate,6.0333331930451095e-05
121,train/learning_rate,5.999999848427251e-05
122,train/learning_rate,5.9666665038093925e-05
123,train/learning_rate,5.933333159191534e-05
124,train/learning_rate,5.900000178371556e-05
125,train/learning_rate,5.8666668337536976e-05
126,train/learning_rate,5.833333489135839e-05
127,train/learning_rate,5.8000001445179805e-05
128,train/learning_rate,5.766666799900122e-05
129,train/learning_rate,5.7333334552822635e-05
130,train/learning_rate,5.700000110664405e-05
131,train/learning_rate,5.6666667660465464e-05
132,train/learning_rate,5.633333421428688e-05
133,train/learning_rate,5.6000000768108293e-05
134,train/learning_rate,5.566666732192971e-05
135,train/learning_rate,5.533333387575112e-05
136,train/learning_rate,5.500000042957254e-05
137,train/learning_rate,5.466666698339395e-05
138,train/learning_rate,5.433333353721537e-05
139,train/learning_rate,5.400000009103678e-05
140,train/learning_rate,5.3666666644858196e-05
141,train/learning_rate,5.333333319867961e-05
142,train/learning_rate,5.2999999752501026e-05
143,train/learning_rate,5.266666630632244e-05
144,train/learning_rate,5.2333332860143855e-05
145,train/learning_rate,5.199999941396527e-05
146,train/learning_rate,5.1666665967786685e-05
147,train/learning_rate,5.13333325216081e-05
148,train/learning_rate,5.0999999075429514e-05
149,train/learning_rate,5.066666562925093e-05
150,train/learning_rate,5.0333332183072343e-05
151,train/learning_rate,4.999999873689376e-05
152,train/learning_rate,4.966666529071517e-05
153,train/learning_rate,4.933333184453659e-05
154,train/learning_rate,4.8999998398358e-05
155,train/learning_rate,4.866666495217942e-05
156,train/learning_rate,4.833333514397964e-05
157,train/learning_rate,4.8000001697801054e-05
158,train/learning_rate,4.766666825162247e-05
159,train/learning_rate,4.733333480544388e-05
160,train/learning_rate,4.70000013592653e-05
161,train/learning_rate,4.666666791308671e-05
162,train/learning_rate,4.633333446690813e-05
163,train/learning_rate,4.600000102072954e-05
164,train/learning_rate,4.5666667574550956e-05
165,train/learning_rate,4.533333412837237e-05
166,train/learning_rate,4.5000000682193786e-05
167,train/learning_rate,4.46666672360152e-05
168,train/learning_rate,4.4333333789836615e-05
169,train/learning_rate,4.400000034365803e-05
170,train/learning_rate,4.3666666897479445e-05
171,train/learning_rate,4.333333345130086e-05
172,train/learning_rate,4.3000000005122274e-05
173,train/learning_rate,4.266666655894369e-05
174,train/learning_rate,4.2333333112765104e-05
175,train/learning_rate,4.199999966658652e-05
176,train/learning_rate,4.166666622040793e-05
177,train/learning_rate,4.133333277422935e-05
178,train/learning_rate,4.099999932805076e-05
179,train/learning_rate,4.066666588187218e-05
180,train/learning_rate,4.033333243569359e-05
181,train/learning_rate,3.9999998989515007e-05
182,train/learning_rate,3.966666554333642e-05
183,train/learning_rate,3.9333332097157836e-05
184,train/learning_rate,3.899999865097925e-05
185,train/learning_rate,3.8666665204800665e-05
186,train/learning_rate,3.833333175862208e-05
187,train/learning_rate,3.7999998312443495e-05
188,train/learning_rate,3.766666486626491e-05
189,train/learning_rate,3.733333505806513e-05
190,train/learning_rate,3.7000001611886546e-05
191,train/learning_rate,3.666666816570796e-05
192,train/learning_rate,3.6333334719529375e-05
193,train/learning_rate,3.600000127335079e-05
194,train/learning_rate,3.5666667827172205e-05
195,train/learning_rate,3.533333438099362e-05
196,train/learning_rate,3.5000000934815034e-05
197,train/learning_rate,3.466666748863645e-05
198,train/learning_rate,3.4333334042457864e-05
199,train/learning_rate,3.400000059627928e-05
200,train/learning_rate,3.366666715010069e-05
201,train/learning_rate,3.333333370392211e-05
202,train/learning_rate,3.300000025774352e-05
203,train/learning_rate,3.266666681156494e-05
204,train/learning_rate,3.233333336538635e-05
205,train/learning_rate,3.199999991920777e-05
206,train/learning_rate,3.166666647302918e-05
207,train/learning_rate,3.1333333026850596e-05
208,train/learning_rate,3.099999958067201e-05
209,train/learning_rate,3.0666666134493425e-05
210,train/learning_rate,3.033333268831484e-05
211,train/learning_rate,2.9999999242136255e-05
212,train/learning_rate,2.966666579595767e-05
213,train/learning_rate,2.9333334168768488e-05
214,train/learning_rate,2.9000000722589903e-05
215,train/learning_rate,2.8666667276411317e-05
216,train/learning_rate,2.8333333830232732e-05
217,train/learning_rate,2.8000000384054147e-05
218,train/learning_rate,2.766666693787556e-05
219,train/learning_rate,2.7333333491696976e-05
220,train/learning_rate,2.700000004551839e-05
221,train/learning_rate,2.6666666599339806e-05
222,train/learning_rate,2.633333315316122e-05
223,train/learning_rate,2.5999999706982635e-05
224,train/learning_rate,2.566666626080405e-05
225,train/learning_rate,2.5333332814625464e-05
226,train/learning_rate,2.499999936844688e-05
227,train/learning_rate,2.4666665922268294e-05
228,train/learning_rate,2.433333247608971e-05
229,train/learning_rate,2.4000000848900527e-05
230,train/learning_rate,2.366666740272194e-05
231,train/learning_rate,2.3333333956543356e-05
232,train/learning_rate,2.300000051036477e-05
233,train/learning_rate,2.2666667064186186e-05
234,train/learning_rate,2.23333336180076e-05
235,train/learning_rate,2.2000000171829015e-05
236,train/learning_rate,2.166666672565043e-05
237,train/learning_rate,2.1333333279471844e-05
238,train/learning_rate,2.099999983329326e-05
239,train/learning_rate,2.0666666387114674e-05
240,train/learning_rate,2.033333294093609e-05
241,train/learning_rate,1.9999999494757503e-05
242,train/learning_rate,1.9666666048578918e-05
243,train/learning_rate,1.9333332602400333e-05
244,train/learning_rate,1.8999999156221747e-05
245,train/learning_rate,1.8666667529032566e-05
246,train/learning_rate,1.833333408285398e-05
247,train/learning_rate,1.8000000636675395e-05
248,train/learning_rate,1.766666719049681e-05
249,train/learning_rate,1.7333333744318224e-05
250,train/learning_rate,1.700000029813964e-05
251,train/learning_rate,1.6666666851961054e-05
252,train/learning_rate,1.633333340578247e-05
253,train/learning_rate,1.5999999959603883e-05
254,train/learning_rate,1.5666666513425298e-05
255,train/learning_rate,1.5333333067246713e-05
256,train/learning_rate,1.4999999621068127e-05
257,train/learning_rate,1.4666667084384244e-05
258,train/learning_rate,1.4333333638205659e-05
259,train/learning_rate,1.4000000192027073e-05
260,train/learning_rate,1.3666666745848488e-05
261,train/learning_rate,1.3333333299669903e-05
262,train/learning_rate,1.2999999853491317e-05
263,train/learning_rate,1.2666666407312732e-05
264,train/learning_rate,1.2333332961134147e-05
265,train/learning_rate,1.2000000424450263e-05
266,train/learning_rate,1.1666666978271678e-05
267,train/learning_rate,1.1333333532093093e-05
268,train/learning_rate,1.1000000085914508e-05
269,train/learning_rate,1.0666666639735922e-05
270,train/learning_rate,1.0333333193557337e-05
271,train/learning_rate,9.999999747378752e-06
272,train/learning_rate,9.666666301200166e-06
273,train/learning_rate,9.333333764516283e-06
274,train/learning_rate,9.000000318337698e-06
275,train/learning_rate,8.666666872159112e-06
276,train/learning_rate,8.333333425980527e-06
277,train/learning_rate,7.999999979801942e-06
278,train/learning_rate,7.666666533623356e-06
279,train/learning_rate,7.333333542192122e-06
280,train/learning_rate,7.000000096013537e-06
281,train/learning_rate,6.666666649834951e-06
282,train/learning_rate,6.333333203656366e-06
283,train/learning_rate,6.000000212225132e-06
284,train/learning_rate,5.666666766046546e-06
285,train/learning_rate,5.333333319867961e-06
286,train/learning_rate,4.999999873689376e-06
287,train/learning_rate,4.666666882258141e-06
288,train/learning_rate,4.333333436079556e-06
289,train/learning_rate,3.999999989900971e-06
290,train/learning_rate,3.666666771096061e-06
291,train/learning_rate,3.3333333249174757e-06
292,train/learning_rate,3.000000106112566e-06
293,train/learning_rate,2.6666666599339806e-06
294,train/learning_rate,2.3333334411290707e-06
295,train/learning_rate,1.9999999949504854e-06
296,train/learning_rate,1.6666666624587378e-06
297,train/learning_rate,1.3333333299669903e-06
298,train/learning_rate,9.999999974752427e-07
299,train/learning_rate,6.666666649834951e-07
300,train/learning_rate,3.3333333249174757e-07
1,train/epoch,0.009999999776482582
2,train/epoch,0.019999999552965164
3,train/epoch,0.029999999329447746
4,train/epoch,0.03999999910593033
5,train/epoch,0.05000000074505806
6,train/epoch,0.05999999865889549
7,train/epoch,0.07000000029802322
8,train/epoch,0.07999999821186066
9,train/epoch,0.09000000357627869
10,train/epoch,0.10000000149011612
11,train/epoch,0.10999999940395355
12,train/epoch,0.11999999731779099
13,train/epoch,0.12999999523162842
14,train/epoch,0.14000000059604645
15,train/epoch,0.15000000596046448
16,train/epoch,0.1599999964237213
17,train/epoch,0.17000000178813934
18,train/epoch,0.18000000715255737
19,train/epoch,0.1899999976158142
20,train/epoch,0.20000000298023224
21,train/epoch,0.20999999344348907
22,train/epoch,0.2199999988079071
23,train/epoch,0.23000000417232513
24,train/epoch,0.23999999463558197
25,train/epoch,0.25
26,train/epoch,0.25999999046325684
27,train/epoch,0.27000001072883606
28,train/epoch,0.2800000011920929
29,train/epoch,0.28999999165534973
30,train/epoch,0.30000001192092896
31,train/epoch,0.3100000023841858
32,train/epoch,0.3199999928474426
33,train/epoch,0.33000001311302185
34,train/epoch,0.3400000035762787
35,train/epoch,0.3499999940395355
36,train/epoch,0.36000001430511475
37,train/epoch,0.3700000047683716
38,train/epoch,0.3799999952316284
39,train/epoch,0.38999998569488525
40,train/epoch,0.4000000059604645
41,train/epoch,0.4099999964237213
42,train/epoch,0.41999998688697815
43,train/epoch,0.4300000071525574
44,train/epoch,0.4399999976158142
45,train/epoch,0.44999998807907104
46,train/epoch,0.46000000834465027
47,train/epoch,0.4699999988079071
48,train/epoch,0.47999998927116394
49,train/epoch,0.49000000953674316
50,train/epoch,0.5
51,train/epoch,0.5099999904632568
52,train/epoch,0.5199999809265137
53,train/epoch,0.5299999713897705
54,train/epoch,0.5400000214576721
55,train/epoch,0.550000011920929
56,train/epoch,0.5600000023841858
57,train/epoch,0.5699999928474426
58,train/epoch,0.5799999833106995
59,train/epoch,0.5899999737739563
60,train/epoch,0.6000000238418579
61,train/epoch,0.6100000143051147
62,train/epoch,0.6200000047683716
63,train/epoch,0.6299999952316284
64,train/epoch,0.6399999856948853
65,train/epoch,0.6499999761581421
66,train/epoch,0.6600000262260437
67,train/epoch,0.6700000166893005
68,train/epoch,0.6800000071525574
69,train/epoch,0.6899999976158142
70,train/epoch,0.699999988079071
71,train/epoch,0.7099999785423279
72,train/epoch,0.7200000286102295
73,train/epoch,0.7300000190734863
74,train/epoch,0.7400000095367432
75,train/epoch,0.75
76,train/epoch,0.7599999904632568
77,train/epoch,0.7699999809265137
78,train/epoch,0.7799999713897705
79,train/epoch,0.7900000214576721
80,train/epoch,0.800000011920929
81,train/epoch,0.8100000023841858
82,train/epoch,0.8199999928474426
83,train/epoch,0.8299999833106995
84,train/epoch,0.8399999737739563
85,train/epoch,0.8500000238418579
86,train/epoch,0.8600000143051147
87,train/epoch,0.8700000047683716
88,train/epoch,0.8799999952316284
89,train/epoch,0.8899999856948853
90,train/epoch,0.8999999761581421
91,train/epoch,0.9100000262260437
92,train/epoch,0.9200000166893005
93,train/epoch,0.9300000071525574
94,train/epoch,0.9399999976158142
95,train/epoch,0.949999988079071
96,train/epoch,0.9599999785423279
97,train/epoch,0.9700000286102295
98,train/epoch,0.9800000190734863
99,train/epoch,0.9900000095367432
100,train/epoch,1.0
101,train/epoch,1.0099999904632568
102,train/epoch,1.0199999809265137
103,train/epoch,1.0299999713897705
104,train/epoch,1.0399999618530273
105,train/epoch,1.0499999523162842
106,train/epoch,1.059999942779541
107,train/epoch,1.0700000524520874
108,train/epoch,1.0800000429153442
109,train/epoch,1.090000033378601
110,train/epoch,1.100000023841858
111,train/epoch,1.1100000143051147
112,train/epoch,1.1200000047683716
113,train/epoch,1.1299999952316284
114,train/epoch,1.1399999856948853
115,train/epoch,1.149999976158142
116,train/epoch,1.159999966621399
117,train/epoch,1.1699999570846558
118,train/epoch,1.1799999475479126
119,train/epoch,1.190000057220459
120,train/epoch,1.2000000476837158
121,train/epoch,1.2100000381469727
122,train/epoch,1.2200000286102295
123,train/epoch,1.2300000190734863
124,train/epoch,1.2400000095367432
125,train/epoch,1.25
126,train/epoch,1.2599999904632568
127,train/epoch,1.2699999809265137
128,train/epoch,1.2799999713897705
129,train/epoch,1.2899999618530273
130,train/epoch,1.2999999523162842
131,train/epoch,1.309999942779541
132,train/epoch,1.3200000524520874
133,train/epoch,1.3300000429153442
134,train/epoch,1.340000033378601
135,train/epoch,1.350000023841858
136,train/epoch,1.3600000143051147
137,train/epoch,1.3700000047683716
138,train/epoch,1.3799999952316284
139,train/epoch,1.3899999856948853
140,train/epoch,1.399999976158142
141,train/epoch,1.409999966621399
142,train/epoch,1.4199999570846558
143,train/epoch,1.4299999475479126
144,train/epoch,1.440000057220459
145,train/epoch,1.4500000476837158
146,train/epoch,1.4600000381469727
147,train/epoch,1.4700000286102295
148,train/epoch,1.4800000190734863
149,train/epoch,1.4900000095367432
150,train/epoch,1.5
151,train/epoch,1.5099999904632568
152,train/epoch,1.5199999809265137
153,train/epoch,1.5299999713897705
154,train/epoch,1.5399999618530273
155,train/epoch,1.5499999523162842
156,train/epoch,1.559999942779541
157,train/epoch,1.5700000524520874
158,train/epoch,1.5800000429153442
159,train/epoch,1.590000033378601
160,train/epoch,1.600000023841858
161,train/epoch,1.6100000143051147
162,train/epoch,1.6200000047683716
163,train/epoch,1.6299999952316284
164,train/epoch,1.6399999856948853
165,train/epoch,1.649999976158142
166,train/epoch,1.659999966621399
167,train/epoch,1.6699999570846558
168,train/epoch,1.6799999475479126
169,train/epoch,1.690000057220459
170,train/epoch,1.7000000476837158
171,train/epoch,1.7100000381469727
172,train/epoch,1.7200000286102295
173,train/epoch,1.7300000190734863
174,train/epoch,1.7400000095367432
175,train/epoch,1.75
176,train/epoch,1.7599999904632568
177,train/epoch,1.7699999809265137
178,train/epoch,1.7799999713897705
179,train/epoch,1.7899999618530273
180,train/epoch,1.7999999523162842
181,train/epoch,1.809999942779541
182,train/epoch,1.8200000524520874
183,train/epoch,1.8300000429153442
184,train/epoch,1.840000033378601
185,train/epoch,1.850000023841858
186,train/epoch,1.8600000143051147
187,train/epoch,1.8700000047683716
188,train/epoch,1.8799999952316284
189,train/epoch,1.8899999856948853
190,train/epoch,1.899999976158142
191,train/epoch,1.909999966621399
192,train/epoch,1.9199999570846558
193,train/epoch,1.9299999475479126
194,train/epoch,1.940000057220459
195,train/epoch,1.9500000476837158
196,train/epoch,1.9600000381469727
197,train/epoch,1.9700000286102295
198,train/epoch,1.9800000190734863
199,train/epoch,1.9900000095367432
200,train/epoch,2.0
201,train/epoch,2.009999990463257
202,train/epoch,2.0199999809265137
203,train/epoch,2.0299999713897705
204,train/epoch,2.0399999618530273
205,train/epoch,2.049999952316284
206,train/epoch,2.059999942779541
207,train/epoch,2.069999933242798
208,train/epoch,2.0799999237060547
209,train/epoch,2.0899999141693115
210,train/epoch,2.0999999046325684
211,train/epoch,2.109999895095825
212,train/epoch,2.119999885559082
213,train/epoch,2.130000114440918
214,train/epoch,2.140000104904175
215,train/epoch,2.1500000953674316
216,train/epoch,2.1600000858306885
217,train/epoch,2.1700000762939453
218,train/epoch,2.180000066757202
219,train/epoch,2.190000057220459
220,train/epoch,2.200000047683716
221,train/epoch,2.2100000381469727
222,train/epoch,2.2200000286102295
223,train/epoch,2.2300000190734863
224,train/epoch,2.240000009536743
225,train/epoch,2.25
226,train/epoch,2.259999990463257
227,train/epoch,2.2699999809265137
228,train/epoch,2.2799999713897705
229,train/epoch,2.2899999618530273
230,train/epoch,2.299999952316284
231,train/epoch,2.309999942779541
232,train/epoch,2.319999933242798
233,train/epoch,2.3299999237060547
234,train/epoch,2.3399999141693115
235,train/epoch,2.3499999046325684
236,train/epoch,2.359999895095825
237,train/epoch,2.369999885559082
238,train/epoch,2.380000114440918
239,train/epoch,2.390000104904175
240,train/epoch,2.4000000953674316
241,train/epoch,2.4100000858306885
242,train/epoch,2.4200000762939453
243,train/epoch,2.430000066757202
244,train/epoch,2.440000057220459
245,train/epoch,2.450000047683716
246,train/epoch,2.4600000381469727
247,train/epoch,2.4700000286102295
248,train/epoch,2.4800000190734863
249,train/epoch,2.490000009536743
250,train/epoch,2.5
251,train/epoch,2.509999990463257
252,train/epoch,2.5199999809265137
253,train/epoch,2.5299999713897705
254,train/epoch,2.5399999618530273
255,train/epoch,2.549999952316284
256,train/epoch,2.559999942779541
257,train/epoch,2.569999933242798
258,train/epoch,2.5799999237060547
259,train/epoch,2.5899999141693115
260,train/epoch,2.5999999046325684
261,train/epoch,2.609999895095825
262,train/epoch,2.619999885559082
263,train/epoch,2.630000114440918
264,train/epoch,2.640000104904175
265,train/epoch,2.6500000953674316
266,train/epoch,2.6600000858306885
267,train/epoch,2.6700000762939453
268,train/epoch,2.680000066757202
269,train/epoch,2.690000057220459
270,train/epoch,2.700000047683716
271,train/epoch,2.7100000381469727
272,train/epoch,2.7200000286102295
273,train/epoch,2.7300000190734863
274,train/epoch,2.740000009536743
275,train/epoch,2.75
276,train/epoch,2.759999990463257
277,train/epoch,2.7699999809265137
278,train/epoch,2.7799999713897705
279,train/epoch,2.7899999618530273
280,train/epoch,2.799999952316284
281,train/epoch,2.809999942779541
282,train/epoch,2.819999933242798
283,train/epoch,2.8299999237060547
284,train/epoch,2.8399999141693115
285,train/epoch,2.8499999046325684
286,train/epoch,2.859999895095825
287,train/epoch,2.869999885559082
288,train/epoch,2.880000114440918
289,train/epoch,2.890000104904175
290,train/epoch,2.9000000953674316
291,train/epoch,2.9100000858306885
292,train/epoch,2.9200000762939453
293,train/epoch,2.930000066757202
294,train/epoch,2.940000057220459
295,train/epoch,2.950000047683716
296,train/epoch,2.9600000381469727
297,train/epoch,2.9700000286102295
298,train/epoch,2.9800000190734863
299,train/epoch,2.990000009536743
300,train/epoch,3.0
300,train/epoch,3.0
300,train/train_runtime,464.76129150390625
300,train/train_samples_per_second,0.6449999809265137
300,train/train_steps_per_second,0.6449999809265137
300,train/total_flos,1.1068175818948608e+16
300,train/train_loss,0.12241636216640472