Augusto777 commited on
Commit
8766c8b
·
verified ·
1 Parent(s): 11adc6f

End of training

Browse files
README.md CHANGED
@@ -32,7 +32,7 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [google/vit-base-patch16-224](https://huggingface.co/google/vit-base-patch16-224) on the imagefolder dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 1.7220
36
  - Accuracy: 0.7541
37
 
38
  ## Model description
 
32
 
33
  This model is a fine-tuned version of [google/vit-base-patch16-224](https://huggingface.co/google/vit-base-patch16-224) on the imagefolder dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 1.7212
36
  - Accuracy: 0.7541
37
 
38
  ## Model description
all_results.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 39.74,
3
+ "eval_accuracy": 0.7540983606557377,
4
+ "eval_loss": 1.7211973667144775,
5
+ "eval_runtime": 1.2098,
6
+ "eval_samples_per_second": 50.423,
7
+ "eval_steps_per_second": 1.653,
8
+ "train_loss": 0.11905086408124159,
9
+ "train_runtime": 3040.3234,
10
+ "train_samples_per_second": 64.204,
11
+ "train_steps_per_second": 0.5
12
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 39.74,
3
+ "eval_accuracy": 0.7540983606557377,
4
+ "eval_loss": 1.7211973667144775,
5
+ "eval_runtime": 1.2098,
6
+ "eval_samples_per_second": 50.423,
7
+ "eval_steps_per_second": 1.653
8
+ }
runs/May23_15-34-03_DESKTOP-SKBE9FB/events.out.tfevents.1716503100.DESKTOP-SKBE9FB.15104.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae2953b8796406566ca25a7383b7d47392a53bf590020541883048c898b8d15f
3
+ size 411
train_results.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 39.74,
3
+ "train_loss": 0.11905086408124159,
4
+ "train_runtime": 3040.3234,
5
+ "train_samples_per_second": 64.204,
6
+ "train_steps_per_second": 0.5
7
+ }
trainer_state.json ADDED
@@ -0,0 +1,1302 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.7540983606557377,
3
+ "best_model_checkpoint": "vit-base-patch16-224-R1-40\\checkpoint-994",
4
+ "epoch": 39.73856209150327,
5
+ "eval_steps": 500,
6
+ "global_step": 1520,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.26,
13
+ "learning_rate": 7.2368421052631575e-06,
14
+ "loss": 1.3841,
15
+ "step": 10
16
+ },
17
+ {
18
+ "epoch": 0.52,
19
+ "learning_rate": 1.4473684210526315e-05,
20
+ "loss": 1.3644,
21
+ "step": 20
22
+ },
23
+ {
24
+ "epoch": 0.78,
25
+ "learning_rate": 2.1710526315789474e-05,
26
+ "loss": 1.3233,
27
+ "step": 30
28
+ },
29
+ {
30
+ "epoch": 0.99,
31
+ "eval_accuracy": 0.5573770491803278,
32
+ "eval_loss": 1.2354576587677002,
33
+ "eval_runtime": 1.2109,
34
+ "eval_samples_per_second": 50.376,
35
+ "eval_steps_per_second": 1.652,
36
+ "step": 38
37
+ },
38
+ {
39
+ "epoch": 1.05,
40
+ "learning_rate": 2.894736842105263e-05,
41
+ "loss": 1.2568,
42
+ "step": 40
43
+ },
44
+ {
45
+ "epoch": 1.31,
46
+ "learning_rate": 3.618421052631579e-05,
47
+ "loss": 1.1698,
48
+ "step": 50
49
+ },
50
+ {
51
+ "epoch": 1.57,
52
+ "learning_rate": 4.342105263157895e-05,
53
+ "loss": 1.0595,
54
+ "step": 60
55
+ },
56
+ {
57
+ "epoch": 1.83,
58
+ "learning_rate": 5.0657894736842104e-05,
59
+ "loss": 0.8643,
60
+ "step": 70
61
+ },
62
+ {
63
+ "epoch": 1.99,
64
+ "eval_accuracy": 0.5901639344262295,
65
+ "eval_loss": 0.9296518564224243,
66
+ "eval_runtime": 0.9419,
67
+ "eval_samples_per_second": 64.761,
68
+ "eval_steps_per_second": 2.123,
69
+ "step": 76
70
+ },
71
+ {
72
+ "epoch": 2.09,
73
+ "learning_rate": 5.484764542936288e-05,
74
+ "loss": 0.7065,
75
+ "step": 80
76
+ },
77
+ {
78
+ "epoch": 2.35,
79
+ "learning_rate": 5.446675900277008e-05,
80
+ "loss": 0.5891,
81
+ "step": 90
82
+ },
83
+ {
84
+ "epoch": 2.61,
85
+ "learning_rate": 5.408587257617729e-05,
86
+ "loss": 0.4685,
87
+ "step": 100
88
+ },
89
+ {
90
+ "epoch": 2.88,
91
+ "learning_rate": 5.370498614958449e-05,
92
+ "loss": 0.4464,
93
+ "step": 110
94
+ },
95
+ {
96
+ "epoch": 2.98,
97
+ "eval_accuracy": 0.639344262295082,
98
+ "eval_loss": 1.1189780235290527,
99
+ "eval_runtime": 0.9517,
100
+ "eval_samples_per_second": 64.093,
101
+ "eval_steps_per_second": 2.101,
102
+ "step": 114
103
+ },
104
+ {
105
+ "epoch": 3.14,
106
+ "learning_rate": 5.332409972299169e-05,
107
+ "loss": 0.3343,
108
+ "step": 120
109
+ },
110
+ {
111
+ "epoch": 3.4,
112
+ "learning_rate": 5.294321329639889e-05,
113
+ "loss": 0.2516,
114
+ "step": 130
115
+ },
116
+ {
117
+ "epoch": 3.66,
118
+ "learning_rate": 5.256232686980609e-05,
119
+ "loss": 0.2748,
120
+ "step": 140
121
+ },
122
+ {
123
+ "epoch": 3.92,
124
+ "learning_rate": 5.21814404432133e-05,
125
+ "loss": 0.3092,
126
+ "step": 150
127
+ },
128
+ {
129
+ "epoch": 4.0,
130
+ "eval_accuracy": 0.7049180327868853,
131
+ "eval_loss": 0.986064612865448,
132
+ "eval_runtime": 0.9785,
133
+ "eval_samples_per_second": 62.339,
134
+ "eval_steps_per_second": 2.044,
135
+ "step": 153
136
+ },
137
+ {
138
+ "epoch": 4.18,
139
+ "learning_rate": 5.18005540166205e-05,
140
+ "loss": 0.1909,
141
+ "step": 160
142
+ },
143
+ {
144
+ "epoch": 4.44,
145
+ "learning_rate": 5.14196675900277e-05,
146
+ "loss": 0.2265,
147
+ "step": 170
148
+ },
149
+ {
150
+ "epoch": 4.71,
151
+ "learning_rate": 5.1038781163434903e-05,
152
+ "loss": 0.1834,
153
+ "step": 180
154
+ },
155
+ {
156
+ "epoch": 4.97,
157
+ "learning_rate": 5.0657894736842104e-05,
158
+ "loss": 0.1628,
159
+ "step": 190
160
+ },
161
+ {
162
+ "epoch": 4.99,
163
+ "eval_accuracy": 0.6721311475409836,
164
+ "eval_loss": 1.1220643520355225,
165
+ "eval_runtime": 0.9649,
166
+ "eval_samples_per_second": 63.216,
167
+ "eval_steps_per_second": 2.073,
168
+ "step": 191
169
+ },
170
+ {
171
+ "epoch": 5.23,
172
+ "learning_rate": 5.027700831024931e-05,
173
+ "loss": 0.1763,
174
+ "step": 200
175
+ },
176
+ {
177
+ "epoch": 5.49,
178
+ "learning_rate": 4.989612188365651e-05,
179
+ "loss": 0.13,
180
+ "step": 210
181
+ },
182
+ {
183
+ "epoch": 5.75,
184
+ "learning_rate": 4.9515235457063714e-05,
185
+ "loss": 0.121,
186
+ "step": 220
187
+ },
188
+ {
189
+ "epoch": 5.99,
190
+ "eval_accuracy": 0.6885245901639344,
191
+ "eval_loss": 1.170951247215271,
192
+ "eval_runtime": 0.977,
193
+ "eval_samples_per_second": 62.435,
194
+ "eval_steps_per_second": 2.047,
195
+ "step": 229
196
+ },
197
+ {
198
+ "epoch": 6.01,
199
+ "learning_rate": 4.9134349030470915e-05,
200
+ "loss": 0.1121,
201
+ "step": 230
202
+ },
203
+ {
204
+ "epoch": 6.27,
205
+ "learning_rate": 4.8753462603878116e-05,
206
+ "loss": 0.1008,
207
+ "step": 240
208
+ },
209
+ {
210
+ "epoch": 6.54,
211
+ "learning_rate": 4.837257617728532e-05,
212
+ "loss": 0.12,
213
+ "step": 250
214
+ },
215
+ {
216
+ "epoch": 6.8,
217
+ "learning_rate": 4.7991689750692524e-05,
218
+ "loss": 0.1138,
219
+ "step": 260
220
+ },
221
+ {
222
+ "epoch": 6.98,
223
+ "eval_accuracy": 0.7213114754098361,
224
+ "eval_loss": 1.199324607849121,
225
+ "eval_runtime": 0.9471,
226
+ "eval_samples_per_second": 64.409,
227
+ "eval_steps_per_second": 2.112,
228
+ "step": 267
229
+ },
230
+ {
231
+ "epoch": 7.06,
232
+ "learning_rate": 4.7610803324099725e-05,
233
+ "loss": 0.1016,
234
+ "step": 270
235
+ },
236
+ {
237
+ "epoch": 7.32,
238
+ "learning_rate": 4.7229916897506926e-05,
239
+ "loss": 0.0953,
240
+ "step": 280
241
+ },
242
+ {
243
+ "epoch": 7.58,
244
+ "learning_rate": 4.684903047091413e-05,
245
+ "loss": 0.1073,
246
+ "step": 290
247
+ },
248
+ {
249
+ "epoch": 7.84,
250
+ "learning_rate": 4.6468144044321335e-05,
251
+ "loss": 0.1124,
252
+ "step": 300
253
+ },
254
+ {
255
+ "epoch": 8.0,
256
+ "eval_accuracy": 0.6885245901639344,
257
+ "eval_loss": 1.2635865211486816,
258
+ "eval_runtime": 0.9388,
259
+ "eval_samples_per_second": 64.974,
260
+ "eval_steps_per_second": 2.13,
261
+ "step": 306
262
+ },
263
+ {
264
+ "epoch": 8.1,
265
+ "learning_rate": 4.6087257617728535e-05,
266
+ "loss": 0.0796,
267
+ "step": 310
268
+ },
269
+ {
270
+ "epoch": 8.37,
271
+ "learning_rate": 4.570637119113573e-05,
272
+ "loss": 0.0944,
273
+ "step": 320
274
+ },
275
+ {
276
+ "epoch": 8.63,
277
+ "learning_rate": 4.532548476454294e-05,
278
+ "loss": 0.0701,
279
+ "step": 330
280
+ },
281
+ {
282
+ "epoch": 8.89,
283
+ "learning_rate": 4.494459833795014e-05,
284
+ "loss": 0.0748,
285
+ "step": 340
286
+ },
287
+ {
288
+ "epoch": 8.99,
289
+ "eval_accuracy": 0.7049180327868853,
290
+ "eval_loss": 1.388106346130371,
291
+ "eval_runtime": 0.9485,
292
+ "eval_samples_per_second": 64.314,
293
+ "eval_steps_per_second": 2.109,
294
+ "step": 344
295
+ },
296
+ {
297
+ "epoch": 9.15,
298
+ "learning_rate": 4.4563711911357346e-05,
299
+ "loss": 0.0708,
300
+ "step": 350
301
+ },
302
+ {
303
+ "epoch": 9.41,
304
+ "learning_rate": 4.418282548476455e-05,
305
+ "loss": 0.1,
306
+ "step": 360
307
+ },
308
+ {
309
+ "epoch": 9.67,
310
+ "learning_rate": 4.380193905817174e-05,
311
+ "loss": 0.0566,
312
+ "step": 370
313
+ },
314
+ {
315
+ "epoch": 9.93,
316
+ "learning_rate": 4.342105263157895e-05,
317
+ "loss": 0.0877,
318
+ "step": 380
319
+ },
320
+ {
321
+ "epoch": 9.99,
322
+ "eval_accuracy": 0.7213114754098361,
323
+ "eval_loss": 1.2892450094223022,
324
+ "eval_runtime": 0.9419,
325
+ "eval_samples_per_second": 64.76,
326
+ "eval_steps_per_second": 2.123,
327
+ "step": 382
328
+ },
329
+ {
330
+ "epoch": 10.2,
331
+ "learning_rate": 4.304016620498615e-05,
332
+ "loss": 0.0929,
333
+ "step": 390
334
+ },
335
+ {
336
+ "epoch": 10.46,
337
+ "learning_rate": 4.265927977839336e-05,
338
+ "loss": 0.1008,
339
+ "step": 400
340
+ },
341
+ {
342
+ "epoch": 10.72,
343
+ "learning_rate": 4.227839335180056e-05,
344
+ "loss": 0.0762,
345
+ "step": 410
346
+ },
347
+ {
348
+ "epoch": 10.98,
349
+ "learning_rate": 4.189750692520776e-05,
350
+ "loss": 0.0642,
351
+ "step": 420
352
+ },
353
+ {
354
+ "epoch": 10.98,
355
+ "eval_accuracy": 0.7049180327868853,
356
+ "eval_loss": 1.3759475946426392,
357
+ "eval_runtime": 0.9604,
358
+ "eval_samples_per_second": 63.518,
359
+ "eval_steps_per_second": 2.083,
360
+ "step": 420
361
+ },
362
+ {
363
+ "epoch": 11.24,
364
+ "learning_rate": 4.151662049861496e-05,
365
+ "loss": 0.0588,
366
+ "step": 430
367
+ },
368
+ {
369
+ "epoch": 11.5,
370
+ "learning_rate": 4.113573407202216e-05,
371
+ "loss": 0.0582,
372
+ "step": 440
373
+ },
374
+ {
375
+ "epoch": 11.76,
376
+ "learning_rate": 4.075484764542937e-05,
377
+ "loss": 0.0675,
378
+ "step": 450
379
+ },
380
+ {
381
+ "epoch": 12.0,
382
+ "eval_accuracy": 0.7213114754098361,
383
+ "eval_loss": 1.4282864332199097,
384
+ "eval_runtime": 0.9099,
385
+ "eval_samples_per_second": 67.038,
386
+ "eval_steps_per_second": 2.198,
387
+ "step": 459
388
+ },
389
+ {
390
+ "epoch": 12.03,
391
+ "learning_rate": 4.037396121883656e-05,
392
+ "loss": 0.066,
393
+ "step": 460
394
+ },
395
+ {
396
+ "epoch": 12.29,
397
+ "learning_rate": 3.999307479224377e-05,
398
+ "loss": 0.0565,
399
+ "step": 470
400
+ },
401
+ {
402
+ "epoch": 12.55,
403
+ "learning_rate": 3.961218836565097e-05,
404
+ "loss": 0.0619,
405
+ "step": 480
406
+ },
407
+ {
408
+ "epoch": 12.81,
409
+ "learning_rate": 3.923130193905817e-05,
410
+ "loss": 0.0694,
411
+ "step": 490
412
+ },
413
+ {
414
+ "epoch": 12.99,
415
+ "eval_accuracy": 0.7213114754098361,
416
+ "eval_loss": 1.361587643623352,
417
+ "eval_runtime": 0.9412,
418
+ "eval_samples_per_second": 64.813,
419
+ "eval_steps_per_second": 2.125,
420
+ "step": 497
421
+ },
422
+ {
423
+ "epoch": 13.07,
424
+ "learning_rate": 3.885041551246538e-05,
425
+ "loss": 0.074,
426
+ "step": 500
427
+ },
428
+ {
429
+ "epoch": 13.33,
430
+ "learning_rate": 3.8469529085872574e-05,
431
+ "loss": 0.0706,
432
+ "step": 510
433
+ },
434
+ {
435
+ "epoch": 13.59,
436
+ "learning_rate": 3.808864265927978e-05,
437
+ "loss": 0.0495,
438
+ "step": 520
439
+ },
440
+ {
441
+ "epoch": 13.86,
442
+ "learning_rate": 3.770775623268698e-05,
443
+ "loss": 0.0689,
444
+ "step": 530
445
+ },
446
+ {
447
+ "epoch": 13.99,
448
+ "eval_accuracy": 0.7213114754098361,
449
+ "eval_loss": 1.3863976001739502,
450
+ "eval_runtime": 1.0042,
451
+ "eval_samples_per_second": 60.748,
452
+ "eval_steps_per_second": 1.992,
453
+ "step": 535
454
+ },
455
+ {
456
+ "epoch": 14.12,
457
+ "learning_rate": 3.732686980609418e-05,
458
+ "loss": 0.049,
459
+ "step": 540
460
+ },
461
+ {
462
+ "epoch": 14.38,
463
+ "learning_rate": 3.694598337950139e-05,
464
+ "loss": 0.0489,
465
+ "step": 550
466
+ },
467
+ {
468
+ "epoch": 14.64,
469
+ "learning_rate": 3.6565096952908585e-05,
470
+ "loss": 0.0458,
471
+ "step": 560
472
+ },
473
+ {
474
+ "epoch": 14.9,
475
+ "learning_rate": 3.618421052631579e-05,
476
+ "loss": 0.0378,
477
+ "step": 570
478
+ },
479
+ {
480
+ "epoch": 14.98,
481
+ "eval_accuracy": 0.7213114754098361,
482
+ "eval_loss": 1.4321750402450562,
483
+ "eval_runtime": 0.9754,
484
+ "eval_samples_per_second": 62.537,
485
+ "eval_steps_per_second": 2.05,
486
+ "step": 573
487
+ },
488
+ {
489
+ "epoch": 15.16,
490
+ "learning_rate": 3.5803324099722994e-05,
491
+ "loss": 0.0311,
492
+ "step": 580
493
+ },
494
+ {
495
+ "epoch": 15.42,
496
+ "learning_rate": 3.5422437673130195e-05,
497
+ "loss": 0.0626,
498
+ "step": 590
499
+ },
500
+ {
501
+ "epoch": 15.69,
502
+ "learning_rate": 3.5041551246537395e-05,
503
+ "loss": 0.0515,
504
+ "step": 600
505
+ },
506
+ {
507
+ "epoch": 15.95,
508
+ "learning_rate": 3.4660664819944596e-05,
509
+ "loss": 0.0472,
510
+ "step": 610
511
+ },
512
+ {
513
+ "epoch": 16.0,
514
+ "eval_accuracy": 0.7213114754098361,
515
+ "eval_loss": 1.600350260734558,
516
+ "eval_runtime": 0.907,
517
+ "eval_samples_per_second": 67.252,
518
+ "eval_steps_per_second": 2.205,
519
+ "step": 612
520
+ },
521
+ {
522
+ "epoch": 16.21,
523
+ "learning_rate": 3.4279778393351804e-05,
524
+ "loss": 0.0378,
525
+ "step": 620
526
+ },
527
+ {
528
+ "epoch": 16.47,
529
+ "learning_rate": 3.3898891966759005e-05,
530
+ "loss": 0.0345,
531
+ "step": 630
532
+ },
533
+ {
534
+ "epoch": 16.73,
535
+ "learning_rate": 3.3518005540166206e-05,
536
+ "loss": 0.0591,
537
+ "step": 640
538
+ },
539
+ {
540
+ "epoch": 16.99,
541
+ "learning_rate": 3.313711911357341e-05,
542
+ "loss": 0.044,
543
+ "step": 650
544
+ },
545
+ {
546
+ "epoch": 16.99,
547
+ "eval_accuracy": 0.7049180327868853,
548
+ "eval_loss": 1.5810414552688599,
549
+ "eval_runtime": 0.9357,
550
+ "eval_samples_per_second": 65.194,
551
+ "eval_steps_per_second": 2.138,
552
+ "step": 650
553
+ },
554
+ {
555
+ "epoch": 17.25,
556
+ "learning_rate": 3.275623268698061e-05,
557
+ "loss": 0.0495,
558
+ "step": 660
559
+ },
560
+ {
561
+ "epoch": 17.52,
562
+ "learning_rate": 3.2375346260387815e-05,
563
+ "loss": 0.0409,
564
+ "step": 670
565
+ },
566
+ {
567
+ "epoch": 17.78,
568
+ "learning_rate": 3.1994459833795016e-05,
569
+ "loss": 0.0386,
570
+ "step": 680
571
+ },
572
+ {
573
+ "epoch": 17.99,
574
+ "eval_accuracy": 0.6885245901639344,
575
+ "eval_loss": 1.640351414680481,
576
+ "eval_runtime": 0.9225,
577
+ "eval_samples_per_second": 66.127,
578
+ "eval_steps_per_second": 2.168,
579
+ "step": 688
580
+ },
581
+ {
582
+ "epoch": 18.04,
583
+ "learning_rate": 3.161357340720222e-05,
584
+ "loss": 0.0323,
585
+ "step": 690
586
+ },
587
+ {
588
+ "epoch": 18.3,
589
+ "learning_rate": 3.123268698060942e-05,
590
+ "loss": 0.0399,
591
+ "step": 700
592
+ },
593
+ {
594
+ "epoch": 18.56,
595
+ "learning_rate": 3.085180055401662e-05,
596
+ "loss": 0.0475,
597
+ "step": 710
598
+ },
599
+ {
600
+ "epoch": 18.82,
601
+ "learning_rate": 3.0470914127423827e-05,
602
+ "loss": 0.0341,
603
+ "step": 720
604
+ },
605
+ {
606
+ "epoch": 18.98,
607
+ "eval_accuracy": 0.7377049180327869,
608
+ "eval_loss": 1.5698273181915283,
609
+ "eval_runtime": 0.9437,
610
+ "eval_samples_per_second": 64.641,
611
+ "eval_steps_per_second": 2.119,
612
+ "step": 726
613
+ },
614
+ {
615
+ "epoch": 19.08,
616
+ "learning_rate": 3.0090027700831024e-05,
617
+ "loss": 0.0457,
618
+ "step": 730
619
+ },
620
+ {
621
+ "epoch": 19.35,
622
+ "learning_rate": 2.9709141274238225e-05,
623
+ "loss": 0.0337,
624
+ "step": 740
625
+ },
626
+ {
627
+ "epoch": 19.61,
628
+ "learning_rate": 2.9328254847645433e-05,
629
+ "loss": 0.0291,
630
+ "step": 750
631
+ },
632
+ {
633
+ "epoch": 19.87,
634
+ "learning_rate": 2.894736842105263e-05,
635
+ "loss": 0.0328,
636
+ "step": 760
637
+ },
638
+ {
639
+ "epoch": 20.0,
640
+ "eval_accuracy": 0.6885245901639344,
641
+ "eval_loss": 1.6720421314239502,
642
+ "eval_runtime": 0.925,
643
+ "eval_samples_per_second": 65.945,
644
+ "eval_steps_per_second": 2.162,
645
+ "step": 765
646
+ },
647
+ {
648
+ "epoch": 20.13,
649
+ "learning_rate": 2.8566481994459838e-05,
650
+ "loss": 0.0226,
651
+ "step": 770
652
+ },
653
+ {
654
+ "epoch": 20.39,
655
+ "learning_rate": 2.8185595567867035e-05,
656
+ "loss": 0.027,
657
+ "step": 780
658
+ },
659
+ {
660
+ "epoch": 20.65,
661
+ "learning_rate": 2.7804709141274236e-05,
662
+ "loss": 0.0241,
663
+ "step": 790
664
+ },
665
+ {
666
+ "epoch": 20.92,
667
+ "learning_rate": 2.742382271468144e-05,
668
+ "loss": 0.0444,
669
+ "step": 800
670
+ },
671
+ {
672
+ "epoch": 20.99,
673
+ "eval_accuracy": 0.7213114754098361,
674
+ "eval_loss": 1.6269422769546509,
675
+ "eval_runtime": 0.9772,
676
+ "eval_samples_per_second": 62.423,
677
+ "eval_steps_per_second": 2.047,
678
+ "step": 803
679
+ },
680
+ {
681
+ "epoch": 21.18,
682
+ "learning_rate": 2.7042936288088645e-05,
683
+ "loss": 0.0312,
684
+ "step": 810
685
+ },
686
+ {
687
+ "epoch": 21.44,
688
+ "learning_rate": 2.6662049861495846e-05,
689
+ "loss": 0.0254,
690
+ "step": 820
691
+ },
692
+ {
693
+ "epoch": 21.7,
694
+ "learning_rate": 2.6281163434903047e-05,
695
+ "loss": 0.0239,
696
+ "step": 830
697
+ },
698
+ {
699
+ "epoch": 21.96,
700
+ "learning_rate": 2.590027700831025e-05,
701
+ "loss": 0.0342,
702
+ "step": 840
703
+ },
704
+ {
705
+ "epoch": 21.99,
706
+ "eval_accuracy": 0.7377049180327869,
707
+ "eval_loss": 1.6344714164733887,
708
+ "eval_runtime": 0.938,
709
+ "eval_samples_per_second": 65.032,
710
+ "eval_steps_per_second": 2.132,
711
+ "step": 841
712
+ },
713
+ {
714
+ "epoch": 22.22,
715
+ "learning_rate": 2.5519390581717452e-05,
716
+ "loss": 0.0203,
717
+ "step": 850
718
+ },
719
+ {
720
+ "epoch": 22.48,
721
+ "learning_rate": 2.5138504155124656e-05,
722
+ "loss": 0.0249,
723
+ "step": 860
724
+ },
725
+ {
726
+ "epoch": 22.75,
727
+ "learning_rate": 2.4757617728531857e-05,
728
+ "loss": 0.0324,
729
+ "step": 870
730
+ },
731
+ {
732
+ "epoch": 22.98,
733
+ "eval_accuracy": 0.7049180327868853,
734
+ "eval_loss": 1.7916051149368286,
735
+ "eval_runtime": 0.9514,
736
+ "eval_samples_per_second": 64.117,
737
+ "eval_steps_per_second": 2.102,
738
+ "step": 879
739
+ },
740
+ {
741
+ "epoch": 23.01,
742
+ "learning_rate": 2.4376731301939058e-05,
743
+ "loss": 0.0287,
744
+ "step": 880
745
+ },
746
+ {
747
+ "epoch": 23.27,
748
+ "learning_rate": 2.3995844875346262e-05,
749
+ "loss": 0.0389,
750
+ "step": 890
751
+ },
752
+ {
753
+ "epoch": 23.53,
754
+ "learning_rate": 2.3614958448753463e-05,
755
+ "loss": 0.0333,
756
+ "step": 900
757
+ },
758
+ {
759
+ "epoch": 23.79,
760
+ "learning_rate": 2.3234072022160667e-05,
761
+ "loss": 0.023,
762
+ "step": 910
763
+ },
764
+ {
765
+ "epoch": 24.0,
766
+ "eval_accuracy": 0.6885245901639344,
767
+ "eval_loss": 1.8753165006637573,
768
+ "eval_runtime": 0.9604,
769
+ "eval_samples_per_second": 63.517,
770
+ "eval_steps_per_second": 2.083,
771
+ "step": 918
772
+ },
773
+ {
774
+ "epoch": 24.05,
775
+ "learning_rate": 2.2853185595567865e-05,
776
+ "loss": 0.0264,
777
+ "step": 920
778
+ },
779
+ {
780
+ "epoch": 24.31,
781
+ "learning_rate": 2.247229916897507e-05,
782
+ "loss": 0.0305,
783
+ "step": 930
784
+ },
785
+ {
786
+ "epoch": 24.58,
787
+ "learning_rate": 2.2091412742382273e-05,
788
+ "loss": 0.0265,
789
+ "step": 940
790
+ },
791
+ {
792
+ "epoch": 24.84,
793
+ "learning_rate": 2.1710526315789474e-05,
794
+ "loss": 0.048,
795
+ "step": 950
796
+ },
797
+ {
798
+ "epoch": 24.99,
799
+ "eval_accuracy": 0.7377049180327869,
800
+ "eval_loss": 1.767918586730957,
801
+ "eval_runtime": 0.9362,
802
+ "eval_samples_per_second": 65.159,
803
+ "eval_steps_per_second": 2.136,
804
+ "step": 956
805
+ },
806
+ {
807
+ "epoch": 25.1,
808
+ "learning_rate": 2.132963988919668e-05,
809
+ "loss": 0.0378,
810
+ "step": 960
811
+ },
812
+ {
813
+ "epoch": 25.36,
814
+ "learning_rate": 2.094875346260388e-05,
815
+ "loss": 0.0326,
816
+ "step": 970
817
+ },
818
+ {
819
+ "epoch": 25.62,
820
+ "learning_rate": 2.056786703601108e-05,
821
+ "loss": 0.0228,
822
+ "step": 980
823
+ },
824
+ {
825
+ "epoch": 25.88,
826
+ "learning_rate": 2.018698060941828e-05,
827
+ "loss": 0.0202,
828
+ "step": 990
829
+ },
830
+ {
831
+ "epoch": 25.99,
832
+ "eval_accuracy": 0.7540983606557377,
833
+ "eval_loss": 1.7211973667144775,
834
+ "eval_runtime": 0.9572,
835
+ "eval_samples_per_second": 63.731,
836
+ "eval_steps_per_second": 2.09,
837
+ "step": 994
838
+ },
839
+ {
840
+ "epoch": 26.14,
841
+ "learning_rate": 1.9806094182825486e-05,
842
+ "loss": 0.023,
843
+ "step": 1000
844
+ },
845
+ {
846
+ "epoch": 26.41,
847
+ "learning_rate": 1.942520775623269e-05,
848
+ "loss": 0.0152,
849
+ "step": 1010
850
+ },
851
+ {
852
+ "epoch": 26.67,
853
+ "learning_rate": 1.904432132963989e-05,
854
+ "loss": 0.0267,
855
+ "step": 1020
856
+ },
857
+ {
858
+ "epoch": 26.93,
859
+ "learning_rate": 1.866343490304709e-05,
860
+ "loss": 0.0336,
861
+ "step": 1030
862
+ },
863
+ {
864
+ "epoch": 26.98,
865
+ "eval_accuracy": 0.7377049180327869,
866
+ "eval_loss": 1.7305350303649902,
867
+ "eval_runtime": 0.9424,
868
+ "eval_samples_per_second": 64.731,
869
+ "eval_steps_per_second": 2.122,
870
+ "step": 1032
871
+ },
872
+ {
873
+ "epoch": 27.19,
874
+ "learning_rate": 1.8282548476454293e-05,
875
+ "loss": 0.0205,
876
+ "step": 1040
877
+ },
878
+ {
879
+ "epoch": 27.45,
880
+ "learning_rate": 1.7901662049861497e-05,
881
+ "loss": 0.0316,
882
+ "step": 1050
883
+ },
884
+ {
885
+ "epoch": 27.71,
886
+ "learning_rate": 1.7520775623268698e-05,
887
+ "loss": 0.023,
888
+ "step": 1060
889
+ },
890
+ {
891
+ "epoch": 27.97,
892
+ "learning_rate": 1.7139889196675902e-05,
893
+ "loss": 0.0163,
894
+ "step": 1070
895
+ },
896
+ {
897
+ "epoch": 28.0,
898
+ "eval_accuracy": 0.7049180327868853,
899
+ "eval_loss": 1.7576478719711304,
900
+ "eval_runtime": 1.0009,
901
+ "eval_samples_per_second": 60.943,
902
+ "eval_steps_per_second": 1.998,
903
+ "step": 1071
904
+ },
905
+ {
906
+ "epoch": 28.24,
907
+ "learning_rate": 1.6759002770083103e-05,
908
+ "loss": 0.0183,
909
+ "step": 1080
910
+ },
911
+ {
912
+ "epoch": 28.5,
913
+ "learning_rate": 1.6378116343490304e-05,
914
+ "loss": 0.0432,
915
+ "step": 1090
916
+ },
917
+ {
918
+ "epoch": 28.76,
919
+ "learning_rate": 1.5997229916897508e-05,
920
+ "loss": 0.0186,
921
+ "step": 1100
922
+ },
923
+ {
924
+ "epoch": 28.99,
925
+ "eval_accuracy": 0.7377049180327869,
926
+ "eval_loss": 1.7540286779403687,
927
+ "eval_runtime": 0.9541,
928
+ "eval_samples_per_second": 63.935,
929
+ "eval_steps_per_second": 2.096,
930
+ "step": 1109
931
+ },
932
+ {
933
+ "epoch": 29.02,
934
+ "learning_rate": 1.561634349030471e-05,
935
+ "loss": 0.0181,
936
+ "step": 1110
937
+ },
938
+ {
939
+ "epoch": 29.28,
940
+ "learning_rate": 1.5235457063711913e-05,
941
+ "loss": 0.0186,
942
+ "step": 1120
943
+ },
944
+ {
945
+ "epoch": 29.54,
946
+ "learning_rate": 1.4854570637119112e-05,
947
+ "loss": 0.0112,
948
+ "step": 1130
949
+ },
950
+ {
951
+ "epoch": 29.8,
952
+ "learning_rate": 1.4473684210526315e-05,
953
+ "loss": 0.0189,
954
+ "step": 1140
955
+ },
956
+ {
957
+ "epoch": 29.99,
958
+ "eval_accuracy": 0.7540983606557377,
959
+ "eval_loss": 1.6593692302703857,
960
+ "eval_runtime": 0.9808,
961
+ "eval_samples_per_second": 62.194,
962
+ "eval_steps_per_second": 2.039,
963
+ "step": 1147
964
+ },
965
+ {
966
+ "epoch": 30.07,
967
+ "learning_rate": 1.4092797783933518e-05,
968
+ "loss": 0.0205,
969
+ "step": 1150
970
+ },
971
+ {
972
+ "epoch": 30.33,
973
+ "learning_rate": 1.371191135734072e-05,
974
+ "loss": 0.0135,
975
+ "step": 1160
976
+ },
977
+ {
978
+ "epoch": 30.59,
979
+ "learning_rate": 1.3331024930747923e-05,
980
+ "loss": 0.0116,
981
+ "step": 1170
982
+ },
983
+ {
984
+ "epoch": 30.85,
985
+ "learning_rate": 1.2950138504155125e-05,
986
+ "loss": 0.039,
987
+ "step": 1180
988
+ },
989
+ {
990
+ "epoch": 30.98,
991
+ "eval_accuracy": 0.7213114754098361,
992
+ "eval_loss": 1.7422717809677124,
993
+ "eval_runtime": 0.9576,
994
+ "eval_samples_per_second": 63.702,
995
+ "eval_steps_per_second": 2.089,
996
+ "step": 1185
997
+ },
998
+ {
999
+ "epoch": 31.11,
1000
+ "learning_rate": 1.2569252077562328e-05,
1001
+ "loss": 0.0209,
1002
+ "step": 1190
1003
+ },
1004
+ {
1005
+ "epoch": 31.37,
1006
+ "learning_rate": 1.2188365650969529e-05,
1007
+ "loss": 0.0217,
1008
+ "step": 1200
1009
+ },
1010
+ {
1011
+ "epoch": 31.63,
1012
+ "learning_rate": 1.1807479224376732e-05,
1013
+ "loss": 0.0242,
1014
+ "step": 1210
1015
+ },
1016
+ {
1017
+ "epoch": 31.9,
1018
+ "learning_rate": 1.1426592797783932e-05,
1019
+ "loss": 0.0194,
1020
+ "step": 1220
1021
+ },
1022
+ {
1023
+ "epoch": 32.0,
1024
+ "eval_accuracy": 0.7377049180327869,
1025
+ "eval_loss": 1.7148489952087402,
1026
+ "eval_runtime": 1.0439,
1027
+ "eval_samples_per_second": 58.435,
1028
+ "eval_steps_per_second": 1.916,
1029
+ "step": 1224
1030
+ },
1031
+ {
1032
+ "epoch": 32.16,
1033
+ "learning_rate": 1.1045706371191137e-05,
1034
+ "loss": 0.0153,
1035
+ "step": 1230
1036
+ },
1037
+ {
1038
+ "epoch": 32.42,
1039
+ "learning_rate": 1.066481994459834e-05,
1040
+ "loss": 0.0214,
1041
+ "step": 1240
1042
+ },
1043
+ {
1044
+ "epoch": 32.68,
1045
+ "learning_rate": 1.028393351800554e-05,
1046
+ "loss": 0.017,
1047
+ "step": 1250
1048
+ },
1049
+ {
1050
+ "epoch": 32.94,
1051
+ "learning_rate": 9.903047091412743e-06,
1052
+ "loss": 0.0205,
1053
+ "step": 1260
1054
+ },
1055
+ {
1056
+ "epoch": 32.99,
1057
+ "eval_accuracy": 0.7377049180327869,
1058
+ "eval_loss": 1.6965419054031372,
1059
+ "eval_runtime": 0.9377,
1060
+ "eval_samples_per_second": 65.055,
1061
+ "eval_steps_per_second": 2.133,
1062
+ "step": 1262
1063
+ },
1064
+ {
1065
+ "epoch": 33.2,
1066
+ "learning_rate": 9.522160664819945e-06,
1067
+ "loss": 0.0069,
1068
+ "step": 1270
1069
+ },
1070
+ {
1071
+ "epoch": 33.46,
1072
+ "learning_rate": 9.141274238227146e-06,
1073
+ "loss": 0.0153,
1074
+ "step": 1280
1075
+ },
1076
+ {
1077
+ "epoch": 33.73,
1078
+ "learning_rate": 8.760387811634349e-06,
1079
+ "loss": 0.024,
1080
+ "step": 1290
1081
+ },
1082
+ {
1083
+ "epoch": 33.99,
1084
+ "learning_rate": 8.379501385041551e-06,
1085
+ "loss": 0.0186,
1086
+ "step": 1300
1087
+ },
1088
+ {
1089
+ "epoch": 33.99,
1090
+ "eval_accuracy": 0.7540983606557377,
1091
+ "eval_loss": 1.7553398609161377,
1092
+ "eval_runtime": 0.9513,
1093
+ "eval_samples_per_second": 64.125,
1094
+ "eval_steps_per_second": 2.102,
1095
+ "step": 1300
1096
+ },
1097
+ {
1098
+ "epoch": 34.25,
1099
+ "learning_rate": 7.998614958448754e-06,
1100
+ "loss": 0.0094,
1101
+ "step": 1310
1102
+ },
1103
+ {
1104
+ "epoch": 34.51,
1105
+ "learning_rate": 7.617728531855957e-06,
1106
+ "loss": 0.0176,
1107
+ "step": 1320
1108
+ },
1109
+ {
1110
+ "epoch": 34.77,
1111
+ "learning_rate": 7.2368421052631575e-06,
1112
+ "loss": 0.0177,
1113
+ "step": 1330
1114
+ },
1115
+ {
1116
+ "epoch": 34.98,
1117
+ "eval_accuracy": 0.7377049180327869,
1118
+ "eval_loss": 1.7475531101226807,
1119
+ "eval_runtime": 0.9569,
1120
+ "eval_samples_per_second": 63.746,
1121
+ "eval_steps_per_second": 2.09,
1122
+ "step": 1338
1123
+ },
1124
+ {
1125
+ "epoch": 35.03,
1126
+ "learning_rate": 6.85595567867036e-06,
1127
+ "loss": 0.0166,
1128
+ "step": 1340
1129
+ },
1130
+ {
1131
+ "epoch": 35.29,
1132
+ "learning_rate": 6.475069252077563e-06,
1133
+ "loss": 0.0109,
1134
+ "step": 1350
1135
+ },
1136
+ {
1137
+ "epoch": 35.56,
1138
+ "learning_rate": 6.0941828254847645e-06,
1139
+ "loss": 0.0134,
1140
+ "step": 1360
1141
+ },
1142
+ {
1143
+ "epoch": 35.82,
1144
+ "learning_rate": 5.713296398891966e-06,
1145
+ "loss": 0.0132,
1146
+ "step": 1370
1147
+ },
1148
+ {
1149
+ "epoch": 36.0,
1150
+ "eval_accuracy": 0.7540983606557377,
1151
+ "eval_loss": 1.750593662261963,
1152
+ "eval_runtime": 0.9217,
1153
+ "eval_samples_per_second": 66.183,
1154
+ "eval_steps_per_second": 2.17,
1155
+ "step": 1377
1156
+ },
1157
+ {
1158
+ "epoch": 36.08,
1159
+ "learning_rate": 5.33240997229917e-06,
1160
+ "loss": 0.0117,
1161
+ "step": 1380
1162
+ },
1163
+ {
1164
+ "epoch": 36.34,
1165
+ "learning_rate": 4.951523545706371e-06,
1166
+ "loss": 0.0091,
1167
+ "step": 1390
1168
+ },
1169
+ {
1170
+ "epoch": 36.6,
1171
+ "learning_rate": 4.570637119113573e-06,
1172
+ "loss": 0.0144,
1173
+ "step": 1400
1174
+ },
1175
+ {
1176
+ "epoch": 36.86,
1177
+ "learning_rate": 4.189750692520776e-06,
1178
+ "loss": 0.0068,
1179
+ "step": 1410
1180
+ },
1181
+ {
1182
+ "epoch": 36.99,
1183
+ "eval_accuracy": 0.7377049180327869,
1184
+ "eval_loss": 1.6917140483856201,
1185
+ "eval_runtime": 0.9809,
1186
+ "eval_samples_per_second": 62.188,
1187
+ "eval_steps_per_second": 2.039,
1188
+ "step": 1415
1189
+ },
1190
+ {
1191
+ "epoch": 37.12,
1192
+ "learning_rate": 3.8088642659279783e-06,
1193
+ "loss": 0.0165,
1194
+ "step": 1420
1195
+ },
1196
+ {
1197
+ "epoch": 37.39,
1198
+ "learning_rate": 3.42797783933518e-06,
1199
+ "loss": 0.0159,
1200
+ "step": 1430
1201
+ },
1202
+ {
1203
+ "epoch": 37.65,
1204
+ "learning_rate": 3.0470914127423822e-06,
1205
+ "loss": 0.0155,
1206
+ "step": 1440
1207
+ },
1208
+ {
1209
+ "epoch": 37.91,
1210
+ "learning_rate": 2.666204986149585e-06,
1211
+ "loss": 0.0121,
1212
+ "step": 1450
1213
+ },
1214
+ {
1215
+ "epoch": 37.99,
1216
+ "eval_accuracy": 0.7540983606557377,
1217
+ "eval_loss": 1.727645993232727,
1218
+ "eval_runtime": 1.0046,
1219
+ "eval_samples_per_second": 60.719,
1220
+ "eval_steps_per_second": 1.991,
1221
+ "step": 1453
1222
+ },
1223
+ {
1224
+ "epoch": 38.17,
1225
+ "learning_rate": 2.2853185595567866e-06,
1226
+ "loss": 0.0115,
1227
+ "step": 1460
1228
+ },
1229
+ {
1230
+ "epoch": 38.43,
1231
+ "learning_rate": 1.9044321329639892e-06,
1232
+ "loss": 0.0094,
1233
+ "step": 1470
1234
+ },
1235
+ {
1236
+ "epoch": 38.69,
1237
+ "learning_rate": 1.5235457063711911e-06,
1238
+ "loss": 0.0095,
1239
+ "step": 1480
1240
+ },
1241
+ {
1242
+ "epoch": 38.95,
1243
+ "learning_rate": 1.1426592797783933e-06,
1244
+ "loss": 0.0129,
1245
+ "step": 1490
1246
+ },
1247
+ {
1248
+ "epoch": 38.98,
1249
+ "eval_accuracy": 0.7540983606557377,
1250
+ "eval_loss": 1.7218044996261597,
1251
+ "eval_runtime": 0.9303,
1252
+ "eval_samples_per_second": 65.571,
1253
+ "eval_steps_per_second": 2.15,
1254
+ "step": 1491
1255
+ },
1256
+ {
1257
+ "epoch": 39.22,
1258
+ "learning_rate": 7.617728531855956e-07,
1259
+ "loss": 0.0077,
1260
+ "step": 1500
1261
+ },
1262
+ {
1263
+ "epoch": 39.48,
1264
+ "learning_rate": 3.808864265927978e-07,
1265
+ "loss": 0.0115,
1266
+ "step": 1510
1267
+ },
1268
+ {
1269
+ "epoch": 39.74,
1270
+ "learning_rate": 0.0,
1271
+ "loss": 0.0067,
1272
+ "step": 1520
1273
+ },
1274
+ {
1275
+ "epoch": 39.74,
1276
+ "eval_accuracy": 0.7540983606557377,
1277
+ "eval_loss": 1.7220282554626465,
1278
+ "eval_runtime": 0.9466,
1279
+ "eval_samples_per_second": 64.441,
1280
+ "eval_steps_per_second": 2.113,
1281
+ "step": 1520
1282
+ },
1283
+ {
1284
+ "epoch": 39.74,
1285
+ "step": 1520,
1286
+ "total_flos": 1.5028755889037378e+19,
1287
+ "train_loss": 0.11905086408124159,
1288
+ "train_runtime": 3040.3234,
1289
+ "train_samples_per_second": 64.204,
1290
+ "train_steps_per_second": 0.5
1291
+ }
1292
+ ],
1293
+ "logging_steps": 10,
1294
+ "max_steps": 1520,
1295
+ "num_input_tokens_seen": 0,
1296
+ "num_train_epochs": 40,
1297
+ "save_steps": 500,
1298
+ "total_flos": 1.5028755889037378e+19,
1299
+ "train_batch_size": 32,
1300
+ "trial_name": null,
1301
+ "trial_params": null
1302
+ }