rbelanec commited on
Commit
c2e4ed0
·
verified ·
1 Parent(s): 7e78c49

End of training

Browse files
README.md CHANGED
@@ -4,6 +4,7 @@ license: llama3
4
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
5
  tags:
6
  - llama-factory
 
7
  - generated_from_trainer
8
  model-index:
9
  - name: train_copa_456_1757596115
@@ -15,9 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # train_copa_456_1757596115
17
 
18
- This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.1792
21
  - Num Input Tokens Seen: 281408
22
 
23
  ## Model description
 
4
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
5
  tags:
6
  - llama-factory
7
+ - prompt-tuning
8
  - generated_from_trainer
9
  model-index:
10
  - name: train_copa_456_1757596115
 
16
 
17
  # train_copa_456_1757596115
18
 
19
+ This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the copa dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.1133
22
  - Num Input Tokens Seen: 281408
23
 
24
  ## Model description
all_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 10.0,
3
+ "eval_loss": 0.11327455192804337,
4
+ "eval_runtime": 0.9054,
5
+ "eval_samples_per_second": 44.18,
6
+ "eval_steps_per_second": 11.045,
7
+ "num_input_tokens_seen": 281408,
8
+ "total_flos": 1.2671675052589056e+16,
9
+ "train_loss": 0.07668703520890428,
10
+ "train_runtime": 179.9186,
11
+ "train_samples_per_second": 20.009,
12
+ "train_steps_per_second": 5.002
13
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 10.0,
3
+ "eval_loss": 0.11327455192804337,
4
+ "eval_runtime": 0.9054,
5
+ "eval_samples_per_second": 44.18,
6
+ "eval_steps_per_second": 11.045,
7
+ "num_input_tokens_seen": 281408
8
+ }
train_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 10.0,
3
+ "num_input_tokens_seen": 281408,
4
+ "total_flos": 1.2671675052589056e+16,
5
+ "train_loss": 0.07668703520890428,
6
+ "train_runtime": 179.9186,
7
+ "train_samples_per_second": 20.009,
8
+ "train_steps_per_second": 5.002
9
+ }
trainer_state.json ADDED
@@ -0,0 +1,1664 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 90,
3
+ "best_metric": 0.11327455192804337,
4
+ "best_model_checkpoint": "saves_stability/prompt-tuning/llama-3-8b-instruct/train_copa_456_1757596115/checkpoint-90",
5
+ "epoch": 10.0,
6
+ "eval_steps": 45,
7
+ "global_step": 900,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.05555555555555555,
14
+ "grad_norm": 17.75,
15
+ "learning_rate": 2.2222222222222225e-06,
16
+ "loss": 0.3036,
17
+ "num_input_tokens_seen": 1568,
18
+ "step": 5
19
+ },
20
+ {
21
+ "epoch": 0.1111111111111111,
22
+ "grad_norm": 22.5,
23
+ "learning_rate": 5e-06,
24
+ "loss": 0.4605,
25
+ "num_input_tokens_seen": 3104,
26
+ "step": 10
27
+ },
28
+ {
29
+ "epoch": 0.16666666666666666,
30
+ "grad_norm": 16.25,
31
+ "learning_rate": 7.777777777777777e-06,
32
+ "loss": 0.6002,
33
+ "num_input_tokens_seen": 4704,
34
+ "step": 15
35
+ },
36
+ {
37
+ "epoch": 0.2222222222222222,
38
+ "grad_norm": 6.0,
39
+ "learning_rate": 1.0555555555555555e-05,
40
+ "loss": 0.284,
41
+ "num_input_tokens_seen": 6304,
42
+ "step": 20
43
+ },
44
+ {
45
+ "epoch": 0.2777777777777778,
46
+ "grad_norm": 18.0,
47
+ "learning_rate": 1.3333333333333333e-05,
48
+ "loss": 0.3611,
49
+ "num_input_tokens_seen": 7808,
50
+ "step": 25
51
+ },
52
+ {
53
+ "epoch": 0.3333333333333333,
54
+ "grad_norm": 5.28125,
55
+ "learning_rate": 1.6111111111111115e-05,
56
+ "loss": 0.218,
57
+ "num_input_tokens_seen": 9344,
58
+ "step": 30
59
+ },
60
+ {
61
+ "epoch": 0.3888888888888889,
62
+ "grad_norm": 2.34375,
63
+ "learning_rate": 1.888888888888889e-05,
64
+ "loss": 0.2672,
65
+ "num_input_tokens_seen": 10912,
66
+ "step": 35
67
+ },
68
+ {
69
+ "epoch": 0.4444444444444444,
70
+ "grad_norm": 1.96875,
71
+ "learning_rate": 2.1666666666666667e-05,
72
+ "loss": 0.1508,
73
+ "num_input_tokens_seen": 12512,
74
+ "step": 40
75
+ },
76
+ {
77
+ "epoch": 0.5,
78
+ "grad_norm": 4.6875,
79
+ "learning_rate": 2.4444444444444445e-05,
80
+ "loss": 0.1925,
81
+ "num_input_tokens_seen": 14016,
82
+ "step": 45
83
+ },
84
+ {
85
+ "epoch": 0.5,
86
+ "eval_loss": 0.14511804282665253,
87
+ "eval_runtime": 0.858,
88
+ "eval_samples_per_second": 46.618,
89
+ "eval_steps_per_second": 11.655,
90
+ "num_input_tokens_seen": 14016,
91
+ "step": 45
92
+ },
93
+ {
94
+ "epoch": 0.5555555555555556,
95
+ "grad_norm": 8.375,
96
+ "learning_rate": 2.7222222222222223e-05,
97
+ "loss": 0.0208,
98
+ "num_input_tokens_seen": 15552,
99
+ "step": 50
100
+ },
101
+ {
102
+ "epoch": 0.6111111111111112,
103
+ "grad_norm": 1.2578125,
104
+ "learning_rate": 3e-05,
105
+ "loss": 0.0363,
106
+ "num_input_tokens_seen": 17120,
107
+ "step": 55
108
+ },
109
+ {
110
+ "epoch": 0.6666666666666666,
111
+ "grad_norm": 9.25,
112
+ "learning_rate": 3.277777777777778e-05,
113
+ "loss": 0.1339,
114
+ "num_input_tokens_seen": 18720,
115
+ "step": 60
116
+ },
117
+ {
118
+ "epoch": 0.7222222222222222,
119
+ "grad_norm": 2.703125,
120
+ "learning_rate": 3.555555555555556e-05,
121
+ "loss": 0.1454,
122
+ "num_input_tokens_seen": 20288,
123
+ "step": 65
124
+ },
125
+ {
126
+ "epoch": 0.7777777777777778,
127
+ "grad_norm": 3.234375,
128
+ "learning_rate": 3.8333333333333334e-05,
129
+ "loss": 0.0142,
130
+ "num_input_tokens_seen": 21856,
131
+ "step": 70
132
+ },
133
+ {
134
+ "epoch": 0.8333333333333334,
135
+ "grad_norm": 20.375,
136
+ "learning_rate": 4.111111111111111e-05,
137
+ "loss": 0.1892,
138
+ "num_input_tokens_seen": 23456,
139
+ "step": 75
140
+ },
141
+ {
142
+ "epoch": 0.8888888888888888,
143
+ "grad_norm": 52.75,
144
+ "learning_rate": 4.388888888888889e-05,
145
+ "loss": 0.1987,
146
+ "num_input_tokens_seen": 24992,
147
+ "step": 80
148
+ },
149
+ {
150
+ "epoch": 0.9444444444444444,
151
+ "grad_norm": 1.2421875,
152
+ "learning_rate": 4.666666666666667e-05,
153
+ "loss": 0.177,
154
+ "num_input_tokens_seen": 26528,
155
+ "step": 85
156
+ },
157
+ {
158
+ "epoch": 1.0,
159
+ "grad_norm": 6.1875,
160
+ "learning_rate": 4.9444444444444446e-05,
161
+ "loss": 0.2215,
162
+ "num_input_tokens_seen": 28096,
163
+ "step": 90
164
+ },
165
+ {
166
+ "epoch": 1.0,
167
+ "eval_loss": 0.11327455192804337,
168
+ "eval_runtime": 0.8557,
169
+ "eval_samples_per_second": 46.744,
170
+ "eval_steps_per_second": 11.686,
171
+ "num_input_tokens_seen": 28096,
172
+ "step": 90
173
+ },
174
+ {
175
+ "epoch": 1.0555555555555556,
176
+ "grad_norm": 0.28515625,
177
+ "learning_rate": 4.9996991493233693e-05,
178
+ "loss": 0.0675,
179
+ "num_input_tokens_seen": 29632,
180
+ "step": 95
181
+ },
182
+ {
183
+ "epoch": 1.1111111111111112,
184
+ "grad_norm": 0.93359375,
185
+ "learning_rate": 4.99847706754774e-05,
186
+ "loss": 0.1155,
187
+ "num_input_tokens_seen": 31200,
188
+ "step": 100
189
+ },
190
+ {
191
+ "epoch": 1.1666666666666667,
192
+ "grad_norm": 6.21875,
193
+ "learning_rate": 4.9963154107272295e-05,
194
+ "loss": 0.0321,
195
+ "num_input_tokens_seen": 32768,
196
+ "step": 105
197
+ },
198
+ {
199
+ "epoch": 1.2222222222222223,
200
+ "grad_norm": 3.015625,
201
+ "learning_rate": 4.993214991772563e-05,
202
+ "loss": 0.2483,
203
+ "num_input_tokens_seen": 34336,
204
+ "step": 110
205
+ },
206
+ {
207
+ "epoch": 1.2777777777777777,
208
+ "grad_norm": 16.625,
209
+ "learning_rate": 4.989176976624511e-05,
210
+ "loss": 0.2041,
211
+ "num_input_tokens_seen": 35872,
212
+ "step": 115
213
+ },
214
+ {
215
+ "epoch": 1.3333333333333333,
216
+ "grad_norm": 20.0,
217
+ "learning_rate": 4.9842028838154285e-05,
218
+ "loss": 0.0246,
219
+ "num_input_tokens_seen": 37440,
220
+ "step": 120
221
+ },
222
+ {
223
+ "epoch": 1.3888888888888888,
224
+ "grad_norm": 2.71875,
225
+ "learning_rate": 4.978294583898196e-05,
226
+ "loss": 0.0045,
227
+ "num_input_tokens_seen": 38976,
228
+ "step": 125
229
+ },
230
+ {
231
+ "epoch": 1.4444444444444444,
232
+ "grad_norm": 17.875,
233
+ "learning_rate": 4.971454298742779e-05,
234
+ "loss": 0.2086,
235
+ "num_input_tokens_seen": 40544,
236
+ "step": 130
237
+ },
238
+ {
239
+ "epoch": 1.5,
240
+ "grad_norm": 1.953125,
241
+ "learning_rate": 4.963684600700679e-05,
242
+ "loss": 0.1174,
243
+ "num_input_tokens_seen": 42144,
244
+ "step": 135
245
+ },
246
+ {
247
+ "epoch": 1.5,
248
+ "eval_loss": 0.12593017518520355,
249
+ "eval_runtime": 0.8635,
250
+ "eval_samples_per_second": 46.325,
251
+ "eval_steps_per_second": 11.581,
252
+ "num_input_tokens_seen": 42144,
253
+ "step": 135
254
+ },
255
+ {
256
+ "epoch": 1.5555555555555556,
257
+ "grad_norm": 17.625,
258
+ "learning_rate": 4.9549884116375714e-05,
259
+ "loss": 0.2169,
260
+ "num_input_tokens_seen": 43744,
261
+ "step": 140
262
+ },
263
+ {
264
+ "epoch": 1.6111111111111112,
265
+ "grad_norm": 3.296875,
266
+ "learning_rate": 4.9453690018345144e-05,
267
+ "loss": 0.1126,
268
+ "num_input_tokens_seen": 45280,
269
+ "step": 145
270
+ },
271
+ {
272
+ "epoch": 1.6666666666666665,
273
+ "grad_norm": 0.173828125,
274
+ "learning_rate": 4.934829988758131e-05,
275
+ "loss": 0.1761,
276
+ "num_input_tokens_seen": 46880,
277
+ "step": 150
278
+ },
279
+ {
280
+ "epoch": 1.7222222222222223,
281
+ "grad_norm": 59.25,
282
+ "learning_rate": 4.923375335700223e-05,
283
+ "loss": 0.4073,
284
+ "num_input_tokens_seen": 48480,
285
+ "step": 155
286
+ },
287
+ {
288
+ "epoch": 1.7777777777777777,
289
+ "grad_norm": 3.1875,
290
+ "learning_rate": 4.9110093502873476e-05,
291
+ "loss": 0.0395,
292
+ "num_input_tokens_seen": 50080,
293
+ "step": 160
294
+ },
295
+ {
296
+ "epoch": 1.8333333333333335,
297
+ "grad_norm": 25.625,
298
+ "learning_rate": 4.897736682860885e-05,
299
+ "loss": 0.1269,
300
+ "num_input_tokens_seen": 51648,
301
+ "step": 165
302
+ },
303
+ {
304
+ "epoch": 1.8888888888888888,
305
+ "grad_norm": 13.1875,
306
+ "learning_rate": 4.883562324728241e-05,
307
+ "loss": 0.0354,
308
+ "num_input_tokens_seen": 53216,
309
+ "step": 170
310
+ },
311
+ {
312
+ "epoch": 1.9444444444444444,
313
+ "grad_norm": 3.09375,
314
+ "learning_rate": 4.868491606285823e-05,
315
+ "loss": 0.1879,
316
+ "num_input_tokens_seen": 54752,
317
+ "step": 175
318
+ },
319
+ {
320
+ "epoch": 2.0,
321
+ "grad_norm": 6.21875,
322
+ "learning_rate": 4.8525301950144894e-05,
323
+ "loss": 0.1442,
324
+ "num_input_tokens_seen": 56352,
325
+ "step": 180
326
+ },
327
+ {
328
+ "epoch": 2.0,
329
+ "eval_loss": 0.11620314419269562,
330
+ "eval_runtime": 0.8633,
331
+ "eval_samples_per_second": 46.336,
332
+ "eval_steps_per_second": 11.584,
333
+ "num_input_tokens_seen": 56352,
334
+ "step": 180
335
+ },
336
+ {
337
+ "epoch": 2.0555555555555554,
338
+ "grad_norm": 0.0703125,
339
+ "learning_rate": 4.835684093348244e-05,
340
+ "loss": 0.0813,
341
+ "num_input_tokens_seen": 57888,
342
+ "step": 185
343
+ },
344
+ {
345
+ "epoch": 2.111111111111111,
346
+ "grad_norm": 15.6875,
347
+ "learning_rate": 4.817959636416969e-05,
348
+ "loss": 0.1462,
349
+ "num_input_tokens_seen": 59488,
350
+ "step": 190
351
+ },
352
+ {
353
+ "epoch": 2.1666666666666665,
354
+ "grad_norm": 0.08642578125,
355
+ "learning_rate": 4.7993634896640394e-05,
356
+ "loss": 0.1586,
357
+ "num_input_tokens_seen": 61024,
358
+ "step": 195
359
+ },
360
+ {
361
+ "epoch": 2.2222222222222223,
362
+ "grad_norm": 38.25,
363
+ "learning_rate": 4.779902646339722e-05,
364
+ "loss": 0.0451,
365
+ "num_input_tokens_seen": 62528,
366
+ "step": 200
367
+ },
368
+ {
369
+ "epoch": 2.2777777777777777,
370
+ "grad_norm": 89.5,
371
+ "learning_rate": 4.759584424871302e-05,
372
+ "loss": 0.1823,
373
+ "num_input_tokens_seen": 64064,
374
+ "step": 205
375
+ },
376
+ {
377
+ "epoch": 2.3333333333333335,
378
+ "grad_norm": 0.8125,
379
+ "learning_rate": 4.7384164661109176e-05,
380
+ "loss": 0.2751,
381
+ "num_input_tokens_seen": 65696,
382
+ "step": 210
383
+ },
384
+ {
385
+ "epoch": 2.388888888888889,
386
+ "grad_norm": 29.75,
387
+ "learning_rate": 4.7164067304621536e-05,
388
+ "loss": 0.135,
389
+ "num_input_tokens_seen": 67232,
390
+ "step": 215
391
+ },
392
+ {
393
+ "epoch": 2.4444444444444446,
394
+ "grad_norm": 24.0,
395
+ "learning_rate": 4.693563494886455e-05,
396
+ "loss": 0.0955,
397
+ "num_input_tokens_seen": 68832,
398
+ "step": 220
399
+ },
400
+ {
401
+ "epoch": 2.5,
402
+ "grad_norm": 60.75,
403
+ "learning_rate": 4.669895349790502e-05,
404
+ "loss": 0.1186,
405
+ "num_input_tokens_seen": 70432,
406
+ "step": 225
407
+ },
408
+ {
409
+ "epoch": 2.5,
410
+ "eval_loss": 0.11699075996875763,
411
+ "eval_runtime": 0.8655,
412
+ "eval_samples_per_second": 46.218,
413
+ "eval_steps_per_second": 11.554,
414
+ "num_input_tokens_seen": 70432,
415
+ "step": 225
416
+ },
417
+ {
418
+ "epoch": 2.5555555555555554,
419
+ "grad_norm": 5.46875,
420
+ "learning_rate": 4.645411195795709e-05,
421
+ "loss": 0.0087,
422
+ "num_input_tokens_seen": 72032,
423
+ "step": 230
424
+ },
425
+ {
426
+ "epoch": 2.611111111111111,
427
+ "grad_norm": 35.5,
428
+ "learning_rate": 4.620120240391065e-05,
429
+ "loss": 0.109,
430
+ "num_input_tokens_seen": 73632,
431
+ "step": 235
432
+ },
433
+ {
434
+ "epoch": 2.6666666666666665,
435
+ "grad_norm": 0.06884765625,
436
+ "learning_rate": 4.5940319944705736e-05,
437
+ "loss": 0.2209,
438
+ "num_input_tokens_seen": 75168,
439
+ "step": 240
440
+ },
441
+ {
442
+ "epoch": 2.7222222222222223,
443
+ "grad_norm": 19.25,
444
+ "learning_rate": 4.567156268756594e-05,
445
+ "loss": 0.0195,
446
+ "num_input_tokens_seen": 76768,
447
+ "step": 245
448
+ },
449
+ {
450
+ "epoch": 2.7777777777777777,
451
+ "grad_norm": 0.09033203125,
452
+ "learning_rate": 4.539503170110431e-05,
453
+ "loss": 0.0136,
454
+ "num_input_tokens_seen": 78336,
455
+ "step": 250
456
+ },
457
+ {
458
+ "epoch": 2.8333333333333335,
459
+ "grad_norm": 0.1083984375,
460
+ "learning_rate": 4.5110830977315556e-05,
461
+ "loss": 0.0232,
462
+ "num_input_tokens_seen": 79872,
463
+ "step": 255
464
+ },
465
+ {
466
+ "epoch": 2.888888888888889,
467
+ "grad_norm": 4.75,
468
+ "learning_rate": 4.4819067392468944e-05,
469
+ "loss": 0.0734,
470
+ "num_input_tokens_seen": 81440,
471
+ "step": 260
472
+ },
473
+ {
474
+ "epoch": 2.9444444444444446,
475
+ "grad_norm": 0.11376953125,
476
+ "learning_rate": 4.4519850666916484e-05,
477
+ "loss": 0.0539,
478
+ "num_input_tokens_seen": 83008,
479
+ "step": 265
480
+ },
481
+ {
482
+ "epoch": 3.0,
483
+ "grad_norm": 0.66015625,
484
+ "learning_rate": 4.4213293323831585e-05,
485
+ "loss": 0.2272,
486
+ "num_input_tokens_seen": 84544,
487
+ "step": 270
488
+ },
489
+ {
490
+ "epoch": 3.0,
491
+ "eval_loss": 0.14363925158977509,
492
+ "eval_runtime": 0.8616,
493
+ "eval_samples_per_second": 46.426,
494
+ "eval_steps_per_second": 11.607,
495
+ "num_input_tokens_seen": 84544,
496
+ "step": 270
497
+ },
498
+ {
499
+ "epoch": 3.0555555555555554,
500
+ "grad_norm": 3.515625,
501
+ "learning_rate": 4.38995106468937e-05,
502
+ "loss": 0.0447,
503
+ "num_input_tokens_seen": 86112,
504
+ "step": 275
505
+ },
506
+ {
507
+ "epoch": 3.111111111111111,
508
+ "grad_norm": 0.2021484375,
509
+ "learning_rate": 4.357862063693486e-05,
510
+ "loss": 0.163,
511
+ "num_input_tokens_seen": 87680,
512
+ "step": 280
513
+ },
514
+ {
515
+ "epoch": 3.1666666666666665,
516
+ "grad_norm": 33.75,
517
+ "learning_rate": 4.325074396756437e-05,
518
+ "loss": 0.0236,
519
+ "num_input_tokens_seen": 89216,
520
+ "step": 285
521
+ },
522
+ {
523
+ "epoch": 3.2222222222222223,
524
+ "grad_norm": 0.212890625,
525
+ "learning_rate": 4.2916003939788403e-05,
526
+ "loss": 0.0395,
527
+ "num_input_tokens_seen": 90816,
528
+ "step": 290
529
+ },
530
+ {
531
+ "epoch": 3.2777777777777777,
532
+ "grad_norm": 0.40625,
533
+ "learning_rate": 4.257452643564155e-05,
534
+ "loss": 0.1351,
535
+ "num_input_tokens_seen": 92448,
536
+ "step": 295
537
+ },
538
+ {
539
+ "epoch": 3.3333333333333335,
540
+ "grad_norm": 0.8203125,
541
+ "learning_rate": 4.22264398708477e-05,
542
+ "loss": 0.0033,
543
+ "num_input_tokens_seen": 93984,
544
+ "step": 300
545
+ },
546
+ {
547
+ "epoch": 3.388888888888889,
548
+ "grad_norm": 0.2109375,
549
+ "learning_rate": 4.1871875146528195e-05,
550
+ "loss": 0.1094,
551
+ "num_input_tokens_seen": 95584,
552
+ "step": 305
553
+ },
554
+ {
555
+ "epoch": 3.4444444444444446,
556
+ "grad_norm": 19.125,
557
+ "learning_rate": 4.1510965599975196e-05,
558
+ "loss": 0.0115,
559
+ "num_input_tokens_seen": 97088,
560
+ "step": 310
561
+ },
562
+ {
563
+ "epoch": 3.5,
564
+ "grad_norm": 0.1572265625,
565
+ "learning_rate": 4.114384695450906e-05,
566
+ "loss": 0.0004,
567
+ "num_input_tokens_seen": 98688,
568
+ "step": 315
569
+ },
570
+ {
571
+ "epoch": 3.5,
572
+ "eval_loss": 0.15867777168750763,
573
+ "eval_runtime": 0.8659,
574
+ "eval_samples_per_second": 46.196,
575
+ "eval_steps_per_second": 11.549,
576
+ "num_input_tokens_seen": 98688,
577
+ "step": 315
578
+ },
579
+ {
580
+ "epoch": 3.5555555555555554,
581
+ "grad_norm": 54.75,
582
+ "learning_rate": 4.077065726843828e-05,
583
+ "loss": 0.1914,
584
+ "num_input_tokens_seen": 100288,
585
+ "step": 320
586
+ },
587
+ {
588
+ "epoch": 3.611111111111111,
589
+ "grad_norm": 0.045166015625,
590
+ "learning_rate": 4.039153688314145e-05,
591
+ "loss": 0.0432,
592
+ "num_input_tokens_seen": 101824,
593
+ "step": 325
594
+ },
595
+ {
596
+ "epoch": 3.6666666666666665,
597
+ "grad_norm": 0.0947265625,
598
+ "learning_rate": 4.000662837029062e-05,
599
+ "loss": 0.0238,
600
+ "num_input_tokens_seen": 103392,
601
+ "step": 330
602
+ },
603
+ {
604
+ "epoch": 3.7222222222222223,
605
+ "grad_norm": 1.0859375,
606
+ "learning_rate": 3.961607647823583e-05,
607
+ "loss": 0.1576,
608
+ "num_input_tokens_seen": 104928,
609
+ "step": 335
610
+ },
611
+ {
612
+ "epoch": 3.7777777777777777,
613
+ "grad_norm": 30.125,
614
+ "learning_rate": 3.9220028077571295e-05,
615
+ "loss": 0.2329,
616
+ "num_input_tokens_seen": 106560,
617
+ "step": 340
618
+ },
619
+ {
620
+ "epoch": 3.8333333333333335,
621
+ "grad_norm": 0.0205078125,
622
+ "learning_rate": 3.881863210590332e-05,
623
+ "loss": 0.0114,
624
+ "num_input_tokens_seen": 108096,
625
+ "step": 345
626
+ },
627
+ {
628
+ "epoch": 3.888888888888889,
629
+ "grad_norm": 23.625,
630
+ "learning_rate": 3.841203951184095e-05,
631
+ "loss": 0.1721,
632
+ "num_input_tokens_seen": 109664,
633
+ "step": 350
634
+ },
635
+ {
636
+ "epoch": 3.9444444444444446,
637
+ "grad_norm": 0.0311279296875,
638
+ "learning_rate": 3.8000403198230387e-05,
639
+ "loss": 0.0934,
640
+ "num_input_tokens_seen": 111232,
641
+ "step": 355
642
+ },
643
+ {
644
+ "epoch": 4.0,
645
+ "grad_norm": 0.031982421875,
646
+ "learning_rate": 3.75838779646545e-05,
647
+ "loss": 0.0823,
648
+ "num_input_tokens_seen": 112800,
649
+ "step": 360
650
+ },
651
+ {
652
+ "epoch": 4.0,
653
+ "eval_loss": 0.15528742969036102,
654
+ "eval_runtime": 0.86,
655
+ "eval_samples_per_second": 46.509,
656
+ "eval_steps_per_second": 11.627,
657
+ "num_input_tokens_seen": 112800,
658
+ "step": 360
659
+ },
660
+ {
661
+ "epoch": 4.055555555555555,
662
+ "grad_norm": 0.056884765625,
663
+ "learning_rate": 3.7162620449219e-05,
664
+ "loss": 0.1866,
665
+ "num_input_tokens_seen": 114400,
666
+ "step": 365
667
+ },
668
+ {
669
+ "epoch": 4.111111111111111,
670
+ "grad_norm": 82.5,
671
+ "learning_rate": 3.673678906964727e-05,
672
+ "loss": 0.1796,
673
+ "num_input_tokens_seen": 115936,
674
+ "step": 370
675
+ },
676
+ {
677
+ "epoch": 4.166666666666667,
678
+ "grad_norm": 20.625,
679
+ "learning_rate": 3.630654396370594e-05,
680
+ "loss": 0.0363,
681
+ "num_input_tokens_seen": 117472,
682
+ "step": 375
683
+ },
684
+ {
685
+ "epoch": 4.222222222222222,
686
+ "grad_norm": 1.0234375,
687
+ "learning_rate": 3.5872046928983626e-05,
688
+ "loss": 0.0894,
689
+ "num_input_tokens_seen": 119040,
690
+ "step": 380
691
+ },
692
+ {
693
+ "epoch": 4.277777777777778,
694
+ "grad_norm": 13.5,
695
+ "learning_rate": 3.543346136204545e-05,
696
+ "loss": 0.0592,
697
+ "num_input_tokens_seen": 120640,
698
+ "step": 385
699
+ },
700
+ {
701
+ "epoch": 4.333333333333333,
702
+ "grad_norm": 0.48046875,
703
+ "learning_rate": 3.499095219698631e-05,
704
+ "loss": 0.0011,
705
+ "num_input_tokens_seen": 122176,
706
+ "step": 390
707
+ },
708
+ {
709
+ "epoch": 4.388888888888889,
710
+ "grad_norm": 0.8828125,
711
+ "learning_rate": 3.454468584340588e-05,
712
+ "loss": 0.0325,
713
+ "num_input_tokens_seen": 123744,
714
+ "step": 395
715
+ },
716
+ {
717
+ "epoch": 4.444444444444445,
718
+ "grad_norm": 0.287109375,
719
+ "learning_rate": 3.409483012382879e-05,
720
+ "loss": 0.0076,
721
+ "num_input_tokens_seen": 125280,
722
+ "step": 400
723
+ },
724
+ {
725
+ "epoch": 4.5,
726
+ "grad_norm": 0.1474609375,
727
+ "learning_rate": 3.364155421059342e-05,
728
+ "loss": 0.0133,
729
+ "num_input_tokens_seen": 126816,
730
+ "step": 405
731
+ },
732
+ {
733
+ "epoch": 4.5,
734
+ "eval_loss": 0.15954655408859253,
735
+ "eval_runtime": 0.8619,
736
+ "eval_samples_per_second": 46.411,
737
+ "eval_steps_per_second": 11.603,
738
+ "num_input_tokens_seen": 126816,
739
+ "step": 405
740
+ },
741
+ {
742
+ "epoch": 4.555555555555555,
743
+ "grad_norm": 10.125,
744
+ "learning_rate": 3.318502856223311e-05,
745
+ "loss": 0.0081,
746
+ "num_input_tokens_seen": 128352,
747
+ "step": 410
748
+ },
749
+ {
750
+ "epoch": 4.611111111111111,
751
+ "grad_norm": 0.059326171875,
752
+ "learning_rate": 3.272542485937369e-05,
753
+ "loss": 0.0009,
754
+ "num_input_tokens_seen": 129920,
755
+ "step": 415
756
+ },
757
+ {
758
+ "epoch": 4.666666666666667,
759
+ "grad_norm": 0.0302734375,
760
+ "learning_rate": 3.2262915940171376e-05,
761
+ "loss": 0.0097,
762
+ "num_input_tokens_seen": 131424,
763
+ "step": 420
764
+ },
765
+ {
766
+ "epoch": 4.722222222222222,
767
+ "grad_norm": 0.0250244140625,
768
+ "learning_rate": 3.1797675735315455e-05,
769
+ "loss": 0.0343,
770
+ "num_input_tokens_seen": 132960,
771
+ "step": 425
772
+ },
773
+ {
774
+ "epoch": 4.777777777777778,
775
+ "grad_norm": 0.02880859375,
776
+ "learning_rate": 3.132987920262005e-05,
777
+ "loss": 0.0014,
778
+ "num_input_tokens_seen": 134528,
779
+ "step": 430
780
+ },
781
+ {
782
+ "epoch": 4.833333333333333,
783
+ "grad_norm": 0.031494140625,
784
+ "learning_rate": 3.085970226122962e-05,
785
+ "loss": 0.0016,
786
+ "num_input_tokens_seen": 136096,
787
+ "step": 435
788
+ },
789
+ {
790
+ "epoch": 4.888888888888889,
791
+ "grad_norm": 0.11962890625,
792
+ "learning_rate": 3.0387321725463e-05,
793
+ "loss": 0.0996,
794
+ "num_input_tokens_seen": 137728,
795
+ "step": 440
796
+ },
797
+ {
798
+ "epoch": 4.944444444444445,
799
+ "grad_norm": 42.5,
800
+ "learning_rate": 2.9912915238320754e-05,
801
+ "loss": 0.1518,
802
+ "num_input_tokens_seen": 139264,
803
+ "step": 445
804
+ },
805
+ {
806
+ "epoch": 5.0,
807
+ "grad_norm": 29.75,
808
+ "learning_rate": 2.9436661204680882e-05,
809
+ "loss": 0.0796,
810
+ "num_input_tokens_seen": 140800,
811
+ "step": 450
812
+ },
813
+ {
814
+ "epoch": 5.0,
815
+ "eval_loss": 0.16527244448661804,
816
+ "eval_runtime": 0.8594,
817
+ "eval_samples_per_second": 46.544,
818
+ "eval_steps_per_second": 11.636,
819
+ "num_input_tokens_seen": 140800,
820
+ "step": 450
821
+ },
822
+ {
823
+ "epoch": 5.055555555555555,
824
+ "grad_norm": 0.1240234375,
825
+ "learning_rate": 2.8958738724208072e-05,
826
+ "loss": 0.0138,
827
+ "num_input_tokens_seen": 142400,
828
+ "step": 455
829
+ },
830
+ {
831
+ "epoch": 5.111111111111111,
832
+ "grad_norm": 0.267578125,
833
+ "learning_rate": 2.8479327524001636e-05,
834
+ "loss": 0.001,
835
+ "num_input_tokens_seen": 143872,
836
+ "step": 460
837
+ },
838
+ {
839
+ "epoch": 5.166666666666667,
840
+ "grad_norm": 0.0498046875,
841
+ "learning_rate": 2.7998607891007495e-05,
842
+ "loss": 0.0019,
843
+ "num_input_tokens_seen": 145440,
844
+ "step": 465
845
+ },
846
+ {
847
+ "epoch": 5.222222222222222,
848
+ "grad_norm": 0.068359375,
849
+ "learning_rate": 2.7516760604219617e-05,
850
+ "loss": 0.0104,
851
+ "num_input_tokens_seen": 147040,
852
+ "step": 470
853
+ },
854
+ {
855
+ "epoch": 5.277777777777778,
856
+ "grad_norm": 0.181640625,
857
+ "learning_rate": 2.7033966866696457e-05,
858
+ "loss": 0.235,
859
+ "num_input_tokens_seen": 148576,
860
+ "step": 475
861
+ },
862
+ {
863
+ "epoch": 5.333333333333333,
864
+ "grad_norm": 4.5625,
865
+ "learning_rate": 2.6550408237417885e-05,
866
+ "loss": 0.0356,
867
+ "num_input_tokens_seen": 150112,
868
+ "step": 480
869
+ },
870
+ {
871
+ "epoch": 5.388888888888889,
872
+ "grad_norm": 99.0,
873
+ "learning_rate": 2.6066266563008267e-05,
874
+ "loss": 0.1515,
875
+ "num_input_tokens_seen": 151712,
876
+ "step": 485
877
+ },
878
+ {
879
+ "epoch": 5.444444444444445,
880
+ "grad_norm": 7.25,
881
+ "learning_rate": 2.5581723909351406e-05,
882
+ "loss": 0.0724,
883
+ "num_input_tokens_seen": 153280,
884
+ "step": 490
885
+ },
886
+ {
887
+ "epoch": 5.5,
888
+ "grad_norm": 0.62890625,
889
+ "learning_rate": 2.5096962493123012e-05,
890
+ "loss": 0.0007,
891
+ "num_input_tokens_seen": 154848,
892
+ "step": 495
893
+ },
894
+ {
895
+ "epoch": 5.5,
896
+ "eval_loss": 0.17034828662872314,
897
+ "eval_runtime": 0.8735,
898
+ "eval_samples_per_second": 45.792,
899
+ "eval_steps_per_second": 11.448,
900
+ "num_input_tokens_seen": 154848,
901
+ "step": 495
902
+ },
903
+ {
904
+ "epoch": 5.555555555555555,
905
+ "grad_norm": 0.0771484375,
906
+ "learning_rate": 2.461216461326642e-05,
907
+ "loss": 0.0006,
908
+ "num_input_tokens_seen": 156352,
909
+ "step": 500
910
+ },
911
+ {
912
+ "epoch": 5.611111111111111,
913
+ "grad_norm": 43.25,
914
+ "learning_rate": 2.4127512582437485e-05,
915
+ "loss": 0.04,
916
+ "num_input_tokens_seen": 157920,
917
+ "step": 505
918
+ },
919
+ {
920
+ "epoch": 5.666666666666667,
921
+ "grad_norm": 14.25,
922
+ "learning_rate": 2.364318865844416e-05,
923
+ "loss": 0.0076,
924
+ "num_input_tokens_seen": 159488,
925
+ "step": 510
926
+ },
927
+ {
928
+ "epoch": 5.722222222222222,
929
+ "grad_norm": 4.125,
930
+ "learning_rate": 2.3159374975706884e-05,
931
+ "loss": 0.0055,
932
+ "num_input_tokens_seen": 161056,
933
+ "step": 515
934
+ },
935
+ {
936
+ "epoch": 5.777777777777778,
937
+ "grad_norm": 226.0,
938
+ "learning_rate": 2.2676253476765196e-05,
939
+ "loss": 0.0796,
940
+ "num_input_tokens_seen": 162624,
941
+ "step": 520
942
+ },
943
+ {
944
+ "epoch": 5.833333333333333,
945
+ "grad_norm": 43.25,
946
+ "learning_rate": 2.2194005843856636e-05,
947
+ "loss": 0.0931,
948
+ "num_input_tokens_seen": 164128,
949
+ "step": 525
950
+ },
951
+ {
952
+ "epoch": 5.888888888888889,
953
+ "grad_norm": 141.0,
954
+ "learning_rate": 2.1712813430593436e-05,
955
+ "loss": 0.0651,
956
+ "num_input_tokens_seen": 165664,
957
+ "step": 530
958
+ },
959
+ {
960
+ "epoch": 5.944444444444445,
961
+ "grad_norm": 0.0517578125,
962
+ "learning_rate": 2.1232857193762924e-05,
963
+ "loss": 0.0026,
964
+ "num_input_tokens_seen": 167200,
965
+ "step": 535
966
+ },
967
+ {
968
+ "epoch": 6.0,
969
+ "grad_norm": 0.6015625,
970
+ "learning_rate": 2.0754317625276983e-05,
971
+ "loss": 0.002,
972
+ "num_input_tokens_seen": 168736,
973
+ "step": 540
974
+ },
975
+ {
976
+ "epoch": 6.0,
977
+ "eval_loss": 0.17467355728149414,
978
+ "eval_runtime": 0.8616,
979
+ "eval_samples_per_second": 46.424,
980
+ "eval_steps_per_second": 11.606,
981
+ "num_input_tokens_seen": 168736,
982
+ "step": 540
983
+ },
984
+ {
985
+ "epoch": 6.055555555555555,
986
+ "grad_norm": 0.07177734375,
987
+ "learning_rate": 2.02773746842965e-05,
988
+ "loss": 0.0004,
989
+ "num_input_tokens_seen": 170304,
990
+ "step": 545
991
+ },
992
+ {
993
+ "epoch": 6.111111111111111,
994
+ "grad_norm": 0.498046875,
995
+ "learning_rate": 1.980220772955602e-05,
996
+ "loss": 0.0132,
997
+ "num_input_tokens_seen": 171840,
998
+ "step": 550
999
+ },
1000
+ {
1001
+ "epoch": 6.166666666666667,
1002
+ "grad_norm": 0.2001953125,
1003
+ "learning_rate": 1.932899545191433e-05,
1004
+ "loss": 0.0004,
1005
+ "num_input_tokens_seen": 173408,
1006
+ "step": 555
1007
+ },
1008
+ {
1009
+ "epoch": 6.222222222222222,
1010
+ "grad_norm": 0.1259765625,
1011
+ "learning_rate": 1.8857915807156092e-05,
1012
+ "loss": 0.0004,
1013
+ "num_input_tokens_seen": 174976,
1014
+ "step": 560
1015
+ },
1016
+ {
1017
+ "epoch": 6.277777777777778,
1018
+ "grad_norm": 0.1669921875,
1019
+ "learning_rate": 1.838914594906995e-05,
1020
+ "loss": 0.0248,
1021
+ "num_input_tokens_seen": 176544,
1022
+ "step": 565
1023
+ },
1024
+ {
1025
+ "epoch": 6.333333333333333,
1026
+ "grad_norm": 0.10595703125,
1027
+ "learning_rate": 1.792286216282824e-05,
1028
+ "loss": 0.0479,
1029
+ "num_input_tokens_seen": 178112,
1030
+ "step": 570
1031
+ },
1032
+ {
1033
+ "epoch": 6.388888888888889,
1034
+ "grad_norm": 0.0654296875,
1035
+ "learning_rate": 1.7459239798693364e-05,
1036
+ "loss": 0.021,
1037
+ "num_input_tokens_seen": 179584,
1038
+ "step": 575
1039
+ },
1040
+ {
1041
+ "epoch": 6.444444444444445,
1042
+ "grad_norm": 69.0,
1043
+ "learning_rate": 1.699845320607571e-05,
1044
+ "loss": 0.0222,
1045
+ "num_input_tokens_seen": 181152,
1046
+ "step": 580
1047
+ },
1048
+ {
1049
+ "epoch": 6.5,
1050
+ "grad_norm": 0.69140625,
1051
+ "learning_rate": 1.6540675667967974e-05,
1052
+ "loss": 0.0014,
1053
+ "num_input_tokens_seen": 182688,
1054
+ "step": 585
1055
+ },
1056
+ {
1057
+ "epoch": 6.5,
1058
+ "eval_loss": 0.17897537350654602,
1059
+ "eval_runtime": 0.8658,
1060
+ "eval_samples_per_second": 46.201,
1061
+ "eval_steps_per_second": 11.55,
1062
+ "num_input_tokens_seen": 182688,
1063
+ "step": 585
1064
+ },
1065
+ {
1066
+ "epoch": 6.555555555555555,
1067
+ "grad_norm": 0.055419921875,
1068
+ "learning_rate": 1.60860793357805e-05,
1069
+ "loss": 0.0795,
1070
+ "num_input_tokens_seen": 184224,
1071
+ "step": 590
1072
+ },
1073
+ {
1074
+ "epoch": 6.611111111111111,
1075
+ "grad_norm": 1.625,
1076
+ "learning_rate": 1.56348351646022e-05,
1077
+ "loss": 0.0011,
1078
+ "num_input_tokens_seen": 185792,
1079
+ "step": 595
1080
+ },
1081
+ {
1082
+ "epoch": 6.666666666666667,
1083
+ "grad_norm": 0.0849609375,
1084
+ "learning_rate": 1.5187112848911323e-05,
1085
+ "loss": 0.1419,
1086
+ "num_input_tokens_seen": 187392,
1087
+ "step": 600
1088
+ },
1089
+ {
1090
+ "epoch": 6.722222222222222,
1091
+ "grad_norm": 0.3125,
1092
+ "learning_rate": 1.47430807587603e-05,
1093
+ "loss": 0.1698,
1094
+ "num_input_tokens_seen": 188992,
1095
+ "step": 605
1096
+ },
1097
+ {
1098
+ "epoch": 6.777777777777778,
1099
+ "grad_norm": 0.054931640625,
1100
+ "learning_rate": 1.430290587645865e-05,
1101
+ "loss": 0.0603,
1102
+ "num_input_tokens_seen": 190560,
1103
+ "step": 610
1104
+ },
1105
+ {
1106
+ "epoch": 6.833333333333333,
1107
+ "grad_norm": 0.4765625,
1108
+ "learning_rate": 1.3866753733777765e-05,
1109
+ "loss": 0.0022,
1110
+ "num_input_tokens_seen": 192128,
1111
+ "step": 615
1112
+ },
1113
+ {
1114
+ "epoch": 6.888888888888889,
1115
+ "grad_norm": 0.04736328125,
1116
+ "learning_rate": 1.343478834970121e-05,
1117
+ "loss": 0.0003,
1118
+ "num_input_tokens_seen": 193664,
1119
+ "step": 620
1120
+ },
1121
+ {
1122
+ "epoch": 6.944444444444445,
1123
+ "grad_norm": 0.84765625,
1124
+ "learning_rate": 1.3007172168743854e-05,
1125
+ "loss": 0.0004,
1126
+ "num_input_tokens_seen": 195296,
1127
+ "step": 625
1128
+ },
1129
+ {
1130
+ "epoch": 7.0,
1131
+ "grad_norm": 0.98828125,
1132
+ "learning_rate": 1.2584065999863102e-05,
1133
+ "loss": 0.0013,
1134
+ "num_input_tokens_seen": 196896,
1135
+ "step": 630
1136
+ },
1137
+ {
1138
+ "epoch": 7.0,
1139
+ "eval_loss": 0.1758497655391693,
1140
+ "eval_runtime": 0.8605,
1141
+ "eval_samples_per_second": 46.486,
1142
+ "eval_steps_per_second": 11.621,
1143
+ "num_input_tokens_seen": 196896,
1144
+ "step": 630
1145
+ },
1146
+ {
1147
+ "epoch": 7.055555555555555,
1148
+ "grad_norm": 0.032958984375,
1149
+ "learning_rate": 1.2165628955985314e-05,
1150
+ "loss": 0.002,
1151
+ "num_input_tokens_seen": 198528,
1152
+ "step": 635
1153
+ },
1154
+ {
1155
+ "epoch": 7.111111111111111,
1156
+ "grad_norm": 0.345703125,
1157
+ "learning_rate": 1.175201839416988e-05,
1158
+ "loss": 0.0161,
1159
+ "num_input_tokens_seen": 200096,
1160
+ "step": 640
1161
+ },
1162
+ {
1163
+ "epoch": 7.166666666666667,
1164
+ "grad_norm": 0.07080078125,
1165
+ "learning_rate": 1.1343389856433658e-05,
1166
+ "loss": 0.2279,
1167
+ "num_input_tokens_seen": 201696,
1168
+ "step": 645
1169
+ },
1170
+ {
1171
+ "epoch": 7.222222222222222,
1172
+ "grad_norm": 3.484375,
1173
+ "learning_rate": 1.0939897011258001e-05,
1174
+ "loss": 0.0014,
1175
+ "num_input_tokens_seen": 203232,
1176
+ "step": 650
1177
+ },
1178
+ {
1179
+ "epoch": 7.277777777777778,
1180
+ "grad_norm": 144.0,
1181
+ "learning_rate": 1.0541691595800337e-05,
1182
+ "loss": 0.0375,
1183
+ "num_input_tokens_seen": 204768,
1184
+ "step": 655
1185
+ },
1186
+ {
1187
+ "epoch": 7.333333333333333,
1188
+ "grad_norm": 0.12109375,
1189
+ "learning_rate": 1.0148923358832022e-05,
1190
+ "loss": 0.0076,
1191
+ "num_input_tokens_seen": 206368,
1192
+ "step": 660
1193
+ },
1194
+ {
1195
+ "epoch": 7.388888888888889,
1196
+ "grad_norm": 0.890625,
1197
+ "learning_rate": 9.761740004423927e-06,
1198
+ "loss": 0.0004,
1199
+ "num_input_tokens_seen": 207904,
1200
+ "step": 665
1201
+ },
1202
+ {
1203
+ "epoch": 7.444444444444445,
1204
+ "grad_norm": 0.07666015625,
1205
+ "learning_rate": 9.380287136401e-06,
1206
+ "loss": 0.0007,
1207
+ "num_input_tokens_seen": 209472,
1208
+ "step": 670
1209
+ },
1210
+ {
1211
+ "epoch": 7.5,
1212
+ "grad_norm": 0.04248046875,
1213
+ "learning_rate": 9.00470820358663e-06,
1214
+ "loss": 0.0012,
1215
+ "num_input_tokens_seen": 211072,
1216
+ "step": 675
1217
+ },
1218
+ {
1219
+ "epoch": 7.5,
1220
+ "eval_loss": 0.17746439576148987,
1221
+ "eval_runtime": 0.8657,
1222
+ "eval_samples_per_second": 46.208,
1223
+ "eval_steps_per_second": 11.552,
1224
+ "num_input_tokens_seen": 211072,
1225
+ "step": 675
1226
+ },
1227
+ {
1228
+ "epoch": 7.555555555555555,
1229
+ "grad_norm": 0.384765625,
1230
+ "learning_rate": 8.635144445857406e-06,
1231
+ "loss": 0.0217,
1232
+ "num_input_tokens_seen": 212608,
1233
+ "step": 680
1234
+ },
1235
+ {
1236
+ "epoch": 7.611111111111111,
1237
+ "grad_norm": 0.04931640625,
1238
+ "learning_rate": 8.271734841028553e-06,
1239
+ "loss": 0.0055,
1240
+ "num_input_tokens_seen": 214176,
1241
+ "step": 685
1242
+ },
1243
+ {
1244
+ "epoch": 7.666666666666667,
1245
+ "grad_norm": 0.119140625,
1246
+ "learning_rate": 7.914616052590071e-06,
1247
+ "loss": 0.0003,
1248
+ "num_input_tokens_seen": 215744,
1249
+ "step": 690
1250
+ },
1251
+ {
1252
+ "epoch": 7.722222222222222,
1253
+ "grad_norm": 74.5,
1254
+ "learning_rate": 7.563922378313218e-06,
1255
+ "loss": 0.0531,
1256
+ "num_input_tokens_seen": 217248,
1257
+ "step": 695
1258
+ },
1259
+ {
1260
+ "epoch": 7.777777777777778,
1261
+ "grad_norm": 0.06982421875,
1262
+ "learning_rate": 7.219785699746573e-06,
1263
+ "loss": 0.0006,
1264
+ "num_input_tokens_seen": 218816,
1265
+ "step": 700
1266
+ },
1267
+ {
1268
+ "epoch": 7.833333333333333,
1269
+ "grad_norm": 0.0673828125,
1270
+ "learning_rate": 6.882335432620779e-06,
1271
+ "loss": 0.0862,
1272
+ "num_input_tokens_seen": 220288,
1273
+ "step": 705
1274
+ },
1275
+ {
1276
+ "epoch": 7.888888888888889,
1277
+ "grad_norm": 0.26171875,
1278
+ "learning_rate": 6.55169847818059e-06,
1279
+ "loss": 0.0006,
1280
+ "num_input_tokens_seen": 221856,
1281
+ "step": 710
1282
+ },
1283
+ {
1284
+ "epoch": 7.944444444444445,
1285
+ "grad_norm": 0.390625,
1286
+ "learning_rate": 6.22799917546252e-06,
1287
+ "loss": 0.005,
1288
+ "num_input_tokens_seen": 223424,
1289
+ "step": 715
1290
+ },
1291
+ {
1292
+ "epoch": 8.0,
1293
+ "grad_norm": 0.061767578125,
1294
+ "learning_rate": 5.9113592545359945e-06,
1295
+ "loss": 0.0293,
1296
+ "num_input_tokens_seen": 225056,
1297
+ "step": 720
1298
+ },
1299
+ {
1300
+ "epoch": 8.0,
1301
+ "eval_loss": 0.1754344254732132,
1302
+ "eval_runtime": 0.8726,
1303
+ "eval_samples_per_second": 45.841,
1304
+ "eval_steps_per_second": 11.46,
1305
+ "num_input_tokens_seen": 225056,
1306
+ "step": 720
1307
+ },
1308
+ {
1309
+ "epoch": 8.055555555555555,
1310
+ "grad_norm": 0.1865234375,
1311
+ "learning_rate": 5.601897790725643e-06,
1312
+ "loss": 0.1541,
1313
+ "num_input_tokens_seen": 226656,
1314
+ "step": 725
1315
+ },
1316
+ {
1317
+ "epoch": 8.11111111111111,
1318
+ "grad_norm": 0.2490234375,
1319
+ "learning_rate": 5.299731159831953e-06,
1320
+ "loss": 0.0129,
1321
+ "num_input_tokens_seen": 228160,
1322
+ "step": 730
1323
+ },
1324
+ {
1325
+ "epoch": 8.166666666666666,
1326
+ "grad_norm": 0.1201171875,
1327
+ "learning_rate": 5.004972994367102e-06,
1328
+ "loss": 0.0004,
1329
+ "num_input_tokens_seen": 229728,
1330
+ "step": 735
1331
+ },
1332
+ {
1333
+ "epoch": 8.222222222222221,
1334
+ "grad_norm": 0.09375,
1335
+ "learning_rate": 4.7177341408224e-06,
1336
+ "loss": 0.0185,
1337
+ "num_input_tokens_seen": 231328,
1338
+ "step": 740
1339
+ },
1340
+ {
1341
+ "epoch": 8.277777777777779,
1342
+ "grad_norm": 0.0498046875,
1343
+ "learning_rate": 4.438122617983443e-06,
1344
+ "loss": 0.0768,
1345
+ "num_input_tokens_seen": 232832,
1346
+ "step": 745
1347
+ },
1348
+ {
1349
+ "epoch": 8.333333333333334,
1350
+ "grad_norm": 0.0576171875,
1351
+ "learning_rate": 4.166243576308712e-06,
1352
+ "loss": 0.0002,
1353
+ "num_input_tokens_seen": 234432,
1354
+ "step": 750
1355
+ },
1356
+ {
1357
+ "epoch": 8.38888888888889,
1358
+ "grad_norm": 0.267578125,
1359
+ "learning_rate": 3.9021992583867325e-06,
1360
+ "loss": 0.0514,
1361
+ "num_input_tokens_seen": 235968,
1362
+ "step": 755
1363
+ },
1364
+ {
1365
+ "epoch": 8.444444444444445,
1366
+ "grad_norm": 0.0751953125,
1367
+ "learning_rate": 3.6460889604868626e-06,
1368
+ "loss": 0.0003,
1369
+ "num_input_tokens_seen": 237568,
1370
+ "step": 760
1371
+ },
1372
+ {
1373
+ "epoch": 8.5,
1374
+ "grad_norm": 26.625,
1375
+ "learning_rate": 3.398008995217988e-06,
1376
+ "loss": 0.031,
1377
+ "num_input_tokens_seen": 239168,
1378
+ "step": 765
1379
+ },
1380
+ {
1381
+ "epoch": 8.5,
1382
+ "eval_loss": 0.1779964417219162,
1383
+ "eval_runtime": 0.8652,
1384
+ "eval_samples_per_second": 46.235,
1385
+ "eval_steps_per_second": 11.559,
1386
+ "num_input_tokens_seen": 239168,
1387
+ "step": 765
1388
+ },
1389
+ {
1390
+ "epoch": 8.555555555555555,
1391
+ "grad_norm": 0.22265625,
1392
+ "learning_rate": 3.158052655309332e-06,
1393
+ "loss": 0.0062,
1394
+ "num_input_tokens_seen": 240800,
1395
+ "step": 770
1396
+ },
1397
+ {
1398
+ "epoch": 8.61111111111111,
1399
+ "grad_norm": 0.07861328125,
1400
+ "learning_rate": 2.9263101785268254e-06,
1401
+ "loss": 0.0783,
1402
+ "num_input_tokens_seen": 242368,
1403
+ "step": 775
1404
+ },
1405
+ {
1406
+ "epoch": 8.666666666666666,
1407
+ "grad_norm": 0.04052734375,
1408
+ "learning_rate": 2.7028687137384267e-06,
1409
+ "loss": 0.0007,
1410
+ "num_input_tokens_seen": 243872,
1411
+ "step": 780
1412
+ },
1413
+ {
1414
+ "epoch": 8.722222222222221,
1415
+ "grad_norm": 0.0859375,
1416
+ "learning_rate": 2.487812288140945e-06,
1417
+ "loss": 0.0055,
1418
+ "num_input_tokens_seen": 245472,
1419
+ "step": 785
1420
+ },
1421
+ {
1422
+ "epoch": 8.777777777777779,
1423
+ "grad_norm": 0.50390625,
1424
+ "learning_rate": 2.281221775660894e-06,
1425
+ "loss": 0.0004,
1426
+ "num_input_tokens_seen": 247072,
1427
+ "step": 790
1428
+ },
1429
+ {
1430
+ "epoch": 8.833333333333334,
1431
+ "grad_norm": 0.083984375,
1432
+ "learning_rate": 2.0831748665410765e-06,
1433
+ "loss": 0.0002,
1434
+ "num_input_tokens_seen": 248640,
1435
+ "step": 795
1436
+ },
1437
+ {
1438
+ "epoch": 8.88888888888889,
1439
+ "grad_norm": 0.03955078125,
1440
+ "learning_rate": 1.893746038124497e-06,
1441
+ "loss": 0.0003,
1442
+ "num_input_tokens_seen": 250208,
1443
+ "step": 800
1444
+ },
1445
+ {
1446
+ "epoch": 8.944444444444445,
1447
+ "grad_norm": 0.23046875,
1448
+ "learning_rate": 1.713006526846439e-06,
1449
+ "loss": 0.0121,
1450
+ "num_input_tokens_seen": 251744,
1451
+ "step": 805
1452
+ },
1453
+ {
1454
+ "epoch": 9.0,
1455
+ "grad_norm": 2.203125,
1456
+ "learning_rate": 1.541024301445404e-06,
1457
+ "loss": 0.0176,
1458
+ "num_input_tokens_seen": 253312,
1459
+ "step": 810
1460
+ },
1461
+ {
1462
+ "epoch": 9.0,
1463
+ "eval_loss": 0.17836380004882812,
1464
+ "eval_runtime": 0.865,
1465
+ "eval_samples_per_second": 46.241,
1466
+ "eval_steps_per_second": 11.56,
1467
+ "num_input_tokens_seen": 253312,
1468
+ "step": 810
1469
+ },
1470
+ {
1471
+ "epoch": 9.055555555555555,
1472
+ "grad_norm": 0.28125,
1473
+ "learning_rate": 1.3778640374027985e-06,
1474
+ "loss": 0.0007,
1475
+ "num_input_tokens_seen": 254944,
1476
+ "step": 815
1477
+ },
1478
+ {
1479
+ "epoch": 9.11111111111111,
1480
+ "grad_norm": 0.04248046875,
1481
+ "learning_rate": 1.2235870926211619e-06,
1482
+ "loss": 0.0006,
1483
+ "num_input_tokens_seen": 256512,
1484
+ "step": 820
1485
+ },
1486
+ {
1487
+ "epoch": 9.166666666666666,
1488
+ "grad_norm": 0.84765625,
1489
+ "learning_rate": 1.0782514843499653e-06,
1490
+ "loss": 0.0004,
1491
+ "num_input_tokens_seen": 258016,
1492
+ "step": 825
1493
+ },
1494
+ {
1495
+ "epoch": 9.222222222222221,
1496
+ "grad_norm": 0.39453125,
1497
+ "learning_rate": 9.419118673676924e-07,
1498
+ "loss": 0.0673,
1499
+ "num_input_tokens_seen": 259552,
1500
+ "step": 830
1501
+ },
1502
+ {
1503
+ "epoch": 9.277777777777779,
1504
+ "grad_norm": 0.76953125,
1505
+ "learning_rate": 8.146195134284052e-07,
1506
+ "loss": 0.0256,
1507
+ "num_input_tokens_seen": 261152,
1508
+ "step": 835
1509
+ },
1510
+ {
1511
+ "epoch": 9.333333333333334,
1512
+ "grad_norm": 1.296875,
1513
+ "learning_rate": 6.964222919805391e-07,
1514
+ "loss": 0.0007,
1515
+ "num_input_tokens_seen": 262720,
1516
+ "step": 840
1517
+ },
1518
+ {
1519
+ "epoch": 9.38888888888889,
1520
+ "grad_norm": 268.0,
1521
+ "learning_rate": 5.87364652165176e-07,
1522
+ "loss": 0.0971,
1523
+ "num_input_tokens_seen": 264224,
1524
+ "step": 845
1525
+ },
1526
+ {
1527
+ "epoch": 9.444444444444445,
1528
+ "grad_norm": 0.25390625,
1529
+ "learning_rate": 4.874876061005173e-07,
1530
+ "loss": 0.0005,
1531
+ "num_input_tokens_seen": 265792,
1532
+ "step": 850
1533
+ },
1534
+ {
1535
+ "epoch": 9.5,
1536
+ "grad_norm": 1.109375,
1537
+ "learning_rate": 3.9682871345891883e-07,
1538
+ "loss": 0.0006,
1539
+ "num_input_tokens_seen": 267392,
1540
+ "step": 855
1541
+ },
1542
+ {
1543
+ "epoch": 9.5,
1544
+ "eval_loss": 0.17666800320148468,
1545
+ "eval_runtime": 0.866,
1546
+ "eval_samples_per_second": 46.189,
1547
+ "eval_steps_per_second": 11.547,
1548
+ "num_input_tokens_seen": 267392,
1549
+ "step": 855
1550
+ },
1551
+ {
1552
+ "epoch": 9.555555555555555,
1553
+ "grad_norm": 4.0625,
1554
+ "learning_rate": 3.1542206734221924e-07,
1555
+ "loss": 0.0669,
1556
+ "num_input_tokens_seen": 268896,
1557
+ "step": 860
1558
+ },
1559
+ {
1560
+ "epoch": 9.61111111111111,
1561
+ "grad_norm": 0.431640625,
1562
+ "learning_rate": 2.4329828146074095e-07,
1563
+ "loss": 0.0059,
1564
+ "num_input_tokens_seen": 270432,
1565
+ "step": 865
1566
+ },
1567
+ {
1568
+ "epoch": 9.666666666666666,
1569
+ "grad_norm": 17.25,
1570
+ "learning_rate": 1.8048447862070718e-07,
1571
+ "loss": 0.0187,
1572
+ "num_input_tokens_seen": 271968,
1573
+ "step": 870
1574
+ },
1575
+ {
1576
+ "epoch": 9.722222222222221,
1577
+ "grad_norm": 0.061279296875,
1578
+ "learning_rate": 1.2700428052447033e-07,
1579
+ "loss": 0.0092,
1580
+ "num_input_tokens_seen": 273504,
1581
+ "step": 875
1582
+ },
1583
+ {
1584
+ "epoch": 9.777777777777779,
1585
+ "grad_norm": 0.04052734375,
1586
+ "learning_rate": 8.28777988873486e-08,
1587
+ "loss": 0.0003,
1588
+ "num_input_tokens_seen": 275104,
1589
+ "step": 880
1590
+ },
1591
+ {
1592
+ "epoch": 9.833333333333334,
1593
+ "grad_norm": 24.375,
1594
+ "learning_rate": 4.8121627874450625e-08,
1595
+ "loss": 0.0067,
1596
+ "num_input_tokens_seen": 276672,
1597
+ "step": 885
1598
+ },
1599
+ {
1600
+ "epoch": 9.88888888888889,
1601
+ "grad_norm": 5.25,
1602
+ "learning_rate": 2.2748837860270267e-08,
1603
+ "loss": 0.002,
1604
+ "num_input_tokens_seen": 278272,
1605
+ "step": 890
1606
+ },
1607
+ {
1608
+ "epoch": 9.944444444444445,
1609
+ "grad_norm": 0.3359375,
1610
+ "learning_rate": 6.768970513457151e-09,
1611
+ "loss": 0.034,
1612
+ "num_input_tokens_seen": 279808,
1613
+ "step": 895
1614
+ },
1615
+ {
1616
+ "epoch": 10.0,
1617
+ "grad_norm": 0.458984375,
1618
+ "learning_rate": 1.8803520859811406e-10,
1619
+ "loss": 0.1336,
1620
+ "num_input_tokens_seen": 281408,
1621
+ "step": 900
1622
+ },
1623
+ {
1624
+ "epoch": 10.0,
1625
+ "eval_loss": 0.1792178899049759,
1626
+ "eval_runtime": 0.8784,
1627
+ "eval_samples_per_second": 45.535,
1628
+ "eval_steps_per_second": 11.384,
1629
+ "num_input_tokens_seen": 281408,
1630
+ "step": 900
1631
+ },
1632
+ {
1633
+ "epoch": 10.0,
1634
+ "num_input_tokens_seen": 281408,
1635
+ "step": 900,
1636
+ "total_flos": 1.2671675052589056e+16,
1637
+ "train_loss": 0.07668703520890428,
1638
+ "train_runtime": 179.9186,
1639
+ "train_samples_per_second": 20.009,
1640
+ "train_steps_per_second": 5.002
1641
+ }
1642
+ ],
1643
+ "logging_steps": 5,
1644
+ "max_steps": 900,
1645
+ "num_input_tokens_seen": 281408,
1646
+ "num_train_epochs": 10,
1647
+ "save_steps": 45,
1648
+ "stateful_callbacks": {
1649
+ "TrainerControl": {
1650
+ "args": {
1651
+ "should_epoch_stop": false,
1652
+ "should_evaluate": false,
1653
+ "should_log": false,
1654
+ "should_save": true,
1655
+ "should_training_stop": true
1656
+ },
1657
+ "attributes": {}
1658
+ }
1659
+ },
1660
+ "total_flos": 1.2671675052589056e+16,
1661
+ "train_batch_size": 4,
1662
+ "trial_name": null,
1663
+ "trial_params": null
1664
+ }
training_eval_loss.png ADDED
training_loss.png ADDED