rbelanec commited on
Commit
ba7e7fe
·
verified ·
1 Parent(s): 81a3752

End of training

Browse files
README.md CHANGED
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # train_cb_456_1760637758
19
 
20
- This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.1684
23
  - Num Input Tokens Seen: 721856
24
 
25
  ## Model description
 
17
 
18
  # train_cb_456_1760637758
19
 
20
+ This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the cb dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.1637
23
  - Num Input Tokens Seen: 721856
24
 
25
  ## Model description
all_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_loss": 0.16373665630817413,
4
+ "eval_runtime": 0.6659,
5
+ "eval_samples_per_second": 37.545,
6
+ "eval_steps_per_second": 10.513,
7
+ "num_input_tokens_seen": 721856,
8
+ "total_flos": 3.250570096017408e+16,
9
+ "train_loss": 0.22163466730138712,
10
+ "train_runtime": 276.432,
11
+ "train_samples_per_second": 16.279,
12
+ "train_steps_per_second": 4.124
13
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_loss": 0.16373665630817413,
4
+ "eval_runtime": 0.6659,
5
+ "eval_samples_per_second": 37.545,
6
+ "eval_steps_per_second": 10.513,
7
+ "num_input_tokens_seen": 721856
8
+ }
train_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "num_input_tokens_seen": 721856,
4
+ "total_flos": 3.250570096017408e+16,
5
+ "train_loss": 0.22163466730138712,
6
+ "train_runtime": 276.432,
7
+ "train_samples_per_second": 16.279,
8
+ "train_steps_per_second": 4.124
9
+ }
trainer_state.json ADDED
@@ -0,0 +1,2048 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 627,
3
+ "best_metric": 0.16373665630817413,
4
+ "best_model_checkpoint": "saves_multiple/ia3/llama-3-8b-instruct/train_cb_456_1760637758/checkpoint-627",
5
+ "epoch": 20.0,
6
+ "eval_steps": 57,
7
+ "global_step": 1140,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.08771929824561403,
14
+ "grad_norm": 3.188133716583252,
15
+ "learning_rate": 1.7543859649122807e-06,
16
+ "loss": 1.0752,
17
+ "num_input_tokens_seen": 3264,
18
+ "step": 5
19
+ },
20
+ {
21
+ "epoch": 0.17543859649122806,
22
+ "grad_norm": 2.7853734493255615,
23
+ "learning_rate": 3.9473684210526315e-06,
24
+ "loss": 1.0574,
25
+ "num_input_tokens_seen": 6336,
26
+ "step": 10
27
+ },
28
+ {
29
+ "epoch": 0.2631578947368421,
30
+ "grad_norm": 2.9166452884674072,
31
+ "learning_rate": 6.140350877192982e-06,
32
+ "loss": 1.03,
33
+ "num_input_tokens_seen": 9152,
34
+ "step": 15
35
+ },
36
+ {
37
+ "epoch": 0.3508771929824561,
38
+ "grad_norm": 3.0032896995544434,
39
+ "learning_rate": 8.333333333333334e-06,
40
+ "loss": 1.0561,
41
+ "num_input_tokens_seen": 12544,
42
+ "step": 20
43
+ },
44
+ {
45
+ "epoch": 0.43859649122807015,
46
+ "grad_norm": 3.5896389484405518,
47
+ "learning_rate": 1.0526315789473684e-05,
48
+ "loss": 1.2617,
49
+ "num_input_tokens_seen": 15296,
50
+ "step": 25
51
+ },
52
+ {
53
+ "epoch": 0.5263157894736842,
54
+ "grad_norm": 2.732612133026123,
55
+ "learning_rate": 1.2719298245614037e-05,
56
+ "loss": 1.1751,
57
+ "num_input_tokens_seen": 18560,
58
+ "step": 30
59
+ },
60
+ {
61
+ "epoch": 0.6140350877192983,
62
+ "grad_norm": 2.9109158515930176,
63
+ "learning_rate": 1.4912280701754386e-05,
64
+ "loss": 1.0189,
65
+ "num_input_tokens_seen": 21728,
66
+ "step": 35
67
+ },
68
+ {
69
+ "epoch": 0.7017543859649122,
70
+ "grad_norm": 3.0096335411071777,
71
+ "learning_rate": 1.7105263157894737e-05,
72
+ "loss": 1.1097,
73
+ "num_input_tokens_seen": 25408,
74
+ "step": 40
75
+ },
76
+ {
77
+ "epoch": 0.7894736842105263,
78
+ "grad_norm": 2.8476667404174805,
79
+ "learning_rate": 1.929824561403509e-05,
80
+ "loss": 1.15,
81
+ "num_input_tokens_seen": 29152,
82
+ "step": 45
83
+ },
84
+ {
85
+ "epoch": 0.8771929824561403,
86
+ "grad_norm": 3.344805955886841,
87
+ "learning_rate": 2.149122807017544e-05,
88
+ "loss": 1.0129,
89
+ "num_input_tokens_seen": 32320,
90
+ "step": 50
91
+ },
92
+ {
93
+ "epoch": 0.9649122807017544,
94
+ "grad_norm": 2.553867816925049,
95
+ "learning_rate": 2.368421052631579e-05,
96
+ "loss": 1.0221,
97
+ "num_input_tokens_seen": 35488,
98
+ "step": 55
99
+ },
100
+ {
101
+ "epoch": 1.0,
102
+ "eval_loss": 1.1781166791915894,
103
+ "eval_runtime": 0.5978,
104
+ "eval_samples_per_second": 41.819,
105
+ "eval_steps_per_second": 11.709,
106
+ "num_input_tokens_seen": 36072,
107
+ "step": 57
108
+ },
109
+ {
110
+ "epoch": 1.0526315789473684,
111
+ "grad_norm": 3.532503128051758,
112
+ "learning_rate": 2.5877192982456143e-05,
113
+ "loss": 1.3096,
114
+ "num_input_tokens_seen": 37544,
115
+ "step": 60
116
+ },
117
+ {
118
+ "epoch": 1.1403508771929824,
119
+ "grad_norm": 2.5019214153289795,
120
+ "learning_rate": 2.8070175438596492e-05,
121
+ "loss": 1.0301,
122
+ "num_input_tokens_seen": 41512,
123
+ "step": 65
124
+ },
125
+ {
126
+ "epoch": 1.2280701754385965,
127
+ "grad_norm": 2.822523593902588,
128
+ "learning_rate": 3.0263157894736844e-05,
129
+ "loss": 1.1433,
130
+ "num_input_tokens_seen": 44936,
131
+ "step": 70
132
+ },
133
+ {
134
+ "epoch": 1.3157894736842106,
135
+ "grad_norm": 4.4493560791015625,
136
+ "learning_rate": 3.24561403508772e-05,
137
+ "loss": 1.1616,
138
+ "num_input_tokens_seen": 48680,
139
+ "step": 75
140
+ },
141
+ {
142
+ "epoch": 1.4035087719298245,
143
+ "grad_norm": 2.776585340499878,
144
+ "learning_rate": 3.4649122807017546e-05,
145
+ "loss": 1.0325,
146
+ "num_input_tokens_seen": 52168,
147
+ "step": 80
148
+ },
149
+ {
150
+ "epoch": 1.4912280701754386,
151
+ "grad_norm": 3.004014253616333,
152
+ "learning_rate": 3.6842105263157895e-05,
153
+ "loss": 1.2118,
154
+ "num_input_tokens_seen": 55464,
155
+ "step": 85
156
+ },
157
+ {
158
+ "epoch": 1.5789473684210527,
159
+ "grad_norm": 3.5347096920013428,
160
+ "learning_rate": 3.9035087719298244e-05,
161
+ "loss": 1.0729,
162
+ "num_input_tokens_seen": 57960,
163
+ "step": 90
164
+ },
165
+ {
166
+ "epoch": 1.6666666666666665,
167
+ "grad_norm": 3.210582971572876,
168
+ "learning_rate": 4.12280701754386e-05,
169
+ "loss": 0.7965,
170
+ "num_input_tokens_seen": 61672,
171
+ "step": 95
172
+ },
173
+ {
174
+ "epoch": 1.7543859649122808,
175
+ "grad_norm": 2.6260721683502197,
176
+ "learning_rate": 4.342105263157895e-05,
177
+ "loss": 1.1929,
178
+ "num_input_tokens_seen": 64872,
179
+ "step": 100
180
+ },
181
+ {
182
+ "epoch": 1.8421052631578947,
183
+ "grad_norm": 2.4814932346343994,
184
+ "learning_rate": 4.56140350877193e-05,
185
+ "loss": 0.9678,
186
+ "num_input_tokens_seen": 67848,
187
+ "step": 105
188
+ },
189
+ {
190
+ "epoch": 1.9298245614035088,
191
+ "grad_norm": 3.311037302017212,
192
+ "learning_rate": 4.780701754385965e-05,
193
+ "loss": 0.7632,
194
+ "num_input_tokens_seen": 70728,
195
+ "step": 110
196
+ },
197
+ {
198
+ "epoch": 2.0,
199
+ "eval_loss": 0.5822951197624207,
200
+ "eval_runtime": 0.5988,
201
+ "eval_samples_per_second": 41.753,
202
+ "eval_steps_per_second": 11.691,
203
+ "num_input_tokens_seen": 72896,
204
+ "step": 114
205
+ },
206
+ {
207
+ "epoch": 2.017543859649123,
208
+ "grad_norm": 1.251522183418274,
209
+ "learning_rate": 5e-05,
210
+ "loss": 0.4447,
211
+ "num_input_tokens_seen": 73664,
212
+ "step": 115
213
+ },
214
+ {
215
+ "epoch": 2.1052631578947367,
216
+ "grad_norm": 1.2661267518997192,
217
+ "learning_rate": 4.999707014206475e-05,
218
+ "loss": 0.412,
219
+ "num_input_tokens_seen": 76736,
220
+ "step": 120
221
+ },
222
+ {
223
+ "epoch": 2.192982456140351,
224
+ "grad_norm": 1.008662223815918,
225
+ "learning_rate": 4.9988281254984414e-05,
226
+ "loss": 0.2476,
227
+ "num_input_tokens_seen": 79744,
228
+ "step": 125
229
+ },
230
+ {
231
+ "epoch": 2.280701754385965,
232
+ "grad_norm": 1.2116782665252686,
233
+ "learning_rate": 4.997363539877422e-05,
234
+ "loss": 0.2851,
235
+ "num_input_tokens_seen": 82848,
236
+ "step": 130
237
+ },
238
+ {
239
+ "epoch": 2.3684210526315788,
240
+ "grad_norm": 0.6277875900268555,
241
+ "learning_rate": 4.9953136006256415e-05,
242
+ "loss": 0.1626,
243
+ "num_input_tokens_seen": 87200,
244
+ "step": 135
245
+ },
246
+ {
247
+ "epoch": 2.456140350877193,
248
+ "grad_norm": 1.7605924606323242,
249
+ "learning_rate": 4.9926787882255636e-05,
250
+ "loss": 0.2189,
251
+ "num_input_tokens_seen": 90176,
252
+ "step": 140
253
+ },
254
+ {
255
+ "epoch": 2.543859649122807,
256
+ "grad_norm": 2.685183048248291,
257
+ "learning_rate": 4.9894597202472696e-05,
258
+ "loss": 0.3855,
259
+ "num_input_tokens_seen": 93408,
260
+ "step": 145
261
+ },
262
+ {
263
+ "epoch": 2.6315789473684212,
264
+ "grad_norm": 0.480960875749588,
265
+ "learning_rate": 4.985657151203706e-05,
266
+ "loss": 0.1882,
267
+ "num_input_tokens_seen": 96800,
268
+ "step": 150
269
+ },
270
+ {
271
+ "epoch": 2.719298245614035,
272
+ "grad_norm": 0.4456038177013397,
273
+ "learning_rate": 4.9812719723738435e-05,
274
+ "loss": 0.2126,
275
+ "num_input_tokens_seen": 99968,
276
+ "step": 155
277
+ },
278
+ {
279
+ "epoch": 2.807017543859649,
280
+ "grad_norm": 0.33716535568237305,
281
+ "learning_rate": 4.976305211593758e-05,
282
+ "loss": 0.2543,
283
+ "num_input_tokens_seen": 103040,
284
+ "step": 160
285
+ },
286
+ {
287
+ "epoch": 2.8947368421052633,
288
+ "grad_norm": 1.0193623304367065,
289
+ "learning_rate": 4.970758033015731e-05,
290
+ "loss": 0.1125,
291
+ "num_input_tokens_seen": 105856,
292
+ "step": 165
293
+ },
294
+ {
295
+ "epoch": 2.982456140350877,
296
+ "grad_norm": 0.4656844437122345,
297
+ "learning_rate": 4.9646317368353743e-05,
298
+ "loss": 0.1503,
299
+ "num_input_tokens_seen": 108992,
300
+ "step": 170
301
+ },
302
+ {
303
+ "epoch": 3.0,
304
+ "eval_loss": 0.1778637170791626,
305
+ "eval_runtime": 0.6005,
306
+ "eval_samples_per_second": 41.631,
307
+ "eval_steps_per_second": 11.657,
308
+ "num_input_tokens_seen": 109080,
309
+ "step": 171
310
+ },
311
+ {
312
+ "epoch": 3.0701754385964914,
313
+ "grad_norm": 1.2109010219573975,
314
+ "learning_rate": 4.957927758986888e-05,
315
+ "loss": 0.0728,
316
+ "num_input_tokens_seen": 111320,
317
+ "step": 175
318
+ },
319
+ {
320
+ "epoch": 3.1578947368421053,
321
+ "grad_norm": 0.9477802515029907,
322
+ "learning_rate": 4.9506476708064865e-05,
323
+ "loss": 0.1846,
324
+ "num_input_tokens_seen": 114840,
325
+ "step": 180
326
+ },
327
+ {
328
+ "epoch": 3.245614035087719,
329
+ "grad_norm": 0.533306896686554,
330
+ "learning_rate": 4.9427931786641e-05,
331
+ "loss": 0.086,
332
+ "num_input_tokens_seen": 117720,
333
+ "step": 185
334
+ },
335
+ {
336
+ "epoch": 3.3333333333333335,
337
+ "grad_norm": 0.849586009979248,
338
+ "learning_rate": 4.93436612356342e-05,
339
+ "loss": 0.3332,
340
+ "num_input_tokens_seen": 121400,
341
+ "step": 190
342
+ },
343
+ {
344
+ "epoch": 3.4210526315789473,
345
+ "grad_norm": 0.7427930235862732,
346
+ "learning_rate": 4.925368480710385e-05,
347
+ "loss": 0.1894,
348
+ "num_input_tokens_seen": 125208,
349
+ "step": 195
350
+ },
351
+ {
352
+ "epoch": 3.5087719298245617,
353
+ "grad_norm": 0.29518067836761475,
354
+ "learning_rate": 4.915802359050222e-05,
355
+ "loss": 0.0976,
356
+ "num_input_tokens_seen": 128568,
357
+ "step": 200
358
+ },
359
+ {
360
+ "epoch": 3.5964912280701755,
361
+ "grad_norm": 0.6132979393005371,
362
+ "learning_rate": 4.905670000773126e-05,
363
+ "loss": 0.1704,
364
+ "num_input_tokens_seen": 131864,
365
+ "step": 205
366
+ },
367
+ {
368
+ "epoch": 3.6842105263157894,
369
+ "grad_norm": 0.845473051071167,
370
+ "learning_rate": 4.894973780788722e-05,
371
+ "loss": 0.0976,
372
+ "num_input_tokens_seen": 134872,
373
+ "step": 210
374
+ },
375
+ {
376
+ "epoch": 3.7719298245614032,
377
+ "grad_norm": 0.2442348748445511,
378
+ "learning_rate": 4.88371620616941e-05,
379
+ "loss": 0.135,
380
+ "num_input_tokens_seen": 137784,
381
+ "step": 215
382
+ },
383
+ {
384
+ "epoch": 3.8596491228070176,
385
+ "grad_norm": 0.7569774985313416,
386
+ "learning_rate": 4.871899915562736e-05,
387
+ "loss": 0.1422,
388
+ "num_input_tokens_seen": 140888,
389
+ "step": 220
390
+ },
391
+ {
392
+ "epoch": 3.9473684210526314,
393
+ "grad_norm": 0.29858508706092834,
394
+ "learning_rate": 4.8595276785729236e-05,
395
+ "loss": 0.1435,
396
+ "num_input_tokens_seen": 144440,
397
+ "step": 225
398
+ },
399
+ {
400
+ "epoch": 4.0,
401
+ "eval_loss": 0.17110419273376465,
402
+ "eval_runtime": 0.6034,
403
+ "eval_samples_per_second": 41.434,
404
+ "eval_steps_per_second": 11.602,
405
+ "num_input_tokens_seen": 145936,
406
+ "step": 228
407
+ },
408
+ {
409
+ "epoch": 4.035087719298246,
410
+ "grad_norm": 0.2264045625925064,
411
+ "learning_rate": 4.846602395111711e-05,
412
+ "loss": 0.9541,
413
+ "num_input_tokens_seen": 147152,
414
+ "step": 230
415
+ },
416
+ {
417
+ "epoch": 4.12280701754386,
418
+ "grad_norm": 1.0871644020080566,
419
+ "learning_rate": 4.833127094718643e-05,
420
+ "loss": 0.1009,
421
+ "num_input_tokens_seen": 150416,
422
+ "step": 235
423
+ },
424
+ {
425
+ "epoch": 4.2105263157894735,
426
+ "grad_norm": 0.7730394601821899,
427
+ "learning_rate": 4.819104935850983e-05,
428
+ "loss": 0.1769,
429
+ "num_input_tokens_seen": 153328,
430
+ "step": 240
431
+ },
432
+ {
433
+ "epoch": 4.298245614035087,
434
+ "grad_norm": 0.47254785895347595,
435
+ "learning_rate": 4.804539205143405e-05,
436
+ "loss": 0.1577,
437
+ "num_input_tokens_seen": 156720,
438
+ "step": 245
439
+ },
440
+ {
441
+ "epoch": 4.385964912280702,
442
+ "grad_norm": 2.6590054035186768,
443
+ "learning_rate": 4.789433316637644e-05,
444
+ "loss": 0.1781,
445
+ "num_input_tokens_seen": 159920,
446
+ "step": 250
447
+ },
448
+ {
449
+ "epoch": 4.473684210526316,
450
+ "grad_norm": 0.263329416513443,
451
+ "learning_rate": 4.7737908109822854e-05,
452
+ "loss": 0.0684,
453
+ "num_input_tokens_seen": 162576,
454
+ "step": 255
455
+ },
456
+ {
457
+ "epoch": 4.56140350877193,
458
+ "grad_norm": 0.9871893525123596,
459
+ "learning_rate": 4.757615354602874e-05,
460
+ "loss": 0.087,
461
+ "num_input_tokens_seen": 165200,
462
+ "step": 260
463
+ },
464
+ {
465
+ "epoch": 4.649122807017544,
466
+ "grad_norm": 0.8960189819335938,
467
+ "learning_rate": 4.7409107388425504e-05,
468
+ "loss": 0.117,
469
+ "num_input_tokens_seen": 168656,
470
+ "step": 265
471
+ },
472
+ {
473
+ "epoch": 4.7368421052631575,
474
+ "grad_norm": 0.6211714744567871,
475
+ "learning_rate": 4.723680879073396e-05,
476
+ "loss": 0.2653,
477
+ "num_input_tokens_seen": 172528,
478
+ "step": 270
479
+ },
480
+ {
481
+ "epoch": 4.824561403508772,
482
+ "grad_norm": 0.8449894785881042,
483
+ "learning_rate": 4.70592981377872e-05,
484
+ "loss": 0.1166,
485
+ "num_input_tokens_seen": 176016,
486
+ "step": 275
487
+ },
488
+ {
489
+ "epoch": 4.912280701754386,
490
+ "grad_norm": 1.5475900173187256,
491
+ "learning_rate": 4.6876617036064844e-05,
492
+ "loss": 0.2535,
493
+ "num_input_tokens_seen": 179504,
494
+ "step": 280
495
+ },
496
+ {
497
+ "epoch": 5.0,
498
+ "grad_norm": 0.021682975813746452,
499
+ "learning_rate": 4.668880830394093e-05,
500
+ "loss": 0.148,
501
+ "num_input_tokens_seen": 182024,
502
+ "step": 285
503
+ },
504
+ {
505
+ "epoch": 5.0,
506
+ "eval_loss": 0.17396755516529083,
507
+ "eval_runtime": 0.6017,
508
+ "eval_samples_per_second": 41.548,
509
+ "eval_steps_per_second": 11.633,
510
+ "num_input_tokens_seen": 182024,
511
+ "step": 285
512
+ },
513
+ {
514
+ "epoch": 5.087719298245614,
515
+ "grad_norm": 0.7350289821624756,
516
+ "learning_rate": 4.649591596164778e-05,
517
+ "loss": 0.0897,
518
+ "num_input_tokens_seen": 185800,
519
+ "step": 290
520
+ },
521
+ {
522
+ "epoch": 5.175438596491228,
523
+ "grad_norm": 0.9024624228477478,
524
+ "learning_rate": 4.629798522095818e-05,
525
+ "loss": 0.1741,
526
+ "num_input_tokens_seen": 188360,
527
+ "step": 295
528
+ },
529
+ {
530
+ "epoch": 5.2631578947368425,
531
+ "grad_norm": 1.9362379312515259,
532
+ "learning_rate": 4.6095062474588225e-05,
533
+ "loss": 0.2149,
534
+ "num_input_tokens_seen": 192232,
535
+ "step": 300
536
+ },
537
+ {
538
+ "epoch": 5.350877192982456,
539
+ "grad_norm": 0.5383522510528564,
540
+ "learning_rate": 4.588719528532342e-05,
541
+ "loss": 0.087,
542
+ "num_input_tokens_seen": 195592,
543
+ "step": 305
544
+ },
545
+ {
546
+ "epoch": 5.43859649122807,
547
+ "grad_norm": 0.2708553075790405,
548
+ "learning_rate": 4.5674432374870455e-05,
549
+ "loss": 0.1364,
550
+ "num_input_tokens_seen": 198632,
551
+ "step": 310
552
+ },
553
+ {
554
+ "epoch": 5.526315789473684,
555
+ "grad_norm": 1.169155478477478,
556
+ "learning_rate": 4.545682361243748e-05,
557
+ "loss": 0.1228,
558
+ "num_input_tokens_seen": 201480,
559
+ "step": 315
560
+ },
561
+ {
562
+ "epoch": 5.614035087719298,
563
+ "grad_norm": 0.39099931716918945,
564
+ "learning_rate": 4.5234420003045236e-05,
565
+ "loss": 0.1765,
566
+ "num_input_tokens_seen": 204584,
567
+ "step": 320
568
+ },
569
+ {
570
+ "epoch": 5.701754385964913,
571
+ "grad_norm": 0.9065895676612854,
572
+ "learning_rate": 4.5007273675572104e-05,
573
+ "loss": 0.1121,
574
+ "num_input_tokens_seen": 208136,
575
+ "step": 325
576
+ },
577
+ {
578
+ "epoch": 5.7894736842105265,
579
+ "grad_norm": 0.9794620275497437,
580
+ "learning_rate": 4.4775437870535685e-05,
581
+ "loss": 0.1778,
582
+ "num_input_tokens_seen": 211560,
583
+ "step": 330
584
+ },
585
+ {
586
+ "epoch": 5.87719298245614,
587
+ "grad_norm": 0.940438449382782,
588
+ "learning_rate": 4.4538966927613836e-05,
589
+ "loss": 0.2377,
590
+ "num_input_tokens_seen": 214472,
591
+ "step": 335
592
+ },
593
+ {
594
+ "epoch": 5.964912280701754,
595
+ "grad_norm": 0.41034215688705444,
596
+ "learning_rate": 4.4297916272908024e-05,
597
+ "loss": 0.0421,
598
+ "num_input_tokens_seen": 217864,
599
+ "step": 340
600
+ },
601
+ {
602
+ "epoch": 6.0,
603
+ "eval_loss": 0.16923700273036957,
604
+ "eval_runtime": 0.605,
605
+ "eval_samples_per_second": 41.323,
606
+ "eval_steps_per_second": 11.57,
607
+ "num_input_tokens_seen": 218672,
608
+ "step": 342
609
+ },
610
+ {
611
+ "epoch": 6.052631578947368,
612
+ "grad_norm": 1.5152359008789062,
613
+ "learning_rate": 4.405234240595214e-05,
614
+ "loss": 0.0716,
615
+ "num_input_tokens_seen": 220272,
616
+ "step": 345
617
+ },
618
+ {
619
+ "epoch": 6.140350877192983,
620
+ "grad_norm": 0.5148724913597107,
621
+ "learning_rate": 4.3802302886469606e-05,
622
+ "loss": 0.1109,
623
+ "num_input_tokens_seen": 223440,
624
+ "step": 350
625
+ },
626
+ {
627
+ "epoch": 6.228070175438597,
628
+ "grad_norm": 1.1933245658874512,
629
+ "learning_rate": 4.3547856320882044e-05,
630
+ "loss": 0.2074,
631
+ "num_input_tokens_seen": 226352,
632
+ "step": 355
633
+ },
634
+ {
635
+ "epoch": 6.315789473684211,
636
+ "grad_norm": 0.44087743759155273,
637
+ "learning_rate": 4.328906234857259e-05,
638
+ "loss": 0.1339,
639
+ "num_input_tokens_seen": 229584,
640
+ "step": 360
641
+ },
642
+ {
643
+ "epoch": 6.4035087719298245,
644
+ "grad_norm": 0.21826516091823578,
645
+ "learning_rate": 4.302598162790712e-05,
646
+ "loss": 0.152,
647
+ "num_input_tokens_seen": 232304,
648
+ "step": 365
649
+ },
650
+ {
651
+ "epoch": 6.491228070175438,
652
+ "grad_norm": 0.347334623336792,
653
+ "learning_rate": 4.27586758220166e-05,
654
+ "loss": 0.1077,
655
+ "num_input_tokens_seen": 236656,
656
+ "step": 370
657
+ },
658
+ {
659
+ "epoch": 6.578947368421053,
660
+ "grad_norm": 0.8332003951072693,
661
+ "learning_rate": 4.2487207584343955e-05,
662
+ "loss": 0.1673,
663
+ "num_input_tokens_seen": 239568,
664
+ "step": 375
665
+ },
666
+ {
667
+ "epoch": 6.666666666666667,
668
+ "grad_norm": 0.29145392775535583,
669
+ "learning_rate": 4.2211640543958796e-05,
670
+ "loss": 0.0353,
671
+ "num_input_tokens_seen": 242544,
672
+ "step": 380
673
+ },
674
+ {
675
+ "epoch": 6.754385964912281,
676
+ "grad_norm": 0.7902359366416931,
677
+ "learning_rate": 4.193203929064353e-05,
678
+ "loss": 0.0675,
679
+ "num_input_tokens_seen": 245584,
680
+ "step": 385
681
+ },
682
+ {
683
+ "epoch": 6.842105263157895,
684
+ "grad_norm": 0.5900273323059082,
685
+ "learning_rate": 4.164846935975421e-05,
686
+ "loss": 0.229,
687
+ "num_input_tokens_seen": 248880,
688
+ "step": 390
689
+ },
690
+ {
691
+ "epoch": 6.9298245614035086,
692
+ "grad_norm": 0.12276192009449005,
693
+ "learning_rate": 4.136099721685983e-05,
694
+ "loss": 0.1542,
695
+ "num_input_tokens_seen": 251856,
696
+ "step": 395
697
+ },
698
+ {
699
+ "epoch": 7.0,
700
+ "eval_loss": 0.17160974442958832,
701
+ "eval_runtime": 0.6022,
702
+ "eval_samples_per_second": 41.513,
703
+ "eval_steps_per_second": 11.624,
704
+ "num_input_tokens_seen": 254232,
705
+ "step": 399
706
+ },
707
+ {
708
+ "epoch": 7.017543859649122,
709
+ "grad_norm": 1.2825690507888794,
710
+ "learning_rate": 4.1069690242163484e-05,
711
+ "loss": 0.1185,
712
+ "num_input_tokens_seen": 254808,
713
+ "step": 400
714
+ },
715
+ {
716
+ "epoch": 7.105263157894737,
717
+ "grad_norm": 1.6038203239440918,
718
+ "learning_rate": 4.0774616714709316e-05,
719
+ "loss": 0.2134,
720
+ "num_input_tokens_seen": 257752,
721
+ "step": 405
722
+ },
723
+ {
724
+ "epoch": 7.192982456140351,
725
+ "grad_norm": 0.28888311982154846,
726
+ "learning_rate": 4.047584579637857e-05,
727
+ "loss": 0.0765,
728
+ "num_input_tokens_seen": 261176,
729
+ "step": 410
730
+ },
731
+ {
732
+ "epoch": 7.280701754385965,
733
+ "grad_norm": 0.22954721748828888,
734
+ "learning_rate": 4.0173447515678916e-05,
735
+ "loss": 0.0959,
736
+ "num_input_tokens_seen": 264568,
737
+ "step": 415
738
+ },
739
+ {
740
+ "epoch": 7.368421052631579,
741
+ "grad_norm": 0.18109272420406342,
742
+ "learning_rate": 3.986749275133057e-05,
743
+ "loss": 0.1044,
744
+ "num_input_tokens_seen": 267672,
745
+ "step": 420
746
+ },
747
+ {
748
+ "epoch": 7.456140350877193,
749
+ "grad_norm": 0.526366114616394,
750
+ "learning_rate": 3.955805321565304e-05,
751
+ "loss": 0.1419,
752
+ "num_input_tokens_seen": 271448,
753
+ "step": 425
754
+ },
755
+ {
756
+ "epoch": 7.543859649122807,
757
+ "grad_norm": 0.10251549631357193,
758
+ "learning_rate": 3.9245201437756654e-05,
759
+ "loss": 0.0795,
760
+ "num_input_tokens_seen": 274616,
761
+ "step": 430
762
+ },
763
+ {
764
+ "epoch": 7.631578947368421,
765
+ "grad_norm": 0.3836061656475067,
766
+ "learning_rate": 3.892901074654255e-05,
767
+ "loss": 0.0528,
768
+ "num_input_tokens_seen": 277656,
769
+ "step": 435
770
+ },
771
+ {
772
+ "epoch": 7.719298245614035,
773
+ "grad_norm": 0.9915176033973694,
774
+ "learning_rate": 3.860955525351516e-05,
775
+ "loss": 0.233,
776
+ "num_input_tokens_seen": 281400,
777
+ "step": 440
778
+ },
779
+ {
780
+ "epoch": 7.807017543859649,
781
+ "grad_norm": 0.4269912838935852,
782
+ "learning_rate": 3.82869098354114e-05,
783
+ "loss": 0.0888,
784
+ "num_input_tokens_seen": 284536,
785
+ "step": 445
786
+ },
787
+ {
788
+ "epoch": 7.894736842105263,
789
+ "grad_norm": 0.8104063272476196,
790
+ "learning_rate": 3.796115011665034e-05,
791
+ "loss": 0.2388,
792
+ "num_input_tokens_seen": 287512,
793
+ "step": 450
794
+ },
795
+ {
796
+ "epoch": 7.982456140350877,
797
+ "grad_norm": 0.6774709224700928,
798
+ "learning_rate": 3.763235245160775e-05,
799
+ "loss": 0.1302,
800
+ "num_input_tokens_seen": 290776,
801
+ "step": 455
802
+ },
803
+ {
804
+ "epoch": 8.0,
805
+ "eval_loss": 0.169868603348732,
806
+ "eval_runtime": 0.6021,
807
+ "eval_samples_per_second": 41.518,
808
+ "eval_steps_per_second": 11.625,
809
+ "num_input_tokens_seen": 290912,
810
+ "step": 456
811
+ },
812
+ {
813
+ "epoch": 8.070175438596491,
814
+ "grad_norm": 0.8973947763442993,
815
+ "learning_rate": 3.7300593906719464e-05,
816
+ "loss": 0.2689,
817
+ "num_input_tokens_seen": 293856,
818
+ "step": 460
819
+ },
820
+ {
821
+ "epoch": 8.157894736842104,
822
+ "grad_norm": 1.0440150499343872,
823
+ "learning_rate": 3.69659522424179e-05,
824
+ "loss": 0.0836,
825
+ "num_input_tokens_seen": 297376,
826
+ "step": 465
827
+ },
828
+ {
829
+ "epoch": 8.24561403508772,
830
+ "grad_norm": 1.0838161706924438,
831
+ "learning_rate": 3.662850589490592e-05,
832
+ "loss": 0.0851,
833
+ "num_input_tokens_seen": 299776,
834
+ "step": 470
835
+ },
836
+ {
837
+ "epoch": 8.333333333333334,
838
+ "grad_norm": 0.8501314520835876,
839
+ "learning_rate": 3.628833395777224e-05,
840
+ "loss": 0.1218,
841
+ "num_input_tokens_seen": 302912,
842
+ "step": 475
843
+ },
844
+ {
845
+ "epoch": 8.421052631578947,
846
+ "grad_norm": 0.691509485244751,
847
+ "learning_rate": 3.59455161634528e-05,
848
+ "loss": 0.0532,
849
+ "num_input_tokens_seen": 305888,
850
+ "step": 480
851
+ },
852
+ {
853
+ "epoch": 8.508771929824562,
854
+ "grad_norm": 0.6177013516426086,
855
+ "learning_rate": 3.560013286454242e-05,
856
+ "loss": 0.1109,
857
+ "num_input_tokens_seen": 309344,
858
+ "step": 485
859
+ },
860
+ {
861
+ "epoch": 8.596491228070175,
862
+ "grad_norm": 1.3195477724075317,
863
+ "learning_rate": 3.5252265014961006e-05,
864
+ "loss": 0.179,
865
+ "num_input_tokens_seen": 312576,
866
+ "step": 490
867
+ },
868
+ {
869
+ "epoch": 8.68421052631579,
870
+ "grad_norm": 0.41115766763687134,
871
+ "learning_rate": 3.490199415097892e-05,
872
+ "loss": 0.0352,
873
+ "num_input_tokens_seen": 315552,
874
+ "step": 495
875
+ },
876
+ {
877
+ "epoch": 8.771929824561404,
878
+ "grad_norm": 0.3349473476409912,
879
+ "learning_rate": 3.45494023721058e-05,
880
+ "loss": 0.2252,
881
+ "num_input_tokens_seen": 318912,
882
+ "step": 500
883
+ },
884
+ {
885
+ "epoch": 8.859649122807017,
886
+ "grad_norm": 0.1699020266532898,
887
+ "learning_rate": 3.4194572321847336e-05,
888
+ "loss": 0.145,
889
+ "num_input_tokens_seen": 321696,
890
+ "step": 505
891
+ },
892
+ {
893
+ "epoch": 8.947368421052632,
894
+ "grad_norm": 1.4947104454040527,
895
+ "learning_rate": 3.383758716833459e-05,
896
+ "loss": 0.0934,
897
+ "num_input_tokens_seen": 325152,
898
+ "step": 510
899
+ },
900
+ {
901
+ "epoch": 9.0,
902
+ "eval_loss": 0.1684989184141159,
903
+ "eval_runtime": 0.604,
904
+ "eval_samples_per_second": 41.391,
905
+ "eval_steps_per_second": 11.59,
906
+ "num_input_tokens_seen": 326432,
907
+ "step": 513
908
+ },
909
+ {
910
+ "epoch": 9.035087719298245,
911
+ "grad_norm": 0.45036911964416504,
912
+ "learning_rate": 3.347853058483037e-05,
913
+ "loss": 0.0306,
914
+ "num_input_tokens_seen": 327584,
915
+ "step": 515
916
+ },
917
+ {
918
+ "epoch": 9.12280701754386,
919
+ "grad_norm": 0.19108375906944275,
920
+ "learning_rate": 3.311748673011709e-05,
921
+ "loss": 0.0661,
922
+ "num_input_tokens_seen": 331200,
923
+ "step": 520
924
+ },
925
+ {
926
+ "epoch": 9.210526315789474,
927
+ "grad_norm": 0.8615373373031616,
928
+ "learning_rate": 3.275454022877097e-05,
929
+ "loss": 0.1946,
930
+ "num_input_tokens_seen": 334272,
931
+ "step": 525
932
+ },
933
+ {
934
+ "epoch": 9.298245614035087,
935
+ "grad_norm": 1.4890180826187134,
936
+ "learning_rate": 3.238977615132697e-05,
937
+ "loss": 0.186,
938
+ "num_input_tokens_seen": 337312,
939
+ "step": 530
940
+ },
941
+ {
942
+ "epoch": 9.385964912280702,
943
+ "grad_norm": 0.10124935954809189,
944
+ "learning_rate": 3.202327999433924e-05,
945
+ "loss": 0.0622,
946
+ "num_input_tokens_seen": 340352,
947
+ "step": 535
948
+ },
949
+ {
950
+ "epoch": 9.473684210526315,
951
+ "grad_norm": 0.6486270427703857,
952
+ "learning_rate": 3.165513766034167e-05,
953
+ "loss": 0.1712,
954
+ "num_input_tokens_seen": 342848,
955
+ "step": 540
956
+ },
957
+ {
958
+ "epoch": 9.56140350877193,
959
+ "grad_norm": 0.39504653215408325,
960
+ "learning_rate": 3.128543543771336e-05,
961
+ "loss": 0.1511,
962
+ "num_input_tokens_seen": 346816,
963
+ "step": 545
964
+ },
965
+ {
966
+ "epoch": 9.649122807017545,
967
+ "grad_norm": 0.36625829339027405,
968
+ "learning_rate": 3.091425998045356e-05,
969
+ "loss": 0.0358,
970
+ "num_input_tokens_seen": 349824,
971
+ "step": 550
972
+ },
973
+ {
974
+ "epoch": 9.736842105263158,
975
+ "grad_norm": 1.1776262521743774,
976
+ "learning_rate": 3.0541698287870965e-05,
977
+ "loss": 0.1735,
978
+ "num_input_tokens_seen": 353152,
979
+ "step": 555
980
+ },
981
+ {
982
+ "epoch": 9.824561403508772,
983
+ "grad_norm": 0.49507373571395874,
984
+ "learning_rate": 3.01678376841921e-05,
985
+ "loss": 0.1294,
986
+ "num_input_tokens_seen": 356384,
987
+ "step": 560
988
+ },
989
+ {
990
+ "epoch": 9.912280701754385,
991
+ "grad_norm": 0.09637733548879623,
992
+ "learning_rate": 2.9792765798093465e-05,
993
+ "loss": 0.1055,
994
+ "num_input_tokens_seen": 359424,
995
+ "step": 565
996
+ },
997
+ {
998
+ "epoch": 10.0,
999
+ "grad_norm": 0.6121596097946167,
1000
+ "learning_rate": 2.94165705421624e-05,
1001
+ "loss": 0.0439,
1002
+ "num_input_tokens_seen": 362240,
1003
+ "step": 570
1004
+ },
1005
+ {
1006
+ "epoch": 10.0,
1007
+ "eval_loss": 0.16682939231395721,
1008
+ "eval_runtime": 0.6029,
1009
+ "eval_samples_per_second": 41.466,
1010
+ "eval_steps_per_second": 11.61,
1011
+ "num_input_tokens_seen": 362240,
1012
+ "step": 570
1013
+ },
1014
+ {
1015
+ "epoch": 10.087719298245615,
1016
+ "grad_norm": 0.25809445977211,
1017
+ "learning_rate": 2.9039340092291373e-05,
1018
+ "loss": 0.0788,
1019
+ "num_input_tokens_seen": 365312,
1020
+ "step": 575
1021
+ },
1022
+ {
1023
+ "epoch": 10.175438596491228,
1024
+ "grad_norm": 0.25701719522476196,
1025
+ "learning_rate": 2.8661162867010543e-05,
1026
+ "loss": 0.1636,
1027
+ "num_input_tokens_seen": 368704,
1028
+ "step": 580
1029
+ },
1030
+ {
1031
+ "epoch": 10.263157894736842,
1032
+ "grad_norm": 1.2454321384429932,
1033
+ "learning_rate": 2.8282127506763456e-05,
1034
+ "loss": 0.164,
1035
+ "num_input_tokens_seen": 372160,
1036
+ "step": 585
1037
+ },
1038
+ {
1039
+ "epoch": 10.350877192982455,
1040
+ "grad_norm": 0.4727979302406311,
1041
+ "learning_rate": 2.7902322853130757e-05,
1042
+ "loss": 0.1611,
1043
+ "num_input_tokens_seen": 375168,
1044
+ "step": 590
1045
+ },
1046
+ {
1047
+ "epoch": 10.43859649122807,
1048
+ "grad_norm": 1.0172535181045532,
1049
+ "learning_rate": 2.752183792800671e-05,
1050
+ "loss": 0.0615,
1051
+ "num_input_tokens_seen": 378208,
1052
+ "step": 595
1053
+ },
1054
+ {
1055
+ "epoch": 10.526315789473685,
1056
+ "grad_norm": 1.2912495136260986,
1057
+ "learning_rate": 2.7140761912733474e-05,
1058
+ "loss": 0.1507,
1059
+ "num_input_tokens_seen": 381408,
1060
+ "step": 600
1061
+ },
1062
+ {
1063
+ "epoch": 10.614035087719298,
1064
+ "grad_norm": 2.1186602115631104,
1065
+ "learning_rate": 2.6759184127198046e-05,
1066
+ "loss": 0.1174,
1067
+ "num_input_tokens_seen": 384192,
1068
+ "step": 605
1069
+ },
1070
+ {
1071
+ "epoch": 10.701754385964913,
1072
+ "grad_norm": 0.6159073710441589,
1073
+ "learning_rate": 2.6377194008896637e-05,
1074
+ "loss": 0.0855,
1075
+ "num_input_tokens_seen": 387328,
1076
+ "step": 610
1077
+ },
1078
+ {
1079
+ "epoch": 10.789473684210526,
1080
+ "grad_norm": 0.8896193504333496,
1081
+ "learning_rate": 2.5994881091971605e-05,
1082
+ "loss": 0.1172,
1083
+ "num_input_tokens_seen": 391008,
1084
+ "step": 615
1085
+ },
1086
+ {
1087
+ "epoch": 10.87719298245614,
1088
+ "grad_norm": 0.45159250497817993,
1089
+ "learning_rate": 2.5612334986225623e-05,
1090
+ "loss": 0.0348,
1091
+ "num_input_tokens_seen": 394112,
1092
+ "step": 620
1093
+ },
1094
+ {
1095
+ "epoch": 10.964912280701755,
1096
+ "grad_norm": 0.48257771134376526,
1097
+ "learning_rate": 2.5229645356118163e-05,
1098
+ "loss": 0.1436,
1099
+ "num_input_tokens_seen": 397120,
1100
+ "step": 625
1101
+ },
1102
+ {
1103
+ "epoch": 11.0,
1104
+ "eval_loss": 0.16373665630817413,
1105
+ "eval_runtime": 0.6017,
1106
+ "eval_samples_per_second": 41.549,
1107
+ "eval_steps_per_second": 11.634,
1108
+ "num_input_tokens_seen": 397880,
1109
+ "step": 627
1110
+ },
1111
+ {
1112
+ "epoch": 11.052631578947368,
1113
+ "grad_norm": 0.8018878698348999,
1114
+ "learning_rate": 2.4846901899749185e-05,
1115
+ "loss": 0.0709,
1116
+ "num_input_tokens_seen": 400024,
1117
+ "step": 630
1118
+ },
1119
+ {
1120
+ "epoch": 11.140350877192983,
1121
+ "grad_norm": 0.16898022592067719,
1122
+ "learning_rate": 2.4464194327834926e-05,
1123
+ "loss": 0.2151,
1124
+ "num_input_tokens_seen": 403544,
1125
+ "step": 635
1126
+ },
1127
+ {
1128
+ "epoch": 11.228070175438596,
1129
+ "grad_norm": 0.6593197584152222,
1130
+ "learning_rate": 2.4081612342680694e-05,
1131
+ "loss": 0.067,
1132
+ "num_input_tokens_seen": 407192,
1133
+ "step": 640
1134
+ },
1135
+ {
1136
+ "epoch": 11.31578947368421,
1137
+ "grad_norm": 0.6002839803695679,
1138
+ "learning_rate": 2.369924561715569e-05,
1139
+ "loss": 0.1594,
1140
+ "num_input_tokens_seen": 410328,
1141
+ "step": 645
1142
+ },
1143
+ {
1144
+ "epoch": 11.403508771929825,
1145
+ "grad_norm": 0.3108993470668793,
1146
+ "learning_rate": 2.3317183773674718e-05,
1147
+ "loss": 0.1185,
1148
+ "num_input_tokens_seen": 413176,
1149
+ "step": 650
1150
+ },
1151
+ {
1152
+ "epoch": 11.491228070175438,
1153
+ "grad_norm": 0.31159061193466187,
1154
+ "learning_rate": 2.2935516363191693e-05,
1155
+ "loss": 0.1009,
1156
+ "num_input_tokens_seen": 415928,
1157
+ "step": 655
1158
+ },
1159
+ {
1160
+ "epoch": 11.578947368421053,
1161
+ "grad_norm": 0.5226975083351135,
1162
+ "learning_rate": 2.2554332844209904e-05,
1163
+ "loss": 0.104,
1164
+ "num_input_tokens_seen": 418968,
1165
+ "step": 660
1166
+ },
1167
+ {
1168
+ "epoch": 11.666666666666666,
1169
+ "grad_norm": 1.165509581565857,
1170
+ "learning_rate": 2.2173722561813987e-05,
1171
+ "loss": 0.0887,
1172
+ "num_input_tokens_seen": 422392,
1173
+ "step": 665
1174
+ },
1175
+ {
1176
+ "epoch": 11.75438596491228,
1177
+ "grad_norm": 1.930398941040039,
1178
+ "learning_rate": 2.179377472672842e-05,
1179
+ "loss": 0.1313,
1180
+ "num_input_tokens_seen": 425592,
1181
+ "step": 670
1182
+ },
1183
+ {
1184
+ "epoch": 11.842105263157894,
1185
+ "grad_norm": 0.4046188294887543,
1186
+ "learning_rate": 2.1414578394407597e-05,
1187
+ "loss": 0.0682,
1188
+ "num_input_tokens_seen": 428664,
1189
+ "step": 675
1190
+ },
1191
+ {
1192
+ "epoch": 11.929824561403509,
1193
+ "grad_norm": 0.432612806558609,
1194
+ "learning_rate": 2.1036222444162147e-05,
1195
+ "loss": 0.0766,
1196
+ "num_input_tokens_seen": 431576,
1197
+ "step": 680
1198
+ },
1199
+ {
1200
+ "epoch": 12.0,
1201
+ "eval_loss": 0.16736947000026703,
1202
+ "eval_runtime": 0.603,
1203
+ "eval_samples_per_second": 41.462,
1204
+ "eval_steps_per_second": 11.609,
1205
+ "num_input_tokens_seen": 433352,
1206
+ "step": 684
1207
+ },
1208
+ {
1209
+ "epoch": 12.017543859649123,
1210
+ "grad_norm": 0.20478223264217377,
1211
+ "learning_rate": 2.0658795558326743e-05,
1212
+ "loss": 0.1394,
1213
+ "num_input_tokens_seen": 433864,
1214
+ "step": 685
1215
+ },
1216
+ {
1217
+ "epoch": 12.105263157894736,
1218
+ "grad_norm": 0.6977035403251648,
1219
+ "learning_rate": 2.0282386201473894e-05,
1220
+ "loss": 0.0829,
1221
+ "num_input_tokens_seen": 437160,
1222
+ "step": 690
1223
+ },
1224
+ {
1225
+ "epoch": 12.192982456140351,
1226
+ "grad_norm": 1.0072869062423706,
1227
+ "learning_rate": 1.99070825996789e-05,
1228
+ "loss": 0.1179,
1229
+ "num_input_tokens_seen": 440264,
1230
+ "step": 695
1231
+ },
1232
+ {
1233
+ "epoch": 12.280701754385966,
1234
+ "grad_norm": 1.7002723217010498,
1235
+ "learning_rate": 1.9532972719840607e-05,
1236
+ "loss": 0.1595,
1237
+ "num_input_tokens_seen": 443720,
1238
+ "step": 700
1239
+ },
1240
+ {
1241
+ "epoch": 12.368421052631579,
1242
+ "grad_norm": 0.6006500124931335,
1243
+ "learning_rate": 1.9160144249063035e-05,
1244
+ "loss": 0.0891,
1245
+ "num_input_tokens_seen": 446184,
1246
+ "step": 705
1247
+ },
1248
+ {
1249
+ "epoch": 12.456140350877194,
1250
+ "grad_norm": 0.06546429544687271,
1251
+ "learning_rate": 1.8788684574102467e-05,
1252
+ "loss": 0.1518,
1253
+ "num_input_tokens_seen": 449800,
1254
+ "step": 710
1255
+ },
1256
+ {
1257
+ "epoch": 12.543859649122806,
1258
+ "grad_norm": 0.5877346396446228,
1259
+ "learning_rate": 1.8418680760885027e-05,
1260
+ "loss": 0.1242,
1261
+ "num_input_tokens_seen": 453512,
1262
+ "step": 715
1263
+ },
1264
+ {
1265
+ "epoch": 12.631578947368421,
1266
+ "grad_norm": 0.5955691337585449,
1267
+ "learning_rate": 1.805021953409934e-05,
1268
+ "loss": 0.1386,
1269
+ "num_input_tokens_seen": 456712,
1270
+ "step": 720
1271
+ },
1272
+ {
1273
+ "epoch": 12.719298245614034,
1274
+ "grad_norm": 0.12753373384475708,
1275
+ "learning_rate": 1.7683387256869353e-05,
1276
+ "loss": 0.0818,
1277
+ "num_input_tokens_seen": 459624,
1278
+ "step": 725
1279
+ },
1280
+ {
1281
+ "epoch": 12.807017543859649,
1282
+ "grad_norm": 0.2285155951976776,
1283
+ "learning_rate": 1.7318269910511736e-05,
1284
+ "loss": 0.048,
1285
+ "num_input_tokens_seen": 462792,
1286
+ "step": 730
1287
+ },
1288
+ {
1289
+ "epoch": 12.894736842105264,
1290
+ "grad_norm": 0.7147763967514038,
1291
+ "learning_rate": 1.6954953074382863e-05,
1292
+ "loss": 0.1374,
1293
+ "num_input_tokens_seen": 465960,
1294
+ "step": 735
1295
+ },
1296
+ {
1297
+ "epoch": 12.982456140350877,
1298
+ "grad_norm": 0.2764018177986145,
1299
+ "learning_rate": 1.659352190581993e-05,
1300
+ "loss": 0.0927,
1301
+ "num_input_tokens_seen": 469480,
1302
+ "step": 740
1303
+ },
1304
+ {
1305
+ "epoch": 13.0,
1306
+ "eval_loss": 0.16528616845607758,
1307
+ "eval_runtime": 0.6065,
1308
+ "eval_samples_per_second": 41.222,
1309
+ "eval_steps_per_second": 11.542,
1310
+ "num_input_tokens_seen": 469568,
1311
+ "step": 741
1312
+ },
1313
+ {
1314
+ "epoch": 13.070175438596491,
1315
+ "grad_norm": 0.07355260848999023,
1316
+ "learning_rate": 1.6234061120181142e-05,
1317
+ "loss": 0.0564,
1318
+ "num_input_tokens_seen": 472512,
1319
+ "step": 745
1320
+ },
1321
+ {
1322
+ "epoch": 13.157894736842104,
1323
+ "grad_norm": 0.7244663834571838,
1324
+ "learning_rate": 1.5876654970989308e-05,
1325
+ "loss": 0.2084,
1326
+ "num_input_tokens_seen": 475552,
1327
+ "step": 750
1328
+ },
1329
+ {
1330
+ "epoch": 13.24561403508772,
1331
+ "grad_norm": 1.2521926164627075,
1332
+ "learning_rate": 1.552138723018382e-05,
1333
+ "loss": 0.0635,
1334
+ "num_input_tokens_seen": 478400,
1335
+ "step": 755
1336
+ },
1337
+ {
1338
+ "epoch": 13.333333333333334,
1339
+ "grad_norm": 0.9716154932975769,
1340
+ "learning_rate": 1.5168341168485423e-05,
1341
+ "loss": 0.1836,
1342
+ "num_input_tokens_seen": 482208,
1343
+ "step": 760
1344
+ },
1345
+ {
1346
+ "epoch": 13.421052631578947,
1347
+ "grad_norm": 0.3328050673007965,
1348
+ "learning_rate": 1.4817599535878565e-05,
1349
+ "loss": 0.1271,
1350
+ "num_input_tokens_seen": 484992,
1351
+ "step": 765
1352
+ },
1353
+ {
1354
+ "epoch": 13.508771929824562,
1355
+ "grad_norm": 1.1851916313171387,
1356
+ "learning_rate": 1.4469244542215682e-05,
1357
+ "loss": 0.1617,
1358
+ "num_input_tokens_seen": 488160,
1359
+ "step": 770
1360
+ },
1361
+ {
1362
+ "epoch": 13.596491228070175,
1363
+ "grad_norm": 0.21802516281604767,
1364
+ "learning_rate": 1.4123357837948175e-05,
1365
+ "loss": 0.0246,
1366
+ "num_input_tokens_seen": 491136,
1367
+ "step": 775
1368
+ },
1369
+ {
1370
+ "epoch": 13.68421052631579,
1371
+ "grad_norm": 0.20303232967853546,
1372
+ "learning_rate": 1.3780020494988446e-05,
1373
+ "loss": 0.0617,
1374
+ "num_input_tokens_seen": 493824,
1375
+ "step": 780
1376
+ },
1377
+ {
1378
+ "epoch": 13.771929824561404,
1379
+ "grad_norm": 0.4628726541996002,
1380
+ "learning_rate": 1.3439312987707615e-05,
1381
+ "loss": 0.1239,
1382
+ "num_input_tokens_seen": 496960,
1383
+ "step": 785
1384
+ },
1385
+ {
1386
+ "epoch": 13.859649122807017,
1387
+ "grad_norm": 0.6936680674552917,
1388
+ "learning_rate": 1.3101315174073162e-05,
1389
+ "loss": 0.1333,
1390
+ "num_input_tokens_seen": 500032,
1391
+ "step": 790
1392
+ },
1393
+ {
1394
+ "epoch": 13.947368421052632,
1395
+ "grad_norm": 1.0667040348052979,
1396
+ "learning_rate": 1.2766106276931223e-05,
1397
+ "loss": 0.0488,
1398
+ "num_input_tokens_seen": 503296,
1399
+ "step": 795
1400
+ },
1401
+ {
1402
+ "epoch": 14.0,
1403
+ "eval_loss": 0.1684103161096573,
1404
+ "eval_runtime": 0.6054,
1405
+ "eval_samples_per_second": 41.293,
1406
+ "eval_steps_per_second": 11.562,
1407
+ "num_input_tokens_seen": 505048,
1408
+ "step": 798
1409
+ },
1410
+ {
1411
+ "epoch": 14.035087719298245,
1412
+ "grad_norm": 1.190641164779663,
1413
+ "learning_rate": 1.243376486543755e-05,
1414
+ "loss": 0.1163,
1415
+ "num_input_tokens_seen": 506136,
1416
+ "step": 800
1417
+ },
1418
+ {
1419
+ "epoch": 14.12280701754386,
1420
+ "grad_norm": 0.7098046541213989,
1421
+ "learning_rate": 1.2104368836641908e-05,
1422
+ "loss": 0.0638,
1423
+ "num_input_tokens_seen": 509432,
1424
+ "step": 805
1425
+ },
1426
+ {
1427
+ "epoch": 14.210526315789474,
1428
+ "grad_norm": 1.90586519241333,
1429
+ "learning_rate": 1.1777995397229771e-05,
1430
+ "loss": 0.1865,
1431
+ "num_input_tokens_seen": 512088,
1432
+ "step": 810
1433
+ },
1434
+ {
1435
+ "epoch": 14.298245614035087,
1436
+ "grad_norm": 0.16771575808525085,
1437
+ "learning_rate": 1.1454721045426073e-05,
1438
+ "loss": 0.0795,
1439
+ "num_input_tokens_seen": 515736,
1440
+ "step": 815
1441
+ },
1442
+ {
1443
+ "epoch": 14.385964912280702,
1444
+ "grad_norm": 2.2329001426696777,
1445
+ "learning_rate": 1.113462155306478e-05,
1446
+ "loss": 0.2313,
1447
+ "num_input_tokens_seen": 518808,
1448
+ "step": 820
1449
+ },
1450
+ {
1451
+ "epoch": 14.473684210526315,
1452
+ "grad_norm": 0.9383437037467957,
1453
+ "learning_rate": 1.0817771947828934e-05,
1454
+ "loss": 0.0668,
1455
+ "num_input_tokens_seen": 522456,
1456
+ "step": 825
1457
+ },
1458
+ {
1459
+ "epoch": 14.56140350877193,
1460
+ "grad_norm": 0.6960124373435974,
1461
+ "learning_rate": 1.0504246495664932e-05,
1462
+ "loss": 0.0941,
1463
+ "num_input_tokens_seen": 525816,
1464
+ "step": 830
1465
+ },
1466
+ {
1467
+ "epoch": 14.649122807017545,
1468
+ "grad_norm": 0.7110118865966797,
1469
+ "learning_rate": 1.0194118683375503e-05,
1470
+ "loss": 0.0827,
1471
+ "num_input_tokens_seen": 528856,
1472
+ "step": 835
1473
+ },
1474
+ {
1475
+ "epoch": 14.736842105263158,
1476
+ "grad_norm": 0.6152472496032715,
1477
+ "learning_rate": 9.887461201395176e-06,
1478
+ "loss": 0.0716,
1479
+ "num_input_tokens_seen": 531704,
1480
+ "step": 840
1481
+ },
1482
+ {
1483
+ "epoch": 14.824561403508772,
1484
+ "grad_norm": 0.09611520171165466,
1485
+ "learning_rate": 9.584345926752524e-06,
1486
+ "loss": 0.0978,
1487
+ "num_input_tokens_seen": 535256,
1488
+ "step": 845
1489
+ },
1490
+ {
1491
+ "epoch": 14.912280701754385,
1492
+ "grad_norm": 0.4372381269931793,
1493
+ "learning_rate": 9.284843906222948e-06,
1494
+ "loss": 0.0831,
1495
+ "num_input_tokens_seen": 538744,
1496
+ "step": 850
1497
+ },
1498
+ {
1499
+ "epoch": 15.0,
1500
+ "grad_norm": 0.27762579917907715,
1501
+ "learning_rate": 8.98902533967618e-06,
1502
+ "loss": 0.054,
1503
+ "num_input_tokens_seen": 541088,
1504
+ "step": 855
1505
+ },
1506
+ {
1507
+ "epoch": 15.0,
1508
+ "eval_loss": 0.16769246757030487,
1509
+ "eval_runtime": 0.6019,
1510
+ "eval_samples_per_second": 41.536,
1511
+ "eval_steps_per_second": 11.63,
1512
+ "num_input_tokens_seen": 541088,
1513
+ "step": 855
1514
+ },
1515
+ {
1516
+ "epoch": 15.087719298245615,
1517
+ "grad_norm": 0.5130884051322937,
1518
+ "learning_rate": 8.696959563622174e-06,
1519
+ "loss": 0.1421,
1520
+ "num_input_tokens_seen": 544032,
1521
+ "step": 860
1522
+ },
1523
+ {
1524
+ "epoch": 15.175438596491228,
1525
+ "grad_norm": 0.6195077896118164,
1526
+ "learning_rate": 8.40871503495947e-06,
1527
+ "loss": 0.1449,
1528
+ "num_input_tokens_seen": 547360,
1529
+ "step": 865
1530
+ },
1531
+ {
1532
+ "epoch": 15.263157894736842,
1533
+ "grad_norm": 1.4489924907684326,
1534
+ "learning_rate": 8.124359314929622e-06,
1535
+ "loss": 0.1799,
1536
+ "num_input_tokens_seen": 550560,
1537
+ "step": 870
1538
+ },
1539
+ {
1540
+ "epoch": 15.350877192982455,
1541
+ "grad_norm": 0.16693495213985443,
1542
+ "learning_rate": 7.843959053281663e-06,
1543
+ "loss": 0.0431,
1544
+ "num_input_tokens_seen": 553632,
1545
+ "step": 875
1546
+ },
1547
+ {
1548
+ "epoch": 15.43859649122807,
1549
+ "grad_norm": 1.5036920309066772,
1550
+ "learning_rate": 7.5675799726501155e-06,
1551
+ "loss": 0.1225,
1552
+ "num_input_tokens_seen": 557184,
1553
+ "step": 880
1554
+ },
1555
+ {
1556
+ "epoch": 15.526315789473685,
1557
+ "grad_norm": 0.46811360120773315,
1558
+ "learning_rate": 7.295286853150391e-06,
1559
+ "loss": 0.1155,
1560
+ "num_input_tokens_seen": 560896,
1561
+ "step": 885
1562
+ },
1563
+ {
1564
+ "epoch": 15.614035087719298,
1565
+ "grad_norm": 0.247733935713768,
1566
+ "learning_rate": 7.027143517195023e-06,
1567
+ "loss": 0.0485,
1568
+ "num_input_tokens_seen": 564864,
1569
+ "step": 890
1570
+ },
1571
+ {
1572
+ "epoch": 15.701754385964913,
1573
+ "grad_norm": 0.4505546987056732,
1574
+ "learning_rate": 6.763212814534484e-06,
1575
+ "loss": 0.1101,
1576
+ "num_input_tokens_seen": 568160,
1577
+ "step": 895
1578
+ },
1579
+ {
1580
+ "epoch": 15.789473684210526,
1581
+ "grad_norm": 0.5195504426956177,
1582
+ "learning_rate": 6.503556607525838e-06,
1583
+ "loss": 0.0698,
1584
+ "num_input_tokens_seen": 571136,
1585
+ "step": 900
1586
+ },
1587
+ {
1588
+ "epoch": 15.87719298245614,
1589
+ "grad_norm": 0.33287501335144043,
1590
+ "learning_rate": 6.248235756632984e-06,
1591
+ "loss": 0.0968,
1592
+ "num_input_tokens_seen": 574272,
1593
+ "step": 905
1594
+ },
1595
+ {
1596
+ "epoch": 15.964912280701755,
1597
+ "grad_norm": 0.2531483769416809,
1598
+ "learning_rate": 5.997310106161589e-06,
1599
+ "loss": 0.116,
1600
+ "num_input_tokens_seen": 576864,
1601
+ "step": 910
1602
+ },
1603
+ {
1604
+ "epoch": 16.0,
1605
+ "eval_loss": 0.16834516823291779,
1606
+ "eval_runtime": 0.6017,
1607
+ "eval_samples_per_second": 41.551,
1608
+ "eval_steps_per_second": 11.634,
1609
+ "num_input_tokens_seen": 577512,
1610
+ "step": 912
1611
+ },
1612
+ {
1613
+ "epoch": 16.05263157894737,
1614
+ "grad_norm": 0.14398978650569916,
1615
+ "learning_rate": 5.7508384702323226e-06,
1616
+ "loss": 0.1738,
1617
+ "num_input_tokens_seen": 579272,
1618
+ "step": 915
1619
+ },
1620
+ {
1621
+ "epoch": 16.140350877192983,
1622
+ "grad_norm": 0.4479779005050659,
1623
+ "learning_rate": 5.508878618995439e-06,
1624
+ "loss": 0.0412,
1625
+ "num_input_tokens_seen": 582472,
1626
+ "step": 920
1627
+ },
1628
+ {
1629
+ "epoch": 16.228070175438596,
1630
+ "grad_norm": 0.25861650705337524,
1631
+ "learning_rate": 5.271487265090163e-06,
1632
+ "loss": 0.1432,
1633
+ "num_input_tokens_seen": 584872,
1634
+ "step": 925
1635
+ },
1636
+ {
1637
+ "epoch": 16.31578947368421,
1638
+ "grad_norm": 0.5827816724777222,
1639
+ "learning_rate": 5.038720050351842e-06,
1640
+ "loss": 0.0739,
1641
+ "num_input_tokens_seen": 587592,
1642
+ "step": 930
1643
+ },
1644
+ {
1645
+ "epoch": 16.403508771929825,
1646
+ "grad_norm": 0.7898945808410645,
1647
+ "learning_rate": 4.810631532770182e-06,
1648
+ "loss": 0.1136,
1649
+ "num_input_tokens_seen": 590888,
1650
+ "step": 935
1651
+ },
1652
+ {
1653
+ "epoch": 16.49122807017544,
1654
+ "grad_norm": 0.8079265356063843,
1655
+ "learning_rate": 4.587275173701428e-06,
1656
+ "loss": 0.0824,
1657
+ "num_input_tokens_seen": 594504,
1658
+ "step": 940
1659
+ },
1660
+ {
1661
+ "epoch": 16.57894736842105,
1662
+ "grad_norm": 0.3525395095348358,
1663
+ "learning_rate": 4.368703325337667e-06,
1664
+ "loss": 0.113,
1665
+ "num_input_tokens_seen": 598152,
1666
+ "step": 945
1667
+ },
1668
+ {
1669
+ "epoch": 16.666666666666668,
1670
+ "grad_norm": 0.7206453084945679,
1671
+ "learning_rate": 4.154967218436037e-06,
1672
+ "loss": 0.0814,
1673
+ "num_input_tokens_seen": 601288,
1674
+ "step": 950
1675
+ },
1676
+ {
1677
+ "epoch": 16.75438596491228,
1678
+ "grad_norm": 0.6702446341514587,
1679
+ "learning_rate": 3.94611695031086e-06,
1680
+ "loss": 0.2507,
1681
+ "num_input_tokens_seen": 605064,
1682
+ "step": 955
1683
+ },
1684
+ {
1685
+ "epoch": 16.842105263157894,
1686
+ "grad_norm": 0.5649908185005188,
1687
+ "learning_rate": 3.74220147309135e-06,
1688
+ "loss": 0.0622,
1689
+ "num_input_tokens_seen": 608200,
1690
+ "step": 960
1691
+ },
1692
+ {
1693
+ "epoch": 16.92982456140351,
1694
+ "grad_norm": 0.5020720362663269,
1695
+ "learning_rate": 3.543268582247844e-06,
1696
+ "loss": 0.0392,
1697
+ "num_input_tokens_seen": 611752,
1698
+ "step": 965
1699
+ },
1700
+ {
1701
+ "epoch": 17.0,
1702
+ "eval_loss": 0.17154988646507263,
1703
+ "eval_runtime": 0.6037,
1704
+ "eval_samples_per_second": 41.409,
1705
+ "eval_steps_per_second": 11.594,
1706
+ "num_input_tokens_seen": 614128,
1707
+ "step": 969
1708
+ },
1709
+ {
1710
+ "epoch": 17.017543859649123,
1711
+ "grad_norm": 1.115767240524292,
1712
+ "learning_rate": 3.3493649053890326e-06,
1713
+ "loss": 0.0407,
1714
+ "num_input_tokens_seen": 614832,
1715
+ "step": 970
1716
+ },
1717
+ {
1718
+ "epoch": 17.105263157894736,
1719
+ "grad_norm": 0.6341782212257385,
1720
+ "learning_rate": 3.1605358913330385e-06,
1721
+ "loss": 0.1085,
1722
+ "num_input_tokens_seen": 618032,
1723
+ "step": 975
1724
+ },
1725
+ {
1726
+ "epoch": 17.19298245614035,
1727
+ "grad_norm": 1.4300333261489868,
1728
+ "learning_rate": 2.9768257994546662e-06,
1729
+ "loss": 0.1136,
1730
+ "num_input_tokens_seen": 620944,
1731
+ "step": 980
1732
+ },
1733
+ {
1734
+ "epoch": 17.280701754385966,
1735
+ "grad_norm": 0.0989091694355011,
1736
+ "learning_rate": 2.7982776893115627e-06,
1737
+ "loss": 0.0963,
1738
+ "num_input_tokens_seen": 624720,
1739
+ "step": 985
1740
+ },
1741
+ {
1742
+ "epoch": 17.36842105263158,
1743
+ "grad_norm": 0.11389263719320297,
1744
+ "learning_rate": 2.624933410551508e-06,
1745
+ "loss": 0.0907,
1746
+ "num_input_tokens_seen": 627632,
1747
+ "step": 990
1748
+ },
1749
+ {
1750
+ "epoch": 17.45614035087719,
1751
+ "grad_norm": 0.8745826482772827,
1752
+ "learning_rate": 2.456833593103361e-06,
1753
+ "loss": 0.079,
1754
+ "num_input_tokens_seen": 630768,
1755
+ "step": 995
1756
+ },
1757
+ {
1758
+ "epoch": 17.54385964912281,
1759
+ "grad_norm": 0.18442676961421967,
1760
+ "learning_rate": 2.2940176376538445e-06,
1761
+ "loss": 0.0352,
1762
+ "num_input_tokens_seen": 633616,
1763
+ "step": 1000
1764
+ },
1765
+ {
1766
+ "epoch": 17.63157894736842,
1767
+ "grad_norm": 0.5634293556213379,
1768
+ "learning_rate": 2.136523706412477e-06,
1769
+ "loss": 0.1026,
1770
+ "num_input_tokens_seen": 636720,
1771
+ "step": 1005
1772
+ },
1773
+ {
1774
+ "epoch": 17.719298245614034,
1775
+ "grad_norm": 0.5354846119880676,
1776
+ "learning_rate": 1.984388714166799e-06,
1777
+ "loss": 0.2101,
1778
+ "num_input_tokens_seen": 639696,
1779
+ "step": 1010
1780
+ },
1781
+ {
1782
+ "epoch": 17.80701754385965,
1783
+ "grad_norm": 0.8380753397941589,
1784
+ "learning_rate": 1.837648319629956e-06,
1785
+ "loss": 0.0806,
1786
+ "num_input_tokens_seen": 642320,
1787
+ "step": 1015
1788
+ },
1789
+ {
1790
+ "epoch": 17.894736842105264,
1791
+ "grad_norm": 0.7979387640953064,
1792
+ "learning_rate": 1.6963369170826943e-06,
1793
+ "loss": 0.0863,
1794
+ "num_input_tokens_seen": 646416,
1795
+ "step": 1020
1796
+ },
1797
+ {
1798
+ "epoch": 17.982456140350877,
1799
+ "grad_norm": 1.9226421117782593,
1800
+ "learning_rate": 1.5604876283117326e-06,
1801
+ "loss": 0.1652,
1802
+ "num_input_tokens_seen": 649488,
1803
+ "step": 1025
1804
+ },
1805
+ {
1806
+ "epoch": 18.0,
1807
+ "eval_loss": 0.16611041128635406,
1808
+ "eval_runtime": 0.6766,
1809
+ "eval_samples_per_second": 36.95,
1810
+ "eval_steps_per_second": 10.346,
1811
+ "num_input_tokens_seen": 649608,
1812
+ "step": 1026
1813
+ },
1814
+ {
1815
+ "epoch": 18.07017543859649,
1816
+ "grad_norm": 1.771928071975708,
1817
+ "learning_rate": 1.4301322948464147e-06,
1818
+ "loss": 0.1597,
1819
+ "num_input_tokens_seen": 652360,
1820
+ "step": 1030
1821
+ },
1822
+ {
1823
+ "epoch": 18.157894736842106,
1824
+ "grad_norm": 0.1352318972349167,
1825
+ "learning_rate": 1.3053014704953987e-06,
1826
+ "loss": 0.0381,
1827
+ "num_input_tokens_seen": 655912,
1828
+ "step": 1035
1829
+ },
1830
+ {
1831
+ "epoch": 18.24561403508772,
1832
+ "grad_norm": 0.27389442920684814,
1833
+ "learning_rate": 1.1860244141851773e-06,
1834
+ "loss": 0.091,
1835
+ "num_input_tokens_seen": 658728,
1836
+ "step": 1040
1837
+ },
1838
+ {
1839
+ "epoch": 18.333333333333332,
1840
+ "grad_norm": 0.5427435040473938,
1841
+ "learning_rate": 1.0723290831021471e-06,
1842
+ "loss": 0.1058,
1843
+ "num_input_tokens_seen": 661960,
1844
+ "step": 1045
1845
+ },
1846
+ {
1847
+ "epoch": 18.42105263157895,
1848
+ "grad_norm": 0.10558883845806122,
1849
+ "learning_rate": 9.642421261397472e-07,
1850
+ "loss": 0.1121,
1851
+ "num_input_tokens_seen": 665352,
1852
+ "step": 1050
1853
+ },
1854
+ {
1855
+ "epoch": 18.50877192982456,
1856
+ "grad_norm": 0.2879549562931061,
1857
+ "learning_rate": 8.617888776522642e-07,
1858
+ "loss": 0.0667,
1859
+ "num_input_tokens_seen": 668584,
1860
+ "step": 1055
1861
+ },
1862
+ {
1863
+ "epoch": 18.596491228070175,
1864
+ "grad_norm": 0.30306294560432434,
1865
+ "learning_rate": 7.649933515167407e-07,
1866
+ "loss": 0.0835,
1867
+ "num_input_tokens_seen": 672232,
1868
+ "step": 1060
1869
+ },
1870
+ {
1871
+ "epoch": 18.68421052631579,
1872
+ "grad_norm": 0.0694447010755539,
1873
+ "learning_rate": 6.738782355044049e-07,
1874
+ "loss": 0.0619,
1875
+ "num_input_tokens_seen": 675208,
1876
+ "step": 1065
1877
+ },
1878
+ {
1879
+ "epoch": 18.771929824561404,
1880
+ "grad_norm": 0.27397459745407104,
1881
+ "learning_rate": 5.88464885962911e-07,
1882
+ "loss": 0.1326,
1883
+ "num_input_tokens_seen": 678216,
1884
+ "step": 1070
1885
+ },
1886
+ {
1887
+ "epoch": 18.859649122807017,
1888
+ "grad_norm": 0.7683075070381165,
1889
+ "learning_rate": 5.087733228106517e-07,
1890
+ "loss": 0.2085,
1891
+ "num_input_tokens_seen": 680808,
1892
+ "step": 1075
1893
+ },
1894
+ {
1895
+ "epoch": 18.94736842105263,
1896
+ "grad_norm": 0.47901666164398193,
1897
+ "learning_rate": 4.3482222484432513e-07,
1898
+ "loss": 0.0601,
1899
+ "num_input_tokens_seen": 684104,
1900
+ "step": 1080
1901
+ },
1902
+ {
1903
+ "epoch": 19.0,
1904
+ "eval_loss": 0.1681518256664276,
1905
+ "eval_runtime": 0.6058,
1906
+ "eval_samples_per_second": 41.268,
1907
+ "eval_steps_per_second": 11.555,
1908
+ "num_input_tokens_seen": 685200,
1909
+ "step": 1083
1910
+ },
1911
+ {
1912
+ "epoch": 19.035087719298247,
1913
+ "grad_norm": 1.0625320672988892,
1914
+ "learning_rate": 3.666289253608235e-07,
1915
+ "loss": 0.1252,
1916
+ "num_input_tokens_seen": 686608,
1917
+ "step": 1085
1918
+ },
1919
+ {
1920
+ "epoch": 19.12280701754386,
1921
+ "grad_norm": 0.2796110510826111,
1922
+ "learning_rate": 3.0420940809451624e-07,
1923
+ "loss": 0.049,
1924
+ "num_input_tokens_seen": 689616,
1925
+ "step": 1090
1926
+ },
1927
+ {
1928
+ "epoch": 19.210526315789473,
1929
+ "grad_norm": 0.5877715349197388,
1930
+ "learning_rate": 2.47578303470844e-07,
1931
+ "loss": 0.0456,
1932
+ "num_input_tokens_seen": 692784,
1933
+ "step": 1095
1934
+ },
1935
+ {
1936
+ "epoch": 19.29824561403509,
1937
+ "grad_norm": 0.32777056097984314,
1938
+ "learning_rate": 1.96748885177106e-07,
1939
+ "loss": 0.0582,
1940
+ "num_input_tokens_seen": 696176,
1941
+ "step": 1100
1942
+ },
1943
+ {
1944
+ "epoch": 19.385964912280702,
1945
+ "grad_norm": 0.8007587194442749,
1946
+ "learning_rate": 1.517330670512629e-07,
1947
+ "loss": 0.253,
1948
+ "num_input_tokens_seen": 699184,
1949
+ "step": 1105
1950
+ },
1951
+ {
1952
+ "epoch": 19.473684210526315,
1953
+ "grad_norm": 0.9381267428398132,
1954
+ "learning_rate": 1.125414002894759e-07,
1955
+ "loss": 0.0827,
1956
+ "num_input_tokens_seen": 702448,
1957
+ "step": 1110
1958
+ },
1959
+ {
1960
+ "epoch": 19.56140350877193,
1961
+ "grad_norm": 0.6560412645339966,
1962
+ "learning_rate": 7.918307097301014e-08,
1963
+ "loss": 0.0775,
1964
+ "num_input_tokens_seen": 705232,
1965
+ "step": 1115
1966
+ },
1967
+ {
1968
+ "epoch": 19.649122807017545,
1969
+ "grad_norm": 0.9032533764839172,
1970
+ "learning_rate": 5.166589791513465e-08,
1971
+ "loss": 0.1479,
1972
+ "num_input_tokens_seen": 708624,
1973
+ "step": 1120
1974
+ },
1975
+ {
1976
+ "epoch": 19.736842105263158,
1977
+ "grad_norm": 0.7370986342430115,
1978
+ "learning_rate": 2.999633082847453e-08,
1979
+ "loss": 0.125,
1980
+ "num_input_tokens_seen": 711568,
1981
+ "step": 1125
1982
+ },
1983
+ {
1984
+ "epoch": 19.82456140350877,
1985
+ "grad_norm": 0.3370450437068939,
1986
+ "learning_rate": 1.4179448813278484e-08,
1987
+ "loss": 0.071,
1988
+ "num_input_tokens_seen": 715216,
1989
+ "step": 1130
1990
+ },
1991
+ {
1992
+ "epoch": 19.912280701754387,
1993
+ "grad_norm": 0.47238922119140625,
1994
+ "learning_rate": 4.218959166932268e-09,
1995
+ "loss": 0.1223,
1996
+ "num_input_tokens_seen": 718288,
1997
+ "step": 1135
1998
+ },
1999
+ {
2000
+ "epoch": 20.0,
2001
+ "grad_norm": 0.06607946753501892,
2002
+ "learning_rate": 1.1719651499819683e-10,
2003
+ "loss": 0.0863,
2004
+ "num_input_tokens_seen": 721856,
2005
+ "step": 1140
2006
+ },
2007
+ {
2008
+ "epoch": 20.0,
2009
+ "eval_loss": 0.16840095818042755,
2010
+ "eval_runtime": 0.6058,
2011
+ "eval_samples_per_second": 41.265,
2012
+ "eval_steps_per_second": 11.554,
2013
+ "num_input_tokens_seen": 721856,
2014
+ "step": 1140
2015
+ },
2016
+ {
2017
+ "epoch": 20.0,
2018
+ "num_input_tokens_seen": 721856,
2019
+ "step": 1140,
2020
+ "total_flos": 3.250570096017408e+16,
2021
+ "train_loss": 0.22163466730138712,
2022
+ "train_runtime": 276.432,
2023
+ "train_samples_per_second": 16.279,
2024
+ "train_steps_per_second": 4.124
2025
+ }
2026
+ ],
2027
+ "logging_steps": 5,
2028
+ "max_steps": 1140,
2029
+ "num_input_tokens_seen": 721856,
2030
+ "num_train_epochs": 20,
2031
+ "save_steps": 57,
2032
+ "stateful_callbacks": {
2033
+ "TrainerControl": {
2034
+ "args": {
2035
+ "should_epoch_stop": false,
2036
+ "should_evaluate": false,
2037
+ "should_log": false,
2038
+ "should_save": true,
2039
+ "should_training_stop": true
2040
+ },
2041
+ "attributes": {}
2042
+ }
2043
+ },
2044
+ "total_flos": 3.250570096017408e+16,
2045
+ "train_batch_size": 4,
2046
+ "trial_name": null,
2047
+ "trial_params": null
2048
+ }
training_eval_loss.png ADDED
training_loss.png ADDED