rbelanec commited on
Commit
b4170b9
·
verified ·
1 Parent(s): 557212b

End of training

Browse files
README.md CHANGED
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # train_cb_123_1760637642
19
 
20
- This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.1430
23
  - Num Input Tokens Seen: 742296
24
 
25
  ## Model description
 
17
 
18
  # train_cb_123_1760637642
19
 
20
+ This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the cb dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.1413
23
  - Num Input Tokens Seen: 742296
24
 
25
  ## Model description
all_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_loss": 0.141252800822258,
4
+ "eval_runtime": 0.6011,
5
+ "eval_samples_per_second": 41.593,
6
+ "eval_steps_per_second": 11.646,
7
+ "num_input_tokens_seen": 742296,
8
+ "total_flos": 3.342612903395328e+16,
9
+ "train_loss": 0.22276320790773943,
10
+ "train_runtime": 280.0262,
11
+ "train_samples_per_second": 16.07,
12
+ "train_steps_per_second": 4.071
13
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_loss": 0.141252800822258,
4
+ "eval_runtime": 0.6011,
5
+ "eval_samples_per_second": 41.593,
6
+ "eval_steps_per_second": 11.646,
7
+ "num_input_tokens_seen": 742296
8
+ }
train_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "num_input_tokens_seen": 742296,
4
+ "total_flos": 3.342612903395328e+16,
5
+ "train_loss": 0.22276320790773943,
6
+ "train_runtime": 280.0262,
7
+ "train_samples_per_second": 16.07,
8
+ "train_steps_per_second": 4.071
9
+ }
trainer_state.json ADDED
@@ -0,0 +1,2048 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 855,
3
+ "best_metric": 0.141252800822258,
4
+ "best_model_checkpoint": "saves_multiple/ia3/llama-3-8b-instruct/train_cb_123_1760637642/checkpoint-855",
5
+ "epoch": 20.0,
6
+ "eval_steps": 57,
7
+ "global_step": 1140,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.08771929824561403,
14
+ "grad_norm": 3.224976062774658,
15
+ "learning_rate": 1.7543859649122807e-06,
16
+ "loss": 1.108,
17
+ "num_input_tokens_seen": 3552,
18
+ "step": 5
19
+ },
20
+ {
21
+ "epoch": 0.17543859649122806,
22
+ "grad_norm": 2.8442697525024414,
23
+ "learning_rate": 3.9473684210526315e-06,
24
+ "loss": 1.2108,
25
+ "num_input_tokens_seen": 7264,
26
+ "step": 10
27
+ },
28
+ {
29
+ "epoch": 0.2631578947368421,
30
+ "grad_norm": 2.962290048599243,
31
+ "learning_rate": 6.140350877192982e-06,
32
+ "loss": 1.0919,
33
+ "num_input_tokens_seen": 10528,
34
+ "step": 15
35
+ },
36
+ {
37
+ "epoch": 0.3508771929824561,
38
+ "grad_norm": 2.782698392868042,
39
+ "learning_rate": 8.333333333333334e-06,
40
+ "loss": 0.9922,
41
+ "num_input_tokens_seen": 14784,
42
+ "step": 20
43
+ },
44
+ {
45
+ "epoch": 0.43859649122807015,
46
+ "grad_norm": 3.0441441535949707,
47
+ "learning_rate": 1.0526315789473684e-05,
48
+ "loss": 1.14,
49
+ "num_input_tokens_seen": 18112,
50
+ "step": 25
51
+ },
52
+ {
53
+ "epoch": 0.5263157894736842,
54
+ "grad_norm": 2.528430461883545,
55
+ "learning_rate": 1.2719298245614037e-05,
56
+ "loss": 1.1978,
57
+ "num_input_tokens_seen": 20736,
58
+ "step": 30
59
+ },
60
+ {
61
+ "epoch": 0.6140350877192983,
62
+ "grad_norm": 3.4071264266967773,
63
+ "learning_rate": 1.4912280701754386e-05,
64
+ "loss": 1.0964,
65
+ "num_input_tokens_seen": 24896,
66
+ "step": 35
67
+ },
68
+ {
69
+ "epoch": 0.7017543859649122,
70
+ "grad_norm": 3.0842833518981934,
71
+ "learning_rate": 1.7105263157894737e-05,
72
+ "loss": 1.112,
73
+ "num_input_tokens_seen": 28160,
74
+ "step": 40
75
+ },
76
+ {
77
+ "epoch": 0.7894736842105263,
78
+ "grad_norm": 2.6400015354156494,
79
+ "learning_rate": 1.929824561403509e-05,
80
+ "loss": 1.2367,
81
+ "num_input_tokens_seen": 31040,
82
+ "step": 45
83
+ },
84
+ {
85
+ "epoch": 0.8771929824561403,
86
+ "grad_norm": 3.220822811126709,
87
+ "learning_rate": 2.149122807017544e-05,
88
+ "loss": 1.0195,
89
+ "num_input_tokens_seen": 33760,
90
+ "step": 50
91
+ },
92
+ {
93
+ "epoch": 0.9649122807017544,
94
+ "grad_norm": 2.8923230171203613,
95
+ "learning_rate": 2.368421052631579e-05,
96
+ "loss": 1.1067,
97
+ "num_input_tokens_seen": 36416,
98
+ "step": 55
99
+ },
100
+ {
101
+ "epoch": 1.0,
102
+ "eval_loss": 1.0791712999343872,
103
+ "eval_runtime": 0.5516,
104
+ "eval_samples_per_second": 45.319,
105
+ "eval_steps_per_second": 12.689,
106
+ "num_input_tokens_seen": 37160,
107
+ "step": 57
108
+ },
109
+ {
110
+ "epoch": 1.0526315789473684,
111
+ "grad_norm": 3.0734691619873047,
112
+ "learning_rate": 2.5877192982456143e-05,
113
+ "loss": 0.8826,
114
+ "num_input_tokens_seen": 39176,
115
+ "step": 60
116
+ },
117
+ {
118
+ "epoch": 1.1403508771929824,
119
+ "grad_norm": 3.8235576152801514,
120
+ "learning_rate": 2.8070175438596492e-05,
121
+ "loss": 1.0172,
122
+ "num_input_tokens_seen": 42632,
123
+ "step": 65
124
+ },
125
+ {
126
+ "epoch": 1.2280701754385965,
127
+ "grad_norm": 2.6555466651916504,
128
+ "learning_rate": 3.0263157894736844e-05,
129
+ "loss": 1.0682,
130
+ "num_input_tokens_seen": 45704,
131
+ "step": 70
132
+ },
133
+ {
134
+ "epoch": 1.3157894736842106,
135
+ "grad_norm": 2.919718027114868,
136
+ "learning_rate": 3.24561403508772e-05,
137
+ "loss": 1.0702,
138
+ "num_input_tokens_seen": 49448,
139
+ "step": 75
140
+ },
141
+ {
142
+ "epoch": 1.4035087719298245,
143
+ "grad_norm": 3.8765575885772705,
144
+ "learning_rate": 3.4649122807017546e-05,
145
+ "loss": 1.2049,
146
+ "num_input_tokens_seen": 52456,
147
+ "step": 80
148
+ },
149
+ {
150
+ "epoch": 1.4912280701754386,
151
+ "grad_norm": 3.6204617023468018,
152
+ "learning_rate": 3.6842105263157895e-05,
153
+ "loss": 0.9868,
154
+ "num_input_tokens_seen": 56488,
155
+ "step": 85
156
+ },
157
+ {
158
+ "epoch": 1.5789473684210527,
159
+ "grad_norm": 3.429600715637207,
160
+ "learning_rate": 3.9035087719298244e-05,
161
+ "loss": 1.2675,
162
+ "num_input_tokens_seen": 59208,
163
+ "step": 90
164
+ },
165
+ {
166
+ "epoch": 1.6666666666666665,
167
+ "grad_norm": 3.225975751876831,
168
+ "learning_rate": 4.12280701754386e-05,
169
+ "loss": 1.0762,
170
+ "num_input_tokens_seen": 62696,
171
+ "step": 95
172
+ },
173
+ {
174
+ "epoch": 1.7543859649122808,
175
+ "grad_norm": 3.10089373588562,
176
+ "learning_rate": 4.342105263157895e-05,
177
+ "loss": 1.0884,
178
+ "num_input_tokens_seen": 66024,
179
+ "step": 100
180
+ },
181
+ {
182
+ "epoch": 1.8421052631578947,
183
+ "grad_norm": 3.096519947052002,
184
+ "learning_rate": 4.56140350877193e-05,
185
+ "loss": 1.084,
186
+ "num_input_tokens_seen": 69000,
187
+ "step": 105
188
+ },
189
+ {
190
+ "epoch": 1.9298245614035088,
191
+ "grad_norm": 1.9868537187576294,
192
+ "learning_rate": 4.780701754385965e-05,
193
+ "loss": 0.7267,
194
+ "num_input_tokens_seen": 72072,
195
+ "step": 110
196
+ },
197
+ {
198
+ "epoch": 2.0,
199
+ "eval_loss": 0.5041866302490234,
200
+ "eval_runtime": 0.5458,
201
+ "eval_samples_per_second": 45.807,
202
+ "eval_steps_per_second": 12.826,
203
+ "num_input_tokens_seen": 73720,
204
+ "step": 114
205
+ },
206
+ {
207
+ "epoch": 2.017543859649123,
208
+ "grad_norm": 2.56526780128479,
209
+ "learning_rate": 5e-05,
210
+ "loss": 0.6765,
211
+ "num_input_tokens_seen": 74264,
212
+ "step": 115
213
+ },
214
+ {
215
+ "epoch": 2.1052631578947367,
216
+ "grad_norm": 2.051358699798584,
217
+ "learning_rate": 4.999707014206475e-05,
218
+ "loss": 0.3524,
219
+ "num_input_tokens_seen": 77528,
220
+ "step": 120
221
+ },
222
+ {
223
+ "epoch": 2.192982456140351,
224
+ "grad_norm": 1.08304762840271,
225
+ "learning_rate": 4.9988281254984414e-05,
226
+ "loss": 0.2315,
227
+ "num_input_tokens_seen": 80600,
228
+ "step": 125
229
+ },
230
+ {
231
+ "epoch": 2.280701754385965,
232
+ "grad_norm": 0.5552704930305481,
233
+ "learning_rate": 4.997363539877422e-05,
234
+ "loss": 0.1703,
235
+ "num_input_tokens_seen": 83800,
236
+ "step": 130
237
+ },
238
+ {
239
+ "epoch": 2.3684210526315788,
240
+ "grad_norm": 0.49190521240234375,
241
+ "learning_rate": 4.9953136006256415e-05,
242
+ "loss": 0.2005,
243
+ "num_input_tokens_seen": 86552,
244
+ "step": 135
245
+ },
246
+ {
247
+ "epoch": 2.456140350877193,
248
+ "grad_norm": 1.4237760305404663,
249
+ "learning_rate": 4.9926787882255636e-05,
250
+ "loss": 0.1769,
251
+ "num_input_tokens_seen": 90008,
252
+ "step": 140
253
+ },
254
+ {
255
+ "epoch": 2.543859649122807,
256
+ "grad_norm": 0.20451903343200684,
257
+ "learning_rate": 4.9894597202472696e-05,
258
+ "loss": 0.5468,
259
+ "num_input_tokens_seen": 93496,
260
+ "step": 145
261
+ },
262
+ {
263
+ "epoch": 2.6315789473684212,
264
+ "grad_norm": 1.6773297786712646,
265
+ "learning_rate": 4.985657151203706e-05,
266
+ "loss": 0.206,
267
+ "num_input_tokens_seen": 96888,
268
+ "step": 150
269
+ },
270
+ {
271
+ "epoch": 2.719298245614035,
272
+ "grad_norm": 1.7288334369659424,
273
+ "learning_rate": 4.9812719723738435e-05,
274
+ "loss": 0.1405,
275
+ "num_input_tokens_seen": 100728,
276
+ "step": 155
277
+ },
278
+ {
279
+ "epoch": 2.807017543859649,
280
+ "grad_norm": 0.3265911936759949,
281
+ "learning_rate": 4.976305211593758e-05,
282
+ "loss": 0.1815,
283
+ "num_input_tokens_seen": 103960,
284
+ "step": 160
285
+ },
286
+ {
287
+ "epoch": 2.8947368421052633,
288
+ "grad_norm": 0.899502158164978,
289
+ "learning_rate": 4.970758033015731e-05,
290
+ "loss": 0.1968,
291
+ "num_input_tokens_seen": 106648,
292
+ "step": 165
293
+ },
294
+ {
295
+ "epoch": 2.982456140350877,
296
+ "grad_norm": 0.5794858336448669,
297
+ "learning_rate": 4.9646317368353743e-05,
298
+ "loss": 0.1436,
299
+ "num_input_tokens_seen": 110136,
300
+ "step": 170
301
+ },
302
+ {
303
+ "epoch": 3.0,
304
+ "eval_loss": 0.1622994989156723,
305
+ "eval_runtime": 0.5483,
306
+ "eval_samples_per_second": 45.595,
307
+ "eval_steps_per_second": 12.767,
308
+ "num_input_tokens_seen": 110296,
309
+ "step": 171
310
+ },
311
+ {
312
+ "epoch": 3.0701754385964914,
313
+ "grad_norm": 1.883181095123291,
314
+ "learning_rate": 4.957927758986888e-05,
315
+ "loss": 0.1772,
316
+ "num_input_tokens_seen": 112984,
317
+ "step": 175
318
+ },
319
+ {
320
+ "epoch": 3.1578947368421053,
321
+ "grad_norm": 0.9425994157791138,
322
+ "learning_rate": 4.9506476708064865e-05,
323
+ "loss": 0.073,
324
+ "num_input_tokens_seen": 116120,
325
+ "step": 180
326
+ },
327
+ {
328
+ "epoch": 3.245614035087719,
329
+ "grad_norm": 0.6446769833564758,
330
+ "learning_rate": 4.9427931786641e-05,
331
+ "loss": 0.0899,
332
+ "num_input_tokens_seen": 119576,
333
+ "step": 185
334
+ },
335
+ {
336
+ "epoch": 3.3333333333333335,
337
+ "grad_norm": 1.5484825372695923,
338
+ "learning_rate": 4.93436612356342e-05,
339
+ "loss": 0.0834,
340
+ "num_input_tokens_seen": 122968,
341
+ "step": 190
342
+ },
343
+ {
344
+ "epoch": 3.4210526315789473,
345
+ "grad_norm": 0.09750091284513474,
346
+ "learning_rate": 4.925368480710385e-05,
347
+ "loss": 0.266,
348
+ "num_input_tokens_seen": 126104,
349
+ "step": 195
350
+ },
351
+ {
352
+ "epoch": 3.5087719298245617,
353
+ "grad_norm": 1.5867477655410767,
354
+ "learning_rate": 4.915802359050222e-05,
355
+ "loss": 0.3019,
356
+ "num_input_tokens_seen": 129368,
357
+ "step": 200
358
+ },
359
+ {
360
+ "epoch": 3.5964912280701755,
361
+ "grad_norm": 0.6024298667907715,
362
+ "learning_rate": 4.905670000773126e-05,
363
+ "loss": 0.1135,
364
+ "num_input_tokens_seen": 132888,
365
+ "step": 205
366
+ },
367
+ {
368
+ "epoch": 3.6842105263157894,
369
+ "grad_norm": 1.3545844554901123,
370
+ "learning_rate": 4.894973780788722e-05,
371
+ "loss": 0.1025,
372
+ "num_input_tokens_seen": 135832,
373
+ "step": 210
374
+ },
375
+ {
376
+ "epoch": 3.7719298245614032,
377
+ "grad_norm": 0.2249176800251007,
378
+ "learning_rate": 4.88371620616941e-05,
379
+ "loss": 0.3105,
380
+ "num_input_tokens_seen": 138936,
381
+ "step": 215
382
+ },
383
+ {
384
+ "epoch": 3.8596491228070176,
385
+ "grad_norm": 0.9181737899780273,
386
+ "learning_rate": 4.871899915562736e-05,
387
+ "loss": 0.0702,
388
+ "num_input_tokens_seen": 142488,
389
+ "step": 220
390
+ },
391
+ {
392
+ "epoch": 3.9473684210526314,
393
+ "grad_norm": 0.9704654812812805,
394
+ "learning_rate": 4.8595276785729236e-05,
395
+ "loss": 0.1234,
396
+ "num_input_tokens_seen": 146808,
397
+ "step": 225
398
+ },
399
+ {
400
+ "epoch": 4.0,
401
+ "eval_loss": 0.15448994934558868,
402
+ "eval_runtime": 0.5468,
403
+ "eval_samples_per_second": 45.722,
404
+ "eval_steps_per_second": 12.802,
405
+ "num_input_tokens_seen": 147784,
406
+ "step": 228
407
+ },
408
+ {
409
+ "epoch": 4.035087719298246,
410
+ "grad_norm": 0.12079440802335739,
411
+ "learning_rate": 4.846602395111711e-05,
412
+ "loss": 0.1769,
413
+ "num_input_tokens_seen": 149448,
414
+ "step": 230
415
+ },
416
+ {
417
+ "epoch": 4.12280701754386,
418
+ "grad_norm": 1.2503697872161865,
419
+ "learning_rate": 4.833127094718643e-05,
420
+ "loss": 0.1858,
421
+ "num_input_tokens_seen": 152488,
422
+ "step": 235
423
+ },
424
+ {
425
+ "epoch": 4.2105263157894735,
426
+ "grad_norm": 3.148477077484131,
427
+ "learning_rate": 4.819104935850983e-05,
428
+ "loss": 0.3028,
429
+ "num_input_tokens_seen": 155208,
430
+ "step": 240
431
+ },
432
+ {
433
+ "epoch": 4.298245614035087,
434
+ "grad_norm": 0.9382994174957275,
435
+ "learning_rate": 4.804539205143405e-05,
436
+ "loss": 0.2042,
437
+ "num_input_tokens_seen": 158088,
438
+ "step": 245
439
+ },
440
+ {
441
+ "epoch": 4.385964912280702,
442
+ "grad_norm": 1.2947958707809448,
443
+ "learning_rate": 4.789433316637644e-05,
444
+ "loss": 0.1566,
445
+ "num_input_tokens_seen": 161032,
446
+ "step": 250
447
+ },
448
+ {
449
+ "epoch": 4.473684210526316,
450
+ "grad_norm": 0.5302771329879761,
451
+ "learning_rate": 4.7737908109822854e-05,
452
+ "loss": 0.0885,
453
+ "num_input_tokens_seen": 164744,
454
+ "step": 255
455
+ },
456
+ {
457
+ "epoch": 4.56140350877193,
458
+ "grad_norm": 0.6444823741912842,
459
+ "learning_rate": 4.757615354602874e-05,
460
+ "loss": 0.0582,
461
+ "num_input_tokens_seen": 167592,
462
+ "step": 260
463
+ },
464
+ {
465
+ "epoch": 4.649122807017544,
466
+ "grad_norm": 0.2313116192817688,
467
+ "learning_rate": 4.7409107388425504e-05,
468
+ "loss": 0.1681,
469
+ "num_input_tokens_seen": 170696,
470
+ "step": 265
471
+ },
472
+ {
473
+ "epoch": 4.7368421052631575,
474
+ "grad_norm": 2.186295986175537,
475
+ "learning_rate": 4.723680879073396e-05,
476
+ "loss": 0.139,
477
+ "num_input_tokens_seen": 174024,
478
+ "step": 270
479
+ },
480
+ {
481
+ "epoch": 4.824561403508772,
482
+ "grad_norm": 0.7340698838233948,
483
+ "learning_rate": 4.70592981377872e-05,
484
+ "loss": 0.1663,
485
+ "num_input_tokens_seen": 178152,
486
+ "step": 275
487
+ },
488
+ {
489
+ "epoch": 4.912280701754386,
490
+ "grad_norm": 0.8540976643562317,
491
+ "learning_rate": 4.6876617036064844e-05,
492
+ "loss": 0.0831,
493
+ "num_input_tokens_seen": 181768,
494
+ "step": 280
495
+ },
496
+ {
497
+ "epoch": 5.0,
498
+ "grad_norm": 0.010767403990030289,
499
+ "learning_rate": 4.668880830394093e-05,
500
+ "loss": 0.0568,
501
+ "num_input_tokens_seen": 184368,
502
+ "step": 285
503
+ },
504
+ {
505
+ "epoch": 5.0,
506
+ "eval_loss": 0.1538160741329193,
507
+ "eval_runtime": 0.5458,
508
+ "eval_samples_per_second": 45.805,
509
+ "eval_steps_per_second": 12.825,
510
+ "num_input_tokens_seen": 184368,
511
+ "step": 285
512
+ },
513
+ {
514
+ "epoch": 5.087719298245614,
515
+ "grad_norm": 0.9611219167709351,
516
+ "learning_rate": 4.649591596164778e-05,
517
+ "loss": 0.0971,
518
+ "num_input_tokens_seen": 187312,
519
+ "step": 290
520
+ },
521
+ {
522
+ "epoch": 5.175438596491228,
523
+ "grad_norm": 1.3983893394470215,
524
+ "learning_rate": 4.629798522095818e-05,
525
+ "loss": 0.1035,
526
+ "num_input_tokens_seen": 190736,
527
+ "step": 295
528
+ },
529
+ {
530
+ "epoch": 5.2631578947368425,
531
+ "grad_norm": 1.360155701637268,
532
+ "learning_rate": 4.6095062474588225e-05,
533
+ "loss": 0.1544,
534
+ "num_input_tokens_seen": 194480,
535
+ "step": 300
536
+ },
537
+ {
538
+ "epoch": 5.350877192982456,
539
+ "grad_norm": 1.1092360019683838,
540
+ "learning_rate": 4.588719528532342e-05,
541
+ "loss": 0.1438,
542
+ "num_input_tokens_seen": 198576,
543
+ "step": 305
544
+ },
545
+ {
546
+ "epoch": 5.43859649122807,
547
+ "grad_norm": 0.6061084866523743,
548
+ "learning_rate": 4.5674432374870455e-05,
549
+ "loss": 0.0687,
550
+ "num_input_tokens_seen": 201808,
551
+ "step": 310
552
+ },
553
+ {
554
+ "epoch": 5.526315789473684,
555
+ "grad_norm": 0.6874249577522278,
556
+ "learning_rate": 4.545682361243748e-05,
557
+ "loss": 0.0716,
558
+ "num_input_tokens_seen": 204912,
559
+ "step": 315
560
+ },
561
+ {
562
+ "epoch": 5.614035087719298,
563
+ "grad_norm": 1.6072134971618652,
564
+ "learning_rate": 4.5234420003045236e-05,
565
+ "loss": 0.2456,
566
+ "num_input_tokens_seen": 207760,
567
+ "step": 320
568
+ },
569
+ {
570
+ "epoch": 5.701754385964913,
571
+ "grad_norm": 1.854293704032898,
572
+ "learning_rate": 4.5007273675572104e-05,
573
+ "loss": 0.2802,
574
+ "num_input_tokens_seen": 210544,
575
+ "step": 325
576
+ },
577
+ {
578
+ "epoch": 5.7894736842105265,
579
+ "grad_norm": 1.1837505102157593,
580
+ "learning_rate": 4.4775437870535685e-05,
581
+ "loss": 0.1646,
582
+ "num_input_tokens_seen": 214480,
583
+ "step": 330
584
+ },
585
+ {
586
+ "epoch": 5.87719298245614,
587
+ "grad_norm": 1.2285683155059814,
588
+ "learning_rate": 4.4538966927613836e-05,
589
+ "loss": 0.1557,
590
+ "num_input_tokens_seen": 218064,
591
+ "step": 335
592
+ },
593
+ {
594
+ "epoch": 5.964912280701754,
595
+ "grad_norm": 0.2614938020706177,
596
+ "learning_rate": 4.4297916272908024e-05,
597
+ "loss": 0.0804,
598
+ "num_input_tokens_seen": 220848,
599
+ "step": 340
600
+ },
601
+ {
602
+ "epoch": 6.0,
603
+ "eval_loss": 0.14913909137248993,
604
+ "eval_runtime": 0.5475,
605
+ "eval_samples_per_second": 45.659,
606
+ "eval_steps_per_second": 12.785,
607
+ "num_input_tokens_seen": 221536,
608
+ "step": 342
609
+ },
610
+ {
611
+ "epoch": 6.052631578947368,
612
+ "grad_norm": 0.2000754028558731,
613
+ "learning_rate": 4.405234240595214e-05,
614
+ "loss": 0.1636,
615
+ "num_input_tokens_seen": 223616,
616
+ "step": 345
617
+ },
618
+ {
619
+ "epoch": 6.140350877192983,
620
+ "grad_norm": 0.5805673599243164,
621
+ "learning_rate": 4.3802302886469606e-05,
622
+ "loss": 0.173,
623
+ "num_input_tokens_seen": 227008,
624
+ "step": 350
625
+ },
626
+ {
627
+ "epoch": 6.228070175438597,
628
+ "grad_norm": 1.0734423398971558,
629
+ "learning_rate": 4.3547856320882044e-05,
630
+ "loss": 0.1652,
631
+ "num_input_tokens_seen": 230752,
632
+ "step": 355
633
+ },
634
+ {
635
+ "epoch": 6.315789473684211,
636
+ "grad_norm": 0.8464383482933044,
637
+ "learning_rate": 4.328906234857259e-05,
638
+ "loss": 0.2624,
639
+ "num_input_tokens_seen": 234208,
640
+ "step": 360
641
+ },
642
+ {
643
+ "epoch": 6.4035087719298245,
644
+ "grad_norm": 0.6082894802093506,
645
+ "learning_rate": 4.302598162790712e-05,
646
+ "loss": 0.1012,
647
+ "num_input_tokens_seen": 237664,
648
+ "step": 365
649
+ },
650
+ {
651
+ "epoch": 6.491228070175438,
652
+ "grad_norm": 0.45816969871520996,
653
+ "learning_rate": 4.27586758220166e-05,
654
+ "loss": 0.0544,
655
+ "num_input_tokens_seen": 240704,
656
+ "step": 370
657
+ },
658
+ {
659
+ "epoch": 6.578947368421053,
660
+ "grad_norm": 1.1108241081237793,
661
+ "learning_rate": 4.2487207584343955e-05,
662
+ "loss": 0.1428,
663
+ "num_input_tokens_seen": 244256,
664
+ "step": 375
665
+ },
666
+ {
667
+ "epoch": 6.666666666666667,
668
+ "grad_norm": 0.365966796875,
669
+ "learning_rate": 4.2211640543958796e-05,
670
+ "loss": 0.1845,
671
+ "num_input_tokens_seen": 246816,
672
+ "step": 380
673
+ },
674
+ {
675
+ "epoch": 6.754385964912281,
676
+ "grad_norm": 0.5473219752311707,
677
+ "learning_rate": 4.193203929064353e-05,
678
+ "loss": 0.0671,
679
+ "num_input_tokens_seen": 249728,
680
+ "step": 385
681
+ },
682
+ {
683
+ "epoch": 6.842105263157895,
684
+ "grad_norm": 0.48897814750671387,
685
+ "learning_rate": 4.164846935975421e-05,
686
+ "loss": 0.0889,
687
+ "num_input_tokens_seen": 252480,
688
+ "step": 390
689
+ },
690
+ {
691
+ "epoch": 6.9298245614035086,
692
+ "grad_norm": 0.5326061844825745,
693
+ "learning_rate": 4.136099721685983e-05,
694
+ "loss": 0.0592,
695
+ "num_input_tokens_seen": 256480,
696
+ "step": 395
697
+ },
698
+ {
699
+ "epoch": 7.0,
700
+ "eval_loss": 0.14913177490234375,
701
+ "eval_runtime": 0.5476,
702
+ "eval_samples_per_second": 45.65,
703
+ "eval_steps_per_second": 12.782,
704
+ "num_input_tokens_seen": 258720,
705
+ "step": 399
706
+ },
707
+ {
708
+ "epoch": 7.017543859649122,
709
+ "grad_norm": 0.5451218485832214,
710
+ "learning_rate": 4.1069690242163484e-05,
711
+ "loss": 0.0819,
712
+ "num_input_tokens_seen": 259424,
713
+ "step": 400
714
+ },
715
+ {
716
+ "epoch": 7.105263157894737,
717
+ "grad_norm": 0.11172731965780258,
718
+ "learning_rate": 4.0774616714709316e-05,
719
+ "loss": 0.0465,
720
+ "num_input_tokens_seen": 262656,
721
+ "step": 405
722
+ },
723
+ {
724
+ "epoch": 7.192982456140351,
725
+ "grad_norm": 0.3562619388103485,
726
+ "learning_rate": 4.047584579637857e-05,
727
+ "loss": 0.053,
728
+ "num_input_tokens_seen": 265408,
729
+ "step": 410
730
+ },
731
+ {
732
+ "epoch": 7.280701754385965,
733
+ "grad_norm": 2.1565439701080322,
734
+ "learning_rate": 4.0173447515678916e-05,
735
+ "loss": 0.2173,
736
+ "num_input_tokens_seen": 268992,
737
+ "step": 415
738
+ },
739
+ {
740
+ "epoch": 7.368421052631579,
741
+ "grad_norm": 0.8803087472915649,
742
+ "learning_rate": 3.986749275133057e-05,
743
+ "loss": 0.2269,
744
+ "num_input_tokens_seen": 272288,
745
+ "step": 420
746
+ },
747
+ {
748
+ "epoch": 7.456140350877193,
749
+ "grad_norm": 1.1545380353927612,
750
+ "learning_rate": 3.955805321565304e-05,
751
+ "loss": 0.2126,
752
+ "num_input_tokens_seen": 275104,
753
+ "step": 425
754
+ },
755
+ {
756
+ "epoch": 7.543859649122807,
757
+ "grad_norm": 0.8341761827468872,
758
+ "learning_rate": 3.9245201437756654e-05,
759
+ "loss": 0.1087,
760
+ "num_input_tokens_seen": 278272,
761
+ "step": 430
762
+ },
763
+ {
764
+ "epoch": 7.631578947368421,
765
+ "grad_norm": 0.36908242106437683,
766
+ "learning_rate": 3.892901074654255e-05,
767
+ "loss": 0.1527,
768
+ "num_input_tokens_seen": 282048,
769
+ "step": 435
770
+ },
771
+ {
772
+ "epoch": 7.719298245614035,
773
+ "grad_norm": 0.7301762104034424,
774
+ "learning_rate": 3.860955525351516e-05,
775
+ "loss": 0.0798,
776
+ "num_input_tokens_seen": 285536,
777
+ "step": 440
778
+ },
779
+ {
780
+ "epoch": 7.807017543859649,
781
+ "grad_norm": 1.0780984163284302,
782
+ "learning_rate": 3.82869098354114e-05,
783
+ "loss": 0.1074,
784
+ "num_input_tokens_seen": 288416,
785
+ "step": 445
786
+ },
787
+ {
788
+ "epoch": 7.894736842105263,
789
+ "grad_norm": 0.6972801685333252,
790
+ "learning_rate": 3.796115011665034e-05,
791
+ "loss": 0.158,
792
+ "num_input_tokens_seen": 291968,
793
+ "step": 450
794
+ },
795
+ {
796
+ "epoch": 7.982456140350877,
797
+ "grad_norm": 0.5425293445587158,
798
+ "learning_rate": 3.763235245160775e-05,
799
+ "loss": 0.1143,
800
+ "num_input_tokens_seen": 295296,
801
+ "step": 455
802
+ },
803
+ {
804
+ "epoch": 8.0,
805
+ "eval_loss": 0.15030860900878906,
806
+ "eval_runtime": 0.5445,
807
+ "eval_samples_per_second": 45.911,
808
+ "eval_steps_per_second": 12.855,
809
+ "num_input_tokens_seen": 295408,
810
+ "step": 456
811
+ },
812
+ {
813
+ "epoch": 8.070175438596491,
814
+ "grad_norm": 0.10447345674037933,
815
+ "learning_rate": 3.7300593906719464e-05,
816
+ "loss": 0.0414,
817
+ "num_input_tokens_seen": 298480,
818
+ "step": 460
819
+ },
820
+ {
821
+ "epoch": 8.157894736842104,
822
+ "grad_norm": 0.26864129304885864,
823
+ "learning_rate": 3.69659522424179e-05,
824
+ "loss": 0.1664,
825
+ "num_input_tokens_seen": 301904,
826
+ "step": 465
827
+ },
828
+ {
829
+ "epoch": 8.24561403508772,
830
+ "grad_norm": 1.7940205335617065,
831
+ "learning_rate": 3.662850589490592e-05,
832
+ "loss": 0.0928,
833
+ "num_input_tokens_seen": 305488,
834
+ "step": 470
835
+ },
836
+ {
837
+ "epoch": 8.333333333333334,
838
+ "grad_norm": 0.3778042495250702,
839
+ "learning_rate": 3.628833395777224e-05,
840
+ "loss": 0.0926,
841
+ "num_input_tokens_seen": 308336,
842
+ "step": 475
843
+ },
844
+ {
845
+ "epoch": 8.421052631578947,
846
+ "grad_norm": 1.0465174913406372,
847
+ "learning_rate": 3.59455161634528e-05,
848
+ "loss": 0.1592,
849
+ "num_input_tokens_seen": 311600,
850
+ "step": 480
851
+ },
852
+ {
853
+ "epoch": 8.508771929824562,
854
+ "grad_norm": 0.8794988989830017,
855
+ "learning_rate": 3.560013286454242e-05,
856
+ "loss": 0.1178,
857
+ "num_input_tokens_seen": 315216,
858
+ "step": 485
859
+ },
860
+ {
861
+ "epoch": 8.596491228070175,
862
+ "grad_norm": 1.4731782674789429,
863
+ "learning_rate": 3.5252265014961006e-05,
864
+ "loss": 0.3034,
865
+ "num_input_tokens_seen": 318640,
866
+ "step": 490
867
+ },
868
+ {
869
+ "epoch": 8.68421052631579,
870
+ "grad_norm": 0.1976107358932495,
871
+ "learning_rate": 3.490199415097892e-05,
872
+ "loss": 0.04,
873
+ "num_input_tokens_seen": 321680,
874
+ "step": 495
875
+ },
876
+ {
877
+ "epoch": 8.771929824561404,
878
+ "grad_norm": 0.1280813068151474,
879
+ "learning_rate": 3.45494023721058e-05,
880
+ "loss": 0.0681,
881
+ "num_input_tokens_seen": 324464,
882
+ "step": 500
883
+ },
884
+ {
885
+ "epoch": 8.859649122807017,
886
+ "grad_norm": 0.20796729624271393,
887
+ "learning_rate": 3.4194572321847336e-05,
888
+ "loss": 0.0936,
889
+ "num_input_tokens_seen": 327888,
890
+ "step": 505
891
+ },
892
+ {
893
+ "epoch": 8.947368421052632,
894
+ "grad_norm": 0.7047799825668335,
895
+ "learning_rate": 3.383758716833459e-05,
896
+ "loss": 0.0974,
897
+ "num_input_tokens_seen": 331312,
898
+ "step": 510
899
+ },
900
+ {
901
+ "epoch": 9.0,
902
+ "eval_loss": 0.1471778303384781,
903
+ "eval_runtime": 0.5464,
904
+ "eval_samples_per_second": 45.755,
905
+ "eval_steps_per_second": 12.811,
906
+ "num_input_tokens_seen": 332648,
907
+ "step": 513
908
+ },
909
+ {
910
+ "epoch": 9.035087719298245,
911
+ "grad_norm": 0.6497840881347656,
912
+ "learning_rate": 3.347853058483037e-05,
913
+ "loss": 0.1674,
914
+ "num_input_tokens_seen": 334120,
915
+ "step": 515
916
+ },
917
+ {
918
+ "epoch": 9.12280701754386,
919
+ "grad_norm": 0.2419990450143814,
920
+ "learning_rate": 3.311748673011709e-05,
921
+ "loss": 0.0675,
922
+ "num_input_tokens_seen": 338280,
923
+ "step": 520
924
+ },
925
+ {
926
+ "epoch": 9.210526315789474,
927
+ "grad_norm": 0.3974565267562866,
928
+ "learning_rate": 3.275454022877097e-05,
929
+ "loss": 0.2197,
930
+ "num_input_tokens_seen": 341064,
931
+ "step": 525
932
+ },
933
+ {
934
+ "epoch": 9.298245614035087,
935
+ "grad_norm": 0.061329640448093414,
936
+ "learning_rate": 3.238977615132697e-05,
937
+ "loss": 0.0704,
938
+ "num_input_tokens_seen": 344552,
939
+ "step": 530
940
+ },
941
+ {
942
+ "epoch": 9.385964912280702,
943
+ "grad_norm": 0.5916696786880493,
944
+ "learning_rate": 3.202327999433924e-05,
945
+ "loss": 0.0989,
946
+ "num_input_tokens_seen": 347592,
947
+ "step": 535
948
+ },
949
+ {
950
+ "epoch": 9.473684210526315,
951
+ "grad_norm": 0.3816446363925934,
952
+ "learning_rate": 3.165513766034167e-05,
953
+ "loss": 0.0536,
954
+ "num_input_tokens_seen": 350440,
955
+ "step": 540
956
+ },
957
+ {
958
+ "epoch": 9.56140350877193,
959
+ "grad_norm": 0.5477246642112732,
960
+ "learning_rate": 3.128543543771336e-05,
961
+ "loss": 0.0736,
962
+ "num_input_tokens_seen": 353992,
963
+ "step": 545
964
+ },
965
+ {
966
+ "epoch": 9.649122807017545,
967
+ "grad_norm": 0.5759958028793335,
968
+ "learning_rate": 3.091425998045356e-05,
969
+ "loss": 0.0951,
970
+ "num_input_tokens_seen": 357544,
971
+ "step": 550
972
+ },
973
+ {
974
+ "epoch": 9.736842105263158,
975
+ "grad_norm": 1.257168173789978,
976
+ "learning_rate": 3.0541698287870965e-05,
977
+ "loss": 0.1305,
978
+ "num_input_tokens_seen": 360872,
979
+ "step": 555
980
+ },
981
+ {
982
+ "epoch": 9.824561403508772,
983
+ "grad_norm": 0.07265958189964294,
984
+ "learning_rate": 3.01678376841921e-05,
985
+ "loss": 0.201,
986
+ "num_input_tokens_seen": 364200,
987
+ "step": 560
988
+ },
989
+ {
990
+ "epoch": 9.912280701754385,
991
+ "grad_norm": 0.4661846160888672,
992
+ "learning_rate": 2.9792765798093465e-05,
993
+ "loss": 0.2183,
994
+ "num_input_tokens_seen": 367656,
995
+ "step": 565
996
+ },
997
+ {
998
+ "epoch": 10.0,
999
+ "grad_norm": 0.1449688822031021,
1000
+ "learning_rate": 2.94165705421624e-05,
1001
+ "loss": 0.1432,
1002
+ "num_input_tokens_seen": 369976,
1003
+ "step": 570
1004
+ },
1005
+ {
1006
+ "epoch": 10.0,
1007
+ "eval_loss": 0.14317916333675385,
1008
+ "eval_runtime": 0.5467,
1009
+ "eval_samples_per_second": 45.729,
1010
+ "eval_steps_per_second": 12.804,
1011
+ "num_input_tokens_seen": 369976,
1012
+ "step": 570
1013
+ },
1014
+ {
1015
+ "epoch": 10.087719298245615,
1016
+ "grad_norm": 0.3919751048088074,
1017
+ "learning_rate": 2.9039340092291373e-05,
1018
+ "loss": 0.1427,
1019
+ "num_input_tokens_seen": 373304,
1020
+ "step": 575
1021
+ },
1022
+ {
1023
+ "epoch": 10.175438596491228,
1024
+ "grad_norm": 0.9583569765090942,
1025
+ "learning_rate": 2.8661162867010543e-05,
1026
+ "loss": 0.1618,
1027
+ "num_input_tokens_seen": 376632,
1028
+ "step": 580
1029
+ },
1030
+ {
1031
+ "epoch": 10.263157894736842,
1032
+ "grad_norm": 0.7386246919631958,
1033
+ "learning_rate": 2.8282127506763456e-05,
1034
+ "loss": 0.1323,
1035
+ "num_input_tokens_seen": 379608,
1036
+ "step": 585
1037
+ },
1038
+ {
1039
+ "epoch": 10.350877192982455,
1040
+ "grad_norm": 0.15466658771038055,
1041
+ "learning_rate": 2.7902322853130757e-05,
1042
+ "loss": 0.1569,
1043
+ "num_input_tokens_seen": 382296,
1044
+ "step": 590
1045
+ },
1046
+ {
1047
+ "epoch": 10.43859649122807,
1048
+ "grad_norm": 0.9496839046478271,
1049
+ "learning_rate": 2.752183792800671e-05,
1050
+ "loss": 0.0868,
1051
+ "num_input_tokens_seen": 385880,
1052
+ "step": 595
1053
+ },
1054
+ {
1055
+ "epoch": 10.526315789473685,
1056
+ "grad_norm": 0.4446188807487488,
1057
+ "learning_rate": 2.7140761912733474e-05,
1058
+ "loss": 0.1518,
1059
+ "num_input_tokens_seen": 388824,
1060
+ "step": 600
1061
+ },
1062
+ {
1063
+ "epoch": 10.614035087719298,
1064
+ "grad_norm": 0.3737786114215851,
1065
+ "learning_rate": 2.6759184127198046e-05,
1066
+ "loss": 0.1112,
1067
+ "num_input_tokens_seen": 391640,
1068
+ "step": 605
1069
+ },
1070
+ {
1071
+ "epoch": 10.701754385964913,
1072
+ "grad_norm": 1.0249379873275757,
1073
+ "learning_rate": 2.6377194008896637e-05,
1074
+ "loss": 0.1474,
1075
+ "num_input_tokens_seen": 394968,
1076
+ "step": 610
1077
+ },
1078
+ {
1079
+ "epoch": 10.789473684210526,
1080
+ "grad_norm": 0.44542402029037476,
1081
+ "learning_rate": 2.5994881091971605e-05,
1082
+ "loss": 0.0423,
1083
+ "num_input_tokens_seen": 398520,
1084
+ "step": 615
1085
+ },
1086
+ {
1087
+ "epoch": 10.87719298245614,
1088
+ "grad_norm": 0.7558425068855286,
1089
+ "learning_rate": 2.5612334986225623e-05,
1090
+ "loss": 0.1147,
1091
+ "num_input_tokens_seen": 402328,
1092
+ "step": 620
1093
+ },
1094
+ {
1095
+ "epoch": 10.964912280701755,
1096
+ "grad_norm": 0.13769015669822693,
1097
+ "learning_rate": 2.5229645356118163e-05,
1098
+ "loss": 0.0643,
1099
+ "num_input_tokens_seen": 405880,
1100
+ "step": 625
1101
+ },
1102
+ {
1103
+ "epoch": 11.0,
1104
+ "eval_loss": 0.14445480704307556,
1105
+ "eval_runtime": 0.5529,
1106
+ "eval_samples_per_second": 45.218,
1107
+ "eval_steps_per_second": 12.661,
1108
+ "num_input_tokens_seen": 406840,
1109
+ "step": 627
1110
+ },
1111
+ {
1112
+ "epoch": 11.052631578947368,
1113
+ "grad_norm": 0.4078235924243927,
1114
+ "learning_rate": 2.4846901899749185e-05,
1115
+ "loss": 0.0422,
1116
+ "num_input_tokens_seen": 408632,
1117
+ "step": 630
1118
+ },
1119
+ {
1120
+ "epoch": 11.140350877192983,
1121
+ "grad_norm": 0.9349294900894165,
1122
+ "learning_rate": 2.4464194327834926e-05,
1123
+ "loss": 0.1594,
1124
+ "num_input_tokens_seen": 411544,
1125
+ "step": 635
1126
+ },
1127
+ {
1128
+ "epoch": 11.228070175438596,
1129
+ "grad_norm": 0.5148085355758667,
1130
+ "learning_rate": 2.4081612342680694e-05,
1131
+ "loss": 0.0808,
1132
+ "num_input_tokens_seen": 414648,
1133
+ "step": 640
1134
+ },
1135
+ {
1136
+ "epoch": 11.31578947368421,
1137
+ "grad_norm": 1.3059886693954468,
1138
+ "learning_rate": 2.369924561715569e-05,
1139
+ "loss": 0.2417,
1140
+ "num_input_tokens_seen": 418968,
1141
+ "step": 645
1142
+ },
1143
+ {
1144
+ "epoch": 11.403508771929825,
1145
+ "grad_norm": 0.30650588870048523,
1146
+ "learning_rate": 2.3317183773674718e-05,
1147
+ "loss": 0.0395,
1148
+ "num_input_tokens_seen": 422584,
1149
+ "step": 650
1150
+ },
1151
+ {
1152
+ "epoch": 11.491228070175438,
1153
+ "grad_norm": 2.1274938583374023,
1154
+ "learning_rate": 2.2935516363191693e-05,
1155
+ "loss": 0.157,
1156
+ "num_input_tokens_seen": 426136,
1157
+ "step": 655
1158
+ },
1159
+ {
1160
+ "epoch": 11.578947368421053,
1161
+ "grad_norm": 0.36772745847702026,
1162
+ "learning_rate": 2.2554332844209904e-05,
1163
+ "loss": 0.0851,
1164
+ "num_input_tokens_seen": 429752,
1165
+ "step": 660
1166
+ },
1167
+ {
1168
+ "epoch": 11.666666666666666,
1169
+ "grad_norm": 0.7562556266784668,
1170
+ "learning_rate": 2.2173722561813987e-05,
1171
+ "loss": 0.0756,
1172
+ "num_input_tokens_seen": 432920,
1173
+ "step": 665
1174
+ },
1175
+ {
1176
+ "epoch": 11.75438596491228,
1177
+ "grad_norm": 0.6950605511665344,
1178
+ "learning_rate": 2.179377472672842e-05,
1179
+ "loss": 0.1423,
1180
+ "num_input_tokens_seen": 435608,
1181
+ "step": 670
1182
+ },
1183
+ {
1184
+ "epoch": 11.842105263157894,
1185
+ "grad_norm": 0.4782346189022064,
1186
+ "learning_rate": 2.1414578394407597e-05,
1187
+ "loss": 0.1075,
1188
+ "num_input_tokens_seen": 438744,
1189
+ "step": 675
1190
+ },
1191
+ {
1192
+ "epoch": 11.929824561403509,
1193
+ "grad_norm": 0.23454903066158295,
1194
+ "learning_rate": 2.1036222444162147e-05,
1195
+ "loss": 0.0506,
1196
+ "num_input_tokens_seen": 442200,
1197
+ "step": 680
1198
+ },
1199
+ {
1200
+ "epoch": 12.0,
1201
+ "eval_loss": 0.1468311995267868,
1202
+ "eval_runtime": 0.5498,
1203
+ "eval_samples_per_second": 45.473,
1204
+ "eval_steps_per_second": 12.732,
1205
+ "num_input_tokens_seen": 444728,
1206
+ "step": 684
1207
+ },
1208
+ {
1209
+ "epoch": 12.017543859649123,
1210
+ "grad_norm": 1.8207346200942993,
1211
+ "learning_rate": 2.0658795558326743e-05,
1212
+ "loss": 0.1272,
1213
+ "num_input_tokens_seen": 445624,
1214
+ "step": 685
1215
+ },
1216
+ {
1217
+ "epoch": 12.105263157894736,
1218
+ "grad_norm": 0.3697846829891205,
1219
+ "learning_rate": 2.0282386201473894e-05,
1220
+ "loss": 0.0424,
1221
+ "num_input_tokens_seen": 448632,
1222
+ "step": 690
1223
+ },
1224
+ {
1225
+ "epoch": 12.192982456140351,
1226
+ "grad_norm": 0.22302426397800446,
1227
+ "learning_rate": 1.99070825996789e-05,
1228
+ "loss": 0.0787,
1229
+ "num_input_tokens_seen": 452248,
1230
+ "step": 695
1231
+ },
1232
+ {
1233
+ "epoch": 12.280701754385966,
1234
+ "grad_norm": 1.2539492845535278,
1235
+ "learning_rate": 1.9532972719840607e-05,
1236
+ "loss": 0.1814,
1237
+ "num_input_tokens_seen": 455544,
1238
+ "step": 700
1239
+ },
1240
+ {
1241
+ "epoch": 12.368421052631579,
1242
+ "grad_norm": 0.21945969760417938,
1243
+ "learning_rate": 1.9160144249063035e-05,
1244
+ "loss": 0.0635,
1245
+ "num_input_tokens_seen": 458520,
1246
+ "step": 705
1247
+ },
1248
+ {
1249
+ "epoch": 12.456140350877194,
1250
+ "grad_norm": 0.2022460699081421,
1251
+ "learning_rate": 1.8788684574102467e-05,
1252
+ "loss": 0.2228,
1253
+ "num_input_tokens_seen": 462264,
1254
+ "step": 710
1255
+ },
1256
+ {
1257
+ "epoch": 12.543859649122806,
1258
+ "grad_norm": 0.45098018646240234,
1259
+ "learning_rate": 1.8418680760885027e-05,
1260
+ "loss": 0.1128,
1261
+ "num_input_tokens_seen": 465624,
1262
+ "step": 715
1263
+ },
1264
+ {
1265
+ "epoch": 12.631578947368421,
1266
+ "grad_norm": 0.7333521246910095,
1267
+ "learning_rate": 1.805021953409934e-05,
1268
+ "loss": 0.0525,
1269
+ "num_input_tokens_seen": 468536,
1270
+ "step": 720
1271
+ },
1272
+ {
1273
+ "epoch": 12.719298245614034,
1274
+ "grad_norm": 0.19715364277362823,
1275
+ "learning_rate": 1.7683387256869353e-05,
1276
+ "loss": 0.0723,
1277
+ "num_input_tokens_seen": 472408,
1278
+ "step": 725
1279
+ },
1280
+ {
1281
+ "epoch": 12.807017543859649,
1282
+ "grad_norm": 0.2162865400314331,
1283
+ "learning_rate": 1.7318269910511736e-05,
1284
+ "loss": 0.1213,
1285
+ "num_input_tokens_seen": 475416,
1286
+ "step": 730
1287
+ },
1288
+ {
1289
+ "epoch": 12.894736842105264,
1290
+ "grad_norm": 0.1988564431667328,
1291
+ "learning_rate": 1.6954953074382863e-05,
1292
+ "loss": 0.1003,
1293
+ "num_input_tokens_seen": 478712,
1294
+ "step": 735
1295
+ },
1296
+ {
1297
+ "epoch": 12.982456140350877,
1298
+ "grad_norm": 0.2192692756652832,
1299
+ "learning_rate": 1.659352190581993e-05,
1300
+ "loss": 0.145,
1301
+ "num_input_tokens_seen": 481592,
1302
+ "step": 740
1303
+ },
1304
+ {
1305
+ "epoch": 13.0,
1306
+ "eval_loss": 0.14278924465179443,
1307
+ "eval_runtime": 0.5487,
1308
+ "eval_samples_per_second": 45.561,
1309
+ "eval_steps_per_second": 12.757,
1310
+ "num_input_tokens_seen": 481720,
1311
+ "step": 741
1312
+ },
1313
+ {
1314
+ "epoch": 13.070175438596491,
1315
+ "grad_norm": 0.569685161113739,
1316
+ "learning_rate": 1.6234061120181142e-05,
1317
+ "loss": 0.0411,
1318
+ "num_input_tokens_seen": 484856,
1319
+ "step": 745
1320
+ },
1321
+ {
1322
+ "epoch": 13.157894736842104,
1323
+ "grad_norm": 0.9767260551452637,
1324
+ "learning_rate": 1.5876654970989308e-05,
1325
+ "loss": 0.0292,
1326
+ "num_input_tokens_seen": 487480,
1327
+ "step": 750
1328
+ },
1329
+ {
1330
+ "epoch": 13.24561403508772,
1331
+ "grad_norm": 0.08649484068155289,
1332
+ "learning_rate": 1.552138723018382e-05,
1333
+ "loss": 0.0338,
1334
+ "num_input_tokens_seen": 490520,
1335
+ "step": 755
1336
+ },
1337
+ {
1338
+ "epoch": 13.333333333333334,
1339
+ "grad_norm": 0.5096527338027954,
1340
+ "learning_rate": 1.5168341168485423e-05,
1341
+ "loss": 0.0489,
1342
+ "num_input_tokens_seen": 493976,
1343
+ "step": 760
1344
+ },
1345
+ {
1346
+ "epoch": 13.421052631578947,
1347
+ "grad_norm": 0.7490821480751038,
1348
+ "learning_rate": 1.4817599535878565e-05,
1349
+ "loss": 0.1526,
1350
+ "num_input_tokens_seen": 497080,
1351
+ "step": 765
1352
+ },
1353
+ {
1354
+ "epoch": 13.508771929824562,
1355
+ "grad_norm": 1.149895191192627,
1356
+ "learning_rate": 1.4469244542215682e-05,
1357
+ "loss": 0.0726,
1358
+ "num_input_tokens_seen": 500792,
1359
+ "step": 770
1360
+ },
1361
+ {
1362
+ "epoch": 13.596491228070175,
1363
+ "grad_norm": 0.9444558024406433,
1364
+ "learning_rate": 1.4123357837948175e-05,
1365
+ "loss": 0.0811,
1366
+ "num_input_tokens_seen": 503832,
1367
+ "step": 775
1368
+ },
1369
+ {
1370
+ "epoch": 13.68421052631579,
1371
+ "grad_norm": 0.5723578333854675,
1372
+ "learning_rate": 1.3780020494988446e-05,
1373
+ "loss": 0.1253,
1374
+ "num_input_tokens_seen": 507256,
1375
+ "step": 780
1376
+ },
1377
+ {
1378
+ "epoch": 13.771929824561404,
1379
+ "grad_norm": 0.2436181753873825,
1380
+ "learning_rate": 1.3439312987707615e-05,
1381
+ "loss": 0.0899,
1382
+ "num_input_tokens_seen": 510616,
1383
+ "step": 785
1384
+ },
1385
+ {
1386
+ "epoch": 13.859649122807017,
1387
+ "grad_norm": 4.446864128112793,
1388
+ "learning_rate": 1.3101315174073162e-05,
1389
+ "loss": 0.3391,
1390
+ "num_input_tokens_seen": 514200,
1391
+ "step": 790
1392
+ },
1393
+ {
1394
+ "epoch": 13.947368421052632,
1395
+ "grad_norm": 2.065760374069214,
1396
+ "learning_rate": 1.2766106276931223e-05,
1397
+ "loss": 0.2225,
1398
+ "num_input_tokens_seen": 517400,
1399
+ "step": 795
1400
+ },
1401
+ {
1402
+ "epoch": 14.0,
1403
+ "eval_loss": 0.1424892693758011,
1404
+ "eval_runtime": 0.5563,
1405
+ "eval_samples_per_second": 44.944,
1406
+ "eval_steps_per_second": 12.584,
1407
+ "num_input_tokens_seen": 518664,
1408
+ "step": 798
1409
+ },
1410
+ {
1411
+ "epoch": 14.035087719298245,
1412
+ "grad_norm": 0.16491180658340454,
1413
+ "learning_rate": 1.243376486543755e-05,
1414
+ "loss": 0.0818,
1415
+ "num_input_tokens_seen": 519848,
1416
+ "step": 800
1417
+ },
1418
+ {
1419
+ "epoch": 14.12280701754386,
1420
+ "grad_norm": 0.1493954062461853,
1421
+ "learning_rate": 1.2104368836641908e-05,
1422
+ "loss": 0.098,
1423
+ "num_input_tokens_seen": 523176,
1424
+ "step": 805
1425
+ },
1426
+ {
1427
+ "epoch": 14.210526315789474,
1428
+ "grad_norm": 0.1759290248155594,
1429
+ "learning_rate": 1.1777995397229771e-05,
1430
+ "loss": 0.1862,
1431
+ "num_input_tokens_seen": 526280,
1432
+ "step": 810
1433
+ },
1434
+ {
1435
+ "epoch": 14.298245614035087,
1436
+ "grad_norm": 0.16360199451446533,
1437
+ "learning_rate": 1.1454721045426073e-05,
1438
+ "loss": 0.1753,
1439
+ "num_input_tokens_seen": 529160,
1440
+ "step": 815
1441
+ },
1442
+ {
1443
+ "epoch": 14.385964912280702,
1444
+ "grad_norm": 0.8864728212356567,
1445
+ "learning_rate": 1.113462155306478e-05,
1446
+ "loss": 0.0746,
1447
+ "num_input_tokens_seen": 533256,
1448
+ "step": 820
1449
+ },
1450
+ {
1451
+ "epoch": 14.473684210526315,
1452
+ "grad_norm": 0.917839765548706,
1453
+ "learning_rate": 1.0817771947828934e-05,
1454
+ "loss": 0.1421,
1455
+ "num_input_tokens_seen": 536712,
1456
+ "step": 825
1457
+ },
1458
+ {
1459
+ "epoch": 14.56140350877193,
1460
+ "grad_norm": 0.286272257566452,
1461
+ "learning_rate": 1.0504246495664932e-05,
1462
+ "loss": 0.0842,
1463
+ "num_input_tokens_seen": 539912,
1464
+ "step": 830
1465
+ },
1466
+ {
1467
+ "epoch": 14.649122807017545,
1468
+ "grad_norm": 0.3394187390804291,
1469
+ "learning_rate": 1.0194118683375503e-05,
1470
+ "loss": 0.0231,
1471
+ "num_input_tokens_seen": 543336,
1472
+ "step": 835
1473
+ },
1474
+ {
1475
+ "epoch": 14.736842105263158,
1476
+ "grad_norm": 1.1049628257751465,
1477
+ "learning_rate": 9.887461201395176e-06,
1478
+ "loss": 0.0495,
1479
+ "num_input_tokens_seen": 547496,
1480
+ "step": 840
1481
+ },
1482
+ {
1483
+ "epoch": 14.824561403508772,
1484
+ "grad_norm": 0.2065039575099945,
1485
+ "learning_rate": 9.584345926752524e-06,
1486
+ "loss": 0.1466,
1487
+ "num_input_tokens_seen": 550280,
1488
+ "step": 845
1489
+ },
1490
+ {
1491
+ "epoch": 14.912280701754385,
1492
+ "grad_norm": 0.31464970111846924,
1493
+ "learning_rate": 9.284843906222948e-06,
1494
+ "loss": 0.0824,
1495
+ "num_input_tokens_seen": 553672,
1496
+ "step": 850
1497
+ },
1498
+ {
1499
+ "epoch": 15.0,
1500
+ "grad_norm": 0.30430617928504944,
1501
+ "learning_rate": 8.98902533967618e-06,
1502
+ "loss": 0.0918,
1503
+ "num_input_tokens_seen": 555728,
1504
+ "step": 855
1505
+ },
1506
+ {
1507
+ "epoch": 15.0,
1508
+ "eval_loss": 0.141252800822258,
1509
+ "eval_runtime": 0.5441,
1510
+ "eval_samples_per_second": 45.946,
1511
+ "eval_steps_per_second": 12.865,
1512
+ "num_input_tokens_seen": 555728,
1513
+ "step": 855
1514
+ },
1515
+ {
1516
+ "epoch": 15.087719298245615,
1517
+ "grad_norm": 1.6647047996520996,
1518
+ "learning_rate": 8.696959563622174e-06,
1519
+ "loss": 0.0736,
1520
+ "num_input_tokens_seen": 559312,
1521
+ "step": 860
1522
+ },
1523
+ {
1524
+ "epoch": 15.175438596491228,
1525
+ "grad_norm": 0.44085150957107544,
1526
+ "learning_rate": 8.40871503495947e-06,
1527
+ "loss": 0.0652,
1528
+ "num_input_tokens_seen": 563056,
1529
+ "step": 865
1530
+ },
1531
+ {
1532
+ "epoch": 15.263157894736842,
1533
+ "grad_norm": 0.31424131989479065,
1534
+ "learning_rate": 8.124359314929622e-06,
1535
+ "loss": 0.1094,
1536
+ "num_input_tokens_seen": 566224,
1537
+ "step": 870
1538
+ },
1539
+ {
1540
+ "epoch": 15.350877192982455,
1541
+ "grad_norm": 3.1368279457092285,
1542
+ "learning_rate": 7.843959053281663e-06,
1543
+ "loss": 0.2245,
1544
+ "num_input_tokens_seen": 569776,
1545
+ "step": 875
1546
+ },
1547
+ {
1548
+ "epoch": 15.43859649122807,
1549
+ "grad_norm": 0.2510080337524414,
1550
+ "learning_rate": 7.5675799726501155e-06,
1551
+ "loss": 0.0676,
1552
+ "num_input_tokens_seen": 573360,
1553
+ "step": 880
1554
+ },
1555
+ {
1556
+ "epoch": 15.526315789473685,
1557
+ "grad_norm": 1.232825517654419,
1558
+ "learning_rate": 7.295286853150391e-06,
1559
+ "loss": 0.0734,
1560
+ "num_input_tokens_seen": 576144,
1561
+ "step": 885
1562
+ },
1563
+ {
1564
+ "epoch": 15.614035087719298,
1565
+ "grad_norm": 0.8447596430778503,
1566
+ "learning_rate": 7.027143517195023e-06,
1567
+ "loss": 0.1219,
1568
+ "num_input_tokens_seen": 579088,
1569
+ "step": 890
1570
+ },
1571
+ {
1572
+ "epoch": 15.701754385964913,
1573
+ "grad_norm": 0.45193973183631897,
1574
+ "learning_rate": 6.763212814534484e-06,
1575
+ "loss": 0.1339,
1576
+ "num_input_tokens_seen": 582032,
1577
+ "step": 895
1578
+ },
1579
+ {
1580
+ "epoch": 15.789473684210526,
1581
+ "grad_norm": 0.7464925050735474,
1582
+ "learning_rate": 6.503556607525838e-06,
1583
+ "loss": 0.1209,
1584
+ "num_input_tokens_seen": 585584,
1585
+ "step": 900
1586
+ },
1587
+ {
1588
+ "epoch": 15.87719298245614,
1589
+ "grad_norm": 1.4182426929473877,
1590
+ "learning_rate": 6.248235756632984e-06,
1591
+ "loss": 0.0702,
1592
+ "num_input_tokens_seen": 588944,
1593
+ "step": 905
1594
+ },
1595
+ {
1596
+ "epoch": 15.964912280701755,
1597
+ "grad_norm": 0.8884740471839905,
1598
+ "learning_rate": 5.997310106161589e-06,
1599
+ "loss": 0.0446,
1600
+ "num_input_tokens_seen": 592112,
1601
+ "step": 910
1602
+ },
1603
+ {
1604
+ "epoch": 16.0,
1605
+ "eval_loss": 0.14353685081005096,
1606
+ "eval_runtime": 0.5486,
1607
+ "eval_samples_per_second": 45.569,
1608
+ "eval_steps_per_second": 12.759,
1609
+ "num_input_tokens_seen": 593096,
1610
+ "step": 912
1611
+ },
1612
+ {
1613
+ "epoch": 16.05263157894737,
1614
+ "grad_norm": 0.5248811841011047,
1615
+ "learning_rate": 5.7508384702323226e-06,
1616
+ "loss": 0.7602,
1617
+ "num_input_tokens_seen": 594440,
1618
+ "step": 915
1619
+ },
1620
+ {
1621
+ "epoch": 16.140350877192983,
1622
+ "grad_norm": 0.4377155900001526,
1623
+ "learning_rate": 5.508878618995439e-06,
1624
+ "loss": 0.0476,
1625
+ "num_input_tokens_seen": 598440,
1626
+ "step": 920
1627
+ },
1628
+ {
1629
+ "epoch": 16.228070175438596,
1630
+ "grad_norm": 0.5021504759788513,
1631
+ "learning_rate": 5.271487265090163e-06,
1632
+ "loss": 0.1024,
1633
+ "num_input_tokens_seen": 602152,
1634
+ "step": 925
1635
+ },
1636
+ {
1637
+ "epoch": 16.31578947368421,
1638
+ "grad_norm": 1.3060020208358765,
1639
+ "learning_rate": 5.038720050351842e-06,
1640
+ "loss": 0.1208,
1641
+ "num_input_tokens_seen": 605736,
1642
+ "step": 930
1643
+ },
1644
+ {
1645
+ "epoch": 16.403508771929825,
1646
+ "grad_norm": 0.22745804488658905,
1647
+ "learning_rate": 4.810631532770182e-06,
1648
+ "loss": 0.1869,
1649
+ "num_input_tokens_seen": 608520,
1650
+ "step": 935
1651
+ },
1652
+ {
1653
+ "epoch": 16.49122807017544,
1654
+ "grad_norm": 0.23964422941207886,
1655
+ "learning_rate": 4.587275173701428e-06,
1656
+ "loss": 0.0483,
1657
+ "num_input_tokens_seen": 612040,
1658
+ "step": 940
1659
+ },
1660
+ {
1661
+ "epoch": 16.57894736842105,
1662
+ "grad_norm": 1.2258174419403076,
1663
+ "learning_rate": 4.368703325337667e-06,
1664
+ "loss": 0.0727,
1665
+ "num_input_tokens_seen": 614920,
1666
+ "step": 945
1667
+ },
1668
+ {
1669
+ "epoch": 16.666666666666668,
1670
+ "grad_norm": 0.414588987827301,
1671
+ "learning_rate": 4.154967218436037e-06,
1672
+ "loss": 0.0763,
1673
+ "num_input_tokens_seen": 618440,
1674
+ "step": 950
1675
+ },
1676
+ {
1677
+ "epoch": 16.75438596491228,
1678
+ "grad_norm": 0.2198306918144226,
1679
+ "learning_rate": 3.94611695031086e-06,
1680
+ "loss": 0.2711,
1681
+ "num_input_tokens_seen": 621320,
1682
+ "step": 955
1683
+ },
1684
+ {
1685
+ "epoch": 16.842105263157894,
1686
+ "grad_norm": 0.47897055745124817,
1687
+ "learning_rate": 3.74220147309135e-06,
1688
+ "loss": 0.053,
1689
+ "num_input_tokens_seen": 624648,
1690
+ "step": 960
1691
+ },
1692
+ {
1693
+ "epoch": 16.92982456140351,
1694
+ "grad_norm": 1.419171929359436,
1695
+ "learning_rate": 3.543268582247844e-06,
1696
+ "loss": 0.0862,
1697
+ "num_input_tokens_seen": 628232,
1698
+ "step": 965
1699
+ },
1700
+ {
1701
+ "epoch": 17.0,
1702
+ "eval_loss": 0.14645947515964508,
1703
+ "eval_runtime": 0.5483,
1704
+ "eval_samples_per_second": 45.592,
1705
+ "eval_steps_per_second": 12.766,
1706
+ "num_input_tokens_seen": 629760,
1707
+ "step": 969
1708
+ },
1709
+ {
1710
+ "epoch": 17.017543859649123,
1711
+ "grad_norm": 0.4822147488594055,
1712
+ "learning_rate": 3.3493649053890326e-06,
1713
+ "loss": 0.1102,
1714
+ "num_input_tokens_seen": 630528,
1715
+ "step": 970
1716
+ },
1717
+ {
1718
+ "epoch": 17.105263157894736,
1719
+ "grad_norm": 0.0900745615363121,
1720
+ "learning_rate": 3.1605358913330385e-06,
1721
+ "loss": 0.0679,
1722
+ "num_input_tokens_seen": 633600,
1723
+ "step": 975
1724
+ },
1725
+ {
1726
+ "epoch": 17.19298245614035,
1727
+ "grad_norm": 0.3047313392162323,
1728
+ "learning_rate": 2.9768257994546662e-06,
1729
+ "loss": 0.0809,
1730
+ "num_input_tokens_seen": 637024,
1731
+ "step": 980
1732
+ },
1733
+ {
1734
+ "epoch": 17.280701754385966,
1735
+ "grad_norm": 0.2203790247440338,
1736
+ "learning_rate": 2.7982776893115627e-06,
1737
+ "loss": 0.1477,
1738
+ "num_input_tokens_seen": 640160,
1739
+ "step": 985
1740
+ },
1741
+ {
1742
+ "epoch": 17.36842105263158,
1743
+ "grad_norm": 0.4543409049510956,
1744
+ "learning_rate": 2.624933410551508e-06,
1745
+ "loss": 0.1211,
1746
+ "num_input_tokens_seen": 643040,
1747
+ "step": 990
1748
+ },
1749
+ {
1750
+ "epoch": 17.45614035087719,
1751
+ "grad_norm": 0.4932427704334259,
1752
+ "learning_rate": 2.456833593103361e-06,
1753
+ "loss": 0.0236,
1754
+ "num_input_tokens_seen": 646336,
1755
+ "step": 995
1756
+ },
1757
+ {
1758
+ "epoch": 17.54385964912281,
1759
+ "grad_norm": 1.4553192853927612,
1760
+ "learning_rate": 2.2940176376538445e-06,
1761
+ "loss": 0.1067,
1762
+ "num_input_tokens_seen": 649984,
1763
+ "step": 1000
1764
+ },
1765
+ {
1766
+ "epoch": 17.63157894736842,
1767
+ "grad_norm": 0.843288779258728,
1768
+ "learning_rate": 2.136523706412477e-06,
1769
+ "loss": 0.0766,
1770
+ "num_input_tokens_seen": 653632,
1771
+ "step": 1005
1772
+ },
1773
+ {
1774
+ "epoch": 17.719298245614034,
1775
+ "grad_norm": 1.9132968187332153,
1776
+ "learning_rate": 1.984388714166799e-06,
1777
+ "loss": 0.1453,
1778
+ "num_input_tokens_seen": 656960,
1779
+ "step": 1010
1780
+ },
1781
+ {
1782
+ "epoch": 17.80701754385965,
1783
+ "grad_norm": 0.293445348739624,
1784
+ "learning_rate": 1.837648319629956e-06,
1785
+ "loss": 0.1944,
1786
+ "num_input_tokens_seen": 659840,
1787
+ "step": 1015
1788
+ },
1789
+ {
1790
+ "epoch": 17.894736842105264,
1791
+ "grad_norm": 0.8959747552871704,
1792
+ "learning_rate": 1.6963369170826943e-06,
1793
+ "loss": 0.1208,
1794
+ "num_input_tokens_seen": 663872,
1795
+ "step": 1020
1796
+ },
1797
+ {
1798
+ "epoch": 17.982456140350877,
1799
+ "grad_norm": 1.5412652492523193,
1800
+ "learning_rate": 1.5604876283117326e-06,
1801
+ "loss": 0.0794,
1802
+ "num_input_tokens_seen": 667264,
1803
+ "step": 1025
1804
+ },
1805
+ {
1806
+ "epoch": 18.0,
1807
+ "eval_loss": 0.14306816458702087,
1808
+ "eval_runtime": 0.5703,
1809
+ "eval_samples_per_second": 43.84,
1810
+ "eval_steps_per_second": 12.275,
1811
+ "num_input_tokens_seen": 667432,
1812
+ "step": 1026
1813
+ },
1814
+ {
1815
+ "epoch": 18.07017543859649,
1816
+ "grad_norm": 1.4053586721420288,
1817
+ "learning_rate": 1.4301322948464147e-06,
1818
+ "loss": 0.0883,
1819
+ "num_input_tokens_seen": 669544,
1820
+ "step": 1030
1821
+ },
1822
+ {
1823
+ "epoch": 18.157894736842106,
1824
+ "grad_norm": 0.8327214121818542,
1825
+ "learning_rate": 1.3053014704953987e-06,
1826
+ "loss": 0.2406,
1827
+ "num_input_tokens_seen": 672776,
1828
+ "step": 1035
1829
+ },
1830
+ {
1831
+ "epoch": 18.24561403508772,
1832
+ "grad_norm": 0.12563203275203705,
1833
+ "learning_rate": 1.1860244141851773e-06,
1834
+ "loss": 0.0419,
1835
+ "num_input_tokens_seen": 676008,
1836
+ "step": 1040
1837
+ },
1838
+ {
1839
+ "epoch": 18.333333333333332,
1840
+ "grad_norm": 0.27162885665893555,
1841
+ "learning_rate": 1.0723290831021471e-06,
1842
+ "loss": 0.1311,
1843
+ "num_input_tokens_seen": 679848,
1844
+ "step": 1045
1845
+ },
1846
+ {
1847
+ "epoch": 18.42105263157895,
1848
+ "grad_norm": 0.07449635118246078,
1849
+ "learning_rate": 9.642421261397472e-07,
1850
+ "loss": 0.1663,
1851
+ "num_input_tokens_seen": 683144,
1852
+ "step": 1050
1853
+ },
1854
+ {
1855
+ "epoch": 18.50877192982456,
1856
+ "grad_norm": 0.8120988607406616,
1857
+ "learning_rate": 8.617888776522642e-07,
1858
+ "loss": 0.1803,
1859
+ "num_input_tokens_seen": 686280,
1860
+ "step": 1055
1861
+ },
1862
+ {
1863
+ "epoch": 18.596491228070175,
1864
+ "grad_norm": 0.5673397183418274,
1865
+ "learning_rate": 7.649933515167407e-07,
1866
+ "loss": 0.0692,
1867
+ "num_input_tokens_seen": 689480,
1868
+ "step": 1060
1869
+ },
1870
+ {
1871
+ "epoch": 18.68421052631579,
1872
+ "grad_norm": 0.9280127882957458,
1873
+ "learning_rate": 6.738782355044049e-07,
1874
+ "loss": 0.0773,
1875
+ "num_input_tokens_seen": 692296,
1876
+ "step": 1065
1877
+ },
1878
+ {
1879
+ "epoch": 18.771929824561404,
1880
+ "grad_norm": 0.09568026661872864,
1881
+ "learning_rate": 5.88464885962911e-07,
1882
+ "loss": 0.0367,
1883
+ "num_input_tokens_seen": 695912,
1884
+ "step": 1070
1885
+ },
1886
+ {
1887
+ "epoch": 18.859649122807017,
1888
+ "grad_norm": 0.4726370871067047,
1889
+ "learning_rate": 5.087733228106517e-07,
1890
+ "loss": 0.0445,
1891
+ "num_input_tokens_seen": 699432,
1892
+ "step": 1075
1893
+ },
1894
+ {
1895
+ "epoch": 18.94736842105263,
1896
+ "grad_norm": 1.00346839427948,
1897
+ "learning_rate": 4.3482222484432513e-07,
1898
+ "loss": 0.1133,
1899
+ "num_input_tokens_seen": 703080,
1900
+ "step": 1080
1901
+ },
1902
+ {
1903
+ "epoch": 19.0,
1904
+ "eval_loss": 0.1472744643688202,
1905
+ "eval_runtime": 0.5495,
1906
+ "eval_samples_per_second": 45.498,
1907
+ "eval_steps_per_second": 12.74,
1908
+ "num_input_tokens_seen": 704816,
1909
+ "step": 1083
1910
+ },
1911
+ {
1912
+ "epoch": 19.035087719298247,
1913
+ "grad_norm": 0.7854535579681396,
1914
+ "learning_rate": 3.666289253608235e-07,
1915
+ "loss": 0.0488,
1916
+ "num_input_tokens_seen": 706192,
1917
+ "step": 1085
1918
+ },
1919
+ {
1920
+ "epoch": 19.12280701754386,
1921
+ "grad_norm": 0.8600553870201111,
1922
+ "learning_rate": 3.0420940809451624e-07,
1923
+ "loss": 0.1502,
1924
+ "num_input_tokens_seen": 709072,
1925
+ "step": 1090
1926
+ },
1927
+ {
1928
+ "epoch": 19.210526315789473,
1929
+ "grad_norm": 0.5129100680351257,
1930
+ "learning_rate": 2.47578303470844e-07,
1931
+ "loss": 0.0381,
1932
+ "num_input_tokens_seen": 712496,
1933
+ "step": 1095
1934
+ },
1935
+ {
1936
+ "epoch": 19.29824561403509,
1937
+ "grad_norm": 1.3048194646835327,
1938
+ "learning_rate": 1.96748885177106e-07,
1939
+ "loss": 0.1185,
1940
+ "num_input_tokens_seen": 715056,
1941
+ "step": 1100
1942
+ },
1943
+ {
1944
+ "epoch": 19.385964912280702,
1945
+ "grad_norm": 0.70549076795578,
1946
+ "learning_rate": 1.517330670512629e-07,
1947
+ "loss": 0.092,
1948
+ "num_input_tokens_seen": 718416,
1949
+ "step": 1105
1950
+ },
1951
+ {
1952
+ "epoch": 19.473684210526315,
1953
+ "grad_norm": 0.7766090035438538,
1954
+ "learning_rate": 1.125414002894759e-07,
1955
+ "loss": 0.1179,
1956
+ "num_input_tokens_seen": 721744,
1957
+ "step": 1110
1958
+ },
1959
+ {
1960
+ "epoch": 19.56140350877193,
1961
+ "grad_norm": 0.1933118849992752,
1962
+ "learning_rate": 7.918307097301014e-08,
1963
+ "loss": 0.0358,
1964
+ "num_input_tokens_seen": 725328,
1965
+ "step": 1115
1966
+ },
1967
+ {
1968
+ "epoch": 19.649122807017545,
1969
+ "grad_norm": 0.28001102805137634,
1970
+ "learning_rate": 5.166589791513465e-08,
1971
+ "loss": 0.1498,
1972
+ "num_input_tokens_seen": 728976,
1973
+ "step": 1120
1974
+ },
1975
+ {
1976
+ "epoch": 19.736842105263158,
1977
+ "grad_norm": 0.9773634672164917,
1978
+ "learning_rate": 2.999633082847453e-08,
1979
+ "loss": 0.0971,
1980
+ "num_input_tokens_seen": 732368,
1981
+ "step": 1125
1982
+ },
1983
+ {
1984
+ "epoch": 19.82456140350877,
1985
+ "grad_norm": 0.047032903879880905,
1986
+ "learning_rate": 1.4179448813278484e-08,
1987
+ "loss": 0.1095,
1988
+ "num_input_tokens_seen": 735440,
1989
+ "step": 1130
1990
+ },
1991
+ {
1992
+ "epoch": 19.912280701754387,
1993
+ "grad_norm": 3.142075538635254,
1994
+ "learning_rate": 4.218959166932268e-09,
1995
+ "loss": 0.1759,
1996
+ "num_input_tokens_seen": 739120,
1997
+ "step": 1135
1998
+ },
1999
+ {
2000
+ "epoch": 20.0,
2001
+ "grad_norm": 0.30034491419792175,
2002
+ "learning_rate": 1.1719651499819683e-10,
2003
+ "loss": 0.0716,
2004
+ "num_input_tokens_seen": 742296,
2005
+ "step": 1140
2006
+ },
2007
+ {
2008
+ "epoch": 20.0,
2009
+ "eval_loss": 0.14301826059818268,
2010
+ "eval_runtime": 0.5491,
2011
+ "eval_samples_per_second": 45.527,
2012
+ "eval_steps_per_second": 12.748,
2013
+ "num_input_tokens_seen": 742296,
2014
+ "step": 1140
2015
+ },
2016
+ {
2017
+ "epoch": 20.0,
2018
+ "num_input_tokens_seen": 742296,
2019
+ "step": 1140,
2020
+ "total_flos": 3.342612903395328e+16,
2021
+ "train_loss": 0.22276320790773943,
2022
+ "train_runtime": 280.0262,
2023
+ "train_samples_per_second": 16.07,
2024
+ "train_steps_per_second": 4.071
2025
+ }
2026
+ ],
2027
+ "logging_steps": 5,
2028
+ "max_steps": 1140,
2029
+ "num_input_tokens_seen": 742296,
2030
+ "num_train_epochs": 20,
2031
+ "save_steps": 57,
2032
+ "stateful_callbacks": {
2033
+ "TrainerControl": {
2034
+ "args": {
2035
+ "should_epoch_stop": false,
2036
+ "should_evaluate": false,
2037
+ "should_log": false,
2038
+ "should_save": true,
2039
+ "should_training_stop": true
2040
+ },
2041
+ "attributes": {}
2042
+ }
2043
+ },
2044
+ "total_flos": 3.342612903395328e+16,
2045
+ "train_batch_size": 4,
2046
+ "trial_name": null,
2047
+ "trial_params": null
2048
+ }
training_eval_loss.png ADDED
training_loss.png ADDED