Hugging Face's logo

agentlans
/
GIST-small-c4-en-doc_type_v2_primary

Text Classification
Safetensors
English
bert
sequence-classification
Eval Results (legacy)
Model card Files
xet
 Community
agentlans commited on
Commit
5ecca13
·
verified ·
1 Parent(s): f9f57b1

Upload 14 files

Browse files
Files changed (14) hide show
  1. README.md +687 -0
  2. all_results.json +15 -0
  3. config.json +80 -0
  4. eval_results.json +9 -0
  5. model.safetensors +3 -0
  6. predict_results.txt +0 -0
  7. report.md +38 -0
  8. special_tokens_map.json +37 -0
  9. tokenizer.json +0 -0
  10. tokenizer_config.json +58 -0
  11. train_results.json +9 -0
  12. trainer_state.json +3745 -0
  13. training_args.bin +3 -0
  14. vocab.txt +0 -0
README.md ADDED
@@ -0,0 +1,687 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+ base_model:
5
+ - avsolatorio/GIST-small-Embedding-v0
6
+ datasets:
7
+ - agentlans/en-document-classification
8
+ tags:
9
+ - bert
10
+ - text-classification
11
+ - sequence-classification
12
+ metrics:
13
+ - f1
14
+ - loss
15
+ model-index:
16
+ - name: GIST-small-c4-en-doc_type_v2_primary
17
+ results:
18
+ - task:
19
+ type: text-classification
20
+ name: Text Classification
21
+ metrics:
22
+ - type: f1
23
+ value: 0.7784
24
+ name: Evaluation F1
25
+ - type: loss
26
+ value: 0.7511
27
+ name: Evaluation Loss
28
+ ---
29
+ # GIST-small-c4-en-doc_type_v2_primary
30
+
31
+ A fine-tuned version of the **bert** architecture (`BertForSequenceClassification`) optimized for the `text-classification` task.
32
+
33
+ - **Model type:** bert
34
+ - **Problem Type:** single_label_classification
35
+ - **Number of Labels:** 25
36
+ - **Vocabulary Size:** 30522
37
+ - **License:** MIT
38
+
39
+ ## Use
40
+
41
+ To get started with this model in Python using the Hugging Face Transformers library, run the following code:
42
+
43
+ ```python
44
+ from transformers import AutoTokenizer, AutoModelForSequenceClassification
45
+ import torch
46
+
47
+ model_id = "agentlans/GIST-small-c4-en-doc_type_v2_primary"
48
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
49
+ model = AutoModelForSequenceClassification.from_pretrained(model_id)
50
+
51
+ text = "Replace this with your input text."
52
+ inputs = tokenizer(text, return_tensors="pt")
53
+
54
+ with torch.no_grad():
55
+ logits = model(**inputs).logits
56
+
57
+ predicted_class_id = logits.argmax().item()
58
+ predicted_class_name = model.config.id2label[predicted_class_id]
59
+
60
+ print(f"Predicted Class ID: {predicted_class_id}")
61
+ print(f"Predicted Class Name: {predicted_class_name}")
62
+ ```
63
+
64
+ ## Intended Uses & Limitations
65
+
66
+ ### Intended Use
67
+ This model is designed for sequence classification tasks. Below are the specific class labels mapped to their corresponding IDs:
68
+
69
+ | Label ID | Label Name |
70
+ |---|---|
71
+ | 0 | About (Org.) |
72
+ | 1 | About (Personal) |
73
+ | 2 | Academic Writing |
74
+ | 3 | Audio Transcript |
75
+ | 4 | Comment Section |
76
+ | 5 | Content Listing |
77
+ | 6 | Creative Writing |
78
+ | 7 | Customer Support |
79
+ | 8 | Documentation |
80
+ | 9 | FAQ |
81
+ | 10 | Knowledge Article |
82
+ | 11 | Legal Notices |
83
+ | 12 | Listicle |
84
+ | 13 | News (Org.) |
85
+ | 14 | News Article |
86
+ | 15 | Nonfiction Writing |
87
+ | 16 | Other/Unclassified |
88
+ | 17 | Personal Blog |
89
+ | 18 | Product Page |
90
+ | 19 | Q&A Forum |
91
+ | 20 | Spam / Ads |
92
+ | 21 | Structured Data |
93
+ | 22 | Truncated |
94
+ | 23 | Tutorial |
95
+ | 24 | User Review |
96
+
97
+ ## Training Details
98
+
99
+ ### Hyperparameters
100
+ The following hyperparameters were used during fine-tuning:
101
+ - **Learning Rate:** 5e-05
102
+ - **Train Batch Size:** 8
103
+ - **Eval Batch Size:** 8
104
+ - **Optimizer:** OptimizerNames.ADAMW_TORCH_FUSED
105
+ - **Number of Epochs:** 3.0
106
+ - **Mixed Precision:** BF16
107
+
108
+ <details>
109
+ <summary><b>Show Advanced Training Configuration</b></summary>
110
+
111
+ #### Optimization & Regularization
112
+ - **Gradient Accumulation Steps:** 1
113
+ - **Learning Rate Scheduler:** SchedulerType.LINEAR
114
+ - **Warmup Steps:** 0
115
+ - **Warmup Ratio:** None
116
+ - **Weight Decay:** 0.0
117
+ - **Max Gradient Norm:** 1.0
118
+
119
+ #### Hardware & Reproducibility
120
+ - **Number of GPUs:** 1
121
+ - **Seed:** 42
122
+
123
+ </details>
124
+
125
+ ## Training Results & Evaluation
126
+
127
+ During fine-tuning, the model achieved the following results on the evaluation set:
128
+
129
+ | Metric | Value |
130
+ |---|---|
131
+ | **Train Loss** | 0.6613 |
132
+ | **Validation Loss** | 0.7511 |
133
+ | **Validation F1 Score** | 0.7784 |
134
+ | **Total FLOPs** | 3.4624e+16 |
135
+
136
+ For performance on the test set, [click here](report.md).
137
+
138
+ ### Speed Performance
139
+ - **Training Runtime:** 4513.963 seconds
140
+ - **Train Samples per Second:** 465.583
141
+ - **Evaluation Runtime:** 49.7968 seconds
142
+ - **Eval Samples per Second:** 1758.588
143
+
144
+
145
+ <details>
146
+ <summary><b>Show Detailed Training Logs</b></summary>
147
+
148
+ ### Training Logs History
149
+
150
+ | Step | Epoch | Learning Rate | Training Loss | Validation Loss | Validation F1 |
151
+ |---|---|---|---|---|---|
152
+ | 500 | 0.006 | 4.9905e-05 | 2.1096 | N/A | N/A |
153
+ | 1000 | 0.011 | 4.9810e-05 | 1.4648 | N/A | N/A |
154
+ | 1500 | 0.017 | 4.9715e-05 | 1.3621 | N/A | N/A |
155
+ | 2000 | 0.023 | 4.9620e-05 | 1.2406 | N/A | N/A |
156
+ | 2500 | 0.029 | 4.9524e-05 | 1.1532 | N/A | N/A |
157
+ | 3000 | 0.034 | 4.9429e-05 | 1.0964 | N/A | N/A |
158
+ | 3500 | 0.04 | 4.9334e-05 | 1.0586 | N/A | N/A |
159
+ | 4000 | 0.046 | 4.9239e-05 | 1.0608 | N/A | N/A |
160
+ | 4500 | 0.051 | 4.9144e-05 | 1.0335 | N/A | N/A |
161
+ | 5000 | 0.057 | 4.9049e-05 | 1.0439 | N/A | N/A |
162
+ | 5500 | 0.063 | 4.8953e-05 | 0.9611 | N/A | N/A |
163
+ | 6000 | 0.069 | 4.8858e-05 | 0.9918 | N/A | N/A |
164
+ | 6500 | 0.074 | 4.8763e-05 | 0.9632 | N/A | N/A |
165
+ | 7000 | 0.08 | 4.8668e-05 | 0.9615 | N/A | N/A |
166
+ | 7500 | 0.086 | 4.8573e-05 | 0.957 | N/A | N/A |
167
+ | 8000 | 0.091 | 4.8478e-05 | 0.9505 | N/A | N/A |
168
+ | 8500 | 0.097 | 4.8382e-05 | 0.9517 | N/A | N/A |
169
+ | 9000 | 0.103 | 4.8287e-05 | 0.9335 | N/A | N/A |
170
+ | 9500 | 0.108 | 4.8192e-05 | 0.9379 | N/A | N/A |
171
+ | 10000 | 0.114 | 4.8097e-05 | 0.9304 | N/A | N/A |
172
+ | 10500 | 0.12 | 4.8002e-05 | 0.8961 | N/A | N/A |
173
+ | 11000 | 0.126 | 4.7907e-05 | 0.934 | N/A | N/A |
174
+ | 11500 | 0.131 | 4.7811e-05 | 0.8942 | N/A | N/A |
175
+ | 12000 | 0.137 | 4.7716e-05 | 0.9017 | N/A | N/A |
176
+ | 12500 | 0.143 | 4.7621e-05 | 0.8932 | N/A | N/A |
177
+ | 13000 | 0.148 | 4.7526e-05 | 0.9261 | N/A | N/A |
178
+ | 13500 | 0.154 | 4.7431e-05 | 0.8984 | N/A | N/A |
179
+ | 14000 | 0.16 | 4.7336e-05 | 0.9197 | N/A | N/A |
180
+ | 14500 | 0.166 | 4.7240e-05 | 0.8839 | N/A | N/A |
181
+ | 15000 | 0.171 | 4.7145e-05 | 0.9165 | N/A | N/A |
182
+ | 15500 | 0.177 | 4.7050e-05 | 0.9321 | N/A | N/A |
183
+ | 16000 | 0.183 | 4.6955e-05 | 0.9121 | N/A | N/A |
184
+ | 16500 | 0.188 | 4.6860e-05 | 0.925 | N/A | N/A |
185
+ | 17000 | 0.194 | 4.6765e-05 | 0.9058 | N/A | N/A |
186
+ | 17500 | 0.2 | 4.6669e-05 | 0.8676 | N/A | N/A |
187
+ | 18000 | 0.206 | 4.6574e-05 | 0.8977 | N/A | N/A |
188
+ | 18500 | 0.211 | 4.6479e-05 | 0.8639 | N/A | N/A |
189
+ | 19000 | 0.217 | 4.6384e-05 | 0.8852 | N/A | N/A |
190
+ | 19500 | 0.223 | 4.6289e-05 | 0.8676 | N/A | N/A |
191
+ | 20000 | 0.228 | 4.6194e-05 | 0.8666 | N/A | N/A |
192
+ | 20500 | 0.234 | 4.6098e-05 | 0.8814 | N/A | N/A |
193
+ | 21000 | 0.24 | 4.6003e-05 | 0.8668 | N/A | N/A |
194
+ | 21500 | 0.246 | 4.5908e-05 | 0.9004 | N/A | N/A |
195
+ | 22000 | 0.251 | 4.5813e-05 | 0.8746 | N/A | N/A |
196
+ | 22500 | 0.257 | 4.5718e-05 | 0.8618 | N/A | N/A |
197
+ | 23000 | 0.263 | 4.5623e-05 | 0.8505 | N/A | N/A |
198
+ | 23500 | 0.268 | 4.5527e-05 | 0.8469 | N/A | N/A |
199
+ | 24000 | 0.274 | 4.5432e-05 | 0.8396 | N/A | N/A |
200
+ | 24500 | 0.28 | 4.5337e-05 | 0.8524 | N/A | N/A |
201
+ | 25000 | 0.285 | 4.5242e-05 | 0.8757 | N/A | N/A |
202
+ | 25500 | 0.291 | 4.5147e-05 | 0.844 | N/A | N/A |
203
+ | 26000 | 0.297 | 4.5052e-05 | 0.8615 | N/A | N/A |
204
+ | 26500 | 0.303 | 4.4956e-05 | 0.8535 | N/A | N/A |
205
+ | 27000 | 0.308 | 4.4861e-05 | 0.8748 | N/A | N/A |
206
+ | 27500 | 0.314 | 4.4766e-05 | 0.8306 | N/A | N/A |
207
+ | 28000 | 0.32 | 4.4671e-05 | 0.8397 | N/A | N/A |
208
+ | 28500 | 0.325 | 4.4576e-05 | 0.8358 | N/A | N/A |
209
+ | 29000 | 0.331 | 4.4481e-05 | 0.8313 | N/A | N/A |
210
+ | 29500 | 0.337 | 4.4386e-05 | 0.8421 | N/A | N/A |
211
+ | 30000 | 0.343 | 4.4290e-05 | 0.8237 | N/A | N/A |
212
+ | 30500 | 0.348 | 4.4195e-05 | 0.857 | N/A | N/A |
213
+ | 31000 | 0.354 | 4.4100e-05 | 0.8299 | N/A | N/A |
214
+ | 31500 | 0.36 | 4.4005e-05 | 0.8107 | N/A | N/A |
215
+ | 32000 | 0.365 | 4.3910e-05 | 0.859 | N/A | N/A |
216
+ | 32500 | 0.371 | 4.3815e-05 | 0.8118 | N/A | N/A |
217
+ | 33000 | 0.377 | 4.3719e-05 | 0.8823 | N/A | N/A |
218
+ | 33500 | 0.383 | 4.3624e-05 | 0.8124 | N/A | N/A |
219
+ | 34000 | 0.388 | 4.3529e-05 | 0.8124 | N/A | N/A |
220
+ | 34500 | 0.394 | 4.3434e-05 | 0.8366 | N/A | N/A |
221
+ | 35000 | 0.4 | 4.3339e-05 | 0.8472 | N/A | N/A |
222
+ | 35500 | 0.405 | 4.3244e-05 | 0.8791 | N/A | N/A |
223
+ | 36000 | 0.411 | 4.3148e-05 | 0.8294 | N/A | N/A |
224
+ | 36500 | 0.417 | 4.3053e-05 | 0.8002 | N/A | N/A |
225
+ | 37000 | 0.423 | 4.2958e-05 | 0.8211 | N/A | N/A |
226
+ | 37500 | 0.428 | 4.2863e-05 | 0.8238 | N/A | N/A |
227
+ | 38000 | 0.434 | 4.2768e-05 | 0.8395 | N/A | N/A |
228
+ | 38500 | 0.44 | 4.2673e-05 | 0.8094 | N/A | N/A |
229
+ | 39000 | 0.445 | 4.2577e-05 | 0.8337 | N/A | N/A |
230
+ | 39500 | 0.451 | 4.2482e-05 | 0.8428 | N/A | N/A |
231
+ | 40000 | 0.457 | 4.2387e-05 | 0.8389 | N/A | N/A |
232
+ | 40500 | 0.462 | 4.2292e-05 | 0.8384 | N/A | N/A |
233
+ | 41000 | 0.468 | 4.2197e-05 | 0.8262 | N/A | N/A |
234
+ | 41500 | 0.474 | 4.2102e-05 | 0.7977 | N/A | N/A |
235
+ | 42000 | 0.48 | 4.2006e-05 | 0.7937 | N/A | N/A |
236
+ | 42500 | 0.485 | 4.1911e-05 | 0.8428 | N/A | N/A |
237
+ | 43000 | 0.491 | 4.1816e-05 | 0.8098 | N/A | N/A |
238
+ | 43500 | 0.497 | 4.1721e-05 | 0.8144 | N/A | N/A |
239
+ | 44000 | 0.502 | 4.1626e-05 | 0.8079 | N/A | N/A |
240
+ | 44500 | 0.508 | 4.1531e-05 | 0.8154 | N/A | N/A |
241
+ | 45000 | 0.514 | 4.1435e-05 | 0.8292 | N/A | N/A |
242
+ | 45500 | 0.52 | 4.1340e-05 | 0.7955 | N/A | N/A |
243
+ | 46000 | 0.525 | 4.1245e-05 | 0.7873 | N/A | N/A |
244
+ | 46500 | 0.531 | 4.1150e-05 | 0.7844 | N/A | N/A |
245
+ | 47000 | 0.537 | 4.1055e-05 | 0.7829 | N/A | N/A |
246
+ | 47500 | 0.542 | 4.0960e-05 | 0.814 | N/A | N/A |
247
+ | 48000 | 0.548 | 4.0864e-05 | 0.823 | N/A | N/A |
248
+ | 48500 | 0.554 | 4.0769e-05 | 0.8049 | N/A | N/A |
249
+ | 49000 | 0.56 | 4.0674e-05 | 0.7987 | N/A | N/A |
250
+ | 49500 | 0.565 | 4.0579e-05 | 0.7752 | N/A | N/A |
251
+ | 50000 | 0.571 | 4.0484e-05 | 0.813 | N/A | N/A |
252
+ | 50500 | 0.577 | 4.0389e-05 | 0.8187 | N/A | N/A |
253
+ | 51000 | 0.582 | 4.0293e-05 | 0.8087 | N/A | N/A |
254
+ | 51500 | 0.588 | 4.0198e-05 | 0.8138 | N/A | N/A |
255
+ | 52000 | 0.594 | 4.0103e-05 | 0.7928 | N/A | N/A |
256
+ | 52500 | 0.6 | 4.0008e-05 | 0.794 | N/A | N/A |
257
+ | 53000 | 0.605 | 3.9913e-05 | 0.819 | N/A | N/A |
258
+ | 53500 | 0.611 | 3.9818e-05 | 0.7804 | N/A | N/A |
259
+ | 54000 | 0.617 | 3.9722e-05 | 0.8267 | N/A | N/A |
260
+ | 54500 | 0.622 | 3.9627e-05 | 0.8193 | N/A | N/A |
261
+ | 55000 | 0.628 | 3.9532e-05 | 0.8122 | N/A | N/A |
262
+ | 55500 | 0.634 | 3.9437e-05 | 0.7854 | N/A | N/A |
263
+ | 56000 | 0.64 | 3.9342e-05 | 0.7966 | N/A | N/A |
264
+ | 56500 | 0.645 | 3.9247e-05 | 0.7814 | N/A | N/A |
265
+ | 57000 | 0.651 | 3.9151e-05 | 0.789 | N/A | N/A |
266
+ | 57500 | 0.657 | 3.9056e-05 | 0.7847 | N/A | N/A |
267
+ | 58000 | 0.662 | 3.8961e-05 | 0.7974 | N/A | N/A |
268
+ | 58500 | 0.668 | 3.8866e-05 | 0.7799 | N/A | N/A |
269
+ | 59000 | 0.674 | 3.8771e-05 | 0.8121 | N/A | N/A |
270
+ | 59500 | 0.679 | 3.8676e-05 | 0.7623 | N/A | N/A |
271
+ | 60000 | 0.685 | 3.8580e-05 | 0.7822 | N/A | N/A |
272
+ | 60500 | 0.691 | 3.8485e-05 | 0.8195 | N/A | N/A |
273
+ | 61000 | 0.697 | 3.8390e-05 | 0.7913 | N/A | N/A |
274
+ | 61500 | 0.702 | 3.8295e-05 | 0.7926 | N/A | N/A |
275
+ | 62000 | 0.708 | 3.8200e-05 | 0.8098 | N/A | N/A |
276
+ | 62500 | 0.714 | 3.8105e-05 | 0.7863 | N/A | N/A |
277
+ | 63000 | 0.719 | 3.8010e-05 | 0.7441 | N/A | N/A |
278
+ | 63500 | 0.725 | 3.7914e-05 | 0.7828 | N/A | N/A |
279
+ | 64000 | 0.731 | 3.7819e-05 | 0.7994 | N/A | N/A |
280
+ | 64500 | 0.737 | 3.7724e-05 | 0.7636 | N/A | N/A |
281
+ | 65000 | 0.742 | 3.7629e-05 | 0.7768 | N/A | N/A |
282
+ | 65500 | 0.748 | 3.7534e-05 | 0.7668 | N/A | N/A |
283
+ | 66000 | 0.754 | 3.7439e-05 | 0.7687 | N/A | N/A |
284
+ | 66500 | 0.759 | 3.7343e-05 | 0.7926 | N/A | N/A |
285
+ | 67000 | 0.765 | 3.7248e-05 | 0.7738 | N/A | N/A |
286
+ | 67500 | 0.771 | 3.7153e-05 | 0.8065 | N/A | N/A |
287
+ | 68000 | 0.777 | 3.7058e-05 | 0.7875 | N/A | N/A |
288
+ | 68500 | 0.782 | 3.6963e-05 | 0.7764 | N/A | N/A |
289
+ | 69000 | 0.788 | 3.6868e-05 | 0.7859 | N/A | N/A |
290
+ | 69500 | 0.794 | 3.6772e-05 | 0.7931 | N/A | N/A |
291
+ | 70000 | 0.799 | 3.6677e-05 | 0.782 | N/A | N/A |
292
+ | 70500 | 0.805 | 3.6582e-05 | 0.7724 | N/A | N/A |
293
+ | 71000 | 0.811 | 3.6487e-05 | 0.7762 | N/A | N/A |
294
+ | 71500 | 0.817 | 3.6392e-05 | 0.7556 | N/A | N/A |
295
+ | 72000 | 0.822 | 3.6297e-05 | 0.7461 | N/A | N/A |
296
+ | 72500 | 0.828 | 3.6201e-05 | 0.7626 | N/A | N/A |
297
+ | 73000 | 0.834 | 3.6106e-05 | 0.7635 | N/A | N/A |
298
+ | 73500 | 0.839 | 3.6011e-05 | 0.7642 | N/A | N/A |
299
+ | 74000 | 0.845 | 3.5916e-05 | 0.7867 | N/A | N/A |
300
+ | 74500 | 0.851 | 3.5821e-05 | 0.7846 | N/A | N/A |
301
+ | 75000 | 0.856 | 3.5726e-05 | 0.78 | N/A | N/A |
302
+ | 75500 | 0.862 | 3.5630e-05 | 0.7641 | N/A | N/A |
303
+ | 76000 | 0.868 | 3.5535e-05 | 0.7566 | N/A | N/A |
304
+ | 76500 | 0.874 | 3.5440e-05 | 0.761 | N/A | N/A |
305
+ | 77000 | 0.879 | 3.5345e-05 | 0.7636 | N/A | N/A |
306
+ | 77500 | 0.885 | 3.5250e-05 | 0.7825 | N/A | N/A |
307
+ | 78000 | 0.891 | 3.5155e-05 | 0.7937 | N/A | N/A |
308
+ | 78500 | 0.896 | 3.5059e-05 | 0.762 | N/A | N/A |
309
+ | 79000 | 0.902 | 3.4964e-05 | 0.7663 | N/A | N/A |
310
+ | 79500 | 0.908 | 3.4869e-05 | 0.7361 | N/A | N/A |
311
+ | 80000 | 0.914 | 3.4774e-05 | 0.7795 | N/A | N/A |
312
+ | 80500 | 0.919 | 3.4679e-05 | 0.7127 | N/A | N/A |
313
+ | 81000 | 0.925 | 3.4584e-05 | 0.7826 | N/A | N/A |
314
+ | 81500 | 0.931 | 3.4488e-05 | 0.7546 | N/A | N/A |
315
+ | 82000 | 0.936 | 3.4393e-05 | 0.7815 | N/A | N/A |
316
+ | 82500 | 0.942 | 3.4298e-05 | 0.7852 | N/A | N/A |
317
+ | 83000 | 0.948 | 3.4203e-05 | 0.7558 | N/A | N/A |
318
+ | 83500 | 0.954 | 3.4108e-05 | 0.7699 | N/A | N/A |
319
+ | 84000 | 0.959 | 3.4013e-05 | 0.736 | N/A | N/A |
320
+ | 84500 | 0.965 | 3.3917e-05 | 0.7546 | N/A | N/A |
321
+ | 85000 | 0.971 | 3.3822e-05 | 0.7477 | N/A | N/A |
322
+ | 85500 | 0.976 | 3.3727e-05 | 0.7401 | N/A | N/A |
323
+ | 86000 | 0.982 | 3.3632e-05 | 0.7825 | N/A | N/A |
324
+ | 86500 | 0.988 | 3.3537e-05 | 0.7471 | N/A | N/A |
325
+ | 87000 | 0.994 | 3.3442e-05 | 0.7953 | N/A | N/A |
326
+ | 87500 | 0.999 | 3.3346e-05 | 0.7437 | N/A | N/A |
327
+ | 87568 | 1.0 | N/A | N/A | 0.722 | 0.7581 |
328
+ | 88000 | 1.005 | 3.3251e-05 | 0.659 | N/A | N/A |
329
+ | 88500 | 1.011 | 3.3156e-05 | 0.6486 | N/A | N/A |
330
+ | 89000 | 1.016 | 3.3061e-05 | 0.6383 | N/A | N/A |
331
+ | 89500 | 1.022 | 3.2966e-05 | 0.6392 | N/A | N/A |
332
+ | 90000 | 1.028 | 3.2871e-05 | 0.6435 | N/A | N/A |
333
+ | 90500 | 1.033 | 3.2775e-05 | 0.6805 | N/A | N/A |
334
+ | 91000 | 1.039 | 3.2680e-05 | 0.6469 | N/A | N/A |
335
+ | 91500 | 1.045 | 3.2585e-05 | 0.6631 | N/A | N/A |
336
+ | 92000 | 1.051 | 3.2490e-05 | 0.6404 | N/A | N/A |
337
+ | 92500 | 1.056 | 3.2395e-05 | 0.6524 | N/A | N/A |
338
+ | 93000 | 1.062 | 3.2300e-05 | 0.6435 | N/A | N/A |
339
+ | 93500 | 1.068 | 3.2204e-05 | 0.672 | N/A | N/A |
340
+ | 94000 | 1.073 | 3.2109e-05 | 0.6613 | N/A | N/A |
341
+ | 94500 | 1.079 | 3.2014e-05 | 0.6243 | N/A | N/A |
342
+ | 95000 | 1.085 | 3.1919e-05 | 0.6519 | N/A | N/A |
343
+ | 95500 | 1.091 | 3.1824e-05 | 0.6402 | N/A | N/A |
344
+ | 96000 | 1.096 | 3.1729e-05 | 0.6828 | N/A | N/A |
345
+ | 96500 | 1.102 | 3.1634e-05 | 0.6734 | N/A | N/A |
346
+ | 97000 | 1.108 | 3.1538e-05 | 0.6624 | N/A | N/A |
347
+ | 97500 | 1.113 | 3.1443e-05 | 0.6281 | N/A | N/A |
348
+ | 98000 | 1.119 | 3.1348e-05 | 0.6617 | N/A | N/A |
349
+ | 98500 | 1.125 | 3.1253e-05 | 0.6485 | N/A | N/A |
350
+ | 99000 | 1.131 | 3.1158e-05 | 0.6495 | N/A | N/A |
351
+ | 99500 | 1.136 | 3.1063e-05 | 0.6656 | N/A | N/A |
352
+ | 100000 | 1.142 | 3.0967e-05 | 0.6832 | N/A | N/A |
353
+ | 100500 | 1.148 | 3.0872e-05 | 0.6636 | N/A | N/A |
354
+ | 101000 | 1.153 | 3.0777e-05 | 0.6556 | N/A | N/A |
355
+ | 101500 | 1.159 | 3.0682e-05 | 0.648 | N/A | N/A |
356
+ | 102000 | 1.165 | 3.0587e-05 | 0.6398 | N/A | N/A |
357
+ | 102500 | 1.171 | 3.0492e-05 | 0.663 | N/A | N/A |
358
+ | 103000 | 1.176 | 3.0396e-05 | 0.6625 | N/A | N/A |
359
+ | 103500 | 1.182 | 3.0301e-05 | 0.6615 | N/A | N/A |
360
+ | 104000 | 1.188 | 3.0206e-05 | 0.6512 | N/A | N/A |
361
+ | 104500 | 1.193 | 3.0111e-05 | 0.663 | N/A | N/A |
362
+ | 105000 | 1.199 | 3.0016e-05 | 0.6651 | N/A | N/A |
363
+ | 105500 | 1.205 | 2.9921e-05 | 0.6601 | N/A | N/A |
364
+ | 106000 | 1.21 | 2.9825e-05 | 0.6512 | N/A | N/A |
365
+ | 106500 | 1.216 | 2.9730e-05 | 0.6577 | N/A | N/A |
366
+ | 107000 | 1.222 | 2.9635e-05 | 0.6278 | N/A | N/A |
367
+ | 107500 | 1.228 | 2.9540e-05 | 0.6594 | N/A | N/A |
368
+ | 108000 | 1.233 | 2.9445e-05 | 0.6825 | N/A | N/A |
369
+ | 108500 | 1.239 | 2.9350e-05 | 0.6594 | N/A | N/A |
370
+ | 109000 | 1.245 | 2.9254e-05 | 0.6717 | N/A | N/A |
371
+ | 109500 | 1.25 | 2.9159e-05 | 0.6645 | N/A | N/A |
372
+ | 110000 | 1.256 | 2.9064e-05 | 0.6347 | N/A | N/A |
373
+ | 110500 | 1.262 | 2.8969e-05 | 0.6409 | N/A | N/A |
374
+ | 111000 | 1.268 | 2.8874e-05 | 0.6612 | N/A | N/A |
375
+ | 111500 | 1.273 | 2.8779e-05 | 0.6824 | N/A | N/A |
376
+ | 112000 | 1.279 | 2.8683e-05 | 0.6656 | N/A | N/A |
377
+ | 112500 | 1.285 | 2.8588e-05 | 0.634 | N/A | N/A |
378
+ | 113000 | 1.29 | 2.8493e-05 | 0.6445 | N/A | N/A |
379
+ | 113500 | 1.296 | 2.8398e-05 | 0.6339 | N/A | N/A |
380
+ | 114000 | 1.302 | 2.8303e-05 | 0.6437 | N/A | N/A |
381
+ | 114500 | 1.308 | 2.8208e-05 | 0.6335 | N/A | N/A |
382
+ | 115000 | 1.313 | 2.8112e-05 | 0.6377 | N/A | N/A |
383
+ | 115500 | 1.319 | 2.8017e-05 | 0.6234 | N/A | N/A |
384
+ | 116000 | 1.325 | 2.7922e-05 | 0.6359 | N/A | N/A |
385
+ | 116500 | 1.33 | 2.7827e-05 | 0.6504 | N/A | N/A |
386
+ | 117000 | 1.336 | 2.7732e-05 | 0.6286 | N/A | N/A |
387
+ | 117500 | 1.342 | 2.7637e-05 | 0.6481 | N/A | N/A |
388
+ | 118000 | 1.348 | 2.7541e-05 | 0.6516 | N/A | N/A |
389
+ | 118500 | 1.353 | 2.7446e-05 | 0.6493 | N/A | N/A |
390
+ | 119000 | 1.359 | 2.7351e-05 | 0.634 | N/A | N/A |
391
+ | 119500 | 1.365 | 2.7256e-05 | 0.6497 | N/A | N/A |
392
+ | 120000 | 1.37 | 2.7161e-05 | 0.627 | N/A | N/A |
393
+ | 120500 | 1.376 | 2.7066e-05 | 0.6659 | N/A | N/A |
394
+ | 121000 | 1.382 | 2.6970e-05 | 0.6184 | N/A | N/A |
395
+ | 121500 | 1.387 | 2.6875e-05 | 0.6332 | N/A | N/A |
396
+ | 122000 | 1.393 | 2.6780e-05 | 0.6281 | N/A | N/A |
397
+ | 122500 | 1.399 | 2.6685e-05 | 0.6542 | N/A | N/A |
398
+ | 123000 | 1.405 | 2.6590e-05 | 0.6455 | N/A | N/A |
399
+ | 123500 | 1.41 | 2.6495e-05 | 0.6248 | N/A | N/A |
400
+ | 124000 | 1.416 | 2.6399e-05 | 0.6468 | N/A | N/A |
401
+ | 124500 | 1.422 | 2.6304e-05 | 0.6635 | N/A | N/A |
402
+ | 125000 | 1.427 | 2.6209e-05 | 0.6441 | N/A | N/A |
403
+ | 125500 | 1.433 | 2.6114e-05 | 0.6369 | N/A | N/A |
404
+ | 126000 | 1.439 | 2.6019e-05 | 0.6569 | N/A | N/A |
405
+ | 126500 | 1.445 | 2.5924e-05 | 0.6708 | N/A | N/A |
406
+ | 127000 | 1.45 | 2.5828e-05 | 0.6348 | N/A | N/A |
407
+ | 127500 | 1.456 | 2.5733e-05 | 0.6337 | N/A | N/A |
408
+ | 128000 | 1.462 | 2.5638e-05 | 0.6317 | N/A | N/A |
409
+ | 128500 | 1.467 | 2.5543e-05 | 0.6391 | N/A | N/A |
410
+ | 129000 | 1.473 | 2.5448e-05 | 0.6351 | N/A | N/A |
411
+ | 129500 | 1.479 | 2.5353e-05 | 0.6481 | N/A | N/A |
412
+ | 130000 | 1.485 | 2.5258e-05 | 0.6466 | N/A | N/A |
413
+ | 130500 | 1.49 | 2.5162e-05 | 0.64 | N/A | N/A |
414
+ | 131000 | 1.496 | 2.5067e-05 | 0.611 | N/A | N/A |
415
+ | 131500 | 1.502 | 2.4972e-05 | 0.6497 | N/A | N/A |
416
+ | 132000 | 1.507 | 2.4877e-05 | 0.6564 | N/A | N/A |
417
+ | 132500 | 1.513 | 2.4782e-05 | 0.6225 | N/A | N/A |
418
+ | 133000 | 1.519 | 2.4687e-05 | 0.6661 | N/A | N/A |
419
+ | 133500 | 1.525 | 2.4591e-05 | 0.6548 | N/A | N/A |
420
+ | 134000 | 1.53 | 2.4496e-05 | 0.6521 | N/A | N/A |
421
+ | 134500 | 1.536 | 2.4401e-05 | 0.6498 | N/A | N/A |
422
+ | 135000 | 1.542 | 2.4306e-05 | 0.6381 | N/A | N/A |
423
+ | 135500 | 1.547 | 2.4211e-05 | 0.6415 | N/A | N/A |
424
+ | 136000 | 1.553 | 2.4116e-05 | 0.6379 | N/A | N/A |
425
+ | 136500 | 1.559 | 2.4020e-05 | 0.6393 | N/A | N/A |
426
+ | 137000 | 1.564 | 2.3925e-05 | 0.6446 | N/A | N/A |
427
+ | 137500 | 1.57 | 2.3830e-05 | 0.671 | N/A | N/A |
428
+ | 138000 | 1.576 | 2.3735e-05 | 0.6055 | N/A | N/A |
429
+ | 138500 | 1.582 | 2.3640e-05 | 0.6551 | N/A | N/A |
430
+ | 139000 | 1.587 | 2.3545e-05 | 0.6315 | N/A | N/A |
431
+ | 139500 | 1.593 | 2.3449e-05 | 0.6614 | N/A | N/A |
432
+ | 140000 | 1.599 | 2.3354e-05 | 0.6866 | N/A | N/A |
433
+ | 140500 | 1.604 | 2.3259e-05 | 0.6231 | N/A | N/A |
434
+ | 141000 | 1.61 | 2.3164e-05 | 0.623 | N/A | N/A |
435
+ | 141500 | 1.616 | 2.3069e-05 | 0.6352 | N/A | N/A |
436
+ | 142000 | 1.622 | 2.2974e-05 | 0.6648 | N/A | N/A |
437
+ | 142500 | 1.627 | 2.2878e-05 | 0.6145 | N/A | N/A |
438
+ | 143000 | 1.633 | 2.2783e-05 | 0.6563 | N/A | N/A |
439
+ | 143500 | 1.639 | 2.2688e-05 | 0.6508 | N/A | N/A |
440
+ | 144000 | 1.644 | 2.2593e-05 | 0.6351 | N/A | N/A |
441
+ | 144500 | 1.65 | 2.2498e-05 | 0.6427 | N/A | N/A |
442
+ | 145000 | 1.656 | 2.2403e-05 | 0.6498 | N/A | N/A |
443
+ | 145500 | 1.662 | 2.2307e-05 | 0.606 | N/A | N/A |
444
+ | 146000 | 1.667 | 2.2212e-05 | 0.6561 | N/A | N/A |
445
+ | 146500 | 1.673 | 2.2117e-05 | 0.6608 | N/A | N/A |
446
+ | 147000 | 1.679 | 2.2022e-05 | 0.6519 | N/A | N/A |
447
+ | 147500 | 1.684 | 2.1927e-05 | 0.6234 | N/A | N/A |
448
+ | 148000 | 1.69 | 2.1832e-05 | 0.6215 | N/A | N/A |
449
+ | 148500 | 1.696 | 2.1736e-05 | 0.6312 | N/A | N/A |
450
+ | 149000 | 1.702 | 2.1641e-05 | 0.6238 | N/A | N/A |
451
+ | 149500 | 1.707 | 2.1546e-05 | 0.6492 | N/A | N/A |
452
+ | 150000 | 1.713 | 2.1451e-05 | 0.6585 | N/A | N/A |
453
+ | 150500 | 1.719 | 2.1356e-05 | 0.649 | N/A | N/A |
454
+ | 151000 | 1.724 | 2.1261e-05 | 0.6313 | N/A | N/A |
455
+ | 151500 | 1.73 | 2.1165e-05 | 0.6383 | N/A | N/A |
456
+ | 152000 | 1.736 | 2.1070e-05 | 0.6315 | N/A | N/A |
457
+ | 152500 | 1.742 | 2.0975e-05 | 0.6738 | N/A | N/A |
458
+ | 153000 | 1.747 | 2.0880e-05 | 0.643 | N/A | N/A |
459
+ | 153500 | 1.753 | 2.0785e-05 | 0.602 | N/A | N/A |
460
+ | 154000 | 1.759 | 2.0690e-05 | 0.6264 | N/A | N/A |
461
+ | 154500 | 1.764 | 2.0594e-05 | 0.6519 | N/A | N/A |
462
+ | 155000 | 1.77 | 2.0499e-05 | 0.6283 | N/A | N/A |
463
+ | 155500 | 1.776 | 2.0404e-05 | 0.6311 | N/A | N/A |
464
+ | 156000 | 1.781 | 2.0309e-05 | 0.5985 | N/A | N/A |
465
+ | 156500 | 1.787 | 2.0214e-05 | 0.6448 | N/A | N/A |
466
+ | 157000 | 1.793 | 2.0119e-05 | 0.6223 | N/A | N/A |
467
+ | 157500 | 1.799 | 2.0023e-05 | 0.63 | N/A | N/A |
468
+ | 158000 | 1.804 | 1.9928e-05 | 0.6233 | N/A | N/A |
469
+ | 158500 | 1.81 | 1.9833e-05 | 0.6232 | N/A | N/A |
470
+ | 159000 | 1.816 | 1.9738e-05 | 0.5908 | N/A | N/A |
471
+ | 159500 | 1.821 | 1.9643e-05 | 0.6251 | N/A | N/A |
472
+ | 160000 | 1.827 | 1.9548e-05 | 0.6112 | N/A | N/A |
473
+ | 160500 | 1.833 | 1.9453e-05 | 0.5847 | N/A | N/A |
474
+ | 161000 | 1.839 | 1.9357e-05 | 0.637 | N/A | N/A |
475
+ | 161500 | 1.844 | 1.9262e-05 | 0.6167 | N/A | N/A |
476
+ | 162000 | 1.85 | 1.9167e-05 | 0.6244 | N/A | N/A |
477
+ | 162500 | 1.856 | 1.9072e-05 | 0.642 | N/A | N/A |
478
+ | 163000 | 1.861 | 1.8977e-05 | 0.6376 | N/A | N/A |
479
+ | 163500 | 1.867 | 1.8882e-05 | 0.6274 | N/A | N/A |
480
+ | 164000 | 1.873 | 1.8786e-05 | 0.6179 | N/A | N/A |
481
+ | 164500 | 1.879 | 1.8691e-05 | 0.6112 | N/A | N/A |
482
+ | 165000 | 1.884 | 1.8596e-05 | 0.6363 | N/A | N/A |
483
+ | 165500 | 1.89 | 1.8501e-05 | 0.6505 | N/A | N/A |
484
+ | 166000 | 1.896 | 1.8406e-05 | 0.5786 | N/A | N/A |
485
+ | 166500 | 1.901 | 1.8311e-05 | 0.6278 | N/A | N/A |
486
+ | 167000 | 1.907 | 1.8215e-05 | 0.6252 | N/A | N/A |
487
+ | 167500 | 1.913 | 1.8120e-05 | 0.6246 | N/A | N/A |
488
+ | 168000 | 1.919 | 1.8025e-05 | 0.5948 | N/A | N/A |
489
+ | 168500 | 1.924 | 1.7930e-05 | 0.6307 | N/A | N/A |
490
+ | 169000 | 1.93 | 1.7835e-05 | 0.6297 | N/A | N/A |
491
+ | 169500 | 1.936 | 1.7740e-05 | 0.5957 | N/A | N/A |
492
+ | 170000 | 1.941 | 1.7644e-05 | 0.6069 | N/A | N/A |
493
+ | 170500 | 1.947 | 1.7549e-05 | 0.6206 | N/A | N/A |
494
+ | 171000 | 1.953 | 1.7454e-05 | 0.6349 | N/A | N/A |
495
+ | 171500 | 1.958 | 1.7359e-05 | 0.6087 | N/A | N/A |
496
+ | 172000 | 1.964 | 1.7264e-05 | 0.6057 | N/A | N/A |
497
+ | 172500 | 1.97 | 1.7169e-05 | 0.6345 | N/A | N/A |
498
+ | 173000 | 1.976 | 1.7073e-05 | 0.6136 | N/A | N/A |
499
+ | 173500 | 1.981 | 1.6978e-05 | 0.6153 | N/A | N/A |
500
+ | 174000 | 1.987 | 1.6883e-05 | 0.618 | N/A | N/A |
501
+ | 174500 | 1.993 | 1.6788e-05 | 0.5829 | N/A | N/A |
502
+ | 175000 | 1.998 | 1.6693e-05 | 0.6237 | N/A | N/A |
503
+ | 175136 | 2.0 | N/A | N/A | 0.7202 | 0.7665 |
504
+ | 175500 | 2.004 | 1.6598e-05 | 0.5356 | N/A | N/A |
505
+ | 176000 | 2.01 | 1.6502e-05 | 0.4917 | N/A | N/A |
506
+ | 176500 | 2.016 | 1.6407e-05 | 0.4878 | N/A | N/A |
507
+ | 177000 | 2.021 | 1.6312e-05 | 0.5695 | N/A | N/A |
508
+ | 177500 | 2.027 | 1.6217e-05 | 0.487 | N/A | N/A |
509
+ | 178000 | 2.033 | 1.6122e-05 | 0.5238 | N/A | N/A |
510
+ | 178500 | 2.038 | 1.6027e-05 | 0.5138 | N/A | N/A |
511
+ | 179000 | 2.044 | 1.5931e-05 | 0.4774 | N/A | N/A |
512
+ | 179500 | 2.05 | 1.5836e-05 | 0.5282 | N/A | N/A |
513
+ | 180000 | 2.056 | 1.5741e-05 | 0.5048 | N/A | N/A |
514
+ | 180500 | 2.061 | 1.5646e-05 | 0.5413 | N/A | N/A |
515
+ | 181000 | 2.067 | 1.5551e-05 | 0.5132 | N/A | N/A |
516
+ | 181500 | 2.073 | 1.5456e-05 | 0.4966 | N/A | N/A |
517
+ | 182000 | 2.078 | 1.5360e-05 | 0.4817 | N/A | N/A |
518
+ | 182500 | 2.084 | 1.5265e-05 | 0.5095 | N/A | N/A |
519
+ | 183000 | 2.09 | 1.5170e-05 | 0.5062 | N/A | N/A |
520
+ | 183500 | 2.096 | 1.5075e-05 | 0.516 | N/A | N/A |
521
+ | 184000 | 2.101 | 1.4980e-05 | 0.5008 | N/A | N/A |
522
+ | 184500 | 2.107 | 1.4885e-05 | 0.4807 | N/A | N/A |
523
+ | 185000 | 2.113 | 1.4789e-05 | 0.4864 | N/A | N/A |
524
+ | 185500 | 2.118 | 1.4694e-05 | 0.5285 | N/A | N/A |
525
+ | 186000 | 2.124 | 1.4599e-05 | 0.5184 | N/A | N/A |
526
+ | 186500 | 2.13 | 1.4504e-05 | 0.4782 | N/A | N/A |
527
+ | 187000 | 2.135 | 1.4409e-05 | 0.531 | N/A | N/A |
528
+ | 187500 | 2.141 | 1.4314e-05 | 0.4952 | N/A | N/A |
529
+ | 188000 | 2.147 | 1.4218e-05 | 0.5107 | N/A | N/A |
530
+ | 188500 | 2.153 | 1.4123e-05 | 0.504 | N/A | N/A |
531
+ | 189000 | 2.158 | 1.4028e-05 | 0.5031 | N/A | N/A |
532
+ | 189500 | 2.164 | 1.3933e-05 | 0.4969 | N/A | N/A |
533
+ | 190000 | 2.17 | 1.3838e-05 | 0.5095 | N/A | N/A |
534
+ | 190500 | 2.175 | 1.3743e-05 | 0.487 | N/A | N/A |
535
+ | 191000 | 2.181 | 1.3647e-05 | 0.4987 | N/A | N/A |
536
+ | 191500 | 2.187 | 1.3552e-05 | 0.5399 | N/A | N/A |
537
+ | 192000 | 2.193 | 1.3457e-05 | 0.5181 | N/A | N/A |
538
+ | 192500 | 2.198 | 1.3362e-05 | 0.5188 | N/A | N/A |
539
+ | 193000 | 2.204 | 1.3267e-05 | 0.4914 | N/A | N/A |
540
+ | 193500 | 2.21 | 1.3172e-05 | 0.4977 | N/A | N/A |
541
+ | 194000 | 2.215 | 1.3077e-05 | 0.5281 | N/A | N/A |
542
+ | 194500 | 2.221 | 1.2981e-05 | 0.5216 | N/A | N/A |
543
+ | 195000 | 2.227 | 1.2886e-05 | 0.5007 | N/A | N/A |
544
+ | 195500 | 2.233 | 1.2791e-05 | 0.5345 | N/A | N/A |
545
+ | 196000 | 2.238 | 1.2696e-05 | 0.5089 | N/A | N/A |
546
+ | 196500 | 2.244 | 1.2601e-05 | 0.5231 | N/A | N/A |
547
+ | 197000 | 2.25 | 1.2506e-05 | 0.4953 | N/A | N/A |
548
+ | 197500 | 2.255 | 1.2410e-05 | 0.4989 | N/A | N/A |
549
+ | 198000 | 2.261 | 1.2315e-05 | 0.4903 | N/A | N/A |
550
+ | 198500 | 2.267 | 1.2220e-05 | 0.5088 | N/A | N/A |
551
+ | 199000 | 2.273 | 1.2125e-05 | 0.4875 | N/A | N/A |
552
+ | 199500 | 2.278 | 1.2030e-05 | 0.5118 | N/A | N/A |
553
+ | 200000 | 2.284 | 1.1935e-05 | 0.5184 | N/A | N/A |
554
+ | 200500 | 2.29 | 1.1839e-05 | 0.4807 | N/A | N/A |
555
+ | 201000 | 2.295 | 1.1744e-05 | 0.5112 | N/A | N/A |
556
+ | 201500 | 2.301 | 1.1649e-05 | 0.5064 | N/A | N/A |
557
+ | 202000 | 2.307 | 1.1554e-05 | 0.5246 | N/A | N/A |
558
+ | 202500 | 2.312 | 1.1459e-05 | 0.496 | N/A | N/A |
559
+ | 203000 | 2.318 | 1.1364e-05 | 0.5101 | N/A | N/A |
560
+ | 203500 | 2.324 | 1.1268e-05 | 0.5184 | N/A | N/A |
561
+ | 204000 | 2.33 | 1.1173e-05 | 0.5134 | N/A | N/A |
562
+ | 204500 | 2.335 | 1.1078e-05 | 0.4875 | N/A | N/A |
563
+ | 205000 | 2.341 | 1.0983e-05 | 0.4975 | N/A | N/A |
564
+ | 205500 | 2.347 | 1.0888e-05 | 0.5156 | N/A | N/A |
565
+ | 206000 | 2.352 | 1.0793e-05 | 0.4994 | N/A | N/A |
566
+ | 206500 | 2.358 | 1.0697e-05 | 0.5309 | N/A | N/A |
567
+ | 207000 | 2.364 | 1.0602e-05 | 0.4896 | N/A | N/A |
568
+ | 207500 | 2.37 | 1.0507e-05 | 0.5013 | N/A | N/A |
569
+ | 208000 | 2.375 | 1.0412e-05 | 0.4921 | N/A | N/A |
570
+ | 208500 | 2.381 | 1.0317e-05 | 0.5007 | N/A | N/A |
571
+ | 209000 | 2.387 | 1.0222e-05 | 0.4899 | N/A | N/A |
572
+ | 209500 | 2.392 | 1.0126e-05 | 0.4943 | N/A | N/A |
573
+ | 210000 | 2.398 | 1.0031e-05 | 0.5005 | N/A | N/A |
574
+ | 210500 | 2.404 | 9.9361e-06 | 0.4829 | N/A | N/A |
575
+ | 211000 | 2.41 | 9.8409e-06 | 0.518 | N/A | N/A |
576
+ | 211500 | 2.415 | 9.7458e-06 | 0.488 | N/A | N/A |
577
+ | 212000 | 2.421 | 9.6506e-06 | 0.5206 | N/A | N/A |
578
+ | 212500 | 2.427 | 9.5554e-06 | 0.5191 | N/A | N/A |
579
+ | 213000 | 2.432 | 9.4603e-06 | 0.5082 | N/A | N/A |
580
+ | 213500 | 2.438 | 9.3651e-06 | 0.4815 | N/A | N/A |
581
+ | 214000 | 2.444 | 9.2699e-06 | 0.4982 | N/A | N/A |
582
+ | 214500 | 2.45 | 9.1748e-06 | 0.5104 | N/A | N/A |
583
+ | 215000 | 2.455 | 9.0796e-06 | 0.5283 | N/A | N/A |
584
+ | 215500 | 2.461 | 8.9844e-06 | 0.5583 | N/A | N/A |
585
+ | 216000 | 2.467 | 8.8893e-06 | 0.4807 | N/A | N/A |
586
+ | 216500 | 2.472 | 8.7941e-06 | 0.4798 | N/A | N/A |
587
+ | 217000 | 2.478 | 8.6990e-06 | 0.5315 | N/A | N/A |
588
+ | 217500 | 2.484 | 8.6038e-06 | 0.4787 | N/A | N/A |
589
+ | 218000 | 2.489 | 8.5086e-06 | 0.4636 | N/A | N/A |
590
+ | 218500 | 2.495 | 8.4135e-06 | 0.4542 | N/A | N/A |
591
+ | 219000 | 2.501 | 8.3183e-06 | 0.5046 | N/A | N/A |
592
+ | 219500 | 2.507 | 8.2231e-06 | 0.4901 | N/A | N/A |
593
+ | 220000 | 2.512 | 8.1280e-06 | 0.5143 | N/A | N/A |
594
+ | 220500 | 2.518 | 8.0328e-06 | 0.5058 | N/A | N/A |
595
+ | 221000 | 2.524 | 7.9376e-06 | 0.5047 | N/A | N/A |
596
+ | 221500 | 2.529 | 7.8425e-06 | 0.4844 | N/A | N/A |
597
+ | 222000 | 2.535 | 7.7473e-06 | 0.5217 | N/A | N/A |
598
+ | 222500 | 2.541 | 7.6521e-06 | 0.4538 | N/A | N/A |
599
+ | 223000 | 2.547 | 7.5570e-06 | 0.5075 | N/A | N/A |
600
+ | 223500 | 2.552 | 7.4618e-06 | 0.4616 | N/A | N/A |
601
+ | 224000 | 2.558 | 7.3667e-06 | 0.4933 | N/A | N/A |
602
+ | 224500 | 2.564 | 7.2715e-06 | 0.5003 | N/A | N/A |
603
+ | 225000 | 2.569 | 7.1763e-06 | 0.4879 | N/A | N/A |
604
+ | 225500 | 2.575 | 7.0812e-06 | 0.4931 | N/A | N/A |
605
+ | 226000 | 2.581 | 6.9860e-06 | 0.5156 | N/A | N/A |
606
+ | 226500 | 2.587 | 6.8908e-06 | 0.5031 | N/A | N/A |
607
+ | 227000 | 2.592 | 6.7957e-06 | 0.4983 | N/A | N/A |
608
+ | 227500 | 2.598 | 6.7005e-06 | 0.4943 | N/A | N/A |
609
+ | 228000 | 2.604 | 6.6053e-06 | 0.4487 | N/A | N/A |
610
+ | 228500 | 2.609 | 6.5102e-06 | 0.4816 | N/A | N/A |
611
+ | 229000 | 2.615 | 6.4150e-06 | 0.5101 | N/A | N/A |
612
+ | 229500 | 2.621 | 6.3199e-06 | 0.4756 | N/A | N/A |
613
+ | 230000 | 2.627 | 6.2247e-06 | 0.4904 | N/A | N/A |
614
+ | 230500 | 2.632 | 6.1295e-06 | 0.4607 | N/A | N/A |
615
+ | 231000 | 2.638 | 6.0344e-06 | 0.4957 | N/A | N/A |
616
+ | 231500 | 2.644 | 5.9392e-06 | 0.478 | N/A | N/A |
617
+ | 232000 | 2.649 | 5.8440e-06 | 0.5147 | N/A | N/A |
618
+ | 232500 | 2.655 | 5.7489e-06 | 0.4972 | N/A | N/A |
619
+ | 233000 | 2.661 | 5.6537e-06 | 0.4959 | N/A | N/A |
620
+ | 233500 | 2.666 | 5.5585e-06 | 0.4734 | N/A | N/A |
621
+ | 234000 | 2.672 | 5.4634e-06 | 0.5072 | N/A | N/A |
622
+ | 234500 | 2.678 | 5.3682e-06 | 0.5031 | N/A | N/A |
623
+ | 235000 | 2.684 | 5.2730e-06 | 0.4865 | N/A | N/A |
624
+ | 235500 | 2.689 | 5.1779e-06 | 0.4752 | N/A | N/A |
625
+ | 236000 | 2.695 | 5.0827e-06 | 0.492 | N/A | N/A |
626
+ | 236500 | 2.701 | 4.9876e-06 | 0.4619 | N/A | N/A |
627
+ | 237000 | 2.706 | 4.8924e-06 | 0.4456 | N/A | N/A |
628
+ | 237500 | 2.712 | 4.7972e-06 | 0.4891 | N/A | N/A |
629
+ | 238000 | 2.718 | 4.7021e-06 | 0.467 | N/A | N/A |
630
+ | 238500 | 2.724 | 4.6069e-06 | 0.4767 | N/A | N/A |
631
+ | 239000 | 2.729 | 4.5117e-06 | 0.4795 | N/A | N/A |
632
+ | 239500 | 2.735 | 4.4166e-06 | 0.4836 | N/A | N/A |
633
+ | 240000 | 2.741 | 4.3214e-06 | 0.5013 | N/A | N/A |
634
+ | 240500 | 2.746 | 4.2262e-06 | 0.4696 | N/A | N/A |
635
+ | 241000 | 2.752 | 4.1311e-06 | 0.4954 | N/A | N/A |
636
+ | 241500 | 2.758 | 4.0359e-06 | 0.4884 | N/A | N/A |
637
+ | 242000 | 2.764 | 3.9407e-06 | 0.4777 | N/A | N/A |
638
+ | 242500 | 2.769 | 3.8456e-06 | 0.4897 | N/A | N/A |
639
+ | 243000 | 2.775 | 3.7504e-06 | 0.4867 | N/A | N/A |
640
+ | 243500 | 2.781 | 3.6553e-06 | 0.4891 | N/A | N/A |
641
+ | 244000 | 2.786 | 3.5601e-06 | 0.4855 | N/A | N/A |
642
+ | 244500 | 2.792 | 3.4649e-06 | 0.4863 | N/A | N/A |
643
+ | 245000 | 2.798 | 3.3698e-06 | 0.4832 | N/A | N/A |
644
+ | 245500 | 2.804 | 3.2746e-06 | 0.4976 | N/A | N/A |
645
+ | 246000 | 2.809 | 3.1794e-06 | 0.4946 | N/A | N/A |
646
+ | 246500 | 2.815 | 3.0843e-06 | 0.4699 | N/A | N/A |
647
+ | 247000 | 2.821 | 2.9891e-06 | 0.4818 | N/A | N/A |
648
+ | 247500 | 2.826 | 2.8939e-06 | 0.4643 | N/A | N/A |
649
+ | 248000 | 2.832 | 2.7988e-06 | 0.4848 | N/A | N/A |
650
+ | 248500 | 2.838 | 2.7036e-06 | 0.4887 | N/A | N/A |
651
+ | 249000 | 2.844 | 2.6084e-06 | 0.4957 | N/A | N/A |
652
+ | 249500 | 2.849 | 2.5133e-06 | 0.4544 | N/A | N/A |
653
+ | 250000 | 2.855 | 2.4181e-06 | 0.4918 | N/A | N/A |
654
+ | 250500 | 2.861 | 2.3230e-06 | 0.4396 | N/A | N/A |
655
+ | 251000 | 2.866 | 2.2278e-06 | 0.4775 | N/A | N/A |
656
+ | 251500 | 2.872 | 2.1326e-06 | 0.5189 | N/A | N/A |
657
+ | 252000 | 2.878 | 2.0375e-06 | 0.5059 | N/A | N/A |
658
+ | 252500 | 2.883 | 1.9423e-06 | 0.4876 | N/A | N/A |
659
+ | 253000 | 2.889 | 1.8471e-06 | 0.4754 | N/A | N/A |
660
+ | 253500 | 2.895 | 1.7520e-06 | 0.5116 | N/A | N/A |
661
+ | 254000 | 2.901 | 1.6568e-06 | 0.4644 | N/A | N/A |
662
+ | 254500 | 2.906 | 1.5616e-06 | 0.4642 | N/A | N/A |
663
+ | 255000 | 2.912 | 1.4665e-06 | 0.4747 | N/A | N/A |
664
+ | 255500 | 2.918 | 1.3713e-06 | 0.4719 | N/A | N/A |
665
+ | 256000 | 2.923 | 1.2762e-06 | 0.4858 | N/A | N/A |
666
+ | 256500 | 2.929 | 1.1810e-06 | 0.4804 | N/A | N/A |
667
+ | 257000 | 2.935 | 1.0858e-06 | 0.4858 | N/A | N/A |
668
+ | 257500 | 2.941 | 9.9066e-07 | 0.4857 | N/A | N/A |
669
+ | 258000 | 2.946 | 8.9549e-07 | 0.4913 | N/A | N/A |
670
+ | 258500 | 2.952 | 8.0033e-07 | 0.4589 | N/A | N/A |
671
+ | 259000 | 2.958 | 7.0517e-07 | 0.5143 | N/A | N/A |
672
+ | 259500 | 2.963 | 6.1000e-07 | 0.484 | N/A | N/A |
673
+ | 260000 | 2.969 | 5.1484e-07 | 0.5094 | N/A | N/A |
674
+ | 260500 | 2.975 | 4.1967e-07 | 0.4875 | N/A | N/A |
675
+ | 261000 | 2.981 | 3.2451e-07 | 0.4676 | N/A | N/A |
676
+ | 261500 | 2.986 | 2.2935e-07 | 0.4857 | N/A | N/A |
677
+ | 262000 | 2.992 | 1.3418e-07 | 0.4703 | N/A | N/A |
678
+ | 262500 | 2.998 | 3.9017e-08 | 0.4785 | N/A | N/A |
679
+ | 262704 | 3.0 | N/A | N/A | 0.7511 | 0.7784 |
680
+
681
+ </details>
682
+
683
+
684
+ ## Framework Versions
685
+
686
+ - **Transformers:** 5.0.0.dev0
687
+ - **PyTorch:** 2.6.0+cu124
all_results.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_f1": 0.7783590324391549,
4
+ "eval_loss": 0.7510631680488586,
5
+ "eval_runtime": 49.7968,
6
+ "eval_samples": 87572,
7
+ "eval_samples_per_second": 1758.588,
8
+ "eval_steps_per_second": 219.834,
9
+ "total_flos": 3.462425297543117e+16,
10
+ "train_loss": 0.6613248294712064,
11
+ "train_runtime": 4513.963,
12
+ "train_samples": 700542,
13
+ "train_samples_per_second": 465.583,
14
+ "train_steps_per_second": 58.198
15
+ }
config.json ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertForSequenceClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "dtype": "float32",
8
+ "finetuning_task": "text-classification",
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 384,
12
+ "id2label": {
13
+ "0": "About (Org.)",
14
+ "1": "About (Personal)",
15
+ "2": "Academic Writing",
16
+ "3": "Audio Transcript",
17
+ "4": "Comment Section",
18
+ "5": "Content Listing",
19
+ "6": "Creative Writing",
20
+ "7": "Customer Support",
21
+ "8": "Documentation",
22
+ "9": "FAQ",
23
+ "10": "Knowledge Article",
24
+ "11": "Legal Notices",
25
+ "12": "Listicle",
26
+ "13": "News (Org.)",
27
+ "14": "News Article",
28
+ "15": "Nonfiction Writing",
29
+ "16": "Other/Unclassified",
30
+ "17": "Personal Blog",
31
+ "18": "Product Page",
32
+ "19": "Q&A Forum",
33
+ "20": "Spam / Ads",
34
+ "21": "Structured Data",
35
+ "22": "Truncated",
36
+ "23": "Tutorial",
37
+ "24": "User Review"
38
+ },
39
+ "initializer_range": 0.02,
40
+ "intermediate_size": 1536,
41
+ "label2id": {
42
+ "About (Org.)": 0,
43
+ "About (Personal)": 1,
44
+ "Academic Writing": 2,
45
+ "Audio Transcript": 3,
46
+ "Comment Section": 4,
47
+ "Content Listing": 5,
48
+ "Creative Writing": 6,
49
+ "Customer Support": 7,
50
+ "Documentation": 8,
51
+ "FAQ": 9,
52
+ "Knowledge Article": 10,
53
+ "Legal Notices": 11,
54
+ "Listicle": 12,
55
+ "News (Org.)": 13,
56
+ "News Article": 14,
57
+ "Nonfiction Writing": 15,
58
+ "Other/Unclassified": 16,
59
+ "Personal Blog": 17,
60
+ "Product Page": 18,
61
+ "Q&A Forum": 19,
62
+ "Spam / Ads": 20,
63
+ "Structured Data": 21,
64
+ "Truncated": 22,
65
+ "Tutorial": 23,
66
+ "User Review": 24
67
+ },
68
+ "layer_norm_eps": 1e-12,
69
+ "max_position_embeddings": 512,
70
+ "model_type": "bert",
71
+ "num_attention_heads": 12,
72
+ "num_hidden_layers": 12,
73
+ "pad_token_id": 0,
74
+ "position_embedding_type": "absolute",
75
+ "problem_type": "single_label_classification",
76
+ "transformers_version": "5.0.0.dev0",
77
+ "type_vocab_size": 2,
78
+ "use_cache": false,
79
+ "vocab_size": 30522
80
+ }
eval_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_f1": 0.7783590324391549,
4
+ "eval_loss": 0.7510631680488586,
5
+ "eval_runtime": 49.7968,
6
+ "eval_samples": 87572,
7
+ "eval_samples_per_second": 1758.588,
8
+ "eval_steps_per_second": 219.834
9
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bd3fab26901c0ffaf2d9c97ef24362aaebab6c638c476acfe16882d5392f040
3
+ size 133501796
predict_results.txt ADDED
The diff for this file is too large to render. See raw diff
 
report.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Model Performance Report
2
+
3
+ **Overall Accuracy:** 77.90%
4
+
5
+ Note: Zeros in the following table indicate lack of test samples for those classes.
6
+
7
+ ### Per-Class Performance
8
+ | Class | Precision | Recall (Accuracy) | F1-Score | Support |
9
+ | :--- | :--- | :--- | :--- | :--- |
10
+ | About (Org.) | 0.77 | 0.78 | 0.78 | 5595.0 |
11
+ | About (Personal) | 0.79 | 0.82 | 0.80 | 2276.0 |
12
+ | Academic Writing | 0.82 | 0.78 | 0.80 | 1611.0 |
13
+ | Audio Transcript | 0.62 | 0.65 | 0.63 | 574.0 |
14
+ | Comment Section | 0.66 | 0.61 | 0.63 | 890.0 |
15
+ | Content Listing | 0.72 | 0.67 | 0.69 | 2051.0 |
16
+ | Creative Writing | 0.69 | 0.56 | 0.62 | 628.0 |
17
+ | Customer Support | 0.61 | 0.65 | 0.63 | 1145.0 |
18
+ | Documentation | 0.73 | 0.63 | 0.68 | 1581.0 |
19
+ | FAQ | 0.69 | 0.65 | 0.67 | 733.0 |
20
+ | Knowledge Article | 0.64 | 0.71 | 0.67 | 7150.0 |
21
+ | Legal Notices | 0.86 | 0.83 | 0.84 | 1122.0 |
22
+ | Listicle | 0.58 | 0.59 | 0.58 | 1336.0 |
23
+ | News (Org.) | 0.72 | 0.73 | 0.73 | 9126.0 |
24
+ | News Article | 0.83 | 0.85 | 0.84 | 11217.0 |
25
+ | Nonfiction Writing | 0.50 | 0.30 | 0.37 | 262.0 |
26
+ | Other/Unclassified | 0.64 | 0.32 | 0.42 | 22.0 |
27
+ | Personal Blog | 0.78 | 0.76 | 0.77 | 9788.0 |
28
+ | Product Page | 0.88 | 0.87 | 0.87 | 22466.0 |
29
+ | Q&A Forum | 0.80 | 0.78 | 0.79 | 2511.0 |
30
+ | Spam / Ads | 0.00 | 0.00 | 0.00 | 6.0 |
31
+ | Structured Data | 0.62 | 0.62 | 0.62 | 340.0 |
32
+ | Truncated | 0.39 | 0.36 | 0.38 | 33.0 |
33
+ | Tutorial | 0.74 | 0.74 | 0.74 | 3384.0 |
34
+ | User Review | 0.73 | 0.68 | 0.70 | 1720.0 |
35
+
36
+ ### Summary Statistics
37
+ - **Macro Avg F1:** 0.65
38
+ - **Weighted Avg F1:** 0.78
special_tokens_map.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": true,
45
+ "cls_token": "[CLS]",
46
+ "do_basic_tokenize": true,
47
+ "do_lower_case": true,
48
+ "extra_special_tokens": {},
49
+ "mask_token": "[MASK]",
50
+ "model_max_length": 512,
51
+ "never_split": null,
52
+ "pad_token": "[PAD]",
53
+ "sep_token": "[SEP]",
54
+ "strip_accents": null,
55
+ "tokenize_chinese_chars": true,
56
+ "tokenizer_class": "BertTokenizer",
57
+ "unk_token": "[UNK]"
58
+ }
train_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "total_flos": 3.462425297543117e+16,
4
+ "train_loss": 0.6613248294712064,
5
+ "train_runtime": 4513.963,
6
+ "train_samples": 700542,
7
+ "train_samples_per_second": 465.583,
8
+ "train_steps_per_second": 58.198
9
+ }
trainer_state.json ADDED
@@ -0,0 +1,3745 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 262704,
3
+ "best_metric": 0.7783590324391549,
4
+ "best_model_checkpoint": "./GIST-small-c4-en-doc_type_v2_primary/checkpoint-262704",
5
+ "epoch": 3.0,
6
+ "eval_steps": 500,
7
+ "global_step": 262704,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.0057098483464279185,
14
+ "grad_norm": 3.6085364818573,
15
+ "learning_rate": 4.990502618917108e-05,
16
+ "loss": 2.1096,
17
+ "step": 500
18
+ },
19
+ {
20
+ "epoch": 0.011419696692855837,
21
+ "grad_norm": 8.987030029296875,
22
+ "learning_rate": 4.980986205006395e-05,
23
+ "loss": 1.4648,
24
+ "step": 1000
25
+ },
26
+ {
27
+ "epoch": 0.017129545039283756,
28
+ "grad_norm": 7.749431133270264,
29
+ "learning_rate": 4.971469791095682e-05,
30
+ "loss": 1.3621,
31
+ "step": 1500
32
+ },
33
+ {
34
+ "epoch": 0.022839393385711674,
35
+ "grad_norm": 10.391922950744629,
36
+ "learning_rate": 4.961953377184969e-05,
37
+ "loss": 1.2406,
38
+ "step": 2000
39
+ },
40
+ {
41
+ "epoch": 0.028549241732139595,
42
+ "grad_norm": 10.904350280761719,
43
+ "learning_rate": 4.9524369632742554e-05,
44
+ "loss": 1.1532,
45
+ "step": 2500
46
+ },
47
+ {
48
+ "epoch": 0.03425909007856751,
49
+ "grad_norm": 9.787611961364746,
50
+ "learning_rate": 4.9429205493635424e-05,
51
+ "loss": 1.0964,
52
+ "step": 3000
53
+ },
54
+ {
55
+ "epoch": 0.03996893842499543,
56
+ "grad_norm": 11.897588729858398,
57
+ "learning_rate": 4.9334041354528294e-05,
58
+ "loss": 1.0586,
59
+ "step": 3500
60
+ },
61
+ {
62
+ "epoch": 0.04567878677142335,
63
+ "grad_norm": 6.8045783042907715,
64
+ "learning_rate": 4.923887721542116e-05,
65
+ "loss": 1.0608,
66
+ "step": 4000
67
+ },
68
+ {
69
+ "epoch": 0.05138863511785127,
70
+ "grad_norm": 14.330623626708984,
71
+ "learning_rate": 4.914371307631403e-05,
72
+ "loss": 1.0335,
73
+ "step": 4500
74
+ },
75
+ {
76
+ "epoch": 0.05709848346427919,
77
+ "grad_norm": 5.744438171386719,
78
+ "learning_rate": 4.90485489372069e-05,
79
+ "loss": 1.0439,
80
+ "step": 5000
81
+ },
82
+ {
83
+ "epoch": 0.06280833181070711,
84
+ "grad_norm": 11.10835075378418,
85
+ "learning_rate": 4.895338479809977e-05,
86
+ "loss": 0.9611,
87
+ "step": 5500
88
+ },
89
+ {
90
+ "epoch": 0.06851818015713503,
91
+ "grad_norm": 12.490266799926758,
92
+ "learning_rate": 4.885822065899263e-05,
93
+ "loss": 0.9918,
94
+ "step": 6000
95
+ },
96
+ {
97
+ "epoch": 0.07422802850356294,
98
+ "grad_norm": 11.168036460876465,
99
+ "learning_rate": 4.87630565198855e-05,
100
+ "loss": 0.9632,
101
+ "step": 6500
102
+ },
103
+ {
104
+ "epoch": 0.07993787684999086,
105
+ "grad_norm": 9.346617698669434,
106
+ "learning_rate": 4.866789238077837e-05,
107
+ "loss": 0.9615,
108
+ "step": 7000
109
+ },
110
+ {
111
+ "epoch": 0.08564772519641878,
112
+ "grad_norm": 11.40776252746582,
113
+ "learning_rate": 4.857272824167124e-05,
114
+ "loss": 0.957,
115
+ "step": 7500
116
+ },
117
+ {
118
+ "epoch": 0.0913575735428467,
119
+ "grad_norm": 15.985426902770996,
120
+ "learning_rate": 4.84775641025641e-05,
121
+ "loss": 0.9505,
122
+ "step": 8000
123
+ },
124
+ {
125
+ "epoch": 0.09706742188927463,
126
+ "grad_norm": 7.924542427062988,
127
+ "learning_rate": 4.838239996345697e-05,
128
+ "loss": 0.9517,
129
+ "step": 8500
130
+ },
131
+ {
132
+ "epoch": 0.10277727023570254,
133
+ "grad_norm": 13.224577903747559,
134
+ "learning_rate": 4.828723582434984e-05,
135
+ "loss": 0.9335,
136
+ "step": 9000
137
+ },
138
+ {
139
+ "epoch": 0.10848711858213046,
140
+ "grad_norm": 3.4942286014556885,
141
+ "learning_rate": 4.8192071685242705e-05,
142
+ "loss": 0.9379,
143
+ "step": 9500
144
+ },
145
+ {
146
+ "epoch": 0.11419696692855838,
147
+ "grad_norm": 10.90908145904541,
148
+ "learning_rate": 4.8096907546135575e-05,
149
+ "loss": 0.9304,
150
+ "step": 10000
151
+ },
152
+ {
153
+ "epoch": 0.1199068152749863,
154
+ "grad_norm": 19.59946632385254,
155
+ "learning_rate": 4.8001743407028445e-05,
156
+ "loss": 0.8961,
157
+ "step": 10500
158
+ },
159
+ {
160
+ "epoch": 0.12561666362141422,
161
+ "grad_norm": 9.941500663757324,
162
+ "learning_rate": 4.7906579267921314e-05,
163
+ "loss": 0.934,
164
+ "step": 11000
165
+ },
166
+ {
167
+ "epoch": 0.13132651196784215,
168
+ "grad_norm": 12.900982856750488,
169
+ "learning_rate": 4.781141512881418e-05,
170
+ "loss": 0.8942,
171
+ "step": 11500
172
+ },
173
+ {
174
+ "epoch": 0.13703636031427005,
175
+ "grad_norm": 10.073945045471191,
176
+ "learning_rate": 4.7716250989707054e-05,
177
+ "loss": 0.9017,
178
+ "step": 12000
179
+ },
180
+ {
181
+ "epoch": 0.14274620866069798,
182
+ "grad_norm": 1.390982747077942,
183
+ "learning_rate": 4.762108685059992e-05,
184
+ "loss": 0.8932,
185
+ "step": 12500
186
+ },
187
+ {
188
+ "epoch": 0.14845605700712589,
189
+ "grad_norm": 15.93363094329834,
190
+ "learning_rate": 4.752592271149279e-05,
191
+ "loss": 0.9261,
192
+ "step": 13000
193
+ },
194
+ {
195
+ "epoch": 0.15416590535355382,
196
+ "grad_norm": 8.784466743469238,
197
+ "learning_rate": 4.743075857238565e-05,
198
+ "loss": 0.8984,
199
+ "step": 13500
200
+ },
201
+ {
202
+ "epoch": 0.15987575369998172,
203
+ "grad_norm": 15.461153030395508,
204
+ "learning_rate": 4.733559443327852e-05,
205
+ "loss": 0.9197,
206
+ "step": 14000
207
+ },
208
+ {
209
+ "epoch": 0.16558560204640965,
210
+ "grad_norm": 17.443038940429688,
211
+ "learning_rate": 4.724043029417139e-05,
212
+ "loss": 0.8839,
213
+ "step": 14500
214
+ },
215
+ {
216
+ "epoch": 0.17129545039283756,
217
+ "grad_norm": 13.286499977111816,
218
+ "learning_rate": 4.714526615506425e-05,
219
+ "loss": 0.9165,
220
+ "step": 15000
221
+ },
222
+ {
223
+ "epoch": 0.1770052987392655,
224
+ "grad_norm": 10.205890655517578,
225
+ "learning_rate": 4.705010201595713e-05,
226
+ "loss": 0.9321,
227
+ "step": 15500
228
+ },
229
+ {
230
+ "epoch": 0.1827151470856934,
231
+ "grad_norm": 9.204654693603516,
232
+ "learning_rate": 4.695493787684999e-05,
233
+ "loss": 0.9121,
234
+ "step": 16000
235
+ },
236
+ {
237
+ "epoch": 0.18842499543212132,
238
+ "grad_norm": 6.136595249176025,
239
+ "learning_rate": 4.685977373774286e-05,
240
+ "loss": 0.925,
241
+ "step": 16500
242
+ },
243
+ {
244
+ "epoch": 0.19413484377854925,
245
+ "grad_norm": 9.665145874023438,
246
+ "learning_rate": 4.6764609598635725e-05,
247
+ "loss": 0.9058,
248
+ "step": 17000
249
+ },
250
+ {
251
+ "epoch": 0.19984469212497716,
252
+ "grad_norm": 15.662653923034668,
253
+ "learning_rate": 4.66694454595286e-05,
254
+ "loss": 0.8676,
255
+ "step": 17500
256
+ },
257
+ {
258
+ "epoch": 0.2055545404714051,
259
+ "grad_norm": 10.073562622070312,
260
+ "learning_rate": 4.6574281320421465e-05,
261
+ "loss": 0.8977,
262
+ "step": 18000
263
+ },
264
+ {
265
+ "epoch": 0.211264388817833,
266
+ "grad_norm": 12.039624214172363,
267
+ "learning_rate": 4.6479117181314335e-05,
268
+ "loss": 0.8639,
269
+ "step": 18500
270
+ },
271
+ {
272
+ "epoch": 0.21697423716426092,
273
+ "grad_norm": 9.763826370239258,
274
+ "learning_rate": 4.6383953042207204e-05,
275
+ "loss": 0.8852,
276
+ "step": 19000
277
+ },
278
+ {
279
+ "epoch": 0.22268408551068883,
280
+ "grad_norm": 11.07213020324707,
281
+ "learning_rate": 4.628878890310007e-05,
282
+ "loss": 0.8676,
283
+ "step": 19500
284
+ },
285
+ {
286
+ "epoch": 0.22839393385711676,
287
+ "grad_norm": 9.623068809509277,
288
+ "learning_rate": 4.619362476399294e-05,
289
+ "loss": 0.8666,
290
+ "step": 20000
291
+ },
292
+ {
293
+ "epoch": 0.23410378220354466,
294
+ "grad_norm": 6.549106121063232,
295
+ "learning_rate": 4.60984606248858e-05,
296
+ "loss": 0.8814,
297
+ "step": 20500
298
+ },
299
+ {
300
+ "epoch": 0.2398136305499726,
301
+ "grad_norm": 4.613440990447998,
302
+ "learning_rate": 4.600329648577868e-05,
303
+ "loss": 0.8668,
304
+ "step": 21000
305
+ },
306
+ {
307
+ "epoch": 0.2455234788964005,
308
+ "grad_norm": 16.33905792236328,
309
+ "learning_rate": 4.590813234667154e-05,
310
+ "loss": 0.9004,
311
+ "step": 21500
312
+ },
313
+ {
314
+ "epoch": 0.25123332724282843,
315
+ "grad_norm": 9.664499282836914,
316
+ "learning_rate": 4.581296820756441e-05,
317
+ "loss": 0.8746,
318
+ "step": 22000
319
+ },
320
+ {
321
+ "epoch": 0.25694317558925633,
322
+ "grad_norm": 8.262542724609375,
323
+ "learning_rate": 4.571780406845727e-05,
324
+ "loss": 0.8618,
325
+ "step": 22500
326
+ },
327
+ {
328
+ "epoch": 0.2626530239356843,
329
+ "grad_norm": 12.129043579101562,
330
+ "learning_rate": 4.562263992935015e-05,
331
+ "loss": 0.8505,
332
+ "step": 23000
333
+ },
334
+ {
335
+ "epoch": 0.2683628722821122,
336
+ "grad_norm": 7.888747692108154,
337
+ "learning_rate": 4.552747579024301e-05,
338
+ "loss": 0.8469,
339
+ "step": 23500
340
+ },
341
+ {
342
+ "epoch": 0.2740727206285401,
343
+ "grad_norm": 9.716676712036133,
344
+ "learning_rate": 4.543231165113588e-05,
345
+ "loss": 0.8396,
346
+ "step": 24000
347
+ },
348
+ {
349
+ "epoch": 0.279782568974968,
350
+ "grad_norm": 3.4726152420043945,
351
+ "learning_rate": 4.533714751202875e-05,
352
+ "loss": 0.8524,
353
+ "step": 24500
354
+ },
355
+ {
356
+ "epoch": 0.28549241732139596,
357
+ "grad_norm": 6.681084156036377,
358
+ "learning_rate": 4.5241983372921615e-05,
359
+ "loss": 0.8757,
360
+ "step": 25000
361
+ },
362
+ {
363
+ "epoch": 0.29120226566782387,
364
+ "grad_norm": 14.962363243103027,
365
+ "learning_rate": 4.5146819233814485e-05,
366
+ "loss": 0.844,
367
+ "step": 25500
368
+ },
369
+ {
370
+ "epoch": 0.29691211401425177,
371
+ "grad_norm": 15.67526626586914,
372
+ "learning_rate": 4.505165509470735e-05,
373
+ "loss": 0.8615,
374
+ "step": 26000
375
+ },
376
+ {
377
+ "epoch": 0.3026219623606797,
378
+ "grad_norm": 16.907922744750977,
379
+ "learning_rate": 4.4956490955600225e-05,
380
+ "loss": 0.8535,
381
+ "step": 26500
382
+ },
383
+ {
384
+ "epoch": 0.30833181070710763,
385
+ "grad_norm": 15.818778038024902,
386
+ "learning_rate": 4.486132681649309e-05,
387
+ "loss": 0.8748,
388
+ "step": 27000
389
+ },
390
+ {
391
+ "epoch": 0.31404165905353554,
392
+ "grad_norm": 14.407879829406738,
393
+ "learning_rate": 4.476616267738596e-05,
394
+ "loss": 0.8306,
395
+ "step": 27500
396
+ },
397
+ {
398
+ "epoch": 0.31975150739996344,
399
+ "grad_norm": 7.06128454208374,
400
+ "learning_rate": 4.467099853827883e-05,
401
+ "loss": 0.8397,
402
+ "step": 28000
403
+ },
404
+ {
405
+ "epoch": 0.3254613557463914,
406
+ "grad_norm": 8.743152618408203,
407
+ "learning_rate": 4.45758343991717e-05,
408
+ "loss": 0.8358,
409
+ "step": 28500
410
+ },
411
+ {
412
+ "epoch": 0.3311712040928193,
413
+ "grad_norm": 10.427400588989258,
414
+ "learning_rate": 4.448067026006456e-05,
415
+ "loss": 0.8313,
416
+ "step": 29000
417
+ },
418
+ {
419
+ "epoch": 0.3368810524392472,
420
+ "grad_norm": 8.77175521850586,
421
+ "learning_rate": 4.438550612095743e-05,
422
+ "loss": 0.8421,
423
+ "step": 29500
424
+ },
425
+ {
426
+ "epoch": 0.3425909007856751,
427
+ "grad_norm": 12.583232879638672,
428
+ "learning_rate": 4.42903419818503e-05,
429
+ "loss": 0.8237,
430
+ "step": 30000
431
+ },
432
+ {
433
+ "epoch": 0.34830074913210307,
434
+ "grad_norm": 8.234016418457031,
435
+ "learning_rate": 4.419517784274316e-05,
436
+ "loss": 0.857,
437
+ "step": 30500
438
+ },
439
+ {
440
+ "epoch": 0.354010597478531,
441
+ "grad_norm": 11.742145538330078,
442
+ "learning_rate": 4.410001370363603e-05,
443
+ "loss": 0.8299,
444
+ "step": 31000
445
+ },
446
+ {
447
+ "epoch": 0.3597204458249589,
448
+ "grad_norm": 24.978178024291992,
449
+ "learning_rate": 4.40048495645289e-05,
450
+ "loss": 0.8107,
451
+ "step": 31500
452
+ },
453
+ {
454
+ "epoch": 0.3654302941713868,
455
+ "grad_norm": 14.165092468261719,
456
+ "learning_rate": 4.390968542542177e-05,
457
+ "loss": 0.859,
458
+ "step": 32000
459
+ },
460
+ {
461
+ "epoch": 0.37114014251781474,
462
+ "grad_norm": 7.322417259216309,
463
+ "learning_rate": 4.3814521286314635e-05,
464
+ "loss": 0.8118,
465
+ "step": 32500
466
+ },
467
+ {
468
+ "epoch": 0.37684999086424265,
469
+ "grad_norm": 5.084038734436035,
470
+ "learning_rate": 4.3719357147207505e-05,
471
+ "loss": 0.8823,
472
+ "step": 33000
473
+ },
474
+ {
475
+ "epoch": 0.38255983921067055,
476
+ "grad_norm": 9.751274108886719,
477
+ "learning_rate": 4.3624193008100375e-05,
478
+ "loss": 0.8124,
479
+ "step": 33500
480
+ },
481
+ {
482
+ "epoch": 0.3882696875570985,
483
+ "grad_norm": 8.654450416564941,
484
+ "learning_rate": 4.3529028868993245e-05,
485
+ "loss": 0.8124,
486
+ "step": 34000
487
+ },
488
+ {
489
+ "epoch": 0.3939795359035264,
490
+ "grad_norm": 17.972393035888672,
491
+ "learning_rate": 4.343386472988611e-05,
492
+ "loss": 0.8366,
493
+ "step": 34500
494
+ },
495
+ {
496
+ "epoch": 0.3996893842499543,
497
+ "grad_norm": 18.538728713989258,
498
+ "learning_rate": 4.333870059077898e-05,
499
+ "loss": 0.8472,
500
+ "step": 35000
501
+ },
502
+ {
503
+ "epoch": 0.4053992325963822,
504
+ "grad_norm": 11.216024398803711,
505
+ "learning_rate": 4.324353645167185e-05,
506
+ "loss": 0.8791,
507
+ "step": 35500
508
+ },
509
+ {
510
+ "epoch": 0.4111090809428102,
511
+ "grad_norm": 19.322118759155273,
512
+ "learning_rate": 4.314837231256471e-05,
513
+ "loss": 0.8294,
514
+ "step": 36000
515
+ },
516
+ {
517
+ "epoch": 0.4168189292892381,
518
+ "grad_norm": 12.127171516418457,
519
+ "learning_rate": 4.305320817345758e-05,
520
+ "loss": 0.8002,
521
+ "step": 36500
522
+ },
523
+ {
524
+ "epoch": 0.422528777635666,
525
+ "grad_norm": 12.57991886138916,
526
+ "learning_rate": 4.295804403435045e-05,
527
+ "loss": 0.8211,
528
+ "step": 37000
529
+ },
530
+ {
531
+ "epoch": 0.4282386259820939,
532
+ "grad_norm": 11.740194320678711,
533
+ "learning_rate": 4.286287989524332e-05,
534
+ "loss": 0.8238,
535
+ "step": 37500
536
+ },
537
+ {
538
+ "epoch": 0.43394847432852185,
539
+ "grad_norm": 18.000648498535156,
540
+ "learning_rate": 4.276771575613618e-05,
541
+ "loss": 0.8395,
542
+ "step": 38000
543
+ },
544
+ {
545
+ "epoch": 0.43965832267494975,
546
+ "grad_norm": 8.163433074951172,
547
+ "learning_rate": 4.267255161702905e-05,
548
+ "loss": 0.8094,
549
+ "step": 38500
550
+ },
551
+ {
552
+ "epoch": 0.44536817102137766,
553
+ "grad_norm": 12.213592529296875,
554
+ "learning_rate": 4.257738747792192e-05,
555
+ "loss": 0.8337,
556
+ "step": 39000
557
+ },
558
+ {
559
+ "epoch": 0.4510780193678056,
560
+ "grad_norm": 14.310477256774902,
561
+ "learning_rate": 4.248222333881479e-05,
562
+ "loss": 0.8428,
563
+ "step": 39500
564
+ },
565
+ {
566
+ "epoch": 0.4567878677142335,
567
+ "grad_norm": 11.018898963928223,
568
+ "learning_rate": 4.2387059199707656e-05,
569
+ "loss": 0.8389,
570
+ "step": 40000
571
+ },
572
+ {
573
+ "epoch": 0.4624977160606614,
574
+ "grad_norm": 9.815699577331543,
575
+ "learning_rate": 4.2291895060600525e-05,
576
+ "loss": 0.8384,
577
+ "step": 40500
578
+ },
579
+ {
580
+ "epoch": 0.4682075644070893,
581
+ "grad_norm": 5.939387798309326,
582
+ "learning_rate": 4.2196730921493395e-05,
583
+ "loss": 0.8262,
584
+ "step": 41000
585
+ },
586
+ {
587
+ "epoch": 0.4739174127535173,
588
+ "grad_norm": 4.190549373626709,
589
+ "learning_rate": 4.210156678238626e-05,
590
+ "loss": 0.7977,
591
+ "step": 41500
592
+ },
593
+ {
594
+ "epoch": 0.4796272610999452,
595
+ "grad_norm": 14.0785551071167,
596
+ "learning_rate": 4.200640264327913e-05,
597
+ "loss": 0.7937,
598
+ "step": 42000
599
+ },
600
+ {
601
+ "epoch": 0.4853371094463731,
602
+ "grad_norm": 11.102999687194824,
603
+ "learning_rate": 4.1911238504172e-05,
604
+ "loss": 0.8428,
605
+ "step": 42500
606
+ },
607
+ {
608
+ "epoch": 0.491046957792801,
609
+ "grad_norm": 11.764595031738281,
610
+ "learning_rate": 4.181607436506487e-05,
611
+ "loss": 0.8098,
612
+ "step": 43000
613
+ },
614
+ {
615
+ "epoch": 0.49675680613922896,
616
+ "grad_norm": 11.915069580078125,
617
+ "learning_rate": 4.172091022595773e-05,
618
+ "loss": 0.8144,
619
+ "step": 43500
620
+ },
621
+ {
622
+ "epoch": 0.5024666544856569,
623
+ "grad_norm": 10.59645938873291,
624
+ "learning_rate": 4.16257460868506e-05,
625
+ "loss": 0.8079,
626
+ "step": 44000
627
+ },
628
+ {
629
+ "epoch": 0.5081765028320848,
630
+ "grad_norm": 16.68412971496582,
631
+ "learning_rate": 4.153058194774347e-05,
632
+ "loss": 0.8154,
633
+ "step": 44500
634
+ },
635
+ {
636
+ "epoch": 0.5138863511785127,
637
+ "grad_norm": 10.325716972351074,
638
+ "learning_rate": 4.143541780863634e-05,
639
+ "loss": 0.8292,
640
+ "step": 45000
641
+ },
642
+ {
643
+ "epoch": 0.5195961995249406,
644
+ "grad_norm": 9.709111213684082,
645
+ "learning_rate": 4.13402536695292e-05,
646
+ "loss": 0.7955,
647
+ "step": 45500
648
+ },
649
+ {
650
+ "epoch": 0.5253060478713686,
651
+ "grad_norm": 14.15976333618164,
652
+ "learning_rate": 4.124508953042207e-05,
653
+ "loss": 0.7873,
654
+ "step": 46000
655
+ },
656
+ {
657
+ "epoch": 0.5310158962177964,
658
+ "grad_norm": 10.180712699890137,
659
+ "learning_rate": 4.114992539131494e-05,
660
+ "loss": 0.7844,
661
+ "step": 46500
662
+ },
663
+ {
664
+ "epoch": 0.5367257445642244,
665
+ "grad_norm": 7.673330783843994,
666
+ "learning_rate": 4.1054761252207806e-05,
667
+ "loss": 0.7829,
668
+ "step": 47000
669
+ },
670
+ {
671
+ "epoch": 0.5424355929106522,
672
+ "grad_norm": 14.804292678833008,
673
+ "learning_rate": 4.0959597113100676e-05,
674
+ "loss": 0.814,
675
+ "step": 47500
676
+ },
677
+ {
678
+ "epoch": 0.5481454412570802,
679
+ "grad_norm": 7.286357879638672,
680
+ "learning_rate": 4.0864432973993546e-05,
681
+ "loss": 0.823,
682
+ "step": 48000
683
+ },
684
+ {
685
+ "epoch": 0.5538552896035082,
686
+ "grad_norm": 9.00866413116455,
687
+ "learning_rate": 4.0769268834886415e-05,
688
+ "loss": 0.8049,
689
+ "step": 48500
690
+ },
691
+ {
692
+ "epoch": 0.559565137949936,
693
+ "grad_norm": 10.838045120239258,
694
+ "learning_rate": 4.067410469577928e-05,
695
+ "loss": 0.7987,
696
+ "step": 49000
697
+ },
698
+ {
699
+ "epoch": 0.565274986296364,
700
+ "grad_norm": 10.507018089294434,
701
+ "learning_rate": 4.057894055667215e-05,
702
+ "loss": 0.7752,
703
+ "step": 49500
704
+ },
705
+ {
706
+ "epoch": 0.5709848346427919,
707
+ "grad_norm": 5.607507705688477,
708
+ "learning_rate": 4.048377641756502e-05,
709
+ "loss": 0.813,
710
+ "step": 50000
711
+ },
712
+ {
713
+ "epoch": 0.5766946829892198,
714
+ "grad_norm": 11.71255874633789,
715
+ "learning_rate": 4.038861227845789e-05,
716
+ "loss": 0.8187,
717
+ "step": 50500
718
+ },
719
+ {
720
+ "epoch": 0.5824045313356477,
721
+ "grad_norm": 19.119720458984375,
722
+ "learning_rate": 4.029344813935075e-05,
723
+ "loss": 0.8087,
724
+ "step": 51000
725
+ },
726
+ {
727
+ "epoch": 0.5881143796820757,
728
+ "grad_norm": 13.78478717803955,
729
+ "learning_rate": 4.019828400024363e-05,
730
+ "loss": 0.8138,
731
+ "step": 51500
732
+ },
733
+ {
734
+ "epoch": 0.5938242280285035,
735
+ "grad_norm": 11.63516902923584,
736
+ "learning_rate": 4.010311986113649e-05,
737
+ "loss": 0.7928,
738
+ "step": 52000
739
+ },
740
+ {
741
+ "epoch": 0.5995340763749315,
742
+ "grad_norm": 9.342263221740723,
743
+ "learning_rate": 4.0007955722029354e-05,
744
+ "loss": 0.794,
745
+ "step": 52500
746
+ },
747
+ {
748
+ "epoch": 0.6052439247213593,
749
+ "grad_norm": 10.79999828338623,
750
+ "learning_rate": 3.9912791582922223e-05,
751
+ "loss": 0.819,
752
+ "step": 53000
753
+ },
754
+ {
755
+ "epoch": 0.6109537730677873,
756
+ "grad_norm": 11.1988525390625,
757
+ "learning_rate": 3.981762744381509e-05,
758
+ "loss": 0.7804,
759
+ "step": 53500
760
+ },
761
+ {
762
+ "epoch": 0.6166636214142153,
763
+ "grad_norm": 12.65152359008789,
764
+ "learning_rate": 3.972246330470796e-05,
765
+ "loss": 0.8267,
766
+ "step": 54000
767
+ },
768
+ {
769
+ "epoch": 0.6223734697606431,
770
+ "grad_norm": 15.964079856872559,
771
+ "learning_rate": 3.9627299165600826e-05,
772
+ "loss": 0.8193,
773
+ "step": 54500
774
+ },
775
+ {
776
+ "epoch": 0.6280833181070711,
777
+ "grad_norm": 15.844160079956055,
778
+ "learning_rate": 3.95321350264937e-05,
779
+ "loss": 0.8122,
780
+ "step": 55000
781
+ },
782
+ {
783
+ "epoch": 0.633793166453499,
784
+ "grad_norm": 13.783295631408691,
785
+ "learning_rate": 3.9436970887386566e-05,
786
+ "loss": 0.7854,
787
+ "step": 55500
788
+ },
789
+ {
790
+ "epoch": 0.6395030147999269,
791
+ "grad_norm": 6.737399101257324,
792
+ "learning_rate": 3.9341806748279436e-05,
793
+ "loss": 0.7966,
794
+ "step": 56000
795
+ },
796
+ {
797
+ "epoch": 0.6452128631463548,
798
+ "grad_norm": 19.983182907104492,
799
+ "learning_rate": 3.92466426091723e-05,
800
+ "loss": 0.7814,
801
+ "step": 56500
802
+ },
803
+ {
804
+ "epoch": 0.6509227114927828,
805
+ "grad_norm": 13.9674072265625,
806
+ "learning_rate": 3.9151478470065175e-05,
807
+ "loss": 0.789,
808
+ "step": 57000
809
+ },
810
+ {
811
+ "epoch": 0.6566325598392106,
812
+ "grad_norm": 4.032986164093018,
813
+ "learning_rate": 3.905631433095804e-05,
814
+ "loss": 0.7847,
815
+ "step": 57500
816
+ },
817
+ {
818
+ "epoch": 0.6623424081856386,
819
+ "grad_norm": 6.149815082550049,
820
+ "learning_rate": 3.89611501918509e-05,
821
+ "loss": 0.7974,
822
+ "step": 58000
823
+ },
824
+ {
825
+ "epoch": 0.6680522565320665,
826
+ "grad_norm": 15.011893272399902,
827
+ "learning_rate": 3.886598605274378e-05,
828
+ "loss": 0.7799,
829
+ "step": 58500
830
+ },
831
+ {
832
+ "epoch": 0.6737621048784944,
833
+ "grad_norm": 19.646854400634766,
834
+ "learning_rate": 3.877082191363664e-05,
835
+ "loss": 0.8121,
836
+ "step": 59000
837
+ },
838
+ {
839
+ "epoch": 0.6794719532249224,
840
+ "grad_norm": 13.169565200805664,
841
+ "learning_rate": 3.867565777452951e-05,
842
+ "loss": 0.7623,
843
+ "step": 59500
844
+ },
845
+ {
846
+ "epoch": 0.6851818015713502,
847
+ "grad_norm": 13.09906005859375,
848
+ "learning_rate": 3.8580493635422374e-05,
849
+ "loss": 0.7822,
850
+ "step": 60000
851
+ },
852
+ {
853
+ "epoch": 0.6908916499177782,
854
+ "grad_norm": 7.800292015075684,
855
+ "learning_rate": 3.848532949631525e-05,
856
+ "loss": 0.8195,
857
+ "step": 60500
858
+ },
859
+ {
860
+ "epoch": 0.6966014982642061,
861
+ "grad_norm": 19.579214096069336,
862
+ "learning_rate": 3.8390165357208114e-05,
863
+ "loss": 0.7913,
864
+ "step": 61000
865
+ },
866
+ {
867
+ "epoch": 0.702311346610634,
868
+ "grad_norm": 6.022160053253174,
869
+ "learning_rate": 3.829500121810098e-05,
870
+ "loss": 0.7926,
871
+ "step": 61500
872
+ },
873
+ {
874
+ "epoch": 0.708021194957062,
875
+ "grad_norm": 11.383055686950684,
876
+ "learning_rate": 3.8199837078993846e-05,
877
+ "loss": 0.8098,
878
+ "step": 62000
879
+ },
880
+ {
881
+ "epoch": 0.7137310433034899,
882
+ "grad_norm": 4.869059085845947,
883
+ "learning_rate": 3.810467293988672e-05,
884
+ "loss": 0.7863,
885
+ "step": 62500
886
+ },
887
+ {
888
+ "epoch": 0.7194408916499178,
889
+ "grad_norm": 14.178489685058594,
890
+ "learning_rate": 3.8009508800779586e-05,
891
+ "loss": 0.7441,
892
+ "step": 63000
893
+ },
894
+ {
895
+ "epoch": 0.7251507399963457,
896
+ "grad_norm": 8.96670150756836,
897
+ "learning_rate": 3.791434466167245e-05,
898
+ "loss": 0.7828,
899
+ "step": 63500
900
+ },
901
+ {
902
+ "epoch": 0.7308605883427736,
903
+ "grad_norm": 7.2239155769348145,
904
+ "learning_rate": 3.7819180522565326e-05,
905
+ "loss": 0.7994,
906
+ "step": 64000
907
+ },
908
+ {
909
+ "epoch": 0.7365704366892015,
910
+ "grad_norm": 12.147716522216797,
911
+ "learning_rate": 3.772401638345819e-05,
912
+ "loss": 0.7636,
913
+ "step": 64500
914
+ },
915
+ {
916
+ "epoch": 0.7422802850356295,
917
+ "grad_norm": 16.532936096191406,
918
+ "learning_rate": 3.762885224435106e-05,
919
+ "loss": 0.7768,
920
+ "step": 65000
921
+ },
922
+ {
923
+ "epoch": 0.7479901333820573,
924
+ "grad_norm": 13.03821849822998,
925
+ "learning_rate": 3.753368810524392e-05,
926
+ "loss": 0.7668,
927
+ "step": 65500
928
+ },
929
+ {
930
+ "epoch": 0.7536999817284853,
931
+ "grad_norm": 20.50548553466797,
932
+ "learning_rate": 3.74385239661368e-05,
933
+ "loss": 0.7687,
934
+ "step": 66000
935
+ },
936
+ {
937
+ "epoch": 0.7594098300749133,
938
+ "grad_norm": 9.615571022033691,
939
+ "learning_rate": 3.734335982702966e-05,
940
+ "loss": 0.7926,
941
+ "step": 66500
942
+ },
943
+ {
944
+ "epoch": 0.7651196784213411,
945
+ "grad_norm": 13.842456817626953,
946
+ "learning_rate": 3.724819568792253e-05,
947
+ "loss": 0.7738,
948
+ "step": 67000
949
+ },
950
+ {
951
+ "epoch": 0.7708295267677691,
952
+ "grad_norm": 8.129408836364746,
953
+ "learning_rate": 3.71530315488154e-05,
954
+ "loss": 0.8065,
955
+ "step": 67500
956
+ },
957
+ {
958
+ "epoch": 0.776539375114197,
959
+ "grad_norm": 9.318329811096191,
960
+ "learning_rate": 3.705786740970827e-05,
961
+ "loss": 0.7875,
962
+ "step": 68000
963
+ },
964
+ {
965
+ "epoch": 0.7822492234606249,
966
+ "grad_norm": 12.057832717895508,
967
+ "learning_rate": 3.6962703270601134e-05,
968
+ "loss": 0.7764,
969
+ "step": 68500
970
+ },
971
+ {
972
+ "epoch": 0.7879590718070528,
973
+ "grad_norm": 11.35529899597168,
974
+ "learning_rate": 3.6867539131494e-05,
975
+ "loss": 0.7859,
976
+ "step": 69000
977
+ },
978
+ {
979
+ "epoch": 0.7936689201534807,
980
+ "grad_norm": 10.482672691345215,
981
+ "learning_rate": 3.6772374992386873e-05,
982
+ "loss": 0.7931,
983
+ "step": 69500
984
+ },
985
+ {
986
+ "epoch": 0.7993787684999086,
987
+ "grad_norm": 11.805619239807129,
988
+ "learning_rate": 3.6677210853279736e-05,
989
+ "loss": 0.782,
990
+ "step": 70000
991
+ },
992
+ {
993
+ "epoch": 0.8050886168463366,
994
+ "grad_norm": 9.342158317565918,
995
+ "learning_rate": 3.6582046714172606e-05,
996
+ "loss": 0.7724,
997
+ "step": 70500
998
+ },
999
+ {
1000
+ "epoch": 0.8107984651927644,
1001
+ "grad_norm": 17.140338897705078,
1002
+ "learning_rate": 3.6486882575065476e-05,
1003
+ "loss": 0.7762,
1004
+ "step": 71000
1005
+ },
1006
+ {
1007
+ "epoch": 0.8165083135391924,
1008
+ "grad_norm": 13.278133392333984,
1009
+ "learning_rate": 3.6391718435958346e-05,
1010
+ "loss": 0.7556,
1011
+ "step": 71500
1012
+ },
1013
+ {
1014
+ "epoch": 0.8222181618856204,
1015
+ "grad_norm": 17.53379249572754,
1016
+ "learning_rate": 3.629655429685121e-05,
1017
+ "loss": 0.7461,
1018
+ "step": 72000
1019
+ },
1020
+ {
1021
+ "epoch": 0.8279280102320482,
1022
+ "grad_norm": 12.628260612487793,
1023
+ "learning_rate": 3.620139015774408e-05,
1024
+ "loss": 0.7626,
1025
+ "step": 72500
1026
+ },
1027
+ {
1028
+ "epoch": 0.8336378585784762,
1029
+ "grad_norm": 10.736380577087402,
1030
+ "learning_rate": 3.610622601863695e-05,
1031
+ "loss": 0.7635,
1032
+ "step": 73000
1033
+ },
1034
+ {
1035
+ "epoch": 0.8393477069249041,
1036
+ "grad_norm": 10.802395820617676,
1037
+ "learning_rate": 3.601106187952982e-05,
1038
+ "loss": 0.7642,
1039
+ "step": 73500
1040
+ },
1041
+ {
1042
+ "epoch": 0.845057555271332,
1043
+ "grad_norm": 17.377172470092773,
1044
+ "learning_rate": 3.591589774042268e-05,
1045
+ "loss": 0.7867,
1046
+ "step": 74000
1047
+ },
1048
+ {
1049
+ "epoch": 0.8507674036177599,
1050
+ "grad_norm": 4.457555294036865,
1051
+ "learning_rate": 3.582073360131555e-05,
1052
+ "loss": 0.7846,
1053
+ "step": 74500
1054
+ },
1055
+ {
1056
+ "epoch": 0.8564772519641878,
1057
+ "grad_norm": 17.134586334228516,
1058
+ "learning_rate": 3.572556946220842e-05,
1059
+ "loss": 0.78,
1060
+ "step": 75000
1061
+ },
1062
+ {
1063
+ "epoch": 0.8621871003106157,
1064
+ "grad_norm": 18.068328857421875,
1065
+ "learning_rate": 3.5630405323101284e-05,
1066
+ "loss": 0.7641,
1067
+ "step": 75500
1068
+ },
1069
+ {
1070
+ "epoch": 0.8678969486570437,
1071
+ "grad_norm": 12.264509201049805,
1072
+ "learning_rate": 3.5535241183994154e-05,
1073
+ "loss": 0.7566,
1074
+ "step": 76000
1075
+ },
1076
+ {
1077
+ "epoch": 0.8736067970034715,
1078
+ "grad_norm": 10.22588062286377,
1079
+ "learning_rate": 3.5440077044887024e-05,
1080
+ "loss": 0.761,
1081
+ "step": 76500
1082
+ },
1083
+ {
1084
+ "epoch": 0.8793166453498995,
1085
+ "grad_norm": 13.480569839477539,
1086
+ "learning_rate": 3.5344912905779894e-05,
1087
+ "loss": 0.7636,
1088
+ "step": 77000
1089
+ },
1090
+ {
1091
+ "epoch": 0.8850264936963275,
1092
+ "grad_norm": 12.72829532623291,
1093
+ "learning_rate": 3.524974876667276e-05,
1094
+ "loss": 0.7825,
1095
+ "step": 77500
1096
+ },
1097
+ {
1098
+ "epoch": 0.8907363420427553,
1099
+ "grad_norm": 6.5139384269714355,
1100
+ "learning_rate": 3.5154584627565626e-05,
1101
+ "loss": 0.7937,
1102
+ "step": 78000
1103
+ },
1104
+ {
1105
+ "epoch": 0.8964461903891833,
1106
+ "grad_norm": 11.882951736450195,
1107
+ "learning_rate": 3.5059420488458496e-05,
1108
+ "loss": 0.762,
1109
+ "step": 78500
1110
+ },
1111
+ {
1112
+ "epoch": 0.9021560387356112,
1113
+ "grad_norm": 4.583463191986084,
1114
+ "learning_rate": 3.4964256349351366e-05,
1115
+ "loss": 0.7663,
1116
+ "step": 79000
1117
+ },
1118
+ {
1119
+ "epoch": 0.9078658870820391,
1120
+ "grad_norm": 13.486393928527832,
1121
+ "learning_rate": 3.486909221024423e-05,
1122
+ "loss": 0.7361,
1123
+ "step": 79500
1124
+ },
1125
+ {
1126
+ "epoch": 0.913575735428467,
1127
+ "grad_norm": 8.407270431518555,
1128
+ "learning_rate": 3.47739280711371e-05,
1129
+ "loss": 0.7795,
1130
+ "step": 80000
1131
+ },
1132
+ {
1133
+ "epoch": 0.9192855837748949,
1134
+ "grad_norm": 20.42609977722168,
1135
+ "learning_rate": 3.467876393202997e-05,
1136
+ "loss": 0.7127,
1137
+ "step": 80500
1138
+ },
1139
+ {
1140
+ "epoch": 0.9249954321213228,
1141
+ "grad_norm": 10.40134334564209,
1142
+ "learning_rate": 3.458359979292283e-05,
1143
+ "loss": 0.7826,
1144
+ "step": 81000
1145
+ },
1146
+ {
1147
+ "epoch": 0.9307052804677508,
1148
+ "grad_norm": 18.492952346801758,
1149
+ "learning_rate": 3.44884356538157e-05,
1150
+ "loss": 0.7546,
1151
+ "step": 81500
1152
+ },
1153
+ {
1154
+ "epoch": 0.9364151288141787,
1155
+ "grad_norm": 12.166952133178711,
1156
+ "learning_rate": 3.439327151470857e-05,
1157
+ "loss": 0.7815,
1158
+ "step": 82000
1159
+ },
1160
+ {
1161
+ "epoch": 0.9421249771606066,
1162
+ "grad_norm": 7.884616374969482,
1163
+ "learning_rate": 3.429810737560144e-05,
1164
+ "loss": 0.7852,
1165
+ "step": 82500
1166
+ },
1167
+ {
1168
+ "epoch": 0.9478348255070346,
1169
+ "grad_norm": 7.636866569519043,
1170
+ "learning_rate": 3.4202943236494304e-05,
1171
+ "loss": 0.7558,
1172
+ "step": 83000
1173
+ },
1174
+ {
1175
+ "epoch": 0.9535446738534624,
1176
+ "grad_norm": 15.227622032165527,
1177
+ "learning_rate": 3.4107779097387174e-05,
1178
+ "loss": 0.7699,
1179
+ "step": 83500
1180
+ },
1181
+ {
1182
+ "epoch": 0.9592545221998904,
1183
+ "grad_norm": 8.254300117492676,
1184
+ "learning_rate": 3.4012614958280044e-05,
1185
+ "loss": 0.736,
1186
+ "step": 84000
1187
+ },
1188
+ {
1189
+ "epoch": 0.9649643705463183,
1190
+ "grad_norm": 21.324234008789062,
1191
+ "learning_rate": 3.3917450819172914e-05,
1192
+ "loss": 0.7546,
1193
+ "step": 84500
1194
+ },
1195
+ {
1196
+ "epoch": 0.9706742188927462,
1197
+ "grad_norm": 7.05968713760376,
1198
+ "learning_rate": 3.382228668006578e-05,
1199
+ "loss": 0.7477,
1200
+ "step": 85000
1201
+ },
1202
+ {
1203
+ "epoch": 0.9763840672391741,
1204
+ "grad_norm": 14.42552375793457,
1205
+ "learning_rate": 3.372712254095865e-05,
1206
+ "loss": 0.7401,
1207
+ "step": 85500
1208
+ },
1209
+ {
1210
+ "epoch": 0.982093915585602,
1211
+ "grad_norm": 11.75474739074707,
1212
+ "learning_rate": 3.3631958401851517e-05,
1213
+ "loss": 0.7825,
1214
+ "step": 86000
1215
+ },
1216
+ {
1217
+ "epoch": 0.98780376393203,
1218
+ "grad_norm": 15.836288452148438,
1219
+ "learning_rate": 3.353679426274438e-05,
1220
+ "loss": 0.7471,
1221
+ "step": 86500
1222
+ },
1223
+ {
1224
+ "epoch": 0.9935136122784579,
1225
+ "grad_norm": 19.473066329956055,
1226
+ "learning_rate": 3.344163012363725e-05,
1227
+ "loss": 0.7953,
1228
+ "step": 87000
1229
+ },
1230
+ {
1231
+ "epoch": 0.9992234606248858,
1232
+ "grad_norm": 13.09760570526123,
1233
+ "learning_rate": 3.334646598453012e-05,
1234
+ "loss": 0.7437,
1235
+ "step": 87500
1236
+ },
1237
+ {
1238
+ "epoch": 1.0,
1239
+ "eval_f1": 0.7580809874701915,
1240
+ "eval_loss": 0.721977949142456,
1241
+ "eval_runtime": 49.9684,
1242
+ "eval_samples_per_second": 1752.546,
1243
+ "eval_steps_per_second": 219.078,
1244
+ "step": 87568
1245
+ },
1246
+ {
1247
+ "epoch": 1.0049333089713137,
1248
+ "grad_norm": 6.043541431427002,
1249
+ "learning_rate": 3.325130184542299e-05,
1250
+ "loss": 0.659,
1251
+ "step": 88000
1252
+ },
1253
+ {
1254
+ "epoch": 1.0106431573177417,
1255
+ "grad_norm": 11.223109245300293,
1256
+ "learning_rate": 3.315613770631585e-05,
1257
+ "loss": 0.6486,
1258
+ "step": 88500
1259
+ },
1260
+ {
1261
+ "epoch": 1.0163530056641696,
1262
+ "grad_norm": 21.971487045288086,
1263
+ "learning_rate": 3.306097356720872e-05,
1264
+ "loss": 0.6383,
1265
+ "step": 89000
1266
+ },
1267
+ {
1268
+ "epoch": 1.0220628540105974,
1269
+ "grad_norm": 20.942811965942383,
1270
+ "learning_rate": 3.296580942810159e-05,
1271
+ "loss": 0.6392,
1272
+ "step": 89500
1273
+ },
1274
+ {
1275
+ "epoch": 1.0277727023570253,
1276
+ "grad_norm": 13.14045524597168,
1277
+ "learning_rate": 3.287064528899446e-05,
1278
+ "loss": 0.6435,
1279
+ "step": 90000
1280
+ },
1281
+ {
1282
+ "epoch": 1.0334825507034533,
1283
+ "grad_norm": 13.744214057922363,
1284
+ "learning_rate": 3.2775481149887325e-05,
1285
+ "loss": 0.6805,
1286
+ "step": 90500
1287
+ },
1288
+ {
1289
+ "epoch": 1.0391923990498813,
1290
+ "grad_norm": 11.761612892150879,
1291
+ "learning_rate": 3.2680317010780194e-05,
1292
+ "loss": 0.6469,
1293
+ "step": 91000
1294
+ },
1295
+ {
1296
+ "epoch": 1.0449022473963092,
1297
+ "grad_norm": 18.324495315551758,
1298
+ "learning_rate": 3.2585152871673064e-05,
1299
+ "loss": 0.6631,
1300
+ "step": 91500
1301
+ },
1302
+ {
1303
+ "epoch": 1.0506120957427372,
1304
+ "grad_norm": 17.75140380859375,
1305
+ "learning_rate": 3.248998873256593e-05,
1306
+ "loss": 0.6404,
1307
+ "step": 92000
1308
+ },
1309
+ {
1310
+ "epoch": 1.056321944089165,
1311
+ "grad_norm": 8.40963077545166,
1312
+ "learning_rate": 3.23948245934588e-05,
1313
+ "loss": 0.6524,
1314
+ "step": 92500
1315
+ },
1316
+ {
1317
+ "epoch": 1.0620317924355929,
1318
+ "grad_norm": 17.263813018798828,
1319
+ "learning_rate": 3.229966045435167e-05,
1320
+ "loss": 0.6435,
1321
+ "step": 93000
1322
+ },
1323
+ {
1324
+ "epoch": 1.0677416407820208,
1325
+ "grad_norm": 13.104687690734863,
1326
+ "learning_rate": 3.220449631524454e-05,
1327
+ "loss": 0.672,
1328
+ "step": 93500
1329
+ },
1330
+ {
1331
+ "epoch": 1.0734514891284488,
1332
+ "grad_norm": 18.809045791625977,
1333
+ "learning_rate": 3.21093321761374e-05,
1334
+ "loss": 0.6613,
1335
+ "step": 94000
1336
+ },
1337
+ {
1338
+ "epoch": 1.0791613374748767,
1339
+ "grad_norm": 13.016844749450684,
1340
+ "learning_rate": 3.2014168037030276e-05,
1341
+ "loss": 0.6243,
1342
+ "step": 94500
1343
+ },
1344
+ {
1345
+ "epoch": 1.0848711858213045,
1346
+ "grad_norm": 11.810553550720215,
1347
+ "learning_rate": 3.191900389792314e-05,
1348
+ "loss": 0.6519,
1349
+ "step": 95000
1350
+ },
1351
+ {
1352
+ "epoch": 1.0905810341677324,
1353
+ "grad_norm": 20.478839874267578,
1354
+ "learning_rate": 3.182383975881601e-05,
1355
+ "loss": 0.6402,
1356
+ "step": 95500
1357
+ },
1358
+ {
1359
+ "epoch": 1.0962908825141604,
1360
+ "grad_norm": 17.17705726623535,
1361
+ "learning_rate": 3.172867561970887e-05,
1362
+ "loss": 0.6828,
1363
+ "step": 96000
1364
+ },
1365
+ {
1366
+ "epoch": 1.1020007308605884,
1367
+ "grad_norm": 14.574952125549316,
1368
+ "learning_rate": 3.163351148060174e-05,
1369
+ "loss": 0.6734,
1370
+ "step": 96500
1371
+ },
1372
+ {
1373
+ "epoch": 1.1077105792070163,
1374
+ "grad_norm": 15.769391059875488,
1375
+ "learning_rate": 3.153834734149461e-05,
1376
+ "loss": 0.6624,
1377
+ "step": 97000
1378
+ },
1379
+ {
1380
+ "epoch": 1.1134204275534443,
1381
+ "grad_norm": 9.247328758239746,
1382
+ "learning_rate": 3.1443183202387475e-05,
1383
+ "loss": 0.6281,
1384
+ "step": 97500
1385
+ },
1386
+ {
1387
+ "epoch": 1.119130275899872,
1388
+ "grad_norm": 22.8876953125,
1389
+ "learning_rate": 3.134801906328035e-05,
1390
+ "loss": 0.6617,
1391
+ "step": 98000
1392
+ },
1393
+ {
1394
+ "epoch": 1.1248401242463,
1395
+ "grad_norm": 9.880688667297363,
1396
+ "learning_rate": 3.1252854924173215e-05,
1397
+ "loss": 0.6485,
1398
+ "step": 98500
1399
+ },
1400
+ {
1401
+ "epoch": 1.130549972592728,
1402
+ "grad_norm": 1.8951044082641602,
1403
+ "learning_rate": 3.1157690785066084e-05,
1404
+ "loss": 0.6495,
1405
+ "step": 99000
1406
+ },
1407
+ {
1408
+ "epoch": 1.136259820939156,
1409
+ "grad_norm": 21.298824310302734,
1410
+ "learning_rate": 3.106252664595895e-05,
1411
+ "loss": 0.6656,
1412
+ "step": 99500
1413
+ },
1414
+ {
1415
+ "epoch": 1.1419696692855839,
1416
+ "grad_norm": 16.68634605407715,
1417
+ "learning_rate": 3.0967362506851824e-05,
1418
+ "loss": 0.6832,
1419
+ "step": 100000
1420
+ },
1421
+ {
1422
+ "epoch": 1.1476795176320116,
1423
+ "grad_norm": 4.926513671875,
1424
+ "learning_rate": 3.087219836774469e-05,
1425
+ "loss": 0.6636,
1426
+ "step": 100500
1427
+ },
1428
+ {
1429
+ "epoch": 1.1533893659784396,
1430
+ "grad_norm": 9.614105224609375,
1431
+ "learning_rate": 3.077703422863756e-05,
1432
+ "loss": 0.6556,
1433
+ "step": 101000
1434
+ },
1435
+ {
1436
+ "epoch": 1.1590992143248675,
1437
+ "grad_norm": 12.843193054199219,
1438
+ "learning_rate": 3.068187008953043e-05,
1439
+ "loss": 0.648,
1440
+ "step": 101500
1441
+ },
1442
+ {
1443
+ "epoch": 1.1648090626712955,
1444
+ "grad_norm": 11.666163444519043,
1445
+ "learning_rate": 3.058670595042329e-05,
1446
+ "loss": 0.6398,
1447
+ "step": 102000
1448
+ },
1449
+ {
1450
+ "epoch": 1.1705189110177234,
1451
+ "grad_norm": 12.201619148254395,
1452
+ "learning_rate": 3.049154181131616e-05,
1453
+ "loss": 0.663,
1454
+ "step": 102500
1455
+ },
1456
+ {
1457
+ "epoch": 1.1762287593641512,
1458
+ "grad_norm": 14.317974090576172,
1459
+ "learning_rate": 3.0396377672209026e-05,
1460
+ "loss": 0.6625,
1461
+ "step": 103000
1462
+ },
1463
+ {
1464
+ "epoch": 1.1819386077105791,
1465
+ "grad_norm": 2.6237876415252686,
1466
+ "learning_rate": 3.0301213533101896e-05,
1467
+ "loss": 0.6615,
1468
+ "step": 103500
1469
+ },
1470
+ {
1471
+ "epoch": 1.187648456057007,
1472
+ "grad_norm": 17.301959991455078,
1473
+ "learning_rate": 3.0206049393994762e-05,
1474
+ "loss": 0.6512,
1475
+ "step": 104000
1476
+ },
1477
+ {
1478
+ "epoch": 1.193358304403435,
1479
+ "grad_norm": 2.7448859214782715,
1480
+ "learning_rate": 3.0110885254887632e-05,
1481
+ "loss": 0.663,
1482
+ "step": 104500
1483
+ },
1484
+ {
1485
+ "epoch": 1.199068152749863,
1486
+ "grad_norm": 17.2750186920166,
1487
+ "learning_rate": 3.00157211157805e-05,
1488
+ "loss": 0.6651,
1489
+ "step": 105000
1490
+ },
1491
+ {
1492
+ "epoch": 1.204778001096291,
1493
+ "grad_norm": 10.277725219726562,
1494
+ "learning_rate": 2.992055697667337e-05,
1495
+ "loss": 0.6601,
1496
+ "step": 105500
1497
+ },
1498
+ {
1499
+ "epoch": 1.210487849442719,
1500
+ "grad_norm": 4.874946594238281,
1501
+ "learning_rate": 2.9825392837566235e-05,
1502
+ "loss": 0.6512,
1503
+ "step": 106000
1504
+ },
1505
+ {
1506
+ "epoch": 1.2161976977891467,
1507
+ "grad_norm": 15.240094184875488,
1508
+ "learning_rate": 2.9730228698459105e-05,
1509
+ "loss": 0.6577,
1510
+ "step": 106500
1511
+ },
1512
+ {
1513
+ "epoch": 1.2219075461355746,
1514
+ "grad_norm": 9.769597053527832,
1515
+ "learning_rate": 2.963506455935197e-05,
1516
+ "loss": 0.6278,
1517
+ "step": 107000
1518
+ },
1519
+ {
1520
+ "epoch": 1.2276173944820026,
1521
+ "grad_norm": 0.5976600646972656,
1522
+ "learning_rate": 2.9539900420244838e-05,
1523
+ "loss": 0.6594,
1524
+ "step": 107500
1525
+ },
1526
+ {
1527
+ "epoch": 1.2333272428284305,
1528
+ "grad_norm": 18.59908676147461,
1529
+ "learning_rate": 2.9444736281137707e-05,
1530
+ "loss": 0.6825,
1531
+ "step": 108000
1532
+ },
1533
+ {
1534
+ "epoch": 1.2390370911748585,
1535
+ "grad_norm": 3.672245979309082,
1536
+ "learning_rate": 2.9349572142030574e-05,
1537
+ "loss": 0.6594,
1538
+ "step": 108500
1539
+ },
1540
+ {
1541
+ "epoch": 1.2447469395212862,
1542
+ "grad_norm": 13.294546127319336,
1543
+ "learning_rate": 2.9254408002923444e-05,
1544
+ "loss": 0.6717,
1545
+ "step": 109000
1546
+ },
1547
+ {
1548
+ "epoch": 1.2504567878677142,
1549
+ "grad_norm": 19.214567184448242,
1550
+ "learning_rate": 2.915924386381631e-05,
1551
+ "loss": 0.6645,
1552
+ "step": 109500
1553
+ },
1554
+ {
1555
+ "epoch": 1.2561666362141422,
1556
+ "grad_norm": 15.022801399230957,
1557
+ "learning_rate": 2.906407972470918e-05,
1558
+ "loss": 0.6347,
1559
+ "step": 110000
1560
+ },
1561
+ {
1562
+ "epoch": 1.26187648456057,
1563
+ "grad_norm": 8.532743453979492,
1564
+ "learning_rate": 2.8968915585602046e-05,
1565
+ "loss": 0.6409,
1566
+ "step": 110500
1567
+ },
1568
+ {
1569
+ "epoch": 1.267586332906998,
1570
+ "grad_norm": 9.182174682617188,
1571
+ "learning_rate": 2.8873751446494916e-05,
1572
+ "loss": 0.6612,
1573
+ "step": 111000
1574
+ },
1575
+ {
1576
+ "epoch": 1.2732961812534258,
1577
+ "grad_norm": 8.777841567993164,
1578
+ "learning_rate": 2.8778587307387783e-05,
1579
+ "loss": 0.6824,
1580
+ "step": 111500
1581
+ },
1582
+ {
1583
+ "epoch": 1.2790060295998538,
1584
+ "grad_norm": 8.157862663269043,
1585
+ "learning_rate": 2.8683423168280656e-05,
1586
+ "loss": 0.6656,
1587
+ "step": 112000
1588
+ },
1589
+ {
1590
+ "epoch": 1.2847158779462817,
1591
+ "grad_norm": 11.573844909667969,
1592
+ "learning_rate": 2.858825902917352e-05,
1593
+ "loss": 0.634,
1594
+ "step": 112500
1595
+ },
1596
+ {
1597
+ "epoch": 1.2904257262927097,
1598
+ "grad_norm": 6.937053680419922,
1599
+ "learning_rate": 2.8493094890066385e-05,
1600
+ "loss": 0.6445,
1601
+ "step": 113000
1602
+ },
1603
+ {
1604
+ "epoch": 1.2961355746391376,
1605
+ "grad_norm": 10.080662727355957,
1606
+ "learning_rate": 2.8397930750959255e-05,
1607
+ "loss": 0.6339,
1608
+ "step": 113500
1609
+ },
1610
+ {
1611
+ "epoch": 1.3018454229855654,
1612
+ "grad_norm": 15.859003067016602,
1613
+ "learning_rate": 2.830276661185212e-05,
1614
+ "loss": 0.6437,
1615
+ "step": 114000
1616
+ },
1617
+ {
1618
+ "epoch": 1.3075552713319933,
1619
+ "grad_norm": 14.5152587890625,
1620
+ "learning_rate": 2.820760247274499e-05,
1621
+ "loss": 0.6335,
1622
+ "step": 114500
1623
+ },
1624
+ {
1625
+ "epoch": 1.3132651196784213,
1626
+ "grad_norm": 9.342087745666504,
1627
+ "learning_rate": 2.8112438333637858e-05,
1628
+ "loss": 0.6377,
1629
+ "step": 115000
1630
+ },
1631
+ {
1632
+ "epoch": 1.3189749680248493,
1633
+ "grad_norm": 4.917702674865723,
1634
+ "learning_rate": 2.801727419453073e-05,
1635
+ "loss": 0.6234,
1636
+ "step": 115500
1637
+ },
1638
+ {
1639
+ "epoch": 1.3246848163712772,
1640
+ "grad_norm": 19.32823944091797,
1641
+ "learning_rate": 2.7922110055423594e-05,
1642
+ "loss": 0.6359,
1643
+ "step": 116000
1644
+ },
1645
+ {
1646
+ "epoch": 1.3303946647177052,
1647
+ "grad_norm": 16.717939376831055,
1648
+ "learning_rate": 2.7826945916316467e-05,
1649
+ "loss": 0.6504,
1650
+ "step": 116500
1651
+ },
1652
+ {
1653
+ "epoch": 1.3361045130641331,
1654
+ "grad_norm": 15.398698806762695,
1655
+ "learning_rate": 2.773178177720933e-05,
1656
+ "loss": 0.6286,
1657
+ "step": 117000
1658
+ },
1659
+ {
1660
+ "epoch": 1.3418143614105609,
1661
+ "grad_norm": 7.797182083129883,
1662
+ "learning_rate": 2.7636617638102203e-05,
1663
+ "loss": 0.6481,
1664
+ "step": 117500
1665
+ },
1666
+ {
1667
+ "epoch": 1.3475242097569888,
1668
+ "grad_norm": 12.790301322937012,
1669
+ "learning_rate": 2.7541453498995067e-05,
1670
+ "loss": 0.6516,
1671
+ "step": 118000
1672
+ },
1673
+ {
1674
+ "epoch": 1.3532340581034168,
1675
+ "grad_norm": 10.504387855529785,
1676
+ "learning_rate": 2.7446289359887933e-05,
1677
+ "loss": 0.6493,
1678
+ "step": 118500
1679
+ },
1680
+ {
1681
+ "epoch": 1.3589439064498448,
1682
+ "grad_norm": 10.009203910827637,
1683
+ "learning_rate": 2.7351125220780803e-05,
1684
+ "loss": 0.634,
1685
+ "step": 119000
1686
+ },
1687
+ {
1688
+ "epoch": 1.3646537547962727,
1689
+ "grad_norm": 6.9657464027404785,
1690
+ "learning_rate": 2.725596108167367e-05,
1691
+ "loss": 0.6497,
1692
+ "step": 119500
1693
+ },
1694
+ {
1695
+ "epoch": 1.3703636031427004,
1696
+ "grad_norm": 23.387422561645508,
1697
+ "learning_rate": 2.7160796942566542e-05,
1698
+ "loss": 0.627,
1699
+ "step": 120000
1700
+ },
1701
+ {
1702
+ "epoch": 1.3760734514891284,
1703
+ "grad_norm": 10.866159439086914,
1704
+ "learning_rate": 2.7065632803459405e-05,
1705
+ "loss": 0.6659,
1706
+ "step": 120500
1707
+ },
1708
+ {
1709
+ "epoch": 1.3817832998355564,
1710
+ "grad_norm": 0.3892815113067627,
1711
+ "learning_rate": 2.697046866435228e-05,
1712
+ "loss": 0.6184,
1713
+ "step": 121000
1714
+ },
1715
+ {
1716
+ "epoch": 1.3874931481819843,
1717
+ "grad_norm": 17.462556838989258,
1718
+ "learning_rate": 2.6875304525245142e-05,
1719
+ "loss": 0.6332,
1720
+ "step": 121500
1721
+ },
1722
+ {
1723
+ "epoch": 1.3932029965284123,
1724
+ "grad_norm": 15.368428230285645,
1725
+ "learning_rate": 2.6780140386138015e-05,
1726
+ "loss": 0.6281,
1727
+ "step": 122000
1728
+ },
1729
+ {
1730
+ "epoch": 1.39891284487484,
1731
+ "grad_norm": 10.465868949890137,
1732
+ "learning_rate": 2.6684976247030878e-05,
1733
+ "loss": 0.6542,
1734
+ "step": 122500
1735
+ },
1736
+ {
1737
+ "epoch": 1.404622693221268,
1738
+ "grad_norm": 8.983809471130371,
1739
+ "learning_rate": 2.658981210792375e-05,
1740
+ "loss": 0.6455,
1741
+ "step": 123000
1742
+ },
1743
+ {
1744
+ "epoch": 1.410332541567696,
1745
+ "grad_norm": 12.235846519470215,
1746
+ "learning_rate": 2.6494647968816618e-05,
1747
+ "loss": 0.6248,
1748
+ "step": 123500
1749
+ },
1750
+ {
1751
+ "epoch": 1.416042389914124,
1752
+ "grad_norm": 16.52556610107422,
1753
+ "learning_rate": 2.639948382970948e-05,
1754
+ "loss": 0.6468,
1755
+ "step": 124000
1756
+ },
1757
+ {
1758
+ "epoch": 1.4217522382605519,
1759
+ "grad_norm": 8.142457008361816,
1760
+ "learning_rate": 2.6304319690602354e-05,
1761
+ "loss": 0.6635,
1762
+ "step": 124500
1763
+ },
1764
+ {
1765
+ "epoch": 1.4274620866069796,
1766
+ "grad_norm": 8.483154296875,
1767
+ "learning_rate": 2.6209155551495217e-05,
1768
+ "loss": 0.6441,
1769
+ "step": 125000
1770
+ },
1771
+ {
1772
+ "epoch": 1.4331719349534076,
1773
+ "grad_norm": 8.840913772583008,
1774
+ "learning_rate": 2.611399141238809e-05,
1775
+ "loss": 0.6369,
1776
+ "step": 125500
1777
+ },
1778
+ {
1779
+ "epoch": 1.4388817832998355,
1780
+ "grad_norm": 18.232011795043945,
1781
+ "learning_rate": 2.6018827273280953e-05,
1782
+ "loss": 0.6569,
1783
+ "step": 126000
1784
+ },
1785
+ {
1786
+ "epoch": 1.4445916316462635,
1787
+ "grad_norm": 18.43021011352539,
1788
+ "learning_rate": 2.5923663134173826e-05,
1789
+ "loss": 0.6708,
1790
+ "step": 126500
1791
+ },
1792
+ {
1793
+ "epoch": 1.4503014799926914,
1794
+ "grad_norm": 8.480986595153809,
1795
+ "learning_rate": 2.5828498995066693e-05,
1796
+ "loss": 0.6348,
1797
+ "step": 127000
1798
+ },
1799
+ {
1800
+ "epoch": 1.4560113283391194,
1801
+ "grad_norm": 19.831527709960938,
1802
+ "learning_rate": 2.5733334855959563e-05,
1803
+ "loss": 0.6337,
1804
+ "step": 127500
1805
+ },
1806
+ {
1807
+ "epoch": 1.4617211766855474,
1808
+ "grad_norm": 16.276309967041016,
1809
+ "learning_rate": 2.563817071685243e-05,
1810
+ "loss": 0.6317,
1811
+ "step": 128000
1812
+ },
1813
+ {
1814
+ "epoch": 1.467431025031975,
1815
+ "grad_norm": 17.740375518798828,
1816
+ "learning_rate": 2.55430065777453e-05,
1817
+ "loss": 0.6391,
1818
+ "step": 128500
1819
+ },
1820
+ {
1821
+ "epoch": 1.473140873378403,
1822
+ "grad_norm": 13.25825309753418,
1823
+ "learning_rate": 2.5447842438638165e-05,
1824
+ "loss": 0.6351,
1825
+ "step": 129000
1826
+ },
1827
+ {
1828
+ "epoch": 1.478850721724831,
1829
+ "grad_norm": 13.454588890075684,
1830
+ "learning_rate": 2.535267829953103e-05,
1831
+ "loss": 0.6481,
1832
+ "step": 129500
1833
+ },
1834
+ {
1835
+ "epoch": 1.484560570071259,
1836
+ "grad_norm": 16.62687873840332,
1837
+ "learning_rate": 2.52575141604239e-05,
1838
+ "loss": 0.6466,
1839
+ "step": 130000
1840
+ },
1841
+ {
1842
+ "epoch": 1.490270418417687,
1843
+ "grad_norm": 9.228678703308105,
1844
+ "learning_rate": 2.5162350021316765e-05,
1845
+ "loss": 0.64,
1846
+ "step": 130500
1847
+ },
1848
+ {
1849
+ "epoch": 1.4959802667641147,
1850
+ "grad_norm": 12.264765739440918,
1851
+ "learning_rate": 2.5067185882209638e-05,
1852
+ "loss": 0.611,
1853
+ "step": 131000
1854
+ },
1855
+ {
1856
+ "epoch": 1.5016901151105426,
1857
+ "grad_norm": 11.804875373840332,
1858
+ "learning_rate": 2.4972021743102504e-05,
1859
+ "loss": 0.6497,
1860
+ "step": 131500
1861
+ },
1862
+ {
1863
+ "epoch": 1.5073999634569706,
1864
+ "grad_norm": 9.199178695678711,
1865
+ "learning_rate": 2.4876857603995374e-05,
1866
+ "loss": 0.6564,
1867
+ "step": 132000
1868
+ },
1869
+ {
1870
+ "epoch": 1.5131098118033985,
1871
+ "grad_norm": 16.46022605895996,
1872
+ "learning_rate": 2.478169346488824e-05,
1873
+ "loss": 0.6225,
1874
+ "step": 132500
1875
+ },
1876
+ {
1877
+ "epoch": 1.5188196601498265,
1878
+ "grad_norm": 26.10277557373047,
1879
+ "learning_rate": 2.4686529325781107e-05,
1880
+ "loss": 0.6661,
1881
+ "step": 133000
1882
+ },
1883
+ {
1884
+ "epoch": 1.5245295084962542,
1885
+ "grad_norm": 6.263282775878906,
1886
+ "learning_rate": 2.4591365186673977e-05,
1887
+ "loss": 0.6548,
1888
+ "step": 133500
1889
+ },
1890
+ {
1891
+ "epoch": 1.5302393568426824,
1892
+ "grad_norm": 16.399032592773438,
1893
+ "learning_rate": 2.4496201047566843e-05,
1894
+ "loss": 0.6521,
1895
+ "step": 134000
1896
+ },
1897
+ {
1898
+ "epoch": 1.5359492051891102,
1899
+ "grad_norm": 11.514322280883789,
1900
+ "learning_rate": 2.4401036908459713e-05,
1901
+ "loss": 0.6498,
1902
+ "step": 134500
1903
+ },
1904
+ {
1905
+ "epoch": 1.5416590535355381,
1906
+ "grad_norm": 11.867612838745117,
1907
+ "learning_rate": 2.430587276935258e-05,
1908
+ "loss": 0.6381,
1909
+ "step": 135000
1910
+ },
1911
+ {
1912
+ "epoch": 1.547368901881966,
1913
+ "grad_norm": 9.079361915588379,
1914
+ "learning_rate": 2.421070863024545e-05,
1915
+ "loss": 0.6415,
1916
+ "step": 135500
1917
+ },
1918
+ {
1919
+ "epoch": 1.5530787502283938,
1920
+ "grad_norm": 12.407960891723633,
1921
+ "learning_rate": 2.4115544491138316e-05,
1922
+ "loss": 0.6379,
1923
+ "step": 136000
1924
+ },
1925
+ {
1926
+ "epoch": 1.558788598574822,
1927
+ "grad_norm": 18.794862747192383,
1928
+ "learning_rate": 2.4020380352031186e-05,
1929
+ "loss": 0.6393,
1930
+ "step": 136500
1931
+ },
1932
+ {
1933
+ "epoch": 1.5644984469212497,
1934
+ "grad_norm": 13.497371673583984,
1935
+ "learning_rate": 2.3925216212924055e-05,
1936
+ "loss": 0.6446,
1937
+ "step": 137000
1938
+ },
1939
+ {
1940
+ "epoch": 1.5702082952676777,
1941
+ "grad_norm": 13.593029022216797,
1942
+ "learning_rate": 2.3830052073816922e-05,
1943
+ "loss": 0.671,
1944
+ "step": 137500
1945
+ },
1946
+ {
1947
+ "epoch": 1.5759181436141056,
1948
+ "grad_norm": 16.934734344482422,
1949
+ "learning_rate": 2.3734887934709788e-05,
1950
+ "loss": 0.6055,
1951
+ "step": 138000
1952
+ },
1953
+ {
1954
+ "epoch": 1.5816279919605334,
1955
+ "grad_norm": 35.854217529296875,
1956
+ "learning_rate": 2.3639723795602655e-05,
1957
+ "loss": 0.6551,
1958
+ "step": 138500
1959
+ },
1960
+ {
1961
+ "epoch": 1.5873378403069616,
1962
+ "grad_norm": 9.43678092956543,
1963
+ "learning_rate": 2.3544559656495524e-05,
1964
+ "loss": 0.6315,
1965
+ "step": 139000
1966
+ },
1967
+ {
1968
+ "epoch": 1.5930476886533893,
1969
+ "grad_norm": 14.417195320129395,
1970
+ "learning_rate": 2.344939551738839e-05,
1971
+ "loss": 0.6614,
1972
+ "step": 139500
1973
+ },
1974
+ {
1975
+ "epoch": 1.5987575369998173,
1976
+ "grad_norm": 25.098596572875977,
1977
+ "learning_rate": 2.335423137828126e-05,
1978
+ "loss": 0.6866,
1979
+ "step": 140000
1980
+ },
1981
+ {
1982
+ "epoch": 1.6044673853462452,
1983
+ "grad_norm": 1.0968633890151978,
1984
+ "learning_rate": 2.3259067239174127e-05,
1985
+ "loss": 0.6231,
1986
+ "step": 140500
1987
+ },
1988
+ {
1989
+ "epoch": 1.610177233692673,
1990
+ "grad_norm": 14.93027114868164,
1991
+ "learning_rate": 2.3163903100066997e-05,
1992
+ "loss": 0.623,
1993
+ "step": 141000
1994
+ },
1995
+ {
1996
+ "epoch": 1.6158870820391011,
1997
+ "grad_norm": 7.8229217529296875,
1998
+ "learning_rate": 2.3068738960959867e-05,
1999
+ "loss": 0.6352,
2000
+ "step": 141500
2001
+ },
2002
+ {
2003
+ "epoch": 1.6215969303855289,
2004
+ "grad_norm": 22.783891677856445,
2005
+ "learning_rate": 2.2973574821852733e-05,
2006
+ "loss": 0.6648,
2007
+ "step": 142000
2008
+ },
2009
+ {
2010
+ "epoch": 1.6273067787319568,
2011
+ "grad_norm": 19.90745735168457,
2012
+ "learning_rate": 2.2878410682745603e-05,
2013
+ "loss": 0.6145,
2014
+ "step": 142500
2015
+ },
2016
+ {
2017
+ "epoch": 1.6330166270783848,
2018
+ "grad_norm": 17.821516036987305,
2019
+ "learning_rate": 2.2783246543638466e-05,
2020
+ "loss": 0.6563,
2021
+ "step": 143000
2022
+ },
2023
+ {
2024
+ "epoch": 1.6387264754248128,
2025
+ "grad_norm": 9.5968017578125,
2026
+ "learning_rate": 2.2688082404531336e-05,
2027
+ "loss": 0.6508,
2028
+ "step": 143500
2029
+ },
2030
+ {
2031
+ "epoch": 1.6444363237712407,
2032
+ "grad_norm": 16.756736755371094,
2033
+ "learning_rate": 2.2592918265424202e-05,
2034
+ "loss": 0.6351,
2035
+ "step": 144000
2036
+ },
2037
+ {
2038
+ "epoch": 1.6501461721176685,
2039
+ "grad_norm": 16.5711669921875,
2040
+ "learning_rate": 2.2497754126317072e-05,
2041
+ "loss": 0.6427,
2042
+ "step": 144500
2043
+ },
2044
+ {
2045
+ "epoch": 1.6558560204640966,
2046
+ "grad_norm": 10.586766242980957,
2047
+ "learning_rate": 2.2402589987209942e-05,
2048
+ "loss": 0.6498,
2049
+ "step": 145000
2050
+ },
2051
+ {
2052
+ "epoch": 1.6615658688105244,
2053
+ "grad_norm": 8.226187705993652,
2054
+ "learning_rate": 2.230742584810281e-05,
2055
+ "loss": 0.606,
2056
+ "step": 145500
2057
+ },
2058
+ {
2059
+ "epoch": 1.6672757171569523,
2060
+ "grad_norm": 13.555891990661621,
2061
+ "learning_rate": 2.2212261708995678e-05,
2062
+ "loss": 0.6561,
2063
+ "step": 146000
2064
+ },
2065
+ {
2066
+ "epoch": 1.6729855655033803,
2067
+ "grad_norm": 15.111556053161621,
2068
+ "learning_rate": 2.2117097569888545e-05,
2069
+ "loss": 0.6608,
2070
+ "step": 146500
2071
+ },
2072
+ {
2073
+ "epoch": 1.678695413849808,
2074
+ "grad_norm": 10.722761154174805,
2075
+ "learning_rate": 2.2021933430781415e-05,
2076
+ "loss": 0.6519,
2077
+ "step": 147000
2078
+ },
2079
+ {
2080
+ "epoch": 1.6844052621962362,
2081
+ "grad_norm": 10.062471389770508,
2082
+ "learning_rate": 2.192676929167428e-05,
2083
+ "loss": 0.6234,
2084
+ "step": 147500
2085
+ },
2086
+ {
2087
+ "epoch": 1.690115110542664,
2088
+ "grad_norm": 20.23332977294922,
2089
+ "learning_rate": 2.183160515256715e-05,
2090
+ "loss": 0.6215,
2091
+ "step": 148000
2092
+ },
2093
+ {
2094
+ "epoch": 1.695824958889092,
2095
+ "grad_norm": 11.4010648727417,
2096
+ "learning_rate": 2.1736441013460014e-05,
2097
+ "loss": 0.6312,
2098
+ "step": 148500
2099
+ },
2100
+ {
2101
+ "epoch": 1.7015348072355199,
2102
+ "grad_norm": 19.603952407836914,
2103
+ "learning_rate": 2.1641276874352884e-05,
2104
+ "loss": 0.6238,
2105
+ "step": 149000
2106
+ },
2107
+ {
2108
+ "epoch": 1.7072446555819476,
2109
+ "grad_norm": 15.310028076171875,
2110
+ "learning_rate": 2.1546112735245753e-05,
2111
+ "loss": 0.6492,
2112
+ "step": 149500
2113
+ },
2114
+ {
2115
+ "epoch": 1.7129545039283758,
2116
+ "grad_norm": 10.911367416381836,
2117
+ "learning_rate": 2.145094859613862e-05,
2118
+ "loss": 0.6585,
2119
+ "step": 150000
2120
+ },
2121
+ {
2122
+ "epoch": 1.7186643522748035,
2123
+ "grad_norm": 21.328384399414062,
2124
+ "learning_rate": 2.135578445703149e-05,
2125
+ "loss": 0.649,
2126
+ "step": 150500
2127
+ },
2128
+ {
2129
+ "epoch": 1.7243742006212315,
2130
+ "grad_norm": 16.059486389160156,
2131
+ "learning_rate": 2.1260620317924356e-05,
2132
+ "loss": 0.6313,
2133
+ "step": 151000
2134
+ },
2135
+ {
2136
+ "epoch": 1.7300840489676594,
2137
+ "grad_norm": 16.90313148498535,
2138
+ "learning_rate": 2.1165456178817226e-05,
2139
+ "loss": 0.6383,
2140
+ "step": 151500
2141
+ },
2142
+ {
2143
+ "epoch": 1.7357938973140872,
2144
+ "grad_norm": 2.6563591957092285,
2145
+ "learning_rate": 2.1070292039710092e-05,
2146
+ "loss": 0.6315,
2147
+ "step": 152000
2148
+ },
2149
+ {
2150
+ "epoch": 1.7415037456605154,
2151
+ "grad_norm": 6.195246696472168,
2152
+ "learning_rate": 2.0975127900602962e-05,
2153
+ "loss": 0.6738,
2154
+ "step": 152500
2155
+ },
2156
+ {
2157
+ "epoch": 1.747213594006943,
2158
+ "grad_norm": 20.523630142211914,
2159
+ "learning_rate": 2.087996376149583e-05,
2160
+ "loss": 0.643,
2161
+ "step": 153000
2162
+ },
2163
+ {
2164
+ "epoch": 1.752923442353371,
2165
+ "grad_norm": 14.711372375488281,
2166
+ "learning_rate": 2.07847996223887e-05,
2167
+ "loss": 0.602,
2168
+ "step": 153500
2169
+ },
2170
+ {
2171
+ "epoch": 1.758633290699799,
2172
+ "grad_norm": 13.794620513916016,
2173
+ "learning_rate": 2.0689635483281565e-05,
2174
+ "loss": 0.6264,
2175
+ "step": 154000
2176
+ },
2177
+ {
2178
+ "epoch": 1.764343139046227,
2179
+ "grad_norm": 21.301605224609375,
2180
+ "learning_rate": 2.059447134417443e-05,
2181
+ "loss": 0.6519,
2182
+ "step": 154500
2183
+ },
2184
+ {
2185
+ "epoch": 1.770052987392655,
2186
+ "grad_norm": 14.508129119873047,
2187
+ "learning_rate": 2.04993072050673e-05,
2188
+ "loss": 0.6283,
2189
+ "step": 155000
2190
+ },
2191
+ {
2192
+ "epoch": 1.7757628357390827,
2193
+ "grad_norm": 18.921592712402344,
2194
+ "learning_rate": 2.0404143065960168e-05,
2195
+ "loss": 0.6311,
2196
+ "step": 155500
2197
+ },
2198
+ {
2199
+ "epoch": 1.7814726840855108,
2200
+ "grad_norm": 10.158668518066406,
2201
+ "learning_rate": 2.0308978926853037e-05,
2202
+ "loss": 0.5985,
2203
+ "step": 156000
2204
+ },
2205
+ {
2206
+ "epoch": 1.7871825324319386,
2207
+ "grad_norm": 10.066750526428223,
2208
+ "learning_rate": 2.0213814787745904e-05,
2209
+ "loss": 0.6448,
2210
+ "step": 156500
2211
+ },
2212
+ {
2213
+ "epoch": 1.7928923807783665,
2214
+ "grad_norm": 13.795319557189941,
2215
+ "learning_rate": 2.0118650648638774e-05,
2216
+ "loss": 0.6223,
2217
+ "step": 157000
2218
+ },
2219
+ {
2220
+ "epoch": 1.7986022291247945,
2221
+ "grad_norm": 16.835466384887695,
2222
+ "learning_rate": 2.002348650953164e-05,
2223
+ "loss": 0.63,
2224
+ "step": 157500
2225
+ },
2226
+ {
2227
+ "epoch": 1.8043120774712222,
2228
+ "grad_norm": 14.02375316619873,
2229
+ "learning_rate": 1.992832237042451e-05,
2230
+ "loss": 0.6233,
2231
+ "step": 158000
2232
+ },
2233
+ {
2234
+ "epoch": 1.8100219258176504,
2235
+ "grad_norm": 12.268004417419434,
2236
+ "learning_rate": 1.9833158231317376e-05,
2237
+ "loss": 0.6232,
2238
+ "step": 158500
2239
+ },
2240
+ {
2241
+ "epoch": 1.8157317741640782,
2242
+ "grad_norm": 13.739754676818848,
2243
+ "learning_rate": 1.9737994092210246e-05,
2244
+ "loss": 0.5908,
2245
+ "step": 159000
2246
+ },
2247
+ {
2248
+ "epoch": 1.8214416225105061,
2249
+ "grad_norm": 13.307083129882812,
2250
+ "learning_rate": 1.9642829953103113e-05,
2251
+ "loss": 0.6251,
2252
+ "step": 159500
2253
+ },
2254
+ {
2255
+ "epoch": 1.827151470856934,
2256
+ "grad_norm": 12.488615036010742,
2257
+ "learning_rate": 1.954766581399598e-05,
2258
+ "loss": 0.6112,
2259
+ "step": 160000
2260
+ },
2261
+ {
2262
+ "epoch": 1.8328613192033618,
2263
+ "grad_norm": 28.27214813232422,
2264
+ "learning_rate": 1.945250167488885e-05,
2265
+ "loss": 0.5847,
2266
+ "step": 160500
2267
+ },
2268
+ {
2269
+ "epoch": 1.83857116754979,
2270
+ "grad_norm": 20.4050350189209,
2271
+ "learning_rate": 1.9357337535781715e-05,
2272
+ "loss": 0.637,
2273
+ "step": 161000
2274
+ },
2275
+ {
2276
+ "epoch": 1.8442810158962177,
2277
+ "grad_norm": 7.468199253082275,
2278
+ "learning_rate": 1.9262173396674585e-05,
2279
+ "loss": 0.6167,
2280
+ "step": 161500
2281
+ },
2282
+ {
2283
+ "epoch": 1.8499908642426457,
2284
+ "grad_norm": 7.347966194152832,
2285
+ "learning_rate": 1.916700925756745e-05,
2286
+ "loss": 0.6244,
2287
+ "step": 162000
2288
+ },
2289
+ {
2290
+ "epoch": 1.8557007125890737,
2291
+ "grad_norm": 20.314546585083008,
2292
+ "learning_rate": 1.907184511846032e-05,
2293
+ "loss": 0.642,
2294
+ "step": 162500
2295
+ },
2296
+ {
2297
+ "epoch": 1.8614105609355014,
2298
+ "grad_norm": 15.169089317321777,
2299
+ "learning_rate": 1.897668097935319e-05,
2300
+ "loss": 0.6376,
2301
+ "step": 163000
2302
+ },
2303
+ {
2304
+ "epoch": 1.8671204092819296,
2305
+ "grad_norm": 9.24698257446289,
2306
+ "learning_rate": 1.8881516840246058e-05,
2307
+ "loss": 0.6274,
2308
+ "step": 163500
2309
+ },
2310
+ {
2311
+ "epoch": 1.8728302576283573,
2312
+ "grad_norm": 12.470107078552246,
2313
+ "learning_rate": 1.8786352701138927e-05,
2314
+ "loss": 0.6179,
2315
+ "step": 164000
2316
+ },
2317
+ {
2318
+ "epoch": 1.8785401059747853,
2319
+ "grad_norm": 13.249616622924805,
2320
+ "learning_rate": 1.8691188562031794e-05,
2321
+ "loss": 0.6112,
2322
+ "step": 164500
2323
+ },
2324
+ {
2325
+ "epoch": 1.8842499543212132,
2326
+ "grad_norm": 13.781914710998535,
2327
+ "learning_rate": 1.859602442292466e-05,
2328
+ "loss": 0.6363,
2329
+ "step": 165000
2330
+ },
2331
+ {
2332
+ "epoch": 1.8899598026676412,
2333
+ "grad_norm": 13.1536226272583,
2334
+ "learning_rate": 1.8500860283817527e-05,
2335
+ "loss": 0.6505,
2336
+ "step": 165500
2337
+ },
2338
+ {
2339
+ "epoch": 1.8956696510140691,
2340
+ "grad_norm": 10.897488594055176,
2341
+ "learning_rate": 1.8405696144710397e-05,
2342
+ "loss": 0.5786,
2343
+ "step": 166000
2344
+ },
2345
+ {
2346
+ "epoch": 1.9013794993604969,
2347
+ "grad_norm": 10.180983543395996,
2348
+ "learning_rate": 1.8310532005603266e-05,
2349
+ "loss": 0.6278,
2350
+ "step": 166500
2351
+ },
2352
+ {
2353
+ "epoch": 1.907089347706925,
2354
+ "grad_norm": 9.879364013671875,
2355
+ "learning_rate": 1.8215367866496133e-05,
2356
+ "loss": 0.6252,
2357
+ "step": 167000
2358
+ },
2359
+ {
2360
+ "epoch": 1.9127991960533528,
2361
+ "grad_norm": 19.131149291992188,
2362
+ "learning_rate": 1.8120203727389003e-05,
2363
+ "loss": 0.6246,
2364
+ "step": 167500
2365
+ },
2366
+ {
2367
+ "epoch": 1.9185090443997808,
2368
+ "grad_norm": 5.495462894439697,
2369
+ "learning_rate": 1.802503958828187e-05,
2370
+ "loss": 0.5948,
2371
+ "step": 168000
2372
+ },
2373
+ {
2374
+ "epoch": 1.9242188927462087,
2375
+ "grad_norm": 4.23709774017334,
2376
+ "learning_rate": 1.792987544917474e-05,
2377
+ "loss": 0.6307,
2378
+ "step": 168500
2379
+ },
2380
+ {
2381
+ "epoch": 1.9299287410926365,
2382
+ "grad_norm": 12.203195571899414,
2383
+ "learning_rate": 1.7834711310067605e-05,
2384
+ "loss": 0.6297,
2385
+ "step": 169000
2386
+ },
2387
+ {
2388
+ "epoch": 1.9356385894390646,
2389
+ "grad_norm": 19.000078201293945,
2390
+ "learning_rate": 1.7739547170960475e-05,
2391
+ "loss": 0.5957,
2392
+ "step": 169500
2393
+ },
2394
+ {
2395
+ "epoch": 1.9413484377854924,
2396
+ "grad_norm": 13.417240142822266,
2397
+ "learning_rate": 1.764438303185334e-05,
2398
+ "loss": 0.6069,
2399
+ "step": 170000
2400
+ },
2401
+ {
2402
+ "epoch": 1.9470582861319203,
2403
+ "grad_norm": 7.899953365325928,
2404
+ "learning_rate": 1.7549218892746208e-05,
2405
+ "loss": 0.6206,
2406
+ "step": 170500
2407
+ },
2408
+ {
2409
+ "epoch": 1.9527681344783483,
2410
+ "grad_norm": 10.010087013244629,
2411
+ "learning_rate": 1.7454054753639078e-05,
2412
+ "loss": 0.6349,
2413
+ "step": 171000
2414
+ },
2415
+ {
2416
+ "epoch": 1.958477982824776,
2417
+ "grad_norm": 4.651134490966797,
2418
+ "learning_rate": 1.7358890614531944e-05,
2419
+ "loss": 0.6087,
2420
+ "step": 171500
2421
+ },
2422
+ {
2423
+ "epoch": 1.9641878311712042,
2424
+ "grad_norm": 6.171414375305176,
2425
+ "learning_rate": 1.7263726475424814e-05,
2426
+ "loss": 0.6057,
2427
+ "step": 172000
2428
+ },
2429
+ {
2430
+ "epoch": 1.969897679517632,
2431
+ "grad_norm": 8.92005443572998,
2432
+ "learning_rate": 1.716856233631768e-05,
2433
+ "loss": 0.6345,
2434
+ "step": 172500
2435
+ },
2436
+ {
2437
+ "epoch": 1.97560752786406,
2438
+ "grad_norm": 0.8387286067008972,
2439
+ "learning_rate": 1.707339819721055e-05,
2440
+ "loss": 0.6136,
2441
+ "step": 173000
2442
+ },
2443
+ {
2444
+ "epoch": 1.9813173762104879,
2445
+ "grad_norm": 10.306057929992676,
2446
+ "learning_rate": 1.6978234058103417e-05,
2447
+ "loss": 0.6153,
2448
+ "step": 173500
2449
+ },
2450
+ {
2451
+ "epoch": 1.9870272245569156,
2452
+ "grad_norm": 14.236461639404297,
2453
+ "learning_rate": 1.6883069918996287e-05,
2454
+ "loss": 0.618,
2455
+ "step": 174000
2456
+ },
2457
+ {
2458
+ "epoch": 1.9927370729033438,
2459
+ "grad_norm": 18.890064239501953,
2460
+ "learning_rate": 1.6787905779889153e-05,
2461
+ "loss": 0.5829,
2462
+ "step": 174500
2463
+ },
2464
+ {
2465
+ "epoch": 1.9984469212497715,
2466
+ "grad_norm": 7.9164533615112305,
2467
+ "learning_rate": 1.6692741640782023e-05,
2468
+ "loss": 0.6237,
2469
+ "step": 175000
2470
+ },
2471
+ {
2472
+ "epoch": 2.0,
2473
+ "eval_f1": 0.7664832205066525,
2474
+ "eval_loss": 0.7202218770980835,
2475
+ "eval_runtime": 49.9329,
2476
+ "eval_samples_per_second": 1753.793,
2477
+ "eval_steps_per_second": 219.234,
2478
+ "step": 175136
2479
+ },
2480
+ {
2481
+ "epoch": 2.0041567695961997,
2482
+ "grad_norm": 14.6402587890625,
2483
+ "learning_rate": 1.659757750167489e-05,
2484
+ "loss": 0.5356,
2485
+ "step": 175500
2486
+ },
2487
+ {
2488
+ "epoch": 2.0098666179426274,
2489
+ "grad_norm": 11.641716003417969,
2490
+ "learning_rate": 1.6502413362567756e-05,
2491
+ "loss": 0.4917,
2492
+ "step": 176000
2493
+ },
2494
+ {
2495
+ "epoch": 2.015576466289055,
2496
+ "grad_norm": 6.198487281799316,
2497
+ "learning_rate": 1.6407249223460626e-05,
2498
+ "loss": 0.4878,
2499
+ "step": 176500
2500
+ },
2501
+ {
2502
+ "epoch": 2.0212863146354834,
2503
+ "grad_norm": 13.014154434204102,
2504
+ "learning_rate": 1.6312085084353492e-05,
2505
+ "loss": 0.5695,
2506
+ "step": 177000
2507
+ },
2508
+ {
2509
+ "epoch": 2.026996162981911,
2510
+ "grad_norm": 17.94867515563965,
2511
+ "learning_rate": 1.6216920945246362e-05,
2512
+ "loss": 0.487,
2513
+ "step": 177500
2514
+ },
2515
+ {
2516
+ "epoch": 2.0327060113283393,
2517
+ "grad_norm": 22.98967933654785,
2518
+ "learning_rate": 1.6121756806139228e-05,
2519
+ "loss": 0.5238,
2520
+ "step": 178000
2521
+ },
2522
+ {
2523
+ "epoch": 2.038415859674767,
2524
+ "grad_norm": 8.596515655517578,
2525
+ "learning_rate": 1.6026592667032098e-05,
2526
+ "loss": 0.5138,
2527
+ "step": 178500
2528
+ },
2529
+ {
2530
+ "epoch": 2.0441257080211948,
2531
+ "grad_norm": 2.9220588207244873,
2532
+ "learning_rate": 1.5931428527924965e-05,
2533
+ "loss": 0.4774,
2534
+ "step": 179000
2535
+ },
2536
+ {
2537
+ "epoch": 2.049835556367623,
2538
+ "grad_norm": 11.015026092529297,
2539
+ "learning_rate": 1.5836264388817834e-05,
2540
+ "loss": 0.5282,
2541
+ "step": 179500
2542
+ },
2543
+ {
2544
+ "epoch": 2.0555454047140507,
2545
+ "grad_norm": 11.531243324279785,
2546
+ "learning_rate": 1.57411002497107e-05,
2547
+ "loss": 0.5048,
2548
+ "step": 180000
2549
+ },
2550
+ {
2551
+ "epoch": 2.061255253060479,
2552
+ "grad_norm": 20.80113983154297,
2553
+ "learning_rate": 1.564593611060357e-05,
2554
+ "loss": 0.5413,
2555
+ "step": 180500
2556
+ },
2557
+ {
2558
+ "epoch": 2.0669651014069066,
2559
+ "grad_norm": 6.490297794342041,
2560
+ "learning_rate": 1.555077197149644e-05,
2561
+ "loss": 0.5132,
2562
+ "step": 181000
2563
+ },
2564
+ {
2565
+ "epoch": 2.0726749497533348,
2566
+ "grad_norm": 30.747642517089844,
2567
+ "learning_rate": 1.5455607832389303e-05,
2568
+ "loss": 0.4966,
2569
+ "step": 181500
2570
+ },
2571
+ {
2572
+ "epoch": 2.0783847980997625,
2573
+ "grad_norm": 17.9570255279541,
2574
+ "learning_rate": 1.5360443693282173e-05,
2575
+ "loss": 0.4817,
2576
+ "step": 182000
2577
+ },
2578
+ {
2579
+ "epoch": 2.0840946464461902,
2580
+ "grad_norm": 12.99807357788086,
2581
+ "learning_rate": 1.526527955417504e-05,
2582
+ "loss": 0.5095,
2583
+ "step": 182500
2584
+ },
2585
+ {
2586
+ "epoch": 2.0898044947926184,
2587
+ "grad_norm": 4.4048261642456055,
2588
+ "learning_rate": 1.517011541506791e-05,
2589
+ "loss": 0.5062,
2590
+ "step": 183000
2591
+ },
2592
+ {
2593
+ "epoch": 2.095514343139046,
2594
+ "grad_norm": 3.120025396347046,
2595
+ "learning_rate": 1.5074951275960778e-05,
2596
+ "loss": 0.516,
2597
+ "step": 183500
2598
+ },
2599
+ {
2600
+ "epoch": 2.1012241914854743,
2601
+ "grad_norm": 0.8969033360481262,
2602
+ "learning_rate": 1.4979787136853646e-05,
2603
+ "loss": 0.5008,
2604
+ "step": 184000
2605
+ },
2606
+ {
2607
+ "epoch": 2.106934039831902,
2608
+ "grad_norm": 25.220611572265625,
2609
+ "learning_rate": 1.4884622997746514e-05,
2610
+ "loss": 0.4807,
2611
+ "step": 184500
2612
+ },
2613
+ {
2614
+ "epoch": 2.11264388817833,
2615
+ "grad_norm": 11.308756828308105,
2616
+ "learning_rate": 1.4789458858639382e-05,
2617
+ "loss": 0.4864,
2618
+ "step": 185000
2619
+ },
2620
+ {
2621
+ "epoch": 2.118353736524758,
2622
+ "grad_norm": 15.854241371154785,
2623
+ "learning_rate": 1.469429471953225e-05,
2624
+ "loss": 0.5285,
2625
+ "step": 185500
2626
+ },
2627
+ {
2628
+ "epoch": 2.1240635848711857,
2629
+ "grad_norm": 20.354990005493164,
2630
+ "learning_rate": 1.4599130580425118e-05,
2631
+ "loss": 0.5184,
2632
+ "step": 186000
2633
+ },
2634
+ {
2635
+ "epoch": 2.129773433217614,
2636
+ "grad_norm": 14.158123016357422,
2637
+ "learning_rate": 1.4503966441317986e-05,
2638
+ "loss": 0.4782,
2639
+ "step": 186500
2640
+ },
2641
+ {
2642
+ "epoch": 2.1354832815640417,
2643
+ "grad_norm": 5.330241680145264,
2644
+ "learning_rate": 1.4408802302210853e-05,
2645
+ "loss": 0.531,
2646
+ "step": 187000
2647
+ },
2648
+ {
2649
+ "epoch": 2.1411931299104694,
2650
+ "grad_norm": 19.958724975585938,
2651
+ "learning_rate": 1.4313638163103721e-05,
2652
+ "loss": 0.4952,
2653
+ "step": 187500
2654
+ },
2655
+ {
2656
+ "epoch": 2.1469029782568976,
2657
+ "grad_norm": 14.609825134277344,
2658
+ "learning_rate": 1.4218474023996589e-05,
2659
+ "loss": 0.5107,
2660
+ "step": 188000
2661
+ },
2662
+ {
2663
+ "epoch": 2.1526128266033253,
2664
+ "grad_norm": 13.86599063873291,
2665
+ "learning_rate": 1.4123309884889457e-05,
2666
+ "loss": 0.504,
2667
+ "step": 188500
2668
+ },
2669
+ {
2670
+ "epoch": 2.1583226749497535,
2671
+ "grad_norm": 15.812468528747559,
2672
+ "learning_rate": 1.4028145745782325e-05,
2673
+ "loss": 0.5031,
2674
+ "step": 189000
2675
+ },
2676
+ {
2677
+ "epoch": 2.1640325232961812,
2678
+ "grad_norm": 8.966920852661133,
2679
+ "learning_rate": 1.3932981606675193e-05,
2680
+ "loss": 0.4969,
2681
+ "step": 189500
2682
+ },
2683
+ {
2684
+ "epoch": 2.169742371642609,
2685
+ "grad_norm": 16.214431762695312,
2686
+ "learning_rate": 1.3837817467568062e-05,
2687
+ "loss": 0.5095,
2688
+ "step": 190000
2689
+ },
2690
+ {
2691
+ "epoch": 2.175452219989037,
2692
+ "grad_norm": 12.681657791137695,
2693
+ "learning_rate": 1.374265332846093e-05,
2694
+ "loss": 0.487,
2695
+ "step": 190500
2696
+ },
2697
+ {
2698
+ "epoch": 2.181162068335465,
2699
+ "grad_norm": 11.042383193969727,
2700
+ "learning_rate": 1.3647489189353798e-05,
2701
+ "loss": 0.4987,
2702
+ "step": 191000
2703
+ },
2704
+ {
2705
+ "epoch": 2.186871916681893,
2706
+ "grad_norm": 8.849902153015137,
2707
+ "learning_rate": 1.3552325050246668e-05,
2708
+ "loss": 0.5399,
2709
+ "step": 191500
2710
+ },
2711
+ {
2712
+ "epoch": 2.192581765028321,
2713
+ "grad_norm": 18.718029022216797,
2714
+ "learning_rate": 1.3457160911139536e-05,
2715
+ "loss": 0.5181,
2716
+ "step": 192000
2717
+ },
2718
+ {
2719
+ "epoch": 2.1982916133747485,
2720
+ "grad_norm": 15.800800323486328,
2721
+ "learning_rate": 1.33619967720324e-05,
2722
+ "loss": 0.5188,
2723
+ "step": 192500
2724
+ },
2725
+ {
2726
+ "epoch": 2.2040014617211767,
2727
+ "grad_norm": 13.425793647766113,
2728
+ "learning_rate": 1.3266832632925269e-05,
2729
+ "loss": 0.4914,
2730
+ "step": 193000
2731
+ },
2732
+ {
2733
+ "epoch": 2.2097113100676045,
2734
+ "grad_norm": 24.20403289794922,
2735
+ "learning_rate": 1.3171668493818137e-05,
2736
+ "loss": 0.4977,
2737
+ "step": 193500
2738
+ },
2739
+ {
2740
+ "epoch": 2.2154211584140326,
2741
+ "grad_norm": 20.757028579711914,
2742
+ "learning_rate": 1.3076504354711005e-05,
2743
+ "loss": 0.5281,
2744
+ "step": 194000
2745
+ },
2746
+ {
2747
+ "epoch": 2.2211310067604604,
2748
+ "grad_norm": 19.734643936157227,
2749
+ "learning_rate": 1.2981340215603873e-05,
2750
+ "loss": 0.5216,
2751
+ "step": 194500
2752
+ },
2753
+ {
2754
+ "epoch": 2.2268408551068886,
2755
+ "grad_norm": 0.47138330340385437,
2756
+ "learning_rate": 1.2886176076496743e-05,
2757
+ "loss": 0.5007,
2758
+ "step": 195000
2759
+ },
2760
+ {
2761
+ "epoch": 2.2325507034533163,
2762
+ "grad_norm": 7.485045909881592,
2763
+ "learning_rate": 1.2791011937389611e-05,
2764
+ "loss": 0.5345,
2765
+ "step": 195500
2766
+ },
2767
+ {
2768
+ "epoch": 2.238260551799744,
2769
+ "grad_norm": 19.07552719116211,
2770
+ "learning_rate": 1.269584779828248e-05,
2771
+ "loss": 0.5089,
2772
+ "step": 196000
2773
+ },
2774
+ {
2775
+ "epoch": 2.243970400146172,
2776
+ "grad_norm": 25.311899185180664,
2777
+ "learning_rate": 1.2600683659175347e-05,
2778
+ "loss": 0.5231,
2779
+ "step": 196500
2780
+ },
2781
+ {
2782
+ "epoch": 2.2496802484926,
2783
+ "grad_norm": 19.643657684326172,
2784
+ "learning_rate": 1.2505519520068215e-05,
2785
+ "loss": 0.4953,
2786
+ "step": 197000
2787
+ },
2788
+ {
2789
+ "epoch": 2.255390096839028,
2790
+ "grad_norm": 9.986800193786621,
2791
+ "learning_rate": 1.2410355380961082e-05,
2792
+ "loss": 0.4989,
2793
+ "step": 197500
2794
+ },
2795
+ {
2796
+ "epoch": 2.261099945185456,
2797
+ "grad_norm": 17.89738655090332,
2798
+ "learning_rate": 1.231519124185395e-05,
2799
+ "loss": 0.4903,
2800
+ "step": 198000
2801
+ },
2802
+ {
2803
+ "epoch": 2.2668097935318836,
2804
+ "grad_norm": 17.670169830322266,
2805
+ "learning_rate": 1.2220027102746818e-05,
2806
+ "loss": 0.5088,
2807
+ "step": 198500
2808
+ },
2809
+ {
2810
+ "epoch": 2.272519641878312,
2811
+ "grad_norm": 9.977444648742676,
2812
+ "learning_rate": 1.2124862963639686e-05,
2813
+ "loss": 0.4875,
2814
+ "step": 199000
2815
+ },
2816
+ {
2817
+ "epoch": 2.2782294902247395,
2818
+ "grad_norm": 16.433969497680664,
2819
+ "learning_rate": 1.2029698824532554e-05,
2820
+ "loss": 0.5118,
2821
+ "step": 199500
2822
+ },
2823
+ {
2824
+ "epoch": 2.2839393385711677,
2825
+ "grad_norm": 17.11726951599121,
2826
+ "learning_rate": 1.1934534685425422e-05,
2827
+ "loss": 0.5184,
2828
+ "step": 200000
2829
+ },
2830
+ {
2831
+ "epoch": 2.2896491869175954,
2832
+ "grad_norm": 4.672770977020264,
2833
+ "learning_rate": 1.183937054631829e-05,
2834
+ "loss": 0.4807,
2835
+ "step": 200500
2836
+ },
2837
+ {
2838
+ "epoch": 2.295359035264023,
2839
+ "grad_norm": 10.617161750793457,
2840
+ "learning_rate": 1.1744206407211159e-05,
2841
+ "loss": 0.5112,
2842
+ "step": 201000
2843
+ },
2844
+ {
2845
+ "epoch": 2.3010688836104514,
2846
+ "grad_norm": 18.985248565673828,
2847
+ "learning_rate": 1.1649042268104027e-05,
2848
+ "loss": 0.5064,
2849
+ "step": 201500
2850
+ },
2851
+ {
2852
+ "epoch": 2.306778731956879,
2853
+ "grad_norm": 31.68198013305664,
2854
+ "learning_rate": 1.1553878128996895e-05,
2855
+ "loss": 0.5246,
2856
+ "step": 202000
2857
+ },
2858
+ {
2859
+ "epoch": 2.3124885803033073,
2860
+ "grad_norm": 5.870474815368652,
2861
+ "learning_rate": 1.1458713989889761e-05,
2862
+ "loss": 0.496,
2863
+ "step": 202500
2864
+ },
2865
+ {
2866
+ "epoch": 2.318198428649735,
2867
+ "grad_norm": 16.422073364257812,
2868
+ "learning_rate": 1.136354985078263e-05,
2869
+ "loss": 0.5101,
2870
+ "step": 203000
2871
+ },
2872
+ {
2873
+ "epoch": 2.323908276996163,
2874
+ "grad_norm": 26.81598663330078,
2875
+ "learning_rate": 1.1268385711675498e-05,
2876
+ "loss": 0.5184,
2877
+ "step": 203500
2878
+ },
2879
+ {
2880
+ "epoch": 2.329618125342591,
2881
+ "grad_norm": 8.190471649169922,
2882
+ "learning_rate": 1.1173221572568368e-05,
2883
+ "loss": 0.5134,
2884
+ "step": 204000
2885
+ },
2886
+ {
2887
+ "epoch": 2.3353279736890187,
2888
+ "grad_norm": 25.15373992919922,
2889
+ "learning_rate": 1.1078057433461236e-05,
2890
+ "loss": 0.4875,
2891
+ "step": 204500
2892
+ },
2893
+ {
2894
+ "epoch": 2.341037822035447,
2895
+ "grad_norm": 23.502195358276367,
2896
+ "learning_rate": 1.0982893294354102e-05,
2897
+ "loss": 0.4975,
2898
+ "step": 205000
2899
+ },
2900
+ {
2901
+ "epoch": 2.3467476703818746,
2902
+ "grad_norm": 16.599660873413086,
2903
+ "learning_rate": 1.088772915524697e-05,
2904
+ "loss": 0.5156,
2905
+ "step": 205500
2906
+ },
2907
+ {
2908
+ "epoch": 2.3524575187283023,
2909
+ "grad_norm": 18.1118106842041,
2910
+ "learning_rate": 1.0792565016139838e-05,
2911
+ "loss": 0.4994,
2912
+ "step": 206000
2913
+ },
2914
+ {
2915
+ "epoch": 2.3581673670747305,
2916
+ "grad_norm": 8.018208503723145,
2917
+ "learning_rate": 1.0697400877032706e-05,
2918
+ "loss": 0.5309,
2919
+ "step": 206500
2920
+ },
2921
+ {
2922
+ "epoch": 2.3638772154211583,
2923
+ "grad_norm": 21.062759399414062,
2924
+ "learning_rate": 1.0602236737925575e-05,
2925
+ "loss": 0.4896,
2926
+ "step": 207000
2927
+ },
2928
+ {
2929
+ "epoch": 2.3695870637675864,
2930
+ "grad_norm": 26.683521270751953,
2931
+ "learning_rate": 1.0507072598818443e-05,
2932
+ "loss": 0.5013,
2933
+ "step": 207500
2934
+ },
2935
+ {
2936
+ "epoch": 2.375296912114014,
2937
+ "grad_norm": 6.408973693847656,
2938
+ "learning_rate": 1.041190845971131e-05,
2939
+ "loss": 0.4921,
2940
+ "step": 208000
2941
+ },
2942
+ {
2943
+ "epoch": 2.3810067604604424,
2944
+ "grad_norm": 2.972761392593384,
2945
+ "learning_rate": 1.0316744320604179e-05,
2946
+ "loss": 0.5007,
2947
+ "step": 208500
2948
+ },
2949
+ {
2950
+ "epoch": 2.38671660880687,
2951
+ "grad_norm": 30.6113338470459,
2952
+ "learning_rate": 1.0221580181497047e-05,
2953
+ "loss": 0.4899,
2954
+ "step": 209000
2955
+ },
2956
+ {
2957
+ "epoch": 2.392426457153298,
2958
+ "grad_norm": 1.1805810928344727,
2959
+ "learning_rate": 1.0126416042389915e-05,
2960
+ "loss": 0.4943,
2961
+ "step": 209500
2962
+ },
2963
+ {
2964
+ "epoch": 2.398136305499726,
2965
+ "grad_norm": 19.439138412475586,
2966
+ "learning_rate": 1.0031251903282783e-05,
2967
+ "loss": 0.5005,
2968
+ "step": 210000
2969
+ },
2970
+ {
2971
+ "epoch": 2.4038461538461537,
2972
+ "grad_norm": 15.17097282409668,
2973
+ "learning_rate": 9.93608776417565e-06,
2974
+ "loss": 0.4829,
2975
+ "step": 210500
2976
+ },
2977
+ {
2978
+ "epoch": 2.409556002192582,
2979
+ "grad_norm": 15.253467559814453,
2980
+ "learning_rate": 9.840923625068518e-06,
2981
+ "loss": 0.518,
2982
+ "step": 211000
2983
+ },
2984
+ {
2985
+ "epoch": 2.4152658505390097,
2986
+ "grad_norm": 3.1537230014801025,
2987
+ "learning_rate": 9.745759485961386e-06,
2988
+ "loss": 0.488,
2989
+ "step": 211500
2990
+ },
2991
+ {
2992
+ "epoch": 2.420975698885438,
2993
+ "grad_norm": 30.182418823242188,
2994
+ "learning_rate": 9.650595346854254e-06,
2995
+ "loss": 0.5206,
2996
+ "step": 212000
2997
+ },
2998
+ {
2999
+ "epoch": 2.4266855472318656,
3000
+ "grad_norm": 13.055935859680176,
3001
+ "learning_rate": 9.555431207747122e-06,
3002
+ "loss": 0.5191,
3003
+ "step": 212500
3004
+ },
3005
+ {
3006
+ "epoch": 2.4323953955782933,
3007
+ "grad_norm": 17.33100700378418,
3008
+ "learning_rate": 9.460267068639992e-06,
3009
+ "loss": 0.5082,
3010
+ "step": 213000
3011
+ },
3012
+ {
3013
+ "epoch": 2.4381052439247215,
3014
+ "grad_norm": 12.193753242492676,
3015
+ "learning_rate": 9.365102929532859e-06,
3016
+ "loss": 0.4815,
3017
+ "step": 213500
3018
+ },
3019
+ {
3020
+ "epoch": 2.4438150922711492,
3021
+ "grad_norm": 31.142057418823242,
3022
+ "learning_rate": 9.269938790425727e-06,
3023
+ "loss": 0.4982,
3024
+ "step": 214000
3025
+ },
3026
+ {
3027
+ "epoch": 2.449524940617577,
3028
+ "grad_norm": 17.307722091674805,
3029
+ "learning_rate": 9.174774651318595e-06,
3030
+ "loss": 0.5104,
3031
+ "step": 214500
3032
+ },
3033
+ {
3034
+ "epoch": 2.455234788964005,
3035
+ "grad_norm": 16.12789535522461,
3036
+ "learning_rate": 9.079610512211463e-06,
3037
+ "loss": 0.5283,
3038
+ "step": 215000
3039
+ },
3040
+ {
3041
+ "epoch": 2.460944637310433,
3042
+ "grad_norm": 14.07739543914795,
3043
+ "learning_rate": 8.984446373104331e-06,
3044
+ "loss": 0.5583,
3045
+ "step": 215500
3046
+ },
3047
+ {
3048
+ "epoch": 2.466654485656861,
3049
+ "grad_norm": 26.61475944519043,
3050
+ "learning_rate": 8.889282233997197e-06,
3051
+ "loss": 0.4807,
3052
+ "step": 216000
3053
+ },
3054
+ {
3055
+ "epoch": 2.472364334003289,
3056
+ "grad_norm": 13.504605293273926,
3057
+ "learning_rate": 8.794118094890066e-06,
3058
+ "loss": 0.4798,
3059
+ "step": 216500
3060
+ },
3061
+ {
3062
+ "epoch": 2.478074182349717,
3063
+ "grad_norm": 8.153654098510742,
3064
+ "learning_rate": 8.698953955782935e-06,
3065
+ "loss": 0.5315,
3066
+ "step": 217000
3067
+ },
3068
+ {
3069
+ "epoch": 2.4837840306961447,
3070
+ "grad_norm": 20.905561447143555,
3071
+ "learning_rate": 8.603789816675804e-06,
3072
+ "loss": 0.4787,
3073
+ "step": 217500
3074
+ },
3075
+ {
3076
+ "epoch": 2.4894938790425725,
3077
+ "grad_norm": 11.875917434692383,
3078
+ "learning_rate": 8.508625677568672e-06,
3079
+ "loss": 0.4636,
3080
+ "step": 218000
3081
+ },
3082
+ {
3083
+ "epoch": 2.4952037273890006,
3084
+ "grad_norm": 24.643348693847656,
3085
+ "learning_rate": 8.41346153846154e-06,
3086
+ "loss": 0.4542,
3087
+ "step": 218500
3088
+ },
3089
+ {
3090
+ "epoch": 2.5009135757354284,
3091
+ "grad_norm": 13.849350929260254,
3092
+ "learning_rate": 8.318297399354406e-06,
3093
+ "loss": 0.5046,
3094
+ "step": 219000
3095
+ },
3096
+ {
3097
+ "epoch": 2.506623424081856,
3098
+ "grad_norm": 11.743799209594727,
3099
+ "learning_rate": 8.223133260247274e-06,
3100
+ "loss": 0.4901,
3101
+ "step": 219500
3102
+ },
3103
+ {
3104
+ "epoch": 2.5123332724282843,
3105
+ "grad_norm": 11.619879722595215,
3106
+ "learning_rate": 8.127969121140142e-06,
3107
+ "loss": 0.5143,
3108
+ "step": 220000
3109
+ },
3110
+ {
3111
+ "epoch": 2.5180431207747125,
3112
+ "grad_norm": 8.898900032043457,
3113
+ "learning_rate": 8.03280498203301e-06,
3114
+ "loss": 0.5058,
3115
+ "step": 220500
3116
+ },
3117
+ {
3118
+ "epoch": 2.52375296912114,
3119
+ "grad_norm": 13.388077735900879,
3120
+ "learning_rate": 7.937640842925879e-06,
3121
+ "loss": 0.5047,
3122
+ "step": 221000
3123
+ },
3124
+ {
3125
+ "epoch": 2.529462817467568,
3126
+ "grad_norm": 10.211919784545898,
3127
+ "learning_rate": 7.842476703818747e-06,
3128
+ "loss": 0.4844,
3129
+ "step": 221500
3130
+ },
3131
+ {
3132
+ "epoch": 2.535172665813996,
3133
+ "grad_norm": 2.6434876918792725,
3134
+ "learning_rate": 7.747312564711615e-06,
3135
+ "loss": 0.5217,
3136
+ "step": 222000
3137
+ },
3138
+ {
3139
+ "epoch": 2.540882514160424,
3140
+ "grad_norm": 11.995810508728027,
3141
+ "learning_rate": 7.652148425604483e-06,
3142
+ "loss": 0.4538,
3143
+ "step": 222500
3144
+ },
3145
+ {
3146
+ "epoch": 2.5465923625068516,
3147
+ "grad_norm": 21.320537567138672,
3148
+ "learning_rate": 7.556984286497351e-06,
3149
+ "loss": 0.5075,
3150
+ "step": 223000
3151
+ },
3152
+ {
3153
+ "epoch": 2.55230221085328,
3154
+ "grad_norm": 13.159751892089844,
3155
+ "learning_rate": 7.461820147390219e-06,
3156
+ "loss": 0.4616,
3157
+ "step": 223500
3158
+ },
3159
+ {
3160
+ "epoch": 2.5580120591997075,
3161
+ "grad_norm": 6.660970687866211,
3162
+ "learning_rate": 7.3666560082830875e-06,
3163
+ "loss": 0.4933,
3164
+ "step": 224000
3165
+ },
3166
+ {
3167
+ "epoch": 2.5637219075461357,
3168
+ "grad_norm": 17.793792724609375,
3169
+ "learning_rate": 7.271491869175955e-06,
3170
+ "loss": 0.5003,
3171
+ "step": 224500
3172
+ },
3173
+ {
3174
+ "epoch": 2.5694317558925635,
3175
+ "grad_norm": 13.550131797790527,
3176
+ "learning_rate": 7.176327730068823e-06,
3177
+ "loss": 0.4879,
3178
+ "step": 225000
3179
+ },
3180
+ {
3181
+ "epoch": 2.5751416042389916,
3182
+ "grad_norm": 17.5866756439209,
3183
+ "learning_rate": 7.081163590961691e-06,
3184
+ "loss": 0.4931,
3185
+ "step": 225500
3186
+ },
3187
+ {
3188
+ "epoch": 2.5808514525854194,
3189
+ "grad_norm": 13.037981986999512,
3190
+ "learning_rate": 6.985999451854559e-06,
3191
+ "loss": 0.5156,
3192
+ "step": 226000
3193
+ },
3194
+ {
3195
+ "epoch": 2.586561300931847,
3196
+ "grad_norm": 16.949880599975586,
3197
+ "learning_rate": 6.890835312747427e-06,
3198
+ "loss": 0.5031,
3199
+ "step": 226500
3200
+ },
3201
+ {
3202
+ "epoch": 2.5922711492782753,
3203
+ "grad_norm": 13.604817390441895,
3204
+ "learning_rate": 6.795671173640295e-06,
3205
+ "loss": 0.4983,
3206
+ "step": 227000
3207
+ },
3208
+ {
3209
+ "epoch": 2.597980997624703,
3210
+ "grad_norm": 7.798038005828857,
3211
+ "learning_rate": 6.700507034533163e-06,
3212
+ "loss": 0.4943,
3213
+ "step": 227500
3214
+ },
3215
+ {
3216
+ "epoch": 2.6036908459711308,
3217
+ "grad_norm": 22.034040451049805,
3218
+ "learning_rate": 6.605342895426031e-06,
3219
+ "loss": 0.4487,
3220
+ "step": 228000
3221
+ },
3222
+ {
3223
+ "epoch": 2.609400694317559,
3224
+ "grad_norm": 19.099645614624023,
3225
+ "learning_rate": 6.510178756318899e-06,
3226
+ "loss": 0.4816,
3227
+ "step": 228500
3228
+ },
3229
+ {
3230
+ "epoch": 2.6151105426639867,
3231
+ "grad_norm": 25.62647819519043,
3232
+ "learning_rate": 6.415014617211768e-06,
3233
+ "loss": 0.5101,
3234
+ "step": 229000
3235
+ },
3236
+ {
3237
+ "epoch": 2.620820391010415,
3238
+ "grad_norm": 14.864277839660645,
3239
+ "learning_rate": 6.319850478104636e-06,
3240
+ "loss": 0.4756,
3241
+ "step": 229500
3242
+ },
3243
+ {
3244
+ "epoch": 2.6265302393568426,
3245
+ "grad_norm": 14.468932151794434,
3246
+ "learning_rate": 6.224686338997503e-06,
3247
+ "loss": 0.4904,
3248
+ "step": 230000
3249
+ },
3250
+ {
3251
+ "epoch": 2.632240087703271,
3252
+ "grad_norm": 3.2162094116210938,
3253
+ "learning_rate": 6.129522199890371e-06,
3254
+ "loss": 0.4607,
3255
+ "step": 230500
3256
+ },
3257
+ {
3258
+ "epoch": 2.6379499360496985,
3259
+ "grad_norm": 25.016502380371094,
3260
+ "learning_rate": 6.03435806078324e-06,
3261
+ "loss": 0.4957,
3262
+ "step": 231000
3263
+ },
3264
+ {
3265
+ "epoch": 2.6436597843961263,
3266
+ "grad_norm": 26.39497184753418,
3267
+ "learning_rate": 5.939193921676108e-06,
3268
+ "loss": 0.478,
3269
+ "step": 231500
3270
+ },
3271
+ {
3272
+ "epoch": 2.6493696327425544,
3273
+ "grad_norm": 26.362104415893555,
3274
+ "learning_rate": 5.844029782568975e-06,
3275
+ "loss": 0.5147,
3276
+ "step": 232000
3277
+ },
3278
+ {
3279
+ "epoch": 2.655079481088982,
3280
+ "grad_norm": 13.370088577270508,
3281
+ "learning_rate": 5.748865643461843e-06,
3282
+ "loss": 0.4972,
3283
+ "step": 232500
3284
+ },
3285
+ {
3286
+ "epoch": 2.6607893294354104,
3287
+ "grad_norm": 4.613801002502441,
3288
+ "learning_rate": 5.653701504354711e-06,
3289
+ "loss": 0.4959,
3290
+ "step": 233000
3291
+ },
3292
+ {
3293
+ "epoch": 2.666499177781838,
3294
+ "grad_norm": 19.363128662109375,
3295
+ "learning_rate": 5.558537365247579e-06,
3296
+ "loss": 0.4734,
3297
+ "step": 233500
3298
+ },
3299
+ {
3300
+ "epoch": 2.6722090261282663,
3301
+ "grad_norm": 2.7340149879455566,
3302
+ "learning_rate": 5.4633732261404475e-06,
3303
+ "loss": 0.5072,
3304
+ "step": 234000
3305
+ },
3306
+ {
3307
+ "epoch": 2.677918874474694,
3308
+ "grad_norm": 9.132205963134766,
3309
+ "learning_rate": 5.368209087033315e-06,
3310
+ "loss": 0.5031,
3311
+ "step": 234500
3312
+ },
3313
+ {
3314
+ "epoch": 2.6836287228211217,
3315
+ "grad_norm": 15.687705993652344,
3316
+ "learning_rate": 5.273044947926183e-06,
3317
+ "loss": 0.4865,
3318
+ "step": 235000
3319
+ },
3320
+ {
3321
+ "epoch": 2.68933857116755,
3322
+ "grad_norm": 12.906676292419434,
3323
+ "learning_rate": 5.177880808819052e-06,
3324
+ "loss": 0.4752,
3325
+ "step": 235500
3326
+ },
3327
+ {
3328
+ "epoch": 2.6950484195139777,
3329
+ "grad_norm": 15.92054557800293,
3330
+ "learning_rate": 5.082716669711919e-06,
3331
+ "loss": 0.492,
3332
+ "step": 236000
3333
+ },
3334
+ {
3335
+ "epoch": 2.7007582678604054,
3336
+ "grad_norm": 10.68714427947998,
3337
+ "learning_rate": 4.987552530604787e-06,
3338
+ "loss": 0.4619,
3339
+ "step": 236500
3340
+ },
3341
+ {
3342
+ "epoch": 2.7064681162068336,
3343
+ "grad_norm": 4.905238628387451,
3344
+ "learning_rate": 4.8923883914976554e-06,
3345
+ "loss": 0.4456,
3346
+ "step": 237000
3347
+ },
3348
+ {
3349
+ "epoch": 2.7121779645532613,
3350
+ "grad_norm": 1.3835444450378418,
3351
+ "learning_rate": 4.7972242523905236e-06,
3352
+ "loss": 0.4891,
3353
+ "step": 237500
3354
+ },
3355
+ {
3356
+ "epoch": 2.7178878128996895,
3357
+ "grad_norm": 18.093151092529297,
3358
+ "learning_rate": 4.702060113283392e-06,
3359
+ "loss": 0.467,
3360
+ "step": 238000
3361
+ },
3362
+ {
3363
+ "epoch": 2.7235976612461172,
3364
+ "grad_norm": 24.381988525390625,
3365
+ "learning_rate": 4.60689597417626e-06,
3366
+ "loss": 0.4767,
3367
+ "step": 238500
3368
+ },
3369
+ {
3370
+ "epoch": 2.7293075095925454,
3371
+ "grad_norm": 18.281627655029297,
3372
+ "learning_rate": 4.511731835069127e-06,
3373
+ "loss": 0.4795,
3374
+ "step": 239000
3375
+ },
3376
+ {
3377
+ "epoch": 2.735017357938973,
3378
+ "grad_norm": 21.739501953125,
3379
+ "learning_rate": 4.416567695961995e-06,
3380
+ "loss": 0.4836,
3381
+ "step": 239500
3382
+ },
3383
+ {
3384
+ "epoch": 2.740727206285401,
3385
+ "grad_norm": 24.666133880615234,
3386
+ "learning_rate": 4.321403556854863e-06,
3387
+ "loss": 0.5013,
3388
+ "step": 240000
3389
+ },
3390
+ {
3391
+ "epoch": 2.746437054631829,
3392
+ "grad_norm": 14.889273643493652,
3393
+ "learning_rate": 4.2262394177477315e-06,
3394
+ "loss": 0.4696,
3395
+ "step": 240500
3396
+ },
3397
+ {
3398
+ "epoch": 2.752146902978257,
3399
+ "grad_norm": 19.896183013916016,
3400
+ "learning_rate": 4.1310752786406e-06,
3401
+ "loss": 0.4954,
3402
+ "step": 241000
3403
+ },
3404
+ {
3405
+ "epoch": 2.7578567513246846,
3406
+ "grad_norm": 15.4746675491333,
3407
+ "learning_rate": 4.035911139533467e-06,
3408
+ "loss": 0.4884,
3409
+ "step": 241500
3410
+ },
3411
+ {
3412
+ "epoch": 2.7635665996711127,
3413
+ "grad_norm": 12.228035926818848,
3414
+ "learning_rate": 3.940747000426336e-06,
3415
+ "loss": 0.4777,
3416
+ "step": 242000
3417
+ },
3418
+ {
3419
+ "epoch": 2.769276448017541,
3420
+ "grad_norm": 24.41202163696289,
3421
+ "learning_rate": 3.845582861319204e-06,
3422
+ "loss": 0.4897,
3423
+ "step": 242500
3424
+ },
3425
+ {
3426
+ "epoch": 2.7749862963639687,
3427
+ "grad_norm": 12.334085464477539,
3428
+ "learning_rate": 3.7504187222120713e-06,
3429
+ "loss": 0.4867,
3430
+ "step": 243000
3431
+ },
3432
+ {
3433
+ "epoch": 2.7806961447103964,
3434
+ "grad_norm": 20.376510620117188,
3435
+ "learning_rate": 3.65525458310494e-06,
3436
+ "loss": 0.4891,
3437
+ "step": 243500
3438
+ },
3439
+ {
3440
+ "epoch": 2.7864059930568246,
3441
+ "grad_norm": 30.040578842163086,
3442
+ "learning_rate": 3.560090443997808e-06,
3443
+ "loss": 0.4855,
3444
+ "step": 244000
3445
+ },
3446
+ {
3447
+ "epoch": 2.7921158414032523,
3448
+ "grad_norm": 2.3403232097625732,
3449
+ "learning_rate": 3.4649263048906757e-06,
3450
+ "loss": 0.4863,
3451
+ "step": 244500
3452
+ },
3453
+ {
3454
+ "epoch": 2.79782568974968,
3455
+ "grad_norm": 1.8146756887435913,
3456
+ "learning_rate": 3.369762165783544e-06,
3457
+ "loss": 0.4832,
3458
+ "step": 245000
3459
+ },
3460
+ {
3461
+ "epoch": 2.8035355380961082,
3462
+ "grad_norm": 21.62696075439453,
3463
+ "learning_rate": 3.2745980266764115e-06,
3464
+ "loss": 0.4976,
3465
+ "step": 245500
3466
+ },
3467
+ {
3468
+ "epoch": 2.809245386442536,
3469
+ "grad_norm": 4.043114185333252,
3470
+ "learning_rate": 3.1794338875692796e-06,
3471
+ "loss": 0.4946,
3472
+ "step": 246000
3473
+ },
3474
+ {
3475
+ "epoch": 2.814955234788964,
3476
+ "grad_norm": 33.280696868896484,
3477
+ "learning_rate": 3.0842697484621473e-06,
3478
+ "loss": 0.4699,
3479
+ "step": 246500
3480
+ },
3481
+ {
3482
+ "epoch": 2.820665083135392,
3483
+ "grad_norm": 4.312365531921387,
3484
+ "learning_rate": 2.989105609355016e-06,
3485
+ "loss": 0.4818,
3486
+ "step": 247000
3487
+ },
3488
+ {
3489
+ "epoch": 2.82637493148182,
3490
+ "grad_norm": 11.858549118041992,
3491
+ "learning_rate": 2.8939414702478836e-06,
3492
+ "loss": 0.4643,
3493
+ "step": 247500
3494
+ },
3495
+ {
3496
+ "epoch": 2.832084779828248,
3497
+ "grad_norm": 18.828821182250977,
3498
+ "learning_rate": 2.7987773311407517e-06,
3499
+ "loss": 0.4848,
3500
+ "step": 248000
3501
+ },
3502
+ {
3503
+ "epoch": 2.8377946281746755,
3504
+ "grad_norm": 10.632979393005371,
3505
+ "learning_rate": 2.70361319203362e-06,
3506
+ "loss": 0.4887,
3507
+ "step": 248500
3508
+ },
3509
+ {
3510
+ "epoch": 2.8435044765211037,
3511
+ "grad_norm": 8.187894821166992,
3512
+ "learning_rate": 2.608449052926488e-06,
3513
+ "loss": 0.4957,
3514
+ "step": 249000
3515
+ },
3516
+ {
3517
+ "epoch": 2.8492143248675315,
3518
+ "grad_norm": 7.119663715362549,
3519
+ "learning_rate": 2.5132849138193557e-06,
3520
+ "loss": 0.4544,
3521
+ "step": 249500
3522
+ },
3523
+ {
3524
+ "epoch": 2.854924173213959,
3525
+ "grad_norm": 25.012086868286133,
3526
+ "learning_rate": 2.418120774712224e-06,
3527
+ "loss": 0.4918,
3528
+ "step": 250000
3529
+ },
3530
+ {
3531
+ "epoch": 2.8606340215603874,
3532
+ "grad_norm": 19.262168884277344,
3533
+ "learning_rate": 2.322956635605092e-06,
3534
+ "loss": 0.4396,
3535
+ "step": 250500
3536
+ },
3537
+ {
3538
+ "epoch": 2.866343869906815,
3539
+ "grad_norm": 5.736115455627441,
3540
+ "learning_rate": 2.2277924964979596e-06,
3541
+ "loss": 0.4775,
3542
+ "step": 251000
3543
+ },
3544
+ {
3545
+ "epoch": 2.8720537182532433,
3546
+ "grad_norm": 20.613554000854492,
3547
+ "learning_rate": 2.1326283573908278e-06,
3548
+ "loss": 0.5189,
3549
+ "step": 251500
3550
+ },
3551
+ {
3552
+ "epoch": 2.877763566599671,
3553
+ "grad_norm": 31.844158172607422,
3554
+ "learning_rate": 2.037464218283696e-06,
3555
+ "loss": 0.5059,
3556
+ "step": 252000
3557
+ },
3558
+ {
3559
+ "epoch": 2.883473414946099,
3560
+ "grad_norm": 13.077164649963379,
3561
+ "learning_rate": 1.942300079176564e-06,
3562
+ "loss": 0.4876,
3563
+ "step": 252500
3564
+ },
3565
+ {
3566
+ "epoch": 2.889183263292527,
3567
+ "grad_norm": 6.8983235359191895,
3568
+ "learning_rate": 1.847135940069432e-06,
3569
+ "loss": 0.4754,
3570
+ "step": 253000
3571
+ },
3572
+ {
3573
+ "epoch": 2.8948931116389547,
3574
+ "grad_norm": 19.89031219482422,
3575
+ "learning_rate": 1.7519718009622998e-06,
3576
+ "loss": 0.5116,
3577
+ "step": 253500
3578
+ },
3579
+ {
3580
+ "epoch": 2.900602959985383,
3581
+ "grad_norm": 28.836467742919922,
3582
+ "learning_rate": 1.656807661855168e-06,
3583
+ "loss": 0.4644,
3584
+ "step": 254000
3585
+ },
3586
+ {
3587
+ "epoch": 2.9063128083318106,
3588
+ "grad_norm": 8.207099914550781,
3589
+ "learning_rate": 1.5616435227480359e-06,
3590
+ "loss": 0.4642,
3591
+ "step": 254500
3592
+ },
3593
+ {
3594
+ "epoch": 2.912022656678239,
3595
+ "grad_norm": 19.2005558013916,
3596
+ "learning_rate": 1.4664793836409038e-06,
3597
+ "loss": 0.4747,
3598
+ "step": 255000
3599
+ },
3600
+ {
3601
+ "epoch": 2.9177325050246665,
3602
+ "grad_norm": 21.798900604248047,
3603
+ "learning_rate": 1.371315244533772e-06,
3604
+ "loss": 0.4719,
3605
+ "step": 255500
3606
+ },
3607
+ {
3608
+ "epoch": 2.9234423533710947,
3609
+ "grad_norm": 24.081745147705078,
3610
+ "learning_rate": 1.2761511054266398e-06,
3611
+ "loss": 0.4858,
3612
+ "step": 256000
3613
+ },
3614
+ {
3615
+ "epoch": 2.9291522017175224,
3616
+ "grad_norm": 16.240169525146484,
3617
+ "learning_rate": 1.180986966319508e-06,
3618
+ "loss": 0.4804,
3619
+ "step": 256500
3620
+ },
3621
+ {
3622
+ "epoch": 2.93486205006395,
3623
+ "grad_norm": 7.07710075378418,
3624
+ "learning_rate": 1.0858228272123759e-06,
3625
+ "loss": 0.4858,
3626
+ "step": 257000
3627
+ },
3628
+ {
3629
+ "epoch": 2.9405718984103784,
3630
+ "grad_norm": 12.752093315124512,
3631
+ "learning_rate": 9.90658688105244e-07,
3632
+ "loss": 0.4857,
3633
+ "step": 257500
3634
+ },
3635
+ {
3636
+ "epoch": 2.946281746756806,
3637
+ "grad_norm": 10.274901390075684,
3638
+ "learning_rate": 8.954945489981119e-07,
3639
+ "loss": 0.4913,
3640
+ "step": 258000
3641
+ },
3642
+ {
3643
+ "epoch": 2.951991595103234,
3644
+ "grad_norm": 17.103899002075195,
3645
+ "learning_rate": 8.003304098909801e-07,
3646
+ "loss": 0.4589,
3647
+ "step": 258500
3648
+ },
3649
+ {
3650
+ "epoch": 2.957701443449662,
3651
+ "grad_norm": 10.452912330627441,
3652
+ "learning_rate": 7.05166270783848e-07,
3653
+ "loss": 0.5143,
3654
+ "step": 259000
3655
+ },
3656
+ {
3657
+ "epoch": 2.9634112917960898,
3658
+ "grad_norm": 23.714805603027344,
3659
+ "learning_rate": 6.10002131676716e-07,
3660
+ "loss": 0.484,
3661
+ "step": 259500
3662
+ },
3663
+ {
3664
+ "epoch": 2.969121140142518,
3665
+ "grad_norm": 9.592878341674805,
3666
+ "learning_rate": 5.14837992569584e-07,
3667
+ "loss": 0.5094,
3668
+ "step": 260000
3669
+ },
3670
+ {
3671
+ "epoch": 2.9748309884889457,
3672
+ "grad_norm": 6.5779242515563965,
3673
+ "learning_rate": 4.1967385346245204e-07,
3674
+ "loss": 0.4875,
3675
+ "step": 260500
3676
+ },
3677
+ {
3678
+ "epoch": 2.980540836835374,
3679
+ "grad_norm": 17.327184677124023,
3680
+ "learning_rate": 3.245097143553201e-07,
3681
+ "loss": 0.4676,
3682
+ "step": 261000
3683
+ },
3684
+ {
3685
+ "epoch": 2.9862506851818016,
3686
+ "grad_norm": 17.79420280456543,
3687
+ "learning_rate": 2.293455752481881e-07,
3688
+ "loss": 0.4857,
3689
+ "step": 261500
3690
+ },
3691
+ {
3692
+ "epoch": 2.9919605335282293,
3693
+ "grad_norm": 30.298192977905273,
3694
+ "learning_rate": 1.341814361410561e-07,
3695
+ "loss": 0.4703,
3696
+ "step": 262000
3697
+ },
3698
+ {
3699
+ "epoch": 2.9976703818746575,
3700
+ "grad_norm": 10.825181007385254,
3701
+ "learning_rate": 3.9017297033924116e-08,
3702
+ "loss": 0.4785,
3703
+ "step": 262500
3704
+ },
3705
+ {
3706
+ "epoch": 3.0,
3707
+ "eval_f1": 0.7783590324391549,
3708
+ "eval_loss": 0.7510631680488586,
3709
+ "eval_runtime": 50.1345,
3710
+ "eval_samples_per_second": 1746.742,
3711
+ "eval_steps_per_second": 218.353,
3712
+ "step": 262704
3713
+ },
3714
+ {
3715
+ "epoch": 3.0,
3716
+ "step": 262704,
3717
+ "total_flos": 3.462425297543117e+16,
3718
+ "train_loss": 0.6613248294712064,
3719
+ "train_runtime": 4513.963,
3720
+ "train_samples_per_second": 465.583,
3721
+ "train_steps_per_second": 58.198
3722
+ }
3723
+ ],
3724
+ "logging_steps": 500,
3725
+ "max_steps": 262704,
3726
+ "num_input_tokens_seen": 0,
3727
+ "num_train_epochs": 3,
3728
+ "save_steps": 500,
3729
+ "stateful_callbacks": {
3730
+ "TrainerControl": {
3731
+ "args": {
3732
+ "should_epoch_stop": false,
3733
+ "should_evaluate": false,
3734
+ "should_log": false,
3735
+ "should_save": true,
3736
+ "should_training_stop": true
3737
+ },
3738
+ "attributes": {}
3739
+ }
3740
+ },
3741
+ "total_flos": 3.462425297543117e+16,
3742
+ "train_batch_size": 8,
3743
+ "trial_name": null,
3744
+ "trial_params": null
3745
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86ee550afe7a54e3f9e10f4052ea1f0a4a9b95bd4e1793702ef81ea82a07dc97
3
+ size 5201
vocab.txt ADDED
The diff for this file is too large to render. See raw diff