Hugging Face's logo

serag-ai
/
BRFSS_MedAlpaca

PEFT
Safetensors
Model card Files
xet
 Community
AITheChillGuy commited on
Commit
6c17582
·
verified ·
1 Parent(s): a419adc

Upload 13 files

Browse files
Files changed (13) hide show
  1. README.md +202 -0
  2. adapter_config.json +37 -0
  3. adapter_model.safetensors +3 -0
  4. added_tokens.json +3 -0
  5. optimizer.pt +3 -0
  6. rng_state.pth +3 -0
  7. scheduler.pt +3 -0
  8. special_tokens_map.json +30 -0
  9. tokenizer.json +0 -0
  10. tokenizer.model +3 -0
  11. tokenizer_config.json +51 -0
  12. trainer_state.json +2839 -0
  13. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: medalpaca/medalpaca-7b
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.12.0
adapter_config.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "medalpaca/medalpaca-7b",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layer_replication": null,
10
+ "layers_pattern": null,
11
+ "layers_to_transform": null,
12
+ "loftq_config": {},
13
+ "lora_alpha": 32,
14
+ "lora_dropout": 0.05,
15
+ "megatron_config": null,
16
+ "megatron_core": "megatron.core",
17
+ "modules_to_save": [
18
+ "classifier",
19
+ "score"
20
+ ],
21
+ "peft_type": "LORA",
22
+ "r": 64,
23
+ "rank_pattern": {},
24
+ "revision": null,
25
+ "target_modules": [
26
+ "q_proj",
27
+ "o_proj",
28
+ "v_proj",
29
+ "down_proj",
30
+ "up_proj",
31
+ "k_proj",
32
+ "gate_proj"
33
+ ],
34
+ "task_type": "SEQ_CLS",
35
+ "use_dora": false,
36
+ "use_rslora": false
37
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e54ef8edd1ad6014c1189f09b4d17d764aa476a7fd39b527ab8500065eaa47d1
3
+ size 639724744
added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "[PAD]": 32000
3
+ }
optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fe5a2142088a40cb09addb11ee0674b081264f783761220c4422148de33eba0
3
+ size 1279707477
rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0043f9b65ec71d5420a79beccd3fc0a98537d7c054b9fa454acf44396a69792
3
+ size 14244
scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfcd1b0dee3d3afc7ea181a31ec41347ec5c682f78af2adccc9a502bfc26d96a
3
+ size 1064
special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "</s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "</s>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
3
+ size 499723
tokenizer_config.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "add_prefix_space": true,
5
+ "added_tokens_decoder": {
6
+ "0": {
7
+ "content": "<unk>",
8
+ "lstrip": false,
9
+ "normalized": false,
10
+ "rstrip": false,
11
+ "single_word": false,
12
+ "special": true
13
+ },
14
+ "1": {
15
+ "content": "<s>",
16
+ "lstrip": false,
17
+ "normalized": false,
18
+ "rstrip": false,
19
+ "single_word": false,
20
+ "special": true
21
+ },
22
+ "2": {
23
+ "content": "</s>",
24
+ "lstrip": false,
25
+ "normalized": false,
26
+ "rstrip": false,
27
+ "single_word": false,
28
+ "special": true
29
+ },
30
+ "32000": {
31
+ "content": "[PAD]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false,
36
+ "special": true
37
+ }
38
+ },
39
+ "bos_token": "</s>",
40
+ "clean_up_tokenization_spaces": false,
41
+ "eos_token": "</s>",
42
+ "legacy": true,
43
+ "model_max_length": 512,
44
+ "pad_token": "[PAD]",
45
+ "padding_side": "right",
46
+ "sp_model_kwargs": {},
47
+ "spaces_between_special_tokens": false,
48
+ "tokenizer_class": "LlamaTokenizer",
49
+ "unk_token": "</s>",
50
+ "use_default_system_prompt": false
51
+ }
trainer_state.json ADDED
@@ -0,0 +1,2839 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 1.139561653137207,
3
+ "best_model_checkpoint": "epoch_weights/checkpoint-195855",
4
+ "epoch": 5.0,
5
+ "eval_steps": 500,
6
+ "global_step": 195855,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.01276454519925455,
13
+ "grad_norm": 140.28497314453125,
14
+ "learning_rate": 1.9948941819202982e-05,
15
+ "loss": 1.5664,
16
+ "step": 500
17
+ },
18
+ {
19
+ "epoch": 0.0255290903985091,
20
+ "grad_norm": 141.11338806152344,
21
+ "learning_rate": 1.9897883638405966e-05,
22
+ "loss": 1.5161,
23
+ "step": 1000
24
+ },
25
+ {
26
+ "epoch": 0.03829363559776365,
27
+ "grad_norm": 0.02641715481877327,
28
+ "learning_rate": 1.9846825457608946e-05,
29
+ "loss": 1.4215,
30
+ "step": 1500
31
+ },
32
+ {
33
+ "epoch": 0.0510581807970182,
34
+ "grad_norm": 135.9166717529297,
35
+ "learning_rate": 1.9795767276811927e-05,
36
+ "loss": 1.3856,
37
+ "step": 2000
38
+ },
39
+ {
40
+ "epoch": 0.06382272599627276,
41
+ "grad_norm": 128.78024291992188,
42
+ "learning_rate": 1.974470909601491e-05,
43
+ "loss": 1.4452,
44
+ "step": 2500
45
+ },
46
+ {
47
+ "epoch": 0.0765872711955273,
48
+ "grad_norm": 129.53390502929688,
49
+ "learning_rate": 1.969365091521789e-05,
50
+ "loss": 1.3472,
51
+ "step": 3000
52
+ },
53
+ {
54
+ "epoch": 0.08935181639478186,
55
+ "grad_norm": 0.33203646540641785,
56
+ "learning_rate": 1.9642592734420874e-05,
57
+ "loss": 1.237,
58
+ "step": 3500
59
+ },
60
+ {
61
+ "epoch": 0.1021163615940364,
62
+ "grad_norm": 0.055011678487062454,
63
+ "learning_rate": 1.9591534553623858e-05,
64
+ "loss": 1.2106,
65
+ "step": 4000
66
+ },
67
+ {
68
+ "epoch": 0.11488090679329095,
69
+ "grad_norm": 0.0781095027923584,
70
+ "learning_rate": 1.954047637282684e-05,
71
+ "loss": 1.2328,
72
+ "step": 4500
73
+ },
74
+ {
75
+ "epoch": 0.1276454519925455,
76
+ "grad_norm": 1.2353436946868896,
77
+ "learning_rate": 1.948941819202982e-05,
78
+ "loss": 1.2461,
79
+ "step": 5000
80
+ },
81
+ {
82
+ "epoch": 0.14040999719180006,
83
+ "grad_norm": 0.024271873757243156,
84
+ "learning_rate": 1.9438360011232803e-05,
85
+ "loss": 1.166,
86
+ "step": 5500
87
+ },
88
+ {
89
+ "epoch": 0.1531745423910546,
90
+ "grad_norm": 0.014351744204759598,
91
+ "learning_rate": 1.9387301830435783e-05,
92
+ "loss": 1.2231,
93
+ "step": 6000
94
+ },
95
+ {
96
+ "epoch": 0.16593908759030915,
97
+ "grad_norm": 0.9833817481994629,
98
+ "learning_rate": 1.9336243649638764e-05,
99
+ "loss": 1.304,
100
+ "step": 6500
101
+ },
102
+ {
103
+ "epoch": 0.17870363278956372,
104
+ "grad_norm": 96.1149673461914,
105
+ "learning_rate": 1.9285185468841747e-05,
106
+ "loss": 1.1702,
107
+ "step": 7000
108
+ },
109
+ {
110
+ "epoch": 0.19146817798881827,
111
+ "grad_norm": 0.02524268440902233,
112
+ "learning_rate": 1.9234127288044728e-05,
113
+ "loss": 1.2281,
114
+ "step": 7500
115
+ },
116
+ {
117
+ "epoch": 0.2042327231880728,
118
+ "grad_norm": 0.0072546107694506645,
119
+ "learning_rate": 1.9183069107247708e-05,
120
+ "loss": 1.2867,
121
+ "step": 8000
122
+ },
123
+ {
124
+ "epoch": 0.21699726838732736,
125
+ "grad_norm": 76.44178009033203,
126
+ "learning_rate": 1.9132010926450692e-05,
127
+ "loss": 1.1755,
128
+ "step": 8500
129
+ },
130
+ {
131
+ "epoch": 0.2297618135865819,
132
+ "grad_norm": 0.16026510298252106,
133
+ "learning_rate": 1.9080952745653672e-05,
134
+ "loss": 1.2859,
135
+ "step": 9000
136
+ },
137
+ {
138
+ "epoch": 0.24252635878583645,
139
+ "grad_norm": 0.06579646468162537,
140
+ "learning_rate": 1.9029894564856656e-05,
141
+ "loss": 1.1714,
142
+ "step": 9500
143
+ },
144
+ {
145
+ "epoch": 0.255290903985091,
146
+ "grad_norm": 0.00680249510332942,
147
+ "learning_rate": 1.8978836384059636e-05,
148
+ "loss": 1.2243,
149
+ "step": 10000
150
+ },
151
+ {
152
+ "epoch": 0.26805544918434554,
153
+ "grad_norm": 0.03524128720164299,
154
+ "learning_rate": 1.892777820326262e-05,
155
+ "loss": 1.2009,
156
+ "step": 10500
157
+ },
158
+ {
159
+ "epoch": 0.2808199943836001,
160
+ "grad_norm": 0.0176234133541584,
161
+ "learning_rate": 1.8876720022465604e-05,
162
+ "loss": 1.3231,
163
+ "step": 11000
164
+ },
165
+ {
166
+ "epoch": 0.2935845395828547,
167
+ "grad_norm": 95.00105285644531,
168
+ "learning_rate": 1.8825661841668584e-05,
169
+ "loss": 1.2972,
170
+ "step": 11500
171
+ },
172
+ {
173
+ "epoch": 0.3063490847821092,
174
+ "grad_norm": 0.11872061342000961,
175
+ "learning_rate": 1.8774603660871565e-05,
176
+ "loss": 1.1147,
177
+ "step": 12000
178
+ },
179
+ {
180
+ "epoch": 0.3191136299813638,
181
+ "grad_norm": 0.15176434814929962,
182
+ "learning_rate": 1.872354548007455e-05,
183
+ "loss": 1.2522,
184
+ "step": 12500
185
+ },
186
+ {
187
+ "epoch": 0.3318781751806183,
188
+ "grad_norm": 0.0020881330128759146,
189
+ "learning_rate": 1.867248729927753e-05,
190
+ "loss": 1.1833,
191
+ "step": 13000
192
+ },
193
+ {
194
+ "epoch": 0.34464272037987287,
195
+ "grad_norm": 85.6802749633789,
196
+ "learning_rate": 1.862142911848051e-05,
197
+ "loss": 1.2002,
198
+ "step": 13500
199
+ },
200
+ {
201
+ "epoch": 0.35740726557912744,
202
+ "grad_norm": 0.3004418909549713,
203
+ "learning_rate": 1.8570370937683493e-05,
204
+ "loss": 1.1833,
205
+ "step": 14000
206
+ },
207
+ {
208
+ "epoch": 0.37017181077838196,
209
+ "grad_norm": 0.11187928169965744,
210
+ "learning_rate": 1.8519312756886473e-05,
211
+ "loss": 1.2438,
212
+ "step": 14500
213
+ },
214
+ {
215
+ "epoch": 0.38293635597763653,
216
+ "grad_norm": 80.47846984863281,
217
+ "learning_rate": 1.8468254576089454e-05,
218
+ "loss": 1.2265,
219
+ "step": 15000
220
+ },
221
+ {
222
+ "epoch": 0.39570090117689105,
223
+ "grad_norm": 0.23214559257030487,
224
+ "learning_rate": 1.8417196395292437e-05,
225
+ "loss": 1.2991,
226
+ "step": 15500
227
+ },
228
+ {
229
+ "epoch": 0.4084654463761456,
230
+ "grad_norm": 0.28407028317451477,
231
+ "learning_rate": 1.8366138214495418e-05,
232
+ "loss": 1.1191,
233
+ "step": 16000
234
+ },
235
+ {
236
+ "epoch": 0.42122999157540014,
237
+ "grad_norm": 0.20093204081058502,
238
+ "learning_rate": 1.83150800336984e-05,
239
+ "loss": 1.1968,
240
+ "step": 16500
241
+ },
242
+ {
243
+ "epoch": 0.4339945367746547,
244
+ "grad_norm": 3.5033493041992188,
245
+ "learning_rate": 1.8264021852901382e-05,
246
+ "loss": 1.1747,
247
+ "step": 17000
248
+ },
249
+ {
250
+ "epoch": 0.4467590819739093,
251
+ "grad_norm": 0.18403905630111694,
252
+ "learning_rate": 1.8212963672104366e-05,
253
+ "loss": 1.2767,
254
+ "step": 17500
255
+ },
256
+ {
257
+ "epoch": 0.4595236271731638,
258
+ "grad_norm": 4.67779016494751,
259
+ "learning_rate": 1.8161905491307346e-05,
260
+ "loss": 1.1336,
261
+ "step": 18000
262
+ },
263
+ {
264
+ "epoch": 0.4722881723724184,
265
+ "grad_norm": 0.06564716249704361,
266
+ "learning_rate": 1.811084731051033e-05,
267
+ "loss": 1.2984,
268
+ "step": 18500
269
+ },
270
+ {
271
+ "epoch": 0.4850527175716729,
272
+ "grad_norm": 0.19199320673942566,
273
+ "learning_rate": 1.805978912971331e-05,
274
+ "loss": 1.2978,
275
+ "step": 19000
276
+ },
277
+ {
278
+ "epoch": 0.49781726277092747,
279
+ "grad_norm": 0.17818531394004822,
280
+ "learning_rate": 1.800873094891629e-05,
281
+ "loss": 1.2206,
282
+ "step": 19500
283
+ },
284
+ {
285
+ "epoch": 0.510581807970182,
286
+ "grad_norm": 0.01932280883193016,
287
+ "learning_rate": 1.7957672768119274e-05,
288
+ "loss": 1.2086,
289
+ "step": 20000
290
+ },
291
+ {
292
+ "epoch": 0.5233463531694366,
293
+ "grad_norm": 0.9884698987007141,
294
+ "learning_rate": 1.7906614587322255e-05,
295
+ "loss": 1.1908,
296
+ "step": 20500
297
+ },
298
+ {
299
+ "epoch": 0.5361108983686911,
300
+ "grad_norm": 88.46417236328125,
301
+ "learning_rate": 1.7855556406525235e-05,
302
+ "loss": 1.2336,
303
+ "step": 21000
304
+ },
305
+ {
306
+ "epoch": 0.5488754435679457,
307
+ "grad_norm": 85.45521545410156,
308
+ "learning_rate": 1.780449822572822e-05,
309
+ "loss": 1.3189,
310
+ "step": 21500
311
+ },
312
+ {
313
+ "epoch": 0.5616399887672002,
314
+ "grad_norm": 0.31710341572761536,
315
+ "learning_rate": 1.77534400449312e-05,
316
+ "loss": 1.167,
317
+ "step": 22000
318
+ },
319
+ {
320
+ "epoch": 0.5744045339664547,
321
+ "grad_norm": 0.1283329427242279,
322
+ "learning_rate": 1.7702381864134183e-05,
323
+ "loss": 1.3206,
324
+ "step": 22500
325
+ },
326
+ {
327
+ "epoch": 0.5871690791657094,
328
+ "grad_norm": 0.5704120993614197,
329
+ "learning_rate": 1.7651323683337164e-05,
330
+ "loss": 1.3472,
331
+ "step": 23000
332
+ },
333
+ {
334
+ "epoch": 0.5999336243649639,
335
+ "grad_norm": 0.17483896017074585,
336
+ "learning_rate": 1.7600265502540147e-05,
337
+ "loss": 1.038,
338
+ "step": 23500
339
+ },
340
+ {
341
+ "epoch": 0.6126981695642184,
342
+ "grad_norm": 0.10589884221553802,
343
+ "learning_rate": 1.7549207321743128e-05,
344
+ "loss": 1.1058,
345
+ "step": 24000
346
+ },
347
+ {
348
+ "epoch": 0.6254627147634729,
349
+ "grad_norm": 0.017856372520327568,
350
+ "learning_rate": 1.749814914094611e-05,
351
+ "loss": 1.1449,
352
+ "step": 24500
353
+ },
354
+ {
355
+ "epoch": 0.6382272599627276,
356
+ "grad_norm": 0.06654372066259384,
357
+ "learning_rate": 1.7447090960149092e-05,
358
+ "loss": 1.2523,
359
+ "step": 25000
360
+ },
361
+ {
362
+ "epoch": 0.6509918051619821,
363
+ "grad_norm": 0.21513181924819946,
364
+ "learning_rate": 1.7396032779352072e-05,
365
+ "loss": 1.4523,
366
+ "step": 25500
367
+ },
368
+ {
369
+ "epoch": 0.6637563503612366,
370
+ "grad_norm": 0.9422369003295898,
371
+ "learning_rate": 1.7344974598555056e-05,
372
+ "loss": 1.2769,
373
+ "step": 26000
374
+ },
375
+ {
376
+ "epoch": 0.6765208955604912,
377
+ "grad_norm": 0.162871316075325,
378
+ "learning_rate": 1.7293916417758036e-05,
379
+ "loss": 1.1441,
380
+ "step": 26500
381
+ },
382
+ {
383
+ "epoch": 0.6892854407597457,
384
+ "grad_norm": 71.17542266845703,
385
+ "learning_rate": 1.7242858236961017e-05,
386
+ "loss": 1.1155,
387
+ "step": 27000
388
+ },
389
+ {
390
+ "epoch": 0.7020499859590003,
391
+ "grad_norm": 100.56575012207031,
392
+ "learning_rate": 1.7191800056164e-05,
393
+ "loss": 1.1037,
394
+ "step": 27500
395
+ },
396
+ {
397
+ "epoch": 0.7148145311582549,
398
+ "grad_norm": 86.7327880859375,
399
+ "learning_rate": 1.714074187536698e-05,
400
+ "loss": 1.1733,
401
+ "step": 28000
402
+ },
403
+ {
404
+ "epoch": 0.7275790763575094,
405
+ "grad_norm": 18.82828140258789,
406
+ "learning_rate": 1.708968369456996e-05,
407
+ "loss": 1.222,
408
+ "step": 28500
409
+ },
410
+ {
411
+ "epoch": 0.7403436215567639,
412
+ "grad_norm": 0.5718840956687927,
413
+ "learning_rate": 1.7038625513772945e-05,
414
+ "loss": 1.168,
415
+ "step": 29000
416
+ },
417
+ {
418
+ "epoch": 0.7531081667560184,
419
+ "grad_norm": 0.4056214392185211,
420
+ "learning_rate": 1.698756733297593e-05,
421
+ "loss": 1.3287,
422
+ "step": 29500
423
+ },
424
+ {
425
+ "epoch": 0.7658727119552731,
426
+ "grad_norm": 0.04400855302810669,
427
+ "learning_rate": 1.693650915217891e-05,
428
+ "loss": 1.174,
429
+ "step": 30000
430
+ },
431
+ {
432
+ "epoch": 0.7786372571545276,
433
+ "grad_norm": 0.04283575341105461,
434
+ "learning_rate": 1.6885450971381893e-05,
435
+ "loss": 1.2674,
436
+ "step": 30500
437
+ },
438
+ {
439
+ "epoch": 0.7914018023537821,
440
+ "grad_norm": 0.1845155507326126,
441
+ "learning_rate": 1.6834392790584873e-05,
442
+ "loss": 1.2073,
443
+ "step": 31000
444
+ },
445
+ {
446
+ "epoch": 0.8041663475530367,
447
+ "grad_norm": 0.06058114022016525,
448
+ "learning_rate": 1.6783334609787854e-05,
449
+ "loss": 1.2334,
450
+ "step": 31500
451
+ },
452
+ {
453
+ "epoch": 0.8169308927522912,
454
+ "grad_norm": 1.1562000513076782,
455
+ "learning_rate": 1.6732276428990837e-05,
456
+ "loss": 1.214,
457
+ "step": 32000
458
+ },
459
+ {
460
+ "epoch": 0.8296954379515458,
461
+ "grad_norm": 0.378207802772522,
462
+ "learning_rate": 1.6681218248193818e-05,
463
+ "loss": 1.1715,
464
+ "step": 32500
465
+ },
466
+ {
467
+ "epoch": 0.8424599831508003,
468
+ "grad_norm": 0.3407273292541504,
469
+ "learning_rate": 1.66301600673968e-05,
470
+ "loss": 1.0001,
471
+ "step": 33000
472
+ },
473
+ {
474
+ "epoch": 0.8552245283500549,
475
+ "grad_norm": 0.09269559383392334,
476
+ "learning_rate": 1.6579101886599782e-05,
477
+ "loss": 1.228,
478
+ "step": 33500
479
+ },
480
+ {
481
+ "epoch": 0.8679890735493094,
482
+ "grad_norm": 0.0733281746506691,
483
+ "learning_rate": 1.6528043705802762e-05,
484
+ "loss": 1.2247,
485
+ "step": 34000
486
+ },
487
+ {
488
+ "epoch": 0.880753618748564,
489
+ "grad_norm": 0.22338716685771942,
490
+ "learning_rate": 1.6476985525005746e-05,
491
+ "loss": 1.2527,
492
+ "step": 34500
493
+ },
494
+ {
495
+ "epoch": 0.8935181639478186,
496
+ "grad_norm": 89.00585174560547,
497
+ "learning_rate": 1.6425927344208727e-05,
498
+ "loss": 1.2141,
499
+ "step": 35000
500
+ },
501
+ {
502
+ "epoch": 0.9062827091470731,
503
+ "grad_norm": 99.81867218017578,
504
+ "learning_rate": 1.6374869163411707e-05,
505
+ "loss": 1.2188,
506
+ "step": 35500
507
+ },
508
+ {
509
+ "epoch": 0.9190472543463276,
510
+ "grad_norm": 0.04752332717180252,
511
+ "learning_rate": 1.632381098261469e-05,
512
+ "loss": 1.213,
513
+ "step": 36000
514
+ },
515
+ {
516
+ "epoch": 0.9318117995455822,
517
+ "grad_norm": 0.887084424495697,
518
+ "learning_rate": 1.6272752801817674e-05,
519
+ "loss": 1.0187,
520
+ "step": 36500
521
+ },
522
+ {
523
+ "epoch": 0.9445763447448368,
524
+ "grad_norm": 0.10183027386665344,
525
+ "learning_rate": 1.6221694621020655e-05,
526
+ "loss": 1.3846,
527
+ "step": 37000
528
+ },
529
+ {
530
+ "epoch": 0.9573408899440913,
531
+ "grad_norm": 68.15225982666016,
532
+ "learning_rate": 1.617063644022364e-05,
533
+ "loss": 1.1611,
534
+ "step": 37500
535
+ },
536
+ {
537
+ "epoch": 0.9701054351433458,
538
+ "grad_norm": 77.0361557006836,
539
+ "learning_rate": 1.611957825942662e-05,
540
+ "loss": 1.3536,
541
+ "step": 38000
542
+ },
543
+ {
544
+ "epoch": 0.9828699803426004,
545
+ "grad_norm": 0.49578896164894104,
546
+ "learning_rate": 1.60685200786296e-05,
547
+ "loss": 1.2039,
548
+ "step": 38500
549
+ },
550
+ {
551
+ "epoch": 0.9956345255418549,
552
+ "grad_norm": 71.01766204833984,
553
+ "learning_rate": 1.6017461897832583e-05,
554
+ "loss": 1.2881,
555
+ "step": 39000
556
+ },
557
+ {
558
+ "epoch": 1.0,
559
+ "eval_accuracy": 0.7532175785089156,
560
+ "eval_f1": 0.7670216056201122,
561
+ "eval_loss": 1.2633434534072876,
562
+ "eval_precision": 0.7280046968044955,
563
+ "eval_recall": 0.8104575163398693,
564
+ "eval_runtime": 5162.2664,
565
+ "eval_samples_per_second": 4.139,
566
+ "eval_steps_per_second": 4.139,
567
+ "step": 39171
568
+ },
569
+ {
570
+ "epoch": 1.0083990707411095,
571
+ "grad_norm": 0.140496626496315,
572
+ "learning_rate": 1.5966403717035563e-05,
573
+ "loss": 1.1573,
574
+ "step": 39500
575
+ },
576
+ {
577
+ "epoch": 1.021163615940364,
578
+ "grad_norm": 4.852931976318359,
579
+ "learning_rate": 1.5915345536238544e-05,
580
+ "loss": 1.239,
581
+ "step": 40000
582
+ },
583
+ {
584
+ "epoch": 1.0339281611396185,
585
+ "grad_norm": 67.7839584350586,
586
+ "learning_rate": 1.5864287355441528e-05,
587
+ "loss": 1.1304,
588
+ "step": 40500
589
+ },
590
+ {
591
+ "epoch": 1.0466927063388731,
592
+ "grad_norm": 64.76880645751953,
593
+ "learning_rate": 1.5813229174644508e-05,
594
+ "loss": 1.2634,
595
+ "step": 41000
596
+ },
597
+ {
598
+ "epoch": 1.0594572515381278,
599
+ "grad_norm": 0.01988534815609455,
600
+ "learning_rate": 1.576217099384749e-05,
601
+ "loss": 1.1543,
602
+ "step": 41500
603
+ },
604
+ {
605
+ "epoch": 1.0722217967373822,
606
+ "grad_norm": 0.09682073444128036,
607
+ "learning_rate": 1.5711112813050472e-05,
608
+ "loss": 1.3033,
609
+ "step": 42000
610
+ },
611
+ {
612
+ "epoch": 1.0849863419366368,
613
+ "grad_norm": 62.33816146850586,
614
+ "learning_rate": 1.5660054632253453e-05,
615
+ "loss": 1.2563,
616
+ "step": 42500
617
+ },
618
+ {
619
+ "epoch": 1.0977508871358914,
620
+ "grad_norm": 0.10174135863780975,
621
+ "learning_rate": 1.5608996451456436e-05,
622
+ "loss": 1.1327,
623
+ "step": 43000
624
+ },
625
+ {
626
+ "epoch": 1.1105154323351458,
627
+ "grad_norm": 0.09258142858743668,
628
+ "learning_rate": 1.555793827065942e-05,
629
+ "loss": 1.1346,
630
+ "step": 43500
631
+ },
632
+ {
633
+ "epoch": 1.1232799775344005,
634
+ "grad_norm": 2.3177037239074707,
635
+ "learning_rate": 1.55068800898624e-05,
636
+ "loss": 1.3973,
637
+ "step": 44000
638
+ },
639
+ {
640
+ "epoch": 1.136044522733655,
641
+ "grad_norm": 0.11052542179822922,
642
+ "learning_rate": 1.545582190906538e-05,
643
+ "loss": 1.1122,
644
+ "step": 44500
645
+ },
646
+ {
647
+ "epoch": 1.1488090679329095,
648
+ "grad_norm": 0.46391013264656067,
649
+ "learning_rate": 1.5404763728268365e-05,
650
+ "loss": 1.276,
651
+ "step": 45000
652
+ },
653
+ {
654
+ "epoch": 1.1615736131321641,
655
+ "grad_norm": 105.83382415771484,
656
+ "learning_rate": 1.5353705547471345e-05,
657
+ "loss": 1.1965,
658
+ "step": 45500
659
+ },
660
+ {
661
+ "epoch": 1.1743381583314187,
662
+ "grad_norm": 0.35738277435302734,
663
+ "learning_rate": 1.5302647366674325e-05,
664
+ "loss": 1.1288,
665
+ "step": 46000
666
+ },
667
+ {
668
+ "epoch": 1.1871027035306732,
669
+ "grad_norm": 0.5937046408653259,
670
+ "learning_rate": 1.5251589185877309e-05,
671
+ "loss": 1.2037,
672
+ "step": 46500
673
+ },
674
+ {
675
+ "epoch": 1.1998672487299278,
676
+ "grad_norm": 22.996158599853516,
677
+ "learning_rate": 1.520053100508029e-05,
678
+ "loss": 1.2176,
679
+ "step": 47000
680
+ },
681
+ {
682
+ "epoch": 1.2126317939291824,
683
+ "grad_norm": 66.02085876464844,
684
+ "learning_rate": 1.5149472824283272e-05,
685
+ "loss": 1.2341,
686
+ "step": 47500
687
+ },
688
+ {
689
+ "epoch": 1.2253963391284368,
690
+ "grad_norm": 0.021743183955550194,
691
+ "learning_rate": 1.5098414643486254e-05,
692
+ "loss": 1.1946,
693
+ "step": 48000
694
+ },
695
+ {
696
+ "epoch": 1.2381608843276914,
697
+ "grad_norm": 0.07644446194171906,
698
+ "learning_rate": 1.5047356462689236e-05,
699
+ "loss": 1.2634,
700
+ "step": 48500
701
+ },
702
+ {
703
+ "epoch": 1.250925429526946,
704
+ "grad_norm": 0.18177048861980438,
705
+ "learning_rate": 1.4996298281892216e-05,
706
+ "loss": 1.2359,
707
+ "step": 49000
708
+ },
709
+ {
710
+ "epoch": 1.2636899747262005,
711
+ "grad_norm": 0.062125977128744125,
712
+ "learning_rate": 1.49452401010952e-05,
713
+ "loss": 1.1674,
714
+ "step": 49500
715
+ },
716
+ {
717
+ "epoch": 1.2764545199254551,
718
+ "grad_norm": 0.13008077442646027,
719
+ "learning_rate": 1.489418192029818e-05,
720
+ "loss": 1.0958,
721
+ "step": 50000
722
+ },
723
+ {
724
+ "epoch": 1.2892190651247097,
725
+ "grad_norm": 70.10698699951172,
726
+ "learning_rate": 1.4843123739501162e-05,
727
+ "loss": 1.0869,
728
+ "step": 50500
729
+ },
730
+ {
731
+ "epoch": 1.3019836103239641,
732
+ "grad_norm": 0.06958911567926407,
733
+ "learning_rate": 1.4792065558704144e-05,
734
+ "loss": 1.3555,
735
+ "step": 51000
736
+ },
737
+ {
738
+ "epoch": 1.3147481555232188,
739
+ "grad_norm": 0.18112103641033173,
740
+ "learning_rate": 1.4741007377907126e-05,
741
+ "loss": 1.0604,
742
+ "step": 51500
743
+ },
744
+ {
745
+ "epoch": 1.3275127007224732,
746
+ "grad_norm": 0.061362918466329575,
747
+ "learning_rate": 1.4689949197110107e-05,
748
+ "loss": 1.1762,
749
+ "step": 52000
750
+ },
751
+ {
752
+ "epoch": 1.3402772459217278,
753
+ "grad_norm": 0.07672413438558578,
754
+ "learning_rate": 1.463889101631309e-05,
755
+ "loss": 1.1267,
756
+ "step": 52500
757
+ },
758
+ {
759
+ "epoch": 1.3530417911209824,
760
+ "grad_norm": 0.21430732309818268,
761
+ "learning_rate": 1.4587832835516071e-05,
762
+ "loss": 1.2802,
763
+ "step": 53000
764
+ },
765
+ {
766
+ "epoch": 1.3658063363202368,
767
+ "grad_norm": 0.5219631791114807,
768
+ "learning_rate": 1.4536774654719053e-05,
769
+ "loss": 1.179,
770
+ "step": 53500
771
+ },
772
+ {
773
+ "epoch": 1.3785708815194915,
774
+ "grad_norm": 43.975406646728516,
775
+ "learning_rate": 1.4485716473922035e-05,
776
+ "loss": 1.3502,
777
+ "step": 54000
778
+ },
779
+ {
780
+ "epoch": 1.3913354267187459,
781
+ "grad_norm": 0.08102339506149292,
782
+ "learning_rate": 1.4434658293125017e-05,
783
+ "loss": 1.2184,
784
+ "step": 54500
785
+ },
786
+ {
787
+ "epoch": 1.4040999719180005,
788
+ "grad_norm": 60.85429000854492,
789
+ "learning_rate": 1.4383600112328e-05,
790
+ "loss": 1.2534,
791
+ "step": 55000
792
+ },
793
+ {
794
+ "epoch": 1.4168645171172551,
795
+ "grad_norm": 0.0526944063603878,
796
+ "learning_rate": 1.4332541931530981e-05,
797
+ "loss": 1.0563,
798
+ "step": 55500
799
+ },
800
+ {
801
+ "epoch": 1.4296290623165095,
802
+ "grad_norm": 0.42533427476882935,
803
+ "learning_rate": 1.4281483750733962e-05,
804
+ "loss": 1.1349,
805
+ "step": 56000
806
+ },
807
+ {
808
+ "epoch": 1.4423936075157642,
809
+ "grad_norm": 0.05623629689216614,
810
+ "learning_rate": 1.4230425569936946e-05,
811
+ "loss": 1.1703,
812
+ "step": 56500
813
+ },
814
+ {
815
+ "epoch": 1.4551581527150188,
816
+ "grad_norm": 0.18461133539676666,
817
+ "learning_rate": 1.4179367389139926e-05,
818
+ "loss": 1.0712,
819
+ "step": 57000
820
+ },
821
+ {
822
+ "epoch": 1.4679226979142732,
823
+ "grad_norm": 0.05219269543886185,
824
+ "learning_rate": 1.4128309208342908e-05,
825
+ "loss": 1.2111,
826
+ "step": 57500
827
+ },
828
+ {
829
+ "epoch": 1.4806872431135278,
830
+ "grad_norm": 0.21101772785186768,
831
+ "learning_rate": 1.407725102754589e-05,
832
+ "loss": 1.2732,
833
+ "step": 58000
834
+ },
835
+ {
836
+ "epoch": 1.4934517883127825,
837
+ "grad_norm": 86.43793487548828,
838
+ "learning_rate": 1.4026192846748872e-05,
839
+ "loss": 1.2156,
840
+ "step": 58500
841
+ },
842
+ {
843
+ "epoch": 1.5062163335120369,
844
+ "grad_norm": 0.06511280685663223,
845
+ "learning_rate": 1.3975134665951853e-05,
846
+ "loss": 1.1611,
847
+ "step": 59000
848
+ },
849
+ {
850
+ "epoch": 1.5189808787112915,
851
+ "grad_norm": 97.44439697265625,
852
+ "learning_rate": 1.3924076485154836e-05,
853
+ "loss": 1.2253,
854
+ "step": 59500
855
+ },
856
+ {
857
+ "epoch": 1.5317454239105461,
858
+ "grad_norm": 0.08237478137016296,
859
+ "learning_rate": 1.3873018304357817e-05,
860
+ "loss": 1.0068,
861
+ "step": 60000
862
+ },
863
+ {
864
+ "epoch": 1.5445099691098005,
865
+ "grad_norm": 0.05841671675443649,
866
+ "learning_rate": 1.3821960123560799e-05,
867
+ "loss": 1.3222,
868
+ "step": 60500
869
+ },
870
+ {
871
+ "epoch": 1.5572745143090552,
872
+ "grad_norm": 75.90589141845703,
873
+ "learning_rate": 1.377090194276378e-05,
874
+ "loss": 1.2399,
875
+ "step": 61000
876
+ },
877
+ {
878
+ "epoch": 1.5700390595083098,
879
+ "grad_norm": 1.232236385345459,
880
+ "learning_rate": 1.3719843761966763e-05,
881
+ "loss": 1.1782,
882
+ "step": 61500
883
+ },
884
+ {
885
+ "epoch": 1.5828036047075642,
886
+ "grad_norm": 0.02467476576566696,
887
+ "learning_rate": 1.3668785581169743e-05,
888
+ "loss": 1.2754,
889
+ "step": 62000
890
+ },
891
+ {
892
+ "epoch": 1.5955681499068188,
893
+ "grad_norm": 0.09265103191137314,
894
+ "learning_rate": 1.3617727400372727e-05,
895
+ "loss": 1.2535,
896
+ "step": 62500
897
+ },
898
+ {
899
+ "epoch": 1.6083326951060735,
900
+ "grad_norm": 96.438232421875,
901
+ "learning_rate": 1.3566669219575707e-05,
902
+ "loss": 1.1848,
903
+ "step": 63000
904
+ },
905
+ {
906
+ "epoch": 1.6210972403053279,
907
+ "grad_norm": 47.80929183959961,
908
+ "learning_rate": 1.351561103877869e-05,
909
+ "loss": 1.1939,
910
+ "step": 63500
911
+ },
912
+ {
913
+ "epoch": 1.6338617855045825,
914
+ "grad_norm": 0.18950742483139038,
915
+ "learning_rate": 1.3464552857981672e-05,
916
+ "loss": 1.2411,
917
+ "step": 64000
918
+ },
919
+ {
920
+ "epoch": 1.6466263307038371,
921
+ "grad_norm": 0.16575618088245392,
922
+ "learning_rate": 1.3413494677184654e-05,
923
+ "loss": 1.1867,
924
+ "step": 64500
925
+ },
926
+ {
927
+ "epoch": 1.6593908759030915,
928
+ "grad_norm": 0.14617562294006348,
929
+ "learning_rate": 1.3362436496387634e-05,
930
+ "loss": 1.1463,
931
+ "step": 65000
932
+ },
933
+ {
934
+ "epoch": 1.6721554211023462,
935
+ "grad_norm": 0.5285425186157227,
936
+ "learning_rate": 1.3311378315590618e-05,
937
+ "loss": 1.1077,
938
+ "step": 65500
939
+ },
940
+ {
941
+ "epoch": 1.6849199663016008,
942
+ "grad_norm": 97.7320785522461,
943
+ "learning_rate": 1.3260320134793598e-05,
944
+ "loss": 1.1621,
945
+ "step": 66000
946
+ },
947
+ {
948
+ "epoch": 1.6976845115008552,
949
+ "grad_norm": 0.18436358869075775,
950
+ "learning_rate": 1.3209261953996579e-05,
951
+ "loss": 1.2015,
952
+ "step": 66500
953
+ },
954
+ {
955
+ "epoch": 1.7104490567001098,
956
+ "grad_norm": 89.31096649169922,
957
+ "learning_rate": 1.3158203773199562e-05,
958
+ "loss": 1.1884,
959
+ "step": 67000
960
+ },
961
+ {
962
+ "epoch": 1.7232136018993645,
963
+ "grad_norm": 0.21570570766925812,
964
+ "learning_rate": 1.3107145592402544e-05,
965
+ "loss": 1.1801,
966
+ "step": 67500
967
+ },
968
+ {
969
+ "epoch": 1.7359781470986189,
970
+ "grad_norm": 82.99295806884766,
971
+ "learning_rate": 1.3056087411605525e-05,
972
+ "loss": 1.1454,
973
+ "step": 68000
974
+ },
975
+ {
976
+ "epoch": 1.7487426922978733,
977
+ "grad_norm": 0.08007831126451492,
978
+ "learning_rate": 1.3005029230808509e-05,
979
+ "loss": 1.1881,
980
+ "step": 68500
981
+ },
982
+ {
983
+ "epoch": 1.7615072374971281,
984
+ "grad_norm": 60.14308166503906,
985
+ "learning_rate": 1.2953971050011489e-05,
986
+ "loss": 1.172,
987
+ "step": 69000
988
+ },
989
+ {
990
+ "epoch": 1.7742717826963825,
991
+ "grad_norm": 0.11971332132816315,
992
+ "learning_rate": 1.290291286921447e-05,
993
+ "loss": 1.1621,
994
+ "step": 69500
995
+ },
996
+ {
997
+ "epoch": 1.787036327895637,
998
+ "grad_norm": 0.10164999961853027,
999
+ "learning_rate": 1.2851854688417453e-05,
1000
+ "loss": 1.1249,
1001
+ "step": 70000
1002
+ },
1003
+ {
1004
+ "epoch": 1.7998008730948918,
1005
+ "grad_norm": 61.06598663330078,
1006
+ "learning_rate": 1.2800796507620435e-05,
1007
+ "loss": 1.2222,
1008
+ "step": 70500
1009
+ },
1010
+ {
1011
+ "epoch": 1.8125654182941462,
1012
+ "grad_norm": 0.14350704848766327,
1013
+ "learning_rate": 1.2749738326823416e-05,
1014
+ "loss": 1.3255,
1015
+ "step": 71000
1016
+ },
1017
+ {
1018
+ "epoch": 1.8253299634934006,
1019
+ "grad_norm": 0.09616607427597046,
1020
+ "learning_rate": 1.26986801460264e-05,
1021
+ "loss": 1.035,
1022
+ "step": 71500
1023
+ },
1024
+ {
1025
+ "epoch": 1.8380945086926552,
1026
+ "grad_norm": 55.88264465332031,
1027
+ "learning_rate": 1.264762196522938e-05,
1028
+ "loss": 1.0909,
1029
+ "step": 72000
1030
+ },
1031
+ {
1032
+ "epoch": 1.8508590538919099,
1033
+ "grad_norm": 0.38782599568367004,
1034
+ "learning_rate": 1.259656378443236e-05,
1035
+ "loss": 1.1427,
1036
+ "step": 72500
1037
+ },
1038
+ {
1039
+ "epoch": 1.8636235990911643,
1040
+ "grad_norm": 58.656150817871094,
1041
+ "learning_rate": 1.2545505603635344e-05,
1042
+ "loss": 1.3211,
1043
+ "step": 73000
1044
+ },
1045
+ {
1046
+ "epoch": 1.876388144290419,
1047
+ "grad_norm": 0.17766106128692627,
1048
+ "learning_rate": 1.2494447422838324e-05,
1049
+ "loss": 1.2852,
1050
+ "step": 73500
1051
+ },
1052
+ {
1053
+ "epoch": 1.8891526894896735,
1054
+ "grad_norm": 0.3174474537372589,
1055
+ "learning_rate": 1.2443389242041306e-05,
1056
+ "loss": 1.3066,
1057
+ "step": 74000
1058
+ },
1059
+ {
1060
+ "epoch": 1.901917234688928,
1061
+ "grad_norm": 0.035434041172266006,
1062
+ "learning_rate": 1.239233106124429e-05,
1063
+ "loss": 1.1822,
1064
+ "step": 74500
1065
+ },
1066
+ {
1067
+ "epoch": 1.9146817798881826,
1068
+ "grad_norm": 0.8877829909324646,
1069
+ "learning_rate": 1.234127288044727e-05,
1070
+ "loss": 1.2427,
1071
+ "step": 75000
1072
+ },
1073
+ {
1074
+ "epoch": 1.9274463250874372,
1075
+ "grad_norm": 0.11592817306518555,
1076
+ "learning_rate": 1.229021469965025e-05,
1077
+ "loss": 1.0892,
1078
+ "step": 75500
1079
+ },
1080
+ {
1081
+ "epoch": 1.9402108702866916,
1082
+ "grad_norm": 0.1280338168144226,
1083
+ "learning_rate": 1.2239156518853235e-05,
1084
+ "loss": 1.1299,
1085
+ "step": 76000
1086
+ },
1087
+ {
1088
+ "epoch": 1.9529754154859462,
1089
+ "grad_norm": 0.6283624768257141,
1090
+ "learning_rate": 1.2188098338056215e-05,
1091
+ "loss": 1.1577,
1092
+ "step": 76500
1093
+ },
1094
+ {
1095
+ "epoch": 1.9657399606852008,
1096
+ "grad_norm": 84.02747344970703,
1097
+ "learning_rate": 1.2137040157259199e-05,
1098
+ "loss": 1.2079,
1099
+ "step": 77000
1100
+ },
1101
+ {
1102
+ "epoch": 1.9785045058844553,
1103
+ "grad_norm": 0.0788327232003212,
1104
+ "learning_rate": 1.2085981976462179e-05,
1105
+ "loss": 1.1105,
1106
+ "step": 77500
1107
+ },
1108
+ {
1109
+ "epoch": 1.9912690510837099,
1110
+ "grad_norm": 0.23907127976417542,
1111
+ "learning_rate": 1.2034923795665161e-05,
1112
+ "loss": 1.2612,
1113
+ "step": 78000
1114
+ },
1115
+ {
1116
+ "epoch": 2.0,
1117
+ "eval_accuracy": 0.7557448401741003,
1118
+ "eval_f1": 0.7723644611157151,
1119
+ "eval_loss": 1.1975839138031006,
1120
+ "eval_precision": 0.7247278382581649,
1121
+ "eval_recall": 0.826704014939309,
1122
+ "eval_runtime": 12078.9848,
1123
+ "eval_samples_per_second": 1.769,
1124
+ "eval_steps_per_second": 1.769,
1125
+ "step": 78342
1126
+ },
1127
+ {
1128
+ "epoch": 2.0040335962829645,
1129
+ "grad_norm": 0.14994749426841736,
1130
+ "learning_rate": 1.1983865614868145e-05,
1131
+ "loss": 1.2523,
1132
+ "step": 78500
1133
+ },
1134
+ {
1135
+ "epoch": 2.016798141482219,
1136
+ "grad_norm": 0.31080254912376404,
1137
+ "learning_rate": 1.1932807434071125e-05,
1138
+ "loss": 1.1872,
1139
+ "step": 79000
1140
+ },
1141
+ {
1142
+ "epoch": 2.0295626866814733,
1143
+ "grad_norm": 84.3240737915039,
1144
+ "learning_rate": 1.1881749253274106e-05,
1145
+ "loss": 1.2685,
1146
+ "step": 79500
1147
+ },
1148
+ {
1149
+ "epoch": 2.042327231880728,
1150
+ "grad_norm": 0.23146286606788635,
1151
+ "learning_rate": 1.183069107247709e-05,
1152
+ "loss": 1.1073,
1153
+ "step": 80000
1154
+ },
1155
+ {
1156
+ "epoch": 2.0550917770799826,
1157
+ "grad_norm": 79.5693359375,
1158
+ "learning_rate": 1.177963289168007e-05,
1159
+ "loss": 1.3067,
1160
+ "step": 80500
1161
+ },
1162
+ {
1163
+ "epoch": 2.067856322279237,
1164
+ "grad_norm": 0.3084176778793335,
1165
+ "learning_rate": 1.1728574710883052e-05,
1166
+ "loss": 1.2385,
1167
+ "step": 81000
1168
+ },
1169
+ {
1170
+ "epoch": 2.080620867478492,
1171
+ "grad_norm": 0.18532565236091614,
1172
+ "learning_rate": 1.1677516530086036e-05,
1173
+ "loss": 1.0913,
1174
+ "step": 81500
1175
+ },
1176
+ {
1177
+ "epoch": 2.0933854126777462,
1178
+ "grad_norm": 0.28613898158073425,
1179
+ "learning_rate": 1.1626458349289016e-05,
1180
+ "loss": 1.1676,
1181
+ "step": 82000
1182
+ },
1183
+ {
1184
+ "epoch": 2.1061499578770007,
1185
+ "grad_norm": 0.2203376442193985,
1186
+ "learning_rate": 1.1575400168491996e-05,
1187
+ "loss": 1.1586,
1188
+ "step": 82500
1189
+ },
1190
+ {
1191
+ "epoch": 2.1189145030762555,
1192
+ "grad_norm": 0.028099488466978073,
1193
+ "learning_rate": 1.152434198769498e-05,
1194
+ "loss": 1.2112,
1195
+ "step": 83000
1196
+ },
1197
+ {
1198
+ "epoch": 2.13167904827551,
1199
+ "grad_norm": 0.38020676374435425,
1200
+ "learning_rate": 1.147328380689796e-05,
1201
+ "loss": 1.1896,
1202
+ "step": 83500
1203
+ },
1204
+ {
1205
+ "epoch": 2.1444435934747643,
1206
+ "grad_norm": 0.2446543127298355,
1207
+ "learning_rate": 1.1422225626100943e-05,
1208
+ "loss": 1.24,
1209
+ "step": 84000
1210
+ },
1211
+ {
1212
+ "epoch": 2.157208138674019,
1213
+ "grad_norm": 0.2872558534145355,
1214
+ "learning_rate": 1.1371167445303925e-05,
1215
+ "loss": 1.1135,
1216
+ "step": 84500
1217
+ },
1218
+ {
1219
+ "epoch": 2.1699726838732736,
1220
+ "grad_norm": 54.6800422668457,
1221
+ "learning_rate": 1.1320109264506907e-05,
1222
+ "loss": 1.1922,
1223
+ "step": 85000
1224
+ },
1225
+ {
1226
+ "epoch": 2.182737229072528,
1227
+ "grad_norm": 54.61248779296875,
1228
+ "learning_rate": 1.1269051083709887e-05,
1229
+ "loss": 1.0622,
1230
+ "step": 85500
1231
+ },
1232
+ {
1233
+ "epoch": 2.195501774271783,
1234
+ "grad_norm": 0.4933607280254364,
1235
+ "learning_rate": 1.1217992902912871e-05,
1236
+ "loss": 1.2695,
1237
+ "step": 86000
1238
+ },
1239
+ {
1240
+ "epoch": 2.2082663194710372,
1241
+ "grad_norm": 0.917009711265564,
1242
+ "learning_rate": 1.1166934722115851e-05,
1243
+ "loss": 1.0661,
1244
+ "step": 86500
1245
+ },
1246
+ {
1247
+ "epoch": 2.2210308646702916,
1248
+ "grad_norm": 53.22758865356445,
1249
+ "learning_rate": 1.1115876541318833e-05,
1250
+ "loss": 1.1891,
1251
+ "step": 87000
1252
+ },
1253
+ {
1254
+ "epoch": 2.2337954098695465,
1255
+ "grad_norm": 0.043716687709093094,
1256
+ "learning_rate": 1.1064818360521816e-05,
1257
+ "loss": 1.1913,
1258
+ "step": 87500
1259
+ },
1260
+ {
1261
+ "epoch": 2.246559955068801,
1262
+ "grad_norm": 0.1775452345609665,
1263
+ "learning_rate": 1.1013760179724798e-05,
1264
+ "loss": 1.2758,
1265
+ "step": 88000
1266
+ },
1267
+ {
1268
+ "epoch": 2.2593245002680553,
1269
+ "grad_norm": 0.9761499762535095,
1270
+ "learning_rate": 1.0962701998927778e-05,
1271
+ "loss": 1.3702,
1272
+ "step": 88500
1273
+ },
1274
+ {
1275
+ "epoch": 2.27208904546731,
1276
+ "grad_norm": 0.12591148912906647,
1277
+ "learning_rate": 1.0911643818130762e-05,
1278
+ "loss": 1.1303,
1279
+ "step": 89000
1280
+ },
1281
+ {
1282
+ "epoch": 2.2848535906665646,
1283
+ "grad_norm": 0.2779516577720642,
1284
+ "learning_rate": 1.0860585637333742e-05,
1285
+ "loss": 1.3963,
1286
+ "step": 89500
1287
+ },
1288
+ {
1289
+ "epoch": 2.297618135865819,
1290
+ "grad_norm": 56.76412582397461,
1291
+ "learning_rate": 1.0809527456536724e-05,
1292
+ "loss": 1.2371,
1293
+ "step": 90000
1294
+ },
1295
+ {
1296
+ "epoch": 2.310382681065074,
1297
+ "grad_norm": 76.87971496582031,
1298
+ "learning_rate": 1.0758469275739706e-05,
1299
+ "loss": 1.0529,
1300
+ "step": 90500
1301
+ },
1302
+ {
1303
+ "epoch": 2.3231472262643282,
1304
+ "grad_norm": 71.0569839477539,
1305
+ "learning_rate": 1.0707411094942688e-05,
1306
+ "loss": 1.0559,
1307
+ "step": 91000
1308
+ },
1309
+ {
1310
+ "epoch": 2.3359117714635826,
1311
+ "grad_norm": 52.22985076904297,
1312
+ "learning_rate": 1.0656352914145669e-05,
1313
+ "loss": 1.1991,
1314
+ "step": 91500
1315
+ },
1316
+ {
1317
+ "epoch": 2.3486763166628375,
1318
+ "grad_norm": 79.58370971679688,
1319
+ "learning_rate": 1.0605294733348653e-05,
1320
+ "loss": 1.1617,
1321
+ "step": 92000
1322
+ },
1323
+ {
1324
+ "epoch": 2.361440861862092,
1325
+ "grad_norm": 0.10898584127426147,
1326
+ "learning_rate": 1.0554236552551633e-05,
1327
+ "loss": 1.0233,
1328
+ "step": 92500
1329
+ },
1330
+ {
1331
+ "epoch": 2.3742054070613463,
1332
+ "grad_norm": 53.62710189819336,
1333
+ "learning_rate": 1.0503178371754615e-05,
1334
+ "loss": 1.1401,
1335
+ "step": 93000
1336
+ },
1337
+ {
1338
+ "epoch": 2.3869699522606007,
1339
+ "grad_norm": 0.14643320441246033,
1340
+ "learning_rate": 1.0452120190957597e-05,
1341
+ "loss": 1.1803,
1342
+ "step": 93500
1343
+ },
1344
+ {
1345
+ "epoch": 2.3997344974598556,
1346
+ "grad_norm": 53.59674072265625,
1347
+ "learning_rate": 1.0401062010160579e-05,
1348
+ "loss": 1.2185,
1349
+ "step": 94000
1350
+ },
1351
+ {
1352
+ "epoch": 2.41249904265911,
1353
+ "grad_norm": 50.3306999206543,
1354
+ "learning_rate": 1.035000382936356e-05,
1355
+ "loss": 1.2904,
1356
+ "step": 94500
1357
+ },
1358
+ {
1359
+ "epoch": 2.425263587858365,
1360
+ "grad_norm": 50.08375930786133,
1361
+ "learning_rate": 1.0298945648566543e-05,
1362
+ "loss": 1.1238,
1363
+ "step": 95000
1364
+ },
1365
+ {
1366
+ "epoch": 2.4380281330576192,
1367
+ "grad_norm": 1.118212103843689,
1368
+ "learning_rate": 1.0247887467769524e-05,
1369
+ "loss": 1.2047,
1370
+ "step": 95500
1371
+ },
1372
+ {
1373
+ "epoch": 2.4507926782568736,
1374
+ "grad_norm": 0.09973154962062836,
1375
+ "learning_rate": 1.0196829286972506e-05,
1376
+ "loss": 1.1284,
1377
+ "step": 96000
1378
+ },
1379
+ {
1380
+ "epoch": 2.463557223456128,
1381
+ "grad_norm": 80.11822509765625,
1382
+ "learning_rate": 1.0145771106175488e-05,
1383
+ "loss": 1.2694,
1384
+ "step": 96500
1385
+ },
1386
+ {
1387
+ "epoch": 2.476321768655383,
1388
+ "grad_norm": 52.427276611328125,
1389
+ "learning_rate": 1.009471292537847e-05,
1390
+ "loss": 1.2676,
1391
+ "step": 97000
1392
+ },
1393
+ {
1394
+ "epoch": 2.4890863138546373,
1395
+ "grad_norm": 0.992283821105957,
1396
+ "learning_rate": 1.004365474458145e-05,
1397
+ "loss": 1.217,
1398
+ "step": 97500
1399
+ },
1400
+ {
1401
+ "epoch": 2.501850859053892,
1402
+ "grad_norm": 49.941741943359375,
1403
+ "learning_rate": 9.992596563784434e-06,
1404
+ "loss": 1.0647,
1405
+ "step": 98000
1406
+ },
1407
+ {
1408
+ "epoch": 2.5146154042531466,
1409
+ "grad_norm": 0.11822199821472168,
1410
+ "learning_rate": 9.941538382987414e-06,
1411
+ "loss": 1.1153,
1412
+ "step": 98500
1413
+ },
1414
+ {
1415
+ "epoch": 2.527379949452401,
1416
+ "grad_norm": 0.18741945922374725,
1417
+ "learning_rate": 9.890480202190396e-06,
1418
+ "loss": 1.1091,
1419
+ "step": 99000
1420
+ },
1421
+ {
1422
+ "epoch": 2.5401444946516554,
1423
+ "grad_norm": 74.856689453125,
1424
+ "learning_rate": 9.839422021393379e-06,
1425
+ "loss": 1.0919,
1426
+ "step": 99500
1427
+ },
1428
+ {
1429
+ "epoch": 2.5529090398509102,
1430
+ "grad_norm": 74.90555572509766,
1431
+ "learning_rate": 9.78836384059636e-06,
1432
+ "loss": 1.038,
1433
+ "step": 100000
1434
+ },
1435
+ {
1436
+ "epoch": 2.5656735850501646,
1437
+ "grad_norm": 53.3681755065918,
1438
+ "learning_rate": 9.737305659799343e-06,
1439
+ "loss": 1.1344,
1440
+ "step": 100500
1441
+ },
1442
+ {
1443
+ "epoch": 2.5784381302494195,
1444
+ "grad_norm": 0.4252275824546814,
1445
+ "learning_rate": 9.686247479002325e-06,
1446
+ "loss": 1.2369,
1447
+ "step": 101000
1448
+ },
1449
+ {
1450
+ "epoch": 2.591202675448674,
1451
+ "grad_norm": 0.11791633814573288,
1452
+ "learning_rate": 9.635189298205305e-06,
1453
+ "loss": 1.0627,
1454
+ "step": 101500
1455
+ },
1456
+ {
1457
+ "epoch": 2.6039672206479283,
1458
+ "grad_norm": 0.4675005376338959,
1459
+ "learning_rate": 9.584131117408287e-06,
1460
+ "loss": 1.1495,
1461
+ "step": 102000
1462
+ },
1463
+ {
1464
+ "epoch": 2.6167317658471827,
1465
+ "grad_norm": 0.5180454850196838,
1466
+ "learning_rate": 9.53307293661127e-06,
1467
+ "loss": 1.2084,
1468
+ "step": 102500
1469
+ },
1470
+ {
1471
+ "epoch": 2.6294963110464376,
1472
+ "grad_norm": 0.35868993401527405,
1473
+ "learning_rate": 9.482014755814251e-06,
1474
+ "loss": 1.009,
1475
+ "step": 103000
1476
+ },
1477
+ {
1478
+ "epoch": 2.642260856245692,
1479
+ "grad_norm": 75.4347152709961,
1480
+ "learning_rate": 9.430956575017233e-06,
1481
+ "loss": 1.205,
1482
+ "step": 103500
1483
+ },
1484
+ {
1485
+ "epoch": 2.6550254014449464,
1486
+ "grad_norm": 0.7229319214820862,
1487
+ "learning_rate": 9.379898394220216e-06,
1488
+ "loss": 1.2395,
1489
+ "step": 104000
1490
+ },
1491
+ {
1492
+ "epoch": 2.667789946644201,
1493
+ "grad_norm": 0.2904759347438812,
1494
+ "learning_rate": 9.328840213423198e-06,
1495
+ "loss": 1.2153,
1496
+ "step": 104500
1497
+ },
1498
+ {
1499
+ "epoch": 2.6805544918434556,
1500
+ "grad_norm": 52.7026252746582,
1501
+ "learning_rate": 9.277782032626178e-06,
1502
+ "loss": 1.1013,
1503
+ "step": 105000
1504
+ },
1505
+ {
1506
+ "epoch": 2.69331903704271,
1507
+ "grad_norm": 0.2737334370613098,
1508
+ "learning_rate": 9.22672385182916e-06,
1509
+ "loss": 1.2366,
1510
+ "step": 105500
1511
+ },
1512
+ {
1513
+ "epoch": 2.706083582241965,
1514
+ "grad_norm": 0.3069186210632324,
1515
+ "learning_rate": 9.175665671032142e-06,
1516
+ "loss": 1.043,
1517
+ "step": 106000
1518
+ },
1519
+ {
1520
+ "epoch": 2.7188481274412193,
1521
+ "grad_norm": 46.9107666015625,
1522
+ "learning_rate": 9.124607490235124e-06,
1523
+ "loss": 1.2249,
1524
+ "step": 106500
1525
+ },
1526
+ {
1527
+ "epoch": 2.7316126726404737,
1528
+ "grad_norm": 0.050258491188287735,
1529
+ "learning_rate": 9.073549309438106e-06,
1530
+ "loss": 1.1147,
1531
+ "step": 107000
1532
+ },
1533
+ {
1534
+ "epoch": 2.7443772178397285,
1535
+ "grad_norm": 72.0387191772461,
1536
+ "learning_rate": 9.022491128641088e-06,
1537
+ "loss": 1.0299,
1538
+ "step": 107500
1539
+ },
1540
+ {
1541
+ "epoch": 2.757141763038983,
1542
+ "grad_norm": 0.10051287710666656,
1543
+ "learning_rate": 8.971432947844069e-06,
1544
+ "loss": 1.2302,
1545
+ "step": 108000
1546
+ },
1547
+ {
1548
+ "epoch": 2.7699063082382374,
1549
+ "grad_norm": 0.5227202773094177,
1550
+ "learning_rate": 8.92037476704705e-06,
1551
+ "loss": 1.2635,
1552
+ "step": 108500
1553
+ },
1554
+ {
1555
+ "epoch": 2.7826708534374918,
1556
+ "grad_norm": 0.025500770658254623,
1557
+ "learning_rate": 8.869316586250033e-06,
1558
+ "loss": 1.0457,
1559
+ "step": 109000
1560
+ },
1561
+ {
1562
+ "epoch": 2.7954353986367466,
1563
+ "grad_norm": 51.052886962890625,
1564
+ "learning_rate": 8.818258405453013e-06,
1565
+ "loss": 1.1189,
1566
+ "step": 109500
1567
+ },
1568
+ {
1569
+ "epoch": 2.808199943836001,
1570
+ "grad_norm": 0.13520953059196472,
1571
+ "learning_rate": 8.767200224655997e-06,
1572
+ "loss": 1.1012,
1573
+ "step": 110000
1574
+ },
1575
+ {
1576
+ "epoch": 2.820964489035256,
1577
+ "grad_norm": 0.10818096995353699,
1578
+ "learning_rate": 8.716142043858979e-06,
1579
+ "loss": 1.1352,
1580
+ "step": 110500
1581
+ },
1582
+ {
1583
+ "epoch": 2.8337290342345103,
1584
+ "grad_norm": 0.6297906637191772,
1585
+ "learning_rate": 8.66508386306196e-06,
1586
+ "loss": 1.0876,
1587
+ "step": 111000
1588
+ },
1589
+ {
1590
+ "epoch": 2.8464935794337647,
1591
+ "grad_norm": 47.97404479980469,
1592
+ "learning_rate": 8.614025682264942e-06,
1593
+ "loss": 1.2544,
1594
+ "step": 111500
1595
+ },
1596
+ {
1597
+ "epoch": 2.859258124633019,
1598
+ "grad_norm": 0.1737406998872757,
1599
+ "learning_rate": 8.562967501467924e-06,
1600
+ "loss": 1.0541,
1601
+ "step": 112000
1602
+ },
1603
+ {
1604
+ "epoch": 2.872022669832274,
1605
+ "grad_norm": 65.94081115722656,
1606
+ "learning_rate": 8.511909320670904e-06,
1607
+ "loss": 1.2665,
1608
+ "step": 112500
1609
+ },
1610
+ {
1611
+ "epoch": 2.8847872150315284,
1612
+ "grad_norm": 1.080540418624878,
1613
+ "learning_rate": 8.460851139873886e-06,
1614
+ "loss": 1.146,
1615
+ "step": 113000
1616
+ },
1617
+ {
1618
+ "epoch": 2.897551760230783,
1619
+ "grad_norm": 76.0383529663086,
1620
+ "learning_rate": 8.409792959076868e-06,
1621
+ "loss": 1.0318,
1622
+ "step": 113500
1623
+ },
1624
+ {
1625
+ "epoch": 2.9103163054300376,
1626
+ "grad_norm": 0.15760071575641632,
1627
+ "learning_rate": 8.35873477827985e-06,
1628
+ "loss": 1.2326,
1629
+ "step": 114000
1630
+ },
1631
+ {
1632
+ "epoch": 2.923080850629292,
1633
+ "grad_norm": 0.206715926527977,
1634
+ "learning_rate": 8.307676597482832e-06,
1635
+ "loss": 1.2068,
1636
+ "step": 114500
1637
+ },
1638
+ {
1639
+ "epoch": 2.9358453958285464,
1640
+ "grad_norm": 54.03914260864258,
1641
+ "learning_rate": 8.256618416685814e-06,
1642
+ "loss": 1.1717,
1643
+ "step": 115000
1644
+ },
1645
+ {
1646
+ "epoch": 2.9486099410278013,
1647
+ "grad_norm": 0.04644392803311348,
1648
+ "learning_rate": 8.205560235888796e-06,
1649
+ "loss": 1.1994,
1650
+ "step": 115500
1651
+ },
1652
+ {
1653
+ "epoch": 2.9613744862270557,
1654
+ "grad_norm": 66.62918853759766,
1655
+ "learning_rate": 8.154502055091777e-06,
1656
+ "loss": 1.0152,
1657
+ "step": 116000
1658
+ },
1659
+ {
1660
+ "epoch": 2.9741390314263105,
1661
+ "grad_norm": 49.81622314453125,
1662
+ "learning_rate": 8.103443874294759e-06,
1663
+ "loss": 1.156,
1664
+ "step": 116500
1665
+ },
1666
+ {
1667
+ "epoch": 2.986903576625565,
1668
+ "grad_norm": 48.2811164855957,
1669
+ "learning_rate": 8.052385693497741e-06,
1670
+ "loss": 1.1536,
1671
+ "step": 117000
1672
+ },
1673
+ {
1674
+ "epoch": 2.9996681218248193,
1675
+ "grad_norm": 0.1103767678141594,
1676
+ "learning_rate": 8.001327512700723e-06,
1677
+ "loss": 0.9975,
1678
+ "step": 117500
1679
+ },
1680
+ {
1681
+ "epoch": 3.0,
1682
+ "eval_accuracy": 0.7554640333224131,
1683
+ "eval_f1": 0.7609898906728878,
1684
+ "eval_loss": 1.1722193956375122,
1685
+ "eval_precision": 0.7459420679759663,
1686
+ "eval_recall": 0.7766573295985061,
1687
+ "eval_runtime": 12077.2737,
1688
+ "eval_samples_per_second": 1.769,
1689
+ "eval_steps_per_second": 1.769,
1690
+ "step": 117513
1691
+ },
1692
+ {
1693
+ "epoch": 3.0124326670240738,
1694
+ "grad_norm": 1.014883279800415,
1695
+ "learning_rate": 7.950269331903705e-06,
1696
+ "loss": 1.1882,
1697
+ "step": 118000
1698
+ },
1699
+ {
1700
+ "epoch": 3.0251972122233286,
1701
+ "grad_norm": 0.3363625705242157,
1702
+ "learning_rate": 7.899211151106687e-06,
1703
+ "loss": 1.0064,
1704
+ "step": 118500
1705
+ },
1706
+ {
1707
+ "epoch": 3.037961757422583,
1708
+ "grad_norm": 0.27434128522872925,
1709
+ "learning_rate": 7.848152970309668e-06,
1710
+ "loss": 1.2177,
1711
+ "step": 119000
1712
+ },
1713
+ {
1714
+ "epoch": 3.0507263026218374,
1715
+ "grad_norm": 0.4122682511806488,
1716
+ "learning_rate": 7.79709478951265e-06,
1717
+ "loss": 1.1348,
1718
+ "step": 119500
1719
+ },
1720
+ {
1721
+ "epoch": 3.0634908478210923,
1722
+ "grad_norm": 46.59445571899414,
1723
+ "learning_rate": 7.746036608715632e-06,
1724
+ "loss": 1.1195,
1725
+ "step": 120000
1726
+ },
1727
+ {
1728
+ "epoch": 3.0762553930203467,
1729
+ "grad_norm": 64.21366882324219,
1730
+ "learning_rate": 7.694978427918614e-06,
1731
+ "loss": 1.0735,
1732
+ "step": 120500
1733
+ },
1734
+ {
1735
+ "epoch": 3.089019938219601,
1736
+ "grad_norm": 65.78421020507812,
1737
+ "learning_rate": 7.643920247121596e-06,
1738
+ "loss": 1.2066,
1739
+ "step": 121000
1740
+ },
1741
+ {
1742
+ "epoch": 3.101784483418856,
1743
+ "grad_norm": 0.03907040134072304,
1744
+ "learning_rate": 7.592862066324578e-06,
1745
+ "loss": 1.1624,
1746
+ "step": 121500
1747
+ },
1748
+ {
1749
+ "epoch": 3.1145490286181103,
1750
+ "grad_norm": 0.05698368698358536,
1751
+ "learning_rate": 7.541803885527559e-06,
1752
+ "loss": 1.0697,
1753
+ "step": 122000
1754
+ },
1755
+ {
1756
+ "epoch": 3.1273135738173647,
1757
+ "grad_norm": 0.18835334479808807,
1758
+ "learning_rate": 7.490745704730541e-06,
1759
+ "loss": 1.1554,
1760
+ "step": 122500
1761
+ },
1762
+ {
1763
+ "epoch": 3.1400781190166196,
1764
+ "grad_norm": 0.287007212638855,
1765
+ "learning_rate": 7.439687523933523e-06,
1766
+ "loss": 1.179,
1767
+ "step": 123000
1768
+ },
1769
+ {
1770
+ "epoch": 3.152842664215874,
1771
+ "grad_norm": 1.5292956829071045,
1772
+ "learning_rate": 7.3886293431365046e-06,
1773
+ "loss": 1.2256,
1774
+ "step": 123500
1775
+ },
1776
+ {
1777
+ "epoch": 3.1656072094151284,
1778
+ "grad_norm": 0.13379082083702087,
1779
+ "learning_rate": 7.337571162339487e-06,
1780
+ "loss": 1.0909,
1781
+ "step": 124000
1782
+ },
1783
+ {
1784
+ "epoch": 3.1783717546143833,
1785
+ "grad_norm": 0.03214769437909126,
1786
+ "learning_rate": 7.286512981542469e-06,
1787
+ "loss": 1.2496,
1788
+ "step": 124500
1789
+ },
1790
+ {
1791
+ "epoch": 3.1911362998136377,
1792
+ "grad_norm": 0.4265711307525635,
1793
+ "learning_rate": 7.235454800745449e-06,
1794
+ "loss": 1.0154,
1795
+ "step": 125000
1796
+ },
1797
+ {
1798
+ "epoch": 3.203900845012892,
1799
+ "grad_norm": 0.7355901598930359,
1800
+ "learning_rate": 7.184396619948432e-06,
1801
+ "loss": 1.0997,
1802
+ "step": 125500
1803
+ },
1804
+ {
1805
+ "epoch": 3.216665390212147,
1806
+ "grad_norm": 0.3517884910106659,
1807
+ "learning_rate": 7.133338439151414e-06,
1808
+ "loss": 1.2083,
1809
+ "step": 126000
1810
+ },
1811
+ {
1812
+ "epoch": 3.2294299354114013,
1813
+ "grad_norm": 1.6502386331558228,
1814
+ "learning_rate": 7.082280258354396e-06,
1815
+ "loss": 1.1834,
1816
+ "step": 126500
1817
+ },
1818
+ {
1819
+ "epoch": 3.2421944806106557,
1820
+ "grad_norm": 0.03524010255932808,
1821
+ "learning_rate": 7.031222077557377e-06,
1822
+ "loss": 1.0274,
1823
+ "step": 127000
1824
+ },
1825
+ {
1826
+ "epoch": 3.25495902580991,
1827
+ "grad_norm": 0.07861253619194031,
1828
+ "learning_rate": 6.9801638967603595e-06,
1829
+ "loss": 1.1885,
1830
+ "step": 127500
1831
+ },
1832
+ {
1833
+ "epoch": 3.267723571009165,
1834
+ "grad_norm": 0.4826868176460266,
1835
+ "learning_rate": 6.9291057159633415e-06,
1836
+ "loss": 1.0994,
1837
+ "step": 128000
1838
+ },
1839
+ {
1840
+ "epoch": 3.2804881162084194,
1841
+ "grad_norm": 1.0621423721313477,
1842
+ "learning_rate": 6.878047535166322e-06,
1843
+ "loss": 1.0537,
1844
+ "step": 128500
1845
+ },
1846
+ {
1847
+ "epoch": 3.2932526614076743,
1848
+ "grad_norm": 0.3429206609725952,
1849
+ "learning_rate": 6.826989354369305e-06,
1850
+ "loss": 1.0489,
1851
+ "step": 129000
1852
+ },
1853
+ {
1854
+ "epoch": 3.3060172066069287,
1855
+ "grad_norm": 0.12878142297267914,
1856
+ "learning_rate": 6.775931173572287e-06,
1857
+ "loss": 1.1243,
1858
+ "step": 129500
1859
+ },
1860
+ {
1861
+ "epoch": 3.318781751806183,
1862
+ "grad_norm": 0.5776382684707642,
1863
+ "learning_rate": 6.724872992775267e-06,
1864
+ "loss": 1.0283,
1865
+ "step": 130000
1866
+ },
1867
+ {
1868
+ "epoch": 3.3315462970054375,
1869
+ "grad_norm": 0.20261600613594055,
1870
+ "learning_rate": 6.673814811978249e-06,
1871
+ "loss": 1.1899,
1872
+ "step": 130500
1873
+ },
1874
+ {
1875
+ "epoch": 3.3443108422046923,
1876
+ "grad_norm": 114.00799560546875,
1877
+ "learning_rate": 6.622756631181232e-06,
1878
+ "loss": 1.1545,
1879
+ "step": 131000
1880
+ },
1881
+ {
1882
+ "epoch": 3.3570753874039467,
1883
+ "grad_norm": 0.15821242332458496,
1884
+ "learning_rate": 6.571698450384213e-06,
1885
+ "loss": 1.2892,
1886
+ "step": 131500
1887
+ },
1888
+ {
1889
+ "epoch": 3.3698399326032016,
1890
+ "grad_norm": 0.06549949198961258,
1891
+ "learning_rate": 6.520640269587195e-06,
1892
+ "loss": 1.1174,
1893
+ "step": 132000
1894
+ },
1895
+ {
1896
+ "epoch": 3.382604477802456,
1897
+ "grad_norm": 0.21926477551460266,
1898
+ "learning_rate": 6.469582088790178e-06,
1899
+ "loss": 1.0664,
1900
+ "step": 132500
1901
+ },
1902
+ {
1903
+ "epoch": 3.3953690230017104,
1904
+ "grad_norm": 78.91864776611328,
1905
+ "learning_rate": 6.418523907993158e-06,
1906
+ "loss": 1.0476,
1907
+ "step": 133000
1908
+ },
1909
+ {
1910
+ "epoch": 3.408133568200965,
1911
+ "grad_norm": 49.71781921386719,
1912
+ "learning_rate": 6.36746572719614e-06,
1913
+ "loss": 1.2337,
1914
+ "step": 133500
1915
+ },
1916
+ {
1917
+ "epoch": 3.4208981134002197,
1918
+ "grad_norm": 0.49726003408432007,
1919
+ "learning_rate": 6.316407546399122e-06,
1920
+ "loss": 1.1532,
1921
+ "step": 134000
1922
+ },
1923
+ {
1924
+ "epoch": 3.433662658599474,
1925
+ "grad_norm": 1.1757820844650269,
1926
+ "learning_rate": 6.265349365602103e-06,
1927
+ "loss": 1.1156,
1928
+ "step": 134500
1929
+ },
1930
+ {
1931
+ "epoch": 3.4464272037987285,
1932
+ "grad_norm": 0.13338498771190643,
1933
+ "learning_rate": 6.2142911848050855e-06,
1934
+ "loss": 1.1103,
1935
+ "step": 135000
1936
+ },
1937
+ {
1938
+ "epoch": 3.4591917489979833,
1939
+ "grad_norm": 46.79091262817383,
1940
+ "learning_rate": 6.1632330040080676e-06,
1941
+ "loss": 0.9749,
1942
+ "step": 135500
1943
+ },
1944
+ {
1945
+ "epoch": 3.4719562941972377,
1946
+ "grad_norm": 0.1096179410815239,
1947
+ "learning_rate": 6.112174823211049e-06,
1948
+ "loss": 1.1457,
1949
+ "step": 136000
1950
+ },
1951
+ {
1952
+ "epoch": 3.484720839396492,
1953
+ "grad_norm": 0.43366190791130066,
1954
+ "learning_rate": 6.061116642414031e-06,
1955
+ "loss": 1.3454,
1956
+ "step": 136500
1957
+ },
1958
+ {
1959
+ "epoch": 3.497485384595747,
1960
+ "grad_norm": 50.31692123413086,
1961
+ "learning_rate": 6.010058461617013e-06,
1962
+ "loss": 1.1355,
1963
+ "step": 137000
1964
+ },
1965
+ {
1966
+ "epoch": 3.5102499297950014,
1967
+ "grad_norm": 0.19994963705539703,
1968
+ "learning_rate": 5.959000280819995e-06,
1969
+ "loss": 1.0873,
1970
+ "step": 137500
1971
+ },
1972
+ {
1973
+ "epoch": 3.523014474994256,
1974
+ "grad_norm": 0.7200211882591248,
1975
+ "learning_rate": 5.907942100022976e-06,
1976
+ "loss": 1.2099,
1977
+ "step": 138000
1978
+ },
1979
+ {
1980
+ "epoch": 3.5357790201935106,
1981
+ "grad_norm": 0.03112562745809555,
1982
+ "learning_rate": 5.856883919225958e-06,
1983
+ "loss": 1.0315,
1984
+ "step": 138500
1985
+ },
1986
+ {
1987
+ "epoch": 3.548543565392765,
1988
+ "grad_norm": 64.0483169555664,
1989
+ "learning_rate": 5.80582573842894e-06,
1990
+ "loss": 1.2964,
1991
+ "step": 139000
1992
+ },
1993
+ {
1994
+ "epoch": 3.5613081105920195,
1995
+ "grad_norm": 0.5150154232978821,
1996
+ "learning_rate": 5.754767557631922e-06,
1997
+ "loss": 1.0543,
1998
+ "step": 139500
1999
+ },
2000
+ {
2001
+ "epoch": 3.5740726557912743,
2002
+ "grad_norm": 49.26338195800781,
2003
+ "learning_rate": 5.703709376834904e-06,
2004
+ "loss": 1.149,
2005
+ "step": 140000
2006
+ },
2007
+ {
2008
+ "epoch": 3.5868372009905287,
2009
+ "grad_norm": 0.2013530135154724,
2010
+ "learning_rate": 5.652651196037886e-06,
2011
+ "loss": 1.1641,
2012
+ "step": 140500
2013
+ },
2014
+ {
2015
+ "epoch": 3.599601746189783,
2016
+ "grad_norm": 98.23664855957031,
2017
+ "learning_rate": 5.601593015240867e-06,
2018
+ "loss": 0.9671,
2019
+ "step": 141000
2020
+ },
2021
+ {
2022
+ "epoch": 3.612366291389038,
2023
+ "grad_norm": 48.584083557128906,
2024
+ "learning_rate": 5.550534834443849e-06,
2025
+ "loss": 1.1613,
2026
+ "step": 141500
2027
+ },
2028
+ {
2029
+ "epoch": 3.6251308365882924,
2030
+ "grad_norm": 0.4875651001930237,
2031
+ "learning_rate": 5.499476653646831e-06,
2032
+ "loss": 1.1276,
2033
+ "step": 142000
2034
+ },
2035
+ {
2036
+ "epoch": 3.637895381787547,
2037
+ "grad_norm": 0.32345932722091675,
2038
+ "learning_rate": 5.448418472849812e-06,
2039
+ "loss": 1.3744,
2040
+ "step": 142500
2041
+ },
2042
+ {
2043
+ "epoch": 3.650659926986801,
2044
+ "grad_norm": 50.976417541503906,
2045
+ "learning_rate": 5.3973602920527944e-06,
2046
+ "loss": 1.1582,
2047
+ "step": 143000
2048
+ },
2049
+ {
2050
+ "epoch": 3.663424472186056,
2051
+ "grad_norm": 0.7011120319366455,
2052
+ "learning_rate": 5.3463021112557765e-06,
2053
+ "loss": 1.0346,
2054
+ "step": 143500
2055
+ },
2056
+ {
2057
+ "epoch": 3.6761890173853105,
2058
+ "grad_norm": 53.7322883605957,
2059
+ "learning_rate": 5.295243930458758e-06,
2060
+ "loss": 1.1549,
2061
+ "step": 144000
2062
+ },
2063
+ {
2064
+ "epoch": 3.6889535625845653,
2065
+ "grad_norm": 0.26070839166641235,
2066
+ "learning_rate": 5.24418574966174e-06,
2067
+ "loss": 1.2752,
2068
+ "step": 144500
2069
+ },
2070
+ {
2071
+ "epoch": 3.7017181077838197,
2072
+ "grad_norm": 0.09898780286312103,
2073
+ "learning_rate": 5.193127568864722e-06,
2074
+ "loss": 1.0996,
2075
+ "step": 145000
2076
+ },
2077
+ {
2078
+ "epoch": 3.714482652983074,
2079
+ "grad_norm": 0.1550414115190506,
2080
+ "learning_rate": 5.142069388067703e-06,
2081
+ "loss": 1.078,
2082
+ "step": 145500
2083
+ },
2084
+ {
2085
+ "epoch": 3.7272471981823285,
2086
+ "grad_norm": 0.08083771169185638,
2087
+ "learning_rate": 5.091011207270685e-06,
2088
+ "loss": 1.2,
2089
+ "step": 146000
2090
+ },
2091
+ {
2092
+ "epoch": 3.7400117433815834,
2093
+ "grad_norm": 0.07470794022083282,
2094
+ "learning_rate": 5.039953026473667e-06,
2095
+ "loss": 1.1761,
2096
+ "step": 146500
2097
+ },
2098
+ {
2099
+ "epoch": 3.752776288580838,
2100
+ "grad_norm": 0.07865650951862335,
2101
+ "learning_rate": 4.988894845676649e-06,
2102
+ "loss": 1.2051,
2103
+ "step": 147000
2104
+ },
2105
+ {
2106
+ "epoch": 3.7655408337800926,
2107
+ "grad_norm": 0.22244471311569214,
2108
+ "learning_rate": 4.9378366648796306e-06,
2109
+ "loss": 1.191,
2110
+ "step": 147500
2111
+ },
2112
+ {
2113
+ "epoch": 3.778305378979347,
2114
+ "grad_norm": 47.203636169433594,
2115
+ "learning_rate": 4.886778484082613e-06,
2116
+ "loss": 1.219,
2117
+ "step": 148000
2118
+ },
2119
+ {
2120
+ "epoch": 3.7910699241786014,
2121
+ "grad_norm": 62.65531921386719,
2122
+ "learning_rate": 4.835720303285594e-06,
2123
+ "loss": 1.0266,
2124
+ "step": 148500
2125
+ },
2126
+ {
2127
+ "epoch": 3.803834469377856,
2128
+ "grad_norm": 64.95884704589844,
2129
+ "learning_rate": 4.784662122488576e-06,
2130
+ "loss": 0.9793,
2131
+ "step": 149000
2132
+ },
2133
+ {
2134
+ "epoch": 3.8165990145771107,
2135
+ "grad_norm": 63.93239974975586,
2136
+ "learning_rate": 4.733603941691558e-06,
2137
+ "loss": 1.1372,
2138
+ "step": 149500
2139
+ },
2140
+ {
2141
+ "epoch": 3.829363559776365,
2142
+ "grad_norm": 0.08474382758140564,
2143
+ "learning_rate": 4.682545760894539e-06,
2144
+ "loss": 0.9784,
2145
+ "step": 150000
2146
+ },
2147
+ {
2148
+ "epoch": 3.84212810497562,
2149
+ "grad_norm": 0.26021113991737366,
2150
+ "learning_rate": 4.631487580097522e-06,
2151
+ "loss": 1.14,
2152
+ "step": 150500
2153
+ },
2154
+ {
2155
+ "epoch": 3.8548926501748744,
2156
+ "grad_norm": 1.316412091255188,
2157
+ "learning_rate": 4.580429399300503e-06,
2158
+ "loss": 1.0896,
2159
+ "step": 151000
2160
+ },
2161
+ {
2162
+ "epoch": 3.8676571953741288,
2163
+ "grad_norm": 0.2090272307395935,
2164
+ "learning_rate": 4.529371218503485e-06,
2165
+ "loss": 0.9288,
2166
+ "step": 151500
2167
+ },
2168
+ {
2169
+ "epoch": 3.880421740573383,
2170
+ "grad_norm": 68.51720428466797,
2171
+ "learning_rate": 4.478313037706467e-06,
2172
+ "loss": 1.1332,
2173
+ "step": 152000
2174
+ },
2175
+ {
2176
+ "epoch": 3.893186285772638,
2177
+ "grad_norm": 0.4788089692592621,
2178
+ "learning_rate": 4.427254856909449e-06,
2179
+ "loss": 1.0948,
2180
+ "step": 152500
2181
+ },
2182
+ {
2183
+ "epoch": 3.9059508309718924,
2184
+ "grad_norm": 0.04724010080099106,
2185
+ "learning_rate": 4.37619667611243e-06,
2186
+ "loss": 1.1331,
2187
+ "step": 153000
2188
+ },
2189
+ {
2190
+ "epoch": 3.9187153761711473,
2191
+ "grad_norm": 0.23654581606388092,
2192
+ "learning_rate": 4.325138495315412e-06,
2193
+ "loss": 1.0805,
2194
+ "step": 153500
2195
+ },
2196
+ {
2197
+ "epoch": 3.9314799213704017,
2198
+ "grad_norm": 0.2007986605167389,
2199
+ "learning_rate": 4.274080314518394e-06,
2200
+ "loss": 1.0289,
2201
+ "step": 154000
2202
+ },
2203
+ {
2204
+ "epoch": 3.944244466569656,
2205
+ "grad_norm": 0.5045840740203857,
2206
+ "learning_rate": 4.223022133721375e-06,
2207
+ "loss": 1.1887,
2208
+ "step": 154500
2209
+ },
2210
+ {
2211
+ "epoch": 3.9570090117689105,
2212
+ "grad_norm": 0.06596600264310837,
2213
+ "learning_rate": 4.1719639529243575e-06,
2214
+ "loss": 1.0421,
2215
+ "step": 155000
2216
+ },
2217
+ {
2218
+ "epoch": 3.9697735569681654,
2219
+ "grad_norm": 0.23973849415779114,
2220
+ "learning_rate": 4.1209057721273395e-06,
2221
+ "loss": 1.1135,
2222
+ "step": 155500
2223
+ },
2224
+ {
2225
+ "epoch": 3.9825381021674198,
2226
+ "grad_norm": 0.47211384773254395,
2227
+ "learning_rate": 4.069847591330322e-06,
2228
+ "loss": 1.019,
2229
+ "step": 156000
2230
+ },
2231
+ {
2232
+ "epoch": 3.995302647366674,
2233
+ "grad_norm": 0.4796395003795624,
2234
+ "learning_rate": 4.018789410533303e-06,
2235
+ "loss": 1.1599,
2236
+ "step": 156500
2237
+ },
2238
+ {
2239
+ "epoch": 4.0,
2240
+ "eval_accuracy": 0.7611269714981046,
2241
+ "eval_f1": 0.7746976251434625,
2242
+ "eval_loss": 1.1430933475494385,
2243
+ "eval_precision": 0.7346784996651038,
2244
+ "eval_recall": 0.819327731092437,
2245
+ "eval_runtime": 12078.5173,
2246
+ "eval_samples_per_second": 1.769,
2247
+ "eval_steps_per_second": 1.769,
2248
+ "step": 156684
2249
+ },
2250
+ {
2251
+ "epoch": 4.008067192565929,
2252
+ "grad_norm": 0.15939053893089294,
2253
+ "learning_rate": 3.967731229736285e-06,
2254
+ "loss": 1.0515,
2255
+ "step": 157000
2256
+ },
2257
+ {
2258
+ "epoch": 4.020831737765183,
2259
+ "grad_norm": 0.03273676335811615,
2260
+ "learning_rate": 3.916673048939267e-06,
2261
+ "loss": 1.2519,
2262
+ "step": 157500
2263
+ },
2264
+ {
2265
+ "epoch": 4.033596282964438,
2266
+ "grad_norm": 0.17249184846878052,
2267
+ "learning_rate": 3.865614868142248e-06,
2268
+ "loss": 1.0881,
2269
+ "step": 158000
2270
+ },
2271
+ {
2272
+ "epoch": 4.046360828163692,
2273
+ "grad_norm": 0.8233430981636047,
2274
+ "learning_rate": 3.81455668734523e-06,
2275
+ "loss": 1.2048,
2276
+ "step": 158500
2277
+ },
2278
+ {
2279
+ "epoch": 4.059125373362947,
2280
+ "grad_norm": 0.08850938826799393,
2281
+ "learning_rate": 3.763498506548212e-06,
2282
+ "loss": 1.0375,
2283
+ "step": 159000
2284
+ },
2285
+ {
2286
+ "epoch": 4.071889918562202,
2287
+ "grad_norm": 0.2934173047542572,
2288
+ "learning_rate": 3.7124403257511936e-06,
2289
+ "loss": 1.1478,
2290
+ "step": 159500
2291
+ },
2292
+ {
2293
+ "epoch": 4.084654463761456,
2294
+ "grad_norm": 0.1924028992652893,
2295
+ "learning_rate": 3.6613821449541752e-06,
2296
+ "loss": 1.1093,
2297
+ "step": 160000
2298
+ },
2299
+ {
2300
+ "epoch": 4.097419008960711,
2301
+ "grad_norm": 0.9462836980819702,
2302
+ "learning_rate": 3.6103239641571573e-06,
2303
+ "loss": 1.0995,
2304
+ "step": 160500
2305
+ },
2306
+ {
2307
+ "epoch": 4.110183554159965,
2308
+ "grad_norm": 0.1675688475370407,
2309
+ "learning_rate": 3.559265783360139e-06,
2310
+ "loss": 1.1485,
2311
+ "step": 161000
2312
+ },
2313
+ {
2314
+ "epoch": 4.12294809935922,
2315
+ "grad_norm": 0.14783819019794464,
2316
+ "learning_rate": 3.508207602563121e-06,
2317
+ "loss": 1.1616,
2318
+ "step": 161500
2319
+ },
2320
+ {
2321
+ "epoch": 4.135712644558474,
2322
+ "grad_norm": 0.051373809576034546,
2323
+ "learning_rate": 3.4571494217661027e-06,
2324
+ "loss": 1.1504,
2325
+ "step": 162000
2326
+ },
2327
+ {
2328
+ "epoch": 4.148477189757729,
2329
+ "grad_norm": 0.02504345215857029,
2330
+ "learning_rate": 3.4060912409690843e-06,
2331
+ "loss": 1.1793,
2332
+ "step": 162500
2333
+ },
2334
+ {
2335
+ "epoch": 4.161241734956984,
2336
+ "grad_norm": 0.22186382114887238,
2337
+ "learning_rate": 3.3550330601720664e-06,
2338
+ "loss": 0.9693,
2339
+ "step": 163000
2340
+ },
2341
+ {
2342
+ "epoch": 4.174006280156238,
2343
+ "grad_norm": 0.1899918168783188,
2344
+ "learning_rate": 3.303974879375048e-06,
2345
+ "loss": 0.9925,
2346
+ "step": 163500
2347
+ },
2348
+ {
2349
+ "epoch": 4.1867708253554925,
2350
+ "grad_norm": 0.013723157346248627,
2351
+ "learning_rate": 3.2529166985780297e-06,
2352
+ "loss": 1.0204,
2353
+ "step": 164000
2354
+ },
2355
+ {
2356
+ "epoch": 4.199535370554747,
2357
+ "grad_norm": 0.24368318915367126,
2358
+ "learning_rate": 3.2018585177810118e-06,
2359
+ "loss": 1.1907,
2360
+ "step": 164500
2361
+ },
2362
+ {
2363
+ "epoch": 4.212299915754001,
2364
+ "grad_norm": 1.1151741743087769,
2365
+ "learning_rate": 3.1508003369839934e-06,
2366
+ "loss": 1.1312,
2367
+ "step": 165000
2368
+ },
2369
+ {
2370
+ "epoch": 4.225064460953257,
2371
+ "grad_norm": 0.15602903068065643,
2372
+ "learning_rate": 3.099742156186975e-06,
2373
+ "loss": 1.1684,
2374
+ "step": 165500
2375
+ },
2376
+ {
2377
+ "epoch": 4.237829006152511,
2378
+ "grad_norm": 0.01620432920753956,
2379
+ "learning_rate": 3.048683975389957e-06,
2380
+ "loss": 1.0305,
2381
+ "step": 166000
2382
+ },
2383
+ {
2384
+ "epoch": 4.250593551351765,
2385
+ "grad_norm": 72.75970458984375,
2386
+ "learning_rate": 2.997625794592939e-06,
2387
+ "loss": 1.2227,
2388
+ "step": 166500
2389
+ },
2390
+ {
2391
+ "epoch": 4.26335809655102,
2392
+ "grad_norm": 0.04621783271431923,
2393
+ "learning_rate": 2.946567613795921e-06,
2394
+ "loss": 1.117,
2395
+ "step": 167000
2396
+ },
2397
+ {
2398
+ "epoch": 4.276122641750274,
2399
+ "grad_norm": 59.60150909423828,
2400
+ "learning_rate": 2.8955094329989025e-06,
2401
+ "loss": 1.0877,
2402
+ "step": 167500
2403
+ },
2404
+ {
2405
+ "epoch": 4.288887186949529,
2406
+ "grad_norm": 0.061805609613657,
2407
+ "learning_rate": 2.844451252201884e-06,
2408
+ "loss": 1.1038,
2409
+ "step": 168000
2410
+ },
2411
+ {
2412
+ "epoch": 4.301651732148784,
2413
+ "grad_norm": 0.0933728888630867,
2414
+ "learning_rate": 2.7933930714048663e-06,
2415
+ "loss": 1.0721,
2416
+ "step": 168500
2417
+ },
2418
+ {
2419
+ "epoch": 4.314416277348038,
2420
+ "grad_norm": 0.06835555285215378,
2421
+ "learning_rate": 2.742334890607848e-06,
2422
+ "loss": 1.1778,
2423
+ "step": 169000
2424
+ },
2425
+ {
2426
+ "epoch": 4.327180822547293,
2427
+ "grad_norm": 0.365980327129364,
2428
+ "learning_rate": 2.6912767098108296e-06,
2429
+ "loss": 1.0519,
2430
+ "step": 169500
2431
+ },
2432
+ {
2433
+ "epoch": 4.339945367746547,
2434
+ "grad_norm": 0.5795122385025024,
2435
+ "learning_rate": 2.6402185290138116e-06,
2436
+ "loss": 1.1297,
2437
+ "step": 170000
2438
+ },
2439
+ {
2440
+ "epoch": 4.352709912945802,
2441
+ "grad_norm": 0.5744270086288452,
2442
+ "learning_rate": 2.5891603482167933e-06,
2443
+ "loss": 0.9813,
2444
+ "step": 170500
2445
+ },
2446
+ {
2447
+ "epoch": 4.365474458145056,
2448
+ "grad_norm": 0.019895438104867935,
2449
+ "learning_rate": 2.538102167419775e-06,
2450
+ "loss": 1.1086,
2451
+ "step": 171000
2452
+ },
2453
+ {
2454
+ "epoch": 4.37823900334431,
2455
+ "grad_norm": 0.6566920876502991,
2456
+ "learning_rate": 2.487043986622757e-06,
2457
+ "loss": 0.9859,
2458
+ "step": 171500
2459
+ },
2460
+ {
2461
+ "epoch": 4.391003548543566,
2462
+ "grad_norm": 64.79024505615234,
2463
+ "learning_rate": 2.4359858058257387e-06,
2464
+ "loss": 1.232,
2465
+ "step": 172000
2466
+ },
2467
+ {
2468
+ "epoch": 4.40376809374282,
2469
+ "grad_norm": 0.1856858730316162,
2470
+ "learning_rate": 2.3849276250287203e-06,
2471
+ "loss": 1.1441,
2472
+ "step": 172500
2473
+ },
2474
+ {
2475
+ "epoch": 4.4165326389420745,
2476
+ "grad_norm": 21.11672592163086,
2477
+ "learning_rate": 2.3338694442317024e-06,
2478
+ "loss": 1.1133,
2479
+ "step": 173000
2480
+ },
2481
+ {
2482
+ "epoch": 4.429297184141329,
2483
+ "grad_norm": 0.28620752692222595,
2484
+ "learning_rate": 2.282811263434684e-06,
2485
+ "loss": 1.0573,
2486
+ "step": 173500
2487
+ },
2488
+ {
2489
+ "epoch": 4.442061729340583,
2490
+ "grad_norm": 0.01737070642411709,
2491
+ "learning_rate": 2.2317530826376657e-06,
2492
+ "loss": 1.164,
2493
+ "step": 174000
2494
+ },
2495
+ {
2496
+ "epoch": 4.454826274539839,
2497
+ "grad_norm": 0.14705878496170044,
2498
+ "learning_rate": 2.1806949018406478e-06,
2499
+ "loss": 1.0665,
2500
+ "step": 174500
2501
+ },
2502
+ {
2503
+ "epoch": 4.467590819739093,
2504
+ "grad_norm": 0.585959255695343,
2505
+ "learning_rate": 2.1296367210436294e-06,
2506
+ "loss": 1.2848,
2507
+ "step": 175000
2508
+ },
2509
+ {
2510
+ "epoch": 4.480355364938347,
2511
+ "grad_norm": 0.4240272343158722,
2512
+ "learning_rate": 2.0785785402466115e-06,
2513
+ "loss": 1.0977,
2514
+ "step": 175500
2515
+ },
2516
+ {
2517
+ "epoch": 4.493119910137602,
2518
+ "grad_norm": 0.03384213149547577,
2519
+ "learning_rate": 2.0275203594495927e-06,
2520
+ "loss": 0.9959,
2521
+ "step": 176000
2522
+ },
2523
+ {
2524
+ "epoch": 4.505884455336856,
2525
+ "grad_norm": 0.5382698178291321,
2526
+ "learning_rate": 1.976462178652575e-06,
2527
+ "loss": 1.1041,
2528
+ "step": 176500
2529
+ },
2530
+ {
2531
+ "epoch": 4.518649000536111,
2532
+ "grad_norm": 0.3288252651691437,
2533
+ "learning_rate": 1.9254039978555564e-06,
2534
+ "loss": 1.2747,
2535
+ "step": 177000
2536
+ },
2537
+ {
2538
+ "epoch": 4.531413545735365,
2539
+ "grad_norm": 62.414817810058594,
2540
+ "learning_rate": 1.8743458170585383e-06,
2541
+ "loss": 1.2577,
2542
+ "step": 177500
2543
+ },
2544
+ {
2545
+ "epoch": 4.54417809093462,
2546
+ "grad_norm": 0.1658298224210739,
2547
+ "learning_rate": 1.8232876362615202e-06,
2548
+ "loss": 1.0062,
2549
+ "step": 178000
2550
+ },
2551
+ {
2552
+ "epoch": 4.556942636133875,
2553
+ "grad_norm": 67.90374755859375,
2554
+ "learning_rate": 1.772229455464502e-06,
2555
+ "loss": 1.0975,
2556
+ "step": 178500
2557
+ },
2558
+ {
2559
+ "epoch": 4.569707181333129,
2560
+ "grad_norm": 79.30056762695312,
2561
+ "learning_rate": 1.721171274667484e-06,
2562
+ "loss": 1.0576,
2563
+ "step": 179000
2564
+ },
2565
+ {
2566
+ "epoch": 4.5824717265323835,
2567
+ "grad_norm": 0.550861656665802,
2568
+ "learning_rate": 1.6701130938704655e-06,
2569
+ "loss": 1.0933,
2570
+ "step": 179500
2571
+ },
2572
+ {
2573
+ "epoch": 4.595236271731638,
2574
+ "grad_norm": 0.1908508986234665,
2575
+ "learning_rate": 1.6190549130734474e-06,
2576
+ "loss": 1.102,
2577
+ "step": 180000
2578
+ },
2579
+ {
2580
+ "epoch": 4.608000816930893,
2581
+ "grad_norm": 0.0896555632352829,
2582
+ "learning_rate": 1.5679967322764293e-06,
2583
+ "loss": 1.0016,
2584
+ "step": 180500
2585
+ },
2586
+ {
2587
+ "epoch": 4.620765362130148,
2588
+ "grad_norm": 0.33798113465309143,
2589
+ "learning_rate": 1.5169385514794111e-06,
2590
+ "loss": 1.261,
2591
+ "step": 181000
2592
+ },
2593
+ {
2594
+ "epoch": 4.633529907329402,
2595
+ "grad_norm": 0.09542163461446762,
2596
+ "learning_rate": 1.4658803706823926e-06,
2597
+ "loss": 1.0797,
2598
+ "step": 181500
2599
+ },
2600
+ {
2601
+ "epoch": 4.6462944525286565,
2602
+ "grad_norm": 71.17037963867188,
2603
+ "learning_rate": 1.4148221898853744e-06,
2604
+ "loss": 1.2623,
2605
+ "step": 182000
2606
+ },
2607
+ {
2608
+ "epoch": 4.659058997727911,
2609
+ "grad_norm": 0.3921016454696655,
2610
+ "learning_rate": 1.3637640090883563e-06,
2611
+ "loss": 1.0148,
2612
+ "step": 182500
2613
+ },
2614
+ {
2615
+ "epoch": 4.671823542927165,
2616
+ "grad_norm": 0.2160830944776535,
2617
+ "learning_rate": 1.312705828291338e-06,
2618
+ "loss": 0.91,
2619
+ "step": 183000
2620
+ },
2621
+ {
2622
+ "epoch": 4.68458808812642,
2623
+ "grad_norm": 0.25559622049331665,
2624
+ "learning_rate": 1.2616476474943198e-06,
2625
+ "loss": 1.0844,
2626
+ "step": 183500
2627
+ },
2628
+ {
2629
+ "epoch": 4.697352633325675,
2630
+ "grad_norm": 69.85313415527344,
2631
+ "learning_rate": 1.2105894666973017e-06,
2632
+ "loss": 1.0526,
2633
+ "step": 184000
2634
+ },
2635
+ {
2636
+ "epoch": 4.710117178524929,
2637
+ "grad_norm": 0.36113739013671875,
2638
+ "learning_rate": 1.1595312859002835e-06,
2639
+ "loss": 1.2584,
2640
+ "step": 184500
2641
+ },
2642
+ {
2643
+ "epoch": 4.722881723724184,
2644
+ "grad_norm": 0.3725496232509613,
2645
+ "learning_rate": 1.1084731051032654e-06,
2646
+ "loss": 1.1403,
2647
+ "step": 185000
2648
+ },
2649
+ {
2650
+ "epoch": 4.735646268923438,
2651
+ "grad_norm": 0.14794978499412537,
2652
+ "learning_rate": 1.057414924306247e-06,
2653
+ "loss": 1.2615,
2654
+ "step": 185500
2655
+ },
2656
+ {
2657
+ "epoch": 4.748410814122693,
2658
+ "grad_norm": 0.3696430027484894,
2659
+ "learning_rate": 1.006356743509229e-06,
2660
+ "loss": 1.2038,
2661
+ "step": 186000
2662
+ },
2663
+ {
2664
+ "epoch": 4.761175359321947,
2665
+ "grad_norm": 0.056009288877248764,
2666
+ "learning_rate": 9.552985627122106e-07,
2667
+ "loss": 1.135,
2668
+ "step": 186500
2669
+ },
2670
+ {
2671
+ "epoch": 4.773939904521201,
2672
+ "grad_norm": 0.47045695781707764,
2673
+ "learning_rate": 9.042403819151923e-07,
2674
+ "loss": 1.1803,
2675
+ "step": 187000
2676
+ },
2677
+ {
2678
+ "epoch": 4.786704449720457,
2679
+ "grad_norm": 0.4348807632923126,
2680
+ "learning_rate": 8.531822011181743e-07,
2681
+ "loss": 1.1306,
2682
+ "step": 187500
2683
+ },
2684
+ {
2685
+ "epoch": 4.799468994919711,
2686
+ "grad_norm": 48.12034606933594,
2687
+ "learning_rate": 8.021240203211559e-07,
2688
+ "loss": 1.1238,
2689
+ "step": 188000
2690
+ },
2691
+ {
2692
+ "epoch": 4.8122335401189655,
2693
+ "grad_norm": 46.608116149902344,
2694
+ "learning_rate": 7.510658395241378e-07,
2695
+ "loss": 1.1175,
2696
+ "step": 188500
2697
+ },
2698
+ {
2699
+ "epoch": 4.82499808531822,
2700
+ "grad_norm": 0.0747414231300354,
2701
+ "learning_rate": 7.000076587271196e-07,
2702
+ "loss": 1.081,
2703
+ "step": 189000
2704
+ },
2705
+ {
2706
+ "epoch": 4.837762630517474,
2707
+ "grad_norm": 53.13431167602539,
2708
+ "learning_rate": 6.489494779301014e-07,
2709
+ "loss": 1.1178,
2710
+ "step": 189500
2711
+ },
2712
+ {
2713
+ "epoch": 4.85052717571673,
2714
+ "grad_norm": 0.6872290372848511,
2715
+ "learning_rate": 5.978912971330832e-07,
2716
+ "loss": 1.1445,
2717
+ "step": 190000
2718
+ },
2719
+ {
2720
+ "epoch": 4.863291720915984,
2721
+ "grad_norm": 0.8452647924423218,
2722
+ "learning_rate": 5.468331163360649e-07,
2723
+ "loss": 0.9908,
2724
+ "step": 190500
2725
+ },
2726
+ {
2727
+ "epoch": 4.8760562661152385,
2728
+ "grad_norm": 0.03034815937280655,
2729
+ "learning_rate": 4.957749355390468e-07,
2730
+ "loss": 1.2309,
2731
+ "step": 191000
2732
+ },
2733
+ {
2734
+ "epoch": 4.888820811314493,
2735
+ "grad_norm": 0.09639449417591095,
2736
+ "learning_rate": 4.4471675474202855e-07,
2737
+ "loss": 1.0792,
2738
+ "step": 191500
2739
+ },
2740
+ {
2741
+ "epoch": 4.901585356513747,
2742
+ "grad_norm": 0.7997586131095886,
2743
+ "learning_rate": 3.9365857394501036e-07,
2744
+ "loss": 1.2845,
2745
+ "step": 192000
2746
+ },
2747
+ {
2748
+ "epoch": 4.914349901713002,
2749
+ "grad_norm": 0.46624112129211426,
2750
+ "learning_rate": 3.426003931479922e-07,
2751
+ "loss": 1.1362,
2752
+ "step": 192500
2753
+ },
2754
+ {
2755
+ "epoch": 4.927114446912256,
2756
+ "grad_norm": 58.6268424987793,
2757
+ "learning_rate": 2.91542212350974e-07,
2758
+ "loss": 1.1973,
2759
+ "step": 193000
2760
+ },
2761
+ {
2762
+ "epoch": 4.939878992111511,
2763
+ "grad_norm": 0.353689968585968,
2764
+ "learning_rate": 2.4048403155395574e-07,
2765
+ "loss": 1.1512,
2766
+ "step": 193500
2767
+ },
2768
+ {
2769
+ "epoch": 4.952643537310766,
2770
+ "grad_norm": 49.337520599365234,
2771
+ "learning_rate": 1.8942585075693755e-07,
2772
+ "loss": 1.084,
2773
+ "step": 194000
2774
+ },
2775
+ {
2776
+ "epoch": 4.96540808251002,
2777
+ "grad_norm": 0.1724877804517746,
2778
+ "learning_rate": 1.3836766995991933e-07,
2779
+ "loss": 1.1512,
2780
+ "step": 194500
2781
+ },
2782
+ {
2783
+ "epoch": 4.978172627709275,
2784
+ "grad_norm": 58.19517517089844,
2785
+ "learning_rate": 8.730948916290113e-08,
2786
+ "loss": 1.1783,
2787
+ "step": 195000
2788
+ },
2789
+ {
2790
+ "epoch": 4.990937172908529,
2791
+ "grad_norm": 68.19010162353516,
2792
+ "learning_rate": 3.6251308365882926e-08,
2793
+ "loss": 1.0048,
2794
+ "step": 195500
2795
+ },
2796
+ {
2797
+ "epoch": 5.0,
2798
+ "eval_accuracy": 0.7621097954790097,
2799
+ "eval_f1": 0.7733737571893531,
2800
+ "eval_loss": 1.139561653137207,
2801
+ "eval_precision": 0.7400802116221521,
2802
+ "eval_recall": 0.8098039215686275,
2803
+ "eval_runtime": 12082.5339,
2804
+ "eval_samples_per_second": 1.768,
2805
+ "eval_steps_per_second": 1.768,
2806
+ "step": 195855
2807
+ }
2808
+ ],
2809
+ "logging_steps": 500,
2810
+ "max_steps": 195855,
2811
+ "num_input_tokens_seen": 0,
2812
+ "num_train_epochs": 5,
2813
+ "save_steps": 500,
2814
+ "stateful_callbacks": {
2815
+ "EarlyStoppingCallback": {
2816
+ "args": {
2817
+ "early_stopping_patience": 1,
2818
+ "early_stopping_threshold": 0.0
2819
+ },
2820
+ "attributes": {
2821
+ "early_stopping_patience_counter": 0
2822
+ }
2823
+ },
2824
+ "TrainerControl": {
2825
+ "args": {
2826
+ "should_epoch_stop": false,
2827
+ "should_evaluate": false,
2828
+ "should_log": false,
2829
+ "should_save": true,
2830
+ "should_training_stop": true
2831
+ },
2832
+ "attributes": {}
2833
+ }
2834
+ },
2835
+ "total_flos": 1.2827678297315328e+18,
2836
+ "train_batch_size": 1,
2837
+ "trial_name": null,
2838
+ "trial_params": null
2839
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e72c7befef451b40be23dc70780006a7e4f90fa001c29e9b081a03957cc8aa2
3
+ size 5176