Hugging Face's logo

gpol13
/
codet5_qlora

PEFT
Safetensors
Transformers
lora
Model card Files
xet
Community
gpol13 commited on
Commit
9eb7f59
·
verified ·
1 Parent(s): 21b6408

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +202 -0
  2. adapter_config.json +34 -0
  3. adapter_model.safetensors +3 -0
  4. checkpoint-11316/README.md +202 -0
  5. checkpoint-11316/adapter_config.json +34 -0
  6. checkpoint-11316/adapter_model.safetensors +3 -0
  7. checkpoint-11316/merges.txt +0 -0
  8. checkpoint-11316/optimizer.pt +3 -0
  9. checkpoint-11316/rng_state.pth +3 -0
  10. checkpoint-11316/scaler.pt +3 -0
  11. checkpoint-11316/scheduler.pt +3 -0
  12. checkpoint-11316/special_tokens_map.json +753 -0
  13. checkpoint-11316/tokenizer.json +0 -0
  14. checkpoint-11316/tokenizer_config.json +960 -0
  15. checkpoint-11316/trainer_state.json +1656 -0
  16. checkpoint-11316/training_args.bin +3 -0
  17. checkpoint-11316/vocab.json +0 -0
  18. checkpoint-14145/README.md +202 -0
  19. checkpoint-14145/adapter_config.json +34 -0
  20. checkpoint-14145/adapter_model.safetensors +3 -0
  21. checkpoint-14145/merges.txt +0 -0
  22. checkpoint-14145/optimizer.pt +3 -0
  23. checkpoint-14145/rng_state.pth +3 -0
  24. checkpoint-14145/scaler.pt +3 -0
  25. checkpoint-14145/scheduler.pt +3 -0
  26. checkpoint-14145/special_tokens_map.json +753 -0
  27. checkpoint-14145/tokenizer.json +0 -0
  28. checkpoint-14145/tokenizer_config.json +960 -0
  29. checkpoint-14145/trainer_state.json +2058 -0
  30. checkpoint-14145/training_args.bin +3 -0
  31. checkpoint-14145/vocab.json +0 -0
  32. checkpoint-2829/README.md +202 -0
  33. checkpoint-2829/adapter_config.json +34 -0
  34. checkpoint-2829/adapter_model.safetensors +3 -0
  35. checkpoint-2829/merges.txt +0 -0
  36. checkpoint-2829/optimizer.pt +3 -0
  37. checkpoint-2829/rng_state.pth +3 -0
  38. checkpoint-2829/scaler.pt +3 -0
  39. checkpoint-2829/scheduler.pt +3 -0
  40. checkpoint-2829/special_tokens_map.json +753 -0
  41. checkpoint-2829/tokenizer.json +0 -0
  42. checkpoint-2829/tokenizer_config.json +960 -0
  43. checkpoint-2829/trainer_state.json +436 -0
  44. checkpoint-2829/training_args.bin +3 -0
  45. checkpoint-2829/vocab.json +0 -0
  46. checkpoint-5658/README.md +202 -0
  47. checkpoint-5658/adapter_config.json +34 -0
  48. checkpoint-5658/adapter_model.safetensors +3 -0
  49. checkpoint-5658/merges.txt +0 -0
  50. checkpoint-5658/optimizer.pt +3 -0
README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Salesforce/codet5-base
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.15.2
adapter_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Salesforce/codet5-base",
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": true,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 16,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0.1,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "r": 8,
24
+ "rank_pattern": {},
25
+ "revision": null,
26
+ "target_modules": [
27
+ "q",
28
+ "v"
29
+ ],
30
+ "task_type": "SEQ_2_SEQ_LM",
31
+ "trainable_token_indices": null,
32
+ "use_dora": false,
33
+ "use_rslora": false
34
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc6a6711d2467cf8cc0d624e48bbe0ad9250fa2646d0816d7c83796afe2c35d7
3
+ size 3558888
checkpoint-11316/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Salesforce/codet5-base
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.15.2
checkpoint-11316/adapter_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Salesforce/codet5-base",
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": true,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 16,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0.1,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "r": 8,
24
+ "rank_pattern": {},
25
+ "revision": null,
26
+ "target_modules": [
27
+ "q",
28
+ "v"
29
+ ],
30
+ "task_type": "SEQ_2_SEQ_LM",
31
+ "trainable_token_indices": null,
32
+ "use_dora": false,
33
+ "use_rslora": false
34
+ }
checkpoint-11316/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7eedc575b3138f6634731e10774186ab709172e72613417d016727703c7539cf
3
+ size 3558888
checkpoint-11316/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-11316/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0a5ee9fcb50de2b7c4b07d45045870df1d196fa2b19a310d10e429a3aefc744
3
+ size 7198906
checkpoint-11316/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b73794b74f76ca77a43ac9cd2487118edd39fbe8a0339df5c0bc73853fa452c7
3
+ size 14244
checkpoint-11316/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8d070fb2b6c1c4efc181e808d5f894c0d77b3934538cc8c67a61a74dbcd9bf0
3
+ size 988
checkpoint-11316/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79fbb5db740a1726d8aed4860d098cb6bfea0cddb3e3e01d4c6f16794358786d
3
+ size 1064
checkpoint-11316/special_tokens_map.json ADDED
@@ -0,0 +1,753 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ {
4
+ "content": "<extra_id_99>",
5
+ "lstrip": true,
6
+ "normalized": true,
7
+ "rstrip": false,
8
+ "single_word": false
9
+ },
10
+ {
11
+ "content": "<extra_id_98>",
12
+ "lstrip": true,
13
+ "normalized": true,
14
+ "rstrip": false,
15
+ "single_word": false
16
+ },
17
+ {
18
+ "content": "<extra_id_97>",
19
+ "lstrip": true,
20
+ "normalized": true,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ {
25
+ "content": "<extra_id_96>",
26
+ "lstrip": true,
27
+ "normalized": true,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ },
31
+ {
32
+ "content": "<extra_id_95>",
33
+ "lstrip": true,
34
+ "normalized": true,
35
+ "rstrip": false,
36
+ "single_word": false
37
+ },
38
+ {
39
+ "content": "<extra_id_94>",
40
+ "lstrip": true,
41
+ "normalized": true,
42
+ "rstrip": false,
43
+ "single_word": false
44
+ },
45
+ {
46
+ "content": "<extra_id_93>",
47
+ "lstrip": true,
48
+ "normalized": true,
49
+ "rstrip": false,
50
+ "single_word": false
51
+ },
52
+ {
53
+ "content": "<extra_id_92>",
54
+ "lstrip": true,
55
+ "normalized": true,
56
+ "rstrip": false,
57
+ "single_word": false
58
+ },
59
+ {
60
+ "content": "<extra_id_91>",
61
+ "lstrip": true,
62
+ "normalized": true,
63
+ "rstrip": false,
64
+ "single_word": false
65
+ },
66
+ {
67
+ "content": "<extra_id_90>",
68
+ "lstrip": true,
69
+ "normalized": true,
70
+ "rstrip": false,
71
+ "single_word": false
72
+ },
73
+ {
74
+ "content": "<extra_id_89>",
75
+ "lstrip": true,
76
+ "normalized": true,
77
+ "rstrip": false,
78
+ "single_word": false
79
+ },
80
+ {
81
+ "content": "<extra_id_88>",
82
+ "lstrip": true,
83
+ "normalized": true,
84
+ "rstrip": false,
85
+ "single_word": false
86
+ },
87
+ {
88
+ "content": "<extra_id_87>",
89
+ "lstrip": true,
90
+ "normalized": true,
91
+ "rstrip": false,
92
+ "single_word": false
93
+ },
94
+ {
95
+ "content": "<extra_id_86>",
96
+ "lstrip": true,
97
+ "normalized": true,
98
+ "rstrip": false,
99
+ "single_word": false
100
+ },
101
+ {
102
+ "content": "<extra_id_85>",
103
+ "lstrip": true,
104
+ "normalized": true,
105
+ "rstrip": false,
106
+ "single_word": false
107
+ },
108
+ {
109
+ "content": "<extra_id_84>",
110
+ "lstrip": true,
111
+ "normalized": true,
112
+ "rstrip": false,
113
+ "single_word": false
114
+ },
115
+ {
116
+ "content": "<extra_id_83>",
117
+ "lstrip": true,
118
+ "normalized": true,
119
+ "rstrip": false,
120
+ "single_word": false
121
+ },
122
+ {
123
+ "content": "<extra_id_82>",
124
+ "lstrip": true,
125
+ "normalized": true,
126
+ "rstrip": false,
127
+ "single_word": false
128
+ },
129
+ {
130
+ "content": "<extra_id_81>",
131
+ "lstrip": true,
132
+ "normalized": true,
133
+ "rstrip": false,
134
+ "single_word": false
135
+ },
136
+ {
137
+ "content": "<extra_id_80>",
138
+ "lstrip": true,
139
+ "normalized": true,
140
+ "rstrip": false,
141
+ "single_word": false
142
+ },
143
+ {
144
+ "content": "<extra_id_79>",
145
+ "lstrip": true,
146
+ "normalized": true,
147
+ "rstrip": false,
148
+ "single_word": false
149
+ },
150
+ {
151
+ "content": "<extra_id_78>",
152
+ "lstrip": true,
153
+ "normalized": true,
154
+ "rstrip": false,
155
+ "single_word": false
156
+ },
157
+ {
158
+ "content": "<extra_id_77>",
159
+ "lstrip": true,
160
+ "normalized": true,
161
+ "rstrip": false,
162
+ "single_word": false
163
+ },
164
+ {
165
+ "content": "<extra_id_76>",
166
+ "lstrip": true,
167
+ "normalized": true,
168
+ "rstrip": false,
169
+ "single_word": false
170
+ },
171
+ {
172
+ "content": "<extra_id_75>",
173
+ "lstrip": true,
174
+ "normalized": true,
175
+ "rstrip": false,
176
+ "single_word": false
177
+ },
178
+ {
179
+ "content": "<extra_id_74>",
180
+ "lstrip": true,
181
+ "normalized": true,
182
+ "rstrip": false,
183
+ "single_word": false
184
+ },
185
+ {
186
+ "content": "<extra_id_73>",
187
+ "lstrip": true,
188
+ "normalized": true,
189
+ "rstrip": false,
190
+ "single_word": false
191
+ },
192
+ {
193
+ "content": "<extra_id_72>",
194
+ "lstrip": true,
195
+ "normalized": true,
196
+ "rstrip": false,
197
+ "single_word": false
198
+ },
199
+ {
200
+ "content": "<extra_id_71>",
201
+ "lstrip": true,
202
+ "normalized": true,
203
+ "rstrip": false,
204
+ "single_word": false
205
+ },
206
+ {
207
+ "content": "<extra_id_70>",
208
+ "lstrip": true,
209
+ "normalized": true,
210
+ "rstrip": false,
211
+ "single_word": false
212
+ },
213
+ {
214
+ "content": "<extra_id_69>",
215
+ "lstrip": true,
216
+ "normalized": true,
217
+ "rstrip": false,
218
+ "single_word": false
219
+ },
220
+ {
221
+ "content": "<extra_id_68>",
222
+ "lstrip": true,
223
+ "normalized": true,
224
+ "rstrip": false,
225
+ "single_word": false
226
+ },
227
+ {
228
+ "content": "<extra_id_67>",
229
+ "lstrip": true,
230
+ "normalized": true,
231
+ "rstrip": false,
232
+ "single_word": false
233
+ },
234
+ {
235
+ "content": "<extra_id_66>",
236
+ "lstrip": true,
237
+ "normalized": true,
238
+ "rstrip": false,
239
+ "single_word": false
240
+ },
241
+ {
242
+ "content": "<extra_id_65>",
243
+ "lstrip": true,
244
+ "normalized": true,
245
+ "rstrip": false,
246
+ "single_word": false
247
+ },
248
+ {
249
+ "content": "<extra_id_64>",
250
+ "lstrip": true,
251
+ "normalized": true,
252
+ "rstrip": false,
253
+ "single_word": false
254
+ },
255
+ {
256
+ "content": "<extra_id_63>",
257
+ "lstrip": true,
258
+ "normalized": true,
259
+ "rstrip": false,
260
+ "single_word": false
261
+ },
262
+ {
263
+ "content": "<extra_id_62>",
264
+ "lstrip": true,
265
+ "normalized": true,
266
+ "rstrip": false,
267
+ "single_word": false
268
+ },
269
+ {
270
+ "content": "<extra_id_61>",
271
+ "lstrip": true,
272
+ "normalized": true,
273
+ "rstrip": false,
274
+ "single_word": false
275
+ },
276
+ {
277
+ "content": "<extra_id_60>",
278
+ "lstrip": true,
279
+ "normalized": true,
280
+ "rstrip": false,
281
+ "single_word": false
282
+ },
283
+ {
284
+ "content": "<extra_id_59>",
285
+ "lstrip": true,
286
+ "normalized": true,
287
+ "rstrip": false,
288
+ "single_word": false
289
+ },
290
+ {
291
+ "content": "<extra_id_58>",
292
+ "lstrip": true,
293
+ "normalized": true,
294
+ "rstrip": false,
295
+ "single_word": false
296
+ },
297
+ {
298
+ "content": "<extra_id_57>",
299
+ "lstrip": true,
300
+ "normalized": true,
301
+ "rstrip": false,
302
+ "single_word": false
303
+ },
304
+ {
305
+ "content": "<extra_id_56>",
306
+ "lstrip": true,
307
+ "normalized": true,
308
+ "rstrip": false,
309
+ "single_word": false
310
+ },
311
+ {
312
+ "content": "<extra_id_55>",
313
+ "lstrip": true,
314
+ "normalized": true,
315
+ "rstrip": false,
316
+ "single_word": false
317
+ },
318
+ {
319
+ "content": "<extra_id_54>",
320
+ "lstrip": true,
321
+ "normalized": true,
322
+ "rstrip": false,
323
+ "single_word": false
324
+ },
325
+ {
326
+ "content": "<extra_id_53>",
327
+ "lstrip": true,
328
+ "normalized": true,
329
+ "rstrip": false,
330
+ "single_word": false
331
+ },
332
+ {
333
+ "content": "<extra_id_52>",
334
+ "lstrip": true,
335
+ "normalized": true,
336
+ "rstrip": false,
337
+ "single_word": false
338
+ },
339
+ {
340
+ "content": "<extra_id_51>",
341
+ "lstrip": true,
342
+ "normalized": true,
343
+ "rstrip": false,
344
+ "single_word": false
345
+ },
346
+ {
347
+ "content": "<extra_id_50>",
348
+ "lstrip": true,
349
+ "normalized": true,
350
+ "rstrip": false,
351
+ "single_word": false
352
+ },
353
+ {
354
+ "content": "<extra_id_49>",
355
+ "lstrip": true,
356
+ "normalized": true,
357
+ "rstrip": false,
358
+ "single_word": false
359
+ },
360
+ {
361
+ "content": "<extra_id_48>",
362
+ "lstrip": true,
363
+ "normalized": true,
364
+ "rstrip": false,
365
+ "single_word": false
366
+ },
367
+ {
368
+ "content": "<extra_id_47>",
369
+ "lstrip": true,
370
+ "normalized": true,
371
+ "rstrip": false,
372
+ "single_word": false
373
+ },
374
+ {
375
+ "content": "<extra_id_46>",
376
+ "lstrip": true,
377
+ "normalized": true,
378
+ "rstrip": false,
379
+ "single_word": false
380
+ },
381
+ {
382
+ "content": "<extra_id_45>",
383
+ "lstrip": true,
384
+ "normalized": true,
385
+ "rstrip": false,
386
+ "single_word": false
387
+ },
388
+ {
389
+ "content": "<extra_id_44>",
390
+ "lstrip": true,
391
+ "normalized": true,
392
+ "rstrip": false,
393
+ "single_word": false
394
+ },
395
+ {
396
+ "content": "<extra_id_43>",
397
+ "lstrip": true,
398
+ "normalized": true,
399
+ "rstrip": false,
400
+ "single_word": false
401
+ },
402
+ {
403
+ "content": "<extra_id_42>",
404
+ "lstrip": true,
405
+ "normalized": true,
406
+ "rstrip": false,
407
+ "single_word": false
408
+ },
409
+ {
410
+ "content": "<extra_id_41>",
411
+ "lstrip": true,
412
+ "normalized": true,
413
+ "rstrip": false,
414
+ "single_word": false
415
+ },
416
+ {
417
+ "content": "<extra_id_40>",
418
+ "lstrip": true,
419
+ "normalized": true,
420
+ "rstrip": false,
421
+ "single_word": false
422
+ },
423
+ {
424
+ "content": "<extra_id_39>",
425
+ "lstrip": true,
426
+ "normalized": true,
427
+ "rstrip": false,
428
+ "single_word": false
429
+ },
430
+ {
431
+ "content": "<extra_id_38>",
432
+ "lstrip": true,
433
+ "normalized": true,
434
+ "rstrip": false,
435
+ "single_word": false
436
+ },
437
+ {
438
+ "content": "<extra_id_37>",
439
+ "lstrip": true,
440
+ "normalized": true,
441
+ "rstrip": false,
442
+ "single_word": false
443
+ },
444
+ {
445
+ "content": "<extra_id_36>",
446
+ "lstrip": true,
447
+ "normalized": true,
448
+ "rstrip": false,
449
+ "single_word": false
450
+ },
451
+ {
452
+ "content": "<extra_id_35>",
453
+ "lstrip": true,
454
+ "normalized": true,
455
+ "rstrip": false,
456
+ "single_word": false
457
+ },
458
+ {
459
+ "content": "<extra_id_34>",
460
+ "lstrip": true,
461
+ "normalized": true,
462
+ "rstrip": false,
463
+ "single_word": false
464
+ },
465
+ {
466
+ "content": "<extra_id_33>",
467
+ "lstrip": true,
468
+ "normalized": true,
469
+ "rstrip": false,
470
+ "single_word": false
471
+ },
472
+ {
473
+ "content": "<extra_id_32>",
474
+ "lstrip": true,
475
+ "normalized": true,
476
+ "rstrip": false,
477
+ "single_word": false
478
+ },
479
+ {
480
+ "content": "<extra_id_31>",
481
+ "lstrip": true,
482
+ "normalized": true,
483
+ "rstrip": false,
484
+ "single_word": false
485
+ },
486
+ {
487
+ "content": "<extra_id_30>",
488
+ "lstrip": true,
489
+ "normalized": true,
490
+ "rstrip": false,
491
+ "single_word": false
492
+ },
493
+ {
494
+ "content": "<extra_id_29>",
495
+ "lstrip": true,
496
+ "normalized": true,
497
+ "rstrip": false,
498
+ "single_word": false
499
+ },
500
+ {
501
+ "content": "<extra_id_28>",
502
+ "lstrip": true,
503
+ "normalized": true,
504
+ "rstrip": false,
505
+ "single_word": false
506
+ },
507
+ {
508
+ "content": "<extra_id_27>",
509
+ "lstrip": true,
510
+ "normalized": true,
511
+ "rstrip": false,
512
+ "single_word": false
513
+ },
514
+ {
515
+ "content": "<extra_id_26>",
516
+ "lstrip": true,
517
+ "normalized": true,
518
+ "rstrip": false,
519
+ "single_word": false
520
+ },
521
+ {
522
+ "content": "<extra_id_25>",
523
+ "lstrip": true,
524
+ "normalized": true,
525
+ "rstrip": false,
526
+ "single_word": false
527
+ },
528
+ {
529
+ "content": "<extra_id_24>",
530
+ "lstrip": true,
531
+ "normalized": true,
532
+ "rstrip": false,
533
+ "single_word": false
534
+ },
535
+ {
536
+ "content": "<extra_id_23>",
537
+ "lstrip": true,
538
+ "normalized": true,
539
+ "rstrip": false,
540
+ "single_word": false
541
+ },
542
+ {
543
+ "content": "<extra_id_22>",
544
+ "lstrip": true,
545
+ "normalized": true,
546
+ "rstrip": false,
547
+ "single_word": false
548
+ },
549
+ {
550
+ "content": "<extra_id_21>",
551
+ "lstrip": true,
552
+ "normalized": true,
553
+ "rstrip": false,
554
+ "single_word": false
555
+ },
556
+ {
557
+ "content": "<extra_id_20>",
558
+ "lstrip": true,
559
+ "normalized": true,
560
+ "rstrip": false,
561
+ "single_word": false
562
+ },
563
+ {
564
+ "content": "<extra_id_19>",
565
+ "lstrip": true,
566
+ "normalized": true,
567
+ "rstrip": false,
568
+ "single_word": false
569
+ },
570
+ {
571
+ "content": "<extra_id_18>",
572
+ "lstrip": true,
573
+ "normalized": true,
574
+ "rstrip": false,
575
+ "single_word": false
576
+ },
577
+ {
578
+ "content": "<extra_id_17>",
579
+ "lstrip": true,
580
+ "normalized": true,
581
+ "rstrip": false,
582
+ "single_word": false
583
+ },
584
+ {
585
+ "content": "<extra_id_16>",
586
+ "lstrip": true,
587
+ "normalized": true,
588
+ "rstrip": false,
589
+ "single_word": false
590
+ },
591
+ {
592
+ "content": "<extra_id_15>",
593
+ "lstrip": true,
594
+ "normalized": true,
595
+ "rstrip": false,
596
+ "single_word": false
597
+ },
598
+ {
599
+ "content": "<extra_id_14>",
600
+ "lstrip": true,
601
+ "normalized": true,
602
+ "rstrip": false,
603
+ "single_word": false
604
+ },
605
+ {
606
+ "content": "<extra_id_13>",
607
+ "lstrip": true,
608
+ "normalized": true,
609
+ "rstrip": false,
610
+ "single_word": false
611
+ },
612
+ {
613
+ "content": "<extra_id_12>",
614
+ "lstrip": true,
615
+ "normalized": true,
616
+ "rstrip": false,
617
+ "single_word": false
618
+ },
619
+ {
620
+ "content": "<extra_id_11>",
621
+ "lstrip": true,
622
+ "normalized": true,
623
+ "rstrip": false,
624
+ "single_word": false
625
+ },
626
+ {
627
+ "content": "<extra_id_10>",
628
+ "lstrip": true,
629
+ "normalized": true,
630
+ "rstrip": false,
631
+ "single_word": false
632
+ },
633
+ {
634
+ "content": "<extra_id_9>",
635
+ "lstrip": true,
636
+ "normalized": true,
637
+ "rstrip": false,
638
+ "single_word": false
639
+ },
640
+ {
641
+ "content": "<extra_id_8>",
642
+ "lstrip": true,
643
+ "normalized": true,
644
+ "rstrip": false,
645
+ "single_word": false
646
+ },
647
+ {
648
+ "content": "<extra_id_7>",
649
+ "lstrip": true,
650
+ "normalized": true,
651
+ "rstrip": false,
652
+ "single_word": false
653
+ },
654
+ {
655
+ "content": "<extra_id_6>",
656
+ "lstrip": true,
657
+ "normalized": true,
658
+ "rstrip": false,
659
+ "single_word": false
660
+ },
661
+ {
662
+ "content": "<extra_id_5>",
663
+ "lstrip": true,
664
+ "normalized": true,
665
+ "rstrip": false,
666
+ "single_word": false
667
+ },
668
+ {
669
+ "content": "<extra_id_4>",
670
+ "lstrip": true,
671
+ "normalized": true,
672
+ "rstrip": false,
673
+ "single_word": false
674
+ },
675
+ {
676
+ "content": "<extra_id_3>",
677
+ "lstrip": true,
678
+ "normalized": true,
679
+ "rstrip": false,
680
+ "single_word": false
681
+ },
682
+ {
683
+ "content": "<extra_id_2>",
684
+ "lstrip": true,
685
+ "normalized": true,
686
+ "rstrip": false,
687
+ "single_word": false
688
+ },
689
+ {
690
+ "content": "<extra_id_1>",
691
+ "lstrip": true,
692
+ "normalized": true,
693
+ "rstrip": false,
694
+ "single_word": false
695
+ },
696
+ {
697
+ "content": "<extra_id_0>",
698
+ "lstrip": true,
699
+ "normalized": true,
700
+ "rstrip": false,
701
+ "single_word": false
702
+ }
703
+ ],
704
+ "bos_token": {
705
+ "content": "<s>",
706
+ "lstrip": false,
707
+ "normalized": true,
708
+ "rstrip": false,
709
+ "single_word": false
710
+ },
711
+ "cls_token": {
712
+ "content": "<s>",
713
+ "lstrip": false,
714
+ "normalized": true,
715
+ "rstrip": false,
716
+ "single_word": false
717
+ },
718
+ "eos_token": {
719
+ "content": "</s>",
720
+ "lstrip": false,
721
+ "normalized": true,
722
+ "rstrip": false,
723
+ "single_word": false
724
+ },
725
+ "mask_token": {
726
+ "content": "<mask>",
727
+ "lstrip": true,
728
+ "normalized": true,
729
+ "rstrip": false,
730
+ "single_word": false
731
+ },
732
+ "pad_token": {
733
+ "content": "<pad>",
734
+ "lstrip": false,
735
+ "normalized": true,
736
+ "rstrip": false,
737
+ "single_word": false
738
+ },
739
+ "sep_token": {
740
+ "content": "</s>",
741
+ "lstrip": false,
742
+ "normalized": true,
743
+ "rstrip": false,
744
+ "single_word": false
745
+ },
746
+ "unk_token": {
747
+ "content": "<unk>",
748
+ "lstrip": false,
749
+ "normalized": true,
750
+ "rstrip": false,
751
+ "single_word": false
752
+ }
753
+ }
checkpoint-11316/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-11316/tokenizer_config.json ADDED
@@ -0,0 +1,960 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<pad>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "<s>",
14
+ "lstrip": false,
15
+ "normalized": true,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "</s>",
22
+ "lstrip": false,
23
+ "normalized": true,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "3": {
29
+ "content": "<unk>",
30
+ "lstrip": false,
31
+ "normalized": true,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "4": {
37
+ "content": "<mask>",
38
+ "lstrip": true,
39
+ "normalized": true,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "32000": {
45
+ "content": "<extra_id_99>",
46
+ "lstrip": true,
47
+ "normalized": true,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "32001": {
53
+ "content": "<extra_id_98>",
54
+ "lstrip": true,
55
+ "normalized": true,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "32002": {
61
+ "content": "<extra_id_97>",
62
+ "lstrip": true,
63
+ "normalized": true,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "32003": {
69
+ "content": "<extra_id_96>",
70
+ "lstrip": true,
71
+ "normalized": true,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "32004": {
77
+ "content": "<extra_id_95>",
78
+ "lstrip": true,
79
+ "normalized": true,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "32005": {
85
+ "content": "<extra_id_94>",
86
+ "lstrip": true,
87
+ "normalized": true,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "32006": {
93
+ "content": "<extra_id_93>",
94
+ "lstrip": true,
95
+ "normalized": true,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "32007": {
101
+ "content": "<extra_id_92>",
102
+ "lstrip": true,
103
+ "normalized": true,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "32008": {
109
+ "content": "<extra_id_91>",
110
+ "lstrip": true,
111
+ "normalized": true,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "32009": {
117
+ "content": "<extra_id_90>",
118
+ "lstrip": true,
119
+ "normalized": true,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "32010": {
125
+ "content": "<extra_id_89>",
126
+ "lstrip": true,
127
+ "normalized": true,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "32011": {
133
+ "content": "<extra_id_88>",
134
+ "lstrip": true,
135
+ "normalized": true,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ },
140
+ "32012": {
141
+ "content": "<extra_id_87>",
142
+ "lstrip": true,
143
+ "normalized": true,
144
+ "rstrip": false,
145
+ "single_word": false,
146
+ "special": true
147
+ },
148
+ "32013": {
149
+ "content": "<extra_id_86>",
150
+ "lstrip": true,
151
+ "normalized": true,
152
+ "rstrip": false,
153
+ "single_word": false,
154
+ "special": true
155
+ },
156
+ "32014": {
157
+ "content": "<extra_id_85>",
158
+ "lstrip": true,
159
+ "normalized": true,
160
+ "rstrip": false,
161
+ "single_word": false,
162
+ "special": true
163
+ },
164
+ "32015": {
165
+ "content": "<extra_id_84>",
166
+ "lstrip": true,
167
+ "normalized": true,
168
+ "rstrip": false,
169
+ "single_word": false,
170
+ "special": true
171
+ },
172
+ "32016": {
173
+ "content": "<extra_id_83>",
174
+ "lstrip": true,
175
+ "normalized": true,
176
+ "rstrip": false,
177
+ "single_word": false,
178
+ "special": true
179
+ },
180
+ "32017": {
181
+ "content": "<extra_id_82>",
182
+ "lstrip": true,
183
+ "normalized": true,
184
+ "rstrip": false,
185
+ "single_word": false,
186
+ "special": true
187
+ },
188
+ "32018": {
189
+ "content": "<extra_id_81>",
190
+ "lstrip": true,
191
+ "normalized": true,
192
+ "rstrip": false,
193
+ "single_word": false,
194
+ "special": true
195
+ },
196
+ "32019": {
197
+ "content": "<extra_id_80>",
198
+ "lstrip": true,
199
+ "normalized": true,
200
+ "rstrip": false,
201
+ "single_word": false,
202
+ "special": true
203
+ },
204
+ "32020": {
205
+ "content": "<extra_id_79>",
206
+ "lstrip": true,
207
+ "normalized": true,
208
+ "rstrip": false,
209
+ "single_word": false,
210
+ "special": true
211
+ },
212
+ "32021": {
213
+ "content": "<extra_id_78>",
214
+ "lstrip": true,
215
+ "normalized": true,
216
+ "rstrip": false,
217
+ "single_word": false,
218
+ "special": true
219
+ },
220
+ "32022": {
221
+ "content": "<extra_id_77>",
222
+ "lstrip": true,
223
+ "normalized": true,
224
+ "rstrip": false,
225
+ "single_word": false,
226
+ "special": true
227
+ },
228
+ "32023": {
229
+ "content": "<extra_id_76>",
230
+ "lstrip": true,
231
+ "normalized": true,
232
+ "rstrip": false,
233
+ "single_word": false,
234
+ "special": true
235
+ },
236
+ "32024": {
237
+ "content": "<extra_id_75>",
238
+ "lstrip": true,
239
+ "normalized": true,
240
+ "rstrip": false,
241
+ "single_word": false,
242
+ "special": true
243
+ },
244
+ "32025": {
245
+ "content": "<extra_id_74>",
246
+ "lstrip": true,
247
+ "normalized": true,
248
+ "rstrip": false,
249
+ "single_word": false,
250
+ "special": true
251
+ },
252
+ "32026": {
253
+ "content": "<extra_id_73>",
254
+ "lstrip": true,
255
+ "normalized": true,
256
+ "rstrip": false,
257
+ "single_word": false,
258
+ "special": true
259
+ },
260
+ "32027": {
261
+ "content": "<extra_id_72>",
262
+ "lstrip": true,
263
+ "normalized": true,
264
+ "rstrip": false,
265
+ "single_word": false,
266
+ "special": true
267
+ },
268
+ "32028": {
269
+ "content": "<extra_id_71>",
270
+ "lstrip": true,
271
+ "normalized": true,
272
+ "rstrip": false,
273
+ "single_word": false,
274
+ "special": true
275
+ },
276
+ "32029": {
277
+ "content": "<extra_id_70>",
278
+ "lstrip": true,
279
+ "normalized": true,
280
+ "rstrip": false,
281
+ "single_word": false,
282
+ "special": true
283
+ },
284
+ "32030": {
285
+ "content": "<extra_id_69>",
286
+ "lstrip": true,
287
+ "normalized": true,
288
+ "rstrip": false,
289
+ "single_word": false,
290
+ "special": true
291
+ },
292
+ "32031": {
293
+ "content": "<extra_id_68>",
294
+ "lstrip": true,
295
+ "normalized": true,
296
+ "rstrip": false,
297
+ "single_word": false,
298
+ "special": true
299
+ },
300
+ "32032": {
301
+ "content": "<extra_id_67>",
302
+ "lstrip": true,
303
+ "normalized": true,
304
+ "rstrip": false,
305
+ "single_word": false,
306
+ "special": true
307
+ },
308
+ "32033": {
309
+ "content": "<extra_id_66>",
310
+ "lstrip": true,
311
+ "normalized": true,
312
+ "rstrip": false,
313
+ "single_word": false,
314
+ "special": true
315
+ },
316
+ "32034": {
317
+ "content": "<extra_id_65>",
318
+ "lstrip": true,
319
+ "normalized": true,
320
+ "rstrip": false,
321
+ "single_word": false,
322
+ "special": true
323
+ },
324
+ "32035": {
325
+ "content": "<extra_id_64>",
326
+ "lstrip": true,
327
+ "normalized": true,
328
+ "rstrip": false,
329
+ "single_word": false,
330
+ "special": true
331
+ },
332
+ "32036": {
333
+ "content": "<extra_id_63>",
334
+ "lstrip": true,
335
+ "normalized": true,
336
+ "rstrip": false,
337
+ "single_word": false,
338
+ "special": true
339
+ },
340
+ "32037": {
341
+ "content": "<extra_id_62>",
342
+ "lstrip": true,
343
+ "normalized": true,
344
+ "rstrip": false,
345
+ "single_word": false,
346
+ "special": true
347
+ },
348
+ "32038": {
349
+ "content": "<extra_id_61>",
350
+ "lstrip": true,
351
+ "normalized": true,
352
+ "rstrip": false,
353
+ "single_word": false,
354
+ "special": true
355
+ },
356
+ "32039": {
357
+ "content": "<extra_id_60>",
358
+ "lstrip": true,
359
+ "normalized": true,
360
+ "rstrip": false,
361
+ "single_word": false,
362
+ "special": true
363
+ },
364
+ "32040": {
365
+ "content": "<extra_id_59>",
366
+ "lstrip": true,
367
+ "normalized": true,
368
+ "rstrip": false,
369
+ "single_word": false,
370
+ "special": true
371
+ },
372
+ "32041": {
373
+ "content": "<extra_id_58>",
374
+ "lstrip": true,
375
+ "normalized": true,
376
+ "rstrip": false,
377
+ "single_word": false,
378
+ "special": true
379
+ },
380
+ "32042": {
381
+ "content": "<extra_id_57>",
382
+ "lstrip": true,
383
+ "normalized": true,
384
+ "rstrip": false,
385
+ "single_word": false,
386
+ "special": true
387
+ },
388
+ "32043": {
389
+ "content": "<extra_id_56>",
390
+ "lstrip": true,
391
+ "normalized": true,
392
+ "rstrip": false,
393
+ "single_word": false,
394
+ "special": true
395
+ },
396
+ "32044": {
397
+ "content": "<extra_id_55>",
398
+ "lstrip": true,
399
+ "normalized": true,
400
+ "rstrip": false,
401
+ "single_word": false,
402
+ "special": true
403
+ },
404
+ "32045": {
405
+ "content": "<extra_id_54>",
406
+ "lstrip": true,
407
+ "normalized": true,
408
+ "rstrip": false,
409
+ "single_word": false,
410
+ "special": true
411
+ },
412
+ "32046": {
413
+ "content": "<extra_id_53>",
414
+ "lstrip": true,
415
+ "normalized": true,
416
+ "rstrip": false,
417
+ "single_word": false,
418
+ "special": true
419
+ },
420
+ "32047": {
421
+ "content": "<extra_id_52>",
422
+ "lstrip": true,
423
+ "normalized": true,
424
+ "rstrip": false,
425
+ "single_word": false,
426
+ "special": true
427
+ },
428
+ "32048": {
429
+ "content": "<extra_id_51>",
430
+ "lstrip": true,
431
+ "normalized": true,
432
+ "rstrip": false,
433
+ "single_word": false,
434
+ "special": true
435
+ },
436
+ "32049": {
437
+ "content": "<extra_id_50>",
438
+ "lstrip": true,
439
+ "normalized": true,
440
+ "rstrip": false,
441
+ "single_word": false,
442
+ "special": true
443
+ },
444
+ "32050": {
445
+ "content": "<extra_id_49>",
446
+ "lstrip": true,
447
+ "normalized": true,
448
+ "rstrip": false,
449
+ "single_word": false,
450
+ "special": true
451
+ },
452
+ "32051": {
453
+ "content": "<extra_id_48>",
454
+ "lstrip": true,
455
+ "normalized": true,
456
+ "rstrip": false,
457
+ "single_word": false,
458
+ "special": true
459
+ },
460
+ "32052": {
461
+ "content": "<extra_id_47>",
462
+ "lstrip": true,
463
+ "normalized": true,
464
+ "rstrip": false,
465
+ "single_word": false,
466
+ "special": true
467
+ },
468
+ "32053": {
469
+ "content": "<extra_id_46>",
470
+ "lstrip": true,
471
+ "normalized": true,
472
+ "rstrip": false,
473
+ "single_word": false,
474
+ "special": true
475
+ },
476
+ "32054": {
477
+ "content": "<extra_id_45>",
478
+ "lstrip": true,
479
+ "normalized": true,
480
+ "rstrip": false,
481
+ "single_word": false,
482
+ "special": true
483
+ },
484
+ "32055": {
485
+ "content": "<extra_id_44>",
486
+ "lstrip": true,
487
+ "normalized": true,
488
+ "rstrip": false,
489
+ "single_word": false,
490
+ "special": true
491
+ },
492
+ "32056": {
493
+ "content": "<extra_id_43>",
494
+ "lstrip": true,
495
+ "normalized": true,
496
+ "rstrip": false,
497
+ "single_word": false,
498
+ "special": true
499
+ },
500
+ "32057": {
501
+ "content": "<extra_id_42>",
502
+ "lstrip": true,
503
+ "normalized": true,
504
+ "rstrip": false,
505
+ "single_word": false,
506
+ "special": true
507
+ },
508
+ "32058": {
509
+ "content": "<extra_id_41>",
510
+ "lstrip": true,
511
+ "normalized": true,
512
+ "rstrip": false,
513
+ "single_word": false,
514
+ "special": true
515
+ },
516
+ "32059": {
517
+ "content": "<extra_id_40>",
518
+ "lstrip": true,
519
+ "normalized": true,
520
+ "rstrip": false,
521
+ "single_word": false,
522
+ "special": true
523
+ },
524
+ "32060": {
525
+ "content": "<extra_id_39>",
526
+ "lstrip": true,
527
+ "normalized": true,
528
+ "rstrip": false,
529
+ "single_word": false,
530
+ "special": true
531
+ },
532
+ "32061": {
533
+ "content": "<extra_id_38>",
534
+ "lstrip": true,
535
+ "normalized": true,
536
+ "rstrip": false,
537
+ "single_word": false,
538
+ "special": true
539
+ },
540
+ "32062": {
541
+ "content": "<extra_id_37>",
542
+ "lstrip": true,
543
+ "normalized": true,
544
+ "rstrip": false,
545
+ "single_word": false,
546
+ "special": true
547
+ },
548
+ "32063": {
549
+ "content": "<extra_id_36>",
550
+ "lstrip": true,
551
+ "normalized": true,
552
+ "rstrip": false,
553
+ "single_word": false,
554
+ "special": true
555
+ },
556
+ "32064": {
557
+ "content": "<extra_id_35>",
558
+ "lstrip": true,
559
+ "normalized": true,
560
+ "rstrip": false,
561
+ "single_word": false,
562
+ "special": true
563
+ },
564
+ "32065": {
565
+ "content": "<extra_id_34>",
566
+ "lstrip": true,
567
+ "normalized": true,
568
+ "rstrip": false,
569
+ "single_word": false,
570
+ "special": true
571
+ },
572
+ "32066": {
573
+ "content": "<extra_id_33>",
574
+ "lstrip": true,
575
+ "normalized": true,
576
+ "rstrip": false,
577
+ "single_word": false,
578
+ "special": true
579
+ },
580
+ "32067": {
581
+ "content": "<extra_id_32>",
582
+ "lstrip": true,
583
+ "normalized": true,
584
+ "rstrip": false,
585
+ "single_word": false,
586
+ "special": true
587
+ },
588
+ "32068": {
589
+ "content": "<extra_id_31>",
590
+ "lstrip": true,
591
+ "normalized": true,
592
+ "rstrip": false,
593
+ "single_word": false,
594
+ "special": true
595
+ },
596
+ "32069": {
597
+ "content": "<extra_id_30>",
598
+ "lstrip": true,
599
+ "normalized": true,
600
+ "rstrip": false,
601
+ "single_word": false,
602
+ "special": true
603
+ },
604
+ "32070": {
605
+ "content": "<extra_id_29>",
606
+ "lstrip": true,
607
+ "normalized": true,
608
+ "rstrip": false,
609
+ "single_word": false,
610
+ "special": true
611
+ },
612
+ "32071": {
613
+ "content": "<extra_id_28>",
614
+ "lstrip": true,
615
+ "normalized": true,
616
+ "rstrip": false,
617
+ "single_word": false,
618
+ "special": true
619
+ },
620
+ "32072": {
621
+ "content": "<extra_id_27>",
622
+ "lstrip": true,
623
+ "normalized": true,
624
+ "rstrip": false,
625
+ "single_word": false,
626
+ "special": true
627
+ },
628
+ "32073": {
629
+ "content": "<extra_id_26>",
630
+ "lstrip": true,
631
+ "normalized": true,
632
+ "rstrip": false,
633
+ "single_word": false,
634
+ "special": true
635
+ },
636
+ "32074": {
637
+ "content": "<extra_id_25>",
638
+ "lstrip": true,
639
+ "normalized": true,
640
+ "rstrip": false,
641
+ "single_word": false,
642
+ "special": true
643
+ },
644
+ "32075": {
645
+ "content": "<extra_id_24>",
646
+ "lstrip": true,
647
+ "normalized": true,
648
+ "rstrip": false,
649
+ "single_word": false,
650
+ "special": true
651
+ },
652
+ "32076": {
653
+ "content": "<extra_id_23>",
654
+ "lstrip": true,
655
+ "normalized": true,
656
+ "rstrip": false,
657
+ "single_word": false,
658
+ "special": true
659
+ },
660
+ "32077": {
661
+ "content": "<extra_id_22>",
662
+ "lstrip": true,
663
+ "normalized": true,
664
+ "rstrip": false,
665
+ "single_word": false,
666
+ "special": true
667
+ },
668
+ "32078": {
669
+ "content": "<extra_id_21>",
670
+ "lstrip": true,
671
+ "normalized": true,
672
+ "rstrip": false,
673
+ "single_word": false,
674
+ "special": true
675
+ },
676
+ "32079": {
677
+ "content": "<extra_id_20>",
678
+ "lstrip": true,
679
+ "normalized": true,
680
+ "rstrip": false,
681
+ "single_word": false,
682
+ "special": true
683
+ },
684
+ "32080": {
685
+ "content": "<extra_id_19>",
686
+ "lstrip": true,
687
+ "normalized": true,
688
+ "rstrip": false,
689
+ "single_word": false,
690
+ "special": true
691
+ },
692
+ "32081": {
693
+ "content": "<extra_id_18>",
694
+ "lstrip": true,
695
+ "normalized": true,
696
+ "rstrip": false,
697
+ "single_word": false,
698
+ "special": true
699
+ },
700
+ "32082": {
701
+ "content": "<extra_id_17>",
702
+ "lstrip": true,
703
+ "normalized": true,
704
+ "rstrip": false,
705
+ "single_word": false,
706
+ "special": true
707
+ },
708
+ "32083": {
709
+ "content": "<extra_id_16>",
710
+ "lstrip": true,
711
+ "normalized": true,
712
+ "rstrip": false,
713
+ "single_word": false,
714
+ "special": true
715
+ },
716
+ "32084": {
717
+ "content": "<extra_id_15>",
718
+ "lstrip": true,
719
+ "normalized": true,
720
+ "rstrip": false,
721
+ "single_word": false,
722
+ "special": true
723
+ },
724
+ "32085": {
725
+ "content": "<extra_id_14>",
726
+ "lstrip": true,
727
+ "normalized": true,
728
+ "rstrip": false,
729
+ "single_word": false,
730
+ "special": true
731
+ },
732
+ "32086": {
733
+ "content": "<extra_id_13>",
734
+ "lstrip": true,
735
+ "normalized": true,
736
+ "rstrip": false,
737
+ "single_word": false,
738
+ "special": true
739
+ },
740
+ "32087": {
741
+ "content": "<extra_id_12>",
742
+ "lstrip": true,
743
+ "normalized": true,
744
+ "rstrip": false,
745
+ "single_word": false,
746
+ "special": true
747
+ },
748
+ "32088": {
749
+ "content": "<extra_id_11>",
750
+ "lstrip": true,
751
+ "normalized": true,
752
+ "rstrip": false,
753
+ "single_word": false,
754
+ "special": true
755
+ },
756
+ "32089": {
757
+ "content": "<extra_id_10>",
758
+ "lstrip": true,
759
+ "normalized": true,
760
+ "rstrip": false,
761
+ "single_word": false,
762
+ "special": true
763
+ },
764
+ "32090": {
765
+ "content": "<extra_id_9>",
766
+ "lstrip": true,
767
+ "normalized": true,
768
+ "rstrip": false,
769
+ "single_word": false,
770
+ "special": true
771
+ },
772
+ "32091": {
773
+ "content": "<extra_id_8>",
774
+ "lstrip": true,
775
+ "normalized": true,
776
+ "rstrip": false,
777
+ "single_word": false,
778
+ "special": true
779
+ },
780
+ "32092": {
781
+ "content": "<extra_id_7>",
782
+ "lstrip": true,
783
+ "normalized": true,
784
+ "rstrip": false,
785
+ "single_word": false,
786
+ "special": true
787
+ },
788
+ "32093": {
789
+ "content": "<extra_id_6>",
790
+ "lstrip": true,
791
+ "normalized": true,
792
+ "rstrip": false,
793
+ "single_word": false,
794
+ "special": true
795
+ },
796
+ "32094": {
797
+ "content": "<extra_id_5>",
798
+ "lstrip": true,
799
+ "normalized": true,
800
+ "rstrip": false,
801
+ "single_word": false,
802
+ "special": true
803
+ },
804
+ "32095": {
805
+ "content": "<extra_id_4>",
806
+ "lstrip": true,
807
+ "normalized": true,
808
+ "rstrip": false,
809
+ "single_word": false,
810
+ "special": true
811
+ },
812
+ "32096": {
813
+ "content": "<extra_id_3>",
814
+ "lstrip": true,
815
+ "normalized": true,
816
+ "rstrip": false,
817
+ "single_word": false,
818
+ "special": true
819
+ },
820
+ "32097": {
821
+ "content": "<extra_id_2>",
822
+ "lstrip": true,
823
+ "normalized": true,
824
+ "rstrip": false,
825
+ "single_word": false,
826
+ "special": true
827
+ },
828
+ "32098": {
829
+ "content": "<extra_id_1>",
830
+ "lstrip": true,
831
+ "normalized": true,
832
+ "rstrip": false,
833
+ "single_word": false,
834
+ "special": true
835
+ },
836
+ "32099": {
837
+ "content": "<extra_id_0>",
838
+ "lstrip": true,
839
+ "normalized": true,
840
+ "rstrip": false,
841
+ "single_word": false,
842
+ "special": true
843
+ }
844
+ },
845
+ "additional_special_tokens": [
846
+ "<extra_id_99>",
847
+ "<extra_id_98>",
848
+ "<extra_id_97>",
849
+ "<extra_id_96>",
850
+ "<extra_id_95>",
851
+ "<extra_id_94>",
852
+ "<extra_id_93>",
853
+ "<extra_id_92>",
854
+ "<extra_id_91>",
855
+ "<extra_id_90>",
856
+ "<extra_id_89>",
857
+ "<extra_id_88>",
858
+ "<extra_id_87>",
859
+ "<extra_id_86>",
860
+ "<extra_id_85>",
861
+ "<extra_id_84>",
862
+ "<extra_id_83>",
863
+ "<extra_id_82>",
864
+ "<extra_id_81>",
865
+ "<extra_id_80>",
866
+ "<extra_id_79>",
867
+ "<extra_id_78>",
868
+ "<extra_id_77>",
869
+ "<extra_id_76>",
870
+ "<extra_id_75>",
871
+ "<extra_id_74>",
872
+ "<extra_id_73>",
873
+ "<extra_id_72>",
874
+ "<extra_id_71>",
875
+ "<extra_id_70>",
876
+ "<extra_id_69>",
877
+ "<extra_id_68>",
878
+ "<extra_id_67>",
879
+ "<extra_id_66>",
880
+ "<extra_id_65>",
881
+ "<extra_id_64>",
882
+ "<extra_id_63>",
883
+ "<extra_id_62>",
884
+ "<extra_id_61>",
885
+ "<extra_id_60>",
886
+ "<extra_id_59>",
887
+ "<extra_id_58>",
888
+ "<extra_id_57>",
889
+ "<extra_id_56>",
890
+ "<extra_id_55>",
891
+ "<extra_id_54>",
892
+ "<extra_id_53>",
893
+ "<extra_id_52>",
894
+ "<extra_id_51>",
895
+ "<extra_id_50>",
896
+ "<extra_id_49>",
897
+ "<extra_id_48>",
898
+ "<extra_id_47>",
899
+ "<extra_id_46>",
900
+ "<extra_id_45>",
901
+ "<extra_id_44>",
902
+ "<extra_id_43>",
903
+ "<extra_id_42>",
904
+ "<extra_id_41>",
905
+ "<extra_id_40>",
906
+ "<extra_id_39>",
907
+ "<extra_id_38>",
908
+ "<extra_id_37>",
909
+ "<extra_id_36>",
910
+ "<extra_id_35>",
911
+ "<extra_id_34>",
912
+ "<extra_id_33>",
913
+ "<extra_id_32>",
914
+ "<extra_id_31>",
915
+ "<extra_id_30>",
916
+ "<extra_id_29>",
917
+ "<extra_id_28>",
918
+ "<extra_id_27>",
919
+ "<extra_id_26>",
920
+ "<extra_id_25>",
921
+ "<extra_id_24>",
922
+ "<extra_id_23>",
923
+ "<extra_id_22>",
924
+ "<extra_id_21>",
925
+ "<extra_id_20>",
926
+ "<extra_id_19>",
927
+ "<extra_id_18>",
928
+ "<extra_id_17>",
929
+ "<extra_id_16>",
930
+ "<extra_id_15>",
931
+ "<extra_id_14>",
932
+ "<extra_id_13>",
933
+ "<extra_id_12>",
934
+ "<extra_id_11>",
935
+ "<extra_id_10>",
936
+ "<extra_id_9>",
937
+ "<extra_id_8>",
938
+ "<extra_id_7>",
939
+ "<extra_id_6>",
940
+ "<extra_id_5>",
941
+ "<extra_id_4>",
942
+ "<extra_id_3>",
943
+ "<extra_id_2>",
944
+ "<extra_id_1>",
945
+ "<extra_id_0>"
946
+ ],
947
+ "bos_token": "<s>",
948
+ "clean_up_tokenization_spaces": false,
949
+ "cls_token": "<s>",
950
+ "eos_token": "</s>",
951
+ "errors": "replace",
952
+ "extra_special_tokens": {},
953
+ "mask_token": "<mask>",
954
+ "model_max_length": 512,
955
+ "pad_token": "<pad>",
956
+ "sep_token": "</s>",
957
+ "tokenizer_class": "RobertaTokenizer",
958
+ "trim_offsets": true,
959
+ "unk_token": "<unk>"
960
+ }
checkpoint-11316/trainer_state.json ADDED
@@ -0,0 +1,1656 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 11316,
3
+ "best_metric": 0.971733581422284,
4
+ "best_model_checkpoint": "./codet5-qlora-k8s/checkpoint-11316",
5
+ "epoch": 4.0,
6
+ "eval_steps": 500,
7
+ "global_step": 11316,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.017674089784376106,
14
+ "grad_norm": 1.1207759380340576,
15
+ "learning_rate": 0.00029898197242841994,
16
+ "loss": 3.2886,
17
+ "step": 50
18
+ },
19
+ {
20
+ "epoch": 0.03534817956875221,
21
+ "grad_norm": 1.2978123426437378,
22
+ "learning_rate": 0.0002979215270413573,
23
+ "loss": 1.8567,
24
+ "step": 100
25
+ },
26
+ {
27
+ "epoch": 0.053022269353128315,
28
+ "grad_norm": 1.624740719795227,
29
+ "learning_rate": 0.0002968610816542948,
30
+ "loss": 1.5695,
31
+ "step": 150
32
+ },
33
+ {
34
+ "epoch": 0.07069635913750442,
35
+ "grad_norm": 1.7711330652236938,
36
+ "learning_rate": 0.0002958006362672322,
37
+ "loss": 1.4205,
38
+ "step": 200
39
+ },
40
+ {
41
+ "epoch": 0.08837044892188052,
42
+ "grad_norm": 1.62517511844635,
43
+ "learning_rate": 0.0002947401908801697,
44
+ "loss": 1.2732,
45
+ "step": 250
46
+ },
47
+ {
48
+ "epoch": 0.10604453870625663,
49
+ "grad_norm": 2.038139820098877,
50
+ "learning_rate": 0.00029367974549310706,
51
+ "loss": 1.1913,
52
+ "step": 300
53
+ },
54
+ {
55
+ "epoch": 0.12371862849063273,
56
+ "grad_norm": 2.262789487838745,
57
+ "learning_rate": 0.00029264050901378576,
58
+ "loss": 1.117,
59
+ "step": 350
60
+ },
61
+ {
62
+ "epoch": 0.14139271827500885,
63
+ "grad_norm": 3.121687650680542,
64
+ "learning_rate": 0.0002915800636267232,
65
+ "loss": 1.0202,
66
+ "step": 400
67
+ },
68
+ {
69
+ "epoch": 0.15906680805938495,
70
+ "grad_norm": 2.0951812267303467,
71
+ "learning_rate": 0.0002905196182396606,
72
+ "loss": 0.9499,
73
+ "step": 450
74
+ },
75
+ {
76
+ "epoch": 0.17674089784376104,
77
+ "grad_norm": 2.670121192932129,
78
+ "learning_rate": 0.00028945917285259806,
79
+ "loss": 0.9707,
80
+ "step": 500
81
+ },
82
+ {
83
+ "epoch": 0.19441498762813716,
84
+ "grad_norm": 2.3631107807159424,
85
+ "learning_rate": 0.00028841993637327676,
86
+ "loss": 0.7961,
87
+ "step": 550
88
+ },
89
+ {
90
+ "epoch": 0.21208907741251326,
91
+ "grad_norm": 2.10772705078125,
92
+ "learning_rate": 0.0002873594909862142,
93
+ "loss": 0.8912,
94
+ "step": 600
95
+ },
96
+ {
97
+ "epoch": 0.22976316719688936,
98
+ "grad_norm": 2.360686779022217,
99
+ "learning_rate": 0.00028629904559915163,
100
+ "loss": 0.871,
101
+ "step": 650
102
+ },
103
+ {
104
+ "epoch": 0.24743725698126545,
105
+ "grad_norm": 2.191119432449341,
106
+ "learning_rate": 0.0002852598091198303,
107
+ "loss": 0.758,
108
+ "step": 700
109
+ },
110
+ {
111
+ "epoch": 0.2651113467656416,
112
+ "grad_norm": 1.7646818161010742,
113
+ "learning_rate": 0.00028419936373276776,
114
+ "loss": 0.8244,
115
+ "step": 750
116
+ },
117
+ {
118
+ "epoch": 0.2827854365500177,
119
+ "grad_norm": 2.3776354789733887,
120
+ "learning_rate": 0.00028313891834570514,
121
+ "loss": 0.7664,
122
+ "step": 800
123
+ },
124
+ {
125
+ "epoch": 0.30045952633439377,
126
+ "grad_norm": 2.8682475090026855,
127
+ "learning_rate": 0.00028207847295864263,
128
+ "loss": 0.6942,
129
+ "step": 850
130
+ },
131
+ {
132
+ "epoch": 0.3181336161187699,
133
+ "grad_norm": 2.353091239929199,
134
+ "learning_rate": 0.00028101802757158,
135
+ "loss": 0.7323,
136
+ "step": 900
137
+ },
138
+ {
139
+ "epoch": 0.335807705903146,
140
+ "grad_norm": 1.9457337856292725,
141
+ "learning_rate": 0.00027995758218451745,
142
+ "loss": 0.6474,
143
+ "step": 950
144
+ },
145
+ {
146
+ "epoch": 0.3534817956875221,
147
+ "grad_norm": 2.510075330734253,
148
+ "learning_rate": 0.00027889713679745494,
149
+ "loss": 0.6801,
150
+ "step": 1000
151
+ },
152
+ {
153
+ "epoch": 0.3711558854718982,
154
+ "grad_norm": 1.7497014999389648,
155
+ "learning_rate": 0.0002778366914103923,
156
+ "loss": 0.656,
157
+ "step": 1050
158
+ },
159
+ {
160
+ "epoch": 0.38882997525627433,
161
+ "grad_norm": 2.862682342529297,
162
+ "learning_rate": 0.0002767762460233298,
163
+ "loss": 0.6238,
164
+ "step": 1100
165
+ },
166
+ {
167
+ "epoch": 0.4065040650406504,
168
+ "grad_norm": 1.998961091041565,
169
+ "learning_rate": 0.0002757158006362672,
170
+ "loss": 0.6306,
171
+ "step": 1150
172
+ },
173
+ {
174
+ "epoch": 0.4241781548250265,
175
+ "grad_norm": 1.854942798614502,
176
+ "learning_rate": 0.0002746553552492047,
177
+ "loss": 0.5689,
178
+ "step": 1200
179
+ },
180
+ {
181
+ "epoch": 0.4418522446094026,
182
+ "grad_norm": 1.8994203805923462,
183
+ "learning_rate": 0.00027359490986214206,
184
+ "loss": 0.6595,
185
+ "step": 1250
186
+ },
187
+ {
188
+ "epoch": 0.4595263343937787,
189
+ "grad_norm": 1.6235908269882202,
190
+ "learning_rate": 0.0002725344644750795,
191
+ "loss": 0.5665,
192
+ "step": 1300
193
+ },
194
+ {
195
+ "epoch": 0.47720042417815484,
196
+ "grad_norm": 2.291989803314209,
197
+ "learning_rate": 0.00027147401908801693,
198
+ "loss": 0.5761,
199
+ "step": 1350
200
+ },
201
+ {
202
+ "epoch": 0.4948745139625309,
203
+ "grad_norm": 1.4632915258407593,
204
+ "learning_rate": 0.00027041357370095437,
205
+ "loss": 0.5171,
206
+ "step": 1400
207
+ },
208
+ {
209
+ "epoch": 0.512548603746907,
210
+ "grad_norm": 2.1687259674072266,
211
+ "learning_rate": 0.0002693531283138918,
212
+ "loss": 0.6183,
213
+ "step": 1450
214
+ },
215
+ {
216
+ "epoch": 0.5302226935312832,
217
+ "grad_norm": 1.734108805656433,
218
+ "learning_rate": 0.00026829268292682924,
219
+ "loss": 0.5411,
220
+ "step": 1500
221
+ },
222
+ {
223
+ "epoch": 0.5478967833156593,
224
+ "grad_norm": 1.3890644311904907,
225
+ "learning_rate": 0.00026723223753976667,
226
+ "loss": 0.5092,
227
+ "step": 1550
228
+ },
229
+ {
230
+ "epoch": 0.5655708731000354,
231
+ "grad_norm": 1.98700749874115,
232
+ "learning_rate": 0.0002661717921527041,
233
+ "loss": 0.4804,
234
+ "step": 1600
235
+ },
236
+ {
237
+ "epoch": 0.5832449628844114,
238
+ "grad_norm": 1.1181468963623047,
239
+ "learning_rate": 0.00026511134676564154,
240
+ "loss": 0.5148,
241
+ "step": 1650
242
+ },
243
+ {
244
+ "epoch": 0.6009190526687875,
245
+ "grad_norm": 1.7994420528411865,
246
+ "learning_rate": 0.000264050901378579,
247
+ "loss": 0.4231,
248
+ "step": 1700
249
+ },
250
+ {
251
+ "epoch": 0.6185931424531637,
252
+ "grad_norm": 2.032198667526245,
253
+ "learning_rate": 0.0002629904559915164,
254
+ "loss": 0.5106,
255
+ "step": 1750
256
+ },
257
+ {
258
+ "epoch": 0.6362672322375398,
259
+ "grad_norm": 3.585948944091797,
260
+ "learning_rate": 0.00026193001060445385,
261
+ "loss": 0.4717,
262
+ "step": 1800
263
+ },
264
+ {
265
+ "epoch": 0.6539413220219159,
266
+ "grad_norm": 1.8610371351242065,
267
+ "learning_rate": 0.0002608695652173913,
268
+ "loss": 0.4765,
269
+ "step": 1850
270
+ },
271
+ {
272
+ "epoch": 0.671615411806292,
273
+ "grad_norm": 1.2324624061584473,
274
+ "learning_rate": 0.0002598091198303287,
275
+ "loss": 0.4643,
276
+ "step": 1900
277
+ },
278
+ {
279
+ "epoch": 0.689289501590668,
280
+ "grad_norm": 2.391714572906494,
281
+ "learning_rate": 0.00025874867444326615,
282
+ "loss": 0.4512,
283
+ "step": 1950
284
+ },
285
+ {
286
+ "epoch": 0.7069635913750442,
287
+ "grad_norm": 1.8863242864608765,
288
+ "learning_rate": 0.0002576882290562036,
289
+ "loss": 0.4115,
290
+ "step": 2000
291
+ },
292
+ {
293
+ "epoch": 0.7246376811594203,
294
+ "grad_norm": 0.7850649356842041,
295
+ "learning_rate": 0.000256627783669141,
296
+ "loss": 0.4341,
297
+ "step": 2050
298
+ },
299
+ {
300
+ "epoch": 0.7423117709437964,
301
+ "grad_norm": 1.5869959592819214,
302
+ "learning_rate": 0.00025556733828207846,
303
+ "loss": 0.4172,
304
+ "step": 2100
305
+ },
306
+ {
307
+ "epoch": 0.7599858607281725,
308
+ "grad_norm": 1.2584971189498901,
309
+ "learning_rate": 0.0002545068928950159,
310
+ "loss": 0.4384,
311
+ "step": 2150
312
+ },
313
+ {
314
+ "epoch": 0.7776599505125487,
315
+ "grad_norm": 2.560710906982422,
316
+ "learning_rate": 0.00025344644750795333,
317
+ "loss": 0.4558,
318
+ "step": 2200
319
+ },
320
+ {
321
+ "epoch": 0.7953340402969247,
322
+ "grad_norm": 2.2893359661102295,
323
+ "learning_rate": 0.00025238600212089076,
324
+ "loss": 0.4345,
325
+ "step": 2250
326
+ },
327
+ {
328
+ "epoch": 0.8130081300813008,
329
+ "grad_norm": 1.5244982242584229,
330
+ "learning_rate": 0.0002513255567338282,
331
+ "loss": 0.4071,
332
+ "step": 2300
333
+ },
334
+ {
335
+ "epoch": 0.8306822198656769,
336
+ "grad_norm": 1.384102463722229,
337
+ "learning_rate": 0.00025026511134676563,
338
+ "loss": 0.3612,
339
+ "step": 2350
340
+ },
341
+ {
342
+ "epoch": 0.848356309650053,
343
+ "grad_norm": 1.3080965280532837,
344
+ "learning_rate": 0.00024920466595970307,
345
+ "loss": 0.3556,
346
+ "step": 2400
347
+ },
348
+ {
349
+ "epoch": 0.8660303994344292,
350
+ "grad_norm": 1.3324400186538696,
351
+ "learning_rate": 0.00024814422057264045,
352
+ "loss": 0.3985,
353
+ "step": 2450
354
+ },
355
+ {
356
+ "epoch": 0.8837044892188052,
357
+ "grad_norm": 1.7705445289611816,
358
+ "learning_rate": 0.00024708377518557794,
359
+ "loss": 0.3895,
360
+ "step": 2500
361
+ },
362
+ {
363
+ "epoch": 0.9013785790031813,
364
+ "grad_norm": 1.352480173110962,
365
+ "learning_rate": 0.0002460233297985153,
366
+ "loss": 0.426,
367
+ "step": 2550
368
+ },
369
+ {
370
+ "epoch": 0.9190526687875574,
371
+ "grad_norm": 1.479979157447815,
372
+ "learning_rate": 0.0002449628844114528,
373
+ "loss": 0.4057,
374
+ "step": 2600
375
+ },
376
+ {
377
+ "epoch": 0.9367267585719335,
378
+ "grad_norm": 2.1380653381347656,
379
+ "learning_rate": 0.00024390243902439022,
380
+ "loss": 0.3689,
381
+ "step": 2650
382
+ },
383
+ {
384
+ "epoch": 0.9544008483563097,
385
+ "grad_norm": 1.9099682569503784,
386
+ "learning_rate": 0.00024284199363732768,
387
+ "loss": 0.3991,
388
+ "step": 2700
389
+ },
390
+ {
391
+ "epoch": 0.9720749381406858,
392
+ "grad_norm": 1.399566411972046,
393
+ "learning_rate": 0.0002417815482502651,
394
+ "loss": 0.3412,
395
+ "step": 2750
396
+ },
397
+ {
398
+ "epoch": 0.9897490279250618,
399
+ "grad_norm": 2.508267879486084,
400
+ "learning_rate": 0.00024072110286320252,
401
+ "loss": 0.3828,
402
+ "step": 2800
403
+ },
404
+ {
405
+ "epoch": 1.0,
406
+ "eval_bertscore_f1": 0.9667777874331811,
407
+ "eval_bleu": 0.5973566262792636,
408
+ "eval_loss": 0.27053505182266235,
409
+ "eval_runtime": 1054.1237,
410
+ "eval_samples_per_second": 6.132,
411
+ "eval_steps_per_second": 0.767,
412
+ "step": 2829
413
+ },
414
+ {
415
+ "epoch": 1.007423117709438,
416
+ "grad_norm": 1.6967344284057617,
417
+ "learning_rate": 0.00023966065747613996,
418
+ "loss": 0.3787,
419
+ "step": 2850
420
+ },
421
+ {
422
+ "epoch": 1.025097207493814,
423
+ "grad_norm": 1.7119196653366089,
424
+ "learning_rate": 0.0002386002120890774,
425
+ "loss": 0.3507,
426
+ "step": 2900
427
+ },
428
+ {
429
+ "epoch": 1.0427712972781902,
430
+ "grad_norm": 1.5456138849258423,
431
+ "learning_rate": 0.00023753976670201483,
432
+ "loss": 0.333,
433
+ "step": 2950
434
+ },
435
+ {
436
+ "epoch": 1.0604453870625663,
437
+ "grad_norm": 1.3519443273544312,
438
+ "learning_rate": 0.00023647932131495226,
439
+ "loss": 0.3897,
440
+ "step": 3000
441
+ },
442
+ {
443
+ "epoch": 1.0781194768469424,
444
+ "grad_norm": 1.4092153310775757,
445
+ "learning_rate": 0.0002354188759278897,
446
+ "loss": 0.3069,
447
+ "step": 3050
448
+ },
449
+ {
450
+ "epoch": 1.0957935666313185,
451
+ "grad_norm": 1.67427659034729,
452
+ "learning_rate": 0.00023435843054082713,
453
+ "loss": 0.3876,
454
+ "step": 3100
455
+ },
456
+ {
457
+ "epoch": 1.1134676564156947,
458
+ "grad_norm": 0.9288003444671631,
459
+ "learning_rate": 0.00023329798515376457,
460
+ "loss": 0.3052,
461
+ "step": 3150
462
+ },
463
+ {
464
+ "epoch": 1.1311417462000706,
465
+ "grad_norm": 2.0493695735931396,
466
+ "learning_rate": 0.000232237539766702,
467
+ "loss": 0.3419,
468
+ "step": 3200
469
+ },
470
+ {
471
+ "epoch": 1.148815835984447,
472
+ "grad_norm": 1.3473105430603027,
473
+ "learning_rate": 0.0002311770943796394,
474
+ "loss": 0.351,
475
+ "step": 3250
476
+ },
477
+ {
478
+ "epoch": 1.1664899257688228,
479
+ "grad_norm": 2.2063777446746826,
480
+ "learning_rate": 0.00023011664899257687,
481
+ "loss": 0.3732,
482
+ "step": 3300
483
+ },
484
+ {
485
+ "epoch": 1.184164015553199,
486
+ "grad_norm": 0.7194732427597046,
487
+ "learning_rate": 0.00022905620360551428,
488
+ "loss": 0.3098,
489
+ "step": 3350
490
+ },
491
+ {
492
+ "epoch": 1.201838105337575,
493
+ "grad_norm": 1.8693958520889282,
494
+ "learning_rate": 0.00022799575821845174,
495
+ "loss": 0.3623,
496
+ "step": 3400
497
+ },
498
+ {
499
+ "epoch": 1.2195121951219512,
500
+ "grad_norm": 1.7452648878097534,
501
+ "learning_rate": 0.00022693531283138915,
502
+ "loss": 0.2985,
503
+ "step": 3450
504
+ },
505
+ {
506
+ "epoch": 1.2371862849063273,
507
+ "grad_norm": 2.7502336502075195,
508
+ "learning_rate": 0.00022587486744432661,
509
+ "loss": 0.2938,
510
+ "step": 3500
511
+ },
512
+ {
513
+ "epoch": 1.2548603746907034,
514
+ "grad_norm": 1.0220433473587036,
515
+ "learning_rate": 0.00022481442205726402,
516
+ "loss": 0.3263,
517
+ "step": 3550
518
+ },
519
+ {
520
+ "epoch": 1.2725344644750796,
521
+ "grad_norm": 1.1841455698013306,
522
+ "learning_rate": 0.00022375397667020146,
523
+ "loss": 0.3456,
524
+ "step": 3600
525
+ },
526
+ {
527
+ "epoch": 1.2902085542594557,
528
+ "grad_norm": 1.1220083236694336,
529
+ "learning_rate": 0.0002226935312831389,
530
+ "loss": 0.3749,
531
+ "step": 3650
532
+ },
533
+ {
534
+ "epoch": 1.3078826440438318,
535
+ "grad_norm": 2.557077646255493,
536
+ "learning_rate": 0.00022163308589607633,
537
+ "loss": 0.3479,
538
+ "step": 3700
539
+ },
540
+ {
541
+ "epoch": 1.3255567338282077,
542
+ "grad_norm": 1.672131061553955,
543
+ "learning_rate": 0.00022057264050901376,
544
+ "loss": 0.3371,
545
+ "step": 3750
546
+ },
547
+ {
548
+ "epoch": 1.343230823612584,
549
+ "grad_norm": 1.5530970096588135,
550
+ "learning_rate": 0.0002195121951219512,
551
+ "loss": 0.3062,
552
+ "step": 3800
553
+ },
554
+ {
555
+ "epoch": 1.36090491339696,
556
+ "grad_norm": 0.8587738871574402,
557
+ "learning_rate": 0.00021845174973488866,
558
+ "loss": 0.3458,
559
+ "step": 3850
560
+ },
561
+ {
562
+ "epoch": 1.378579003181336,
563
+ "grad_norm": 1.2779722213745117,
564
+ "learning_rate": 0.00021739130434782607,
565
+ "loss": 0.3582,
566
+ "step": 3900
567
+ },
568
+ {
569
+ "epoch": 1.3962530929657122,
570
+ "grad_norm": 1.7616783380508423,
571
+ "learning_rate": 0.00021633085896076348,
572
+ "loss": 0.2999,
573
+ "step": 3950
574
+ },
575
+ {
576
+ "epoch": 1.4139271827500883,
577
+ "grad_norm": 1.2923225164413452,
578
+ "learning_rate": 0.00021527041357370094,
579
+ "loss": 0.3079,
580
+ "step": 4000
581
+ },
582
+ {
583
+ "epoch": 1.4316012725344645,
584
+ "grad_norm": 0.7930673360824585,
585
+ "learning_rate": 0.00021420996818663835,
586
+ "loss": 0.2973,
587
+ "step": 4050
588
+ },
589
+ {
590
+ "epoch": 1.4492753623188406,
591
+ "grad_norm": 1.5622656345367432,
592
+ "learning_rate": 0.0002131495227995758,
593
+ "loss": 0.291,
594
+ "step": 4100
595
+ },
596
+ {
597
+ "epoch": 1.4669494521032167,
598
+ "grad_norm": 0.8834390640258789,
599
+ "learning_rate": 0.00021208907741251324,
600
+ "loss": 0.2691,
601
+ "step": 4150
602
+ },
603
+ {
604
+ "epoch": 1.4846235418875928,
605
+ "grad_norm": 1.2596232891082764,
606
+ "learning_rate": 0.00021102863202545068,
607
+ "loss": 0.247,
608
+ "step": 4200
609
+ },
610
+ {
611
+ "epoch": 1.502297631671969,
612
+ "grad_norm": 0.7010456323623657,
613
+ "learning_rate": 0.00020996818663838811,
614
+ "loss": 0.3019,
615
+ "step": 4250
616
+ },
617
+ {
618
+ "epoch": 1.5199717214563448,
619
+ "grad_norm": 1.071253776550293,
620
+ "learning_rate": 0.00020890774125132552,
621
+ "loss": 0.2447,
622
+ "step": 4300
623
+ },
624
+ {
625
+ "epoch": 1.5376458112407212,
626
+ "grad_norm": 0.63275545835495,
627
+ "learning_rate": 0.00020784729586426298,
628
+ "loss": 0.246,
629
+ "step": 4350
630
+ },
631
+ {
632
+ "epoch": 1.555319901025097,
633
+ "grad_norm": 1.0832668542861938,
634
+ "learning_rate": 0.0002067868504772004,
635
+ "loss": 0.249,
636
+ "step": 4400
637
+ },
638
+ {
639
+ "epoch": 1.5729939908094734,
640
+ "grad_norm": 1.0748353004455566,
641
+ "learning_rate": 0.00020572640509013785,
642
+ "loss": 0.2585,
643
+ "step": 4450
644
+ },
645
+ {
646
+ "epoch": 1.5906680805938493,
647
+ "grad_norm": 1.2410573959350586,
648
+ "learning_rate": 0.00020466595970307526,
649
+ "loss": 0.2821,
650
+ "step": 4500
651
+ },
652
+ {
653
+ "epoch": 1.6083421703782255,
654
+ "grad_norm": 1.8322285413742065,
655
+ "learning_rate": 0.00020360551431601272,
656
+ "loss": 0.2642,
657
+ "step": 4550
658
+ },
659
+ {
660
+ "epoch": 1.6260162601626016,
661
+ "grad_norm": 1.5231540203094482,
662
+ "learning_rate": 0.00020254506892895013,
663
+ "loss": 0.329,
664
+ "step": 4600
665
+ },
666
+ {
667
+ "epoch": 1.6436903499469777,
668
+ "grad_norm": 0.8996387124061584,
669
+ "learning_rate": 0.0002014846235418876,
670
+ "loss": 0.2822,
671
+ "step": 4650
672
+ },
673
+ {
674
+ "epoch": 1.6613644397313538,
675
+ "grad_norm": 1.107340693473816,
676
+ "learning_rate": 0.000200424178154825,
677
+ "loss": 0.2647,
678
+ "step": 4700
679
+ },
680
+ {
681
+ "epoch": 1.67903852951573,
682
+ "grad_norm": 1.44370698928833,
683
+ "learning_rate": 0.00019936373276776244,
684
+ "loss": 0.3281,
685
+ "step": 4750
686
+ },
687
+ {
688
+ "epoch": 1.696712619300106,
689
+ "grad_norm": 1.433866024017334,
690
+ "learning_rate": 0.00019830328738069987,
691
+ "loss": 0.2867,
692
+ "step": 4800
693
+ },
694
+ {
695
+ "epoch": 1.714386709084482,
696
+ "grad_norm": 0.7778879404067993,
697
+ "learning_rate": 0.0001972428419936373,
698
+ "loss": 0.2363,
699
+ "step": 4850
700
+ },
701
+ {
702
+ "epoch": 1.7320607988688583,
703
+ "grad_norm": 1.0693784952163696,
704
+ "learning_rate": 0.00019618239660657474,
705
+ "loss": 0.2989,
706
+ "step": 4900
707
+ },
708
+ {
709
+ "epoch": 1.7497348886532342,
710
+ "grad_norm": 0.9680020213127136,
711
+ "learning_rate": 0.00019512195121951218,
712
+ "loss": 0.2512,
713
+ "step": 4950
714
+ },
715
+ {
716
+ "epoch": 1.7674089784376106,
717
+ "grad_norm": 0.9300338625907898,
718
+ "learning_rate": 0.00019406150583244961,
719
+ "loss": 0.2814,
720
+ "step": 5000
721
+ },
722
+ {
723
+ "epoch": 1.7850830682219865,
724
+ "grad_norm": 1.6086584329605103,
725
+ "learning_rate": 0.00019300106044538705,
726
+ "loss": 0.2895,
727
+ "step": 5050
728
+ },
729
+ {
730
+ "epoch": 1.8027571580063628,
731
+ "grad_norm": 1.522153615951538,
732
+ "learning_rate": 0.00019194061505832446,
733
+ "loss": 0.2804,
734
+ "step": 5100
735
+ },
736
+ {
737
+ "epoch": 1.8204312477907387,
738
+ "grad_norm": 1.3292605876922607,
739
+ "learning_rate": 0.00019088016967126192,
740
+ "loss": 0.2676,
741
+ "step": 5150
742
+ },
743
+ {
744
+ "epoch": 1.8381053375751149,
745
+ "grad_norm": 1.0950225591659546,
746
+ "learning_rate": 0.00018981972428419933,
747
+ "loss": 0.2991,
748
+ "step": 5200
749
+ },
750
+ {
751
+ "epoch": 1.855779427359491,
752
+ "grad_norm": 1.8333910703659058,
753
+ "learning_rate": 0.0001887592788971368,
754
+ "loss": 0.2742,
755
+ "step": 5250
756
+ },
757
+ {
758
+ "epoch": 1.873453517143867,
759
+ "grad_norm": 1.447016716003418,
760
+ "learning_rate": 0.0001876988335100742,
761
+ "loss": 0.2125,
762
+ "step": 5300
763
+ },
764
+ {
765
+ "epoch": 1.8911276069282432,
766
+ "grad_norm": 1.0409213304519653,
767
+ "learning_rate": 0.00018663838812301166,
768
+ "loss": 0.2372,
769
+ "step": 5350
770
+ },
771
+ {
772
+ "epoch": 1.9088016967126193,
773
+ "grad_norm": 0.5701714158058167,
774
+ "learning_rate": 0.00018557794273594907,
775
+ "loss": 0.2332,
776
+ "step": 5400
777
+ },
778
+ {
779
+ "epoch": 1.9264757864969955,
780
+ "grad_norm": 1.0092428922653198,
781
+ "learning_rate": 0.0001845174973488865,
782
+ "loss": 0.2897,
783
+ "step": 5450
784
+ },
785
+ {
786
+ "epoch": 1.9441498762813714,
787
+ "grad_norm": 1.031217098236084,
788
+ "learning_rate": 0.00018345705196182397,
789
+ "loss": 0.2722,
790
+ "step": 5500
791
+ },
792
+ {
793
+ "epoch": 1.9618239660657477,
794
+ "grad_norm": 1.2638362646102905,
795
+ "learning_rate": 0.00018239660657476137,
796
+ "loss": 0.2505,
797
+ "step": 5550
798
+ },
799
+ {
800
+ "epoch": 1.9794980558501236,
801
+ "grad_norm": 1.3998290300369263,
802
+ "learning_rate": 0.00018133616118769884,
803
+ "loss": 0.2772,
804
+ "step": 5600
805
+ },
806
+ {
807
+ "epoch": 1.9971721456345,
808
+ "grad_norm": 1.4681320190429688,
809
+ "learning_rate": 0.00018027571580063624,
810
+ "loss": 0.25,
811
+ "step": 5650
812
+ },
813
+ {
814
+ "epoch": 2.0,
815
+ "eval_bertscore_f1": 0.970109825833968,
816
+ "eval_bleu": 0.6229920961802436,
817
+ "eval_loss": 0.1904931217432022,
818
+ "eval_runtime": 1018.8038,
819
+ "eval_samples_per_second": 6.345,
820
+ "eval_steps_per_second": 0.793,
821
+ "step": 5658
822
+ },
823
+ {
824
+ "epoch": 2.014846235418876,
825
+ "grad_norm": 1.3499983549118042,
826
+ "learning_rate": 0.0001792152704135737,
827
+ "loss": 0.2412,
828
+ "step": 5700
829
+ },
830
+ {
831
+ "epoch": 2.032520325203252,
832
+ "grad_norm": 1.2155545949935913,
833
+ "learning_rate": 0.00017815482502651111,
834
+ "loss": 0.2919,
835
+ "step": 5750
836
+ },
837
+ {
838
+ "epoch": 2.050194414987628,
839
+ "grad_norm": 0.9294681549072266,
840
+ "learning_rate": 0.00017709437963944858,
841
+ "loss": 0.2191,
842
+ "step": 5800
843
+ },
844
+ {
845
+ "epoch": 2.0678685047720045,
846
+ "grad_norm": 0.8069599270820618,
847
+ "learning_rate": 0.00017603393425238598,
848
+ "loss": 0.228,
849
+ "step": 5850
850
+ },
851
+ {
852
+ "epoch": 2.0855425945563804,
853
+ "grad_norm": 1.1825474500656128,
854
+ "learning_rate": 0.00017497348886532342,
855
+ "loss": 0.2422,
856
+ "step": 5900
857
+ },
858
+ {
859
+ "epoch": 2.1032166843407563,
860
+ "grad_norm": 1.2947015762329102,
861
+ "learning_rate": 0.00017391304347826085,
862
+ "loss": 0.2333,
863
+ "step": 5950
864
+ },
865
+ {
866
+ "epoch": 2.1208907741251326,
867
+ "grad_norm": 1.0622906684875488,
868
+ "learning_rate": 0.0001728525980911983,
869
+ "loss": 0.2029,
870
+ "step": 6000
871
+ },
872
+ {
873
+ "epoch": 2.1385648639095085,
874
+ "grad_norm": 0.8785162568092346,
875
+ "learning_rate": 0.00017179215270413572,
876
+ "loss": 0.2039,
877
+ "step": 6050
878
+ },
879
+ {
880
+ "epoch": 2.156238953693885,
881
+ "grad_norm": 0.3702610433101654,
882
+ "learning_rate": 0.00017073170731707316,
883
+ "loss": 0.2631,
884
+ "step": 6100
885
+ },
886
+ {
887
+ "epoch": 2.1739130434782608,
888
+ "grad_norm": 1.0092154741287231,
889
+ "learning_rate": 0.0001696712619300106,
890
+ "loss": 0.2325,
891
+ "step": 6150
892
+ },
893
+ {
894
+ "epoch": 2.191587133262637,
895
+ "grad_norm": 1.648000955581665,
896
+ "learning_rate": 0.00016861081654294803,
897
+ "loss": 0.2501,
898
+ "step": 6200
899
+ },
900
+ {
901
+ "epoch": 2.209261223047013,
902
+ "grad_norm": 0.979069173336029,
903
+ "learning_rate": 0.00016755037115588544,
904
+ "loss": 0.256,
905
+ "step": 6250
906
+ },
907
+ {
908
+ "epoch": 2.2269353128313893,
909
+ "grad_norm": 1.459558129310608,
910
+ "learning_rate": 0.0001664899257688229,
911
+ "loss": 0.2603,
912
+ "step": 6300
913
+ },
914
+ {
915
+ "epoch": 2.2446094026157652,
916
+ "grad_norm": 1.5793472528457642,
917
+ "learning_rate": 0.0001654294803817603,
918
+ "loss": 0.2564,
919
+ "step": 6350
920
+ },
921
+ {
922
+ "epoch": 2.262283492400141,
923
+ "grad_norm": 1.1787140369415283,
924
+ "learning_rate": 0.00016436903499469777,
925
+ "loss": 0.2782,
926
+ "step": 6400
927
+ },
928
+ {
929
+ "epoch": 2.2799575821845175,
930
+ "grad_norm": 1.041374683380127,
931
+ "learning_rate": 0.00016330858960763518,
932
+ "loss": 0.2331,
933
+ "step": 6450
934
+ },
935
+ {
936
+ "epoch": 2.297631671968894,
937
+ "grad_norm": 0.7799555063247681,
938
+ "learning_rate": 0.00016224814422057264,
939
+ "loss": 0.2338,
940
+ "step": 6500
941
+ },
942
+ {
943
+ "epoch": 2.3153057617532697,
944
+ "grad_norm": 1.4405689239501953,
945
+ "learning_rate": 0.00016118769883351005,
946
+ "loss": 0.2737,
947
+ "step": 6550
948
+ },
949
+ {
950
+ "epoch": 2.3329798515376456,
951
+ "grad_norm": 0.979608416557312,
952
+ "learning_rate": 0.00016012725344644748,
953
+ "loss": 0.2495,
954
+ "step": 6600
955
+ },
956
+ {
957
+ "epoch": 2.350653941322022,
958
+ "grad_norm": 0.9300618171691895,
959
+ "learning_rate": 0.00015906680805938492,
960
+ "loss": 0.2157,
961
+ "step": 6650
962
+ },
963
+ {
964
+ "epoch": 2.368328031106398,
965
+ "grad_norm": 0.8745370507240295,
966
+ "learning_rate": 0.00015800636267232235,
967
+ "loss": 0.2837,
968
+ "step": 6700
969
+ },
970
+ {
971
+ "epoch": 2.3860021208907742,
972
+ "grad_norm": 0.9898168444633484,
973
+ "learning_rate": 0.00015694591728525982,
974
+ "loss": 0.221,
975
+ "step": 6750
976
+ },
977
+ {
978
+ "epoch": 2.40367621067515,
979
+ "grad_norm": 0.8933513760566711,
980
+ "learning_rate": 0.00015588547189819722,
981
+ "loss": 0.1994,
982
+ "step": 6800
983
+ },
984
+ {
985
+ "epoch": 2.4213503004595265,
986
+ "grad_norm": 1.7144904136657715,
987
+ "learning_rate": 0.0001548250265111347,
988
+ "loss": 0.2429,
989
+ "step": 6850
990
+ },
991
+ {
992
+ "epoch": 2.4390243902439024,
993
+ "grad_norm": 1.5800135135650635,
994
+ "learning_rate": 0.0001537645811240721,
995
+ "loss": 0.2284,
996
+ "step": 6900
997
+ },
998
+ {
999
+ "epoch": 2.4566984800282787,
1000
+ "grad_norm": 1.0567731857299805,
1001
+ "learning_rate": 0.0001527041357370095,
1002
+ "loss": 0.2028,
1003
+ "step": 6950
1004
+ },
1005
+ {
1006
+ "epoch": 2.4743725698126546,
1007
+ "grad_norm": 0.59196537733078,
1008
+ "learning_rate": 0.00015164369034994697,
1009
+ "loss": 0.228,
1010
+ "step": 7000
1011
+ },
1012
+ {
1013
+ "epoch": 2.4920466595970305,
1014
+ "grad_norm": 1.0257049798965454,
1015
+ "learning_rate": 0.00015058324496288437,
1016
+ "loss": 0.2196,
1017
+ "step": 7050
1018
+ },
1019
+ {
1020
+ "epoch": 2.509720749381407,
1021
+ "grad_norm": 1.500623345375061,
1022
+ "learning_rate": 0.00014952279957582184,
1023
+ "loss": 0.2351,
1024
+ "step": 7100
1025
+ },
1026
+ {
1027
+ "epoch": 2.5273948391657832,
1028
+ "grad_norm": 1.1046085357666016,
1029
+ "learning_rate": 0.00014846235418875927,
1030
+ "loss": 0.2595,
1031
+ "step": 7150
1032
+ },
1033
+ {
1034
+ "epoch": 2.545068928950159,
1035
+ "grad_norm": 1.2226991653442383,
1036
+ "learning_rate": 0.0001474019088016967,
1037
+ "loss": 0.1914,
1038
+ "step": 7200
1039
+ },
1040
+ {
1041
+ "epoch": 2.562743018734535,
1042
+ "grad_norm": 0.6742298007011414,
1043
+ "learning_rate": 0.00014634146341463414,
1044
+ "loss": 0.2096,
1045
+ "step": 7250
1046
+ },
1047
+ {
1048
+ "epoch": 2.5804171085189114,
1049
+ "grad_norm": 1.5504461526870728,
1050
+ "learning_rate": 0.00014528101802757158,
1051
+ "loss": 0.2051,
1052
+ "step": 7300
1053
+ },
1054
+ {
1055
+ "epoch": 2.5980911983032873,
1056
+ "grad_norm": 0.9681800603866577,
1057
+ "learning_rate": 0.000144220572640509,
1058
+ "loss": 0.2327,
1059
+ "step": 7350
1060
+ },
1061
+ {
1062
+ "epoch": 2.6157652880876636,
1063
+ "grad_norm": 0.9383839964866638,
1064
+ "learning_rate": 0.00014316012725344645,
1065
+ "loss": 0.2344,
1066
+ "step": 7400
1067
+ },
1068
+ {
1069
+ "epoch": 2.6334393778720395,
1070
+ "grad_norm": 0.6154807209968567,
1071
+ "learning_rate": 0.00014209968186638388,
1072
+ "loss": 0.2383,
1073
+ "step": 7450
1074
+ },
1075
+ {
1076
+ "epoch": 2.6511134676564154,
1077
+ "grad_norm": 1.2676986455917358,
1078
+ "learning_rate": 0.00014103923647932132,
1079
+ "loss": 0.2257,
1080
+ "step": 7500
1081
+ },
1082
+ {
1083
+ "epoch": 2.6687875574407918,
1084
+ "grad_norm": 1.183440089225769,
1085
+ "learning_rate": 0.00013997879109225872,
1086
+ "loss": 0.2102,
1087
+ "step": 7550
1088
+ },
1089
+ {
1090
+ "epoch": 2.686461647225168,
1091
+ "grad_norm": 0.7244306802749634,
1092
+ "learning_rate": 0.00013891834570519616,
1093
+ "loss": 0.2146,
1094
+ "step": 7600
1095
+ },
1096
+ {
1097
+ "epoch": 2.704135737009544,
1098
+ "grad_norm": 1.187232494354248,
1099
+ "learning_rate": 0.0001378579003181336,
1100
+ "loss": 0.2119,
1101
+ "step": 7650
1102
+ },
1103
+ {
1104
+ "epoch": 2.72180982679392,
1105
+ "grad_norm": 1.4510794878005981,
1106
+ "learning_rate": 0.00013679745493107103,
1107
+ "loss": 0.1916,
1108
+ "step": 7700
1109
+ },
1110
+ {
1111
+ "epoch": 2.7394839165782963,
1112
+ "grad_norm": 1.383832335472107,
1113
+ "learning_rate": 0.00013573700954400847,
1114
+ "loss": 0.2179,
1115
+ "step": 7750
1116
+ },
1117
+ {
1118
+ "epoch": 2.757158006362672,
1119
+ "grad_norm": 0.9274504780769348,
1120
+ "learning_rate": 0.0001346765641569459,
1121
+ "loss": 0.199,
1122
+ "step": 7800
1123
+ },
1124
+ {
1125
+ "epoch": 2.7748320961470485,
1126
+ "grad_norm": 2.6429216861724854,
1127
+ "learning_rate": 0.00013361611876988334,
1128
+ "loss": 0.2407,
1129
+ "step": 7850
1130
+ },
1131
+ {
1132
+ "epoch": 2.7925061859314244,
1133
+ "grad_norm": 1.3947652578353882,
1134
+ "learning_rate": 0.00013255567338282077,
1135
+ "loss": 0.2019,
1136
+ "step": 7900
1137
+ },
1138
+ {
1139
+ "epoch": 2.8101802757158008,
1140
+ "grad_norm": 1.148478627204895,
1141
+ "learning_rate": 0.0001314952279957582,
1142
+ "loss": 0.205,
1143
+ "step": 7950
1144
+ },
1145
+ {
1146
+ "epoch": 2.8278543655001767,
1147
+ "grad_norm": 1.1087610721588135,
1148
+ "learning_rate": 0.00013043478260869564,
1149
+ "loss": 0.2527,
1150
+ "step": 8000
1151
+ },
1152
+ {
1153
+ "epoch": 2.845528455284553,
1154
+ "grad_norm": 1.4348084926605225,
1155
+ "learning_rate": 0.00012937433722163308,
1156
+ "loss": 0.2465,
1157
+ "step": 8050
1158
+ },
1159
+ {
1160
+ "epoch": 2.863202545068929,
1161
+ "grad_norm": 1.2600926160812378,
1162
+ "learning_rate": 0.0001283138918345705,
1163
+ "loss": 0.1699,
1164
+ "step": 8100
1165
+ },
1166
+ {
1167
+ "epoch": 2.880876634853305,
1168
+ "grad_norm": 0.8724793195724487,
1169
+ "learning_rate": 0.00012725344644750795,
1170
+ "loss": 0.2257,
1171
+ "step": 8150
1172
+ },
1173
+ {
1174
+ "epoch": 2.898550724637681,
1175
+ "grad_norm": 1.5324125289916992,
1176
+ "learning_rate": 0.00012619300106044538,
1177
+ "loss": 0.2002,
1178
+ "step": 8200
1179
+ },
1180
+ {
1181
+ "epoch": 2.9162248144220575,
1182
+ "grad_norm": 1.0066156387329102,
1183
+ "learning_rate": 0.00012513255567338282,
1184
+ "loss": 0.192,
1185
+ "step": 8250
1186
+ },
1187
+ {
1188
+ "epoch": 2.9338989042064334,
1189
+ "grad_norm": 0.4273667633533478,
1190
+ "learning_rate": 0.00012407211028632022,
1191
+ "loss": 0.1758,
1192
+ "step": 8300
1193
+ },
1194
+ {
1195
+ "epoch": 2.9515729939908093,
1196
+ "grad_norm": 0.6536590456962585,
1197
+ "learning_rate": 0.00012301166489925766,
1198
+ "loss": 0.1905,
1199
+ "step": 8350
1200
+ },
1201
+ {
1202
+ "epoch": 2.9692470837751856,
1203
+ "grad_norm": 0.6973742246627808,
1204
+ "learning_rate": 0.00012195121951219511,
1205
+ "loss": 0.2116,
1206
+ "step": 8400
1207
+ },
1208
+ {
1209
+ "epoch": 2.9869211735595615,
1210
+ "grad_norm": 0.9764792919158936,
1211
+ "learning_rate": 0.00012089077412513254,
1212
+ "loss": 0.2098,
1213
+ "step": 8450
1214
+ },
1215
+ {
1216
+ "epoch": 3.0,
1217
+ "eval_bertscore_f1": 0.9710737692450385,
1218
+ "eval_bleu": 0.6330045835354601,
1219
+ "eval_loss": 0.15814107656478882,
1220
+ "eval_runtime": 1020.076,
1221
+ "eval_samples_per_second": 6.337,
1222
+ "eval_steps_per_second": 0.792,
1223
+ "step": 8487
1224
+ },
1225
+ {
1226
+ "epoch": 3.004595263343938,
1227
+ "grad_norm": 1.2752796411514282,
1228
+ "learning_rate": 0.00011983032873806998,
1229
+ "loss": 0.1815,
1230
+ "step": 8500
1231
+ },
1232
+ {
1233
+ "epoch": 3.022269353128314,
1234
+ "grad_norm": 1.1779205799102783,
1235
+ "learning_rate": 0.00011876988335100741,
1236
+ "loss": 0.2125,
1237
+ "step": 8550
1238
+ },
1239
+ {
1240
+ "epoch": 3.03994344291269,
1241
+ "grad_norm": 0.7505296468734741,
1242
+ "learning_rate": 0.00011770943796394485,
1243
+ "loss": 0.1989,
1244
+ "step": 8600
1245
+ },
1246
+ {
1247
+ "epoch": 3.057617532697066,
1248
+ "grad_norm": 4.621654033660889,
1249
+ "learning_rate": 0.00011664899257688228,
1250
+ "loss": 0.2015,
1251
+ "step": 8650
1252
+ },
1253
+ {
1254
+ "epoch": 3.0752916224814424,
1255
+ "grad_norm": 0.8159476518630981,
1256
+ "learning_rate": 0.0001155885471898197,
1257
+ "loss": 0.1685,
1258
+ "step": 8700
1259
+ },
1260
+ {
1261
+ "epoch": 3.0929657122658183,
1262
+ "grad_norm": 1.5748199224472046,
1263
+ "learning_rate": 0.00011452810180275714,
1264
+ "loss": 0.1748,
1265
+ "step": 8750
1266
+ },
1267
+ {
1268
+ "epoch": 3.110639802050194,
1269
+ "grad_norm": 2.3961069583892822,
1270
+ "learning_rate": 0.00011346765641569458,
1271
+ "loss": 0.2439,
1272
+ "step": 8800
1273
+ },
1274
+ {
1275
+ "epoch": 3.1283138918345705,
1276
+ "grad_norm": 1.1994341611862183,
1277
+ "learning_rate": 0.00011240721102863201,
1278
+ "loss": 0.1819,
1279
+ "step": 8850
1280
+ },
1281
+ {
1282
+ "epoch": 3.1459879816189464,
1283
+ "grad_norm": 1.4692330360412598,
1284
+ "learning_rate": 0.00011134676564156945,
1285
+ "loss": 0.1757,
1286
+ "step": 8900
1287
+ },
1288
+ {
1289
+ "epoch": 3.163662071403323,
1290
+ "grad_norm": 0.559505820274353,
1291
+ "learning_rate": 0.00011028632025450688,
1292
+ "loss": 0.1832,
1293
+ "step": 8950
1294
+ },
1295
+ {
1296
+ "epoch": 3.1813361611876987,
1297
+ "grad_norm": 0.608403205871582,
1298
+ "learning_rate": 0.00010922587486744433,
1299
+ "loss": 0.2094,
1300
+ "step": 9000
1301
+ },
1302
+ {
1303
+ "epoch": 3.199010250972075,
1304
+ "grad_norm": 0.9615042805671692,
1305
+ "learning_rate": 0.00010816542948038174,
1306
+ "loss": 0.1868,
1307
+ "step": 9050
1308
+ },
1309
+ {
1310
+ "epoch": 3.216684340756451,
1311
+ "grad_norm": 1.3172391653060913,
1312
+ "learning_rate": 0.00010710498409331917,
1313
+ "loss": 0.2161,
1314
+ "step": 9100
1315
+ },
1316
+ {
1317
+ "epoch": 3.2343584305408273,
1318
+ "grad_norm": 1.120377779006958,
1319
+ "learning_rate": 0.00010604453870625662,
1320
+ "loss": 0.1621,
1321
+ "step": 9150
1322
+ },
1323
+ {
1324
+ "epoch": 3.252032520325203,
1325
+ "grad_norm": 1.7331315279006958,
1326
+ "learning_rate": 0.00010498409331919406,
1327
+ "loss": 0.2172,
1328
+ "step": 9200
1329
+ },
1330
+ {
1331
+ "epoch": 3.2697066101095795,
1332
+ "grad_norm": 1.0575073957443237,
1333
+ "learning_rate": 0.00010392364793213149,
1334
+ "loss": 0.2013,
1335
+ "step": 9250
1336
+ },
1337
+ {
1338
+ "epoch": 3.2873806998939554,
1339
+ "grad_norm": 0.9054147601127625,
1340
+ "learning_rate": 0.00010286320254506893,
1341
+ "loss": 0.1648,
1342
+ "step": 9300
1343
+ },
1344
+ {
1345
+ "epoch": 3.3050547896783318,
1346
+ "grad_norm": 1.450341820716858,
1347
+ "learning_rate": 0.00010180275715800636,
1348
+ "loss": 0.1753,
1349
+ "step": 9350
1350
+ },
1351
+ {
1352
+ "epoch": 3.3227288794627077,
1353
+ "grad_norm": 1.1002529859542847,
1354
+ "learning_rate": 0.0001007423117709438,
1355
+ "loss": 0.1863,
1356
+ "step": 9400
1357
+ },
1358
+ {
1359
+ "epoch": 3.3404029692470836,
1360
+ "grad_norm": 0.9334053993225098,
1361
+ "learning_rate": 9.968186638388122e-05,
1362
+ "loss": 0.1702,
1363
+ "step": 9450
1364
+ },
1365
+ {
1366
+ "epoch": 3.35807705903146,
1367
+ "grad_norm": 0.8281420469284058,
1368
+ "learning_rate": 9.862142099681865e-05,
1369
+ "loss": 0.2526,
1370
+ "step": 9500
1371
+ },
1372
+ {
1373
+ "epoch": 3.375751148815836,
1374
+ "grad_norm": 1.2539646625518799,
1375
+ "learning_rate": 9.756097560975609e-05,
1376
+ "loss": 0.1894,
1377
+ "step": 9550
1378
+ },
1379
+ {
1380
+ "epoch": 3.393425238600212,
1381
+ "grad_norm": 0.949944794178009,
1382
+ "learning_rate": 9.650053022269352e-05,
1383
+ "loss": 0.1936,
1384
+ "step": 9600
1385
+ },
1386
+ {
1387
+ "epoch": 3.411099328384588,
1388
+ "grad_norm": 1.2891144752502441,
1389
+ "learning_rate": 9.544008483563096e-05,
1390
+ "loss": 0.1865,
1391
+ "step": 9650
1392
+ },
1393
+ {
1394
+ "epoch": 3.4287734181689644,
1395
+ "grad_norm": 0.5977984070777893,
1396
+ "learning_rate": 9.43796394485684e-05,
1397
+ "loss": 0.1484,
1398
+ "step": 9700
1399
+ },
1400
+ {
1401
+ "epoch": 3.4464475079533403,
1402
+ "grad_norm": 0.3996190130710602,
1403
+ "learning_rate": 9.331919406150583e-05,
1404
+ "loss": 0.2573,
1405
+ "step": 9750
1406
+ },
1407
+ {
1408
+ "epoch": 3.4641215977377167,
1409
+ "grad_norm": 1.8965319395065308,
1410
+ "learning_rate": 9.225874867444325e-05,
1411
+ "loss": 0.195,
1412
+ "step": 9800
1413
+ },
1414
+ {
1415
+ "epoch": 3.4817956875220926,
1416
+ "grad_norm": 1.197365403175354,
1417
+ "learning_rate": 9.119830328738069e-05,
1418
+ "loss": 0.2083,
1419
+ "step": 9850
1420
+ },
1421
+ {
1422
+ "epoch": 3.499469777306469,
1423
+ "grad_norm": 0.6886301040649414,
1424
+ "learning_rate": 9.013785790031812e-05,
1425
+ "loss": 0.2112,
1426
+ "step": 9900
1427
+ },
1428
+ {
1429
+ "epoch": 3.517143867090845,
1430
+ "grad_norm": 0.677227795124054,
1431
+ "learning_rate": 8.907741251325556e-05,
1432
+ "loss": 0.1789,
1433
+ "step": 9950
1434
+ },
1435
+ {
1436
+ "epoch": 3.534817956875221,
1437
+ "grad_norm": 1.131480097770691,
1438
+ "learning_rate": 8.801696712619299e-05,
1439
+ "loss": 0.1857,
1440
+ "step": 10000
1441
+ },
1442
+ {
1443
+ "epoch": 3.552492046659597,
1444
+ "grad_norm": 1.6898012161254883,
1445
+ "learning_rate": 8.695652173913043e-05,
1446
+ "loss": 0.197,
1447
+ "step": 10050
1448
+ },
1449
+ {
1450
+ "epoch": 3.570166136443973,
1451
+ "grad_norm": 1.6000021696090698,
1452
+ "learning_rate": 8.589607635206786e-05,
1453
+ "loss": 0.2028,
1454
+ "step": 10100
1455
+ },
1456
+ {
1457
+ "epoch": 3.5878402262283493,
1458
+ "grad_norm": 0.59913170337677,
1459
+ "learning_rate": 8.48356309650053e-05,
1460
+ "loss": 0.2056,
1461
+ "step": 10150
1462
+ },
1463
+ {
1464
+ "epoch": 3.605514316012725,
1465
+ "grad_norm": 1.2439507246017456,
1466
+ "learning_rate": 8.377518557794272e-05,
1467
+ "loss": 0.264,
1468
+ "step": 10200
1469
+ },
1470
+ {
1471
+ "epoch": 3.6231884057971016,
1472
+ "grad_norm": 1.2470340728759766,
1473
+ "learning_rate": 8.271474019088015e-05,
1474
+ "loss": 0.1818,
1475
+ "step": 10250
1476
+ },
1477
+ {
1478
+ "epoch": 3.6408624955814775,
1479
+ "grad_norm": 0.8461691737174988,
1480
+ "learning_rate": 8.165429480381759e-05,
1481
+ "loss": 0.1893,
1482
+ "step": 10300
1483
+ },
1484
+ {
1485
+ "epoch": 3.658536585365854,
1486
+ "grad_norm": 1.161589503288269,
1487
+ "learning_rate": 8.059384941675502e-05,
1488
+ "loss": 0.183,
1489
+ "step": 10350
1490
+ },
1491
+ {
1492
+ "epoch": 3.6762106751502297,
1493
+ "grad_norm": 1.1066420078277588,
1494
+ "learning_rate": 7.953340402969246e-05,
1495
+ "loss": 0.2059,
1496
+ "step": 10400
1497
+ },
1498
+ {
1499
+ "epoch": 3.693884764934606,
1500
+ "grad_norm": 0.04225541278719902,
1501
+ "learning_rate": 7.847295864262991e-05,
1502
+ "loss": 0.1579,
1503
+ "step": 10450
1504
+ },
1505
+ {
1506
+ "epoch": 3.711558854718982,
1507
+ "grad_norm": 2.536710500717163,
1508
+ "learning_rate": 7.741251325556734e-05,
1509
+ "loss": 0.2092,
1510
+ "step": 10500
1511
+ },
1512
+ {
1513
+ "epoch": 3.729232944503358,
1514
+ "grad_norm": 0.49366581439971924,
1515
+ "learning_rate": 7.635206786850475e-05,
1516
+ "loss": 0.2148,
1517
+ "step": 10550
1518
+ },
1519
+ {
1520
+ "epoch": 3.746907034287734,
1521
+ "grad_norm": 0.5715583562850952,
1522
+ "learning_rate": 7.529162248144219e-05,
1523
+ "loss": 0.1697,
1524
+ "step": 10600
1525
+ },
1526
+ {
1527
+ "epoch": 3.7645811240721105,
1528
+ "grad_norm": 0.6103105545043945,
1529
+ "learning_rate": 7.423117709437964e-05,
1530
+ "loss": 0.1631,
1531
+ "step": 10650
1532
+ },
1533
+ {
1534
+ "epoch": 3.7822552138564864,
1535
+ "grad_norm": 0.6263866424560547,
1536
+ "learning_rate": 7.317073170731707e-05,
1537
+ "loss": 0.211,
1538
+ "step": 10700
1539
+ },
1540
+ {
1541
+ "epoch": 3.7999293036408623,
1542
+ "grad_norm": 2.3304359912872314,
1543
+ "learning_rate": 7.21102863202545e-05,
1544
+ "loss": 0.2101,
1545
+ "step": 10750
1546
+ },
1547
+ {
1548
+ "epoch": 3.8176033934252387,
1549
+ "grad_norm": 0.96124666929245,
1550
+ "learning_rate": 7.104984093319194e-05,
1551
+ "loss": 0.2033,
1552
+ "step": 10800
1553
+ },
1554
+ {
1555
+ "epoch": 3.8352774832096146,
1556
+ "grad_norm": 0.8838850855827332,
1557
+ "learning_rate": 6.998939554612936e-05,
1558
+ "loss": 0.1686,
1559
+ "step": 10850
1560
+ },
1561
+ {
1562
+ "epoch": 3.852951572993991,
1563
+ "grad_norm": 0.40561985969543457,
1564
+ "learning_rate": 6.89289501590668e-05,
1565
+ "loss": 0.1584,
1566
+ "step": 10900
1567
+ },
1568
+ {
1569
+ "epoch": 3.870625662778367,
1570
+ "grad_norm": 0.1844971626996994,
1571
+ "learning_rate": 6.788971367974548e-05,
1572
+ "loss": 0.1804,
1573
+ "step": 10950
1574
+ },
1575
+ {
1576
+ "epoch": 3.888299752562743,
1577
+ "grad_norm": 0.16500629484653473,
1578
+ "learning_rate": 6.682926829268293e-05,
1579
+ "loss": 0.1573,
1580
+ "step": 11000
1581
+ },
1582
+ {
1583
+ "epoch": 3.905973842347119,
1584
+ "grad_norm": 1.1422902345657349,
1585
+ "learning_rate": 6.576882290562035e-05,
1586
+ "loss": 0.168,
1587
+ "step": 11050
1588
+ },
1589
+ {
1590
+ "epoch": 3.9236479321314954,
1591
+ "grad_norm": 1.0575031042099,
1592
+ "learning_rate": 6.470837751855779e-05,
1593
+ "loss": 0.1839,
1594
+ "step": 11100
1595
+ },
1596
+ {
1597
+ "epoch": 3.9413220219158713,
1598
+ "grad_norm": 1.222320318222046,
1599
+ "learning_rate": 6.364793213149522e-05,
1600
+ "loss": 0.184,
1601
+ "step": 11150
1602
+ },
1603
+ {
1604
+ "epoch": 3.9589961117002472,
1605
+ "grad_norm": 1.2237067222595215,
1606
+ "learning_rate": 6.258748674443266e-05,
1607
+ "loss": 0.1593,
1608
+ "step": 11200
1609
+ },
1610
+ {
1611
+ "epoch": 3.9766702014846236,
1612
+ "grad_norm": 0.5730044841766357,
1613
+ "learning_rate": 6.152704135737009e-05,
1614
+ "loss": 0.1952,
1615
+ "step": 11250
1616
+ },
1617
+ {
1618
+ "epoch": 3.9943442912689995,
1619
+ "grad_norm": 1.0718284845352173,
1620
+ "learning_rate": 6.046659597030752e-05,
1621
+ "loss": 0.2006,
1622
+ "step": 11300
1623
+ },
1624
+ {
1625
+ "epoch": 4.0,
1626
+ "eval_bertscore_f1": 0.971733581422284,
1627
+ "eval_bleu": 0.6349849586545804,
1628
+ "eval_loss": 0.14258554577827454,
1629
+ "eval_runtime": 1019.3837,
1630
+ "eval_samples_per_second": 6.341,
1631
+ "eval_steps_per_second": 0.793,
1632
+ "step": 11316
1633
+ }
1634
+ ],
1635
+ "logging_steps": 50,
1636
+ "max_steps": 14145,
1637
+ "num_input_tokens_seen": 0,
1638
+ "num_train_epochs": 5,
1639
+ "save_steps": 500,
1640
+ "stateful_callbacks": {
1641
+ "TrainerControl": {
1642
+ "args": {
1643
+ "should_epoch_stop": false,
1644
+ "should_evaluate": false,
1645
+ "should_log": false,
1646
+ "should_save": true,
1647
+ "should_training_stop": false
1648
+ },
1649
+ "attributes": {}
1650
+ }
1651
+ },
1652
+ "total_flos": 1.3840388316463104e+16,
1653
+ "train_batch_size": 8,
1654
+ "trial_name": null,
1655
+ "trial_params": null
1656
+ }
checkpoint-11316/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ee513a34fdce19a0629cc9aa4ea661dbd2cb881304d77bffec8f2b929d97943
3
+ size 5432
checkpoint-11316/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-14145/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Salesforce/codet5-base
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.15.2
checkpoint-14145/adapter_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Salesforce/codet5-base",
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": true,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 16,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0.1,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "r": 8,
24
+ "rank_pattern": {},
25
+ "revision": null,
26
+ "target_modules": [
27
+ "q",
28
+ "v"
29
+ ],
30
+ "task_type": "SEQ_2_SEQ_LM",
31
+ "trainable_token_indices": null,
32
+ "use_dora": false,
33
+ "use_rslora": false
34
+ }
checkpoint-14145/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc6a6711d2467cf8cc0d624e48bbe0ad9250fa2646d0816d7c83796afe2c35d7
3
+ size 3558888
checkpoint-14145/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-14145/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53ddcb136257f96c53597b9ba32ee00c9c8be3408fecbfc3a03475b4df41d500
3
+ size 7198906
checkpoint-14145/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3478c29fdb2a6f4393d8af319b0ba5ff02838fe330b8c9faf6e6c9ec4ba3220
3
+ size 14244
checkpoint-14145/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f5b751b47b6cccbdd2c32abdde3d32c796c18aaf5c957da0ab861aefc469561
3
+ size 988
checkpoint-14145/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb9c7879fbb6caacd2e719a636a3b1cb107ccb95a6e44e69d0bbc3b31d131786
3
+ size 1064
checkpoint-14145/special_tokens_map.json ADDED
@@ -0,0 +1,753 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ {
4
+ "content": "<extra_id_99>",
5
+ "lstrip": true,
6
+ "normalized": true,
7
+ "rstrip": false,
8
+ "single_word": false
9
+ },
10
+ {
11
+ "content": "<extra_id_98>",
12
+ "lstrip": true,
13
+ "normalized": true,
14
+ "rstrip": false,
15
+ "single_word": false
16
+ },
17
+ {
18
+ "content": "<extra_id_97>",
19
+ "lstrip": true,
20
+ "normalized": true,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ {
25
+ "content": "<extra_id_96>",
26
+ "lstrip": true,
27
+ "normalized": true,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ },
31
+ {
32
+ "content": "<extra_id_95>",
33
+ "lstrip": true,
34
+ "normalized": true,
35
+ "rstrip": false,
36
+ "single_word": false
37
+ },
38
+ {
39
+ "content": "<extra_id_94>",
40
+ "lstrip": true,
41
+ "normalized": true,
42
+ "rstrip": false,
43
+ "single_word": false
44
+ },
45
+ {
46
+ "content": "<extra_id_93>",
47
+ "lstrip": true,
48
+ "normalized": true,
49
+ "rstrip": false,
50
+ "single_word": false
51
+ },
52
+ {
53
+ "content": "<extra_id_92>",
54
+ "lstrip": true,
55
+ "normalized": true,
56
+ "rstrip": false,
57
+ "single_word": false
58
+ },
59
+ {
60
+ "content": "<extra_id_91>",
61
+ "lstrip": true,
62
+ "normalized": true,
63
+ "rstrip": false,
64
+ "single_word": false
65
+ },
66
+ {
67
+ "content": "<extra_id_90>",
68
+ "lstrip": true,
69
+ "normalized": true,
70
+ "rstrip": false,
71
+ "single_word": false
72
+ },
73
+ {
74
+ "content": "<extra_id_89>",
75
+ "lstrip": true,
76
+ "normalized": true,
77
+ "rstrip": false,
78
+ "single_word": false
79
+ },
80
+ {
81
+ "content": "<extra_id_88>",
82
+ "lstrip": true,
83
+ "normalized": true,
84
+ "rstrip": false,
85
+ "single_word": false
86
+ },
87
+ {
88
+ "content": "<extra_id_87>",
89
+ "lstrip": true,
90
+ "normalized": true,
91
+ "rstrip": false,
92
+ "single_word": false
93
+ },
94
+ {
95
+ "content": "<extra_id_86>",
96
+ "lstrip": true,
97
+ "normalized": true,
98
+ "rstrip": false,
99
+ "single_word": false
100
+ },
101
+ {
102
+ "content": "<extra_id_85>",
103
+ "lstrip": true,
104
+ "normalized": true,
105
+ "rstrip": false,
106
+ "single_word": false
107
+ },
108
+ {
109
+ "content": "<extra_id_84>",
110
+ "lstrip": true,
111
+ "normalized": true,
112
+ "rstrip": false,
113
+ "single_word": false
114
+ },
115
+ {
116
+ "content": "<extra_id_83>",
117
+ "lstrip": true,
118
+ "normalized": true,
119
+ "rstrip": false,
120
+ "single_word": false
121
+ },
122
+ {
123
+ "content": "<extra_id_82>",
124
+ "lstrip": true,
125
+ "normalized": true,
126
+ "rstrip": false,
127
+ "single_word": false
128
+ },
129
+ {
130
+ "content": "<extra_id_81>",
131
+ "lstrip": true,
132
+ "normalized": true,
133
+ "rstrip": false,
134
+ "single_word": false
135
+ },
136
+ {
137
+ "content": "<extra_id_80>",
138
+ "lstrip": true,
139
+ "normalized": true,
140
+ "rstrip": false,
141
+ "single_word": false
142
+ },
143
+ {
144
+ "content": "<extra_id_79>",
145
+ "lstrip": true,
146
+ "normalized": true,
147
+ "rstrip": false,
148
+ "single_word": false
149
+ },
150
+ {
151
+ "content": "<extra_id_78>",
152
+ "lstrip": true,
153
+ "normalized": true,
154
+ "rstrip": false,
155
+ "single_word": false
156
+ },
157
+ {
158
+ "content": "<extra_id_77>",
159
+ "lstrip": true,
160
+ "normalized": true,
161
+ "rstrip": false,
162
+ "single_word": false
163
+ },
164
+ {
165
+ "content": "<extra_id_76>",
166
+ "lstrip": true,
167
+ "normalized": true,
168
+ "rstrip": false,
169
+ "single_word": false
170
+ },
171
+ {
172
+ "content": "<extra_id_75>",
173
+ "lstrip": true,
174
+ "normalized": true,
175
+ "rstrip": false,
176
+ "single_word": false
177
+ },
178
+ {
179
+ "content": "<extra_id_74>",
180
+ "lstrip": true,
181
+ "normalized": true,
182
+ "rstrip": false,
183
+ "single_word": false
184
+ },
185
+ {
186
+ "content": "<extra_id_73>",
187
+ "lstrip": true,
188
+ "normalized": true,
189
+ "rstrip": false,
190
+ "single_word": false
191
+ },
192
+ {
193
+ "content": "<extra_id_72>",
194
+ "lstrip": true,
195
+ "normalized": true,
196
+ "rstrip": false,
197
+ "single_word": false
198
+ },
199
+ {
200
+ "content": "<extra_id_71>",
201
+ "lstrip": true,
202
+ "normalized": true,
203
+ "rstrip": false,
204
+ "single_word": false
205
+ },
206
+ {
207
+ "content": "<extra_id_70>",
208
+ "lstrip": true,
209
+ "normalized": true,
210
+ "rstrip": false,
211
+ "single_word": false
212
+ },
213
+ {
214
+ "content": "<extra_id_69>",
215
+ "lstrip": true,
216
+ "normalized": true,
217
+ "rstrip": false,
218
+ "single_word": false
219
+ },
220
+ {
221
+ "content": "<extra_id_68>",
222
+ "lstrip": true,
223
+ "normalized": true,
224
+ "rstrip": false,
225
+ "single_word": false
226
+ },
227
+ {
228
+ "content": "<extra_id_67>",
229
+ "lstrip": true,
230
+ "normalized": true,
231
+ "rstrip": false,
232
+ "single_word": false
233
+ },
234
+ {
235
+ "content": "<extra_id_66>",
236
+ "lstrip": true,
237
+ "normalized": true,
238
+ "rstrip": false,
239
+ "single_word": false
240
+ },
241
+ {
242
+ "content": "<extra_id_65>",
243
+ "lstrip": true,
244
+ "normalized": true,
245
+ "rstrip": false,
246
+ "single_word": false
247
+ },
248
+ {
249
+ "content": "<extra_id_64>",
250
+ "lstrip": true,
251
+ "normalized": true,
252
+ "rstrip": false,
253
+ "single_word": false
254
+ },
255
+ {
256
+ "content": "<extra_id_63>",
257
+ "lstrip": true,
258
+ "normalized": true,
259
+ "rstrip": false,
260
+ "single_word": false
261
+ },
262
+ {
263
+ "content": "<extra_id_62>",
264
+ "lstrip": true,
265
+ "normalized": true,
266
+ "rstrip": false,
267
+ "single_word": false
268
+ },
269
+ {
270
+ "content": "<extra_id_61>",
271
+ "lstrip": true,
272
+ "normalized": true,
273
+ "rstrip": false,
274
+ "single_word": false
275
+ },
276
+ {
277
+ "content": "<extra_id_60>",
278
+ "lstrip": true,
279
+ "normalized": true,
280
+ "rstrip": false,
281
+ "single_word": false
282
+ },
283
+ {
284
+ "content": "<extra_id_59>",
285
+ "lstrip": true,
286
+ "normalized": true,
287
+ "rstrip": false,
288
+ "single_word": false
289
+ },
290
+ {
291
+ "content": "<extra_id_58>",
292
+ "lstrip": true,
293
+ "normalized": true,
294
+ "rstrip": false,
295
+ "single_word": false
296
+ },
297
+ {
298
+ "content": "<extra_id_57>",
299
+ "lstrip": true,
300
+ "normalized": true,
301
+ "rstrip": false,
302
+ "single_word": false
303
+ },
304
+ {
305
+ "content": "<extra_id_56>",
306
+ "lstrip": true,
307
+ "normalized": true,
308
+ "rstrip": false,
309
+ "single_word": false
310
+ },
311
+ {
312
+ "content": "<extra_id_55>",
313
+ "lstrip": true,
314
+ "normalized": true,
315
+ "rstrip": false,
316
+ "single_word": false
317
+ },
318
+ {
319
+ "content": "<extra_id_54>",
320
+ "lstrip": true,
321
+ "normalized": true,
322
+ "rstrip": false,
323
+ "single_word": false
324
+ },
325
+ {
326
+ "content": "<extra_id_53>",
327
+ "lstrip": true,
328
+ "normalized": true,
329
+ "rstrip": false,
330
+ "single_word": false
331
+ },
332
+ {
333
+ "content": "<extra_id_52>",
334
+ "lstrip": true,
335
+ "normalized": true,
336
+ "rstrip": false,
337
+ "single_word": false
338
+ },
339
+ {
340
+ "content": "<extra_id_51>",
341
+ "lstrip": true,
342
+ "normalized": true,
343
+ "rstrip": false,
344
+ "single_word": false
345
+ },
346
+ {
347
+ "content": "<extra_id_50>",
348
+ "lstrip": true,
349
+ "normalized": true,
350
+ "rstrip": false,
351
+ "single_word": false
352
+ },
353
+ {
354
+ "content": "<extra_id_49>",
355
+ "lstrip": true,
356
+ "normalized": true,
357
+ "rstrip": false,
358
+ "single_word": false
359
+ },
360
+ {
361
+ "content": "<extra_id_48>",
362
+ "lstrip": true,
363
+ "normalized": true,
364
+ "rstrip": false,
365
+ "single_word": false
366
+ },
367
+ {
368
+ "content": "<extra_id_47>",
369
+ "lstrip": true,
370
+ "normalized": true,
371
+ "rstrip": false,
372
+ "single_word": false
373
+ },
374
+ {
375
+ "content": "<extra_id_46>",
376
+ "lstrip": true,
377
+ "normalized": true,
378
+ "rstrip": false,
379
+ "single_word": false
380
+ },
381
+ {
382
+ "content": "<extra_id_45>",
383
+ "lstrip": true,
384
+ "normalized": true,
385
+ "rstrip": false,
386
+ "single_word": false
387
+ },
388
+ {
389
+ "content": "<extra_id_44>",
390
+ "lstrip": true,
391
+ "normalized": true,
392
+ "rstrip": false,
393
+ "single_word": false
394
+ },
395
+ {
396
+ "content": "<extra_id_43>",
397
+ "lstrip": true,
398
+ "normalized": true,
399
+ "rstrip": false,
400
+ "single_word": false
401
+ },
402
+ {
403
+ "content": "<extra_id_42>",
404
+ "lstrip": true,
405
+ "normalized": true,
406
+ "rstrip": false,
407
+ "single_word": false
408
+ },
409
+ {
410
+ "content": "<extra_id_41>",
411
+ "lstrip": true,
412
+ "normalized": true,
413
+ "rstrip": false,
414
+ "single_word": false
415
+ },
416
+ {
417
+ "content": "<extra_id_40>",
418
+ "lstrip": true,
419
+ "normalized": true,
420
+ "rstrip": false,
421
+ "single_word": false
422
+ },
423
+ {
424
+ "content": "<extra_id_39>",
425
+ "lstrip": true,
426
+ "normalized": true,
427
+ "rstrip": false,
428
+ "single_word": false
429
+ },
430
+ {
431
+ "content": "<extra_id_38>",
432
+ "lstrip": true,
433
+ "normalized": true,
434
+ "rstrip": false,
435
+ "single_word": false
436
+ },
437
+ {
438
+ "content": "<extra_id_37>",
439
+ "lstrip": true,
440
+ "normalized": true,
441
+ "rstrip": false,
442
+ "single_word": false
443
+ },
444
+ {
445
+ "content": "<extra_id_36>",
446
+ "lstrip": true,
447
+ "normalized": true,
448
+ "rstrip": false,
449
+ "single_word": false
450
+ },
451
+ {
452
+ "content": "<extra_id_35>",
453
+ "lstrip": true,
454
+ "normalized": true,
455
+ "rstrip": false,
456
+ "single_word": false
457
+ },
458
+ {
459
+ "content": "<extra_id_34>",
460
+ "lstrip": true,
461
+ "normalized": true,
462
+ "rstrip": false,
463
+ "single_word": false
464
+ },
465
+ {
466
+ "content": "<extra_id_33>",
467
+ "lstrip": true,
468
+ "normalized": true,
469
+ "rstrip": false,
470
+ "single_word": false
471
+ },
472
+ {
473
+ "content": "<extra_id_32>",
474
+ "lstrip": true,
475
+ "normalized": true,
476
+ "rstrip": false,
477
+ "single_word": false
478
+ },
479
+ {
480
+ "content": "<extra_id_31>",
481
+ "lstrip": true,
482
+ "normalized": true,
483
+ "rstrip": false,
484
+ "single_word": false
485
+ },
486
+ {
487
+ "content": "<extra_id_30>",
488
+ "lstrip": true,
489
+ "normalized": true,
490
+ "rstrip": false,
491
+ "single_word": false
492
+ },
493
+ {
494
+ "content": "<extra_id_29>",
495
+ "lstrip": true,
496
+ "normalized": true,
497
+ "rstrip": false,
498
+ "single_word": false
499
+ },
500
+ {
501
+ "content": "<extra_id_28>",
502
+ "lstrip": true,
503
+ "normalized": true,
504
+ "rstrip": false,
505
+ "single_word": false
506
+ },
507
+ {
508
+ "content": "<extra_id_27>",
509
+ "lstrip": true,
510
+ "normalized": true,
511
+ "rstrip": false,
512
+ "single_word": false
513
+ },
514
+ {
515
+ "content": "<extra_id_26>",
516
+ "lstrip": true,
517
+ "normalized": true,
518
+ "rstrip": false,
519
+ "single_word": false
520
+ },
521
+ {
522
+ "content": "<extra_id_25>",
523
+ "lstrip": true,
524
+ "normalized": true,
525
+ "rstrip": false,
526
+ "single_word": false
527
+ },
528
+ {
529
+ "content": "<extra_id_24>",
530
+ "lstrip": true,
531
+ "normalized": true,
532
+ "rstrip": false,
533
+ "single_word": false
534
+ },
535
+ {
536
+ "content": "<extra_id_23>",
537
+ "lstrip": true,
538
+ "normalized": true,
539
+ "rstrip": false,
540
+ "single_word": false
541
+ },
542
+ {
543
+ "content": "<extra_id_22>",
544
+ "lstrip": true,
545
+ "normalized": true,
546
+ "rstrip": false,
547
+ "single_word": false
548
+ },
549
+ {
550
+ "content": "<extra_id_21>",
551
+ "lstrip": true,
552
+ "normalized": true,
553
+ "rstrip": false,
554
+ "single_word": false
555
+ },
556
+ {
557
+ "content": "<extra_id_20>",
558
+ "lstrip": true,
559
+ "normalized": true,
560
+ "rstrip": false,
561
+ "single_word": false
562
+ },
563
+ {
564
+ "content": "<extra_id_19>",
565
+ "lstrip": true,
566
+ "normalized": true,
567
+ "rstrip": false,
568
+ "single_word": false
569
+ },
570
+ {
571
+ "content": "<extra_id_18>",
572
+ "lstrip": true,
573
+ "normalized": true,
574
+ "rstrip": false,
575
+ "single_word": false
576
+ },
577
+ {
578
+ "content": "<extra_id_17>",
579
+ "lstrip": true,
580
+ "normalized": true,
581
+ "rstrip": false,
582
+ "single_word": false
583
+ },
584
+ {
585
+ "content": "<extra_id_16>",
586
+ "lstrip": true,
587
+ "normalized": true,
588
+ "rstrip": false,
589
+ "single_word": false
590
+ },
591
+ {
592
+ "content": "<extra_id_15>",
593
+ "lstrip": true,
594
+ "normalized": true,
595
+ "rstrip": false,
596
+ "single_word": false
597
+ },
598
+ {
599
+ "content": "<extra_id_14>",
600
+ "lstrip": true,
601
+ "normalized": true,
602
+ "rstrip": false,
603
+ "single_word": false
604
+ },
605
+ {
606
+ "content": "<extra_id_13>",
607
+ "lstrip": true,
608
+ "normalized": true,
609
+ "rstrip": false,
610
+ "single_word": false
611
+ },
612
+ {
613
+ "content": "<extra_id_12>",
614
+ "lstrip": true,
615
+ "normalized": true,
616
+ "rstrip": false,
617
+ "single_word": false
618
+ },
619
+ {
620
+ "content": "<extra_id_11>",
621
+ "lstrip": true,
622
+ "normalized": true,
623
+ "rstrip": false,
624
+ "single_word": false
625
+ },
626
+ {
627
+ "content": "<extra_id_10>",
628
+ "lstrip": true,
629
+ "normalized": true,
630
+ "rstrip": false,
631
+ "single_word": false
632
+ },
633
+ {
634
+ "content": "<extra_id_9>",
635
+ "lstrip": true,
636
+ "normalized": true,
637
+ "rstrip": false,
638
+ "single_word": false
639
+ },
640
+ {
641
+ "content": "<extra_id_8>",
642
+ "lstrip": true,
643
+ "normalized": true,
644
+ "rstrip": false,
645
+ "single_word": false
646
+ },
647
+ {
648
+ "content": "<extra_id_7>",
649
+ "lstrip": true,
650
+ "normalized": true,
651
+ "rstrip": false,
652
+ "single_word": false
653
+ },
654
+ {
655
+ "content": "<extra_id_6>",
656
+ "lstrip": true,
657
+ "normalized": true,
658
+ "rstrip": false,
659
+ "single_word": false
660
+ },
661
+ {
662
+ "content": "<extra_id_5>",
663
+ "lstrip": true,
664
+ "normalized": true,
665
+ "rstrip": false,
666
+ "single_word": false
667
+ },
668
+ {
669
+ "content": "<extra_id_4>",
670
+ "lstrip": true,
671
+ "normalized": true,
672
+ "rstrip": false,
673
+ "single_word": false
674
+ },
675
+ {
676
+ "content": "<extra_id_3>",
677
+ "lstrip": true,
678
+ "normalized": true,
679
+ "rstrip": false,
680
+ "single_word": false
681
+ },
682
+ {
683
+ "content": "<extra_id_2>",
684
+ "lstrip": true,
685
+ "normalized": true,
686
+ "rstrip": false,
687
+ "single_word": false
688
+ },
689
+ {
690
+ "content": "<extra_id_1>",
691
+ "lstrip": true,
692
+ "normalized": true,
693
+ "rstrip": false,
694
+ "single_word": false
695
+ },
696
+ {
697
+ "content": "<extra_id_0>",
698
+ "lstrip": true,
699
+ "normalized": true,
700
+ "rstrip": false,
701
+ "single_word": false
702
+ }
703
+ ],
704
+ "bos_token": {
705
+ "content": "<s>",
706
+ "lstrip": false,
707
+ "normalized": true,
708
+ "rstrip": false,
709
+ "single_word": false
710
+ },
711
+ "cls_token": {
712
+ "content": "<s>",
713
+ "lstrip": false,
714
+ "normalized": true,
715
+ "rstrip": false,
716
+ "single_word": false
717
+ },
718
+ "eos_token": {
719
+ "content": "</s>",
720
+ "lstrip": false,
721
+ "normalized": true,
722
+ "rstrip": false,
723
+ "single_word": false
724
+ },
725
+ "mask_token": {
726
+ "content": "<mask>",
727
+ "lstrip": true,
728
+ "normalized": true,
729
+ "rstrip": false,
730
+ "single_word": false
731
+ },
732
+ "pad_token": {
733
+ "content": "<pad>",
734
+ "lstrip": false,
735
+ "normalized": true,
736
+ "rstrip": false,
737
+ "single_word": false
738
+ },
739
+ "sep_token": {
740
+ "content": "</s>",
741
+ "lstrip": false,
742
+ "normalized": true,
743
+ "rstrip": false,
744
+ "single_word": false
745
+ },
746
+ "unk_token": {
747
+ "content": "<unk>",
748
+ "lstrip": false,
749
+ "normalized": true,
750
+ "rstrip": false,
751
+ "single_word": false
752
+ }
753
+ }
checkpoint-14145/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-14145/tokenizer_config.json ADDED
@@ -0,0 +1,960 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<pad>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "<s>",
14
+ "lstrip": false,
15
+ "normalized": true,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "</s>",
22
+ "lstrip": false,
23
+ "normalized": true,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "3": {
29
+ "content": "<unk>",
30
+ "lstrip": false,
31
+ "normalized": true,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "4": {
37
+ "content": "<mask>",
38
+ "lstrip": true,
39
+ "normalized": true,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "32000": {
45
+ "content": "<extra_id_99>",
46
+ "lstrip": true,
47
+ "normalized": true,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "32001": {
53
+ "content": "<extra_id_98>",
54
+ "lstrip": true,
55
+ "normalized": true,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "32002": {
61
+ "content": "<extra_id_97>",
62
+ "lstrip": true,
63
+ "normalized": true,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "32003": {
69
+ "content": "<extra_id_96>",
70
+ "lstrip": true,
71
+ "normalized": true,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "32004": {
77
+ "content": "<extra_id_95>",
78
+ "lstrip": true,
79
+ "normalized": true,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "32005": {
85
+ "content": "<extra_id_94>",
86
+ "lstrip": true,
87
+ "normalized": true,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "32006": {
93
+ "content": "<extra_id_93>",
94
+ "lstrip": true,
95
+ "normalized": true,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "32007": {
101
+ "content": "<extra_id_92>",
102
+ "lstrip": true,
103
+ "normalized": true,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "32008": {
109
+ "content": "<extra_id_91>",
110
+ "lstrip": true,
111
+ "normalized": true,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "32009": {
117
+ "content": "<extra_id_90>",
118
+ "lstrip": true,
119
+ "normalized": true,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "32010": {
125
+ "content": "<extra_id_89>",
126
+ "lstrip": true,
127
+ "normalized": true,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "32011": {
133
+ "content": "<extra_id_88>",
134
+ "lstrip": true,
135
+ "normalized": true,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ },
140
+ "32012": {
141
+ "content": "<extra_id_87>",
142
+ "lstrip": true,
143
+ "normalized": true,
144
+ "rstrip": false,
145
+ "single_word": false,
146
+ "special": true
147
+ },
148
+ "32013": {
149
+ "content": "<extra_id_86>",
150
+ "lstrip": true,
151
+ "normalized": true,
152
+ "rstrip": false,
153
+ "single_word": false,
154
+ "special": true
155
+ },
156
+ "32014": {
157
+ "content": "<extra_id_85>",
158
+ "lstrip": true,
159
+ "normalized": true,
160
+ "rstrip": false,
161
+ "single_word": false,
162
+ "special": true
163
+ },
164
+ "32015": {
165
+ "content": "<extra_id_84>",
166
+ "lstrip": true,
167
+ "normalized": true,
168
+ "rstrip": false,
169
+ "single_word": false,
170
+ "special": true
171
+ },
172
+ "32016": {
173
+ "content": "<extra_id_83>",
174
+ "lstrip": true,
175
+ "normalized": true,
176
+ "rstrip": false,
177
+ "single_word": false,
178
+ "special": true
179
+ },
180
+ "32017": {
181
+ "content": "<extra_id_82>",
182
+ "lstrip": true,
183
+ "normalized": true,
184
+ "rstrip": false,
185
+ "single_word": false,
186
+ "special": true
187
+ },
188
+ "32018": {
189
+ "content": "<extra_id_81>",
190
+ "lstrip": true,
191
+ "normalized": true,
192
+ "rstrip": false,
193
+ "single_word": false,
194
+ "special": true
195
+ },
196
+ "32019": {
197
+ "content": "<extra_id_80>",
198
+ "lstrip": true,
199
+ "normalized": true,
200
+ "rstrip": false,
201
+ "single_word": false,
202
+ "special": true
203
+ },
204
+ "32020": {
205
+ "content": "<extra_id_79>",
206
+ "lstrip": true,
207
+ "normalized": true,
208
+ "rstrip": false,
209
+ "single_word": false,
210
+ "special": true
211
+ },
212
+ "32021": {
213
+ "content": "<extra_id_78>",
214
+ "lstrip": true,
215
+ "normalized": true,
216
+ "rstrip": false,
217
+ "single_word": false,
218
+ "special": true
219
+ },
220
+ "32022": {
221
+ "content": "<extra_id_77>",
222
+ "lstrip": true,
223
+ "normalized": true,
224
+ "rstrip": false,
225
+ "single_word": false,
226
+ "special": true
227
+ },
228
+ "32023": {
229
+ "content": "<extra_id_76>",
230
+ "lstrip": true,
231
+ "normalized": true,
232
+ "rstrip": false,
233
+ "single_word": false,
234
+ "special": true
235
+ },
236
+ "32024": {
237
+ "content": "<extra_id_75>",
238
+ "lstrip": true,
239
+ "normalized": true,
240
+ "rstrip": false,
241
+ "single_word": false,
242
+ "special": true
243
+ },
244
+ "32025": {
245
+ "content": "<extra_id_74>",
246
+ "lstrip": true,
247
+ "normalized": true,
248
+ "rstrip": false,
249
+ "single_word": false,
250
+ "special": true
251
+ },
252
+ "32026": {
253
+ "content": "<extra_id_73>",
254
+ "lstrip": true,
255
+ "normalized": true,
256
+ "rstrip": false,
257
+ "single_word": false,
258
+ "special": true
259
+ },
260
+ "32027": {
261
+ "content": "<extra_id_72>",
262
+ "lstrip": true,
263
+ "normalized": true,
264
+ "rstrip": false,
265
+ "single_word": false,
266
+ "special": true
267
+ },
268
+ "32028": {
269
+ "content": "<extra_id_71>",
270
+ "lstrip": true,
271
+ "normalized": true,
272
+ "rstrip": false,
273
+ "single_word": false,
274
+ "special": true
275
+ },
276
+ "32029": {
277
+ "content": "<extra_id_70>",
278
+ "lstrip": true,
279
+ "normalized": true,
280
+ "rstrip": false,
281
+ "single_word": false,
282
+ "special": true
283
+ },
284
+ "32030": {
285
+ "content": "<extra_id_69>",
286
+ "lstrip": true,
287
+ "normalized": true,
288
+ "rstrip": false,
289
+ "single_word": false,
290
+ "special": true
291
+ },
292
+ "32031": {
293
+ "content": "<extra_id_68>",
294
+ "lstrip": true,
295
+ "normalized": true,
296
+ "rstrip": false,
297
+ "single_word": false,
298
+ "special": true
299
+ },
300
+ "32032": {
301
+ "content": "<extra_id_67>",
302
+ "lstrip": true,
303
+ "normalized": true,
304
+ "rstrip": false,
305
+ "single_word": false,
306
+ "special": true
307
+ },
308
+ "32033": {
309
+ "content": "<extra_id_66>",
310
+ "lstrip": true,
311
+ "normalized": true,
312
+ "rstrip": false,
313
+ "single_word": false,
314
+ "special": true
315
+ },
316
+ "32034": {
317
+ "content": "<extra_id_65>",
318
+ "lstrip": true,
319
+ "normalized": true,
320
+ "rstrip": false,
321
+ "single_word": false,
322
+ "special": true
323
+ },
324
+ "32035": {
325
+ "content": "<extra_id_64>",
326
+ "lstrip": true,
327
+ "normalized": true,
328
+ "rstrip": false,
329
+ "single_word": false,
330
+ "special": true
331
+ },
332
+ "32036": {
333
+ "content": "<extra_id_63>",
334
+ "lstrip": true,
335
+ "normalized": true,
336
+ "rstrip": false,
337
+ "single_word": false,
338
+ "special": true
339
+ },
340
+ "32037": {
341
+ "content": "<extra_id_62>",
342
+ "lstrip": true,
343
+ "normalized": true,
344
+ "rstrip": false,
345
+ "single_word": false,
346
+ "special": true
347
+ },
348
+ "32038": {
349
+ "content": "<extra_id_61>",
350
+ "lstrip": true,
351
+ "normalized": true,
352
+ "rstrip": false,
353
+ "single_word": false,
354
+ "special": true
355
+ },
356
+ "32039": {
357
+ "content": "<extra_id_60>",
358
+ "lstrip": true,
359
+ "normalized": true,
360
+ "rstrip": false,
361
+ "single_word": false,
362
+ "special": true
363
+ },
364
+ "32040": {
365
+ "content": "<extra_id_59>",
366
+ "lstrip": true,
367
+ "normalized": true,
368
+ "rstrip": false,
369
+ "single_word": false,
370
+ "special": true
371
+ },
372
+ "32041": {
373
+ "content": "<extra_id_58>",
374
+ "lstrip": true,
375
+ "normalized": true,
376
+ "rstrip": false,
377
+ "single_word": false,
378
+ "special": true
379
+ },
380
+ "32042": {
381
+ "content": "<extra_id_57>",
382
+ "lstrip": true,
383
+ "normalized": true,
384
+ "rstrip": false,
385
+ "single_word": false,
386
+ "special": true
387
+ },
388
+ "32043": {
389
+ "content": "<extra_id_56>",
390
+ "lstrip": true,
391
+ "normalized": true,
392
+ "rstrip": false,
393
+ "single_word": false,
394
+ "special": true
395
+ },
396
+ "32044": {
397
+ "content": "<extra_id_55>",
398
+ "lstrip": true,
399
+ "normalized": true,
400
+ "rstrip": false,
401
+ "single_word": false,
402
+ "special": true
403
+ },
404
+ "32045": {
405
+ "content": "<extra_id_54>",
406
+ "lstrip": true,
407
+ "normalized": true,
408
+ "rstrip": false,
409
+ "single_word": false,
410
+ "special": true
411
+ },
412
+ "32046": {
413
+ "content": "<extra_id_53>",
414
+ "lstrip": true,
415
+ "normalized": true,
416
+ "rstrip": false,
417
+ "single_word": false,
418
+ "special": true
419
+ },
420
+ "32047": {
421
+ "content": "<extra_id_52>",
422
+ "lstrip": true,
423
+ "normalized": true,
424
+ "rstrip": false,
425
+ "single_word": false,
426
+ "special": true
427
+ },
428
+ "32048": {
429
+ "content": "<extra_id_51>",
430
+ "lstrip": true,
431
+ "normalized": true,
432
+ "rstrip": false,
433
+ "single_word": false,
434
+ "special": true
435
+ },
436
+ "32049": {
437
+ "content": "<extra_id_50>",
438
+ "lstrip": true,
439
+ "normalized": true,
440
+ "rstrip": false,
441
+ "single_word": false,
442
+ "special": true
443
+ },
444
+ "32050": {
445
+ "content": "<extra_id_49>",
446
+ "lstrip": true,
447
+ "normalized": true,
448
+ "rstrip": false,
449
+ "single_word": false,
450
+ "special": true
451
+ },
452
+ "32051": {
453
+ "content": "<extra_id_48>",
454
+ "lstrip": true,
455
+ "normalized": true,
456
+ "rstrip": false,
457
+ "single_word": false,
458
+ "special": true
459
+ },
460
+ "32052": {
461
+ "content": "<extra_id_47>",
462
+ "lstrip": true,
463
+ "normalized": true,
464
+ "rstrip": false,
465
+ "single_word": false,
466
+ "special": true
467
+ },
468
+ "32053": {
469
+ "content": "<extra_id_46>",
470
+ "lstrip": true,
471
+ "normalized": true,
472
+ "rstrip": false,
473
+ "single_word": false,
474
+ "special": true
475
+ },
476
+ "32054": {
477
+ "content": "<extra_id_45>",
478
+ "lstrip": true,
479
+ "normalized": true,
480
+ "rstrip": false,
481
+ "single_word": false,
482
+ "special": true
483
+ },
484
+ "32055": {
485
+ "content": "<extra_id_44>",
486
+ "lstrip": true,
487
+ "normalized": true,
488
+ "rstrip": false,
489
+ "single_word": false,
490
+ "special": true
491
+ },
492
+ "32056": {
493
+ "content": "<extra_id_43>",
494
+ "lstrip": true,
495
+ "normalized": true,
496
+ "rstrip": false,
497
+ "single_word": false,
498
+ "special": true
499
+ },
500
+ "32057": {
501
+ "content": "<extra_id_42>",
502
+ "lstrip": true,
503
+ "normalized": true,
504
+ "rstrip": false,
505
+ "single_word": false,
506
+ "special": true
507
+ },
508
+ "32058": {
509
+ "content": "<extra_id_41>",
510
+ "lstrip": true,
511
+ "normalized": true,
512
+ "rstrip": false,
513
+ "single_word": false,
514
+ "special": true
515
+ },
516
+ "32059": {
517
+ "content": "<extra_id_40>",
518
+ "lstrip": true,
519
+ "normalized": true,
520
+ "rstrip": false,
521
+ "single_word": false,
522
+ "special": true
523
+ },
524
+ "32060": {
525
+ "content": "<extra_id_39>",
526
+ "lstrip": true,
527
+ "normalized": true,
528
+ "rstrip": false,
529
+ "single_word": false,
530
+ "special": true
531
+ },
532
+ "32061": {
533
+ "content": "<extra_id_38>",
534
+ "lstrip": true,
535
+ "normalized": true,
536
+ "rstrip": false,
537
+ "single_word": false,
538
+ "special": true
539
+ },
540
+ "32062": {
541
+ "content": "<extra_id_37>",
542
+ "lstrip": true,
543
+ "normalized": true,
544
+ "rstrip": false,
545
+ "single_word": false,
546
+ "special": true
547
+ },
548
+ "32063": {
549
+ "content": "<extra_id_36>",
550
+ "lstrip": true,
551
+ "normalized": true,
552
+ "rstrip": false,
553
+ "single_word": false,
554
+ "special": true
555
+ },
556
+ "32064": {
557
+ "content": "<extra_id_35>",
558
+ "lstrip": true,
559
+ "normalized": true,
560
+ "rstrip": false,
561
+ "single_word": false,
562
+ "special": true
563
+ },
564
+ "32065": {
565
+ "content": "<extra_id_34>",
566
+ "lstrip": true,
567
+ "normalized": true,
568
+ "rstrip": false,
569
+ "single_word": false,
570
+ "special": true
571
+ },
572
+ "32066": {
573
+ "content": "<extra_id_33>",
574
+ "lstrip": true,
575
+ "normalized": true,
576
+ "rstrip": false,
577
+ "single_word": false,
578
+ "special": true
579
+ },
580
+ "32067": {
581
+ "content": "<extra_id_32>",
582
+ "lstrip": true,
583
+ "normalized": true,
584
+ "rstrip": false,
585
+ "single_word": false,
586
+ "special": true
587
+ },
588
+ "32068": {
589
+ "content": "<extra_id_31>",
590
+ "lstrip": true,
591
+ "normalized": true,
592
+ "rstrip": false,
593
+ "single_word": false,
594
+ "special": true
595
+ },
596
+ "32069": {
597
+ "content": "<extra_id_30>",
598
+ "lstrip": true,
599
+ "normalized": true,
600
+ "rstrip": false,
601
+ "single_word": false,
602
+ "special": true
603
+ },
604
+ "32070": {
605
+ "content": "<extra_id_29>",
606
+ "lstrip": true,
607
+ "normalized": true,
608
+ "rstrip": false,
609
+ "single_word": false,
610
+ "special": true
611
+ },
612
+ "32071": {
613
+ "content": "<extra_id_28>",
614
+ "lstrip": true,
615
+ "normalized": true,
616
+ "rstrip": false,
617
+ "single_word": false,
618
+ "special": true
619
+ },
620
+ "32072": {
621
+ "content": "<extra_id_27>",
622
+ "lstrip": true,
623
+ "normalized": true,
624
+ "rstrip": false,
625
+ "single_word": false,
626
+ "special": true
627
+ },
628
+ "32073": {
629
+ "content": "<extra_id_26>",
630
+ "lstrip": true,
631
+ "normalized": true,
632
+ "rstrip": false,
633
+ "single_word": false,
634
+ "special": true
635
+ },
636
+ "32074": {
637
+ "content": "<extra_id_25>",
638
+ "lstrip": true,
639
+ "normalized": true,
640
+ "rstrip": false,
641
+ "single_word": false,
642
+ "special": true
643
+ },
644
+ "32075": {
645
+ "content": "<extra_id_24>",
646
+ "lstrip": true,
647
+ "normalized": true,
648
+ "rstrip": false,
649
+ "single_word": false,
650
+ "special": true
651
+ },
652
+ "32076": {
653
+ "content": "<extra_id_23>",
654
+ "lstrip": true,
655
+ "normalized": true,
656
+ "rstrip": false,
657
+ "single_word": false,
658
+ "special": true
659
+ },
660
+ "32077": {
661
+ "content": "<extra_id_22>",
662
+ "lstrip": true,
663
+ "normalized": true,
664
+ "rstrip": false,
665
+ "single_word": false,
666
+ "special": true
667
+ },
668
+ "32078": {
669
+ "content": "<extra_id_21>",
670
+ "lstrip": true,
671
+ "normalized": true,
672
+ "rstrip": false,
673
+ "single_word": false,
674
+ "special": true
675
+ },
676
+ "32079": {
677
+ "content": "<extra_id_20>",
678
+ "lstrip": true,
679
+ "normalized": true,
680
+ "rstrip": false,
681
+ "single_word": false,
682
+ "special": true
683
+ },
684
+ "32080": {
685
+ "content": "<extra_id_19>",
686
+ "lstrip": true,
687
+ "normalized": true,
688
+ "rstrip": false,
689
+ "single_word": false,
690
+ "special": true
691
+ },
692
+ "32081": {
693
+ "content": "<extra_id_18>",
694
+ "lstrip": true,
695
+ "normalized": true,
696
+ "rstrip": false,
697
+ "single_word": false,
698
+ "special": true
699
+ },
700
+ "32082": {
701
+ "content": "<extra_id_17>",
702
+ "lstrip": true,
703
+ "normalized": true,
704
+ "rstrip": false,
705
+ "single_word": false,
706
+ "special": true
707
+ },
708
+ "32083": {
709
+ "content": "<extra_id_16>",
710
+ "lstrip": true,
711
+ "normalized": true,
712
+ "rstrip": false,
713
+ "single_word": false,
714
+ "special": true
715
+ },
716
+ "32084": {
717
+ "content": "<extra_id_15>",
718
+ "lstrip": true,
719
+ "normalized": true,
720
+ "rstrip": false,
721
+ "single_word": false,
722
+ "special": true
723
+ },
724
+ "32085": {
725
+ "content": "<extra_id_14>",
726
+ "lstrip": true,
727
+ "normalized": true,
728
+ "rstrip": false,
729
+ "single_word": false,
730
+ "special": true
731
+ },
732
+ "32086": {
733
+ "content": "<extra_id_13>",
734
+ "lstrip": true,
735
+ "normalized": true,
736
+ "rstrip": false,
737
+ "single_word": false,
738
+ "special": true
739
+ },
740
+ "32087": {
741
+ "content": "<extra_id_12>",
742
+ "lstrip": true,
743
+ "normalized": true,
744
+ "rstrip": false,
745
+ "single_word": false,
746
+ "special": true
747
+ },
748
+ "32088": {
749
+ "content": "<extra_id_11>",
750
+ "lstrip": true,
751
+ "normalized": true,
752
+ "rstrip": false,
753
+ "single_word": false,
754
+ "special": true
755
+ },
756
+ "32089": {
757
+ "content": "<extra_id_10>",
758
+ "lstrip": true,
759
+ "normalized": true,
760
+ "rstrip": false,
761
+ "single_word": false,
762
+ "special": true
763
+ },
764
+ "32090": {
765
+ "content": "<extra_id_9>",
766
+ "lstrip": true,
767
+ "normalized": true,
768
+ "rstrip": false,
769
+ "single_word": false,
770
+ "special": true
771
+ },
772
+ "32091": {
773
+ "content": "<extra_id_8>",
774
+ "lstrip": true,
775
+ "normalized": true,
776
+ "rstrip": false,
777
+ "single_word": false,
778
+ "special": true
779
+ },
780
+ "32092": {
781
+ "content": "<extra_id_7>",
782
+ "lstrip": true,
783
+ "normalized": true,
784
+ "rstrip": false,
785
+ "single_word": false,
786
+ "special": true
787
+ },
788
+ "32093": {
789
+ "content": "<extra_id_6>",
790
+ "lstrip": true,
791
+ "normalized": true,
792
+ "rstrip": false,
793
+ "single_word": false,
794
+ "special": true
795
+ },
796
+ "32094": {
797
+ "content": "<extra_id_5>",
798
+ "lstrip": true,
799
+ "normalized": true,
800
+ "rstrip": false,
801
+ "single_word": false,
802
+ "special": true
803
+ },
804
+ "32095": {
805
+ "content": "<extra_id_4>",
806
+ "lstrip": true,
807
+ "normalized": true,
808
+ "rstrip": false,
809
+ "single_word": false,
810
+ "special": true
811
+ },
812
+ "32096": {
813
+ "content": "<extra_id_3>",
814
+ "lstrip": true,
815
+ "normalized": true,
816
+ "rstrip": false,
817
+ "single_word": false,
818
+ "special": true
819
+ },
820
+ "32097": {
821
+ "content": "<extra_id_2>",
822
+ "lstrip": true,
823
+ "normalized": true,
824
+ "rstrip": false,
825
+ "single_word": false,
826
+ "special": true
827
+ },
828
+ "32098": {
829
+ "content": "<extra_id_1>",
830
+ "lstrip": true,
831
+ "normalized": true,
832
+ "rstrip": false,
833
+ "single_word": false,
834
+ "special": true
835
+ },
836
+ "32099": {
837
+ "content": "<extra_id_0>",
838
+ "lstrip": true,
839
+ "normalized": true,
840
+ "rstrip": false,
841
+ "single_word": false,
842
+ "special": true
843
+ }
844
+ },
845
+ "additional_special_tokens": [
846
+ "<extra_id_99>",
847
+ "<extra_id_98>",
848
+ "<extra_id_97>",
849
+ "<extra_id_96>",
850
+ "<extra_id_95>",
851
+ "<extra_id_94>",
852
+ "<extra_id_93>",
853
+ "<extra_id_92>",
854
+ "<extra_id_91>",
855
+ "<extra_id_90>",
856
+ "<extra_id_89>",
857
+ "<extra_id_88>",
858
+ "<extra_id_87>",
859
+ "<extra_id_86>",
860
+ "<extra_id_85>",
861
+ "<extra_id_84>",
862
+ "<extra_id_83>",
863
+ "<extra_id_82>",
864
+ "<extra_id_81>",
865
+ "<extra_id_80>",
866
+ "<extra_id_79>",
867
+ "<extra_id_78>",
868
+ "<extra_id_77>",
869
+ "<extra_id_76>",
870
+ "<extra_id_75>",
871
+ "<extra_id_74>",
872
+ "<extra_id_73>",
873
+ "<extra_id_72>",
874
+ "<extra_id_71>",
875
+ "<extra_id_70>",
876
+ "<extra_id_69>",
877
+ "<extra_id_68>",
878
+ "<extra_id_67>",
879
+ "<extra_id_66>",
880
+ "<extra_id_65>",
881
+ "<extra_id_64>",
882
+ "<extra_id_63>",
883
+ "<extra_id_62>",
884
+ "<extra_id_61>",
885
+ "<extra_id_60>",
886
+ "<extra_id_59>",
887
+ "<extra_id_58>",
888
+ "<extra_id_57>",
889
+ "<extra_id_56>",
890
+ "<extra_id_55>",
891
+ "<extra_id_54>",
892
+ "<extra_id_53>",
893
+ "<extra_id_52>",
894
+ "<extra_id_51>",
895
+ "<extra_id_50>",
896
+ "<extra_id_49>",
897
+ "<extra_id_48>",
898
+ "<extra_id_47>",
899
+ "<extra_id_46>",
900
+ "<extra_id_45>",
901
+ "<extra_id_44>",
902
+ "<extra_id_43>",
903
+ "<extra_id_42>",
904
+ "<extra_id_41>",
905
+ "<extra_id_40>",
906
+ "<extra_id_39>",
907
+ "<extra_id_38>",
908
+ "<extra_id_37>",
909
+ "<extra_id_36>",
910
+ "<extra_id_35>",
911
+ "<extra_id_34>",
912
+ "<extra_id_33>",
913
+ "<extra_id_32>",
914
+ "<extra_id_31>",
915
+ "<extra_id_30>",
916
+ "<extra_id_29>",
917
+ "<extra_id_28>",
918
+ "<extra_id_27>",
919
+ "<extra_id_26>",
920
+ "<extra_id_25>",
921
+ "<extra_id_24>",
922
+ "<extra_id_23>",
923
+ "<extra_id_22>",
924
+ "<extra_id_21>",
925
+ "<extra_id_20>",
926
+ "<extra_id_19>",
927
+ "<extra_id_18>",
928
+ "<extra_id_17>",
929
+ "<extra_id_16>",
930
+ "<extra_id_15>",
931
+ "<extra_id_14>",
932
+ "<extra_id_13>",
933
+ "<extra_id_12>",
934
+ "<extra_id_11>",
935
+ "<extra_id_10>",
936
+ "<extra_id_9>",
937
+ "<extra_id_8>",
938
+ "<extra_id_7>",
939
+ "<extra_id_6>",
940
+ "<extra_id_5>",
941
+ "<extra_id_4>",
942
+ "<extra_id_3>",
943
+ "<extra_id_2>",
944
+ "<extra_id_1>",
945
+ "<extra_id_0>"
946
+ ],
947
+ "bos_token": "<s>",
948
+ "clean_up_tokenization_spaces": false,
949
+ "cls_token": "<s>",
950
+ "eos_token": "</s>",
951
+ "errors": "replace",
952
+ "extra_special_tokens": {},
953
+ "mask_token": "<mask>",
954
+ "model_max_length": 512,
955
+ "pad_token": "<pad>",
956
+ "sep_token": "</s>",
957
+ "tokenizer_class": "RobertaTokenizer",
958
+ "trim_offsets": true,
959
+ "unk_token": "<unk>"
960
+ }
checkpoint-14145/trainer_state.json ADDED
@@ -0,0 +1,2058 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 14145,
3
+ "best_metric": 0.9718361922106383,
4
+ "best_model_checkpoint": "./codet5-qlora-k8s/checkpoint-14145",
5
+ "epoch": 5.0,
6
+ "eval_steps": 500,
7
+ "global_step": 14145,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.017674089784376106,
14
+ "grad_norm": 1.1207759380340576,
15
+ "learning_rate": 0.00029898197242841994,
16
+ "loss": 3.2886,
17
+ "step": 50
18
+ },
19
+ {
20
+ "epoch": 0.03534817956875221,
21
+ "grad_norm": 1.2978123426437378,
22
+ "learning_rate": 0.0002979215270413573,
23
+ "loss": 1.8567,
24
+ "step": 100
25
+ },
26
+ {
27
+ "epoch": 0.053022269353128315,
28
+ "grad_norm": 1.624740719795227,
29
+ "learning_rate": 0.0002968610816542948,
30
+ "loss": 1.5695,
31
+ "step": 150
32
+ },
33
+ {
34
+ "epoch": 0.07069635913750442,
35
+ "grad_norm": 1.7711330652236938,
36
+ "learning_rate": 0.0002958006362672322,
37
+ "loss": 1.4205,
38
+ "step": 200
39
+ },
40
+ {
41
+ "epoch": 0.08837044892188052,
42
+ "grad_norm": 1.62517511844635,
43
+ "learning_rate": 0.0002947401908801697,
44
+ "loss": 1.2732,
45
+ "step": 250
46
+ },
47
+ {
48
+ "epoch": 0.10604453870625663,
49
+ "grad_norm": 2.038139820098877,
50
+ "learning_rate": 0.00029367974549310706,
51
+ "loss": 1.1913,
52
+ "step": 300
53
+ },
54
+ {
55
+ "epoch": 0.12371862849063273,
56
+ "grad_norm": 2.262789487838745,
57
+ "learning_rate": 0.00029264050901378576,
58
+ "loss": 1.117,
59
+ "step": 350
60
+ },
61
+ {
62
+ "epoch": 0.14139271827500885,
63
+ "grad_norm": 3.121687650680542,
64
+ "learning_rate": 0.0002915800636267232,
65
+ "loss": 1.0202,
66
+ "step": 400
67
+ },
68
+ {
69
+ "epoch": 0.15906680805938495,
70
+ "grad_norm": 2.0951812267303467,
71
+ "learning_rate": 0.0002905196182396606,
72
+ "loss": 0.9499,
73
+ "step": 450
74
+ },
75
+ {
76
+ "epoch": 0.17674089784376104,
77
+ "grad_norm": 2.670121192932129,
78
+ "learning_rate": 0.00028945917285259806,
79
+ "loss": 0.9707,
80
+ "step": 500
81
+ },
82
+ {
83
+ "epoch": 0.19441498762813716,
84
+ "grad_norm": 2.3631107807159424,
85
+ "learning_rate": 0.00028841993637327676,
86
+ "loss": 0.7961,
87
+ "step": 550
88
+ },
89
+ {
90
+ "epoch": 0.21208907741251326,
91
+ "grad_norm": 2.10772705078125,
92
+ "learning_rate": 0.0002873594909862142,
93
+ "loss": 0.8912,
94
+ "step": 600
95
+ },
96
+ {
97
+ "epoch": 0.22976316719688936,
98
+ "grad_norm": 2.360686779022217,
99
+ "learning_rate": 0.00028629904559915163,
100
+ "loss": 0.871,
101
+ "step": 650
102
+ },
103
+ {
104
+ "epoch": 0.24743725698126545,
105
+ "grad_norm": 2.191119432449341,
106
+ "learning_rate": 0.0002852598091198303,
107
+ "loss": 0.758,
108
+ "step": 700
109
+ },
110
+ {
111
+ "epoch": 0.2651113467656416,
112
+ "grad_norm": 1.7646818161010742,
113
+ "learning_rate": 0.00028419936373276776,
114
+ "loss": 0.8244,
115
+ "step": 750
116
+ },
117
+ {
118
+ "epoch": 0.2827854365500177,
119
+ "grad_norm": 2.3776354789733887,
120
+ "learning_rate": 0.00028313891834570514,
121
+ "loss": 0.7664,
122
+ "step": 800
123
+ },
124
+ {
125
+ "epoch": 0.30045952633439377,
126
+ "grad_norm": 2.8682475090026855,
127
+ "learning_rate": 0.00028207847295864263,
128
+ "loss": 0.6942,
129
+ "step": 850
130
+ },
131
+ {
132
+ "epoch": 0.3181336161187699,
133
+ "grad_norm": 2.353091239929199,
134
+ "learning_rate": 0.00028101802757158,
135
+ "loss": 0.7323,
136
+ "step": 900
137
+ },
138
+ {
139
+ "epoch": 0.335807705903146,
140
+ "grad_norm": 1.9457337856292725,
141
+ "learning_rate": 0.00027995758218451745,
142
+ "loss": 0.6474,
143
+ "step": 950
144
+ },
145
+ {
146
+ "epoch": 0.3534817956875221,
147
+ "grad_norm": 2.510075330734253,
148
+ "learning_rate": 0.00027889713679745494,
149
+ "loss": 0.6801,
150
+ "step": 1000
151
+ },
152
+ {
153
+ "epoch": 0.3711558854718982,
154
+ "grad_norm": 1.7497014999389648,
155
+ "learning_rate": 0.0002778366914103923,
156
+ "loss": 0.656,
157
+ "step": 1050
158
+ },
159
+ {
160
+ "epoch": 0.38882997525627433,
161
+ "grad_norm": 2.862682342529297,
162
+ "learning_rate": 0.0002767762460233298,
163
+ "loss": 0.6238,
164
+ "step": 1100
165
+ },
166
+ {
167
+ "epoch": 0.4065040650406504,
168
+ "grad_norm": 1.998961091041565,
169
+ "learning_rate": 0.0002757158006362672,
170
+ "loss": 0.6306,
171
+ "step": 1150
172
+ },
173
+ {
174
+ "epoch": 0.4241781548250265,
175
+ "grad_norm": 1.854942798614502,
176
+ "learning_rate": 0.0002746553552492047,
177
+ "loss": 0.5689,
178
+ "step": 1200
179
+ },
180
+ {
181
+ "epoch": 0.4418522446094026,
182
+ "grad_norm": 1.8994203805923462,
183
+ "learning_rate": 0.00027359490986214206,
184
+ "loss": 0.6595,
185
+ "step": 1250
186
+ },
187
+ {
188
+ "epoch": 0.4595263343937787,
189
+ "grad_norm": 1.6235908269882202,
190
+ "learning_rate": 0.0002725344644750795,
191
+ "loss": 0.5665,
192
+ "step": 1300
193
+ },
194
+ {
195
+ "epoch": 0.47720042417815484,
196
+ "grad_norm": 2.291989803314209,
197
+ "learning_rate": 0.00027147401908801693,
198
+ "loss": 0.5761,
199
+ "step": 1350
200
+ },
201
+ {
202
+ "epoch": 0.4948745139625309,
203
+ "grad_norm": 1.4632915258407593,
204
+ "learning_rate": 0.00027041357370095437,
205
+ "loss": 0.5171,
206
+ "step": 1400
207
+ },
208
+ {
209
+ "epoch": 0.512548603746907,
210
+ "grad_norm": 2.1687259674072266,
211
+ "learning_rate": 0.0002693531283138918,
212
+ "loss": 0.6183,
213
+ "step": 1450
214
+ },
215
+ {
216
+ "epoch": 0.5302226935312832,
217
+ "grad_norm": 1.734108805656433,
218
+ "learning_rate": 0.00026829268292682924,
219
+ "loss": 0.5411,
220
+ "step": 1500
221
+ },
222
+ {
223
+ "epoch": 0.5478967833156593,
224
+ "grad_norm": 1.3890644311904907,
225
+ "learning_rate": 0.00026723223753976667,
226
+ "loss": 0.5092,
227
+ "step": 1550
228
+ },
229
+ {
230
+ "epoch": 0.5655708731000354,
231
+ "grad_norm": 1.98700749874115,
232
+ "learning_rate": 0.0002661717921527041,
233
+ "loss": 0.4804,
234
+ "step": 1600
235
+ },
236
+ {
237
+ "epoch": 0.5832449628844114,
238
+ "grad_norm": 1.1181468963623047,
239
+ "learning_rate": 0.00026511134676564154,
240
+ "loss": 0.5148,
241
+ "step": 1650
242
+ },
243
+ {
244
+ "epoch": 0.6009190526687875,
245
+ "grad_norm": 1.7994420528411865,
246
+ "learning_rate": 0.000264050901378579,
247
+ "loss": 0.4231,
248
+ "step": 1700
249
+ },
250
+ {
251
+ "epoch": 0.6185931424531637,
252
+ "grad_norm": 2.032198667526245,
253
+ "learning_rate": 0.0002629904559915164,
254
+ "loss": 0.5106,
255
+ "step": 1750
256
+ },
257
+ {
258
+ "epoch": 0.6362672322375398,
259
+ "grad_norm": 3.585948944091797,
260
+ "learning_rate": 0.00026193001060445385,
261
+ "loss": 0.4717,
262
+ "step": 1800
263
+ },
264
+ {
265
+ "epoch": 0.6539413220219159,
266
+ "grad_norm": 1.8610371351242065,
267
+ "learning_rate": 0.0002608695652173913,
268
+ "loss": 0.4765,
269
+ "step": 1850
270
+ },
271
+ {
272
+ "epoch": 0.671615411806292,
273
+ "grad_norm": 1.2324624061584473,
274
+ "learning_rate": 0.0002598091198303287,
275
+ "loss": 0.4643,
276
+ "step": 1900
277
+ },
278
+ {
279
+ "epoch": 0.689289501590668,
280
+ "grad_norm": 2.391714572906494,
281
+ "learning_rate": 0.00025874867444326615,
282
+ "loss": 0.4512,
283
+ "step": 1950
284
+ },
285
+ {
286
+ "epoch": 0.7069635913750442,
287
+ "grad_norm": 1.8863242864608765,
288
+ "learning_rate": 0.0002576882290562036,
289
+ "loss": 0.4115,
290
+ "step": 2000
291
+ },
292
+ {
293
+ "epoch": 0.7246376811594203,
294
+ "grad_norm": 0.7850649356842041,
295
+ "learning_rate": 0.000256627783669141,
296
+ "loss": 0.4341,
297
+ "step": 2050
298
+ },
299
+ {
300
+ "epoch": 0.7423117709437964,
301
+ "grad_norm": 1.5869959592819214,
302
+ "learning_rate": 0.00025556733828207846,
303
+ "loss": 0.4172,
304
+ "step": 2100
305
+ },
306
+ {
307
+ "epoch": 0.7599858607281725,
308
+ "grad_norm": 1.2584971189498901,
309
+ "learning_rate": 0.0002545068928950159,
310
+ "loss": 0.4384,
311
+ "step": 2150
312
+ },
313
+ {
314
+ "epoch": 0.7776599505125487,
315
+ "grad_norm": 2.560710906982422,
316
+ "learning_rate": 0.00025344644750795333,
317
+ "loss": 0.4558,
318
+ "step": 2200
319
+ },
320
+ {
321
+ "epoch": 0.7953340402969247,
322
+ "grad_norm": 2.2893359661102295,
323
+ "learning_rate": 0.00025238600212089076,
324
+ "loss": 0.4345,
325
+ "step": 2250
326
+ },
327
+ {
328
+ "epoch": 0.8130081300813008,
329
+ "grad_norm": 1.5244982242584229,
330
+ "learning_rate": 0.0002513255567338282,
331
+ "loss": 0.4071,
332
+ "step": 2300
333
+ },
334
+ {
335
+ "epoch": 0.8306822198656769,
336
+ "grad_norm": 1.384102463722229,
337
+ "learning_rate": 0.00025026511134676563,
338
+ "loss": 0.3612,
339
+ "step": 2350
340
+ },
341
+ {
342
+ "epoch": 0.848356309650053,
343
+ "grad_norm": 1.3080965280532837,
344
+ "learning_rate": 0.00024920466595970307,
345
+ "loss": 0.3556,
346
+ "step": 2400
347
+ },
348
+ {
349
+ "epoch": 0.8660303994344292,
350
+ "grad_norm": 1.3324400186538696,
351
+ "learning_rate": 0.00024814422057264045,
352
+ "loss": 0.3985,
353
+ "step": 2450
354
+ },
355
+ {
356
+ "epoch": 0.8837044892188052,
357
+ "grad_norm": 1.7705445289611816,
358
+ "learning_rate": 0.00024708377518557794,
359
+ "loss": 0.3895,
360
+ "step": 2500
361
+ },
362
+ {
363
+ "epoch": 0.9013785790031813,
364
+ "grad_norm": 1.352480173110962,
365
+ "learning_rate": 0.0002460233297985153,
366
+ "loss": 0.426,
367
+ "step": 2550
368
+ },
369
+ {
370
+ "epoch": 0.9190526687875574,
371
+ "grad_norm": 1.479979157447815,
372
+ "learning_rate": 0.0002449628844114528,
373
+ "loss": 0.4057,
374
+ "step": 2600
375
+ },
376
+ {
377
+ "epoch": 0.9367267585719335,
378
+ "grad_norm": 2.1380653381347656,
379
+ "learning_rate": 0.00024390243902439022,
380
+ "loss": 0.3689,
381
+ "step": 2650
382
+ },
383
+ {
384
+ "epoch": 0.9544008483563097,
385
+ "grad_norm": 1.9099682569503784,
386
+ "learning_rate": 0.00024284199363732768,
387
+ "loss": 0.3991,
388
+ "step": 2700
389
+ },
390
+ {
391
+ "epoch": 0.9720749381406858,
392
+ "grad_norm": 1.399566411972046,
393
+ "learning_rate": 0.0002417815482502651,
394
+ "loss": 0.3412,
395
+ "step": 2750
396
+ },
397
+ {
398
+ "epoch": 0.9897490279250618,
399
+ "grad_norm": 2.508267879486084,
400
+ "learning_rate": 0.00024072110286320252,
401
+ "loss": 0.3828,
402
+ "step": 2800
403
+ },
404
+ {
405
+ "epoch": 1.0,
406
+ "eval_bertscore_f1": 0.9667777874331811,
407
+ "eval_bleu": 0.5973566262792636,
408
+ "eval_loss": 0.27053505182266235,
409
+ "eval_runtime": 1054.1237,
410
+ "eval_samples_per_second": 6.132,
411
+ "eval_steps_per_second": 0.767,
412
+ "step": 2829
413
+ },
414
+ {
415
+ "epoch": 1.007423117709438,
416
+ "grad_norm": 1.6967344284057617,
417
+ "learning_rate": 0.00023966065747613996,
418
+ "loss": 0.3787,
419
+ "step": 2850
420
+ },
421
+ {
422
+ "epoch": 1.025097207493814,
423
+ "grad_norm": 1.7119196653366089,
424
+ "learning_rate": 0.0002386002120890774,
425
+ "loss": 0.3507,
426
+ "step": 2900
427
+ },
428
+ {
429
+ "epoch": 1.0427712972781902,
430
+ "grad_norm": 1.5456138849258423,
431
+ "learning_rate": 0.00023753976670201483,
432
+ "loss": 0.333,
433
+ "step": 2950
434
+ },
435
+ {
436
+ "epoch": 1.0604453870625663,
437
+ "grad_norm": 1.3519443273544312,
438
+ "learning_rate": 0.00023647932131495226,
439
+ "loss": 0.3897,
440
+ "step": 3000
441
+ },
442
+ {
443
+ "epoch": 1.0781194768469424,
444
+ "grad_norm": 1.4092153310775757,
445
+ "learning_rate": 0.0002354188759278897,
446
+ "loss": 0.3069,
447
+ "step": 3050
448
+ },
449
+ {
450
+ "epoch": 1.0957935666313185,
451
+ "grad_norm": 1.67427659034729,
452
+ "learning_rate": 0.00023435843054082713,
453
+ "loss": 0.3876,
454
+ "step": 3100
455
+ },
456
+ {
457
+ "epoch": 1.1134676564156947,
458
+ "grad_norm": 0.9288003444671631,
459
+ "learning_rate": 0.00023329798515376457,
460
+ "loss": 0.3052,
461
+ "step": 3150
462
+ },
463
+ {
464
+ "epoch": 1.1311417462000706,
465
+ "grad_norm": 2.0493695735931396,
466
+ "learning_rate": 0.000232237539766702,
467
+ "loss": 0.3419,
468
+ "step": 3200
469
+ },
470
+ {
471
+ "epoch": 1.148815835984447,
472
+ "grad_norm": 1.3473105430603027,
473
+ "learning_rate": 0.0002311770943796394,
474
+ "loss": 0.351,
475
+ "step": 3250
476
+ },
477
+ {
478
+ "epoch": 1.1664899257688228,
479
+ "grad_norm": 2.2063777446746826,
480
+ "learning_rate": 0.00023011664899257687,
481
+ "loss": 0.3732,
482
+ "step": 3300
483
+ },
484
+ {
485
+ "epoch": 1.184164015553199,
486
+ "grad_norm": 0.7194732427597046,
487
+ "learning_rate": 0.00022905620360551428,
488
+ "loss": 0.3098,
489
+ "step": 3350
490
+ },
491
+ {
492
+ "epoch": 1.201838105337575,
493
+ "grad_norm": 1.8693958520889282,
494
+ "learning_rate": 0.00022799575821845174,
495
+ "loss": 0.3623,
496
+ "step": 3400
497
+ },
498
+ {
499
+ "epoch": 1.2195121951219512,
500
+ "grad_norm": 1.7452648878097534,
501
+ "learning_rate": 0.00022693531283138915,
502
+ "loss": 0.2985,
503
+ "step": 3450
504
+ },
505
+ {
506
+ "epoch": 1.2371862849063273,
507
+ "grad_norm": 2.7502336502075195,
508
+ "learning_rate": 0.00022587486744432661,
509
+ "loss": 0.2938,
510
+ "step": 3500
511
+ },
512
+ {
513
+ "epoch": 1.2548603746907034,
514
+ "grad_norm": 1.0220433473587036,
515
+ "learning_rate": 0.00022481442205726402,
516
+ "loss": 0.3263,
517
+ "step": 3550
518
+ },
519
+ {
520
+ "epoch": 1.2725344644750796,
521
+ "grad_norm": 1.1841455698013306,
522
+ "learning_rate": 0.00022375397667020146,
523
+ "loss": 0.3456,
524
+ "step": 3600
525
+ },
526
+ {
527
+ "epoch": 1.2902085542594557,
528
+ "grad_norm": 1.1220083236694336,
529
+ "learning_rate": 0.0002226935312831389,
530
+ "loss": 0.3749,
531
+ "step": 3650
532
+ },
533
+ {
534
+ "epoch": 1.3078826440438318,
535
+ "grad_norm": 2.557077646255493,
536
+ "learning_rate": 0.00022163308589607633,
537
+ "loss": 0.3479,
538
+ "step": 3700
539
+ },
540
+ {
541
+ "epoch": 1.3255567338282077,
542
+ "grad_norm": 1.672131061553955,
543
+ "learning_rate": 0.00022057264050901376,
544
+ "loss": 0.3371,
545
+ "step": 3750
546
+ },
547
+ {
548
+ "epoch": 1.343230823612584,
549
+ "grad_norm": 1.5530970096588135,
550
+ "learning_rate": 0.0002195121951219512,
551
+ "loss": 0.3062,
552
+ "step": 3800
553
+ },
554
+ {
555
+ "epoch": 1.36090491339696,
556
+ "grad_norm": 0.8587738871574402,
557
+ "learning_rate": 0.00021845174973488866,
558
+ "loss": 0.3458,
559
+ "step": 3850
560
+ },
561
+ {
562
+ "epoch": 1.378579003181336,
563
+ "grad_norm": 1.2779722213745117,
564
+ "learning_rate": 0.00021739130434782607,
565
+ "loss": 0.3582,
566
+ "step": 3900
567
+ },
568
+ {
569
+ "epoch": 1.3962530929657122,
570
+ "grad_norm": 1.7616783380508423,
571
+ "learning_rate": 0.00021633085896076348,
572
+ "loss": 0.2999,
573
+ "step": 3950
574
+ },
575
+ {
576
+ "epoch": 1.4139271827500883,
577
+ "grad_norm": 1.2923225164413452,
578
+ "learning_rate": 0.00021527041357370094,
579
+ "loss": 0.3079,
580
+ "step": 4000
581
+ },
582
+ {
583
+ "epoch": 1.4316012725344645,
584
+ "grad_norm": 0.7930673360824585,
585
+ "learning_rate": 0.00021420996818663835,
586
+ "loss": 0.2973,
587
+ "step": 4050
588
+ },
589
+ {
590
+ "epoch": 1.4492753623188406,
591
+ "grad_norm": 1.5622656345367432,
592
+ "learning_rate": 0.0002131495227995758,
593
+ "loss": 0.291,
594
+ "step": 4100
595
+ },
596
+ {
597
+ "epoch": 1.4669494521032167,
598
+ "grad_norm": 0.8834390640258789,
599
+ "learning_rate": 0.00021208907741251324,
600
+ "loss": 0.2691,
601
+ "step": 4150
602
+ },
603
+ {
604
+ "epoch": 1.4846235418875928,
605
+ "grad_norm": 1.2596232891082764,
606
+ "learning_rate": 0.00021102863202545068,
607
+ "loss": 0.247,
608
+ "step": 4200
609
+ },
610
+ {
611
+ "epoch": 1.502297631671969,
612
+ "grad_norm": 0.7010456323623657,
613
+ "learning_rate": 0.00020996818663838811,
614
+ "loss": 0.3019,
615
+ "step": 4250
616
+ },
617
+ {
618
+ "epoch": 1.5199717214563448,
619
+ "grad_norm": 1.071253776550293,
620
+ "learning_rate": 0.00020890774125132552,
621
+ "loss": 0.2447,
622
+ "step": 4300
623
+ },
624
+ {
625
+ "epoch": 1.5376458112407212,
626
+ "grad_norm": 0.63275545835495,
627
+ "learning_rate": 0.00020784729586426298,
628
+ "loss": 0.246,
629
+ "step": 4350
630
+ },
631
+ {
632
+ "epoch": 1.555319901025097,
633
+ "grad_norm": 1.0832668542861938,
634
+ "learning_rate": 0.0002067868504772004,
635
+ "loss": 0.249,
636
+ "step": 4400
637
+ },
638
+ {
639
+ "epoch": 1.5729939908094734,
640
+ "grad_norm": 1.0748353004455566,
641
+ "learning_rate": 0.00020572640509013785,
642
+ "loss": 0.2585,
643
+ "step": 4450
644
+ },
645
+ {
646
+ "epoch": 1.5906680805938493,
647
+ "grad_norm": 1.2410573959350586,
648
+ "learning_rate": 0.00020466595970307526,
649
+ "loss": 0.2821,
650
+ "step": 4500
651
+ },
652
+ {
653
+ "epoch": 1.6083421703782255,
654
+ "grad_norm": 1.8322285413742065,
655
+ "learning_rate": 0.00020360551431601272,
656
+ "loss": 0.2642,
657
+ "step": 4550
658
+ },
659
+ {
660
+ "epoch": 1.6260162601626016,
661
+ "grad_norm": 1.5231540203094482,
662
+ "learning_rate": 0.00020254506892895013,
663
+ "loss": 0.329,
664
+ "step": 4600
665
+ },
666
+ {
667
+ "epoch": 1.6436903499469777,
668
+ "grad_norm": 0.8996387124061584,
669
+ "learning_rate": 0.0002014846235418876,
670
+ "loss": 0.2822,
671
+ "step": 4650
672
+ },
673
+ {
674
+ "epoch": 1.6613644397313538,
675
+ "grad_norm": 1.107340693473816,
676
+ "learning_rate": 0.000200424178154825,
677
+ "loss": 0.2647,
678
+ "step": 4700
679
+ },
680
+ {
681
+ "epoch": 1.67903852951573,
682
+ "grad_norm": 1.44370698928833,
683
+ "learning_rate": 0.00019936373276776244,
684
+ "loss": 0.3281,
685
+ "step": 4750
686
+ },
687
+ {
688
+ "epoch": 1.696712619300106,
689
+ "grad_norm": 1.433866024017334,
690
+ "learning_rate": 0.00019830328738069987,
691
+ "loss": 0.2867,
692
+ "step": 4800
693
+ },
694
+ {
695
+ "epoch": 1.714386709084482,
696
+ "grad_norm": 0.7778879404067993,
697
+ "learning_rate": 0.0001972428419936373,
698
+ "loss": 0.2363,
699
+ "step": 4850
700
+ },
701
+ {
702
+ "epoch": 1.7320607988688583,
703
+ "grad_norm": 1.0693784952163696,
704
+ "learning_rate": 0.00019618239660657474,
705
+ "loss": 0.2989,
706
+ "step": 4900
707
+ },
708
+ {
709
+ "epoch": 1.7497348886532342,
710
+ "grad_norm": 0.9680020213127136,
711
+ "learning_rate": 0.00019512195121951218,
712
+ "loss": 0.2512,
713
+ "step": 4950
714
+ },
715
+ {
716
+ "epoch": 1.7674089784376106,
717
+ "grad_norm": 0.9300338625907898,
718
+ "learning_rate": 0.00019406150583244961,
719
+ "loss": 0.2814,
720
+ "step": 5000
721
+ },
722
+ {
723
+ "epoch": 1.7850830682219865,
724
+ "grad_norm": 1.6086584329605103,
725
+ "learning_rate": 0.00019300106044538705,
726
+ "loss": 0.2895,
727
+ "step": 5050
728
+ },
729
+ {
730
+ "epoch": 1.8027571580063628,
731
+ "grad_norm": 1.522153615951538,
732
+ "learning_rate": 0.00019194061505832446,
733
+ "loss": 0.2804,
734
+ "step": 5100
735
+ },
736
+ {
737
+ "epoch": 1.8204312477907387,
738
+ "grad_norm": 1.3292605876922607,
739
+ "learning_rate": 0.00019088016967126192,
740
+ "loss": 0.2676,
741
+ "step": 5150
742
+ },
743
+ {
744
+ "epoch": 1.8381053375751149,
745
+ "grad_norm": 1.0950225591659546,
746
+ "learning_rate": 0.00018981972428419933,
747
+ "loss": 0.2991,
748
+ "step": 5200
749
+ },
750
+ {
751
+ "epoch": 1.855779427359491,
752
+ "grad_norm": 1.8333910703659058,
753
+ "learning_rate": 0.0001887592788971368,
754
+ "loss": 0.2742,
755
+ "step": 5250
756
+ },
757
+ {
758
+ "epoch": 1.873453517143867,
759
+ "grad_norm": 1.447016716003418,
760
+ "learning_rate": 0.0001876988335100742,
761
+ "loss": 0.2125,
762
+ "step": 5300
763
+ },
764
+ {
765
+ "epoch": 1.8911276069282432,
766
+ "grad_norm": 1.0409213304519653,
767
+ "learning_rate": 0.00018663838812301166,
768
+ "loss": 0.2372,
769
+ "step": 5350
770
+ },
771
+ {
772
+ "epoch": 1.9088016967126193,
773
+ "grad_norm": 0.5701714158058167,
774
+ "learning_rate": 0.00018557794273594907,
775
+ "loss": 0.2332,
776
+ "step": 5400
777
+ },
778
+ {
779
+ "epoch": 1.9264757864969955,
780
+ "grad_norm": 1.0092428922653198,
781
+ "learning_rate": 0.0001845174973488865,
782
+ "loss": 0.2897,
783
+ "step": 5450
784
+ },
785
+ {
786
+ "epoch": 1.9441498762813714,
787
+ "grad_norm": 1.031217098236084,
788
+ "learning_rate": 0.00018345705196182397,
789
+ "loss": 0.2722,
790
+ "step": 5500
791
+ },
792
+ {
793
+ "epoch": 1.9618239660657477,
794
+ "grad_norm": 1.2638362646102905,
795
+ "learning_rate": 0.00018239660657476137,
796
+ "loss": 0.2505,
797
+ "step": 5550
798
+ },
799
+ {
800
+ "epoch": 1.9794980558501236,
801
+ "grad_norm": 1.3998290300369263,
802
+ "learning_rate": 0.00018133616118769884,
803
+ "loss": 0.2772,
804
+ "step": 5600
805
+ },
806
+ {
807
+ "epoch": 1.9971721456345,
808
+ "grad_norm": 1.4681320190429688,
809
+ "learning_rate": 0.00018027571580063624,
810
+ "loss": 0.25,
811
+ "step": 5650
812
+ },
813
+ {
814
+ "epoch": 2.0,
815
+ "eval_bertscore_f1": 0.970109825833968,
816
+ "eval_bleu": 0.6229920961802436,
817
+ "eval_loss": 0.1904931217432022,
818
+ "eval_runtime": 1018.8038,
819
+ "eval_samples_per_second": 6.345,
820
+ "eval_steps_per_second": 0.793,
821
+ "step": 5658
822
+ },
823
+ {
824
+ "epoch": 2.014846235418876,
825
+ "grad_norm": 1.3499983549118042,
826
+ "learning_rate": 0.0001792152704135737,
827
+ "loss": 0.2412,
828
+ "step": 5700
829
+ },
830
+ {
831
+ "epoch": 2.032520325203252,
832
+ "grad_norm": 1.2155545949935913,
833
+ "learning_rate": 0.00017815482502651111,
834
+ "loss": 0.2919,
835
+ "step": 5750
836
+ },
837
+ {
838
+ "epoch": 2.050194414987628,
839
+ "grad_norm": 0.9294681549072266,
840
+ "learning_rate": 0.00017709437963944858,
841
+ "loss": 0.2191,
842
+ "step": 5800
843
+ },
844
+ {
845
+ "epoch": 2.0678685047720045,
846
+ "grad_norm": 0.8069599270820618,
847
+ "learning_rate": 0.00017603393425238598,
848
+ "loss": 0.228,
849
+ "step": 5850
850
+ },
851
+ {
852
+ "epoch": 2.0855425945563804,
853
+ "grad_norm": 1.1825474500656128,
854
+ "learning_rate": 0.00017497348886532342,
855
+ "loss": 0.2422,
856
+ "step": 5900
857
+ },
858
+ {
859
+ "epoch": 2.1032166843407563,
860
+ "grad_norm": 1.2947015762329102,
861
+ "learning_rate": 0.00017391304347826085,
862
+ "loss": 0.2333,
863
+ "step": 5950
864
+ },
865
+ {
866
+ "epoch": 2.1208907741251326,
867
+ "grad_norm": 1.0622906684875488,
868
+ "learning_rate": 0.0001728525980911983,
869
+ "loss": 0.2029,
870
+ "step": 6000
871
+ },
872
+ {
873
+ "epoch": 2.1385648639095085,
874
+ "grad_norm": 0.8785162568092346,
875
+ "learning_rate": 0.00017179215270413572,
876
+ "loss": 0.2039,
877
+ "step": 6050
878
+ },
879
+ {
880
+ "epoch": 2.156238953693885,
881
+ "grad_norm": 0.3702610433101654,
882
+ "learning_rate": 0.00017073170731707316,
883
+ "loss": 0.2631,
884
+ "step": 6100
885
+ },
886
+ {
887
+ "epoch": 2.1739130434782608,
888
+ "grad_norm": 1.0092154741287231,
889
+ "learning_rate": 0.0001696712619300106,
890
+ "loss": 0.2325,
891
+ "step": 6150
892
+ },
893
+ {
894
+ "epoch": 2.191587133262637,
895
+ "grad_norm": 1.648000955581665,
896
+ "learning_rate": 0.00016861081654294803,
897
+ "loss": 0.2501,
898
+ "step": 6200
899
+ },
900
+ {
901
+ "epoch": 2.209261223047013,
902
+ "grad_norm": 0.979069173336029,
903
+ "learning_rate": 0.00016755037115588544,
904
+ "loss": 0.256,
905
+ "step": 6250
906
+ },
907
+ {
908
+ "epoch": 2.2269353128313893,
909
+ "grad_norm": 1.459558129310608,
910
+ "learning_rate": 0.0001664899257688229,
911
+ "loss": 0.2603,
912
+ "step": 6300
913
+ },
914
+ {
915
+ "epoch": 2.2446094026157652,
916
+ "grad_norm": 1.5793472528457642,
917
+ "learning_rate": 0.0001654294803817603,
918
+ "loss": 0.2564,
919
+ "step": 6350
920
+ },
921
+ {
922
+ "epoch": 2.262283492400141,
923
+ "grad_norm": 1.1787140369415283,
924
+ "learning_rate": 0.00016436903499469777,
925
+ "loss": 0.2782,
926
+ "step": 6400
927
+ },
928
+ {
929
+ "epoch": 2.2799575821845175,
930
+ "grad_norm": 1.041374683380127,
931
+ "learning_rate": 0.00016330858960763518,
932
+ "loss": 0.2331,
933
+ "step": 6450
934
+ },
935
+ {
936
+ "epoch": 2.297631671968894,
937
+ "grad_norm": 0.7799555063247681,
938
+ "learning_rate": 0.00016224814422057264,
939
+ "loss": 0.2338,
940
+ "step": 6500
941
+ },
942
+ {
943
+ "epoch": 2.3153057617532697,
944
+ "grad_norm": 1.4405689239501953,
945
+ "learning_rate": 0.00016118769883351005,
946
+ "loss": 0.2737,
947
+ "step": 6550
948
+ },
949
+ {
950
+ "epoch": 2.3329798515376456,
951
+ "grad_norm": 0.979608416557312,
952
+ "learning_rate": 0.00016012725344644748,
953
+ "loss": 0.2495,
954
+ "step": 6600
955
+ },
956
+ {
957
+ "epoch": 2.350653941322022,
958
+ "grad_norm": 0.9300618171691895,
959
+ "learning_rate": 0.00015906680805938492,
960
+ "loss": 0.2157,
961
+ "step": 6650
962
+ },
963
+ {
964
+ "epoch": 2.368328031106398,
965
+ "grad_norm": 0.8745370507240295,
966
+ "learning_rate": 0.00015800636267232235,
967
+ "loss": 0.2837,
968
+ "step": 6700
969
+ },
970
+ {
971
+ "epoch": 2.3860021208907742,
972
+ "grad_norm": 0.9898168444633484,
973
+ "learning_rate": 0.00015694591728525982,
974
+ "loss": 0.221,
975
+ "step": 6750
976
+ },
977
+ {
978
+ "epoch": 2.40367621067515,
979
+ "grad_norm": 0.8933513760566711,
980
+ "learning_rate": 0.00015588547189819722,
981
+ "loss": 0.1994,
982
+ "step": 6800
983
+ },
984
+ {
985
+ "epoch": 2.4213503004595265,
986
+ "grad_norm": 1.7144904136657715,
987
+ "learning_rate": 0.0001548250265111347,
988
+ "loss": 0.2429,
989
+ "step": 6850
990
+ },
991
+ {
992
+ "epoch": 2.4390243902439024,
993
+ "grad_norm": 1.5800135135650635,
994
+ "learning_rate": 0.0001537645811240721,
995
+ "loss": 0.2284,
996
+ "step": 6900
997
+ },
998
+ {
999
+ "epoch": 2.4566984800282787,
1000
+ "grad_norm": 1.0567731857299805,
1001
+ "learning_rate": 0.0001527041357370095,
1002
+ "loss": 0.2028,
1003
+ "step": 6950
1004
+ },
1005
+ {
1006
+ "epoch": 2.4743725698126546,
1007
+ "grad_norm": 0.59196537733078,
1008
+ "learning_rate": 0.00015164369034994697,
1009
+ "loss": 0.228,
1010
+ "step": 7000
1011
+ },
1012
+ {
1013
+ "epoch": 2.4920466595970305,
1014
+ "grad_norm": 1.0257049798965454,
1015
+ "learning_rate": 0.00015058324496288437,
1016
+ "loss": 0.2196,
1017
+ "step": 7050
1018
+ },
1019
+ {
1020
+ "epoch": 2.509720749381407,
1021
+ "grad_norm": 1.500623345375061,
1022
+ "learning_rate": 0.00014952279957582184,
1023
+ "loss": 0.2351,
1024
+ "step": 7100
1025
+ },
1026
+ {
1027
+ "epoch": 2.5273948391657832,
1028
+ "grad_norm": 1.1046085357666016,
1029
+ "learning_rate": 0.00014846235418875927,
1030
+ "loss": 0.2595,
1031
+ "step": 7150
1032
+ },
1033
+ {
1034
+ "epoch": 2.545068928950159,
1035
+ "grad_norm": 1.2226991653442383,
1036
+ "learning_rate": 0.0001474019088016967,
1037
+ "loss": 0.1914,
1038
+ "step": 7200
1039
+ },
1040
+ {
1041
+ "epoch": 2.562743018734535,
1042
+ "grad_norm": 0.6742298007011414,
1043
+ "learning_rate": 0.00014634146341463414,
1044
+ "loss": 0.2096,
1045
+ "step": 7250
1046
+ },
1047
+ {
1048
+ "epoch": 2.5804171085189114,
1049
+ "grad_norm": 1.5504461526870728,
1050
+ "learning_rate": 0.00014528101802757158,
1051
+ "loss": 0.2051,
1052
+ "step": 7300
1053
+ },
1054
+ {
1055
+ "epoch": 2.5980911983032873,
1056
+ "grad_norm": 0.9681800603866577,
1057
+ "learning_rate": 0.000144220572640509,
1058
+ "loss": 0.2327,
1059
+ "step": 7350
1060
+ },
1061
+ {
1062
+ "epoch": 2.6157652880876636,
1063
+ "grad_norm": 0.9383839964866638,
1064
+ "learning_rate": 0.00014316012725344645,
1065
+ "loss": 0.2344,
1066
+ "step": 7400
1067
+ },
1068
+ {
1069
+ "epoch": 2.6334393778720395,
1070
+ "grad_norm": 0.6154807209968567,
1071
+ "learning_rate": 0.00014209968186638388,
1072
+ "loss": 0.2383,
1073
+ "step": 7450
1074
+ },
1075
+ {
1076
+ "epoch": 2.6511134676564154,
1077
+ "grad_norm": 1.2676986455917358,
1078
+ "learning_rate": 0.00014103923647932132,
1079
+ "loss": 0.2257,
1080
+ "step": 7500
1081
+ },
1082
+ {
1083
+ "epoch": 2.6687875574407918,
1084
+ "grad_norm": 1.183440089225769,
1085
+ "learning_rate": 0.00013997879109225872,
1086
+ "loss": 0.2102,
1087
+ "step": 7550
1088
+ },
1089
+ {
1090
+ "epoch": 2.686461647225168,
1091
+ "grad_norm": 0.7244306802749634,
1092
+ "learning_rate": 0.00013891834570519616,
1093
+ "loss": 0.2146,
1094
+ "step": 7600
1095
+ },
1096
+ {
1097
+ "epoch": 2.704135737009544,
1098
+ "grad_norm": 1.187232494354248,
1099
+ "learning_rate": 0.0001378579003181336,
1100
+ "loss": 0.2119,
1101
+ "step": 7650
1102
+ },
1103
+ {
1104
+ "epoch": 2.72180982679392,
1105
+ "grad_norm": 1.4510794878005981,
1106
+ "learning_rate": 0.00013679745493107103,
1107
+ "loss": 0.1916,
1108
+ "step": 7700
1109
+ },
1110
+ {
1111
+ "epoch": 2.7394839165782963,
1112
+ "grad_norm": 1.383832335472107,
1113
+ "learning_rate": 0.00013573700954400847,
1114
+ "loss": 0.2179,
1115
+ "step": 7750
1116
+ },
1117
+ {
1118
+ "epoch": 2.757158006362672,
1119
+ "grad_norm": 0.9274504780769348,
1120
+ "learning_rate": 0.0001346765641569459,
1121
+ "loss": 0.199,
1122
+ "step": 7800
1123
+ },
1124
+ {
1125
+ "epoch": 2.7748320961470485,
1126
+ "grad_norm": 2.6429216861724854,
1127
+ "learning_rate": 0.00013361611876988334,
1128
+ "loss": 0.2407,
1129
+ "step": 7850
1130
+ },
1131
+ {
1132
+ "epoch": 2.7925061859314244,
1133
+ "grad_norm": 1.3947652578353882,
1134
+ "learning_rate": 0.00013255567338282077,
1135
+ "loss": 0.2019,
1136
+ "step": 7900
1137
+ },
1138
+ {
1139
+ "epoch": 2.8101802757158008,
1140
+ "grad_norm": 1.148478627204895,
1141
+ "learning_rate": 0.0001314952279957582,
1142
+ "loss": 0.205,
1143
+ "step": 7950
1144
+ },
1145
+ {
1146
+ "epoch": 2.8278543655001767,
1147
+ "grad_norm": 1.1087610721588135,
1148
+ "learning_rate": 0.00013043478260869564,
1149
+ "loss": 0.2527,
1150
+ "step": 8000
1151
+ },
1152
+ {
1153
+ "epoch": 2.845528455284553,
1154
+ "grad_norm": 1.4348084926605225,
1155
+ "learning_rate": 0.00012937433722163308,
1156
+ "loss": 0.2465,
1157
+ "step": 8050
1158
+ },
1159
+ {
1160
+ "epoch": 2.863202545068929,
1161
+ "grad_norm": 1.2600926160812378,
1162
+ "learning_rate": 0.0001283138918345705,
1163
+ "loss": 0.1699,
1164
+ "step": 8100
1165
+ },
1166
+ {
1167
+ "epoch": 2.880876634853305,
1168
+ "grad_norm": 0.8724793195724487,
1169
+ "learning_rate": 0.00012725344644750795,
1170
+ "loss": 0.2257,
1171
+ "step": 8150
1172
+ },
1173
+ {
1174
+ "epoch": 2.898550724637681,
1175
+ "grad_norm": 1.5324125289916992,
1176
+ "learning_rate": 0.00012619300106044538,
1177
+ "loss": 0.2002,
1178
+ "step": 8200
1179
+ },
1180
+ {
1181
+ "epoch": 2.9162248144220575,
1182
+ "grad_norm": 1.0066156387329102,
1183
+ "learning_rate": 0.00012513255567338282,
1184
+ "loss": 0.192,
1185
+ "step": 8250
1186
+ },
1187
+ {
1188
+ "epoch": 2.9338989042064334,
1189
+ "grad_norm": 0.4273667633533478,
1190
+ "learning_rate": 0.00012407211028632022,
1191
+ "loss": 0.1758,
1192
+ "step": 8300
1193
+ },
1194
+ {
1195
+ "epoch": 2.9515729939908093,
1196
+ "grad_norm": 0.6536590456962585,
1197
+ "learning_rate": 0.00012301166489925766,
1198
+ "loss": 0.1905,
1199
+ "step": 8350
1200
+ },
1201
+ {
1202
+ "epoch": 2.9692470837751856,
1203
+ "grad_norm": 0.6973742246627808,
1204
+ "learning_rate": 0.00012195121951219511,
1205
+ "loss": 0.2116,
1206
+ "step": 8400
1207
+ },
1208
+ {
1209
+ "epoch": 2.9869211735595615,
1210
+ "grad_norm": 0.9764792919158936,
1211
+ "learning_rate": 0.00012089077412513254,
1212
+ "loss": 0.2098,
1213
+ "step": 8450
1214
+ },
1215
+ {
1216
+ "epoch": 3.0,
1217
+ "eval_bertscore_f1": 0.9710737692450385,
1218
+ "eval_bleu": 0.6330045835354601,
1219
+ "eval_loss": 0.15814107656478882,
1220
+ "eval_runtime": 1020.076,
1221
+ "eval_samples_per_second": 6.337,
1222
+ "eval_steps_per_second": 0.792,
1223
+ "step": 8487
1224
+ },
1225
+ {
1226
+ "epoch": 3.004595263343938,
1227
+ "grad_norm": 1.2752796411514282,
1228
+ "learning_rate": 0.00011983032873806998,
1229
+ "loss": 0.1815,
1230
+ "step": 8500
1231
+ },
1232
+ {
1233
+ "epoch": 3.022269353128314,
1234
+ "grad_norm": 1.1779205799102783,
1235
+ "learning_rate": 0.00011876988335100741,
1236
+ "loss": 0.2125,
1237
+ "step": 8550
1238
+ },
1239
+ {
1240
+ "epoch": 3.03994344291269,
1241
+ "grad_norm": 0.7505296468734741,
1242
+ "learning_rate": 0.00011770943796394485,
1243
+ "loss": 0.1989,
1244
+ "step": 8600
1245
+ },
1246
+ {
1247
+ "epoch": 3.057617532697066,
1248
+ "grad_norm": 4.621654033660889,
1249
+ "learning_rate": 0.00011664899257688228,
1250
+ "loss": 0.2015,
1251
+ "step": 8650
1252
+ },
1253
+ {
1254
+ "epoch": 3.0752916224814424,
1255
+ "grad_norm": 0.8159476518630981,
1256
+ "learning_rate": 0.0001155885471898197,
1257
+ "loss": 0.1685,
1258
+ "step": 8700
1259
+ },
1260
+ {
1261
+ "epoch": 3.0929657122658183,
1262
+ "grad_norm": 1.5748199224472046,
1263
+ "learning_rate": 0.00011452810180275714,
1264
+ "loss": 0.1748,
1265
+ "step": 8750
1266
+ },
1267
+ {
1268
+ "epoch": 3.110639802050194,
1269
+ "grad_norm": 2.3961069583892822,
1270
+ "learning_rate": 0.00011346765641569458,
1271
+ "loss": 0.2439,
1272
+ "step": 8800
1273
+ },
1274
+ {
1275
+ "epoch": 3.1283138918345705,
1276
+ "grad_norm": 1.1994341611862183,
1277
+ "learning_rate": 0.00011240721102863201,
1278
+ "loss": 0.1819,
1279
+ "step": 8850
1280
+ },
1281
+ {
1282
+ "epoch": 3.1459879816189464,
1283
+ "grad_norm": 1.4692330360412598,
1284
+ "learning_rate": 0.00011134676564156945,
1285
+ "loss": 0.1757,
1286
+ "step": 8900
1287
+ },
1288
+ {
1289
+ "epoch": 3.163662071403323,
1290
+ "grad_norm": 0.559505820274353,
1291
+ "learning_rate": 0.00011028632025450688,
1292
+ "loss": 0.1832,
1293
+ "step": 8950
1294
+ },
1295
+ {
1296
+ "epoch": 3.1813361611876987,
1297
+ "grad_norm": 0.608403205871582,
1298
+ "learning_rate": 0.00010922587486744433,
1299
+ "loss": 0.2094,
1300
+ "step": 9000
1301
+ },
1302
+ {
1303
+ "epoch": 3.199010250972075,
1304
+ "grad_norm": 0.9615042805671692,
1305
+ "learning_rate": 0.00010816542948038174,
1306
+ "loss": 0.1868,
1307
+ "step": 9050
1308
+ },
1309
+ {
1310
+ "epoch": 3.216684340756451,
1311
+ "grad_norm": 1.3172391653060913,
1312
+ "learning_rate": 0.00010710498409331917,
1313
+ "loss": 0.2161,
1314
+ "step": 9100
1315
+ },
1316
+ {
1317
+ "epoch": 3.2343584305408273,
1318
+ "grad_norm": 1.120377779006958,
1319
+ "learning_rate": 0.00010604453870625662,
1320
+ "loss": 0.1621,
1321
+ "step": 9150
1322
+ },
1323
+ {
1324
+ "epoch": 3.252032520325203,
1325
+ "grad_norm": 1.7331315279006958,
1326
+ "learning_rate": 0.00010498409331919406,
1327
+ "loss": 0.2172,
1328
+ "step": 9200
1329
+ },
1330
+ {
1331
+ "epoch": 3.2697066101095795,
1332
+ "grad_norm": 1.0575073957443237,
1333
+ "learning_rate": 0.00010392364793213149,
1334
+ "loss": 0.2013,
1335
+ "step": 9250
1336
+ },
1337
+ {
1338
+ "epoch": 3.2873806998939554,
1339
+ "grad_norm": 0.9054147601127625,
1340
+ "learning_rate": 0.00010286320254506893,
1341
+ "loss": 0.1648,
1342
+ "step": 9300
1343
+ },
1344
+ {
1345
+ "epoch": 3.3050547896783318,
1346
+ "grad_norm": 1.450341820716858,
1347
+ "learning_rate": 0.00010180275715800636,
1348
+ "loss": 0.1753,
1349
+ "step": 9350
1350
+ },
1351
+ {
1352
+ "epoch": 3.3227288794627077,
1353
+ "grad_norm": 1.1002529859542847,
1354
+ "learning_rate": 0.0001007423117709438,
1355
+ "loss": 0.1863,
1356
+ "step": 9400
1357
+ },
1358
+ {
1359
+ "epoch": 3.3404029692470836,
1360
+ "grad_norm": 0.9334053993225098,
1361
+ "learning_rate": 9.968186638388122e-05,
1362
+ "loss": 0.1702,
1363
+ "step": 9450
1364
+ },
1365
+ {
1366
+ "epoch": 3.35807705903146,
1367
+ "grad_norm": 0.8281420469284058,
1368
+ "learning_rate": 9.862142099681865e-05,
1369
+ "loss": 0.2526,
1370
+ "step": 9500
1371
+ },
1372
+ {
1373
+ "epoch": 3.375751148815836,
1374
+ "grad_norm": 1.2539646625518799,
1375
+ "learning_rate": 9.756097560975609e-05,
1376
+ "loss": 0.1894,
1377
+ "step": 9550
1378
+ },
1379
+ {
1380
+ "epoch": 3.393425238600212,
1381
+ "grad_norm": 0.949944794178009,
1382
+ "learning_rate": 9.650053022269352e-05,
1383
+ "loss": 0.1936,
1384
+ "step": 9600
1385
+ },
1386
+ {
1387
+ "epoch": 3.411099328384588,
1388
+ "grad_norm": 1.2891144752502441,
1389
+ "learning_rate": 9.544008483563096e-05,
1390
+ "loss": 0.1865,
1391
+ "step": 9650
1392
+ },
1393
+ {
1394
+ "epoch": 3.4287734181689644,
1395
+ "grad_norm": 0.5977984070777893,
1396
+ "learning_rate": 9.43796394485684e-05,
1397
+ "loss": 0.1484,
1398
+ "step": 9700
1399
+ },
1400
+ {
1401
+ "epoch": 3.4464475079533403,
1402
+ "grad_norm": 0.3996190130710602,
1403
+ "learning_rate": 9.331919406150583e-05,
1404
+ "loss": 0.2573,
1405
+ "step": 9750
1406
+ },
1407
+ {
1408
+ "epoch": 3.4641215977377167,
1409
+ "grad_norm": 1.8965319395065308,
1410
+ "learning_rate": 9.225874867444325e-05,
1411
+ "loss": 0.195,
1412
+ "step": 9800
1413
+ },
1414
+ {
1415
+ "epoch": 3.4817956875220926,
1416
+ "grad_norm": 1.197365403175354,
1417
+ "learning_rate": 9.119830328738069e-05,
1418
+ "loss": 0.2083,
1419
+ "step": 9850
1420
+ },
1421
+ {
1422
+ "epoch": 3.499469777306469,
1423
+ "grad_norm": 0.6886301040649414,
1424
+ "learning_rate": 9.013785790031812e-05,
1425
+ "loss": 0.2112,
1426
+ "step": 9900
1427
+ },
1428
+ {
1429
+ "epoch": 3.517143867090845,
1430
+ "grad_norm": 0.677227795124054,
1431
+ "learning_rate": 8.907741251325556e-05,
1432
+ "loss": 0.1789,
1433
+ "step": 9950
1434
+ },
1435
+ {
1436
+ "epoch": 3.534817956875221,
1437
+ "grad_norm": 1.131480097770691,
1438
+ "learning_rate": 8.801696712619299e-05,
1439
+ "loss": 0.1857,
1440
+ "step": 10000
1441
+ },
1442
+ {
1443
+ "epoch": 3.552492046659597,
1444
+ "grad_norm": 1.6898012161254883,
1445
+ "learning_rate": 8.695652173913043e-05,
1446
+ "loss": 0.197,
1447
+ "step": 10050
1448
+ },
1449
+ {
1450
+ "epoch": 3.570166136443973,
1451
+ "grad_norm": 1.6000021696090698,
1452
+ "learning_rate": 8.589607635206786e-05,
1453
+ "loss": 0.2028,
1454
+ "step": 10100
1455
+ },
1456
+ {
1457
+ "epoch": 3.5878402262283493,
1458
+ "grad_norm": 0.59913170337677,
1459
+ "learning_rate": 8.48356309650053e-05,
1460
+ "loss": 0.2056,
1461
+ "step": 10150
1462
+ },
1463
+ {
1464
+ "epoch": 3.605514316012725,
1465
+ "grad_norm": 1.2439507246017456,
1466
+ "learning_rate": 8.377518557794272e-05,
1467
+ "loss": 0.264,
1468
+ "step": 10200
1469
+ },
1470
+ {
1471
+ "epoch": 3.6231884057971016,
1472
+ "grad_norm": 1.2470340728759766,
1473
+ "learning_rate": 8.271474019088015e-05,
1474
+ "loss": 0.1818,
1475
+ "step": 10250
1476
+ },
1477
+ {
1478
+ "epoch": 3.6408624955814775,
1479
+ "grad_norm": 0.8461691737174988,
1480
+ "learning_rate": 8.165429480381759e-05,
1481
+ "loss": 0.1893,
1482
+ "step": 10300
1483
+ },
1484
+ {
1485
+ "epoch": 3.658536585365854,
1486
+ "grad_norm": 1.161589503288269,
1487
+ "learning_rate": 8.059384941675502e-05,
1488
+ "loss": 0.183,
1489
+ "step": 10350
1490
+ },
1491
+ {
1492
+ "epoch": 3.6762106751502297,
1493
+ "grad_norm": 1.1066420078277588,
1494
+ "learning_rate": 7.953340402969246e-05,
1495
+ "loss": 0.2059,
1496
+ "step": 10400
1497
+ },
1498
+ {
1499
+ "epoch": 3.693884764934606,
1500
+ "grad_norm": 0.04225541278719902,
1501
+ "learning_rate": 7.847295864262991e-05,
1502
+ "loss": 0.1579,
1503
+ "step": 10450
1504
+ },
1505
+ {
1506
+ "epoch": 3.711558854718982,
1507
+ "grad_norm": 2.536710500717163,
1508
+ "learning_rate": 7.741251325556734e-05,
1509
+ "loss": 0.2092,
1510
+ "step": 10500
1511
+ },
1512
+ {
1513
+ "epoch": 3.729232944503358,
1514
+ "grad_norm": 0.49366581439971924,
1515
+ "learning_rate": 7.635206786850475e-05,
1516
+ "loss": 0.2148,
1517
+ "step": 10550
1518
+ },
1519
+ {
1520
+ "epoch": 3.746907034287734,
1521
+ "grad_norm": 0.5715583562850952,
1522
+ "learning_rate": 7.529162248144219e-05,
1523
+ "loss": 0.1697,
1524
+ "step": 10600
1525
+ },
1526
+ {
1527
+ "epoch": 3.7645811240721105,
1528
+ "grad_norm": 0.6103105545043945,
1529
+ "learning_rate": 7.423117709437964e-05,
1530
+ "loss": 0.1631,
1531
+ "step": 10650
1532
+ },
1533
+ {
1534
+ "epoch": 3.7822552138564864,
1535
+ "grad_norm": 0.6263866424560547,
1536
+ "learning_rate": 7.317073170731707e-05,
1537
+ "loss": 0.211,
1538
+ "step": 10700
1539
+ },
1540
+ {
1541
+ "epoch": 3.7999293036408623,
1542
+ "grad_norm": 2.3304359912872314,
1543
+ "learning_rate": 7.21102863202545e-05,
1544
+ "loss": 0.2101,
1545
+ "step": 10750
1546
+ },
1547
+ {
1548
+ "epoch": 3.8176033934252387,
1549
+ "grad_norm": 0.96124666929245,
1550
+ "learning_rate": 7.104984093319194e-05,
1551
+ "loss": 0.2033,
1552
+ "step": 10800
1553
+ },
1554
+ {
1555
+ "epoch": 3.8352774832096146,
1556
+ "grad_norm": 0.8838850855827332,
1557
+ "learning_rate": 6.998939554612936e-05,
1558
+ "loss": 0.1686,
1559
+ "step": 10850
1560
+ },
1561
+ {
1562
+ "epoch": 3.852951572993991,
1563
+ "grad_norm": 0.40561985969543457,
1564
+ "learning_rate": 6.89289501590668e-05,
1565
+ "loss": 0.1584,
1566
+ "step": 10900
1567
+ },
1568
+ {
1569
+ "epoch": 3.870625662778367,
1570
+ "grad_norm": 0.1844971626996994,
1571
+ "learning_rate": 6.788971367974548e-05,
1572
+ "loss": 0.1804,
1573
+ "step": 10950
1574
+ },
1575
+ {
1576
+ "epoch": 3.888299752562743,
1577
+ "grad_norm": 0.16500629484653473,
1578
+ "learning_rate": 6.682926829268293e-05,
1579
+ "loss": 0.1573,
1580
+ "step": 11000
1581
+ },
1582
+ {
1583
+ "epoch": 3.905973842347119,
1584
+ "grad_norm": 1.1422902345657349,
1585
+ "learning_rate": 6.576882290562035e-05,
1586
+ "loss": 0.168,
1587
+ "step": 11050
1588
+ },
1589
+ {
1590
+ "epoch": 3.9236479321314954,
1591
+ "grad_norm": 1.0575031042099,
1592
+ "learning_rate": 6.470837751855779e-05,
1593
+ "loss": 0.1839,
1594
+ "step": 11100
1595
+ },
1596
+ {
1597
+ "epoch": 3.9413220219158713,
1598
+ "grad_norm": 1.222320318222046,
1599
+ "learning_rate": 6.364793213149522e-05,
1600
+ "loss": 0.184,
1601
+ "step": 11150
1602
+ },
1603
+ {
1604
+ "epoch": 3.9589961117002472,
1605
+ "grad_norm": 1.2237067222595215,
1606
+ "learning_rate": 6.258748674443266e-05,
1607
+ "loss": 0.1593,
1608
+ "step": 11200
1609
+ },
1610
+ {
1611
+ "epoch": 3.9766702014846236,
1612
+ "grad_norm": 0.5730044841766357,
1613
+ "learning_rate": 6.152704135737009e-05,
1614
+ "loss": 0.1952,
1615
+ "step": 11250
1616
+ },
1617
+ {
1618
+ "epoch": 3.9943442912689995,
1619
+ "grad_norm": 1.0718284845352173,
1620
+ "learning_rate": 6.046659597030752e-05,
1621
+ "loss": 0.2006,
1622
+ "step": 11300
1623
+ },
1624
+ {
1625
+ "epoch": 4.0,
1626
+ "eval_bertscore_f1": 0.971733581422284,
1627
+ "eval_bleu": 0.6349849586545804,
1628
+ "eval_loss": 0.14258554577827454,
1629
+ "eval_runtime": 1019.3837,
1630
+ "eval_samples_per_second": 6.341,
1631
+ "eval_steps_per_second": 0.793,
1632
+ "step": 11316
1633
+ },
1634
+ {
1635
+ "epoch": 4.012018381053376,
1636
+ "grad_norm": 1.2913243770599365,
1637
+ "learning_rate": 5.940615058324496e-05,
1638
+ "loss": 0.1864,
1639
+ "step": 11350
1640
+ },
1641
+ {
1642
+ "epoch": 4.029692470837752,
1643
+ "grad_norm": 0.7768388390541077,
1644
+ "learning_rate": 5.8345705196182385e-05,
1645
+ "loss": 0.1761,
1646
+ "step": 11400
1647
+ },
1648
+ {
1649
+ "epoch": 4.047366560622128,
1650
+ "grad_norm": 1.3466072082519531,
1651
+ "learning_rate": 5.728525980911983e-05,
1652
+ "loss": 0.149,
1653
+ "step": 11450
1654
+ },
1655
+ {
1656
+ "epoch": 4.065040650406504,
1657
+ "grad_norm": 0.5589826703071594,
1658
+ "learning_rate": 5.622481442205726e-05,
1659
+ "loss": 0.1951,
1660
+ "step": 11500
1661
+ },
1662
+ {
1663
+ "epoch": 4.08271474019088,
1664
+ "grad_norm": 1.1719962358474731,
1665
+ "learning_rate": 5.51643690349947e-05,
1666
+ "loss": 0.1893,
1667
+ "step": 11550
1668
+ },
1669
+ {
1670
+ "epoch": 4.100388829975256,
1671
+ "grad_norm": 1.6090291738510132,
1672
+ "learning_rate": 5.4103923647932125e-05,
1673
+ "loss": 0.1669,
1674
+ "step": 11600
1675
+ },
1676
+ {
1677
+ "epoch": 4.118062919759632,
1678
+ "grad_norm": 0.7359048128128052,
1679
+ "learning_rate": 5.304347826086956e-05,
1680
+ "loss": 0.182,
1681
+ "step": 11650
1682
+ },
1683
+ {
1684
+ "epoch": 4.135737009544009,
1685
+ "grad_norm": 1.337510347366333,
1686
+ "learning_rate": 5.1983032873806996e-05,
1687
+ "loss": 0.1894,
1688
+ "step": 11700
1689
+ },
1690
+ {
1691
+ "epoch": 4.153411099328385,
1692
+ "grad_norm": 1.1865614652633667,
1693
+ "learning_rate": 5.092258748674443e-05,
1694
+ "loss": 0.1898,
1695
+ "step": 11750
1696
+ },
1697
+ {
1698
+ "epoch": 4.171085189112761,
1699
+ "grad_norm": 1.8255292177200317,
1700
+ "learning_rate": 4.986214209968186e-05,
1701
+ "loss": 0.1716,
1702
+ "step": 11800
1703
+ },
1704
+ {
1705
+ "epoch": 4.188759278897137,
1706
+ "grad_norm": 0.624253511428833,
1707
+ "learning_rate": 4.8801696712619294e-05,
1708
+ "loss": 0.1766,
1709
+ "step": 11850
1710
+ },
1711
+ {
1712
+ "epoch": 4.2064333686815125,
1713
+ "grad_norm": 0.9569867253303528,
1714
+ "learning_rate": 4.774125132555673e-05,
1715
+ "loss": 0.1458,
1716
+ "step": 11900
1717
+ },
1718
+ {
1719
+ "epoch": 4.224107458465889,
1720
+ "grad_norm": 0.9596979022026062,
1721
+ "learning_rate": 4.6680805938494165e-05,
1722
+ "loss": 0.1808,
1723
+ "step": 11950
1724
+ },
1725
+ {
1726
+ "epoch": 4.241781548250265,
1727
+ "grad_norm": 1.014739751815796,
1728
+ "learning_rate": 4.562036055143159e-05,
1729
+ "loss": 0.1918,
1730
+ "step": 12000
1731
+ },
1732
+ {
1733
+ "epoch": 4.259455638034641,
1734
+ "grad_norm": 1.2566267251968384,
1735
+ "learning_rate": 4.455991516436903e-05,
1736
+ "loss": 0.1581,
1737
+ "step": 12050
1738
+ },
1739
+ {
1740
+ "epoch": 4.277129727819017,
1741
+ "grad_norm": 0.7401285171508789,
1742
+ "learning_rate": 4.349946977730647e-05,
1743
+ "loss": 0.164,
1744
+ "step": 12100
1745
+ },
1746
+ {
1747
+ "epoch": 4.294803817603394,
1748
+ "grad_norm": 0.43340951204299927,
1749
+ "learning_rate": 4.243902439024389e-05,
1750
+ "loss": 0.1722,
1751
+ "step": 12150
1752
+ },
1753
+ {
1754
+ "epoch": 4.31247790738777,
1755
+ "grad_norm": 4.859116554260254,
1756
+ "learning_rate": 4.1378579003181334e-05,
1757
+ "loss": 0.1986,
1758
+ "step": 12200
1759
+ },
1760
+ {
1761
+ "epoch": 4.330151997172146,
1762
+ "grad_norm": 1.3189374208450317,
1763
+ "learning_rate": 4.031813361611877e-05,
1764
+ "loss": 0.2118,
1765
+ "step": 12250
1766
+ },
1767
+ {
1768
+ "epoch": 4.3478260869565215,
1769
+ "grad_norm": 0.6523744463920593,
1770
+ "learning_rate": 3.9257688229056204e-05,
1771
+ "loss": 0.1974,
1772
+ "step": 12300
1773
+ },
1774
+ {
1775
+ "epoch": 4.365500176740898,
1776
+ "grad_norm": 0.5694284439086914,
1777
+ "learning_rate": 3.819724284199363e-05,
1778
+ "loss": 0.2032,
1779
+ "step": 12350
1780
+ },
1781
+ {
1782
+ "epoch": 4.383174266525274,
1783
+ "grad_norm": 0.6631605625152588,
1784
+ "learning_rate": 3.713679745493107e-05,
1785
+ "loss": 0.1648,
1786
+ "step": 12400
1787
+ },
1788
+ {
1789
+ "epoch": 4.40084835630965,
1790
+ "grad_norm": 1.4959896802902222,
1791
+ "learning_rate": 3.60763520678685e-05,
1792
+ "loss": 0.1397,
1793
+ "step": 12450
1794
+ },
1795
+ {
1796
+ "epoch": 4.418522446094026,
1797
+ "grad_norm": 0.8434396982192993,
1798
+ "learning_rate": 3.501590668080594e-05,
1799
+ "loss": 0.1834,
1800
+ "step": 12500
1801
+ },
1802
+ {
1803
+ "epoch": 4.436196535878402,
1804
+ "grad_norm": 0.748446524143219,
1805
+ "learning_rate": 3.395546129374337e-05,
1806
+ "loss": 0.1916,
1807
+ "step": 12550
1808
+ },
1809
+ {
1810
+ "epoch": 4.453870625662779,
1811
+ "grad_norm": 1.5315219163894653,
1812
+ "learning_rate": 3.28950159066808e-05,
1813
+ "loss": 0.1696,
1814
+ "step": 12600
1815
+ },
1816
+ {
1817
+ "epoch": 4.471544715447155,
1818
+ "grad_norm": 0.81038498878479,
1819
+ "learning_rate": 3.1834570519618236e-05,
1820
+ "loss": 0.1861,
1821
+ "step": 12650
1822
+ },
1823
+ {
1824
+ "epoch": 4.4892188052315305,
1825
+ "grad_norm": 0.5976743102073669,
1826
+ "learning_rate": 3.077412513255567e-05,
1827
+ "loss": 0.2113,
1828
+ "step": 12700
1829
+ },
1830
+ {
1831
+ "epoch": 4.506892895015906,
1832
+ "grad_norm": 0.806030809879303,
1833
+ "learning_rate": 2.9713679745493106e-05,
1834
+ "loss": 0.1571,
1835
+ "step": 12750
1836
+ },
1837
+ {
1838
+ "epoch": 4.524566984800282,
1839
+ "grad_norm": 1.6976985931396484,
1840
+ "learning_rate": 2.8653234358430538e-05,
1841
+ "loss": 0.167,
1842
+ "step": 12800
1843
+ },
1844
+ {
1845
+ "epoch": 4.542241074584659,
1846
+ "grad_norm": 0.8575769662857056,
1847
+ "learning_rate": 2.7592788971367973e-05,
1848
+ "loss": 0.1551,
1849
+ "step": 12850
1850
+ },
1851
+ {
1852
+ "epoch": 4.559915164369035,
1853
+ "grad_norm": 0.8071011900901794,
1854
+ "learning_rate": 2.6532343584305405e-05,
1855
+ "loss": 0.197,
1856
+ "step": 12900
1857
+ },
1858
+ {
1859
+ "epoch": 4.577589254153411,
1860
+ "grad_norm": 0.8892520666122437,
1861
+ "learning_rate": 2.547189819724284e-05,
1862
+ "loss": 0.1766,
1863
+ "step": 12950
1864
+ },
1865
+ {
1866
+ "epoch": 4.595263343937788,
1867
+ "grad_norm": 1.0027281045913696,
1868
+ "learning_rate": 2.4411452810180272e-05,
1869
+ "loss": 0.1826,
1870
+ "step": 13000
1871
+ },
1872
+ {
1873
+ "epoch": 4.612937433722164,
1874
+ "grad_norm": 1.3052587509155273,
1875
+ "learning_rate": 2.3351007423117707e-05,
1876
+ "loss": 0.1779,
1877
+ "step": 13050
1878
+ },
1879
+ {
1880
+ "epoch": 4.6306115235065395,
1881
+ "grad_norm": 1.1934298276901245,
1882
+ "learning_rate": 2.2290562036055142e-05,
1883
+ "loss": 0.1585,
1884
+ "step": 13100
1885
+ },
1886
+ {
1887
+ "epoch": 4.648285613290915,
1888
+ "grad_norm": 1.305802583694458,
1889
+ "learning_rate": 2.1251325556733824e-05,
1890
+ "loss": 0.1689,
1891
+ "step": 13150
1892
+ },
1893
+ {
1894
+ "epoch": 4.665959703075291,
1895
+ "grad_norm": 1.010707974433899,
1896
+ "learning_rate": 2.0190880169671262e-05,
1897
+ "loss": 0.1975,
1898
+ "step": 13200
1899
+ },
1900
+ {
1901
+ "epoch": 4.683633792859668,
1902
+ "grad_norm": 0.8816762566566467,
1903
+ "learning_rate": 1.9130434782608694e-05,
1904
+ "loss": 0.1395,
1905
+ "step": 13250
1906
+ },
1907
+ {
1908
+ "epoch": 4.701307882644044,
1909
+ "grad_norm": 0.9856722950935364,
1910
+ "learning_rate": 1.8069989395546126e-05,
1911
+ "loss": 0.2111,
1912
+ "step": 13300
1913
+ },
1914
+ {
1915
+ "epoch": 4.71898197242842,
1916
+ "grad_norm": 1.1348321437835693,
1917
+ "learning_rate": 1.700954400848356e-05,
1918
+ "loss": 0.1715,
1919
+ "step": 13350
1920
+ },
1921
+ {
1922
+ "epoch": 4.736656062212796,
1923
+ "grad_norm": 1.5361067056655884,
1924
+ "learning_rate": 1.5949098621420996e-05,
1925
+ "loss": 0.1569,
1926
+ "step": 13400
1927
+ },
1928
+ {
1929
+ "epoch": 4.754330151997172,
1930
+ "grad_norm": 0.6704153418540955,
1931
+ "learning_rate": 1.488865323435843e-05,
1932
+ "loss": 0.1518,
1933
+ "step": 13450
1934
+ },
1935
+ {
1936
+ "epoch": 4.7720042417815485,
1937
+ "grad_norm": 1.731184482574463,
1938
+ "learning_rate": 1.3828207847295863e-05,
1939
+ "loss": 0.1671,
1940
+ "step": 13500
1941
+ },
1942
+ {
1943
+ "epoch": 4.789678331565924,
1944
+ "grad_norm": 0.18779240548610687,
1945
+ "learning_rate": 1.2767762460233296e-05,
1946
+ "loss": 0.163,
1947
+ "step": 13550
1948
+ },
1949
+ {
1950
+ "epoch": 4.8073524213503,
1951
+ "grad_norm": 0.5464810132980347,
1952
+ "learning_rate": 1.1707317073170731e-05,
1953
+ "loss": 0.1998,
1954
+ "step": 13600
1955
+ },
1956
+ {
1957
+ "epoch": 4.825026511134676,
1958
+ "grad_norm": 1.0994397401809692,
1959
+ "learning_rate": 1.0646871686108165e-05,
1960
+ "loss": 0.1997,
1961
+ "step": 13650
1962
+ },
1963
+ {
1964
+ "epoch": 4.842700600919053,
1965
+ "grad_norm": 1.5267748832702637,
1966
+ "learning_rate": 9.586426299045598e-06,
1967
+ "loss": 0.1643,
1968
+ "step": 13700
1969
+ },
1970
+ {
1971
+ "epoch": 4.860374690703429,
1972
+ "grad_norm": 0.586216151714325,
1973
+ "learning_rate": 8.525980911983032e-06,
1974
+ "loss": 0.1661,
1975
+ "step": 13750
1976
+ },
1977
+ {
1978
+ "epoch": 4.878048780487805,
1979
+ "grad_norm": 1.5473626852035522,
1980
+ "learning_rate": 7.465535524920466e-06,
1981
+ "loss": 0.1584,
1982
+ "step": 13800
1983
+ },
1984
+ {
1985
+ "epoch": 4.895722870272181,
1986
+ "grad_norm": 0.5935518741607666,
1987
+ "learning_rate": 6.4050901378578995e-06,
1988
+ "loss": 0.1695,
1989
+ "step": 13850
1990
+ },
1991
+ {
1992
+ "epoch": 4.9133969600565575,
1993
+ "grad_norm": 1.2073270082473755,
1994
+ "learning_rate": 5.344644750795333e-06,
1995
+ "loss": 0.168,
1996
+ "step": 13900
1997
+ },
1998
+ {
1999
+ "epoch": 4.931071049840933,
2000
+ "grad_norm": 0.43232324719429016,
2001
+ "learning_rate": 4.284199363732767e-06,
2002
+ "loss": 0.1631,
2003
+ "step": 13950
2004
+ },
2005
+ {
2006
+ "epoch": 4.948745139625309,
2007
+ "grad_norm": 1.4200788736343384,
2008
+ "learning_rate": 3.223753976670201e-06,
2009
+ "loss": 0.1997,
2010
+ "step": 14000
2011
+ },
2012
+ {
2013
+ "epoch": 4.966419229409685,
2014
+ "grad_norm": 0.20576679706573486,
2015
+ "learning_rate": 2.163308589607635e-06,
2016
+ "loss": 0.1642,
2017
+ "step": 14050
2018
+ },
2019
+ {
2020
+ "epoch": 4.984093319194061,
2021
+ "grad_norm": 0.6973247528076172,
2022
+ "learning_rate": 1.1028632025450689e-06,
2023
+ "loss": 0.1908,
2024
+ "step": 14100
2025
+ },
2026
+ {
2027
+ "epoch": 5.0,
2028
+ "eval_bertscore_f1": 0.9718361922106383,
2029
+ "eval_bleu": 0.6364935942381945,
2030
+ "eval_loss": 0.13659338653087616,
2031
+ "eval_runtime": 1013.1078,
2032
+ "eval_samples_per_second": 6.38,
2033
+ "eval_steps_per_second": 0.798,
2034
+ "step": 14145
2035
+ }
2036
+ ],
2037
+ "logging_steps": 50,
2038
+ "max_steps": 14145,
2039
+ "num_input_tokens_seen": 0,
2040
+ "num_train_epochs": 5,
2041
+ "save_steps": 500,
2042
+ "stateful_callbacks": {
2043
+ "TrainerControl": {
2044
+ "args": {
2045
+ "should_epoch_stop": false,
2046
+ "should_evaluate": false,
2047
+ "should_log": false,
2048
+ "should_save": true,
2049
+ "should_training_stop": true
2050
+ },
2051
+ "attributes": {}
2052
+ }
2053
+ },
2054
+ "total_flos": 1.730048539557888e+16,
2055
+ "train_batch_size": 8,
2056
+ "trial_name": null,
2057
+ "trial_params": null
2058
+ }
checkpoint-14145/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ee513a34fdce19a0629cc9aa4ea661dbd2cb881304d77bffec8f2b929d97943
3
+ size 5432
checkpoint-14145/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-2829/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Salesforce/codet5-base
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.15.2
checkpoint-2829/adapter_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Salesforce/codet5-base",
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": true,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 16,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0.1,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "r": 8,
24
+ "rank_pattern": {},
25
+ "revision": null,
26
+ "target_modules": [
27
+ "q",
28
+ "v"
29
+ ],
30
+ "task_type": "SEQ_2_SEQ_LM",
31
+ "trainable_token_indices": null,
32
+ "use_dora": false,
33
+ "use_rslora": false
34
+ }
checkpoint-2829/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f9922cdee03551d8e8dd9cb6259d9f30edf1c1f49f4864a56a6d1c3f8995c92
3
+ size 3558888
checkpoint-2829/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-2829/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:112f5c8210cf6487081a5d03f7c66a40852e66d89f7c1394475cbdf3478d1789
3
+ size 7198906
checkpoint-2829/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c97783621e71cbe29e01a57da9a71edeb763dd2270faf812ebf719134716d58
3
+ size 14244
checkpoint-2829/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22880f144fb19623ebc62214b7e583ea6b1913725bf5c8b19e77f9a9f6ba4442
3
+ size 988
checkpoint-2829/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31ca510384a761356eb77b942726cb33cbdea8cba6a28fae8d3b8b0b931aa60b
3
+ size 1064
checkpoint-2829/special_tokens_map.json ADDED
@@ -0,0 +1,753 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ {
4
+ "content": "<extra_id_99>",
5
+ "lstrip": true,
6
+ "normalized": true,
7
+ "rstrip": false,
8
+ "single_word": false
9
+ },
10
+ {
11
+ "content": "<extra_id_98>",
12
+ "lstrip": true,
13
+ "normalized": true,
14
+ "rstrip": false,
15
+ "single_word": false
16
+ },
17
+ {
18
+ "content": "<extra_id_97>",
19
+ "lstrip": true,
20
+ "normalized": true,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ {
25
+ "content": "<extra_id_96>",
26
+ "lstrip": true,
27
+ "normalized": true,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ },
31
+ {
32
+ "content": "<extra_id_95>",
33
+ "lstrip": true,
34
+ "normalized": true,
35
+ "rstrip": false,
36
+ "single_word": false
37
+ },
38
+ {
39
+ "content": "<extra_id_94>",
40
+ "lstrip": true,
41
+ "normalized": true,
42
+ "rstrip": false,
43
+ "single_word": false
44
+ },
45
+ {
46
+ "content": "<extra_id_93>",
47
+ "lstrip": true,
48
+ "normalized": true,
49
+ "rstrip": false,
50
+ "single_word": false
51
+ },
52
+ {
53
+ "content": "<extra_id_92>",
54
+ "lstrip": true,
55
+ "normalized": true,
56
+ "rstrip": false,
57
+ "single_word": false
58
+ },
59
+ {
60
+ "content": "<extra_id_91>",
61
+ "lstrip": true,
62
+ "normalized": true,
63
+ "rstrip": false,
64
+ "single_word": false
65
+ },
66
+ {
67
+ "content": "<extra_id_90>",
68
+ "lstrip": true,
69
+ "normalized": true,
70
+ "rstrip": false,
71
+ "single_word": false
72
+ },
73
+ {
74
+ "content": "<extra_id_89>",
75
+ "lstrip": true,
76
+ "normalized": true,
77
+ "rstrip": false,
78
+ "single_word": false
79
+ },
80
+ {
81
+ "content": "<extra_id_88>",
82
+ "lstrip": true,
83
+ "normalized": true,
84
+ "rstrip": false,
85
+ "single_word": false
86
+ },
87
+ {
88
+ "content": "<extra_id_87>",
89
+ "lstrip": true,
90
+ "normalized": true,
91
+ "rstrip": false,
92
+ "single_word": false
93
+ },
94
+ {
95
+ "content": "<extra_id_86>",
96
+ "lstrip": true,
97
+ "normalized": true,
98
+ "rstrip": false,
99
+ "single_word": false
100
+ },
101
+ {
102
+ "content": "<extra_id_85>",
103
+ "lstrip": true,
104
+ "normalized": true,
105
+ "rstrip": false,
106
+ "single_word": false
107
+ },
108
+ {
109
+ "content": "<extra_id_84>",
110
+ "lstrip": true,
111
+ "normalized": true,
112
+ "rstrip": false,
113
+ "single_word": false
114
+ },
115
+ {
116
+ "content": "<extra_id_83>",
117
+ "lstrip": true,
118
+ "normalized": true,
119
+ "rstrip": false,
120
+ "single_word": false
121
+ },
122
+ {
123
+ "content": "<extra_id_82>",
124
+ "lstrip": true,
125
+ "normalized": true,
126
+ "rstrip": false,
127
+ "single_word": false
128
+ },
129
+ {
130
+ "content": "<extra_id_81>",
131
+ "lstrip": true,
132
+ "normalized": true,
133
+ "rstrip": false,
134
+ "single_word": false
135
+ },
136
+ {
137
+ "content": "<extra_id_80>",
138
+ "lstrip": true,
139
+ "normalized": true,
140
+ "rstrip": false,
141
+ "single_word": false
142
+ },
143
+ {
144
+ "content": "<extra_id_79>",
145
+ "lstrip": true,
146
+ "normalized": true,
147
+ "rstrip": false,
148
+ "single_word": false
149
+ },
150
+ {
151
+ "content": "<extra_id_78>",
152
+ "lstrip": true,
153
+ "normalized": true,
154
+ "rstrip": false,
155
+ "single_word": false
156
+ },
157
+ {
158
+ "content": "<extra_id_77>",
159
+ "lstrip": true,
160
+ "normalized": true,
161
+ "rstrip": false,
162
+ "single_word": false
163
+ },
164
+ {
165
+ "content": "<extra_id_76>",
166
+ "lstrip": true,
167
+ "normalized": true,
168
+ "rstrip": false,
169
+ "single_word": false
170
+ },
171
+ {
172
+ "content": "<extra_id_75>",
173
+ "lstrip": true,
174
+ "normalized": true,
175
+ "rstrip": false,
176
+ "single_word": false
177
+ },
178
+ {
179
+ "content": "<extra_id_74>",
180
+ "lstrip": true,
181
+ "normalized": true,
182
+ "rstrip": false,
183
+ "single_word": false
184
+ },
185
+ {
186
+ "content": "<extra_id_73>",
187
+ "lstrip": true,
188
+ "normalized": true,
189
+ "rstrip": false,
190
+ "single_word": false
191
+ },
192
+ {
193
+ "content": "<extra_id_72>",
194
+ "lstrip": true,
195
+ "normalized": true,
196
+ "rstrip": false,
197
+ "single_word": false
198
+ },
199
+ {
200
+ "content": "<extra_id_71>",
201
+ "lstrip": true,
202
+ "normalized": true,
203
+ "rstrip": false,
204
+ "single_word": false
205
+ },
206
+ {
207
+ "content": "<extra_id_70>",
208
+ "lstrip": true,
209
+ "normalized": true,
210
+ "rstrip": false,
211
+ "single_word": false
212
+ },
213
+ {
214
+ "content": "<extra_id_69>",
215
+ "lstrip": true,
216
+ "normalized": true,
217
+ "rstrip": false,
218
+ "single_word": false
219
+ },
220
+ {
221
+ "content": "<extra_id_68>",
222
+ "lstrip": true,
223
+ "normalized": true,
224
+ "rstrip": false,
225
+ "single_word": false
226
+ },
227
+ {
228
+ "content": "<extra_id_67>",
229
+ "lstrip": true,
230
+ "normalized": true,
231
+ "rstrip": false,
232
+ "single_word": false
233
+ },
234
+ {
235
+ "content": "<extra_id_66>",
236
+ "lstrip": true,
237
+ "normalized": true,
238
+ "rstrip": false,
239
+ "single_word": false
240
+ },
241
+ {
242
+ "content": "<extra_id_65>",
243
+ "lstrip": true,
244
+ "normalized": true,
245
+ "rstrip": false,
246
+ "single_word": false
247
+ },
248
+ {
249
+ "content": "<extra_id_64>",
250
+ "lstrip": true,
251
+ "normalized": true,
252
+ "rstrip": false,
253
+ "single_word": false
254
+ },
255
+ {
256
+ "content": "<extra_id_63>",
257
+ "lstrip": true,
258
+ "normalized": true,
259
+ "rstrip": false,
260
+ "single_word": false
261
+ },
262
+ {
263
+ "content": "<extra_id_62>",
264
+ "lstrip": true,
265
+ "normalized": true,
266
+ "rstrip": false,
267
+ "single_word": false
268
+ },
269
+ {
270
+ "content": "<extra_id_61>",
271
+ "lstrip": true,
272
+ "normalized": true,
273
+ "rstrip": false,
274
+ "single_word": false
275
+ },
276
+ {
277
+ "content": "<extra_id_60>",
278
+ "lstrip": true,
279
+ "normalized": true,
280
+ "rstrip": false,
281
+ "single_word": false
282
+ },
283
+ {
284
+ "content": "<extra_id_59>",
285
+ "lstrip": true,
286
+ "normalized": true,
287
+ "rstrip": false,
288
+ "single_word": false
289
+ },
290
+ {
291
+ "content": "<extra_id_58>",
292
+ "lstrip": true,
293
+ "normalized": true,
294
+ "rstrip": false,
295
+ "single_word": false
296
+ },
297
+ {
298
+ "content": "<extra_id_57>",
299
+ "lstrip": true,
300
+ "normalized": true,
301
+ "rstrip": false,
302
+ "single_word": false
303
+ },
304
+ {
305
+ "content": "<extra_id_56>",
306
+ "lstrip": true,
307
+ "normalized": true,
308
+ "rstrip": false,
309
+ "single_word": false
310
+ },
311
+ {
312
+ "content": "<extra_id_55>",
313
+ "lstrip": true,
314
+ "normalized": true,
315
+ "rstrip": false,
316
+ "single_word": false
317
+ },
318
+ {
319
+ "content": "<extra_id_54>",
320
+ "lstrip": true,
321
+ "normalized": true,
322
+ "rstrip": false,
323
+ "single_word": false
324
+ },
325
+ {
326
+ "content": "<extra_id_53>",
327
+ "lstrip": true,
328
+ "normalized": true,
329
+ "rstrip": false,
330
+ "single_word": false
331
+ },
332
+ {
333
+ "content": "<extra_id_52>",
334
+ "lstrip": true,
335
+ "normalized": true,
336
+ "rstrip": false,
337
+ "single_word": false
338
+ },
339
+ {
340
+ "content": "<extra_id_51>",
341
+ "lstrip": true,
342
+ "normalized": true,
343
+ "rstrip": false,
344
+ "single_word": false
345
+ },
346
+ {
347
+ "content": "<extra_id_50>",
348
+ "lstrip": true,
349
+ "normalized": true,
350
+ "rstrip": false,
351
+ "single_word": false
352
+ },
353
+ {
354
+ "content": "<extra_id_49>",
355
+ "lstrip": true,
356
+ "normalized": true,
357
+ "rstrip": false,
358
+ "single_word": false
359
+ },
360
+ {
361
+ "content": "<extra_id_48>",
362
+ "lstrip": true,
363
+ "normalized": true,
364
+ "rstrip": false,
365
+ "single_word": false
366
+ },
367
+ {
368
+ "content": "<extra_id_47>",
369
+ "lstrip": true,
370
+ "normalized": true,
371
+ "rstrip": false,
372
+ "single_word": false
373
+ },
374
+ {
375
+ "content": "<extra_id_46>",
376
+ "lstrip": true,
377
+ "normalized": true,
378
+ "rstrip": false,
379
+ "single_word": false
380
+ },
381
+ {
382
+ "content": "<extra_id_45>",
383
+ "lstrip": true,
384
+ "normalized": true,
385
+ "rstrip": false,
386
+ "single_word": false
387
+ },
388
+ {
389
+ "content": "<extra_id_44>",
390
+ "lstrip": true,
391
+ "normalized": true,
392
+ "rstrip": false,
393
+ "single_word": false
394
+ },
395
+ {
396
+ "content": "<extra_id_43>",
397
+ "lstrip": true,
398
+ "normalized": true,
399
+ "rstrip": false,
400
+ "single_word": false
401
+ },
402
+ {
403
+ "content": "<extra_id_42>",
404
+ "lstrip": true,
405
+ "normalized": true,
406
+ "rstrip": false,
407
+ "single_word": false
408
+ },
409
+ {
410
+ "content": "<extra_id_41>",
411
+ "lstrip": true,
412
+ "normalized": true,
413
+ "rstrip": false,
414
+ "single_word": false
415
+ },
416
+ {
417
+ "content": "<extra_id_40>",
418
+ "lstrip": true,
419
+ "normalized": true,
420
+ "rstrip": false,
421
+ "single_word": false
422
+ },
423
+ {
424
+ "content": "<extra_id_39>",
425
+ "lstrip": true,
426
+ "normalized": true,
427
+ "rstrip": false,
428
+ "single_word": false
429
+ },
430
+ {
431
+ "content": "<extra_id_38>",
432
+ "lstrip": true,
433
+ "normalized": true,
434
+ "rstrip": false,
435
+ "single_word": false
436
+ },
437
+ {
438
+ "content": "<extra_id_37>",
439
+ "lstrip": true,
440
+ "normalized": true,
441
+ "rstrip": false,
442
+ "single_word": false
443
+ },
444
+ {
445
+ "content": "<extra_id_36>",
446
+ "lstrip": true,
447
+ "normalized": true,
448
+ "rstrip": false,
449
+ "single_word": false
450
+ },
451
+ {
452
+ "content": "<extra_id_35>",
453
+ "lstrip": true,
454
+ "normalized": true,
455
+ "rstrip": false,
456
+ "single_word": false
457
+ },
458
+ {
459
+ "content": "<extra_id_34>",
460
+ "lstrip": true,
461
+ "normalized": true,
462
+ "rstrip": false,
463
+ "single_word": false
464
+ },
465
+ {
466
+ "content": "<extra_id_33>",
467
+ "lstrip": true,
468
+ "normalized": true,
469
+ "rstrip": false,
470
+ "single_word": false
471
+ },
472
+ {
473
+ "content": "<extra_id_32>",
474
+ "lstrip": true,
475
+ "normalized": true,
476
+ "rstrip": false,
477
+ "single_word": false
478
+ },
479
+ {
480
+ "content": "<extra_id_31>",
481
+ "lstrip": true,
482
+ "normalized": true,
483
+ "rstrip": false,
484
+ "single_word": false
485
+ },
486
+ {
487
+ "content": "<extra_id_30>",
488
+ "lstrip": true,
489
+ "normalized": true,
490
+ "rstrip": false,
491
+ "single_word": false
492
+ },
493
+ {
494
+ "content": "<extra_id_29>",
495
+ "lstrip": true,
496
+ "normalized": true,
497
+ "rstrip": false,
498
+ "single_word": false
499
+ },
500
+ {
501
+ "content": "<extra_id_28>",
502
+ "lstrip": true,
503
+ "normalized": true,
504
+ "rstrip": false,
505
+ "single_word": false
506
+ },
507
+ {
508
+ "content": "<extra_id_27>",
509
+ "lstrip": true,
510
+ "normalized": true,
511
+ "rstrip": false,
512
+ "single_word": false
513
+ },
514
+ {
515
+ "content": "<extra_id_26>",
516
+ "lstrip": true,
517
+ "normalized": true,
518
+ "rstrip": false,
519
+ "single_word": false
520
+ },
521
+ {
522
+ "content": "<extra_id_25>",
523
+ "lstrip": true,
524
+ "normalized": true,
525
+ "rstrip": false,
526
+ "single_word": false
527
+ },
528
+ {
529
+ "content": "<extra_id_24>",
530
+ "lstrip": true,
531
+ "normalized": true,
532
+ "rstrip": false,
533
+ "single_word": false
534
+ },
535
+ {
536
+ "content": "<extra_id_23>",
537
+ "lstrip": true,
538
+ "normalized": true,
539
+ "rstrip": false,
540
+ "single_word": false
541
+ },
542
+ {
543
+ "content": "<extra_id_22>",
544
+ "lstrip": true,
545
+ "normalized": true,
546
+ "rstrip": false,
547
+ "single_word": false
548
+ },
549
+ {
550
+ "content": "<extra_id_21>",
551
+ "lstrip": true,
552
+ "normalized": true,
553
+ "rstrip": false,
554
+ "single_word": false
555
+ },
556
+ {
557
+ "content": "<extra_id_20>",
558
+ "lstrip": true,
559
+ "normalized": true,
560
+ "rstrip": false,
561
+ "single_word": false
562
+ },
563
+ {
564
+ "content": "<extra_id_19>",
565
+ "lstrip": true,
566
+ "normalized": true,
567
+ "rstrip": false,
568
+ "single_word": false
569
+ },
570
+ {
571
+ "content": "<extra_id_18>",
572
+ "lstrip": true,
573
+ "normalized": true,
574
+ "rstrip": false,
575
+ "single_word": false
576
+ },
577
+ {
578
+ "content": "<extra_id_17>",
579
+ "lstrip": true,
580
+ "normalized": true,
581
+ "rstrip": false,
582
+ "single_word": false
583
+ },
584
+ {
585
+ "content": "<extra_id_16>",
586
+ "lstrip": true,
587
+ "normalized": true,
588
+ "rstrip": false,
589
+ "single_word": false
590
+ },
591
+ {
592
+ "content": "<extra_id_15>",
593
+ "lstrip": true,
594
+ "normalized": true,
595
+ "rstrip": false,
596
+ "single_word": false
597
+ },
598
+ {
599
+ "content": "<extra_id_14>",
600
+ "lstrip": true,
601
+ "normalized": true,
602
+ "rstrip": false,
603
+ "single_word": false
604
+ },
605
+ {
606
+ "content": "<extra_id_13>",
607
+ "lstrip": true,
608
+ "normalized": true,
609
+ "rstrip": false,
610
+ "single_word": false
611
+ },
612
+ {
613
+ "content": "<extra_id_12>",
614
+ "lstrip": true,
615
+ "normalized": true,
616
+ "rstrip": false,
617
+ "single_word": false
618
+ },
619
+ {
620
+ "content": "<extra_id_11>",
621
+ "lstrip": true,
622
+ "normalized": true,
623
+ "rstrip": false,
624
+ "single_word": false
625
+ },
626
+ {
627
+ "content": "<extra_id_10>",
628
+ "lstrip": true,
629
+ "normalized": true,
630
+ "rstrip": false,
631
+ "single_word": false
632
+ },
633
+ {
634
+ "content": "<extra_id_9>",
635
+ "lstrip": true,
636
+ "normalized": true,
637
+ "rstrip": false,
638
+ "single_word": false
639
+ },
640
+ {
641
+ "content": "<extra_id_8>",
642
+ "lstrip": true,
643
+ "normalized": true,
644
+ "rstrip": false,
645
+ "single_word": false
646
+ },
647
+ {
648
+ "content": "<extra_id_7>",
649
+ "lstrip": true,
650
+ "normalized": true,
651
+ "rstrip": false,
652
+ "single_word": false
653
+ },
654
+ {
655
+ "content": "<extra_id_6>",
656
+ "lstrip": true,
657
+ "normalized": true,
658
+ "rstrip": false,
659
+ "single_word": false
660
+ },
661
+ {
662
+ "content": "<extra_id_5>",
663
+ "lstrip": true,
664
+ "normalized": true,
665
+ "rstrip": false,
666
+ "single_word": false
667
+ },
668
+ {
669
+ "content": "<extra_id_4>",
670
+ "lstrip": true,
671
+ "normalized": true,
672
+ "rstrip": false,
673
+ "single_word": false
674
+ },
675
+ {
676
+ "content": "<extra_id_3>",
677
+ "lstrip": true,
678
+ "normalized": true,
679
+ "rstrip": false,
680
+ "single_word": false
681
+ },
682
+ {
683
+ "content": "<extra_id_2>",
684
+ "lstrip": true,
685
+ "normalized": true,
686
+ "rstrip": false,
687
+ "single_word": false
688
+ },
689
+ {
690
+ "content": "<extra_id_1>",
691
+ "lstrip": true,
692
+ "normalized": true,
693
+ "rstrip": false,
694
+ "single_word": false
695
+ },
696
+ {
697
+ "content": "<extra_id_0>",
698
+ "lstrip": true,
699
+ "normalized": true,
700
+ "rstrip": false,
701
+ "single_word": false
702
+ }
703
+ ],
704
+ "bos_token": {
705
+ "content": "<s>",
706
+ "lstrip": false,
707
+ "normalized": true,
708
+ "rstrip": false,
709
+ "single_word": false
710
+ },
711
+ "cls_token": {
712
+ "content": "<s>",
713
+ "lstrip": false,
714
+ "normalized": true,
715
+ "rstrip": false,
716
+ "single_word": false
717
+ },
718
+ "eos_token": {
719
+ "content": "</s>",
720
+ "lstrip": false,
721
+ "normalized": true,
722
+ "rstrip": false,
723
+ "single_word": false
724
+ },
725
+ "mask_token": {
726
+ "content": "<mask>",
727
+ "lstrip": true,
728
+ "normalized": true,
729
+ "rstrip": false,
730
+ "single_word": false
731
+ },
732
+ "pad_token": {
733
+ "content": "<pad>",
734
+ "lstrip": false,
735
+ "normalized": true,
736
+ "rstrip": false,
737
+ "single_word": false
738
+ },
739
+ "sep_token": {
740
+ "content": "</s>",
741
+ "lstrip": false,
742
+ "normalized": true,
743
+ "rstrip": false,
744
+ "single_word": false
745
+ },
746
+ "unk_token": {
747
+ "content": "<unk>",
748
+ "lstrip": false,
749
+ "normalized": true,
750
+ "rstrip": false,
751
+ "single_word": false
752
+ }
753
+ }
checkpoint-2829/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-2829/tokenizer_config.json ADDED
@@ -0,0 +1,960 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<pad>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "<s>",
14
+ "lstrip": false,
15
+ "normalized": true,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "</s>",
22
+ "lstrip": false,
23
+ "normalized": true,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "3": {
29
+ "content": "<unk>",
30
+ "lstrip": false,
31
+ "normalized": true,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "4": {
37
+ "content": "<mask>",
38
+ "lstrip": true,
39
+ "normalized": true,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "32000": {
45
+ "content": "<extra_id_99>",
46
+ "lstrip": true,
47
+ "normalized": true,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "32001": {
53
+ "content": "<extra_id_98>",
54
+ "lstrip": true,
55
+ "normalized": true,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "32002": {
61
+ "content": "<extra_id_97>",
62
+ "lstrip": true,
63
+ "normalized": true,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "32003": {
69
+ "content": "<extra_id_96>",
70
+ "lstrip": true,
71
+ "normalized": true,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "32004": {
77
+ "content": "<extra_id_95>",
78
+ "lstrip": true,
79
+ "normalized": true,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "32005": {
85
+ "content": "<extra_id_94>",
86
+ "lstrip": true,
87
+ "normalized": true,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "32006": {
93
+ "content": "<extra_id_93>",
94
+ "lstrip": true,
95
+ "normalized": true,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "32007": {
101
+ "content": "<extra_id_92>",
102
+ "lstrip": true,
103
+ "normalized": true,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "32008": {
109
+ "content": "<extra_id_91>",
110
+ "lstrip": true,
111
+ "normalized": true,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "32009": {
117
+ "content": "<extra_id_90>",
118
+ "lstrip": true,
119
+ "normalized": true,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "32010": {
125
+ "content": "<extra_id_89>",
126
+ "lstrip": true,
127
+ "normalized": true,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "32011": {
133
+ "content": "<extra_id_88>",
134
+ "lstrip": true,
135
+ "normalized": true,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ },
140
+ "32012": {
141
+ "content": "<extra_id_87>",
142
+ "lstrip": true,
143
+ "normalized": true,
144
+ "rstrip": false,
145
+ "single_word": false,
146
+ "special": true
147
+ },
148
+ "32013": {
149
+ "content": "<extra_id_86>",
150
+ "lstrip": true,
151
+ "normalized": true,
152
+ "rstrip": false,
153
+ "single_word": false,
154
+ "special": true
155
+ },
156
+ "32014": {
157
+ "content": "<extra_id_85>",
158
+ "lstrip": true,
159
+ "normalized": true,
160
+ "rstrip": false,
161
+ "single_word": false,
162
+ "special": true
163
+ },
164
+ "32015": {
165
+ "content": "<extra_id_84>",
166
+ "lstrip": true,
167
+ "normalized": true,
168
+ "rstrip": false,
169
+ "single_word": false,
170
+ "special": true
171
+ },
172
+ "32016": {
173
+ "content": "<extra_id_83>",
174
+ "lstrip": true,
175
+ "normalized": true,
176
+ "rstrip": false,
177
+ "single_word": false,
178
+ "special": true
179
+ },
180
+ "32017": {
181
+ "content": "<extra_id_82>",
182
+ "lstrip": true,
183
+ "normalized": true,
184
+ "rstrip": false,
185
+ "single_word": false,
186
+ "special": true
187
+ },
188
+ "32018": {
189
+ "content": "<extra_id_81>",
190
+ "lstrip": true,
191
+ "normalized": true,
192
+ "rstrip": false,
193
+ "single_word": false,
194
+ "special": true
195
+ },
196
+ "32019": {
197
+ "content": "<extra_id_80>",
198
+ "lstrip": true,
199
+ "normalized": true,
200
+ "rstrip": false,
201
+ "single_word": false,
202
+ "special": true
203
+ },
204
+ "32020": {
205
+ "content": "<extra_id_79>",
206
+ "lstrip": true,
207
+ "normalized": true,
208
+ "rstrip": false,
209
+ "single_word": false,
210
+ "special": true
211
+ },
212
+ "32021": {
213
+ "content": "<extra_id_78>",
214
+ "lstrip": true,
215
+ "normalized": true,
216
+ "rstrip": false,
217
+ "single_word": false,
218
+ "special": true
219
+ },
220
+ "32022": {
221
+ "content": "<extra_id_77>",
222
+ "lstrip": true,
223
+ "normalized": true,
224
+ "rstrip": false,
225
+ "single_word": false,
226
+ "special": true
227
+ },
228
+ "32023": {
229
+ "content": "<extra_id_76>",
230
+ "lstrip": true,
231
+ "normalized": true,
232
+ "rstrip": false,
233
+ "single_word": false,
234
+ "special": true
235
+ },
236
+ "32024": {
237
+ "content": "<extra_id_75>",
238
+ "lstrip": true,
239
+ "normalized": true,
240
+ "rstrip": false,
241
+ "single_word": false,
242
+ "special": true
243
+ },
244
+ "32025": {
245
+ "content": "<extra_id_74>",
246
+ "lstrip": true,
247
+ "normalized": true,
248
+ "rstrip": false,
249
+ "single_word": false,
250
+ "special": true
251
+ },
252
+ "32026": {
253
+ "content": "<extra_id_73>",
254
+ "lstrip": true,
255
+ "normalized": true,
256
+ "rstrip": false,
257
+ "single_word": false,
258
+ "special": true
259
+ },
260
+ "32027": {
261
+ "content": "<extra_id_72>",
262
+ "lstrip": true,
263
+ "normalized": true,
264
+ "rstrip": false,
265
+ "single_word": false,
266
+ "special": true
267
+ },
268
+ "32028": {
269
+ "content": "<extra_id_71>",
270
+ "lstrip": true,
271
+ "normalized": true,
272
+ "rstrip": false,
273
+ "single_word": false,
274
+ "special": true
275
+ },
276
+ "32029": {
277
+ "content": "<extra_id_70>",
278
+ "lstrip": true,
279
+ "normalized": true,
280
+ "rstrip": false,
281
+ "single_word": false,
282
+ "special": true
283
+ },
284
+ "32030": {
285
+ "content": "<extra_id_69>",
286
+ "lstrip": true,
287
+ "normalized": true,
288
+ "rstrip": false,
289
+ "single_word": false,
290
+ "special": true
291
+ },
292
+ "32031": {
293
+ "content": "<extra_id_68>",
294
+ "lstrip": true,
295
+ "normalized": true,
296
+ "rstrip": false,
297
+ "single_word": false,
298
+ "special": true
299
+ },
300
+ "32032": {
301
+ "content": "<extra_id_67>",
302
+ "lstrip": true,
303
+ "normalized": true,
304
+ "rstrip": false,
305
+ "single_word": false,
306
+ "special": true
307
+ },
308
+ "32033": {
309
+ "content": "<extra_id_66>",
310
+ "lstrip": true,
311
+ "normalized": true,
312
+ "rstrip": false,
313
+ "single_word": false,
314
+ "special": true
315
+ },
316
+ "32034": {
317
+ "content": "<extra_id_65>",
318
+ "lstrip": true,
319
+ "normalized": true,
320
+ "rstrip": false,
321
+ "single_word": false,
322
+ "special": true
323
+ },
324
+ "32035": {
325
+ "content": "<extra_id_64>",
326
+ "lstrip": true,
327
+ "normalized": true,
328
+ "rstrip": false,
329
+ "single_word": false,
330
+ "special": true
331
+ },
332
+ "32036": {
333
+ "content": "<extra_id_63>",
334
+ "lstrip": true,
335
+ "normalized": true,
336
+ "rstrip": false,
337
+ "single_word": false,
338
+ "special": true
339
+ },
340
+ "32037": {
341
+ "content": "<extra_id_62>",
342
+ "lstrip": true,
343
+ "normalized": true,
344
+ "rstrip": false,
345
+ "single_word": false,
346
+ "special": true
347
+ },
348
+ "32038": {
349
+ "content": "<extra_id_61>",
350
+ "lstrip": true,
351
+ "normalized": true,
352
+ "rstrip": false,
353
+ "single_word": false,
354
+ "special": true
355
+ },
356
+ "32039": {
357
+ "content": "<extra_id_60>",
358
+ "lstrip": true,
359
+ "normalized": true,
360
+ "rstrip": false,
361
+ "single_word": false,
362
+ "special": true
363
+ },
364
+ "32040": {
365
+ "content": "<extra_id_59>",
366
+ "lstrip": true,
367
+ "normalized": true,
368
+ "rstrip": false,
369
+ "single_word": false,
370
+ "special": true
371
+ },
372
+ "32041": {
373
+ "content": "<extra_id_58>",
374
+ "lstrip": true,
375
+ "normalized": true,
376
+ "rstrip": false,
377
+ "single_word": false,
378
+ "special": true
379
+ },
380
+ "32042": {
381
+ "content": "<extra_id_57>",
382
+ "lstrip": true,
383
+ "normalized": true,
384
+ "rstrip": false,
385
+ "single_word": false,
386
+ "special": true
387
+ },
388
+ "32043": {
389
+ "content": "<extra_id_56>",
390
+ "lstrip": true,
391
+ "normalized": true,
392
+ "rstrip": false,
393
+ "single_word": false,
394
+ "special": true
395
+ },
396
+ "32044": {
397
+ "content": "<extra_id_55>",
398
+ "lstrip": true,
399
+ "normalized": true,
400
+ "rstrip": false,
401
+ "single_word": false,
402
+ "special": true
403
+ },
404
+ "32045": {
405
+ "content": "<extra_id_54>",
406
+ "lstrip": true,
407
+ "normalized": true,
408
+ "rstrip": false,
409
+ "single_word": false,
410
+ "special": true
411
+ },
412
+ "32046": {
413
+ "content": "<extra_id_53>",
414
+ "lstrip": true,
415
+ "normalized": true,
416
+ "rstrip": false,
417
+ "single_word": false,
418
+ "special": true
419
+ },
420
+ "32047": {
421
+ "content": "<extra_id_52>",
422
+ "lstrip": true,
423
+ "normalized": true,
424
+ "rstrip": false,
425
+ "single_word": false,
426
+ "special": true
427
+ },
428
+ "32048": {
429
+ "content": "<extra_id_51>",
430
+ "lstrip": true,
431
+ "normalized": true,
432
+ "rstrip": false,
433
+ "single_word": false,
434
+ "special": true
435
+ },
436
+ "32049": {
437
+ "content": "<extra_id_50>",
438
+ "lstrip": true,
439
+ "normalized": true,
440
+ "rstrip": false,
441
+ "single_word": false,
442
+ "special": true
443
+ },
444
+ "32050": {
445
+ "content": "<extra_id_49>",
446
+ "lstrip": true,
447
+ "normalized": true,
448
+ "rstrip": false,
449
+ "single_word": false,
450
+ "special": true
451
+ },
452
+ "32051": {
453
+ "content": "<extra_id_48>",
454
+ "lstrip": true,
455
+ "normalized": true,
456
+ "rstrip": false,
457
+ "single_word": false,
458
+ "special": true
459
+ },
460
+ "32052": {
461
+ "content": "<extra_id_47>",
462
+ "lstrip": true,
463
+ "normalized": true,
464
+ "rstrip": false,
465
+ "single_word": false,
466
+ "special": true
467
+ },
468
+ "32053": {
469
+ "content": "<extra_id_46>",
470
+ "lstrip": true,
471
+ "normalized": true,
472
+ "rstrip": false,
473
+ "single_word": false,
474
+ "special": true
475
+ },
476
+ "32054": {
477
+ "content": "<extra_id_45>",
478
+ "lstrip": true,
479
+ "normalized": true,
480
+ "rstrip": false,
481
+ "single_word": false,
482
+ "special": true
483
+ },
484
+ "32055": {
485
+ "content": "<extra_id_44>",
486
+ "lstrip": true,
487
+ "normalized": true,
488
+ "rstrip": false,
489
+ "single_word": false,
490
+ "special": true
491
+ },
492
+ "32056": {
493
+ "content": "<extra_id_43>",
494
+ "lstrip": true,
495
+ "normalized": true,
496
+ "rstrip": false,
497
+ "single_word": false,
498
+ "special": true
499
+ },
500
+ "32057": {
501
+ "content": "<extra_id_42>",
502
+ "lstrip": true,
503
+ "normalized": true,
504
+ "rstrip": false,
505
+ "single_word": false,
506
+ "special": true
507
+ },
508
+ "32058": {
509
+ "content": "<extra_id_41>",
510
+ "lstrip": true,
511
+ "normalized": true,
512
+ "rstrip": false,
513
+ "single_word": false,
514
+ "special": true
515
+ },
516
+ "32059": {
517
+ "content": "<extra_id_40>",
518
+ "lstrip": true,
519
+ "normalized": true,
520
+ "rstrip": false,
521
+ "single_word": false,
522
+ "special": true
523
+ },
524
+ "32060": {
525
+ "content": "<extra_id_39>",
526
+ "lstrip": true,
527
+ "normalized": true,
528
+ "rstrip": false,
529
+ "single_word": false,
530
+ "special": true
531
+ },
532
+ "32061": {
533
+ "content": "<extra_id_38>",
534
+ "lstrip": true,
535
+ "normalized": true,
536
+ "rstrip": false,
537
+ "single_word": false,
538
+ "special": true
539
+ },
540
+ "32062": {
541
+ "content": "<extra_id_37>",
542
+ "lstrip": true,
543
+ "normalized": true,
544
+ "rstrip": false,
545
+ "single_word": false,
546
+ "special": true
547
+ },
548
+ "32063": {
549
+ "content": "<extra_id_36>",
550
+ "lstrip": true,
551
+ "normalized": true,
552
+ "rstrip": false,
553
+ "single_word": false,
554
+ "special": true
555
+ },
556
+ "32064": {
557
+ "content": "<extra_id_35>",
558
+ "lstrip": true,
559
+ "normalized": true,
560
+ "rstrip": false,
561
+ "single_word": false,
562
+ "special": true
563
+ },
564
+ "32065": {
565
+ "content": "<extra_id_34>",
566
+ "lstrip": true,
567
+ "normalized": true,
568
+ "rstrip": false,
569
+ "single_word": false,
570
+ "special": true
571
+ },
572
+ "32066": {
573
+ "content": "<extra_id_33>",
574
+ "lstrip": true,
575
+ "normalized": true,
576
+ "rstrip": false,
577
+ "single_word": false,
578
+ "special": true
579
+ },
580
+ "32067": {
581
+ "content": "<extra_id_32>",
582
+ "lstrip": true,
583
+ "normalized": true,
584
+ "rstrip": false,
585
+ "single_word": false,
586
+ "special": true
587
+ },
588
+ "32068": {
589
+ "content": "<extra_id_31>",
590
+ "lstrip": true,
591
+ "normalized": true,
592
+ "rstrip": false,
593
+ "single_word": false,
594
+ "special": true
595
+ },
596
+ "32069": {
597
+ "content": "<extra_id_30>",
598
+ "lstrip": true,
599
+ "normalized": true,
600
+ "rstrip": false,
601
+ "single_word": false,
602
+ "special": true
603
+ },
604
+ "32070": {
605
+ "content": "<extra_id_29>",
606
+ "lstrip": true,
607
+ "normalized": true,
608
+ "rstrip": false,
609
+ "single_word": false,
610
+ "special": true
611
+ },
612
+ "32071": {
613
+ "content": "<extra_id_28>",
614
+ "lstrip": true,
615
+ "normalized": true,
616
+ "rstrip": false,
617
+ "single_word": false,
618
+ "special": true
619
+ },
620
+ "32072": {
621
+ "content": "<extra_id_27>",
622
+ "lstrip": true,
623
+ "normalized": true,
624
+ "rstrip": false,
625
+ "single_word": false,
626
+ "special": true
627
+ },
628
+ "32073": {
629
+ "content": "<extra_id_26>",
630
+ "lstrip": true,
631
+ "normalized": true,
632
+ "rstrip": false,
633
+ "single_word": false,
634
+ "special": true
635
+ },
636
+ "32074": {
637
+ "content": "<extra_id_25>",
638
+ "lstrip": true,
639
+ "normalized": true,
640
+ "rstrip": false,
641
+ "single_word": false,
642
+ "special": true
643
+ },
644
+ "32075": {
645
+ "content": "<extra_id_24>",
646
+ "lstrip": true,
647
+ "normalized": true,
648
+ "rstrip": false,
649
+ "single_word": false,
650
+ "special": true
651
+ },
652
+ "32076": {
653
+ "content": "<extra_id_23>",
654
+ "lstrip": true,
655
+ "normalized": true,
656
+ "rstrip": false,
657
+ "single_word": false,
658
+ "special": true
659
+ },
660
+ "32077": {
661
+ "content": "<extra_id_22>",
662
+ "lstrip": true,
663
+ "normalized": true,
664
+ "rstrip": false,
665
+ "single_word": false,
666
+ "special": true
667
+ },
668
+ "32078": {
669
+ "content": "<extra_id_21>",
670
+ "lstrip": true,
671
+ "normalized": true,
672
+ "rstrip": false,
673
+ "single_word": false,
674
+ "special": true
675
+ },
676
+ "32079": {
677
+ "content": "<extra_id_20>",
678
+ "lstrip": true,
679
+ "normalized": true,
680
+ "rstrip": false,
681
+ "single_word": false,
682
+ "special": true
683
+ },
684
+ "32080": {
685
+ "content": "<extra_id_19>",
686
+ "lstrip": true,
687
+ "normalized": true,
688
+ "rstrip": false,
689
+ "single_word": false,
690
+ "special": true
691
+ },
692
+ "32081": {
693
+ "content": "<extra_id_18>",
694
+ "lstrip": true,
695
+ "normalized": true,
696
+ "rstrip": false,
697
+ "single_word": false,
698
+ "special": true
699
+ },
700
+ "32082": {
701
+ "content": "<extra_id_17>",
702
+ "lstrip": true,
703
+ "normalized": true,
704
+ "rstrip": false,
705
+ "single_word": false,
706
+ "special": true
707
+ },
708
+ "32083": {
709
+ "content": "<extra_id_16>",
710
+ "lstrip": true,
711
+ "normalized": true,
712
+ "rstrip": false,
713
+ "single_word": false,
714
+ "special": true
715
+ },
716
+ "32084": {
717
+ "content": "<extra_id_15>",
718
+ "lstrip": true,
719
+ "normalized": true,
720
+ "rstrip": false,
721
+ "single_word": false,
722
+ "special": true
723
+ },
724
+ "32085": {
725
+ "content": "<extra_id_14>",
726
+ "lstrip": true,
727
+ "normalized": true,
728
+ "rstrip": false,
729
+ "single_word": false,
730
+ "special": true
731
+ },
732
+ "32086": {
733
+ "content": "<extra_id_13>",
734
+ "lstrip": true,
735
+ "normalized": true,
736
+ "rstrip": false,
737
+ "single_word": false,
738
+ "special": true
739
+ },
740
+ "32087": {
741
+ "content": "<extra_id_12>",
742
+ "lstrip": true,
743
+ "normalized": true,
744
+ "rstrip": false,
745
+ "single_word": false,
746
+ "special": true
747
+ },
748
+ "32088": {
749
+ "content": "<extra_id_11>",
750
+ "lstrip": true,
751
+ "normalized": true,
752
+ "rstrip": false,
753
+ "single_word": false,
754
+ "special": true
755
+ },
756
+ "32089": {
757
+ "content": "<extra_id_10>",
758
+ "lstrip": true,
759
+ "normalized": true,
760
+ "rstrip": false,
761
+ "single_word": false,
762
+ "special": true
763
+ },
764
+ "32090": {
765
+ "content": "<extra_id_9>",
766
+ "lstrip": true,
767
+ "normalized": true,
768
+ "rstrip": false,
769
+ "single_word": false,
770
+ "special": true
771
+ },
772
+ "32091": {
773
+ "content": "<extra_id_8>",
774
+ "lstrip": true,
775
+ "normalized": true,
776
+ "rstrip": false,
777
+ "single_word": false,
778
+ "special": true
779
+ },
780
+ "32092": {
781
+ "content": "<extra_id_7>",
782
+ "lstrip": true,
783
+ "normalized": true,
784
+ "rstrip": false,
785
+ "single_word": false,
786
+ "special": true
787
+ },
788
+ "32093": {
789
+ "content": "<extra_id_6>",
790
+ "lstrip": true,
791
+ "normalized": true,
792
+ "rstrip": false,
793
+ "single_word": false,
794
+ "special": true
795
+ },
796
+ "32094": {
797
+ "content": "<extra_id_5>",
798
+ "lstrip": true,
799
+ "normalized": true,
800
+ "rstrip": false,
801
+ "single_word": false,
802
+ "special": true
803
+ },
804
+ "32095": {
805
+ "content": "<extra_id_4>",
806
+ "lstrip": true,
807
+ "normalized": true,
808
+ "rstrip": false,
809
+ "single_word": false,
810
+ "special": true
811
+ },
812
+ "32096": {
813
+ "content": "<extra_id_3>",
814
+ "lstrip": true,
815
+ "normalized": true,
816
+ "rstrip": false,
817
+ "single_word": false,
818
+ "special": true
819
+ },
820
+ "32097": {
821
+ "content": "<extra_id_2>",
822
+ "lstrip": true,
823
+ "normalized": true,
824
+ "rstrip": false,
825
+ "single_word": false,
826
+ "special": true
827
+ },
828
+ "32098": {
829
+ "content": "<extra_id_1>",
830
+ "lstrip": true,
831
+ "normalized": true,
832
+ "rstrip": false,
833
+ "single_word": false,
834
+ "special": true
835
+ },
836
+ "32099": {
837
+ "content": "<extra_id_0>",
838
+ "lstrip": true,
839
+ "normalized": true,
840
+ "rstrip": false,
841
+ "single_word": false,
842
+ "special": true
843
+ }
844
+ },
845
+ "additional_special_tokens": [
846
+ "<extra_id_99>",
847
+ "<extra_id_98>",
848
+ "<extra_id_97>",
849
+ "<extra_id_96>",
850
+ "<extra_id_95>",
851
+ "<extra_id_94>",
852
+ "<extra_id_93>",
853
+ "<extra_id_92>",
854
+ "<extra_id_91>",
855
+ "<extra_id_90>",
856
+ "<extra_id_89>",
857
+ "<extra_id_88>",
858
+ "<extra_id_87>",
859
+ "<extra_id_86>",
860
+ "<extra_id_85>",
861
+ "<extra_id_84>",
862
+ "<extra_id_83>",
863
+ "<extra_id_82>",
864
+ "<extra_id_81>",
865
+ "<extra_id_80>",
866
+ "<extra_id_79>",
867
+ "<extra_id_78>",
868
+ "<extra_id_77>",
869
+ "<extra_id_76>",
870
+ "<extra_id_75>",
871
+ "<extra_id_74>",
872
+ "<extra_id_73>",
873
+ "<extra_id_72>",
874
+ "<extra_id_71>",
875
+ "<extra_id_70>",
876
+ "<extra_id_69>",
877
+ "<extra_id_68>",
878
+ "<extra_id_67>",
879
+ "<extra_id_66>",
880
+ "<extra_id_65>",
881
+ "<extra_id_64>",
882
+ "<extra_id_63>",
883
+ "<extra_id_62>",
884
+ "<extra_id_61>",
885
+ "<extra_id_60>",
886
+ "<extra_id_59>",
887
+ "<extra_id_58>",
888
+ "<extra_id_57>",
889
+ "<extra_id_56>",
890
+ "<extra_id_55>",
891
+ "<extra_id_54>",
892
+ "<extra_id_53>",
893
+ "<extra_id_52>",
894
+ "<extra_id_51>",
895
+ "<extra_id_50>",
896
+ "<extra_id_49>",
897
+ "<extra_id_48>",
898
+ "<extra_id_47>",
899
+ "<extra_id_46>",
900
+ "<extra_id_45>",
901
+ "<extra_id_44>",
902
+ "<extra_id_43>",
903
+ "<extra_id_42>",
904
+ "<extra_id_41>",
905
+ "<extra_id_40>",
906
+ "<extra_id_39>",
907
+ "<extra_id_38>",
908
+ "<extra_id_37>",
909
+ "<extra_id_36>",
910
+ "<extra_id_35>",
911
+ "<extra_id_34>",
912
+ "<extra_id_33>",
913
+ "<extra_id_32>",
914
+ "<extra_id_31>",
915
+ "<extra_id_30>",
916
+ "<extra_id_29>",
917
+ "<extra_id_28>",
918
+ "<extra_id_27>",
919
+ "<extra_id_26>",
920
+ "<extra_id_25>",
921
+ "<extra_id_24>",
922
+ "<extra_id_23>",
923
+ "<extra_id_22>",
924
+ "<extra_id_21>",
925
+ "<extra_id_20>",
926
+ "<extra_id_19>",
927
+ "<extra_id_18>",
928
+ "<extra_id_17>",
929
+ "<extra_id_16>",
930
+ "<extra_id_15>",
931
+ "<extra_id_14>",
932
+ "<extra_id_13>",
933
+ "<extra_id_12>",
934
+ "<extra_id_11>",
935
+ "<extra_id_10>",
936
+ "<extra_id_9>",
937
+ "<extra_id_8>",
938
+ "<extra_id_7>",
939
+ "<extra_id_6>",
940
+ "<extra_id_5>",
941
+ "<extra_id_4>",
942
+ "<extra_id_3>",
943
+ "<extra_id_2>",
944
+ "<extra_id_1>",
945
+ "<extra_id_0>"
946
+ ],
947
+ "bos_token": "<s>",
948
+ "clean_up_tokenization_spaces": false,
949
+ "cls_token": "<s>",
950
+ "eos_token": "</s>",
951
+ "errors": "replace",
952
+ "extra_special_tokens": {},
953
+ "mask_token": "<mask>",
954
+ "model_max_length": 512,
955
+ "pad_token": "<pad>",
956
+ "sep_token": "</s>",
957
+ "tokenizer_class": "RobertaTokenizer",
958
+ "trim_offsets": true,
959
+ "unk_token": "<unk>"
960
+ }
checkpoint-2829/trainer_state.json ADDED
@@ -0,0 +1,436 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 2829,
3
+ "best_metric": 0.9667777874331811,
4
+ "best_model_checkpoint": "./codet5-qlora-k8s/checkpoint-2829",
5
+ "epoch": 1.0,
6
+ "eval_steps": 500,
7
+ "global_step": 2829,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.017674089784376106,
14
+ "grad_norm": 1.1207759380340576,
15
+ "learning_rate": 0.00029898197242841994,
16
+ "loss": 3.2886,
17
+ "step": 50
18
+ },
19
+ {
20
+ "epoch": 0.03534817956875221,
21
+ "grad_norm": 1.2978123426437378,
22
+ "learning_rate": 0.0002979215270413573,
23
+ "loss": 1.8567,
24
+ "step": 100
25
+ },
26
+ {
27
+ "epoch": 0.053022269353128315,
28
+ "grad_norm": 1.624740719795227,
29
+ "learning_rate": 0.0002968610816542948,
30
+ "loss": 1.5695,
31
+ "step": 150
32
+ },
33
+ {
34
+ "epoch": 0.07069635913750442,
35
+ "grad_norm": 1.7711330652236938,
36
+ "learning_rate": 0.0002958006362672322,
37
+ "loss": 1.4205,
38
+ "step": 200
39
+ },
40
+ {
41
+ "epoch": 0.08837044892188052,
42
+ "grad_norm": 1.62517511844635,
43
+ "learning_rate": 0.0002947401908801697,
44
+ "loss": 1.2732,
45
+ "step": 250
46
+ },
47
+ {
48
+ "epoch": 0.10604453870625663,
49
+ "grad_norm": 2.038139820098877,
50
+ "learning_rate": 0.00029367974549310706,
51
+ "loss": 1.1913,
52
+ "step": 300
53
+ },
54
+ {
55
+ "epoch": 0.12371862849063273,
56
+ "grad_norm": 2.262789487838745,
57
+ "learning_rate": 0.00029264050901378576,
58
+ "loss": 1.117,
59
+ "step": 350
60
+ },
61
+ {
62
+ "epoch": 0.14139271827500885,
63
+ "grad_norm": 3.121687650680542,
64
+ "learning_rate": 0.0002915800636267232,
65
+ "loss": 1.0202,
66
+ "step": 400
67
+ },
68
+ {
69
+ "epoch": 0.15906680805938495,
70
+ "grad_norm": 2.0951812267303467,
71
+ "learning_rate": 0.0002905196182396606,
72
+ "loss": 0.9499,
73
+ "step": 450
74
+ },
75
+ {
76
+ "epoch": 0.17674089784376104,
77
+ "grad_norm": 2.670121192932129,
78
+ "learning_rate": 0.00028945917285259806,
79
+ "loss": 0.9707,
80
+ "step": 500
81
+ },
82
+ {
83
+ "epoch": 0.19441498762813716,
84
+ "grad_norm": 2.3631107807159424,
85
+ "learning_rate": 0.00028841993637327676,
86
+ "loss": 0.7961,
87
+ "step": 550
88
+ },
89
+ {
90
+ "epoch": 0.21208907741251326,
91
+ "grad_norm": 2.10772705078125,
92
+ "learning_rate": 0.0002873594909862142,
93
+ "loss": 0.8912,
94
+ "step": 600
95
+ },
96
+ {
97
+ "epoch": 0.22976316719688936,
98
+ "grad_norm": 2.360686779022217,
99
+ "learning_rate": 0.00028629904559915163,
100
+ "loss": 0.871,
101
+ "step": 650
102
+ },
103
+ {
104
+ "epoch": 0.24743725698126545,
105
+ "grad_norm": 2.191119432449341,
106
+ "learning_rate": 0.0002852598091198303,
107
+ "loss": 0.758,
108
+ "step": 700
109
+ },
110
+ {
111
+ "epoch": 0.2651113467656416,
112
+ "grad_norm": 1.7646818161010742,
113
+ "learning_rate": 0.00028419936373276776,
114
+ "loss": 0.8244,
115
+ "step": 750
116
+ },
117
+ {
118
+ "epoch": 0.2827854365500177,
119
+ "grad_norm": 2.3776354789733887,
120
+ "learning_rate": 0.00028313891834570514,
121
+ "loss": 0.7664,
122
+ "step": 800
123
+ },
124
+ {
125
+ "epoch": 0.30045952633439377,
126
+ "grad_norm": 2.8682475090026855,
127
+ "learning_rate": 0.00028207847295864263,
128
+ "loss": 0.6942,
129
+ "step": 850
130
+ },
131
+ {
132
+ "epoch": 0.3181336161187699,
133
+ "grad_norm": 2.353091239929199,
134
+ "learning_rate": 0.00028101802757158,
135
+ "loss": 0.7323,
136
+ "step": 900
137
+ },
138
+ {
139
+ "epoch": 0.335807705903146,
140
+ "grad_norm": 1.9457337856292725,
141
+ "learning_rate": 0.00027995758218451745,
142
+ "loss": 0.6474,
143
+ "step": 950
144
+ },
145
+ {
146
+ "epoch": 0.3534817956875221,
147
+ "grad_norm": 2.510075330734253,
148
+ "learning_rate": 0.00027889713679745494,
149
+ "loss": 0.6801,
150
+ "step": 1000
151
+ },
152
+ {
153
+ "epoch": 0.3711558854718982,
154
+ "grad_norm": 1.7497014999389648,
155
+ "learning_rate": 0.0002778366914103923,
156
+ "loss": 0.656,
157
+ "step": 1050
158
+ },
159
+ {
160
+ "epoch": 0.38882997525627433,
161
+ "grad_norm": 2.862682342529297,
162
+ "learning_rate": 0.0002767762460233298,
163
+ "loss": 0.6238,
164
+ "step": 1100
165
+ },
166
+ {
167
+ "epoch": 0.4065040650406504,
168
+ "grad_norm": 1.998961091041565,
169
+ "learning_rate": 0.0002757158006362672,
170
+ "loss": 0.6306,
171
+ "step": 1150
172
+ },
173
+ {
174
+ "epoch": 0.4241781548250265,
175
+ "grad_norm": 1.854942798614502,
176
+ "learning_rate": 0.0002746553552492047,
177
+ "loss": 0.5689,
178
+ "step": 1200
179
+ },
180
+ {
181
+ "epoch": 0.4418522446094026,
182
+ "grad_norm": 1.8994203805923462,
183
+ "learning_rate": 0.00027359490986214206,
184
+ "loss": 0.6595,
185
+ "step": 1250
186
+ },
187
+ {
188
+ "epoch": 0.4595263343937787,
189
+ "grad_norm": 1.6235908269882202,
190
+ "learning_rate": 0.0002725344644750795,
191
+ "loss": 0.5665,
192
+ "step": 1300
193
+ },
194
+ {
195
+ "epoch": 0.47720042417815484,
196
+ "grad_norm": 2.291989803314209,
197
+ "learning_rate": 0.00027147401908801693,
198
+ "loss": 0.5761,
199
+ "step": 1350
200
+ },
201
+ {
202
+ "epoch": 0.4948745139625309,
203
+ "grad_norm": 1.4632915258407593,
204
+ "learning_rate": 0.00027041357370095437,
205
+ "loss": 0.5171,
206
+ "step": 1400
207
+ },
208
+ {
209
+ "epoch": 0.512548603746907,
210
+ "grad_norm": 2.1687259674072266,
211
+ "learning_rate": 0.0002693531283138918,
212
+ "loss": 0.6183,
213
+ "step": 1450
214
+ },
215
+ {
216
+ "epoch": 0.5302226935312832,
217
+ "grad_norm": 1.734108805656433,
218
+ "learning_rate": 0.00026829268292682924,
219
+ "loss": 0.5411,
220
+ "step": 1500
221
+ },
222
+ {
223
+ "epoch": 0.5478967833156593,
224
+ "grad_norm": 1.3890644311904907,
225
+ "learning_rate": 0.00026723223753976667,
226
+ "loss": 0.5092,
227
+ "step": 1550
228
+ },
229
+ {
230
+ "epoch": 0.5655708731000354,
231
+ "grad_norm": 1.98700749874115,
232
+ "learning_rate": 0.0002661717921527041,
233
+ "loss": 0.4804,
234
+ "step": 1600
235
+ },
236
+ {
237
+ "epoch": 0.5832449628844114,
238
+ "grad_norm": 1.1181468963623047,
239
+ "learning_rate": 0.00026511134676564154,
240
+ "loss": 0.5148,
241
+ "step": 1650
242
+ },
243
+ {
244
+ "epoch": 0.6009190526687875,
245
+ "grad_norm": 1.7994420528411865,
246
+ "learning_rate": 0.000264050901378579,
247
+ "loss": 0.4231,
248
+ "step": 1700
249
+ },
250
+ {
251
+ "epoch": 0.6185931424531637,
252
+ "grad_norm": 2.032198667526245,
253
+ "learning_rate": 0.0002629904559915164,
254
+ "loss": 0.5106,
255
+ "step": 1750
256
+ },
257
+ {
258
+ "epoch": 0.6362672322375398,
259
+ "grad_norm": 3.585948944091797,
260
+ "learning_rate": 0.00026193001060445385,
261
+ "loss": 0.4717,
262
+ "step": 1800
263
+ },
264
+ {
265
+ "epoch": 0.6539413220219159,
266
+ "grad_norm": 1.8610371351242065,
267
+ "learning_rate": 0.0002608695652173913,
268
+ "loss": 0.4765,
269
+ "step": 1850
270
+ },
271
+ {
272
+ "epoch": 0.671615411806292,
273
+ "grad_norm": 1.2324624061584473,
274
+ "learning_rate": 0.0002598091198303287,
275
+ "loss": 0.4643,
276
+ "step": 1900
277
+ },
278
+ {
279
+ "epoch": 0.689289501590668,
280
+ "grad_norm": 2.391714572906494,
281
+ "learning_rate": 0.00025874867444326615,
282
+ "loss": 0.4512,
283
+ "step": 1950
284
+ },
285
+ {
286
+ "epoch": 0.7069635913750442,
287
+ "grad_norm": 1.8863242864608765,
288
+ "learning_rate": 0.0002576882290562036,
289
+ "loss": 0.4115,
290
+ "step": 2000
291
+ },
292
+ {
293
+ "epoch": 0.7246376811594203,
294
+ "grad_norm": 0.7850649356842041,
295
+ "learning_rate": 0.000256627783669141,
296
+ "loss": 0.4341,
297
+ "step": 2050
298
+ },
299
+ {
300
+ "epoch": 0.7423117709437964,
301
+ "grad_norm": 1.5869959592819214,
302
+ "learning_rate": 0.00025556733828207846,
303
+ "loss": 0.4172,
304
+ "step": 2100
305
+ },
306
+ {
307
+ "epoch": 0.7599858607281725,
308
+ "grad_norm": 1.2584971189498901,
309
+ "learning_rate": 0.0002545068928950159,
310
+ "loss": 0.4384,
311
+ "step": 2150
312
+ },
313
+ {
314
+ "epoch": 0.7776599505125487,
315
+ "grad_norm": 2.560710906982422,
316
+ "learning_rate": 0.00025344644750795333,
317
+ "loss": 0.4558,
318
+ "step": 2200
319
+ },
320
+ {
321
+ "epoch": 0.7953340402969247,
322
+ "grad_norm": 2.2893359661102295,
323
+ "learning_rate": 0.00025238600212089076,
324
+ "loss": 0.4345,
325
+ "step": 2250
326
+ },
327
+ {
328
+ "epoch": 0.8130081300813008,
329
+ "grad_norm": 1.5244982242584229,
330
+ "learning_rate": 0.0002513255567338282,
331
+ "loss": 0.4071,
332
+ "step": 2300
333
+ },
334
+ {
335
+ "epoch": 0.8306822198656769,
336
+ "grad_norm": 1.384102463722229,
337
+ "learning_rate": 0.00025026511134676563,
338
+ "loss": 0.3612,
339
+ "step": 2350
340
+ },
341
+ {
342
+ "epoch": 0.848356309650053,
343
+ "grad_norm": 1.3080965280532837,
344
+ "learning_rate": 0.00024920466595970307,
345
+ "loss": 0.3556,
346
+ "step": 2400
347
+ },
348
+ {
349
+ "epoch": 0.8660303994344292,
350
+ "grad_norm": 1.3324400186538696,
351
+ "learning_rate": 0.00024814422057264045,
352
+ "loss": 0.3985,
353
+ "step": 2450
354
+ },
355
+ {
356
+ "epoch": 0.8837044892188052,
357
+ "grad_norm": 1.7705445289611816,
358
+ "learning_rate": 0.00024708377518557794,
359
+ "loss": 0.3895,
360
+ "step": 2500
361
+ },
362
+ {
363
+ "epoch": 0.9013785790031813,
364
+ "grad_norm": 1.352480173110962,
365
+ "learning_rate": 0.0002460233297985153,
366
+ "loss": 0.426,
367
+ "step": 2550
368
+ },
369
+ {
370
+ "epoch": 0.9190526687875574,
371
+ "grad_norm": 1.479979157447815,
372
+ "learning_rate": 0.0002449628844114528,
373
+ "loss": 0.4057,
374
+ "step": 2600
375
+ },
376
+ {
377
+ "epoch": 0.9367267585719335,
378
+ "grad_norm": 2.1380653381347656,
379
+ "learning_rate": 0.00024390243902439022,
380
+ "loss": 0.3689,
381
+ "step": 2650
382
+ },
383
+ {
384
+ "epoch": 0.9544008483563097,
385
+ "grad_norm": 1.9099682569503784,
386
+ "learning_rate": 0.00024284199363732768,
387
+ "loss": 0.3991,
388
+ "step": 2700
389
+ },
390
+ {
391
+ "epoch": 0.9720749381406858,
392
+ "grad_norm": 1.399566411972046,
393
+ "learning_rate": 0.0002417815482502651,
394
+ "loss": 0.3412,
395
+ "step": 2750
396
+ },
397
+ {
398
+ "epoch": 0.9897490279250618,
399
+ "grad_norm": 2.508267879486084,
400
+ "learning_rate": 0.00024072110286320252,
401
+ "loss": 0.3828,
402
+ "step": 2800
403
+ },
404
+ {
405
+ "epoch": 1.0,
406
+ "eval_bertscore_f1": 0.9667777874331811,
407
+ "eval_bleu": 0.5973566262792636,
408
+ "eval_loss": 0.27053505182266235,
409
+ "eval_runtime": 1054.1237,
410
+ "eval_samples_per_second": 6.132,
411
+ "eval_steps_per_second": 0.767,
412
+ "step": 2829
413
+ }
414
+ ],
415
+ "logging_steps": 50,
416
+ "max_steps": 14145,
417
+ "num_input_tokens_seen": 0,
418
+ "num_train_epochs": 5,
419
+ "save_steps": 500,
420
+ "stateful_callbacks": {
421
+ "TrainerControl": {
422
+ "args": {
423
+ "should_epoch_stop": false,
424
+ "should_evaluate": false,
425
+ "should_log": false,
426
+ "should_save": true,
427
+ "should_training_stop": false
428
+ },
429
+ "attributes": {}
430
+ }
431
+ },
432
+ "total_flos": 3460097079115776.0,
433
+ "train_batch_size": 8,
434
+ "trial_name": null,
435
+ "trial_params": null
436
+ }
checkpoint-2829/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ee513a34fdce19a0629cc9aa4ea661dbd2cb881304d77bffec8f2b929d97943
3
+ size 5432
checkpoint-2829/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-5658/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Salesforce/codet5-base
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.15.2
checkpoint-5658/adapter_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Salesforce/codet5-base",
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": true,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 16,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0.1,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "r": 8,
24
+ "rank_pattern": {},
25
+ "revision": null,
26
+ "target_modules": [
27
+ "q",
28
+ "v"
29
+ ],
30
+ "task_type": "SEQ_2_SEQ_LM",
31
+ "trainable_token_indices": null,
32
+ "use_dora": false,
33
+ "use_rslora": false
34
+ }
checkpoint-5658/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb2383433d76fe317e11ae0cdc5e479f55d5144dc96676ea9381f237b0aaae61
3
+ size 3558888
checkpoint-5658/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-5658/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d39453c19287e62a374e0bdaa02653cf349611ad219292b14fb3b6e47547a4c
3
+ size 7198906