Hugging Face's logo

nikJ13
/
Qwen2.5-Coder-7B-Instruct-MathQA

Safetensors
Model card Files
xet
 Community
nikJ13 commited on
Commit
8d71282
·
verified ·
1 Parent(s): f0b0a53

Delete Qwen2.5-Coder-7B-Instruct-math-solver-config_2

Browse files
Files changed (26) hide show
  1. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/added_tokens.json +0 -24
  2. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/README.md +0 -202
  3. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/adapter_config.json +0 -34
  4. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/adapter_model.safetensors +0 -3
  5. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/added_tokens.json +0 -24
  6. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/merges.txt +0 -0
  7. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/optimizer.pt +0 -3
  8. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/rng_state.pth +0 -3
  9. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/scheduler.pt +0 -3
  10. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/special_tokens_map.json +0 -31
  11. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/tokenizer.json +0 -3
  12. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/tokenizer_config.json +0 -207
  13. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/trainer_state.json +0 -1783
  14. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/training_args.bin +0 -3
  15. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/vocab.json +0 -0
  16. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/config.json +0 -45
  17. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/generation_config.json +0 -14
  18. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/merges.txt +0 -0
  19. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model-00001-of-00003.safetensors +0 -3
  20. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model-00002-of-00003.safetensors +0 -3
  21. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model-00003-of-00003.safetensors +0 -3
  22. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model.safetensors.index.json +0 -0
  23. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/special_tokens_map.json +0 -31
  24. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/tokenizer.json +0 -3
  25. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/tokenizer_config.json +0 -207
  26. Qwen2.5-Coder-7B-Instruct-math-solver-config_2/vocab.json +0 -0
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/added_tokens.json DELETED
@@ -1,24 +0,0 @@
1
- {
2
- "</tool_call>": 151658,
3
- "<tool_call>": 151657,
4
- "<|box_end|>": 151649,
5
- "<|box_start|>": 151648,
6
- "<|endoftext|>": 151643,
7
- "<|file_sep|>": 151664,
8
- "<|fim_middle|>": 151660,
9
- "<|fim_pad|>": 151662,
10
- "<|fim_prefix|>": 151659,
11
- "<|fim_suffix|>": 151661,
12
- "<|im_end|>": 151645,
13
- "<|im_start|>": 151644,
14
- "<|image_pad|>": 151655,
15
- "<|object_ref_end|>": 151647,
16
- "<|object_ref_start|>": 151646,
17
- "<|quad_end|>": 151651,
18
- "<|quad_start|>": 151650,
19
- "<|repo_name|>": 151663,
20
- "<|video_pad|>": 151656,
21
- "<|vision_end|>": 151653,
22
- "<|vision_pad|>": 151654,
23
- "<|vision_start|>": 151652
24
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/README.md DELETED
@@ -1,202 +0,0 @@
1
- ---
2
- base_model: Qwen/Qwen2.5-Coder-7B-Instruct
3
- library_name: peft
4
- ---
5
-
6
- # Model Card for Model ID
7
-
8
- <!-- Provide a quick summary of what the model is/does. -->
9
-
10
-
11
-
12
- ## Model Details
13
-
14
- ### Model Description
15
-
16
- <!-- Provide a longer summary of what this model is. -->
17
-
18
-
19
-
20
- - **Developed by:** [More Information Needed]
21
- - **Funded by [optional]:** [More Information Needed]
22
- - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
- - **Language(s) (NLP):** [More Information Needed]
25
- - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
-
28
- ### Model Sources [optional]
29
-
30
- <!-- Provide the basic links for the model. -->
31
-
32
- - **Repository:** [More Information Needed]
33
- - **Paper [optional]:** [More Information Needed]
34
- - **Demo [optional]:** [More Information Needed]
35
-
36
- ## Uses
37
-
38
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
-
40
- ### Direct Use
41
-
42
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
-
44
- [More Information Needed]
45
-
46
- ### Downstream Use [optional]
47
-
48
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
-
50
- [More Information Needed]
51
-
52
- ### Out-of-Scope Use
53
-
54
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
-
56
- [More Information Needed]
57
-
58
- ## Bias, Risks, and Limitations
59
-
60
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
-
62
- [More Information Needed]
63
-
64
- ### Recommendations
65
-
66
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
-
68
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
-
70
- ## How to Get Started with the Model
71
-
72
- Use the code below to get started with the model.
73
-
74
- [More Information Needed]
75
-
76
- ## Training Details
77
-
78
- ### Training Data
79
-
80
- <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
-
82
- [More Information Needed]
83
-
84
- ### Training Procedure
85
-
86
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
-
88
- #### Preprocessing [optional]
89
-
90
- [More Information Needed]
91
-
92
-
93
- #### Training Hyperparameters
94
-
95
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
-
97
- #### Speeds, Sizes, Times [optional]
98
-
99
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
-
101
- [More Information Needed]
102
-
103
- ## Evaluation
104
-
105
- <!-- This section describes the evaluation protocols and provides the results. -->
106
-
107
- ### Testing Data, Factors & Metrics
108
-
109
- #### Testing Data
110
-
111
- <!-- This should link to a Dataset Card if possible. -->
112
-
113
- [More Information Needed]
114
-
115
- #### Factors
116
-
117
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
-
119
- [More Information Needed]
120
-
121
- #### Metrics
122
-
123
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
-
125
- [More Information Needed]
126
-
127
- ### Results
128
-
129
- [More Information Needed]
130
-
131
- #### Summary
132
-
133
-
134
-
135
- ## Model Examination [optional]
136
-
137
- <!-- Relevant interpretability work for the model goes here -->
138
-
139
- [More Information Needed]
140
-
141
- ## Environmental Impact
142
-
143
- <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
-
145
- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
-
147
- - **Hardware Type:** [More Information Needed]
148
- - **Hours used:** [More Information Needed]
149
- - **Cloud Provider:** [More Information Needed]
150
- - **Compute Region:** [More Information Needed]
151
- - **Carbon Emitted:** [More Information Needed]
152
-
153
- ## Technical Specifications [optional]
154
-
155
- ### Model Architecture and Objective
156
-
157
- [More Information Needed]
158
-
159
- ### Compute Infrastructure
160
-
161
- [More Information Needed]
162
-
163
- #### Hardware
164
-
165
- [More Information Needed]
166
-
167
- #### Software
168
-
169
- [More Information Needed]
170
-
171
- ## Citation [optional]
172
-
173
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
-
175
- **BibTeX:**
176
-
177
- [More Information Needed]
178
-
179
- **APA:**
180
-
181
- [More Information Needed]
182
-
183
- ## Glossary [optional]
184
-
185
- <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
-
187
- [More Information Needed]
188
-
189
- ## More Information [optional]
190
-
191
- [More Information Needed]
192
-
193
- ## Model Card Authors [optional]
194
-
195
- [More Information Needed]
196
-
197
- ## Model Card Contact
198
-
199
- [More Information Needed]
200
- ### Framework versions
201
-
202
- - PEFT 0.13.2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/adapter_config.json DELETED
@@ -1,34 +0,0 @@
1
- {
2
- "alpha_pattern": {},
3
- "auto_mapping": null,
4
- "base_model_name_or_path": "Qwen/Qwen2.5-Coder-7B-Instruct",
5
- "bias": "none",
6
- "fan_in_fan_out": false,
7
- "inference_mode": true,
8
- "init_lora_weights": true,
9
- "layer_replication": null,
10
- "layers_pattern": null,
11
- "layers_to_transform": null,
12
- "loftq_config": {},
13
- "lora_alpha": 16,
14
- "lora_dropout": 0.03,
15
- "megatron_config": null,
16
- "megatron_core": "megatron.core",
17
- "modules_to_save": null,
18
- "peft_type": "LORA",
19
- "r": 8,
20
- "rank_pattern": {},
21
- "revision": null,
22
- "target_modules": [
23
- "o_proj",
24
- "gate_proj",
25
- "up_proj",
26
- "v_proj",
27
- "q_proj",
28
- "down_proj",
29
- "k_proj"
30
- ],
31
- "task_type": "CAUSAL_LM",
32
- "use_dora": false,
33
- "use_rslora": false
34
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/adapter_model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:3f9a17e54a9b8fcb3027c6f562093f975bf42ee361cb332018835153fcf7e5ce
3
- size 80792096
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/added_tokens.json DELETED
@@ -1,24 +0,0 @@
1
- {
2
- "</tool_call>": 151658,
3
- "<tool_call>": 151657,
4
- "<|box_end|>": 151649,
5
- "<|box_start|>": 151648,
6
- "<|endoftext|>": 151643,
7
- "<|file_sep|>": 151664,
8
- "<|fim_middle|>": 151660,
9
- "<|fim_pad|>": 151662,
10
- "<|fim_prefix|>": 151659,
11
- "<|fim_suffix|>": 151661,
12
- "<|im_end|>": 151645,
13
- "<|im_start|>": 151644,
14
- "<|image_pad|>": 151655,
15
- "<|object_ref_end|>": 151647,
16
- "<|object_ref_start|>": 151646,
17
- "<|quad_end|>": 151651,
18
- "<|quad_start|>": 151650,
19
- "<|repo_name|>": 151663,
20
- "<|video_pad|>": 151656,
21
- "<|vision_end|>": 151653,
22
- "<|vision_pad|>": 151654,
23
- "<|vision_start|>": 151652
24
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/merges.txt DELETED
The diff for this file is too large to render. See raw diff
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/optimizer.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d7e954659aef6782c05a3ce6ea0ac96423015a7ef9dab22128aad227938f142f
3
- size 161714746
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/rng_state.pth DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:46285fdf783fb8c88b056edfb4586a34cf9e1923fb5c13de3800e6806fb20d85
3
- size 14244
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/scheduler.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:043e829d8b37b27991c97100faafefff4d4da481d5b3d95feba3b539e8f039f8
3
- size 1064
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/special_tokens_map.json DELETED
@@ -1,31 +0,0 @@
1
- {
2
- "additional_special_tokens": [
3
- "<|im_start|>",
4
- "<|im_end|>",
5
- "<|object_ref_start|>",
6
- "<|object_ref_end|>",
7
- "<|box_start|>",
8
- "<|box_end|>",
9
- "<|quad_start|>",
10
- "<|quad_end|>",
11
- "<|vision_start|>",
12
- "<|vision_end|>",
13
- "<|vision_pad|>",
14
- "<|image_pad|>",
15
- "<|video_pad|>"
16
- ],
17
- "eos_token": {
18
- "content": "<|im_end|>",
19
- "lstrip": false,
20
- "normalized": false,
21
- "rstrip": false,
22
- "single_word": false
23
- },
24
- "pad_token": {
25
- "content": "<|endoftext|>",
26
- "lstrip": false,
27
- "normalized": false,
28
- "rstrip": false,
29
- "single_word": false
30
- }
31
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/tokenizer.json DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:962b8d8c521fefa934665afddae177326e974ddd6a26e69ff31ad6bccbb5593b
3
- size 11421994
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/tokenizer_config.json DELETED
@@ -1,207 +0,0 @@
1
- {
2
- "add_bos_token": false,
3
- "add_prefix_space": false,
4
- "added_tokens_decoder": {
5
- "151643": {
6
- "content": "<|endoftext|>",
7
- "lstrip": false,
8
- "normalized": false,
9
- "rstrip": false,
10
- "single_word": false,
11
- "special": true
12
- },
13
- "151644": {
14
- "content": "<|im_start|>",
15
- "lstrip": false,
16
- "normalized": false,
17
- "rstrip": false,
18
- "single_word": false,
19
- "special": true
20
- },
21
- "151645": {
22
- "content": "<|im_end|>",
23
- "lstrip": false,
24
- "normalized": false,
25
- "rstrip": false,
26
- "single_word": false,
27
- "special": true
28
- },
29
- "151646": {
30
- "content": "<|object_ref_start|>",
31
- "lstrip": false,
32
- "normalized": false,
33
- "rstrip": false,
34
- "single_word": false,
35
- "special": true
36
- },
37
- "151647": {
38
- "content": "<|object_ref_end|>",
39
- "lstrip": false,
40
- "normalized": false,
41
- "rstrip": false,
42
- "single_word": false,
43
- "special": true
44
- },
45
- "151648": {
46
- "content": "<|box_start|>",
47
- "lstrip": false,
48
- "normalized": false,
49
- "rstrip": false,
50
- "single_word": false,
51
- "special": true
52
- },
53
- "151649": {
54
- "content": "<|box_end|>",
55
- "lstrip": false,
56
- "normalized": false,
57
- "rstrip": false,
58
- "single_word": false,
59
- "special": true
60
- },
61
- "151650": {
62
- "content": "<|quad_start|>",
63
- "lstrip": false,
64
- "normalized": false,
65
- "rstrip": false,
66
- "single_word": false,
67
- "special": true
68
- },
69
- "151651": {
70
- "content": "<|quad_end|>",
71
- "lstrip": false,
72
- "normalized": false,
73
- "rstrip": false,
74
- "single_word": false,
75
- "special": true
76
- },
77
- "151652": {
78
- "content": "<|vision_start|>",
79
- "lstrip": false,
80
- "normalized": false,
81
- "rstrip": false,
82
- "single_word": false,
83
- "special": true
84
- },
85
- "151653": {
86
- "content": "<|vision_end|>",
87
- "lstrip": false,
88
- "normalized": false,
89
- "rstrip": false,
90
- "single_word": false,
91
- "special": true
92
- },
93
- "151654": {
94
- "content": "<|vision_pad|>",
95
- "lstrip": false,
96
- "normalized": false,
97
- "rstrip": false,
98
- "single_word": false,
99
- "special": true
100
- },
101
- "151655": {
102
- "content": "<|image_pad|>",
103
- "lstrip": false,
104
- "normalized": false,
105
- "rstrip": false,
106
- "single_word": false,
107
- "special": true
108
- },
109
- "151656": {
110
- "content": "<|video_pad|>",
111
- "lstrip": false,
112
- "normalized": false,
113
- "rstrip": false,
114
- "single_word": false,
115
- "special": true
116
- },
117
- "151657": {
118
- "content": "<tool_call>",
119
- "lstrip": false,
120
- "normalized": false,
121
- "rstrip": false,
122
- "single_word": false,
123
- "special": false
124
- },
125
- "151658": {
126
- "content": "</tool_call>",
127
- "lstrip": false,
128
- "normalized": false,
129
- "rstrip": false,
130
- "single_word": false,
131
- "special": false
132
- },
133
- "151659": {
134
- "content": "<|fim_prefix|>",
135
- "lstrip": false,
136
- "normalized": false,
137
- "rstrip": false,
138
- "single_word": false,
139
- "special": false
140
- },
141
- "151660": {
142
- "content": "<|fim_middle|>",
143
- "lstrip": false,
144
- "normalized": false,
145
- "rstrip": false,
146
- "single_word": false,
147
- "special": false
148
- },
149
- "151661": {
150
- "content": "<|fim_suffix|>",
151
- "lstrip": false,
152
- "normalized": false,
153
- "rstrip": false,
154
- "single_word": false,
155
- "special": false
156
- },
157
- "151662": {
158
- "content": "<|fim_pad|>",
159
- "lstrip": false,
160
- "normalized": false,
161
- "rstrip": false,
162
- "single_word": false,
163
- "special": false
164
- },
165
- "151663": {
166
- "content": "<|repo_name|>",
167
- "lstrip": false,
168
- "normalized": false,
169
- "rstrip": false,
170
- "single_word": false,
171
- "special": false
172
- },
173
- "151664": {
174
- "content": "<|file_sep|>",
175
- "lstrip": false,
176
- "normalized": false,
177
- "rstrip": false,
178
- "single_word": false,
179
- "special": false
180
- }
181
- },
182
- "additional_special_tokens": [
183
- "<|im_start|>",
184
- "<|im_end|>",
185
- "<|object_ref_start|>",
186
- "<|object_ref_end|>",
187
- "<|box_start|>",
188
- "<|box_end|>",
189
- "<|quad_start|>",
190
- "<|quad_end|>",
191
- "<|vision_start|>",
192
- "<|vision_end|>",
193
- "<|vision_pad|>",
194
- "<|image_pad|>",
195
- "<|video_pad|>"
196
- ],
197
- "bos_token": null,
198
- "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0]['role'] == 'system' %}\n {{- messages[0]['content'] }}\n {%- else %}\n {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n {%- endif %}\n {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0]['role'] == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n {%- else %}\n {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role }}\n {%- if message.content %}\n {{- '\\n' + message.content }}\n {%- endif %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {{- tool_call.arguments | tojson }}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- message.content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
199
- "clean_up_tokenization_spaces": false,
200
- "eos_token": "<|im_end|>",
201
- "errors": "replace",
202
- "model_max_length": 32768,
203
- "pad_token": "<|endoftext|>",
204
- "split_special_tokens": false,
205
- "tokenizer_class": "Qwen2Tokenizer",
206
- "unk_token": null
207
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/trainer_state.json DELETED
@@ -1,1783 +0,0 @@
1
- {
2
- "best_metric": null,
3
- "best_model_checkpoint": null,
4
- "epoch": 2.0,
5
- "eval_steps": 500,
6
- "global_step": 250,
7
- "is_hyper_param_search": false,
8
- "is_local_process_zero": true,
9
- "is_world_process_zero": true,
10
- "log_history": [
11
- {
12
- "epoch": 0.008,
13
- "grad_norm": 0.24865664541721344,
14
- "learning_rate": 1.3157894736842106e-06,
15
- "loss": 1.1602,
16
- "step": 1
17
- },
18
- {
19
- "epoch": 0.016,
20
- "grad_norm": 0.3196355402469635,
21
- "learning_rate": 2.631578947368421e-06,
22
- "loss": 1.4248,
23
- "step": 2
24
- },
25
- {
26
- "epoch": 0.024,
27
- "grad_norm": 0.3538743257522583,
28
- "learning_rate": 3.9473684210526315e-06,
29
- "loss": 1.5393,
30
- "step": 3
31
- },
32
- {
33
- "epoch": 0.032,
34
- "grad_norm": 0.36658579111099243,
35
- "learning_rate": 5.263157894736842e-06,
36
- "loss": 1.4325,
37
- "step": 4
38
- },
39
- {
40
- "epoch": 0.04,
41
- "grad_norm": 0.3693000078201294,
42
- "learning_rate": 6.578947368421053e-06,
43
- "loss": 1.5301,
44
- "step": 5
45
- },
46
- {
47
- "epoch": 0.048,
48
- "grad_norm": 0.3944966197013855,
49
- "learning_rate": 7.894736842105263e-06,
50
- "loss": 1.5176,
51
- "step": 6
52
- },
53
- {
54
- "epoch": 0.056,
55
- "grad_norm": 0.41085588932037354,
56
- "learning_rate": 9.210526315789474e-06,
57
- "loss": 1.6602,
58
- "step": 7
59
- },
60
- {
61
- "epoch": 0.064,
62
- "grad_norm": 0.421796590089798,
63
- "learning_rate": 1.0526315789473684e-05,
64
- "loss": 1.6694,
65
- "step": 8
66
- },
67
- {
68
- "epoch": 0.072,
69
- "grad_norm": 0.4749573767185211,
70
- "learning_rate": 1.1842105263157895e-05,
71
- "loss": 1.6725,
72
- "step": 9
73
- },
74
- {
75
- "epoch": 0.08,
76
- "grad_norm": 0.4257892966270447,
77
- "learning_rate": 1.3157894736842106e-05,
78
- "loss": 1.6013,
79
- "step": 10
80
- },
81
- {
82
- "epoch": 0.088,
83
- "grad_norm": 0.44330233335494995,
84
- "learning_rate": 1.4473684210526317e-05,
85
- "loss": 1.6438,
86
- "step": 11
87
- },
88
- {
89
- "epoch": 0.096,
90
- "grad_norm": 0.4523654282093048,
91
- "learning_rate": 1.5789473684210526e-05,
92
- "loss": 1.6242,
93
- "step": 12
94
- },
95
- {
96
- "epoch": 0.104,
97
- "grad_norm": 0.458086222410202,
98
- "learning_rate": 1.7105263157894737e-05,
99
- "loss": 1.7038,
100
- "step": 13
101
- },
102
- {
103
- "epoch": 0.112,
104
- "grad_norm": 0.48318082094192505,
105
- "learning_rate": 1.8421052631578947e-05,
106
- "loss": 1.7358,
107
- "step": 14
108
- },
109
- {
110
- "epoch": 0.12,
111
- "grad_norm": 0.5008033514022827,
112
- "learning_rate": 1.9736842105263158e-05,
113
- "loss": 1.6975,
114
- "step": 15
115
- },
116
- {
117
- "epoch": 0.128,
118
- "grad_norm": 0.5200161933898926,
119
- "learning_rate": 2.105263157894737e-05,
120
- "loss": 1.6532,
121
- "step": 16
122
- },
123
- {
124
- "epoch": 0.136,
125
- "grad_norm": 0.5368704199790955,
126
- "learning_rate": 2.236842105263158e-05,
127
- "loss": 1.6966,
128
- "step": 17
129
- },
130
- {
131
- "epoch": 0.144,
132
- "grad_norm": 0.5759434700012207,
133
- "learning_rate": 2.368421052631579e-05,
134
- "loss": 1.7358,
135
- "step": 18
136
- },
137
- {
138
- "epoch": 0.152,
139
- "grad_norm": 0.5874106287956238,
140
- "learning_rate": 2.5e-05,
141
- "loss": 1.7357,
142
- "step": 19
143
- },
144
- {
145
- "epoch": 0.16,
146
- "grad_norm": 0.599157452583313,
147
- "learning_rate": 2.6315789473684212e-05,
148
- "loss": 1.7976,
149
- "step": 20
150
- },
151
- {
152
- "epoch": 0.168,
153
- "grad_norm": 0.613358199596405,
154
- "learning_rate": 2.7631578947368426e-05,
155
- "loss": 1.6758,
156
- "step": 21
157
- },
158
- {
159
- "epoch": 0.176,
160
- "grad_norm": 0.6018260717391968,
161
- "learning_rate": 2.8947368421052634e-05,
162
- "loss": 1.6598,
163
- "step": 22
164
- },
165
- {
166
- "epoch": 0.184,
167
- "grad_norm": 0.6722389459609985,
168
- "learning_rate": 3.0263157894736844e-05,
169
- "loss": 1.6789,
170
- "step": 23
171
- },
172
- {
173
- "epoch": 0.192,
174
- "grad_norm": 0.6526374220848083,
175
- "learning_rate": 3.157894736842105e-05,
176
- "loss": 1.6829,
177
- "step": 24
178
- },
179
- {
180
- "epoch": 0.2,
181
- "grad_norm": 0.6730968952178955,
182
- "learning_rate": 3.289473684210527e-05,
183
- "loss": 1.6589,
184
- "step": 25
185
- },
186
- {
187
- "epoch": 0.208,
188
- "grad_norm": 0.7118183970451355,
189
- "learning_rate": 3.421052631578947e-05,
190
- "loss": 1.6073,
191
- "step": 26
192
- },
193
- {
194
- "epoch": 0.216,
195
- "grad_norm": 0.7171126008033752,
196
- "learning_rate": 3.5526315789473684e-05,
197
- "loss": 1.5865,
198
- "step": 27
199
- },
200
- {
201
- "epoch": 0.224,
202
- "grad_norm": 0.7675009965896606,
203
- "learning_rate": 3.6842105263157895e-05,
204
- "loss": 1.6071,
205
- "step": 28
206
- },
207
- {
208
- "epoch": 0.232,
209
- "grad_norm": 0.8262112736701965,
210
- "learning_rate": 3.815789473684211e-05,
211
- "loss": 1.6342,
212
- "step": 29
213
- },
214
- {
215
- "epoch": 0.24,
216
- "grad_norm": 0.896486759185791,
217
- "learning_rate": 3.9473684210526316e-05,
218
- "loss": 1.6481,
219
- "step": 30
220
- },
221
- {
222
- "epoch": 0.248,
223
- "grad_norm": 1.0325651168823242,
224
- "learning_rate": 4.078947368421053e-05,
225
- "loss": 1.6967,
226
- "step": 31
227
- },
228
- {
229
- "epoch": 0.256,
230
- "grad_norm": 0.4542241096496582,
231
- "learning_rate": 4.210526315789474e-05,
232
- "loss": 0.9785,
233
- "step": 32
234
- },
235
- {
236
- "epoch": 0.264,
237
- "grad_norm": 0.5293198227882385,
238
- "learning_rate": 4.342105263157895e-05,
239
- "loss": 0.9006,
240
- "step": 33
241
- },
242
- {
243
- "epoch": 0.272,
244
- "grad_norm": 0.5653361678123474,
245
- "learning_rate": 4.473684210526316e-05,
246
- "loss": 0.9437,
247
- "step": 34
248
- },
249
- {
250
- "epoch": 0.28,
251
- "grad_norm": 0.6040241122245789,
252
- "learning_rate": 4.605263157894737e-05,
253
- "loss": 0.8542,
254
- "step": 35
255
- },
256
- {
257
- "epoch": 0.288,
258
- "grad_norm": 0.6314385533332825,
259
- "learning_rate": 4.736842105263158e-05,
260
- "loss": 0.8234,
261
- "step": 36
262
- },
263
- {
264
- "epoch": 0.296,
265
- "grad_norm": 0.6959924697875977,
266
- "learning_rate": 4.868421052631579e-05,
267
- "loss": 0.7829,
268
- "step": 37
269
- },
270
- {
271
- "epoch": 0.304,
272
- "grad_norm": 0.7756078839302063,
273
- "learning_rate": 5e-05,
274
- "loss": 0.8282,
275
- "step": 38
276
- },
277
- {
278
- "epoch": 0.312,
279
- "grad_norm": 0.6908975839614868,
280
- "learning_rate": 4.999725507748798e-05,
281
- "loss": 0.7242,
282
- "step": 39
283
- },
284
- {
285
- "epoch": 0.32,
286
- "grad_norm": 0.6330760717391968,
287
- "learning_rate": 4.9989020912719864e-05,
288
- "loss": 0.727,
289
- "step": 40
290
- },
291
- {
292
- "epoch": 0.328,
293
- "grad_norm": 0.6052272915840149,
294
- "learning_rate": 4.99752993138672e-05,
295
- "loss": 0.6643,
296
- "step": 41
297
- },
298
- {
299
- "epoch": 0.336,
300
- "grad_norm": 0.6132879853248596,
301
- "learning_rate": 4.995609329410804e-05,
302
- "loss": 0.6447,
303
- "step": 42
304
- },
305
- {
306
- "epoch": 0.344,
307
- "grad_norm": 0.5237879157066345,
308
- "learning_rate": 4.9931407070965254e-05,
309
- "loss": 0.6108,
310
- "step": 43
311
- },
312
- {
313
- "epoch": 0.352,
314
- "grad_norm": 0.518282949924469,
315
- "learning_rate": 4.990124606538042e-05,
316
- "loss": 0.5422,
317
- "step": 44
318
- },
319
- {
320
- "epoch": 0.36,
321
- "grad_norm": 0.5129300355911255,
322
- "learning_rate": 4.9865616900523406e-05,
323
- "loss": 0.5246,
324
- "step": 45
325
- },
326
- {
327
- "epoch": 0.368,
328
- "grad_norm": 0.4948086440563202,
329
- "learning_rate": 4.982452740033793e-05,
330
- "loss": 0.5155,
331
- "step": 46
332
- },
333
- {
334
- "epoch": 0.376,
335
- "grad_norm": 0.5217537879943848,
336
- "learning_rate": 4.9777986587823523e-05,
337
- "loss": 0.5249,
338
- "step": 47
339
- },
340
- {
341
- "epoch": 0.384,
342
- "grad_norm": 0.5145795345306396,
343
- "learning_rate": 4.97260046830541e-05,
344
- "loss": 0.4969,
345
- "step": 48
346
- },
347
- {
348
- "epoch": 0.392,
349
- "grad_norm": 0.4615589380264282,
350
- "learning_rate": 4.966859310093372e-05,
351
- "loss": 0.4851,
352
- "step": 49
353
- },
354
- {
355
- "epoch": 0.4,
356
- "grad_norm": 0.49507981538772583,
357
- "learning_rate": 4.960576444868992e-05,
358
- "loss": 0.5188,
359
- "step": 50
360
- },
361
- {
362
- "epoch": 0.408,
363
- "grad_norm": 0.4753955602645874,
364
- "learning_rate": 4.953753252310526e-05,
365
- "loss": 0.4683,
366
- "step": 51
367
- },
368
- {
369
- "epoch": 0.416,
370
- "grad_norm": 0.5587810277938843,
371
- "learning_rate": 4.94639123074876e-05,
372
- "loss": 0.515,
373
- "step": 52
374
- },
375
- {
376
- "epoch": 0.424,
377
- "grad_norm": 0.4961254894733429,
378
- "learning_rate": 4.9384919968379945e-05,
379
- "loss": 0.4965,
380
- "step": 53
381
- },
382
- {
383
- "epoch": 0.432,
384
- "grad_norm": 0.5089071989059448,
385
- "learning_rate": 4.930057285201027e-05,
386
- "loss": 0.4635,
387
- "step": 54
388
- },
389
- {
390
- "epoch": 0.44,
391
- "grad_norm": 0.4938870072364807,
392
- "learning_rate": 4.921088948048247e-05,
393
- "loss": 0.4057,
394
- "step": 55
395
- },
396
- {
397
- "epoch": 0.448,
398
- "grad_norm": 0.5369834899902344,
399
- "learning_rate": 4.911588954770897e-05,
400
- "loss": 0.4987,
401
- "step": 56
402
- },
403
- {
404
- "epoch": 0.456,
405
- "grad_norm": 0.48214656114578247,
406
- "learning_rate": 4.901559391508611e-05,
407
- "loss": 0.3411,
408
- "step": 57
409
- },
410
- {
411
- "epoch": 0.464,
412
- "grad_norm": 0.5370784401893616,
413
- "learning_rate": 4.891002460691306e-05,
414
- "loss": 0.4392,
415
- "step": 58
416
- },
417
- {
418
- "epoch": 0.472,
419
- "grad_norm": 0.6377392411231995,
420
- "learning_rate": 4.879920480555549e-05,
421
- "loss": 0.4301,
422
- "step": 59
423
- },
424
- {
425
- "epoch": 0.48,
426
- "grad_norm": 0.5838919878005981,
427
- "learning_rate": 4.8683158846354786e-05,
428
- "loss": 0.4132,
429
- "step": 60
430
- },
431
- {
432
- "epoch": 0.488,
433
- "grad_norm": 0.5902217030525208,
434
- "learning_rate": 4.8561912212284223e-05,
435
- "loss": 0.3576,
436
- "step": 61
437
- },
438
- {
439
- "epoch": 0.496,
440
- "grad_norm": 0.754410982131958,
441
- "learning_rate": 4.8435491528353026e-05,
442
- "loss": 0.4523,
443
- "step": 62
444
- },
445
- {
446
- "epoch": 0.504,
447
- "grad_norm": 0.3841688334941864,
448
- "learning_rate": 4.83039245557597e-05,
449
- "loss": 0.45,
450
- "step": 63
451
- },
452
- {
453
- "epoch": 0.512,
454
- "grad_norm": 0.3717823922634125,
455
- "learning_rate": 4.8167240185795835e-05,
456
- "loss": 0.3336,
457
- "step": 64
458
- },
459
- {
460
- "epoch": 0.52,
461
- "grad_norm": 0.47037777304649353,
462
- "learning_rate": 4.8025468433501774e-05,
463
- "loss": 0.3582,
464
- "step": 65
465
- },
466
- {
467
- "epoch": 0.528,
468
- "grad_norm": 0.46502575278282166,
469
- "learning_rate": 4.787864043107546e-05,
470
- "loss": 0.3409,
471
- "step": 66
472
- },
473
- {
474
- "epoch": 0.536,
475
- "grad_norm": 0.43655312061309814,
476
- "learning_rate": 4.772678842103605e-05,
477
- "loss": 0.3126,
478
- "step": 67
479
- },
480
- {
481
- "epoch": 0.544,
482
- "grad_norm": 0.4324004352092743,
483
- "learning_rate": 4.756994574914359e-05,
484
- "loss": 0.4056,
485
- "step": 68
486
- },
487
- {
488
- "epoch": 0.552,
489
- "grad_norm": 0.4691210687160492,
490
- "learning_rate": 4.7408146857076566e-05,
491
- "loss": 0.4303,
492
- "step": 69
493
- },
494
- {
495
- "epoch": 0.56,
496
- "grad_norm": 0.4408304691314697,
497
- "learning_rate": 4.724142727486869e-05,
498
- "loss": 0.3864,
499
- "step": 70
500
- },
501
- {
502
- "epoch": 0.568,
503
- "grad_norm": 0.3811875581741333,
504
- "learning_rate": 4.706982361310669e-05,
505
- "loss": 0.3703,
506
- "step": 71
507
- },
508
- {
509
- "epoch": 0.576,
510
- "grad_norm": 0.41049814224243164,
511
- "learning_rate": 4.6893373554890925e-05,
512
- "loss": 0.4377,
513
- "step": 72
514
- },
515
- {
516
- "epoch": 0.584,
517
- "grad_norm": 0.38311585783958435,
518
- "learning_rate": 4.6712115847560355e-05,
519
- "loss": 0.3632,
520
- "step": 73
521
- },
522
- {
523
- "epoch": 0.592,
524
- "grad_norm": 0.36485862731933594,
525
- "learning_rate": 4.652609029418389e-05,
526
- "loss": 0.307,
527
- "step": 74
528
- },
529
- {
530
- "epoch": 0.6,
531
- "grad_norm": 0.3729493319988251,
532
- "learning_rate": 4.6335337744819873e-05,
533
- "loss": 0.3158,
534
- "step": 75
535
- },
536
- {
537
- "epoch": 0.608,
538
- "grad_norm": 0.3677141070365906,
539
- "learning_rate": 4.613990008754565e-05,
540
- "loss": 0.3068,
541
- "step": 76
542
- },
543
- {
544
- "epoch": 0.616,
545
- "grad_norm": 0.39400383830070496,
546
- "learning_rate": 4.593982023925926e-05,
547
- "loss": 0.3059,
548
- "step": 77
549
- },
550
- {
551
- "epoch": 0.624,
552
- "grad_norm": 0.37077513337135315,
553
- "learning_rate": 4.573514213625505e-05,
554
- "loss": 0.3265,
555
- "step": 78
556
- },
557
- {
558
- "epoch": 0.632,
559
- "grad_norm": 0.3794172406196594,
560
- "learning_rate": 4.552591072457565e-05,
561
- "loss": 0.2704,
562
- "step": 79
563
- },
564
- {
565
- "epoch": 0.64,
566
- "grad_norm": 0.34052136540412903,
567
- "learning_rate": 4.5312171950142034e-05,
568
- "loss": 0.3608,
569
- "step": 80
570
- },
571
- {
572
- "epoch": 0.648,
573
- "grad_norm": 0.3633767068386078,
574
- "learning_rate": 4.509397274866409e-05,
575
- "loss": 0.3121,
576
- "step": 81
577
- },
578
- {
579
- "epoch": 0.656,
580
- "grad_norm": 0.3865094482898712,
581
- "learning_rate": 4.4871361035333836e-05,
582
- "loss": 0.3223,
583
- "step": 82
584
- },
585
- {
586
- "epoch": 0.664,
587
- "grad_norm": 0.3914569914340973,
588
- "learning_rate": 4.464438569430354e-05,
589
- "loss": 0.31,
590
- "step": 83
591
- },
592
- {
593
- "epoch": 0.672,
594
- "grad_norm": 0.4124690890312195,
595
- "learning_rate": 4.441309656795106e-05,
596
- "loss": 0.3271,
597
- "step": 84
598
- },
599
- {
600
- "epoch": 0.68,
601
- "grad_norm": 0.40047597885131836,
602
- "learning_rate": 4.417754444593478e-05,
603
- "loss": 0.2988,
604
- "step": 85
605
- },
606
- {
607
- "epoch": 0.688,
608
- "grad_norm": 0.3661949932575226,
609
- "learning_rate": 4.3937781054040505e-05,
610
- "loss": 0.2711,
611
- "step": 86
612
- },
613
- {
614
- "epoch": 0.696,
615
- "grad_norm": 0.4758113920688629,
616
- "learning_rate": 4.3693859042822774e-05,
617
- "loss": 0.3229,
618
- "step": 87
619
- },
620
- {
621
- "epoch": 0.704,
622
- "grad_norm": 0.3500553369522095,
623
- "learning_rate": 4.344583197604318e-05,
624
- "loss": 0.2457,
625
- "step": 88
626
- },
627
- {
628
- "epoch": 0.712,
629
- "grad_norm": 0.37871506810188293,
630
- "learning_rate": 4.319375431890806e-05,
631
- "loss": 0.253,
632
- "step": 89
633
- },
634
- {
635
- "epoch": 0.72,
636
- "grad_norm": 0.4252273142337799,
637
- "learning_rate": 4.293768142610828e-05,
638
- "loss": 0.261,
639
- "step": 90
640
- },
641
- {
642
- "epoch": 0.728,
643
- "grad_norm": 0.46472597122192383,
644
- "learning_rate": 4.267766952966369e-05,
645
- "loss": 0.2603,
646
- "step": 91
647
- },
648
- {
649
- "epoch": 0.736,
650
- "grad_norm": 0.4873800277709961,
651
- "learning_rate": 4.241377572657493e-05,
652
- "loss": 0.309,
653
- "step": 92
654
- },
655
- {
656
- "epoch": 0.744,
657
- "grad_norm": 0.6409206986427307,
658
- "learning_rate": 4.214605796628527e-05,
659
- "loss": 0.2934,
660
- "step": 93
661
- },
662
- {
663
- "epoch": 0.752,
664
- "grad_norm": 0.39864566922187805,
665
- "learning_rate": 4.187457503795527e-05,
666
- "loss": 0.2996,
667
- "step": 94
668
- },
669
- {
670
- "epoch": 0.76,
671
- "grad_norm": 0.41790562868118286,
672
- "learning_rate": 4.159938655755306e-05,
673
- "loss": 0.3601,
674
- "step": 95
675
- },
676
- {
677
- "epoch": 0.768,
678
- "grad_norm": 0.3415062427520752,
679
- "learning_rate": 4.1320552954763044e-05,
680
- "loss": 0.3769,
681
- "step": 96
682
- },
683
- {
684
- "epoch": 0.776,
685
- "grad_norm": 0.4017191529273987,
686
- "learning_rate": 4.103813545971589e-05,
687
- "loss": 0.2815,
688
- "step": 97
689
- },
690
- {
691
- "epoch": 0.784,
692
- "grad_norm": 0.373216837644577,
693
- "learning_rate": 4.075219608954278e-05,
694
- "loss": 0.3004,
695
- "step": 98
696
- },
697
- {
698
- "epoch": 0.792,
699
- "grad_norm": 0.43103694915771484,
700
- "learning_rate": 4.046279763475687e-05,
701
- "loss": 0.299,
702
- "step": 99
703
- },
704
- {
705
- "epoch": 0.8,
706
- "grad_norm": 0.4167613983154297,
707
- "learning_rate": 4.017000364546484e-05,
708
- "loss": 0.3681,
709
- "step": 100
710
- },
711
- {
712
- "epoch": 0.808,
713
- "grad_norm": 0.37350332736968994,
714
- "learning_rate": 3.987387841741169e-05,
715
- "loss": 0.3132,
716
- "step": 101
717
- },
718
- {
719
- "epoch": 0.816,
720
- "grad_norm": 0.3607206344604492,
721
- "learning_rate": 3.95744869778618e-05,
722
- "loss": 0.3887,
723
- "step": 102
724
- },
725
- {
726
- "epoch": 0.824,
727
- "grad_norm": 0.3549709916114807,
728
- "learning_rate": 3.927189507131938e-05,
729
- "loss": 0.2621,
730
- "step": 103
731
- },
732
- {
733
- "epoch": 0.832,
734
- "grad_norm": 0.356314092874527,
735
- "learning_rate": 3.896616914509131e-05,
736
- "loss": 0.3039,
737
- "step": 104
738
- },
739
- {
740
- "epoch": 0.84,
741
- "grad_norm": 0.35983917117118835,
742
- "learning_rate": 3.8657376334695794e-05,
743
- "loss": 0.2641,
744
- "step": 105
745
- },
746
- {
747
- "epoch": 0.848,
748
- "grad_norm": 0.3070785701274872,
749
- "learning_rate": 3.8345584449119776e-05,
750
- "loss": 0.2441,
751
- "step": 106
752
- },
753
- {
754
- "epoch": 0.856,
755
- "grad_norm": 0.36583074927330017,
756
- "learning_rate": 3.80308619559285e-05,
757
- "loss": 0.2722,
758
- "step": 107
759
- },
760
- {
761
- "epoch": 0.864,
762
- "grad_norm": 0.3986961841583252,
763
- "learning_rate": 3.7713277966230514e-05,
764
- "loss": 0.2712,
765
- "step": 108
766
- },
767
- {
768
- "epoch": 0.872,
769
- "grad_norm": 0.3344065248966217,
770
- "learning_rate": 3.7392902219501234e-05,
771
- "loss": 0.2503,
772
- "step": 109
773
- },
774
- {
775
- "epoch": 0.88,
776
- "grad_norm": 0.345533549785614,
777
- "learning_rate": 3.706980506826863e-05,
778
- "loss": 0.3013,
779
- "step": 110
780
- },
781
- {
782
- "epoch": 0.888,
783
- "grad_norm": 0.47017595171928406,
784
- "learning_rate": 3.67440574626642e-05,
785
- "loss": 0.2805,
786
- "step": 111
787
- },
788
- {
789
- "epoch": 0.896,
790
- "grad_norm": 0.355198472738266,
791
- "learning_rate": 3.6415730934842827e-05,
792
- "loss": 0.2788,
793
- "step": 112
794
- },
795
- {
796
- "epoch": 0.904,
797
- "grad_norm": 0.5492923259735107,
798
- "learning_rate": 3.608489758327472e-05,
799
- "loss": 0.3435,
800
- "step": 113
801
- },
802
- {
803
- "epoch": 0.912,
804
- "grad_norm": 0.389226496219635,
805
- "learning_rate": 3.575163005691302e-05,
806
- "loss": 0.2873,
807
- "step": 114
808
- },
809
- {
810
- "epoch": 0.92,
811
- "grad_norm": 0.35273322463035583,
812
- "learning_rate": 3.541600153924058e-05,
813
- "loss": 0.2114,
814
- "step": 115
815
- },
816
- {
817
- "epoch": 0.928,
818
- "grad_norm": 0.3816155791282654,
819
- "learning_rate": 3.507808573219931e-05,
820
- "loss": 0.2154,
821
- "step": 116
822
- },
823
- {
824
- "epoch": 0.936,
825
- "grad_norm": 0.3877938389778137,
826
- "learning_rate": 3.473795684000569e-05,
827
- "loss": 0.3103,
828
- "step": 117
829
- },
830
- {
831
- "epoch": 0.944,
832
- "grad_norm": 0.39338254928588867,
833
- "learning_rate": 3.4395689552855955e-05,
834
- "loss": 0.286,
835
- "step": 118
836
- },
837
- {
838
- "epoch": 0.952,
839
- "grad_norm": 0.36437609791755676,
840
- "learning_rate": 3.4051359030524654e-05,
841
- "loss": 0.2864,
842
- "step": 119
843
- },
844
- {
845
- "epoch": 0.96,
846
- "grad_norm": 0.3598105013370514,
847
- "learning_rate": 3.3705040885859975e-05,
848
- "loss": 0.2443,
849
- "step": 120
850
- },
851
- {
852
- "epoch": 0.968,
853
- "grad_norm": 0.3966371715068817,
854
- "learning_rate": 3.335681116817963e-05,
855
- "loss": 0.3216,
856
- "step": 121
857
- },
858
- {
859
- "epoch": 0.976,
860
- "grad_norm": 0.3814857006072998,
861
- "learning_rate": 3.300674634657094e-05,
862
- "loss": 0.2423,
863
- "step": 122
864
- },
865
- {
866
- "epoch": 0.984,
867
- "grad_norm": 0.4128704071044922,
868
- "learning_rate": 3.265492329309867e-05,
869
- "loss": 0.2215,
870
- "step": 123
871
- },
872
- {
873
- "epoch": 0.992,
874
- "grad_norm": 0.5964083671569824,
875
- "learning_rate": 3.2301419265924395e-05,
876
- "loss": 0.3492,
877
- "step": 124
878
- },
879
- {
880
- "epoch": 1.0,
881
- "grad_norm": 0.4189704656600952,
882
- "learning_rate": 3.19463118923411e-05,
883
- "loss": 0.3667,
884
- "step": 125
885
- },
886
- {
887
- "epoch": 1.008,
888
- "grad_norm": 0.27754926681518555,
889
- "learning_rate": 3.158967915172669e-05,
890
- "loss": 0.318,
891
- "step": 126
892
- },
893
- {
894
- "epoch": 1.016,
895
- "grad_norm": 0.3140697479248047,
896
- "learning_rate": 3.123159935842024e-05,
897
- "loss": 0.2889,
898
- "step": 127
899
- },
900
- {
901
- "epoch": 1.024,
902
- "grad_norm": 0.31723132729530334,
903
- "learning_rate": 3.0872151144524595e-05,
904
- "loss": 0.2976,
905
- "step": 128
906
- },
907
- {
908
- "epoch": 1.032,
909
- "grad_norm": 0.33284464478492737,
910
- "learning_rate": 3.0511413442639296e-05,
911
- "loss": 0.2278,
912
- "step": 129
913
- },
914
- {
915
- "epoch": 1.04,
916
- "grad_norm": 0.29519200325012207,
917
- "learning_rate": 3.014946546852746e-05,
918
- "loss": 0.2556,
919
- "step": 130
920
- },
921
- {
922
- "epoch": 1.048,
923
- "grad_norm": 0.34405550360679626,
924
- "learning_rate": 2.978638670372047e-05,
925
- "loss": 0.2412,
926
- "step": 131
927
- },
928
- {
929
- "epoch": 1.056,
930
- "grad_norm": 0.3354402482509613,
931
- "learning_rate": 2.9422256878064325e-05,
932
- "loss": 0.3231,
933
- "step": 132
934
- },
935
- {
936
- "epoch": 1.064,
937
- "grad_norm": 0.3525708317756653,
938
- "learning_rate": 2.9057155952211502e-05,
939
- "loss": 0.3269,
940
- "step": 133
941
- },
942
- {
943
- "epoch": 1.072,
944
- "grad_norm": 0.3531375229358673,
945
- "learning_rate": 2.8691164100062034e-05,
946
- "loss": 0.2843,
947
- "step": 134
948
- },
949
- {
950
- "epoch": 1.08,
951
- "grad_norm": 0.3505934178829193,
952
- "learning_rate": 2.8324361691157858e-05,
953
- "loss": 0.2897,
954
- "step": 135
955
- },
956
- {
957
- "epoch": 1.088,
958
- "grad_norm": 0.3927627503871918,
959
- "learning_rate": 2.7956829273034148e-05,
960
- "loss": 0.2478,
961
- "step": 136
962
- },
963
- {
964
- "epoch": 1.096,
965
- "grad_norm": 0.30181774497032166,
966
- "learning_rate": 2.7588647553531576e-05,
967
- "loss": 0.2241,
968
- "step": 137
969
- },
970
- {
971
- "epoch": 1.104,
972
- "grad_norm": 0.2972296178340912,
973
- "learning_rate": 2.7219897383073373e-05,
974
- "loss": 0.2172,
975
- "step": 138
976
- },
977
- {
978
- "epoch": 1.112,
979
- "grad_norm": 0.31349578499794006,
980
- "learning_rate": 2.6850659736911073e-05,
981
- "loss": 0.21,
982
- "step": 139
983
- },
984
- {
985
- "epoch": 1.12,
986
- "grad_norm": 0.3143104910850525,
987
- "learning_rate": 2.648101569734286e-05,
988
- "loss": 0.2488,
989
- "step": 140
990
- },
991
- {
992
- "epoch": 1.1280000000000001,
993
- "grad_norm": 0.2934572100639343,
994
- "learning_rate": 2.6111046435908383e-05,
995
- "loss": 0.1929,
996
- "step": 141
997
- },
998
- {
999
- "epoch": 1.1360000000000001,
1000
- "grad_norm": 0.3367699980735779,
1001
- "learning_rate": 2.5740833195563996e-05,
1002
- "loss": 0.2006,
1003
- "step": 142
1004
- },
1005
- {
1006
- "epoch": 1.144,
1007
- "grad_norm": 0.35663464665412903,
1008
- "learning_rate": 2.537045727284232e-05,
1009
- "loss": 0.2916,
1010
- "step": 143
1011
- },
1012
- {
1013
- "epoch": 1.152,
1014
- "grad_norm": 0.325509250164032,
1015
- "learning_rate": 2.5e-05,
1016
- "loss": 0.2086,
1017
- "step": 144
1018
- },
1019
- {
1020
- "epoch": 1.16,
1021
- "grad_norm": 0.3458765149116516,
1022
- "learning_rate": 2.4629542727157684e-05,
1023
- "loss": 0.3017,
1024
- "step": 145
1025
- },
1026
- {
1027
- "epoch": 1.168,
1028
- "grad_norm": 0.45983412861824036,
1029
- "learning_rate": 2.4259166804436006e-05,
1030
- "loss": 0.2917,
1031
- "step": 146
1032
- },
1033
- {
1034
- "epoch": 1.176,
1035
- "grad_norm": 0.4231317341327667,
1036
- "learning_rate": 2.388895356409162e-05,
1037
- "loss": 0.2355,
1038
- "step": 147
1039
- },
1040
- {
1041
- "epoch": 1.184,
1042
- "grad_norm": 0.4036581814289093,
1043
- "learning_rate": 2.3518984302657146e-05,
1044
- "loss": 0.2632,
1045
- "step": 148
1046
- },
1047
- {
1048
- "epoch": 1.192,
1049
- "grad_norm": 0.34695810079574585,
1050
- "learning_rate": 2.314934026308893e-05,
1051
- "loss": 0.2336,
1052
- "step": 149
1053
- },
1054
- {
1055
- "epoch": 1.2,
1056
- "grad_norm": 0.34892335534095764,
1057
- "learning_rate": 2.2780102616926633e-05,
1058
- "loss": 0.2596,
1059
- "step": 150
1060
- },
1061
- {
1062
- "epoch": 1.208,
1063
- "grad_norm": 0.36718881130218506,
1064
- "learning_rate": 2.2411352446468426e-05,
1065
- "loss": 0.226,
1066
- "step": 151
1067
- },
1068
- {
1069
- "epoch": 1.216,
1070
- "grad_norm": 0.4148387610912323,
1071
- "learning_rate": 2.2043170726965858e-05,
1072
- "loss": 0.2049,
1073
- "step": 152
1074
- },
1075
- {
1076
- "epoch": 1.224,
1077
- "grad_norm": 0.382362961769104,
1078
- "learning_rate": 2.1675638308842145e-05,
1079
- "loss": 0.2266,
1080
- "step": 153
1081
- },
1082
- {
1083
- "epoch": 1.232,
1084
- "grad_norm": 0.4222099184989929,
1085
- "learning_rate": 2.1308835899937972e-05,
1086
- "loss": 0.2173,
1087
- "step": 154
1088
- },
1089
- {
1090
- "epoch": 1.24,
1091
- "grad_norm": 0.4744393229484558,
1092
- "learning_rate": 2.09428440477885e-05,
1093
- "loss": 0.2388,
1094
- "step": 155
1095
- },
1096
- {
1097
- "epoch": 1.248,
1098
- "grad_norm": 0.49966511130332947,
1099
- "learning_rate": 2.0577743121935684e-05,
1100
- "loss": 0.2863,
1101
- "step": 156
1102
- },
1103
- {
1104
- "epoch": 1.256,
1105
- "grad_norm": 0.303067684173584,
1106
- "learning_rate": 2.0213613296279533e-05,
1107
- "loss": 0.27,
1108
- "step": 157
1109
- },
1110
- {
1111
- "epoch": 1.264,
1112
- "grad_norm": 0.3159477412700653,
1113
- "learning_rate": 1.9850534531472546e-05,
1114
- "loss": 0.2676,
1115
- "step": 158
1116
- },
1117
- {
1118
- "epoch": 1.272,
1119
- "grad_norm": 0.4037911295890808,
1120
- "learning_rate": 1.9488586557360703e-05,
1121
- "loss": 0.2756,
1122
- "step": 159
1123
- },
1124
- {
1125
- "epoch": 1.28,
1126
- "grad_norm": 0.31597021222114563,
1127
- "learning_rate": 1.912784885547541e-05,
1128
- "loss": 0.2352,
1129
- "step": 160
1130
- },
1131
- {
1132
- "epoch": 1.288,
1133
- "grad_norm": 0.3116990625858307,
1134
- "learning_rate": 1.876840064157976e-05,
1135
- "loss": 0.2567,
1136
- "step": 161
1137
- },
1138
- {
1139
- "epoch": 1.296,
1140
- "grad_norm": 0.363339364528656,
1141
- "learning_rate": 1.8410320848273315e-05,
1142
- "loss": 0.2531,
1143
- "step": 162
1144
- },
1145
- {
1146
- "epoch": 1.304,
1147
- "grad_norm": 0.3354041576385498,
1148
- "learning_rate": 1.8053688107658908e-05,
1149
- "loss": 0.2269,
1150
- "step": 163
1151
- },
1152
- {
1153
- "epoch": 1.312,
1154
- "grad_norm": 0.33837804198265076,
1155
- "learning_rate": 1.769858073407561e-05,
1156
- "loss": 0.2979,
1157
- "step": 164
1158
- },
1159
- {
1160
- "epoch": 1.32,
1161
- "grad_norm": 0.38501226902008057,
1162
- "learning_rate": 1.734507670690133e-05,
1163
- "loss": 0.2992,
1164
- "step": 165
1165
- },
1166
- {
1167
- "epoch": 1.328,
1168
- "grad_norm": 0.3775830566883087,
1169
- "learning_rate": 1.6993253653429063e-05,
1170
- "loss": 0.2786,
1171
- "step": 166
1172
- },
1173
- {
1174
- "epoch": 1.336,
1175
- "grad_norm": 0.38247784972190857,
1176
- "learning_rate": 1.6643188831820375e-05,
1177
- "loss": 0.3024,
1178
- "step": 167
1179
- },
1180
- {
1181
- "epoch": 1.3439999999999999,
1182
- "grad_norm": 0.3799767792224884,
1183
- "learning_rate": 1.6294959114140034e-05,
1184
- "loss": 0.2601,
1185
- "step": 168
1186
- },
1187
- {
1188
- "epoch": 1.3519999999999999,
1189
- "grad_norm": 0.4074380695819855,
1190
- "learning_rate": 1.5948640969475346e-05,
1191
- "loss": 0.3349,
1192
- "step": 169
1193
- },
1194
- {
1195
- "epoch": 1.3599999999999999,
1196
- "grad_norm": 0.32019665837287903,
1197
- "learning_rate": 1.560431044714405e-05,
1198
- "loss": 0.2076,
1199
- "step": 170
1200
- },
1201
- {
1202
- "epoch": 1.3679999999999999,
1203
- "grad_norm": 0.33893170952796936,
1204
- "learning_rate": 1.5262043159994317e-05,
1205
- "loss": 0.2082,
1206
- "step": 171
1207
- },
1208
- {
1209
- "epoch": 1.376,
1210
- "grad_norm": 0.3765079081058502,
1211
- "learning_rate": 1.49219142678007e-05,
1212
- "loss": 0.2474,
1213
- "step": 172
1214
- },
1215
- {
1216
- "epoch": 1.384,
1217
- "grad_norm": 0.38151660561561584,
1218
- "learning_rate": 1.4583998460759424e-05,
1219
- "loss": 0.2516,
1220
- "step": 173
1221
- },
1222
- {
1223
- "epoch": 1.392,
1224
- "grad_norm": 0.3881061375141144,
1225
- "learning_rate": 1.4248369943086998e-05,
1226
- "loss": 0.2569,
1227
- "step": 174
1228
- },
1229
- {
1230
- "epoch": 1.4,
1231
- "grad_norm": 0.342462956905365,
1232
- "learning_rate": 1.3915102416725287e-05,
1233
- "loss": 0.2872,
1234
- "step": 175
1235
- },
1236
- {
1237
- "epoch": 1.408,
1238
- "grad_norm": 0.34670352935791016,
1239
- "learning_rate": 1.3584269065157174e-05,
1240
- "loss": 0.2234,
1241
- "step": 176
1242
- },
1243
- {
1244
- "epoch": 1.416,
1245
- "grad_norm": 0.3738473057746887,
1246
- "learning_rate": 1.3255942537335805e-05,
1247
- "loss": 0.2595,
1248
- "step": 177
1249
- },
1250
- {
1251
- "epoch": 1.424,
1252
- "grad_norm": 0.38799089193344116,
1253
- "learning_rate": 1.2930194931731382e-05,
1254
- "loss": 0.2764,
1255
- "step": 178
1256
- },
1257
- {
1258
- "epoch": 1.432,
1259
- "grad_norm": 0.3547898232936859,
1260
- "learning_rate": 1.2607097780498772e-05,
1261
- "loss": 0.2068,
1262
- "step": 179
1263
- },
1264
- {
1265
- "epoch": 1.44,
1266
- "grad_norm": 0.3661913573741913,
1267
- "learning_rate": 1.2286722033769493e-05,
1268
- "loss": 0.2441,
1269
- "step": 180
1270
- },
1271
- {
1272
- "epoch": 1.448,
1273
- "grad_norm": 0.4146352708339691,
1274
- "learning_rate": 1.1969138044071501e-05,
1275
- "loss": 0.2437,
1276
- "step": 181
1277
- },
1278
- {
1279
- "epoch": 1.456,
1280
- "grad_norm": 0.385513573884964,
1281
- "learning_rate": 1.1654415550880243e-05,
1282
- "loss": 0.2435,
1283
- "step": 182
1284
- },
1285
- {
1286
- "epoch": 1.464,
1287
- "grad_norm": 0.32480141520500183,
1288
- "learning_rate": 1.1342623665304209e-05,
1289
- "loss": 0.2132,
1290
- "step": 183
1291
- },
1292
- {
1293
- "epoch": 1.472,
1294
- "grad_norm": 0.3700958788394928,
1295
- "learning_rate": 1.1033830854908691e-05,
1296
- "loss": 0.221,
1297
- "step": 184
1298
- },
1299
- {
1300
- "epoch": 1.48,
1301
- "grad_norm": 0.40862661600112915,
1302
- "learning_rate": 1.0728104928680624e-05,
1303
- "loss": 0.1856,
1304
- "step": 185
1305
- },
1306
- {
1307
- "epoch": 1.488,
1308
- "grad_norm": 0.3734498918056488,
1309
- "learning_rate": 1.0425513022138203e-05,
1310
- "loss": 0.1938,
1311
- "step": 186
1312
- },
1313
- {
1314
- "epoch": 1.496,
1315
- "grad_norm": 0.43678006529808044,
1316
- "learning_rate": 1.0126121582588316e-05,
1317
- "loss": 0.2358,
1318
- "step": 187
1319
- },
1320
- {
1321
- "epoch": 1.504,
1322
- "grad_norm": 0.323270708322525,
1323
- "learning_rate": 9.829996354535172e-06,
1324
- "loss": 0.3189,
1325
- "step": 188
1326
- },
1327
- {
1328
- "epoch": 1.512,
1329
- "grad_norm": 0.3792528510093689,
1330
- "learning_rate": 9.53720236524313e-06,
1331
- "loss": 0.3121,
1332
- "step": 189
1333
- },
1334
- {
1335
- "epoch": 1.52,
1336
- "grad_norm": 0.2836848497390747,
1337
- "learning_rate": 9.247803910457226e-06,
1338
- "loss": 0.2361,
1339
- "step": 190
1340
- },
1341
- {
1342
- "epoch": 1.528,
1343
- "grad_norm": 0.3050157129764557,
1344
- "learning_rate": 8.96186454028412e-06,
1345
- "loss": 0.2303,
1346
- "step": 191
1347
- },
1348
- {
1349
- "epoch": 1.536,
1350
- "grad_norm": 0.3157828748226166,
1351
- "learning_rate": 8.679447045236962e-06,
1352
- "loss": 0.1952,
1353
- "step": 192
1354
- },
1355
- {
1356
- "epoch": 1.544,
1357
- "grad_norm": 0.3665717840194702,
1358
- "learning_rate": 8.400613442446948e-06,
1359
- "loss": 0.2791,
1360
- "step": 193
1361
- },
1362
- {
1363
- "epoch": 1.552,
1364
- "grad_norm": 0.3696276843547821,
1365
- "learning_rate": 8.125424962044742e-06,
1366
- "loss": 0.2683,
1367
- "step": 194
1368
- },
1369
- {
1370
- "epoch": 1.56,
1371
- "grad_norm": 0.3830272853374481,
1372
- "learning_rate": 7.853942033714736e-06,
1373
- "loss": 0.2632,
1374
- "step": 195
1375
- },
1376
- {
1377
- "epoch": 1.568,
1378
- "grad_norm": 0.376257985830307,
1379
- "learning_rate": 7.586224273425082e-06,
1380
- "loss": 0.2529,
1381
- "step": 196
1382
- },
1383
- {
1384
- "epoch": 1.576,
1385
- "grad_norm": 0.36672934889793396,
1386
- "learning_rate": 7.3223304703363135e-06,
1387
- "loss": 0.216,
1388
- "step": 197
1389
- },
1390
- {
1391
- "epoch": 1.584,
1392
- "grad_norm": 0.37204644083976746,
1393
- "learning_rate": 7.062318573891716e-06,
1394
- "loss": 0.1973,
1395
- "step": 198
1396
- },
1397
- {
1398
- "epoch": 1.592,
1399
- "grad_norm": 0.34666261076927185,
1400
- "learning_rate": 6.806245681091944e-06,
1401
- "loss": 0.3028,
1402
- "step": 199
1403
- },
1404
- {
1405
- "epoch": 1.6,
1406
- "grad_norm": 0.3931131958961487,
1407
- "learning_rate": 6.5541680239568165e-06,
1408
- "loss": 0.2937,
1409
- "step": 200
1410
- },
1411
- {
1412
- "epoch": 1.608,
1413
- "grad_norm": 0.39191216230392456,
1414
- "learning_rate": 6.3061409571772254e-06,
1415
- "loss": 0.282,
1416
- "step": 201
1417
- },
1418
- {
1419
- "epoch": 1.616,
1420
- "grad_norm": 0.30904093384742737,
1421
- "learning_rate": 6.062218945959497e-06,
1422
- "loss": 0.1957,
1423
- "step": 202
1424
- },
1425
- {
1426
- "epoch": 1.624,
1427
- "grad_norm": 0.35880279541015625,
1428
- "learning_rate": 5.822455554065217e-06,
1429
- "loss": 0.2354,
1430
- "step": 203
1431
- },
1432
- {
1433
- "epoch": 1.6320000000000001,
1434
- "grad_norm": 0.3484679162502289,
1435
- "learning_rate": 5.586903432048943e-06,
1436
- "loss": 0.2238,
1437
- "step": 204
1438
- },
1439
- {
1440
- "epoch": 1.6400000000000001,
1441
- "grad_norm": 0.3838287889957428,
1442
- "learning_rate": 5.355614305696468e-06,
1443
- "loss": 0.21,
1444
- "step": 205
1445
- },
1446
- {
1447
- "epoch": 1.6480000000000001,
1448
- "grad_norm": 0.3907261788845062,
1449
- "learning_rate": 5.128638964666166e-06,
1450
- "loss": 0.2891,
1451
- "step": 206
1452
- },
1453
- {
1454
- "epoch": 1.6560000000000001,
1455
- "grad_norm": 0.3640119433403015,
1456
- "learning_rate": 4.906027251335918e-06,
1457
- "loss": 0.238,
1458
- "step": 207
1459
- },
1460
- {
1461
- "epoch": 1.6640000000000001,
1462
- "grad_norm": 0.3209097981452942,
1463
- "learning_rate": 4.687828049857967e-06,
1464
- "loss": 0.2151,
1465
- "step": 208
1466
- },
1467
- {
1468
- "epoch": 1.6720000000000002,
1469
- "grad_norm": 0.40882906317710876,
1470
- "learning_rate": 4.474089275424351e-06,
1471
- "loss": 0.2042,
1472
- "step": 209
1473
- },
1474
- {
1475
- "epoch": 1.6800000000000002,
1476
- "grad_norm": 0.40567830204963684,
1477
- "learning_rate": 4.264857863744956e-06,
1478
- "loss": 0.2186,
1479
- "step": 210
1480
- },
1481
- {
1482
- "epoch": 1.688,
1483
- "grad_norm": 0.3913113474845886,
1484
- "learning_rate": 4.060179760740751e-06,
1485
- "loss": 0.2217,
1486
- "step": 211
1487
- },
1488
- {
1489
- "epoch": 1.696,
1490
- "grad_norm": 0.3794434070587158,
1491
- "learning_rate": 3.860099912454346e-06,
1492
- "loss": 0.2397,
1493
- "step": 212
1494
- },
1495
- {
1496
- "epoch": 1.704,
1497
- "grad_norm": 0.41944846510887146,
1498
- "learning_rate": 3.6646622551801345e-06,
1499
- "loss": 0.2753,
1500
- "step": 213
1501
- },
1502
- {
1503
- "epoch": 1.712,
1504
- "grad_norm": 0.37950611114501953,
1505
- "learning_rate": 3.4739097058161114e-06,
1506
- "loss": 0.2396,
1507
- "step": 214
1508
- },
1509
- {
1510
- "epoch": 1.72,
1511
- "grad_norm": 0.45468416810035706,
1512
- "learning_rate": 3.2878841524396465e-06,
1513
- "loss": 0.2628,
1514
- "step": 215
1515
- },
1516
- {
1517
- "epoch": 1.728,
1518
- "grad_norm": 0.4265020489692688,
1519
- "learning_rate": 3.1066264451090815e-06,
1520
- "loss": 0.2258,
1521
- "step": 216
1522
- },
1523
- {
1524
- "epoch": 1.736,
1525
- "grad_norm": 0.33766037225723267,
1526
- "learning_rate": 2.9301763868933157e-06,
1527
- "loss": 0.1755,
1528
- "step": 217
1529
- },
1530
- {
1531
- "epoch": 1.744,
1532
- "grad_norm": 0.46125152707099915,
1533
- "learning_rate": 2.75857272513132e-06,
1534
- "loss": 0.2202,
1535
- "step": 218
1536
- },
1537
- {
1538
- "epoch": 1.752,
1539
- "grad_norm": 0.2844786047935486,
1540
- "learning_rate": 2.5918531429234368e-06,
1541
- "loss": 0.3253,
1542
- "step": 219
1543
- },
1544
- {
1545
- "epoch": 1.76,
1546
- "grad_norm": 0.3015494644641876,
1547
- "learning_rate": 2.430054250856412e-06,
1548
- "loss": 0.2382,
1549
- "step": 220
1550
- },
1551
- {
1552
- "epoch": 1.768,
1553
- "grad_norm": 0.36929041147232056,
1554
- "learning_rate": 2.2732115789639603e-06,
1555
- "loss": 0.2531,
1556
- "step": 221
1557
- },
1558
- {
1559
- "epoch": 1.776,
1560
- "grad_norm": 0.36073899269104004,
1561
- "learning_rate": 2.1213595689245386e-06,
1562
- "loss": 0.3212,
1563
- "step": 222
1564
- },
1565
- {
1566
- "epoch": 1.784,
1567
- "grad_norm": 0.3759128153324127,
1568
- "learning_rate": 1.9745315664982276e-06,
1569
- "loss": 0.2729,
1570
- "step": 223
1571
- },
1572
- {
1573
- "epoch": 1.792,
1574
- "grad_norm": 0.407050222158432,
1575
- "learning_rate": 1.8327598142041658e-06,
1576
- "loss": 0.3041,
1577
- "step": 224
1578
- },
1579
- {
1580
- "epoch": 1.8,
1581
- "grad_norm": 0.3014572262763977,
1582
- "learning_rate": 1.6960754442403054e-06,
1583
- "loss": 0.1983,
1584
- "step": 225
1585
- },
1586
- {
1587
- "epoch": 1.808,
1588
- "grad_norm": 0.37884315848350525,
1589
- "learning_rate": 1.5645084716469777e-06,
1590
- "loss": 0.2668,
1591
- "step": 226
1592
- },
1593
- {
1594
- "epoch": 1.8159999999999998,
1595
- "grad_norm": 0.43857306241989136,
1596
- "learning_rate": 1.4380877877157834e-06,
1597
- "loss": 0.2759,
1598
- "step": 227
1599
- },
1600
- {
1601
- "epoch": 1.8239999999999998,
1602
- "grad_norm": 0.35497647523880005,
1603
- "learning_rate": 1.3168411536452152e-06,
1604
- "loss": 0.2731,
1605
- "step": 228
1606
- },
1607
- {
1608
- "epoch": 1.8319999999999999,
1609
- "grad_norm": 0.39014437794685364,
1610
- "learning_rate": 1.2007951944445122e-06,
1611
- "loss": 0.3247,
1612
- "step": 229
1613
- },
1614
- {
1615
- "epoch": 1.8399999999999999,
1616
- "grad_norm": 0.35698774456977844,
1617
- "learning_rate": 1.0899753930869394e-06,
1618
- "loss": 0.1736,
1619
- "step": 230
1620
- },
1621
- {
1622
- "epoch": 1.8479999999999999,
1623
- "grad_norm": 0.350015789270401,
1624
- "learning_rate": 9.844060849138997e-07,
1625
- "loss": 0.1855,
1626
- "step": 231
1627
- },
1628
- {
1629
- "epoch": 1.8559999999999999,
1630
- "grad_norm": 0.3690522015094757,
1631
- "learning_rate": 8.841104522910343e-07,
1632
- "loss": 0.3065,
1633
- "step": 232
1634
- },
1635
- {
1636
- "epoch": 1.8639999999999999,
1637
- "grad_norm": 0.35292261838912964,
1638
- "learning_rate": 7.891105195175358e-07,
1639
- "loss": 0.2125,
1640
- "step": 233
1641
- },
1642
- {
1643
- "epoch": 1.8719999999999999,
1644
- "grad_norm": 0.36542925238609314,
1645
- "learning_rate": 6.994271479897314e-07,
1646
- "loss": 0.2438,
1647
- "step": 234
1648
- },
1649
- {
1650
- "epoch": 1.88,
1651
- "grad_norm": 0.3314102292060852,
1652
- "learning_rate": 6.150800316200605e-07,
1653
- "loss": 0.178,
1654
- "step": 235
1655
- },
1656
- {
1657
- "epoch": 1.888,
1658
- "grad_norm": 0.47994476556777954,
1659
- "learning_rate": 5.360876925123992e-07,
1660
- "loss": 0.2671,
1661
- "step": 236
1662
- },
1663
- {
1664
- "epoch": 1.896,
1665
- "grad_norm": 0.3392440676689148,
1666
- "learning_rate": 4.6246747689474847e-07,
1667
- "loss": 0.2443,
1668
- "step": 237
1669
- },
1670
- {
1671
- "epoch": 1.904,
1672
- "grad_norm": 0.399720162153244,
1673
- "learning_rate": 3.9423555131007925e-07,
1674
- "loss": 0.2435,
1675
- "step": 238
1676
- },
1677
- {
1678
- "epoch": 1.912,
1679
- "grad_norm": 0.3899043798446655,
1680
- "learning_rate": 3.3140689906628054e-07,
1681
- "loss": 0.2339,
1682
- "step": 239
1683
- },
1684
- {
1685
- "epoch": 1.92,
1686
- "grad_norm": 0.3892936408519745,
1687
- "learning_rate": 2.739953169458992e-07,
1688
- "loss": 0.2036,
1689
- "step": 240
1690
- },
1691
- {
1692
- "epoch": 1.928,
1693
- "grad_norm": 0.3665865659713745,
1694
- "learning_rate": 2.2201341217648331e-07,
1695
- "loss": 0.1968,
1696
- "step": 241
1697
- },
1698
- {
1699
- "epoch": 1.936,
1700
- "grad_norm": 0.3669964671134949,
1701
- "learning_rate": 1.7547259966207708e-07,
1702
- "loss": 0.2047,
1703
- "step": 242
1704
- },
1705
- {
1706
- "epoch": 1.944,
1707
- "grad_norm": 0.3324055075645447,
1708
- "learning_rate": 1.343830994765982e-07,
1709
- "loss": 0.1778,
1710
- "step": 243
1711
- },
1712
- {
1713
- "epoch": 1.952,
1714
- "grad_norm": 0.3321472108364105,
1715
- "learning_rate": 9.87539346195776e-08,
1716
- "loss": 0.1658,
1717
- "step": 244
1718
- },
1719
- {
1720
- "epoch": 1.96,
1721
- "grad_norm": 0.3692459762096405,
1722
- "learning_rate": 6.859292903474702e-08,
1723
- "loss": 0.1839,
1724
- "step": 245
1725
- },
1726
- {
1727
- "epoch": 1.968,
1728
- "grad_norm": 0.3558332026004791,
1729
- "learning_rate": 4.390670589196622e-08,
1730
- "loss": 0.2315,
1731
- "step": 246
1732
- },
1733
- {
1734
- "epoch": 1.976,
1735
- "grad_norm": 0.3770068287849426,
1736
- "learning_rate": 2.4700686132803076e-08,
1737
- "loss": 0.1847,
1738
- "step": 247
1739
- },
1740
- {
1741
- "epoch": 1.984,
1742
- "grad_norm": 0.4247698187828064,
1743
- "learning_rate": 1.0979087280141298e-08,
1744
- "loss": 0.2019,
1745
- "step": 248
1746
- },
1747
- {
1748
- "epoch": 1.992,
1749
- "grad_norm": 0.47204524278640747,
1750
- "learning_rate": 2.7449225120268484e-09,
1751
- "loss": 0.2714,
1752
- "step": 249
1753
- },
1754
- {
1755
- "epoch": 2.0,
1756
- "grad_norm": 0.36844396591186523,
1757
- "learning_rate": 0.0,
1758
- "loss": 0.2509,
1759
- "step": 250
1760
- }
1761
- ],
1762
- "logging_steps": 1,
1763
- "max_steps": 250,
1764
- "num_input_tokens_seen": 0,
1765
- "num_train_epochs": 2,
1766
- "save_steps": 500,
1767
- "stateful_callbacks": {
1768
- "TrainerControl": {
1769
- "args": {
1770
- "should_epoch_stop": false,
1771
- "should_evaluate": false,
1772
- "should_log": false,
1773
- "should_save": true,
1774
- "should_training_stop": true
1775
- },
1776
- "attributes": {}
1777
- }
1778
- },
1779
- "total_flos": 1.976760219958272e+16,
1780
- "train_batch_size": 2,
1781
- "trial_name": null,
1782
- "trial_params": null
1783
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/training_args.bin DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d0c707a9134ba7a06c81c1f21785e39ec698e8015510f14c086096ea286f41c
3
- size 5752
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/checkpoint-250/vocab.json DELETED
The diff for this file is too large to render. See raw diff
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/config.json DELETED
@@ -1,45 +0,0 @@
1
- {
2
- "_name_or_path": "Qwen/Qwen2.5-Coder-7B-Instruct",
3
- "architectures": [
4
- "Qwen2ForCausalLM"
5
- ],
6
- "attention_dropout": 0.0,
7
- "bos_token_id": 151643,
8
- "eos_token_id": 151645,
9
- "hidden_act": "silu",
10
- "hidden_size": 3584,
11
- "initializer_range": 0.02,
12
- "intermediate_size": 18944,
13
- "max_position_embeddings": 32768,
14
- "max_window_layers": 28,
15
- "model_type": "qwen2",
16
- "num_attention_heads": 28,
17
- "num_hidden_layers": 28,
18
- "num_key_value_heads": 4,
19
- "pad_token_id": 151645,
20
- "quantization_config": {
21
- "_load_in_4bit": true,
22
- "_load_in_8bit": false,
23
- "bnb_4bit_compute_dtype": "bfloat16",
24
- "bnb_4bit_quant_storage": "uint8",
25
- "bnb_4bit_quant_type": "nf4",
26
- "bnb_4bit_use_double_quant": true,
27
- "llm_int8_enable_fp32_cpu_offload": false,
28
- "llm_int8_has_fp16_weight": false,
29
- "llm_int8_skip_modules": null,
30
- "llm_int8_threshold": 6.0,
31
- "load_in_4bit": true,
32
- "load_in_8bit": false,
33
- "quant_method": "bitsandbytes"
34
- },
35
- "rms_norm_eps": 1e-06,
36
- "rope_scaling": null,
37
- "rope_theta": 1000000.0,
38
- "sliding_window": null,
39
- "tie_word_embeddings": false,
40
- "torch_dtype": "bfloat16",
41
- "transformers_version": "4.46.3",
42
- "use_cache": true,
43
- "use_sliding_window": false,
44
- "vocab_size": 152064
45
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/generation_config.json DELETED
@@ -1,14 +0,0 @@
1
- {
2
- "bos_token_id": 151643,
3
- "do_sample": true,
4
- "eos_token_id": [
5
- 151645,
6
- 151643
7
- ],
8
- "pad_token_id": 151643,
9
- "repetition_penalty": 1.1,
10
- "temperature": 0.7,
11
- "top_k": 20,
12
- "top_p": 0.8,
13
- "transformers_version": "4.46.3"
14
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/merges.txt DELETED
The diff for this file is too large to render. See raw diff
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model-00001-of-00003.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:963555366ebe5a085c7bc1dda3feaa2376ef5e207ea63c56972970096054daa2
3
- size 1982173101
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model-00002-of-00003.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:91b2f340ad1224de3f1dece269d98623082b792e263bc6a07ce8fce8d7a650a8
3
- size 1994606129
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model-00003-of-00003.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c6d5d41b7cde70fa21d76d11fc7dde58110f91eba9b4bb35c002d5c2d11b6f7a
3
- size 1571140062
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/model.safetensors.index.json DELETED
The diff for this file is too large to render. See raw diff
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/special_tokens_map.json DELETED
@@ -1,31 +0,0 @@
1
- {
2
- "additional_special_tokens": [
3
- "<|im_start|>",
4
- "<|im_end|>",
5
- "<|object_ref_start|>",
6
- "<|object_ref_end|>",
7
- "<|box_start|>",
8
- "<|box_end|>",
9
- "<|quad_start|>",
10
- "<|quad_end|>",
11
- "<|vision_start|>",
12
- "<|vision_end|>",
13
- "<|vision_pad|>",
14
- "<|image_pad|>",
15
- "<|video_pad|>"
16
- ],
17
- "eos_token": {
18
- "content": "<|im_end|>",
19
- "lstrip": false,
20
- "normalized": false,
21
- "rstrip": false,
22
- "single_word": false
23
- },
24
- "pad_token": {
25
- "content": "<|endoftext|>",
26
- "lstrip": false,
27
- "normalized": false,
28
- "rstrip": false,
29
- "single_word": false
30
- }
31
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/tokenizer.json DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:962b8d8c521fefa934665afddae177326e974ddd6a26e69ff31ad6bccbb5593b
3
- size 11421994
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/tokenizer_config.json DELETED
@@ -1,207 +0,0 @@
1
- {
2
- "add_bos_token": false,
3
- "add_prefix_space": false,
4
- "added_tokens_decoder": {
5
- "151643": {
6
- "content": "<|endoftext|>",
7
- "lstrip": false,
8
- "normalized": false,
9
- "rstrip": false,
10
- "single_word": false,
11
- "special": true
12
- },
13
- "151644": {
14
- "content": "<|im_start|>",
15
- "lstrip": false,
16
- "normalized": false,
17
- "rstrip": false,
18
- "single_word": false,
19
- "special": true
20
- },
21
- "151645": {
22
- "content": "<|im_end|>",
23
- "lstrip": false,
24
- "normalized": false,
25
- "rstrip": false,
26
- "single_word": false,
27
- "special": true
28
- },
29
- "151646": {
30
- "content": "<|object_ref_start|>",
31
- "lstrip": false,
32
- "normalized": false,
33
- "rstrip": false,
34
- "single_word": false,
35
- "special": true
36
- },
37
- "151647": {
38
- "content": "<|object_ref_end|>",
39
- "lstrip": false,
40
- "normalized": false,
41
- "rstrip": false,
42
- "single_word": false,
43
- "special": true
44
- },
45
- "151648": {
46
- "content": "<|box_start|>",
47
- "lstrip": false,
48
- "normalized": false,
49
- "rstrip": false,
50
- "single_word": false,
51
- "special": true
52
- },
53
- "151649": {
54
- "content": "<|box_end|>",
55
- "lstrip": false,
56
- "normalized": false,
57
- "rstrip": false,
58
- "single_word": false,
59
- "special": true
60
- },
61
- "151650": {
62
- "content": "<|quad_start|>",
63
- "lstrip": false,
64
- "normalized": false,
65
- "rstrip": false,
66
- "single_word": false,
67
- "special": true
68
- },
69
- "151651": {
70
- "content": "<|quad_end|>",
71
- "lstrip": false,
72
- "normalized": false,
73
- "rstrip": false,
74
- "single_word": false,
75
- "special": true
76
- },
77
- "151652": {
78
- "content": "<|vision_start|>",
79
- "lstrip": false,
80
- "normalized": false,
81
- "rstrip": false,
82
- "single_word": false,
83
- "special": true
84
- },
85
- "151653": {
86
- "content": "<|vision_end|>",
87
- "lstrip": false,
88
- "normalized": false,
89
- "rstrip": false,
90
- "single_word": false,
91
- "special": true
92
- },
93
- "151654": {
94
- "content": "<|vision_pad|>",
95
- "lstrip": false,
96
- "normalized": false,
97
- "rstrip": false,
98
- "single_word": false,
99
- "special": true
100
- },
101
- "151655": {
102
- "content": "<|image_pad|>",
103
- "lstrip": false,
104
- "normalized": false,
105
- "rstrip": false,
106
- "single_word": false,
107
- "special": true
108
- },
109
- "151656": {
110
- "content": "<|video_pad|>",
111
- "lstrip": false,
112
- "normalized": false,
113
- "rstrip": false,
114
- "single_word": false,
115
- "special": true
116
- },
117
- "151657": {
118
- "content": "<tool_call>",
119
- "lstrip": false,
120
- "normalized": false,
121
- "rstrip": false,
122
- "single_word": false,
123
- "special": false
124
- },
125
- "151658": {
126
- "content": "</tool_call>",
127
- "lstrip": false,
128
- "normalized": false,
129
- "rstrip": false,
130
- "single_word": false,
131
- "special": false
132
- },
133
- "151659": {
134
- "content": "<|fim_prefix|>",
135
- "lstrip": false,
136
- "normalized": false,
137
- "rstrip": false,
138
- "single_word": false,
139
- "special": false
140
- },
141
- "151660": {
142
- "content": "<|fim_middle|>",
143
- "lstrip": false,
144
- "normalized": false,
145
- "rstrip": false,
146
- "single_word": false,
147
- "special": false
148
- },
149
- "151661": {
150
- "content": "<|fim_suffix|>",
151
- "lstrip": false,
152
- "normalized": false,
153
- "rstrip": false,
154
- "single_word": false,
155
- "special": false
156
- },
157
- "151662": {
158
- "content": "<|fim_pad|>",
159
- "lstrip": false,
160
- "normalized": false,
161
- "rstrip": false,
162
- "single_word": false,
163
- "special": false
164
- },
165
- "151663": {
166
- "content": "<|repo_name|>",
167
- "lstrip": false,
168
- "normalized": false,
169
- "rstrip": false,
170
- "single_word": false,
171
- "special": false
172
- },
173
- "151664": {
174
- "content": "<|file_sep|>",
175
- "lstrip": false,
176
- "normalized": false,
177
- "rstrip": false,
178
- "single_word": false,
179
- "special": false
180
- }
181
- },
182
- "additional_special_tokens": [
183
- "<|im_start|>",
184
- "<|im_end|>",
185
- "<|object_ref_start|>",
186
- "<|object_ref_end|>",
187
- "<|box_start|>",
188
- "<|box_end|>",
189
- "<|quad_start|>",
190
- "<|quad_end|>",
191
- "<|vision_start|>",
192
- "<|vision_end|>",
193
- "<|vision_pad|>",
194
- "<|image_pad|>",
195
- "<|video_pad|>"
196
- ],
197
- "bos_token": null,
198
- "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0]['role'] == 'system' %}\n {{- messages[0]['content'] }}\n {%- else %}\n {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n {%- endif %}\n {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0]['role'] == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n {%- else %}\n {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role }}\n {%- if message.content %}\n {{- '\\n' + message.content }}\n {%- endif %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {{- tool_call.arguments | tojson }}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- message.content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
199
- "clean_up_tokenization_spaces": false,
200
- "eos_token": "<|im_end|>",
201
- "errors": "replace",
202
- "model_max_length": 32768,
203
- "pad_token": "<|endoftext|>",
204
- "split_special_tokens": false,
205
- "tokenizer_class": "Qwen2Tokenizer",
206
- "unk_token": null
207
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Qwen2.5-Coder-7B-Instruct-math-solver-config_2/vocab.json DELETED
The diff for this file is too large to render. See raw diff