Hugging Face's logo

stojchet
/
lr_small_e5_sft

PEFT
Safetensors
trl
sft
Generated from Trainer
Model card Files
xet
 Community
stojchet commited on
Commit
e5044b1
·
verified ·
1 Parent(s): 6555cf3

End of training

Browse files
Files changed (1) hide show
  1. README.md +455 -0
README.md ADDED
@@ -0,0 +1,455 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: deepseek-ai/deepseek-coder-1.3b-base
3
+ datasets:
4
+ - generator
5
+ library_name: peft
6
+ license: other
7
+ tags:
8
+ - trl
9
+ - sft
10
+ - generated_from_trainer
11
+ model-index:
12
+ - name: lr_small_e5_sft
13
+ results: []
14
+ ---
15
+
16
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
+ should probably proofread and complete it, then remove this comment. -->
18
+
19
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/stojchets/huggingface/runs/lr_small_e5_sft)
20
+ # lr_small_e5_sft
21
+
22
+ This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on the generator dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 1.2372
25
+
26
+ ## Model description
27
+
28
+ More information needed
29
+
30
+ ## Intended uses & limitations
31
+
32
+ More information needed
33
+
34
+ ## Training and evaluation data
35
+
36
+ More information needed
37
+
38
+ ## Training procedure
39
+
40
+ ### Training hyperparameters
41
+
42
+ The following hyperparameters were used during training:
43
+ - learning_rate: 1.41e-07
44
+ - train_batch_size: 8
45
+ - eval_batch_size: 8
46
+ - seed: 42
47
+ - gradient_accumulation_steps: 16
48
+ - total_train_batch_size: 128
49
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
+ - lr_scheduler_type: linear
51
+ - num_epochs: 5
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss |
56
+ |:-------------:|:------:|:----:|:---------------:|
57
+ | 1.2662 | 0.0128 | 1 | 1.2401 |
58
+ | 1.2266 | 0.0256 | 2 | 1.2401 |
59
+ | 1.2594 | 0.0384 | 3 | 1.2401 |
60
+ | 1.1592 | 0.0512 | 4 | 1.2400 |
61
+ | 1.2268 | 0.064 | 5 | 1.2400 |
62
+ | 1.2151 | 0.0768 | 6 | 1.2400 |
63
+ | 1.2202 | 0.0896 | 7 | 1.2400 |
64
+ | 1.2694 | 0.1024 | 8 | 1.2400 |
65
+ | 1.2341 | 0.1152 | 9 | 1.2400 |
66
+ | 1.2519 | 0.128 | 10 | 1.2399 |
67
+ | 1.2733 | 0.1408 | 11 | 1.2399 |
68
+ | 1.2018 | 0.1536 | 12 | 1.2399 |
69
+ | 1.1774 | 0.1664 | 13 | 1.2399 |
70
+ | 1.2955 | 0.1792 | 14 | 1.2399 |
71
+ | 1.2297 | 0.192 | 15 | 1.2399 |
72
+ | 1.2685 | 0.2048 | 16 | 1.2399 |
73
+ | 1.2485 | 0.2176 | 17 | 1.2398 |
74
+ | 1.2604 | 0.2304 | 18 | 1.2398 |
75
+ | 1.2048 | 0.2432 | 19 | 1.2398 |
76
+ | 1.2037 | 0.256 | 20 | 1.2398 |
77
+ | 1.2399 | 0.2688 | 21 | 1.2398 |
78
+ | 1.212 | 0.2816 | 22 | 1.2398 |
79
+ | 1.2505 | 0.2944 | 23 | 1.2398 |
80
+ | 1.2966 | 0.3072 | 24 | 1.2397 |
81
+ | 1.2109 | 0.32 | 25 | 1.2397 |
82
+ | 1.2595 | 0.3328 | 26 | 1.2397 |
83
+ | 1.2283 | 0.3456 | 27 | 1.2397 |
84
+ | 1.2027 | 0.3584 | 28 | 1.2397 |
85
+ | 1.2004 | 0.3712 | 29 | 1.2397 |
86
+ | 1.189 | 0.384 | 30 | 1.2397 |
87
+ | 1.1946 | 0.3968 | 31 | 1.2396 |
88
+ | 1.2234 | 0.4096 | 32 | 1.2396 |
89
+ | 1.269 | 0.4224 | 33 | 1.2396 |
90
+ | 1.2421 | 0.4352 | 34 | 1.2396 |
91
+ | 1.2031 | 0.448 | 35 | 1.2396 |
92
+ | 1.1914 | 0.4608 | 36 | 1.2396 |
93
+ | 1.2188 | 0.4736 | 37 | 1.2396 |
94
+ | 1.2434 | 0.4864 | 38 | 1.2395 |
95
+ | 1.276 | 0.4992 | 39 | 1.2395 |
96
+ | 1.212 | 0.512 | 40 | 1.2395 |
97
+ | 1.2414 | 0.5248 | 41 | 1.2395 |
98
+ | 1.2359 | 0.5376 | 42 | 1.2395 |
99
+ | 1.1813 | 0.5504 | 43 | 1.2395 |
100
+ | 1.2172 | 0.5632 | 44 | 1.2395 |
101
+ | 1.2052 | 0.576 | 45 | 1.2395 |
102
+ | 1.2451 | 0.5888 | 46 | 1.2394 |
103
+ | 1.1902 | 0.6016 | 47 | 1.2394 |
104
+ | 1.2322 | 0.6144 | 48 | 1.2394 |
105
+ | 1.2201 | 0.6272 | 49 | 1.2394 |
106
+ | 1.2086 | 0.64 | 50 | 1.2394 |
107
+ | 1.2439 | 0.6528 | 51 | 1.2394 |
108
+ | 1.1928 | 0.6656 | 52 | 1.2394 |
109
+ | 1.2412 | 0.6784 | 53 | 1.2394 |
110
+ | 1.2058 | 0.6912 | 54 | 1.2393 |
111
+ | 1.1883 | 0.704 | 55 | 1.2393 |
112
+ | 1.2065 | 0.7168 | 56 | 1.2393 |
113
+ | 1.2334 | 0.7296 | 57 | 1.2393 |
114
+ | 1.2276 | 0.7424 | 58 | 1.2393 |
115
+ | 1.2009 | 0.7552 | 59 | 1.2393 |
116
+ | 1.245 | 0.768 | 60 | 1.2393 |
117
+ | 1.2835 | 0.7808 | 61 | 1.2393 |
118
+ | 1.2671 | 0.7936 | 62 | 1.2392 |
119
+ | 1.201 | 0.8064 | 63 | 1.2392 |
120
+ | 1.2489 | 0.8192 | 64 | 1.2392 |
121
+ | 1.2038 | 0.832 | 65 | 1.2392 |
122
+ | 1.1625 | 0.8448 | 66 | 1.2392 |
123
+ | 1.2959 | 0.8576 | 67 | 1.2392 |
124
+ | 1.1787 | 0.8704 | 68 | 1.2392 |
125
+ | 1.1992 | 0.8832 | 69 | 1.2392 |
126
+ | 1.1789 | 0.896 | 70 | 1.2391 |
127
+ | 1.2455 | 0.9088 | 71 | 1.2391 |
128
+ | 1.269 | 0.9216 | 72 | 1.2391 |
129
+ | 1.2519 | 0.9344 | 73 | 1.2391 |
130
+ | 1.1986 | 0.9472 | 74 | 1.2391 |
131
+ | 1.2427 | 0.96 | 75 | 1.2391 |
132
+ | 1.2743 | 0.9728 | 76 | 1.2391 |
133
+ | 1.2139 | 0.9856 | 77 | 1.2391 |
134
+ | 1.2297 | 0.9984 | 78 | 1.2390 |
135
+ | 1.2004 | 1.0112 | 79 | 1.2390 |
136
+ | 1.1837 | 1.024 | 80 | 1.2390 |
137
+ | 1.1996 | 1.0368 | 81 | 1.2390 |
138
+ | 1.2621 | 1.0496 | 82 | 1.2390 |
139
+ | 1.2061 | 1.0624 | 83 | 1.2390 |
140
+ | 1.1926 | 1.0752 | 84 | 1.2390 |
141
+ | 1.2024 | 1.088 | 85 | 1.2390 |
142
+ | 1.2435 | 1.1008 | 86 | 1.2390 |
143
+ | 1.2531 | 1.1136 | 87 | 1.2389 |
144
+ | 1.1794 | 1.1264 | 88 | 1.2389 |
145
+ | 1.2244 | 1.1392 | 89 | 1.2389 |
146
+ | 1.2612 | 1.152 | 90 | 1.2389 |
147
+ | 1.187 | 1.1648 | 91 | 1.2389 |
148
+ | 1.1657 | 1.1776 | 92 | 1.2389 |
149
+ | 1.2265 | 1.1904 | 93 | 1.2389 |
150
+ | 1.2354 | 1.2032 | 94 | 1.2389 |
151
+ | 1.2089 | 1.216 | 95 | 1.2388 |
152
+ | 1.2879 | 1.2288 | 96 | 1.2388 |
153
+ | 1.1864 | 1.2416 | 97 | 1.2388 |
154
+ | 1.1877 | 1.2544 | 98 | 1.2388 |
155
+ | 1.2365 | 1.2672 | 99 | 1.2388 |
156
+ | 1.2211 | 1.28 | 100 | 1.2388 |
157
+ | 1.1654 | 1.2928 | 101 | 1.2388 |
158
+ | 1.2635 | 1.3056 | 102 | 1.2388 |
159
+ | 1.2163 | 1.3184 | 103 | 1.2388 |
160
+ | 1.2451 | 1.3312 | 104 | 1.2388 |
161
+ | 1.1779 | 1.3440 | 105 | 1.2387 |
162
+ | 1.2307 | 1.3568 | 106 | 1.2387 |
163
+ | 1.216 | 1.3696 | 107 | 1.2387 |
164
+ | 1.2072 | 1.3824 | 108 | 1.2387 |
165
+ | 1.2682 | 1.3952 | 109 | 1.2387 |
166
+ | 1.2594 | 1.408 | 110 | 1.2387 |
167
+ | 1.2478 | 1.4208 | 111 | 1.2387 |
168
+ | 1.2661 | 1.4336 | 112 | 1.2387 |
169
+ | 1.2112 | 1.4464 | 113 | 1.2387 |
170
+ | 1.2198 | 1.4592 | 114 | 1.2386 |
171
+ | 1.2139 | 1.472 | 115 | 1.2386 |
172
+ | 1.2387 | 1.4848 | 116 | 1.2386 |
173
+ | 1.2283 | 1.4976 | 117 | 1.2386 |
174
+ | 1.2096 | 1.5104 | 118 | 1.2386 |
175
+ | 1.1933 | 1.5232 | 119 | 1.2386 |
176
+ | 1.2256 | 1.536 | 120 | 1.2386 |
177
+ | 1.2189 | 1.5488 | 121 | 1.2386 |
178
+ | 1.2513 | 1.5616 | 122 | 1.2386 |
179
+ | 1.2174 | 1.5744 | 123 | 1.2386 |
180
+ | 1.1715 | 1.5872 | 124 | 1.2386 |
181
+ | 1.2519 | 1.6 | 125 | 1.2385 |
182
+ | 1.3025 | 1.6128 | 126 | 1.2385 |
183
+ | 1.275 | 1.6256 | 127 | 1.2385 |
184
+ | 1.2159 | 1.6384 | 128 | 1.2385 |
185
+ | 1.2654 | 1.6512 | 129 | 1.2385 |
186
+ | 1.2578 | 1.6640 | 130 | 1.2385 |
187
+ | 1.2109 | 1.6768 | 131 | 1.2385 |
188
+ | 1.2051 | 1.6896 | 132 | 1.2385 |
189
+ | 1.2345 | 1.7024 | 133 | 1.2385 |
190
+ | 1.2252 | 1.7152 | 134 | 1.2385 |
191
+ | 1.2907 | 1.728 | 135 | 1.2384 |
192
+ | 1.2581 | 1.7408 | 136 | 1.2384 |
193
+ | 1.2019 | 1.7536 | 137 | 1.2384 |
194
+ | 1.1398 | 1.7664 | 138 | 1.2384 |
195
+ | 1.248 | 1.7792 | 139 | 1.2384 |
196
+ | 1.2405 | 1.792 | 140 | 1.2384 |
197
+ | 1.2377 | 1.8048 | 141 | 1.2384 |
198
+ | 1.2202 | 1.8176 | 142 | 1.2384 |
199
+ | 1.2258 | 1.8304 | 143 | 1.2384 |
200
+ | 1.2795 | 1.8432 | 144 | 1.2384 |
201
+ | 1.2337 | 1.8560 | 145 | 1.2383 |
202
+ | 1.2606 | 1.8688 | 146 | 1.2383 |
203
+ | 1.2036 | 1.8816 | 147 | 1.2383 |
204
+ | 1.2198 | 1.8944 | 148 | 1.2383 |
205
+ | 1.1932 | 1.9072 | 149 | 1.2383 |
206
+ | 1.2388 | 1.92 | 150 | 1.2383 |
207
+ | 1.2139 | 1.9328 | 151 | 1.2383 |
208
+ | 1.1596 | 1.9456 | 152 | 1.2383 |
209
+ | 1.2878 | 1.9584 | 153 | 1.2383 |
210
+ | 1.2157 | 1.9712 | 154 | 1.2383 |
211
+ | 1.2824 | 1.984 | 155 | 1.2382 |
212
+ | 1.2283 | 1.9968 | 156 | 1.2382 |
213
+ | 1.2511 | 2.0096 | 157 | 1.2382 |
214
+ | 1.2028 | 2.0224 | 158 | 1.2382 |
215
+ | 1.2694 | 2.0352 | 159 | 1.2382 |
216
+ | 1.2099 | 2.048 | 160 | 1.2382 |
217
+ | 1.1883 | 2.0608 | 161 | 1.2382 |
218
+ | 1.2332 | 2.0736 | 162 | 1.2382 |
219
+ | 1.2156 | 2.0864 | 163 | 1.2382 |
220
+ | 1.2147 | 2.0992 | 164 | 1.2382 |
221
+ | 1.1711 | 2.112 | 165 | 1.2381 |
222
+ | 1.2415 | 2.1248 | 166 | 1.2381 |
223
+ | 1.2761 | 2.1376 | 167 | 1.2381 |
224
+ | 1.2508 | 2.1504 | 168 | 1.2381 |
225
+ | 1.2206 | 2.1632 | 169 | 1.2381 |
226
+ | 1.2453 | 2.176 | 170 | 1.2381 |
227
+ | 1.2355 | 2.1888 | 171 | 1.2381 |
228
+ | 1.2047 | 2.2016 | 172 | 1.2381 |
229
+ | 1.2247 | 2.2144 | 173 | 1.2381 |
230
+ | 1.2012 | 2.2272 | 174 | 1.2381 |
231
+ | 1.1953 | 2.24 | 175 | 1.2381 |
232
+ | 1.2563 | 2.2528 | 176 | 1.2381 |
233
+ | 1.2429 | 2.2656 | 177 | 1.2380 |
234
+ | 1.1839 | 2.2784 | 178 | 1.2380 |
235
+ | 1.1571 | 2.2912 | 179 | 1.2380 |
236
+ | 1.2277 | 2.304 | 180 | 1.2380 |
237
+ | 1.2133 | 2.3168 | 181 | 1.2380 |
238
+ | 1.232 | 2.3296 | 182 | 1.2380 |
239
+ | 1.2567 | 2.3424 | 183 | 1.2380 |
240
+ | 1.2277 | 2.3552 | 184 | 1.2380 |
241
+ | 1.2397 | 2.368 | 185 | 1.2380 |
242
+ | 1.1894 | 2.3808 | 186 | 1.2380 |
243
+ | 1.1736 | 2.3936 | 187 | 1.2380 |
244
+ | 1.2767 | 2.4064 | 188 | 1.2380 |
245
+ | 1.2343 | 2.4192 | 189 | 1.2380 |
246
+ | 1.2082 | 2.432 | 190 | 1.2380 |
247
+ | 1.1952 | 2.4448 | 191 | 1.2379 |
248
+ | 1.2408 | 2.4576 | 192 | 1.2379 |
249
+ | 1.2013 | 2.4704 | 193 | 1.2379 |
250
+ | 1.231 | 2.4832 | 194 | 1.2379 |
251
+ | 1.24 | 2.496 | 195 | 1.2379 |
252
+ | 1.2435 | 2.5088 | 196 | 1.2379 |
253
+ | 1.2484 | 2.5216 | 197 | 1.2379 |
254
+ | 1.2466 | 2.5344 | 198 | 1.2379 |
255
+ | 1.2019 | 2.5472 | 199 | 1.2379 |
256
+ | 1.1954 | 2.56 | 200 | 1.2379 |
257
+ | 1.1974 | 2.5728 | 201 | 1.2379 |
258
+ | 1.2271 | 2.5856 | 202 | 1.2379 |
259
+ | 1.2532 | 2.5984 | 203 | 1.2379 |
260
+ | 1.1606 | 2.6112 | 204 | 1.2379 |
261
+ | 1.2247 | 2.624 | 205 | 1.2378 |
262
+ | 1.2458 | 2.6368 | 206 | 1.2378 |
263
+ | 1.2675 | 2.6496 | 207 | 1.2378 |
264
+ | 1.2415 | 2.6624 | 208 | 1.2378 |
265
+ | 1.227 | 2.6752 | 209 | 1.2378 |
266
+ | 1.1998 | 2.6880 | 210 | 1.2378 |
267
+ | 1.242 | 2.7008 | 211 | 1.2378 |
268
+ | 1.2265 | 2.7136 | 212 | 1.2378 |
269
+ | 1.2242 | 2.7264 | 213 | 1.2378 |
270
+ | 1.2559 | 2.7392 | 214 | 1.2378 |
271
+ | 1.2286 | 2.752 | 215 | 1.2378 |
272
+ | 1.2285 | 2.7648 | 216 | 1.2378 |
273
+ | 1.2311 | 2.7776 | 217 | 1.2378 |
274
+ | 1.268 | 2.7904 | 218 | 1.2378 |
275
+ | 1.2513 | 2.8032 | 219 | 1.2377 |
276
+ | 1.2834 | 2.816 | 220 | 1.2377 |
277
+ | 1.2535 | 2.8288 | 221 | 1.2377 |
278
+ | 1.2214 | 2.8416 | 222 | 1.2377 |
279
+ | 1.2127 | 2.8544 | 223 | 1.2377 |
280
+ | 1.1854 | 2.8672 | 224 | 1.2377 |
281
+ | 1.2651 | 2.88 | 225 | 1.2377 |
282
+ | 1.2434 | 2.8928 | 226 | 1.2377 |
283
+ | 1.1727 | 2.9056 | 227 | 1.2377 |
284
+ | 1.237 | 2.9184 | 228 | 1.2377 |
285
+ | 1.182 | 2.9312 | 229 | 1.2377 |
286
+ | 1.1925 | 2.944 | 230 | 1.2377 |
287
+ | 1.2101 | 2.9568 | 231 | 1.2377 |
288
+ | 1.2566 | 2.9696 | 232 | 1.2377 |
289
+ | 1.2056 | 2.9824 | 233 | 1.2377 |
290
+ | 1.2068 | 2.9952 | 234 | 1.2377 |
291
+ | 1.2142 | 3.008 | 235 | 1.2377 |
292
+ | 1.2174 | 3.0208 | 236 | 1.2376 |
293
+ | 1.2084 | 3.0336 | 237 | 1.2376 |
294
+ | 1.2535 | 3.0464 | 238 | 1.2376 |
295
+ | 1.2019 | 3.0592 | 239 | 1.2376 |
296
+ | 1.2401 | 3.072 | 240 | 1.2376 |
297
+ | 1.187 | 3.0848 | 241 | 1.2376 |
298
+ | 1.2852 | 3.0976 | 242 | 1.2376 |
299
+ | 1.2061 | 3.1104 | 243 | 1.2376 |
300
+ | 1.1962 | 3.1232 | 244 | 1.2376 |
301
+ | 1.197 | 3.136 | 245 | 1.2376 |
302
+ | 1.2596 | 3.1488 | 246 | 1.2376 |
303
+ | 1.2476 | 3.1616 | 247 | 1.2376 |
304
+ | 1.163 | 3.1744 | 248 | 1.2376 |
305
+ | 1.2619 | 3.1872 | 249 | 1.2376 |
306
+ | 1.2432 | 3.2 | 250 | 1.2376 |
307
+ | 1.2739 | 3.2128 | 251 | 1.2376 |
308
+ | 1.2259 | 3.2256 | 252 | 1.2376 |
309
+ | 1.2601 | 3.2384 | 253 | 1.2376 |
310
+ | 1.223 | 3.2512 | 254 | 1.2375 |
311
+ | 1.2189 | 3.2640 | 255 | 1.2375 |
312
+ | 1.2332 | 3.2768 | 256 | 1.2375 |
313
+ | 1.2355 | 3.2896 | 257 | 1.2375 |
314
+ | 1.2167 | 3.3024 | 258 | 1.2375 |
315
+ | 1.2379 | 3.3152 | 259 | 1.2375 |
316
+ | 1.2399 | 3.328 | 260 | 1.2375 |
317
+ | 1.2689 | 3.3408 | 261 | 1.2375 |
318
+ | 1.1815 | 3.3536 | 262 | 1.2375 |
319
+ | 1.2063 | 3.3664 | 263 | 1.2375 |
320
+ | 1.2283 | 3.3792 | 264 | 1.2375 |
321
+ | 1.2725 | 3.392 | 265 | 1.2375 |
322
+ | 1.2147 | 3.4048 | 266 | 1.2375 |
323
+ | 1.1906 | 3.4176 | 267 | 1.2375 |
324
+ | 1.2483 | 3.4304 | 268 | 1.2375 |
325
+ | 1.2373 | 3.4432 | 269 | 1.2375 |
326
+ | 1.2347 | 3.456 | 270 | 1.2375 |
327
+ | 1.2671 | 3.4688 | 271 | 1.2375 |
328
+ | 1.2533 | 3.4816 | 272 | 1.2375 |
329
+ | 1.1967 | 3.4944 | 273 | 1.2375 |
330
+ | 1.2325 | 3.5072 | 274 | 1.2375 |
331
+ | 1.1707 | 3.52 | 275 | 1.2374 |
332
+ | 1.2044 | 3.5328 | 276 | 1.2374 |
333
+ | 1.2309 | 3.5456 | 277 | 1.2374 |
334
+ | 1.2419 | 3.5584 | 278 | 1.2374 |
335
+ | 1.2066 | 3.5712 | 279 | 1.2374 |
336
+ | 1.19 | 3.584 | 280 | 1.2374 |
337
+ | 1.2569 | 3.5968 | 281 | 1.2374 |
338
+ | 1.2009 | 3.6096 | 282 | 1.2374 |
339
+ | 1.2628 | 3.6224 | 283 | 1.2374 |
340
+ | 1.2042 | 3.6352 | 284 | 1.2374 |
341
+ | 1.1863 | 3.648 | 285 | 1.2374 |
342
+ | 1.242 | 3.6608 | 286 | 1.2374 |
343
+ | 1.2452 | 3.6736 | 287 | 1.2374 |
344
+ | 1.2264 | 3.6864 | 288 | 1.2374 |
345
+ | 1.2975 | 3.6992 | 289 | 1.2374 |
346
+ | 1.2291 | 3.7120 | 290 | 1.2374 |
347
+ | 1.2091 | 3.7248 | 291 | 1.2374 |
348
+ | 1.2253 | 3.7376 | 292 | 1.2374 |
349
+ | 1.2382 | 3.7504 | 293 | 1.2374 |
350
+ | 1.2249 | 3.7632 | 294 | 1.2374 |
351
+ | 1.2276 | 3.776 | 295 | 1.2374 |
352
+ | 1.2609 | 3.7888 | 296 | 1.2374 |
353
+ | 1.2503 | 3.8016 | 297 | 1.2374 |
354
+ | 1.1788 | 3.8144 | 298 | 1.2374 |
355
+ | 1.2189 | 3.8272 | 299 | 1.2374 |
356
+ | 1.1886 | 3.84 | 300 | 1.2373 |
357
+ | 1.2337 | 3.8528 | 301 | 1.2373 |
358
+ | 1.2084 | 3.8656 | 302 | 1.2373 |
359
+ | 1.2366 | 3.8784 | 303 | 1.2373 |
360
+ | 1.183 | 3.8912 | 304 | 1.2373 |
361
+ | 1.2253 | 3.904 | 305 | 1.2373 |
362
+ | 1.2123 | 3.9168 | 306 | 1.2373 |
363
+ | 1.1668 | 3.9296 | 307 | 1.2373 |
364
+ | 1.1947 | 3.9424 | 308 | 1.2373 |
365
+ | 1.2131 | 3.9552 | 309 | 1.2373 |
366
+ | 1.2225 | 3.968 | 310 | 1.2373 |
367
+ | 1.2312 | 3.9808 | 311 | 1.2373 |
368
+ | 1.1971 | 3.9936 | 312 | 1.2373 |
369
+ | 1.2206 | 4.0064 | 313 | 1.2373 |
370
+ | 1.1943 | 4.0192 | 314 | 1.2373 |
371
+ | 1.251 | 4.032 | 315 | 1.2373 |
372
+ | 1.217 | 4.0448 | 316 | 1.2373 |
373
+ | 1.2485 | 4.0576 | 317 | 1.2373 |
374
+ | 1.1592 | 4.0704 | 318 | 1.2373 |
375
+ | 1.2168 | 4.0832 | 319 | 1.2373 |
376
+ | 1.2029 | 4.096 | 320 | 1.2373 |
377
+ | 1.2057 | 4.1088 | 321 | 1.2373 |
378
+ | 1.2338 | 4.1216 | 322 | 1.2373 |
379
+ | 1.2558 | 4.1344 | 323 | 1.2373 |
380
+ | 1.2744 | 4.1472 | 324 | 1.2373 |
381
+ | 1.2222 | 4.16 | 325 | 1.2373 |
382
+ | 1.2182 | 4.1728 | 326 | 1.2373 |
383
+ | 1.2555 | 4.1856 | 327 | 1.2373 |
384
+ | 1.238 | 4.1984 | 328 | 1.2373 |
385
+ | 1.2253 | 4.2112 | 329 | 1.2373 |
386
+ | 1.2597 | 4.224 | 330 | 1.2373 |
387
+ | 1.1844 | 4.2368 | 331 | 1.2373 |
388
+ | 1.2253 | 4.2496 | 332 | 1.2373 |
389
+ | 1.2254 | 4.2624 | 333 | 1.2373 |
390
+ | 1.23 | 4.2752 | 334 | 1.2373 |
391
+ | 1.283 | 4.288 | 335 | 1.2373 |
392
+ | 1.2561 | 4.3008 | 336 | 1.2372 |
393
+ | 1.2368 | 4.3136 | 337 | 1.2372 |
394
+ | 1.2204 | 4.3264 | 338 | 1.2372 |
395
+ | 1.204 | 4.3392 | 339 | 1.2372 |
396
+ | 1.2165 | 4.352 | 340 | 1.2372 |
397
+ | 1.2591 | 4.3648 | 341 | 1.2372 |
398
+ | 1.2301 | 4.3776 | 342 | 1.2372 |
399
+ | 1.2 | 4.3904 | 343 | 1.2372 |
400
+ | 1.228 | 4.4032 | 344 | 1.2372 |
401
+ | 1.2481 | 4.416 | 345 | 1.2372 |
402
+ | 1.2043 | 4.4288 | 346 | 1.2372 |
403
+ | 1.2609 | 4.4416 | 347 | 1.2372 |
404
+ | 1.2163 | 4.4544 | 348 | 1.2372 |
405
+ | 1.257 | 4.4672 | 349 | 1.2372 |
406
+ | 1.2073 | 4.48 | 350 | 1.2372 |
407
+ | 1.2602 | 4.4928 | 351 | 1.2372 |
408
+ | 1.2639 | 4.5056 | 352 | 1.2372 |
409
+ | 1.2102 | 4.5184 | 353 | 1.2372 |
410
+ | 1.2104 | 4.5312 | 354 | 1.2372 |
411
+ | 1.1943 | 4.5440 | 355 | 1.2372 |
412
+ | 1.223 | 4.5568 | 356 | 1.2372 |
413
+ | 1.2168 | 4.5696 | 357 | 1.2372 |
414
+ | 1.2054 | 4.5824 | 358 | 1.2372 |
415
+ | 1.2042 | 4.5952 | 359 | 1.2372 |
416
+ | 1.1875 | 4.608 | 360 | 1.2372 |
417
+ | 1.188 | 4.6208 | 361 | 1.2372 |
418
+ | 1.2374 | 4.6336 | 362 | 1.2372 |
419
+ | 1.2418 | 4.6464 | 363 | 1.2372 |
420
+ | 1.2363 | 4.6592 | 364 | 1.2372 |
421
+ | 1.2319 | 4.672 | 365 | 1.2372 |
422
+ | 1.2349 | 4.6848 | 366 | 1.2372 |
423
+ | 1.2357 | 4.6976 | 367 | 1.2372 |
424
+ | 1.1544 | 4.7104 | 368 | 1.2372 |
425
+ | 1.1897 | 4.7232 | 369 | 1.2372 |
426
+ | 1.2462 | 4.736 | 370 | 1.2372 |
427
+ | 1.1635 | 4.7488 | 371 | 1.2372 |
428
+ | 1.2841 | 4.7616 | 372 | 1.2372 |
429
+ | 1.2488 | 4.7744 | 373 | 1.2372 |
430
+ | 1.2466 | 4.7872 | 374 | 1.2372 |
431
+ | 1.23 | 4.8 | 375 | 1.2372 |
432
+ | 1.199 | 4.8128 | 376 | 1.2372 |
433
+ | 1.2095 | 4.8256 | 377 | 1.2372 |
434
+ | 1.1816 | 4.8384 | 378 | 1.2372 |
435
+ | 1.3457 | 4.8512 | 379 | 1.2372 |
436
+ | 1.2052 | 4.864 | 380 | 1.2372 |
437
+ | 1.233 | 4.8768 | 381 | 1.2372 |
438
+ | 1.2699 | 4.8896 | 382 | 1.2372 |
439
+ | 1.2544 | 4.9024 | 383 | 1.2372 |
440
+ | 1.221 | 4.9152 | 384 | 1.2372 |
441
+ | 1.2299 | 4.928 | 385 | 1.2372 |
442
+ | 1.1672 | 4.9408 | 386 | 1.2372 |
443
+ | 1.1694 | 4.9536 | 387 | 1.2372 |
444
+ | 1.2394 | 4.9664 | 388 | 1.2372 |
445
+ | 1.2328 | 4.9792 | 389 | 1.2372 |
446
+ | 1.1979 | 4.992 | 390 | 1.2372 |
447
+
448
+
449
+ ### Framework versions
450
+
451
+ - PEFT 0.10.0
452
+ - Transformers 4.43.0.dev0
453
+ - Pytorch 2.2.2+cu121
454
+ - Datasets 2.19.2
455
+ - Tokenizers 0.19.1