Hugging Face's logo

EricWesthoff
/
phi-1_5-finetuned-SQL

Text Generation
Transformers
PyTorch
mixformer-sequential
Generated from Trainer
custom_code
Model card Files
xet
Community
EricWesthoff commited on
Commit
05f5185
·
1 Parent(s): 5686b9b

End of training

Browse files
Files changed (2) hide show
  1. README.md +182 -2
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-1_5) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.1812
19
 
20
  ## Model description
21
 
@@ -40,7 +40,7 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
- - training_steps: 18000
44
 
45
  ### Training results
46
 
@@ -226,6 +226,186 @@ The following hyperparameters were used during training:
226
  | 0.1832 | 71.2 | 17800 | 0.1812 |
227
  | 0.1818 | 71.6 | 17900 | 0.1812 |
228
  | 0.181 | 72.0 | 18000 | 0.1812 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
229
 
230
 
231
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-1_5) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.2630
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
+ - training_steps: 36000
44
 
45
  ### Training results
46
 
 
226
  | 0.1832 | 71.2 | 17800 | 0.1812 |
227
  | 0.1818 | 71.6 | 17900 | 0.1812 |
228
  | 0.181 | 72.0 | 18000 | 0.1812 |
229
+ | 2.0915 | 1.46 | 18100 | 1.3624 |
230
+ | 1.8647 | 1.47 | 18200 | 1.3663 |
231
+ | 1.8362 | 1.48 | 18300 | 1.3781 |
232
+ | 1.8216 | 1.49 | 18400 | 1.3598 |
233
+ | 1.8023 | 1.5 | 18500 | 1.3633 |
234
+ | 1.7273 | 1.5 | 18600 | 1.3409 |
235
+ | 1.7835 | 1.51 | 18700 | 1.3696 |
236
+ | 1.8034 | 1.52 | 18800 | 1.3512 |
237
+ | 1.7312 | 1.53 | 18900 | 1.3322 |
238
+ | 1.7479 | 1.54 | 19000 | 1.3300 |
239
+ | 1.6961 | 1.54 | 19100 | 1.3488 |
240
+ | 1.7625 | 1.55 | 19200 | 1.3566 |
241
+ | 1.6767 | 1.56 | 19300 | 1.3311 |
242
+ | 1.7146 | 1.57 | 19400 | 1.3366 |
243
+ | 1.7105 | 1.58 | 19500 | 1.3369 |
244
+ | 1.718 | 1.59 | 19600 | 1.3580 |
245
+ | 1.7224 | 1.59 | 19700 | 1.3446 |
246
+ | 1.6981 | 1.6 | 19800 | 1.3481 |
247
+ | 1.6872 | 1.61 | 19900 | 1.3515 |
248
+ | 1.6453 | 1.62 | 20000 | 1.3442 |
249
+ | 1.7233 | 1.63 | 20100 | 1.3501 |
250
+ | 1.7092 | 1.63 | 20200 | 1.3388 |
251
+ | 1.6792 | 1.64 | 20300 | 1.3404 |
252
+ | 1.7033 | 1.65 | 20400 | 1.3280 |
253
+ | 1.6514 | 1.66 | 20500 | 1.3296 |
254
+ | 1.6873 | 1.67 | 20600 | 1.3415 |
255
+ | 1.7064 | 1.67 | 20700 | 1.3384 |
256
+ | 1.6438 | 1.68 | 20800 | 1.3372 |
257
+ | 1.6821 | 1.69 | 20900 | 1.3414 |
258
+ | 1.6491 | 1.7 | 21000 | 1.3356 |
259
+ | 1.7099 | 1.71 | 21100 | 1.3436 |
260
+ | 1.6279 | 1.71 | 21200 | 1.3265 |
261
+ | 1.6267 | 1.72 | 21300 | 1.3454 |
262
+ | 1.6631 | 1.73 | 21400 | 1.3322 |
263
+ | 1.6078 | 1.74 | 21500 | 1.3367 |
264
+ | 1.6165 | 1.75 | 21600 | 1.3439 |
265
+ | 1.6093 | 1.76 | 21700 | 1.3317 |
266
+ | 1.6648 | 1.76 | 21800 | 1.3248 |
267
+ | 1.6071 | 1.77 | 21900 | 1.3200 |
268
+ | 1.6539 | 1.78 | 22000 | 1.3409 |
269
+ | 1.6084 | 1.79 | 22100 | 1.3362 |
270
+ | 1.658 | 1.8 | 22200 | 1.3387 |
271
+ | 1.5855 | 1.8 | 22300 | 1.3271 |
272
+ | 1.6351 | 1.81 | 22400 | 1.3281 |
273
+ | 1.6402 | 1.82 | 22500 | 1.3344 |
274
+ | 1.5961 | 1.83 | 22600 | 1.3247 |
275
+ | 1.5894 | 1.84 | 22700 | 1.3266 |
276
+ | 1.6248 | 1.84 | 22800 | 1.3261 |
277
+ | 1.6172 | 1.85 | 22900 | 1.3210 |
278
+ | 1.5944 | 1.86 | 23000 | 1.3255 |
279
+ | 1.6238 | 1.87 | 23100 | 1.3260 |
280
+ | 1.6705 | 1.88 | 23200 | 1.3198 |
281
+ | 1.6116 | 1.88 | 23300 | 1.3202 |
282
+ | 1.5902 | 1.89 | 23400 | 1.3269 |
283
+ | 1.649 | 1.9 | 23500 | 1.3240 |
284
+ | 1.5729 | 1.91 | 23600 | 1.3189 |
285
+ | 1.6074 | 1.92 | 23700 | 1.3283 |
286
+ | 1.624 | 1.92 | 23800 | 1.3326 |
287
+ | 1.6319 | 1.93 | 23900 | 1.3282 |
288
+ | 1.6507 | 1.94 | 24000 | 1.3336 |
289
+ | 1.6229 | 1.95 | 24100 | 1.3217 |
290
+ | 1.6241 | 1.96 | 24200 | 1.3226 |
291
+ | 1.5927 | 1.97 | 24300 | 1.3293 |
292
+ | 1.5919 | 1.97 | 24400 | 1.3210 |
293
+ | 1.5779 | 1.98 | 24500 | 1.3222 |
294
+ | 1.6048 | 1.99 | 24600 | 1.3135 |
295
+ | 1.6315 | 2.0 | 24700 | 1.3143 |
296
+ | 1.6103 | 2.01 | 24800 | 1.3141 |
297
+ | 1.6211 | 2.01 | 24900 | 1.3122 |
298
+ | 1.5708 | 2.02 | 25000 | 1.3070 |
299
+ | 1.5982 | 2.03 | 25100 | 1.3040 |
300
+ | 1.5622 | 2.04 | 25200 | 1.3017 |
301
+ | 1.5957 | 2.05 | 25300 | 1.2996 |
302
+ | 1.5581 | 2.05 | 25400 | 1.3034 |
303
+ | 1.6162 | 2.06 | 25500 | 1.2977 |
304
+ | 1.615 | 2.07 | 25600 | 1.3019 |
305
+ | 1.5554 | 2.08 | 25700 | 1.2912 |
306
+ | 1.6112 | 2.09 | 25800 | 1.2973 |
307
+ | 1.5937 | 2.09 | 25900 | 1.2989 |
308
+ | 1.5605 | 2.1 | 26000 | 1.2956 |
309
+ | 1.5757 | 2.11 | 26100 | 1.2957 |
310
+ | 1.5362 | 2.12 | 26200 | 1.2945 |
311
+ | 1.5558 | 2.13 | 26300 | 1.2869 |
312
+ | 1.5116 | 2.14 | 26400 | 1.2846 |
313
+ | 1.5563 | 2.14 | 26500 | 1.2931 |
314
+ | 1.5356 | 2.15 | 26600 | 1.2876 |
315
+ | 1.5291 | 2.16 | 26700 | 1.2896 |
316
+ | 1.5452 | 2.17 | 26800 | 1.2835 |
317
+ | 1.5688 | 2.18 | 26900 | 1.2876 |
318
+ | 1.5424 | 2.18 | 27000 | 1.2906 |
319
+ | 1.5295 | 2.19 | 27100 | 1.2862 |
320
+ | 1.5344 | 2.2 | 27200 | 1.2795 |
321
+ | 1.5963 | 2.21 | 27300 | 1.2849 |
322
+ | 1.5569 | 2.22 | 27400 | 1.2857 |
323
+ | 1.5413 | 2.22 | 27500 | 1.2849 |
324
+ | 1.5851 | 2.23 | 27600 | 1.2852 |
325
+ | 1.5496 | 2.24 | 27700 | 1.2855 |
326
+ | 1.5375 | 2.25 | 27800 | 1.2841 |
327
+ | 1.5252 | 2.26 | 27900 | 1.2756 |
328
+ | 1.5657 | 2.26 | 28000 | 1.2853 |
329
+ | 1.5236 | 2.27 | 28100 | 1.2793 |
330
+ | 1.5641 | 2.28 | 28200 | 1.2793 |
331
+ | 1.5485 | 2.29 | 28300 | 1.2799 |
332
+ | 1.5419 | 2.3 | 28400 | 1.2758 |
333
+ | 1.5353 | 2.31 | 28500 | 1.2773 |
334
+ | 1.5716 | 2.31 | 28600 | 1.2792 |
335
+ | 1.5427 | 2.32 | 28700 | 1.2805 |
336
+ | 1.5296 | 2.33 | 28800 | 1.2753 |
337
+ | 1.5551 | 2.34 | 28900 | 1.2759 |
338
+ | 1.5204 | 2.35 | 29000 | 1.2743 |
339
+ | 1.575 | 2.35 | 29100 | 1.2740 |
340
+ | 1.5585 | 2.36 | 29200 | 1.2749 |
341
+ | 1.547 | 2.37 | 29300 | 1.2724 |
342
+ | 1.5661 | 2.38 | 29400 | 1.2700 |
343
+ | 1.4931 | 2.39 | 29500 | 1.2677 |
344
+ | 1.5507 | 2.39 | 29600 | 1.2703 |
345
+ | 1.5798 | 2.4 | 29700 | 1.2693 |
346
+ | 1.5425 | 2.41 | 29800 | 1.2669 |
347
+ | 1.5636 | 2.42 | 29900 | 1.2731 |
348
+ | 1.5488 | 2.43 | 30000 | 1.2717 |
349
+ | 1.5258 | 2.43 | 30100 | 1.2701 |
350
+ | 1.5395 | 2.44 | 30200 | 1.2676 |
351
+ | 1.544 | 2.45 | 30300 | 1.2700 |
352
+ | 1.5259 | 2.46 | 30400 | 1.2674 |
353
+ | 1.529 | 2.47 | 30500 | 1.2689 |
354
+ | 1.5162 | 2.47 | 30600 | 1.2651 |
355
+ | 1.527 | 2.48 | 30700 | 1.2662 |
356
+ | 1.5273 | 2.49 | 30800 | 1.2670 |
357
+ | 1.5462 | 2.5 | 30900 | 1.2672 |
358
+ | 1.5043 | 2.51 | 31000 | 1.2704 |
359
+ | 1.5811 | 2.52 | 31100 | 1.2708 |
360
+ | 1.5619 | 2.52 | 31200 | 1.2706 |
361
+ | 1.5714 | 2.53 | 31300 | 1.2688 |
362
+ | 1.5901 | 2.54 | 31400 | 1.2723 |
363
+ | 1.5845 | 2.55 | 31500 | 1.2674 |
364
+ | 1.5331 | 2.56 | 31600 | 1.2666 |
365
+ | 1.5685 | 2.56 | 31700 | 1.2673 |
366
+ | 1.5114 | 2.57 | 31800 | 1.2668 |
367
+ | 1.5574 | 2.58 | 31900 | 1.2675 |
368
+ | 1.527 | 2.59 | 32000 | 1.2678 |
369
+ | 1.5424 | 2.6 | 32100 | 1.2666 |
370
+ | 1.5706 | 2.6 | 32200 | 1.2676 |
371
+ | 1.5407 | 2.61 | 32300 | 1.2667 |
372
+ | 1.5534 | 2.62 | 32400 | 1.2677 |
373
+ | 1.5691 | 2.63 | 32500 | 1.2669 |
374
+ | 1.5223 | 2.64 | 32600 | 1.2662 |
375
+ | 1.4817 | 2.64 | 32700 | 1.2642 |
376
+ | 1.5603 | 2.65 | 32800 | 1.2652 |
377
+ | 1.5072 | 2.66 | 32900 | 1.2641 |
378
+ | 1.5691 | 2.67 | 33000 | 1.2633 |
379
+ | 1.5673 | 2.68 | 33100 | 1.2643 |
380
+ | 1.5433 | 2.69 | 33200 | 1.2645 |
381
+ | 1.5102 | 2.69 | 33300 | 1.2634 |
382
+ | 1.497 | 2.7 | 33400 | 1.2639 |
383
+ | 1.564 | 2.71 | 33500 | 1.2636 |
384
+ | 1.5131 | 2.72 | 33600 | 1.2637 |
385
+ | 1.5138 | 2.73 | 33700 | 1.2632 |
386
+ | 1.5345 | 2.73 | 33800 | 1.2634 |
387
+ | 1.5539 | 2.74 | 33900 | 1.2631 |
388
+ | 1.5571 | 2.75 | 34000 | 1.2634 |
389
+ | 1.5325 | 2.76 | 34100 | 1.2634 |
390
+ | 1.5434 | 2.77 | 34200 | 1.2635 |
391
+ | 1.5053 | 2.77 | 34300 | 1.2630 |
392
+ | 1.5503 | 2.78 | 34400 | 1.2633 |
393
+ | 1.5414 | 2.79 | 34500 | 1.2632 |
394
+ | 1.4909 | 2.8 | 34600 | 1.2627 |
395
+ | 1.5447 | 2.81 | 34700 | 1.2626 |
396
+ | 1.5897 | 2.81 | 34800 | 1.2630 |
397
+ | 1.5738 | 2.82 | 34900 | 1.2634 |
398
+ | 1.5125 | 2.83 | 35000 | 1.2632 |
399
+ | 1.5532 | 2.84 | 35100 | 1.2633 |
400
+ | 1.5423 | 2.85 | 35200 | 1.2632 |
401
+ | 1.4817 | 2.86 | 35300 | 1.2631 |
402
+ | 1.542 | 2.86 | 35400 | 1.2631 |
403
+ | 1.5232 | 2.87 | 35500 | 1.2631 |
404
+ | 1.556 | 2.88 | 35600 | 1.2631 |
405
+ | 1.5154 | 2.89 | 35700 | 1.2631 |
406
+ | 1.5174 | 2.9 | 35800 | 1.2631 |
407
+ | 1.5469 | 2.9 | 35900 | 1.2631 |
408
+ | 1.5171 | 2.91 | 36000 | 1.2630 |
409
 
410
 
411
  ### Framework versions
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a6ecde7fba552831f60b3b5a309178d6804266e6ae3903bda24b93135bc7854d
3
  size 18908110
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b50113307082b21eac3909f0b2a73cfff8931117464adef77930b743081562b0
3
  size 18908110