8688chris commited on
Commit
5d30e79
·
verified ·
1 Parent(s): 0a53617

Model save

Browse files
Files changed (3) hide show
  1. README.md +64 -34
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [facebook/wav2vec2-large-960h](https://huggingface.co/facebook/wav2vec2-large-960h) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 103.9572
21
- - Wer: 0.1109
22
 
23
  ## Model description
24
 
@@ -37,50 +37,80 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - learning_rate: 7e-05
41
  - train_batch_size: 16
42
  - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_ratio: 0.1
47
- - num_epochs: 30
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Wer |
53
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
54
- | 1110.2937 | 1.0 | 488 | 798.5612 | 0.6094 |
55
- | 872.6142 | 2.0 | 976 | 644.4997 | 0.5275 |
56
- | 748.6137 | 3.0 | 1464 | 567.8405 | 0.4740 |
57
- | 656.3362 | 4.0 | 1952 | 521.2706 | 0.4084 |
58
- | 586.6886 | 5.0 | 2440 | 384.2380 | 0.3523 |
59
- | 527.1101 | 6.0 | 2928 | 359.2795 | 0.3276 |
60
- | 482.441 | 7.0 | 3416 | 340.2037 | 0.2877 |
61
- | 449.7326 | 8.0 | 3904 | 321.2819 | 0.2804 |
62
- | 414.3373 | 9.0 | 4392 | 283.5350 | 0.2464 |
63
- | 388.4806 | 10.0 | 4880 | 232.1919 | 0.2322 |
64
- | 353.5541 | 11.0 | 5368 | 231.7585 | 0.2203 |
65
- | 336.3599 | 12.0 | 5856 | 223.0914 | 0.2059 |
66
- | 308.4163 | 13.0 | 6344 | 192.1331 | 0.1808 |
67
- | 294.2416 | 14.0 | 6832 | 171.5126 | 0.1755 |
68
- | 285.5686 | 15.0 | 7320 | 179.4413 | 0.1693 |
69
- | 262.8742 | 16.0 | 7808 | 160.9288 | 0.1621 |
70
- | 249.4716 | 17.0 | 8296 | 153.5433 | 0.1533 |
71
- | 242.8608 | 18.0 | 8784 | 140.9700 | 0.1475 |
72
- | 225.0344 | 19.0 | 9272 | 136.3707 | 0.1406 |
73
- | 224.6627 | 20.0 | 9760 | 135.5559 | 0.1316 |
74
- | 212.3516 | 21.0 | 10248 | 129.7029 | 0.1324 |
75
- | 204.9112 | 22.0 | 10736 | 125.1028 | 0.1291 |
76
- | 192.82 | 23.0 | 11224 | 117.4351 | 0.1251 |
77
- | 187.7432 | 24.0 | 11712 | 113.0604 | 0.1165 |
78
- | 178.6721 | 25.0 | 12200 | 108.2998 | 0.1143 |
79
- | 175.2548 | 26.0 | 12688 | 111.3398 | 0.1134 |
80
- | 173.7431 | 27.0 | 13176 | 106.5738 | 0.1123 |
81
- | 169.3344 | 28.0 | 13664 | 106.4765 | 0.1127 |
82
- | 161.1687 | 29.0 | 14152 | 102.0833 | 0.1122 |
83
- | 162.3253 | 30.0 | 14640 | 103.9572 | 0.1109 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
84
 
85
 
86
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [facebook/wav2vec2-large-960h](https://huggingface.co/facebook/wav2vec2-large-960h) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 32.5406
21
+ - Wer: 0.0515
22
 
23
  ## Model description
24
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - learning_rate: 8e-05
41
  - train_batch_size: 16
42
  - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_ratio: 0.1
47
+ - num_epochs: 60
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Wer |
53
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
54
+ | 1153.3836 | 1.0 | 488 | 850.3044 | 0.6449 |
55
+ | 928.434 | 2.0 | 976 | 691.6172 | 0.5685 |
56
+ | 811.1838 | 3.0 | 1464 | 598.8566 | 0.4987 |
57
+ | 717.7333 | 4.0 | 1952 | 552.0085 | 0.4545 |
58
+ | 647.3931 | 5.0 | 2440 | 463.2961 | 0.3979 |
59
+ | 586.5474 | 6.0 | 2928 | 417.2820 | 0.3674 |
60
+ | 533.4568 | 7.0 | 3416 | 398.9988 | 0.3179 |
61
+ | 488.8762 | 8.0 | 3904 | 369.4180 | 0.3068 |
62
+ | 444.0211 | 9.0 | 4392 | 301.7917 | 0.2615 |
63
+ | 413.0845 | 10.0 | 4880 | 251.3396 | 0.2400 |
64
+ | 372.2671 | 11.0 | 5368 | 249.1012 | 0.2238 |
65
+ | 347.6574 | 12.0 | 5856 | 230.7993 | 0.1970 |
66
+ | 314.716 | 13.0 | 6344 | 217.9398 | 0.1959 |
67
+ | 298.8911 | 14.0 | 6832 | 189.8561 | 0.1857 |
68
+ | 283.848 | 15.0 | 7320 | 191.2605 | 0.1741 |
69
+ | 258.3081 | 16.0 | 7808 | 143.3509 | 0.1580 |
70
+ | 243.6687 | 17.0 | 8296 | 145.5848 | 0.1499 |
71
+ | 233.2926 | 18.0 | 8784 | 140.6835 | 0.1495 |
72
+ | 211.4206 | 19.0 | 9272 | 124.2010 | 0.1386 |
73
+ | 208.7865 | 20.0 | 9760 | 118.0089 | 0.1269 |
74
+ | 195.4273 | 21.0 | 10248 | 117.8243 | 0.1262 |
75
+ | 184.6244 | 22.0 | 10736 | 97.7215 | 0.1164 |
76
+ | 171.8441 | 23.0 | 11224 | 111.4605 | 0.1131 |
77
+ | 163.1848 | 24.0 | 11712 | 89.1710 | 0.1134 |
78
+ | 153.9752 | 25.0 | 12200 | 87.3499 | 0.1047 |
79
+ | 147.2633 | 26.0 | 12688 | 87.4700 | 0.1082 |
80
+ | 142.8953 | 27.0 | 13176 | 83.6597 | 0.1020 |
81
+ | 136.2411 | 28.0 | 13664 | 82.2492 | 0.0981 |
82
+ | 125.4659 | 29.0 | 14152 | 80.2814 | 0.0996 |
83
+ | 123.5863 | 30.0 | 14640 | 72.3761 | 0.0878 |
84
+ | 123.4564 | 31.0 | 15128 | 74.1428 | 0.0898 |
85
+ | 119.1795 | 32.0 | 15616 | 60.4706 | 0.0805 |
86
+ | 106.3762 | 33.0 | 16104 | 70.6227 | 0.0834 |
87
+ | 108.1521 | 34.0 | 16592 | 59.9063 | 0.0785 |
88
+ | 102.576 | 35.0 | 17080 | 56.8914 | 0.0781 |
89
+ | 94.8957 | 36.0 | 17568 | 58.9398 | 0.0785 |
90
+ | 96.225 | 37.0 | 18056 | 55.8423 | 0.0777 |
91
+ | 91.3152 | 38.0 | 18544 | 55.6489 | 0.0747 |
92
+ | 94.8994 | 39.0 | 19032 | 55.0808 | 0.0701 |
93
+ | 86.3052 | 40.0 | 19520 | 51.2320 | 0.0716 |
94
+ | 81.8472 | 41.0 | 20008 | 47.2280 | 0.0641 |
95
+ | 84.5362 | 42.0 | 20496 | 48.6431 | 0.0654 |
96
+ | 80.2845 | 43.0 | 20984 | 44.2606 | 0.0663 |
97
+ | 79.6424 | 44.0 | 21472 | 46.5519 | 0.0612 |
98
+ | 78.9052 | 45.0 | 21960 | 47.1750 | 0.0654 |
99
+ | 75.1781 | 46.0 | 22448 | 41.0039 | 0.0630 |
100
+ | 66.398 | 47.0 | 22936 | 41.1136 | 0.0599 |
101
+ | 68.9468 | 48.0 | 23424 | 39.4498 | 0.0577 |
102
+ | 69.0842 | 49.0 | 23912 | 39.5141 | 0.0590 |
103
+ | 63.1563 | 50.0 | 24400 | 38.1891 | 0.0572 |
104
+ | 66.0264 | 51.0 | 24888 | 36.2524 | 0.0606 |
105
+ | 64.2084 | 52.0 | 25376 | 39.5151 | 0.0579 |
106
+ | 63.0642 | 53.0 | 25864 | 36.7211 | 0.0579 |
107
+ | 61.9061 | 54.0 | 26352 | 37.9883 | 0.0564 |
108
+ | 60.9176 | 55.0 | 26840 | 35.0138 | 0.0528 |
109
+ | 56.4366 | 56.0 | 27328 | 33.8095 | 0.0519 |
110
+ | 60.1974 | 57.0 | 27816 | 32.5853 | 0.0492 |
111
+ | 57.5505 | 58.0 | 28304 | 34.2817 | 0.0512 |
112
+ | 58.9594 | 59.0 | 28792 | 32.7452 | 0.0519 |
113
+ | 58.9188 | 60.0 | 29280 | 32.5406 | 0.0515 |
114
 
115
 
116
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6f823f385cb4c2c8c75005ad0a6025d6bbfe371c60cb06dd8c7c46f40f39d346
3
  size 1261897368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2697b097013f682f8cd1e0f08264f66eca8babc158c67656d80e4295dbb0f059
3
  size 1261897368
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b4236b4778e04d1b82d6c48df8c7296e646e493d04c56023eb7e0c896f3765e
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3933599f5e4a5a9973599931182d82005e10cb49b72302ce0b90417f54bbfe1
3
  size 5240