8688chris commited on
Commit
bdfb785
·
verified ·
1 Parent(s): b6aec3d

Model save

Browse files
Files changed (3) hide show
  1. README.md +34 -33
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [facebook/wav2vec2-base-960h](https://huggingface.co/facebook/wav2vec2-base-960h) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 134.4454
21
- - Wer: 0.0694
22
 
23
  ## Model description
24
 
@@ -42,7 +42,8 @@ The following hyperparameters were used during training:
42
  - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
- - lr_scheduler_type: cosine
 
46
  - num_epochs: 30
47
  - mixed_precision_training: Native AMP
48
 
@@ -50,36 +51,36 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Wer |
52
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
53
- | 707.3282 | 1.0 | 486 | 401.7251 | 0.3725 |
54
- | 477.7054 | 2.0 | 972 | 338.9568 | 0.3002 |
55
- | 377.4668 | 3.0 | 1458 | 332.3391 | 0.2766 |
56
- | 312.8686 | 4.0 | 1944 | 250.9001 | 0.2083 |
57
- | 263.9122 | 5.0 | 2430 | 255.3110 | 0.1924 |
58
- | 225.1422 | 6.0 | 2916 | 235.4016 | 0.1733 |
59
- | 205.3537 | 7.0 | 3402 | 167.1833 | 0.1290 |
60
- | 180.8011 | 8.0 | 3888 | 150.0885 | 0.1195 |
61
- | 159.5088 | 9.0 | 4374 | 171.2871 | 0.1314 |
62
- | 150.4287 | 10.0 | 4860 | 158.4681 | 0.1093 |
63
- | 127.9891 | 11.0 | 5346 | 142.8434 | 0.0979 |
64
- | 120.8978 | 12.0 | 5832 | 134.8509 | 0.0976 |
65
- | 110.0645 | 13.0 | 6318 | 132.9552 | 0.0976 |
66
- | 104.547 | 14.0 | 6804 | 122.0037 | 0.0835 |
67
- | 96.8871 | 15.0 | 7290 | 142.5403 | 0.0873 |
68
- | 87.4426 | 16.0 | 7776 | 136.5416 | 0.0862 |
69
- | 80.2423 | 17.0 | 8262 | 113.7286 | 0.0772 |
70
- | 76.5584 | 18.0 | 8748 | 123.2151 | 0.0747 |
71
- | 71.483 | 19.0 | 9234 | 123.1056 | 0.0729 |
72
- | 74.9826 | 20.0 | 9720 | 126.8235 | 0.0710 |
73
- | 64.5212 | 21.0 | 10206 | 123.9980 | 0.0692 |
74
- | 66.9201 | 22.0 | 10692 | 133.9775 | 0.0747 |
75
- | 72.1223 | 23.0 | 11178 | 125.7820 | 0.0677 |
76
- | 59.429 | 24.0 | 11664 | 137.0608 | 0.0730 |
77
- | 64.658 | 25.0 | 12150 | 123.1982 | 0.0655 |
78
- | 62.1091 | 26.0 | 12636 | 128.4541 | 0.0664 |
79
- | 59.1036 | 27.0 | 13122 | 132.6404 | 0.0681 |
80
- | 58.5964 | 28.0 | 13608 | 133.0307 | 0.0685 |
81
- | 58.6317 | 29.0 | 14094 | 134.8861 | 0.0694 |
82
- | 64.5423 | 30.0 | 14580 | 134.4454 | 0.0694 |
83
 
84
 
85
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [facebook/wav2vec2-base-960h](https://huggingface.co/facebook/wav2vec2-base-960h) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 121.7825
21
+ - Wer: 0.0701
22
 
23
  ## Model description
24
 
 
42
  - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - lr_scheduler_warmup_ratio: 0.1
47
  - num_epochs: 30
48
  - mixed_precision_training: Native AMP
49
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Wer |
53
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
54
+ | 989.1626 | 1.0 | 488 | 609.3144 | 0.5319 |
55
+ | 659.4745 | 2.0 | 976 | 441.8672 | 0.3931 |
56
+ | 514.4119 | 3.0 | 1464 | 382.5584 | 0.3219 |
57
+ | 419.7142 | 4.0 | 1952 | 288.8653 | 0.2560 |
58
+ | 341.4243 | 5.0 | 2440 | 281.8234 | 0.2205 |
59
+ | 288.763 | 6.0 | 2928 | 226.5483 | 0.1841 |
60
+ | 253.7379 | 7.0 | 3416 | 226.4153 | 0.1735 |
61
+ | 215.8471 | 8.0 | 3904 | 225.1913 | 0.1611 |
62
+ | 193.4694 | 9.0 | 4392 | 261.5921 | 0.1593 |
63
+ | 171.5698 | 10.0 | 4880 | 162.4843 | 0.1218 |
64
+ | 153.7561 | 11.0 | 5368 | 168.0577 | 0.1202 |
65
+ | 143.2963 | 12.0 | 5856 | 188.0740 | 0.1173 |
66
+ | 128.2614 | 13.0 | 6344 | 146.3703 | 0.0960 |
67
+ | 125.1001 | 14.0 | 6832 | 163.2122 | 0.0936 |
68
+ | 112.3151 | 15.0 | 7320 | 121.7357 | 0.0763 |
69
+ | 105.5073 | 16.0 | 7808 | 133.4259 | 0.0808 |
70
+ | 91.294 | 17.0 | 8296 | 134.9446 | 0.0827 |
71
+ | 94.5096 | 18.0 | 8784 | 109.5260 | 0.0794 |
72
+ | 83.6972 | 19.0 | 9272 | 163.8145 | 0.0909 |
73
+ | 78.8643 | 20.0 | 9760 | 102.4994 | 0.0665 |
74
+ | 72.3876 | 21.0 | 10248 | 102.5806 | 0.0676 |
75
+ | 71.9532 | 22.0 | 10736 | 109.1589 | 0.0666 |
76
+ | 73.799 | 23.0 | 11224 | 114.1257 | 0.0703 |
77
+ | 71.033 | 24.0 | 11712 | 121.2289 | 0.0781 |
78
+ | 66.3356 | 25.0 | 12200 | 109.2525 | 0.0666 |
79
+ | 64.8495 | 26.0 | 12688 | 108.1266 | 0.0657 |
80
+ | 60.262 | 27.0 | 13176 | 120.6045 | 0.0699 |
81
+ | 55.4432 | 28.0 | 13664 | 124.6207 | 0.0716 |
82
+ | 62.6622 | 29.0 | 14152 | 122.5060 | 0.0683 |
83
+ | 58.4588 | 30.0 | 14640 | 121.7825 | 0.0701 |
84
 
85
 
86
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:06661a1451962c8e612b690642ea3322b720c1955c06ed1d5c5d4b572ae59414
3
  size 377611120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d19dfa606f67e4ff906043bf5dbf92a2303c24015d34017294e2f84be8ecd05
3
  size 377611120
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:088a123df7ffb58042710ea939a332a151f6ba323aed87a2ac5c603e14785fb3
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d90df8d81584ab6a1eae5e0b0251f0e41bd56de9884adef0be7703f879999b05
3
  size 5240