kostissz commited on
Commit
c493e69
·
verified ·
1 Parent(s): ef0bffc

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +19 -88
README.md CHANGED
@@ -1,103 +1,34 @@
1
  ---
2
- library_name: transformers
3
- license: apache-2.0
4
  base_model: openai/whisper-small
5
- tags:
6
- - generated_from_trainer
7
  datasets:
8
- - common_voice_17_0
9
- metrics:
10
- - wer
11
  model-index:
12
- - name: whisper-small-swedish
13
  results:
14
  - task:
15
- name: Automatic Speech Recognition
16
  type: automatic-speech-recognition
 
17
  dataset:
18
- name: common_voice_17_0
19
- type: common_voice_17_0
20
- config: sv-SE
21
- split: test
22
- args: sv-SE
23
  metrics:
24
- - name: Wer
25
- type: wer
26
- value: 20.14691254112786
27
  ---
28
 
29
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
- should probably proofread and complete it, then remove this comment. -->
31
-
32
- # whisper-small-swedish
33
-
34
- This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the common_voice_17_0 dataset.
35
- It achieves the following results on the evaluation set:
36
- - Loss: 0.3111
37
- - Model Preparation Time: 0.0044
38
- - Wer: 20.1469
39
-
40
- ## Model description
41
-
42
- More information needed
43
-
44
- ## Intended uses & limitations
45
-
46
- More information needed
47
-
48
- ## Training and evaluation data
49
-
50
- More information needed
51
-
52
- ## Training procedure
53
-
54
- ### Training hyperparameters
55
-
56
- The following hyperparameters were used during training:
57
- - learning_rate: 1e-05
58
- - train_batch_size: 258
59
- - eval_batch_size: 64
60
- - seed: 42
61
- - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
62
- - lr_scheduler_type: linear
63
- - lr_scheduler_warmup_steps: 50
64
- - training_steps: 1250
65
- - mixed_precision_training: Native AMP
66
-
67
- ### Training results
68
 
69
- | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Wer |
70
- |:-------------:|:-------:|:----:|:---------------:|:----------------------:|:-------:|
71
- | 0.6188 | 0.9804 | 50 | 0.3424 | 0.0044 | 23.1107 |
72
- | 0.2417 | 1.9608 | 100 | 0.3089 | 0.0044 | 21.0881 |
73
- | 0.1456 | 2.9412 | 150 | 0.3038 | 0.0044 | 20.7412 |
74
- | 0.0928 | 3.9216 | 200 | 0.3111 | 0.0044 | 20.1469 |
75
- | 0.0554 | 4.9020 | 250 | 0.3231 | 0.0044 | 20.3739 |
76
- | 0.035 | 5.8824 | 300 | 0.3367 | 0.0044 | 20.8432 |
77
- | 0.0215 | 6.8627 | 350 | 0.3619 | 0.0044 | 20.8458 |
78
- | 0.0143 | 7.8431 | 400 | 0.3768 | 0.0044 | 20.9299 |
79
- | 0.0101 | 8.8235 | 450 | 0.3880 | 0.0044 | 20.8509 |
80
- | 0.0084 | 9.8039 | 500 | 0.3960 | 0.0044 | 20.8993 |
81
- | 0.0072 | 10.7843 | 550 | 0.3999 | 0.0044 | 21.0014 |
82
- | 0.0059 | 11.7647 | 600 | 0.4069 | 0.0044 | 20.8942 |
83
- | 0.0053 | 12.7451 | 650 | 0.4130 | 0.0044 | 20.9656 |
84
- | 0.0047 | 13.7255 | 700 | 0.4177 | 0.0044 | 20.9963 |
85
- | 0.0043 | 14.7059 | 750 | 0.4208 | 0.0044 | 20.9478 |
86
- | 0.004 | 15.6863 | 800 | 0.4241 | 0.0044 | 21.0371 |
87
- | 0.0037 | 16.6667 | 850 | 0.4265 | 0.0044 | 21.0600 |
88
- | 0.0035 | 17.6471 | 900 | 0.4298 | 0.0044 | 21.1034 |
89
- | 0.0034 | 18.6275 | 950 | 0.4317 | 0.0044 | 21.0983 |
90
- | 0.0032 | 19.6078 | 1000 | 0.4334 | 0.0044 | 21.1416 |
91
- | 0.0031 | 20.5882 | 1050 | 0.4351 | 0.0044 | 21.1518 |
92
- | 0.003 | 21.5686 | 1100 | 0.4361 | 0.0044 | 21.1748 |
93
- | 0.0029 | 22.5490 | 1150 | 0.4368 | 0.0044 | 21.1620 |
94
- | 0.0029 | 23.5294 | 1200 | 0.4374 | 0.0044 | 21.1799 |
95
- | 0.0029 | 24.5098 | 1250 | 0.4377 | 0.0044 | 21.1722 |
96
 
 
97
 
98
- ### Framework versions
 
 
99
 
100
- - Transformers 4.49.0
101
- - Pytorch 2.6.0+cu124
102
- - Datasets 3.3.2
103
- - Tokenizers 0.21.0
 
1
  ---
 
 
2
  base_model: openai/whisper-small
 
 
3
  datasets:
4
+ - artifacts/sv-SE_mozilla-foundation_common_voice_17_0
5
+ library_name: transformers
6
+ license: apache-2.0
7
  model-index:
8
+ - name: Finetuned openai/whisper-small on Swedish
9
  results:
10
  - task:
 
11
  type: automatic-speech-recognition
12
+ name: Speech-to-Text
13
  dataset:
14
+ name: Common Voice (Swedish)
15
+ type: common_voice
 
 
 
16
  metrics:
17
+ - type: wer
18
+ value: 20.147
 
19
  ---
20
 
21
+ # Finetuned openai/whisper-small on 12954 Swedish training audio samples from artifacts/sv-SE_mozilla-foundation_common_voice_17_0.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
 
23
+ This model was created from the Mozilla.ai Blueprint:
24
+ [speech-to-text-finetune](https://github.com/mozilla-ai/speech-to-text-finetune).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
 
26
+ ## Evaluation results on 5259 audio samples of Swedish:
27
 
28
+ ### Baseline model (before finetuning) on Swedish
29
+ - Word Error Rate: 28.413
30
+ - Loss: 1.066
31
 
32
+ ### Finetuned model (after finetuning) on Swedish
33
+ - Word Error Rate: 20.147
34
+ - Loss: 0.311