deepdml commited on
Commit
9ff3f54
·
verified ·
1 Parent(s): 99b5cc4

End of training

Browse files
README.md ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ar
4
+ license: apache-2.0
5
+ base_model: openai/whisper-tiny
6
+ tags:
7
+ - generated_from_trainer
8
+ datasets:
9
+ - ymoslem/MediaSpeech
10
+ - deepdml/Tunisian_MSA
11
+ - UBC-NLP/Casablanca
12
+ - fixie-ai/common_voice_17_0
13
+ - google/fleurs
14
+ metrics:
15
+ - wer
16
+ model-index:
17
+ - name: Whisper Tiny ar
18
+ results:
19
+ - task:
20
+ name: Automatic Speech Recognition
21
+ type: automatic-speech-recognition
22
+ dataset:
23
+ name: Common Voice 17.0
24
+ type: ymoslem/MediaSpeech
25
+ metrics:
26
+ - name: Wer
27
+ type: wer
28
+ value: 60.61585354657461
29
+ ---
30
+
31
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
32
+ should probably proofread and complete it, then remove this comment. -->
33
+
34
+ # Whisper Tiny ar
35
+
36
+ This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the Common Voice 17.0 dataset.
37
+ It achieves the following results on the evaluation set:
38
+ - Loss: 0.7162
39
+ - Wer: 60.6159
40
+ - Cer: 21.8903
41
+
42
+ ## Model description
43
+
44
+ More information needed
45
+
46
+ ## Intended uses & limitations
47
+
48
+ More information needed
49
+
50
+ ## Training and evaluation data
51
+
52
+ More information needed
53
+
54
+ ## Training procedure
55
+
56
+ ### Training hyperparameters
57
+
58
+ The following hyperparameters were used during training:
59
+ - learning_rate: 1e-05
60
+ - train_batch_size: 64
61
+ - eval_batch_size: 64
62
+ - seed: 42
63
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
64
+ - lr_scheduler_type: linear
65
+ - lr_scheduler_warmup_ratio: 0.04
66
+ - training_steps: 5000
67
+
68
+ ### Training results
69
+
70
+ | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
71
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
72
+ | 0.8928 | 0.2 | 1000 | 0.7965 | 66.8809 | 25.5809 |
73
+ | 0.6731 | 0.4 | 2000 | 0.7496 | 63.1479 | 23.1687 |
74
+ | 0.5235 | 0.6 | 3000 | 0.7214 | 61.6845 | 22.3557 |
75
+ | 0.4641 | 0.8 | 4000 | 0.7161 | 60.8490 | 21.9854 |
76
+ | 0.4296 | 1.0 | 5000 | 0.7162 | 60.6159 | 21.8903 |
77
+
78
+
79
+ ### Framework versions
80
+
81
+ - Transformers 4.42.0.dev0
82
+ - Pytorch 2.3.0+cu121
83
+ - Datasets 2.19.1
84
+ - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4ab16fa8da016140c7a072ad56c7a207a00727f6f365e6875a324f77b7026adb
3
  size 151061672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:298121245341d18474b6201b804904086e13d391c81f9b588ee205097b13f246
3
  size 151061672
runs/Feb21_12-52-21_32895c83bbac/events.out.tfevents.1771678342.32895c83bbac.1108.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9e13346f0aa2f26a38f8d96d843819e1909f3a9da63888f18748ff4f68315b97
3
- size 41827
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:026824137914d6d7748a57ee5b4a191ea051fc42af0dcdd81bd8c0074ef3add5
3
+ size 50986