Baselhany commited on
Commit
f22f8d5
·
verified ·
1 Parent(s): d5db462

Model save

Browse files
README.md CHANGED
@@ -1,27 +1,25 @@
1
  ---
2
  library_name: transformers
3
- language:
4
- - ar
5
  license: apache-2.0
6
- base_model: openai/whisper-base
7
  tags:
8
  - generated_from_trainer
9
  metrics:
10
  - wer
11
  model-index:
12
- - name: Whisper base AR - BA
13
  results: []
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
- # Whisper base AR - BA
20
 
21
- This model is a fine-tuned version of [openai/whisper-base](https://huggingface.co/openai/whisper-base) on the quran-ayat-speech-to-text dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.0907
24
- - Wer: 0.1967
25
 
26
  ## Model description
27
 
@@ -49,23 +47,28 @@ The following hyperparameters were used during training:
49
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
  - lr_scheduler_type: linear
51
  - lr_scheduler_warmup_steps: 500
52
- - num_epochs: 10
53
  - mixed_precision_training: Native AMP
54
 
55
  ### Training results
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Wer |
58
  |:-------------:|:-----:|:----:|:---------------:|:------:|
59
- | 2.1766 | 1.0 | 625 | 0.0940 | 0.2060 |
60
- | 1.8382 | 2.0 | 1250 | 0.0916 | 0.1966 |
61
- | 1.4337 | 3.0 | 1875 | 0.0906 | 0.1905 |
62
- | 1.2601 | 4.0 | 2500 | 0.0898 | 0.1904 |
63
- | 1.1154 | 5.0 | 3125 | 0.0884 | 0.1886 |
64
- | 1.0993 | 6.0 | 3750 | 0.0875 | 0.1902 |
65
- | 0.9665 | 7.0 | 4375 | 0.0866 | 0.1936 |
66
- | 0.9165 | 8.0 | 5000 | 0.0866 | 0.1929 |
67
- | 0.8476 | 9.0 | 5625 | 0.0865 | 0.1926 |
68
- | 0.7916 | 10.0 | 6250 | 0.0865 | 0.1927 |
 
 
 
 
 
69
 
70
 
71
  ### Framework versions
 
1
  ---
2
  library_name: transformers
 
 
3
  license: apache-2.0
4
+ base_model: Baselhany/Distilation_Whisper_base_bigger_samples
5
  tags:
6
  - generated_from_trainer
7
  metrics:
8
  - wer
9
  model-index:
10
+ - name: Distilation_Whisper_base_bigger_samples
11
  results: []
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
17
+ # Distilation_Whisper_base_bigger_samples
18
 
19
+ This model is a fine-tuned version of [Baselhany/Distilation_Whisper_base_bigger_samples](https://huggingface.co/Baselhany/Distilation_Whisper_base_bigger_samples) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.0931
22
+ - Wer: 0.1960
23
 
24
  ## Model description
25
 
 
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_steps: 500
50
+ - num_epochs: 15
51
  - mixed_precision_training: Native AMP
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Wer |
56
  |:-------------:|:-----:|:----:|:---------------:|:------:|
57
+ | 1.8752 | 1.0 | 457 | 0.0914 | 0.2050 |
58
+ | 1.8589 | 2.0 | 914 | 0.0902 | 0.1879 |
59
+ | 1.4408 | 3.0 | 1371 | 0.0905 | 0.2060 |
60
+ | 1.3046 | 4.0 | 1828 | 0.0886 | 0.1908 |
61
+ | 1.1751 | 5.0 | 2285 | 0.0870 | 0.2003 |
62
+ | 1.0567 | 6.0 | 2742 | 0.0882 | 0.1955 |
63
+ | 0.9915 | 7.0 | 3199 | 0.0867 | 0.1950 |
64
+ | 0.91 | 8.0 | 3656 | 0.0875 | 0.2004 |
65
+ | 0.8595 | 9.0 | 4113 | 0.0858 | 0.2093 |
66
+ | 0.7878 | 10.0 | 4570 | 0.0863 | 0.2019 |
67
+ | 0.7881 | 11.0 | 5027 | 0.0854 | 0.1983 |
68
+ | 0.7512 | 12.0 | 5484 | 0.0853 | 0.2053 |
69
+ | 0.7167 | 13.0 | 5941 | 0.0853 | 0.2054 |
70
+ | 0.683 | 14.0 | 6398 | 0.0850 | 0.1995 |
71
+ | 0.6468 | 15.0 | 6855 | 0.0851 | 0.1986 |
72
 
73
 
74
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ae7606038ed41d9f54150c607563af1e0b7e37ba6fa4835806cd1c8dcccc654
3
  size 223144592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d7b4badba29f69c647fcd5fe48898b278b29767819baeaa9525e7d13d1f30bb
3
  size 223144592
runs/Jun02_04-35-50_581b6451c54e/events.out.tfevents.1748865288.581b6451c54e.19.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:586a46cf0100799652d64cbf303b065e3af53ed2c9deadc6705857d1f9daa9df
3
+ size 406