Hugging Face's logo

Baselhany
/
Distilation_Whisper_base_CKP_256

Automatic Speech Recognition
Transformers
TensorBoard
Safetensors
Arabic
whisper
Generated from Trainer
Model card Files
xet
 Metrics Community
Baselhany commited on
Commit
26c98fb
·
verified ·
1 Parent(s): 27cd0ef

Model save

Browse files
Files changed (3) hide show
  1. README.md +29 -21
  2. model.safetensors +1 -1
  3. runs/Jun09_16-01-21_71c0a30dd336/events.out.tfevents.1749522427.71c0a30dd336.19.1 +3 -0
README.md CHANGED
@@ -1,27 +1,25 @@
1
  ---
2
  library_name: transformers
3
- language:
4
- - ar
5
  license: apache-2.0
6
- base_model: openai/whisper-base
7
  tags:
8
  - generated_from_trainer
9
  metrics:
10
  - wer
11
  model-index:
12
- - name: Whisper base AR - BA
13
  results: []
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
- # Whisper base AR - BA
20
 
21
- This model is a fine-tuned version of [openai/whisper-base](https://huggingface.co/openai/whisper-base) on the quran-ayat-speech-to-text dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.0963
24
- - Wer: 0.2053
25
 
26
  ## Model description
27
 
@@ -49,23 +47,33 @@ The following hyperparameters were used during training:
49
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
  - lr_scheduler_type: linear
51
  - lr_scheduler_warmup_steps: 500
52
- - num_epochs: 6
53
  - mixed_precision_training: Native AMP
54
 
55
  ### Training results
56
 
57
- | Training Loss | Epoch | Step | Validation Loss | Wer |
58
- |:-------------:|:------:|:-----:|:---------------:|:------:|
59
- | 3.2982 | 0.5928 | 1000 | 0.1013 | 0.2140 |
60
- | 2.442 | 1.1855 | 2000 | 0.1004 | 0.2026 |
61
- | 2.4875 | 1.7783 | 3000 | 0.0967 | 0.1972 |
62
- | 1.7274 | 2.3711 | 4000 | 0.0925 | 0.1963 |
63
- | 1.8653 | 2.9638 | 5000 | 0.0941 | 0.2039 |
64
- | 1.5181 | 3.5566 | 6000 | 0.0921 | 0.2011 |
65
- | 1.4064 | 4.1494 | 7000 | 0.0911 | 0.2023 |
66
- | 1.3914 | 4.7421 | 8000 | 0.0905 | 0.1998 |
67
- | 1.2463 | 5.3349 | 9000 | 0.0891 | 0.2022 |
68
- | 1.2122 | 5.9277 | 10000 | 0.0896 | 0.2093 |
 
 
 
 
 
 
 
 
 
 
69
 
70
 
71
  ### Framework versions
 
1
  ---
2
  library_name: transformers
 
 
3
  license: apache-2.0
4
+ base_model: Baselhany/Distilation_Whisper_base_CKP_256
5
  tags:
6
  - generated_from_trainer
7
  metrics:
8
  - wer
9
  model-index:
10
+ - name: Distilation_Whisper_base_CKP_256
11
  results: []
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
17
+ # Distilation_Whisper_base_CKP_256
18
 
19
+ This model is a fine-tuned version of [Baselhany/Distilation_Whisper_base_CKP_256](https://huggingface.co/Baselhany/Distilation_Whisper_base_CKP_256) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.0937
22
+ - Wer: 0.2022
23
 
24
  ## Model description
25
 
 
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_steps: 500
50
+ - num_epochs: 12
51
  - mixed_precision_training: Native AMP
52
 
53
  ### Training results
54
 
55
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
56
+ |:-------------:|:-------:|:-----:|:---------------:|:------:|
57
+ | 3.2982 | 0.5928 | 1000 | 0.1013 | 0.2140 |
58
+ | 2.442 | 1.1855 | 2000 | 0.1004 | 0.2026 |
59
+ | 2.4875 | 1.7783 | 3000 | 0.0967 | 0.1972 |
60
+ | 1.7274 | 2.3711 | 4000 | 0.0925 | 0.1963 |
61
+ | 1.8653 | 2.9638 | 5000 | 0.0941 | 0.2039 |
62
+ | 1.5181 | 3.5566 | 6000 | 0.0921 | 0.2011 |
63
+ | 1.4064 | 4.1494 | 7000 | 0.0911 | 0.2023 |
64
+ | 1.3914 | 4.7421 | 8000 | 0.0905 | 0.1998 |
65
+ | 1.2463 | 5.3349 | 9000 | 0.0891 | 0.2022 |
66
+ | 1.2122 | 5.9277 | 10000 | 0.0896 | 0.2093 |
67
+ | 1.4104 | 6.5205 | 11000 | 0.0912 | 0.2007 |
68
+ | 1.2912 | 7.1132 | 12000 | 0.0902 | 0.1958 |
69
+ | 1.2074 | 7.7060 | 13000 | 0.0907 | 0.1988 |
70
+ | 1.1992 | 8.2988 | 14000 | 0.0895 | 0.2016 |
71
+ | 1.0971 | 8.8915 | 15000 | 0.0902 | 0.2028 |
72
+ | 1.1248 | 9.4843 | 16000 | 0.0897 | 0.2019 |
73
+ | 0.9882 | 10.0771 | 17000 | 0.0885 | 0.1967 |
74
+ | 1.0489 | 10.6698 | 18000 | 0.0881 | 0.2009 |
75
+ | 0.9598 | 11.2626 | 19000 | 0.0881 | 0.2026 |
76
+ | 1.059 | 11.8554 | 20000 | 0.0881 | 0.1995 |
77
 
78
 
79
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f4612f66291eeeaa3639de9ff081bcc44d3bacc4dde38cc4d6a5c9fd0380eddb
3
  size 223144592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35fc0381d56f274c1a1f554f12a90d83a1d380fb08bc5a9595ae2c4c2915bb38
3
  size 223144592
runs/Jun09_16-01-21_71c0a30dd336/events.out.tfevents.1749522427.71c0a30dd336.19.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1164ad3c04be073a739c8e64240ca308c4590341cdbfe9dc1d732c81be453cc7
3
+ size 412