Model save
Browse files
README.md
CHANGED
|
@@ -1,27 +1,25 @@
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
-
language:
|
| 4 |
-
- ar
|
| 5 |
license: apache-2.0
|
| 6 |
-
base_model:
|
| 7 |
tags:
|
| 8 |
- generated_from_trainer
|
| 9 |
metrics:
|
| 10 |
- wer
|
| 11 |
model-index:
|
| 12 |
-
- name:
|
| 13 |
results: []
|
| 14 |
---
|
| 15 |
|
| 16 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 17 |
should probably proofread and complete it, then remove this comment. -->
|
| 18 |
|
| 19 |
-
#
|
| 20 |
|
| 21 |
-
This model is a fine-tuned version of [
|
| 22 |
It achieves the following results on the evaluation set:
|
| 23 |
-
- Loss: 0.
|
| 24 |
-
- Wer: 0.
|
| 25 |
|
| 26 |
## Model description
|
| 27 |
|
|
@@ -49,7 +47,7 @@ The following hyperparameters were used during training:
|
|
| 49 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 50 |
- lr_scheduler_type: linear
|
| 51 |
- lr_scheduler_warmup_steps: 500
|
| 52 |
-
- num_epochs:
|
| 53 |
- mixed_precision_training: Native AMP
|
| 54 |
|
| 55 |
### Training results
|
|
@@ -115,6 +113,34 @@ The following hyperparameters were used during training:
|
|
| 115 |
| 1.2094 | 16.2466 | 22800 | 0.0941 | 0.2050 |
|
| 116 |
| 1.2505 | 16.5316 | 23200 | 0.0941 | 0.2003 |
|
| 117 |
| 1.1193 | 16.8167 | 23600 | 0.0942 | 0.1991 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 118 |
|
| 119 |
|
| 120 |
### Framework versions
|
|
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
|
|
|
|
|
|
| 3 |
license: apache-2.0
|
| 4 |
+
base_model: Baselhany/Distilation_Whisper_base_CKP2
|
| 5 |
tags:
|
| 6 |
- generated_from_trainer
|
| 7 |
metrics:
|
| 8 |
- wer
|
| 9 |
model-index:
|
| 10 |
+
- name: Distilation_Whisper_base_CKP2
|
| 11 |
results: []
|
| 12 |
---
|
| 13 |
|
| 14 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 15 |
should probably proofread and complete it, then remove this comment. -->
|
| 16 |
|
| 17 |
+
# Distilation_Whisper_base_CKP2
|
| 18 |
|
| 19 |
+
This model is a fine-tuned version of [Baselhany/Distilation_Whisper_base_CKP2](https://huggingface.co/Baselhany/Distilation_Whisper_base_CKP2) on an unknown dataset.
|
| 20 |
It achieves the following results on the evaluation set:
|
| 21 |
+
- Loss: 0.0954
|
| 22 |
+
- Wer: 0.2102
|
| 23 |
|
| 24 |
## Model description
|
| 25 |
|
|
|
|
| 47 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 48 |
- lr_scheduler_type: linear
|
| 49 |
- lr_scheduler_warmup_steps: 500
|
| 50 |
+
- num_epochs: 25
|
| 51 |
- mixed_precision_training: Native AMP
|
| 52 |
|
| 53 |
### Training results
|
|
|
|
| 113 |
| 1.2094 | 16.2466 | 22800 | 0.0941 | 0.2050 |
|
| 114 |
| 1.2505 | 16.5316 | 23200 | 0.0941 | 0.2003 |
|
| 115 |
| 1.1193 | 16.8167 | 23600 | 0.0942 | 0.1991 |
|
| 116 |
+
| 1.1992 | 17.1062 | 24000 | 0.0946 | 0.2020 |
|
| 117 |
+
| 1.2794 | 17.3912 | 24400 | 0.0954 | 0.2118 |
|
| 118 |
+
| 1.2362 | 17.6763 | 24800 | 0.0948 | 0.2025 |
|
| 119 |
+
| 1.3528 | 17.9613 | 25200 | 0.0956 | 0.2070 |
|
| 120 |
+
| 1.1863 | 18.2459 | 25600 | 0.0935 | 0.2037 |
|
| 121 |
+
| 1.2936 | 18.5309 | 26000 | 0.0940 | 0.2032 |
|
| 122 |
+
| 1.2434 | 18.8160 | 26400 | 0.0938 | 0.2029 |
|
| 123 |
+
| 1.1254 | 19.1005 | 26800 | 0.0933 | 0.2026 |
|
| 124 |
+
| 1.2345 | 19.3855 | 27200 | 0.0934 | 0.2009 |
|
| 125 |
+
| 1.2177 | 19.6706 | 27600 | 0.0938 | 0.2037 |
|
| 126 |
+
| 1.1479 | 19.9556 | 28000 | 0.0938 | 0.2007 |
|
| 127 |
+
| 1.1077 | 20.2402 | 28400 | 0.0933 | 0.1995 |
|
| 128 |
+
| 1.1615 | 20.5252 | 28800 | 0.0931 | 0.2025 |
|
| 129 |
+
| 1.0642 | 20.8103 | 29200 | 0.0940 | 0.2045 |
|
| 130 |
+
| 1.0922 | 21.0948 | 29600 | 0.0935 | 0.2011 |
|
| 131 |
+
| 1.0885 | 21.3798 | 30000 | 0.0929 | 0.2010 |
|
| 132 |
+
| 1.107 | 21.6649 | 30400 | 0.0930 | 0.1988 |
|
| 133 |
+
| 1.0449 | 21.9499 | 30800 | 0.0931 | 0.2001 |
|
| 134 |
+
| 1.033 | 22.2345 | 31200 | 0.0931 | 0.2048 |
|
| 135 |
+
| 1.057 | 22.5195 | 31600 | 0.0932 | 0.1988 |
|
| 136 |
+
| 1.0248 | 22.8046 | 32000 | 0.0929 | 0.2019 |
|
| 137 |
+
| 0.9784 | 23.0891 | 32400 | 0.0927 | 0.1951 |
|
| 138 |
+
| 1.0443 | 23.3741 | 32800 | 0.0927 | 0.1995 |
|
| 139 |
+
| 0.9972 | 23.6592 | 33200 | 0.0923 | 0.1995 |
|
| 140 |
+
| 1.0527 | 23.9442 | 33600 | 0.0930 | 0.1964 |
|
| 141 |
+
| 0.9927 | 24.2288 | 34000 | 0.0927 | 0.1979 |
|
| 142 |
+
| 0.9504 | 24.5138 | 34400 | 0.0927 | 0.1960 |
|
| 143 |
+
| 1.0567 | 24.7989 | 34800 | 0.0925 | 0.1986 |
|
| 144 |
|
| 145 |
|
| 146 |
### Framework versions
|
runs/May25_06-45-00_cb29d34e4ecc/events.out.tfevents.1748157451.cb29d34e4ecc.19.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eaa965315360b60a7be72a74625c20cb3054a42d01402fd51f94345216b38fb0
|
| 3 |
+
size 412
|