End of training

README.md

@@ -8,9 +8,24 @@ tags:
 - generated_from_trainer
 datasets:
 - mozilla-foundation/common_voice_11_0
+metrics:
+- wer
 model-index:
 - name: Whisper Small Hi - Sanchit Gandhi
-  results: []
+  results:
+  - task:
+      name: Automatic Speech Recognition
+      type: automatic-speech-recognition
+    dataset:
+      name: Common Voice 11.0
+      type: mozilla-foundation/common_voice_11_0
+      config: hi
+      split: None
+      args: 'config: hi, split: test'
+    metrics:
+    - name: Wer
+      type: wer
+      value: 32.984847202234825
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -19,6 +34,9 @@ should probably proofread and complete it, then remove this comment. -->
 # Whisper Small Hi - Sanchit Gandhi
 
 This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the Common Voice 11.0 dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4377
+- Wer: 32.9848
 
 ## Model description
 
@@ -39,7 +57,7 @@ More information needed
 The following hyperparameters were used during training:
 - learning_rate: 1e-05
 - train_batch_size: 16
-- eval_batch_size: 8
+- eval_batch_size: 32
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -47,6 +65,21 @@ The following hyperparameters were used during training:
 - training_steps: 4000
 - mixed_precision_training: Native AMP
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Wer     |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|
+| No log        | 0.0   | 1    | 2.2652          | 86.7857 |
+| 0.1858        | 1.22  | 500  | 0.3301          | 39.7317 |
+| 0.0881        | 2.44  | 1000 | 0.2966          | 34.9065 |
+| 0.0457        | 3.67  | 1500 | 0.3160          | 33.8695 |
+| 0.0195        | 4.89  | 2000 | 0.3571          | 33.9287 |
+| 0.0047        | 6.11  | 2500 | 0.3913          | 33.4843 |
+| 0.0014        | 7.33  | 3000 | 0.4186          | 32.9637 |
+| 0.0005        | 8.56  | 3500 | 0.4286          | 33.0737 |
+| 0.0005        | 9.78  | 4000 | 0.4377          | 32.9848 |
+
+
 ### Framework versions
 
 - Transformers 4.40.0.dev0

generation_config.json

@@ -160,6 +160,7 @@
     "<|yo|>": 50325,
     "<|zh|>": 50260
   },
+  "language": "hi",
   "max_initial_timestamp_index": 50,
   "max_length": 448,
   "no_timestamps_token_id": 50363,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0d4ca1263512e2daffab031eefa5b4df4b6ba57c9e6faceca76182e58055e9e1
+oid sha256:cbc45000948638da4096e1e4853ddb446272e4c2d573ff3a46c7041bbfd46e14
 size 966995080

runs/Mar20_19-13-54_2b76929eb25a/events.out.tfevents.1710962048.2b76929eb25a.12451.1

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fe71920ff383a2bcb26f3d0e90503435a110e6e6214a4d12e3d37f3e886a6792
-size 42031
+oid sha256:0bf47c22dac6a94b906585398f08760c26a6daa3576e52bf593555a7c670d571
+size 42385