End of training

README.md

@@ -0,0 +1,80 @@
+---
+base_model: openai/whisper-tiny
+datasets:
+- mozilla-foundation/common_voice_11_0
+language:
+- hi
+library_name: peft
+license: apache-2.0
+metrics:
+- wer
+tags:
+- generated_from_trainer
+model-index:
+- name: Whisper Small Hi - Sanchit Gandhi
+  results:
+  - task:
+      type: automatic-speech-recognition
+      name: Automatic Speech Recognition
+    dataset:
+      name: Common Voice 11.0
+      type: mozilla-foundation/common_voice_11_0
+      args: 'config: hi, split: test'
+    metrics:
+    - type: wer
+      value: 0.0
+      name: Wer
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# Whisper Small Hi - Sanchit Gandhi
+
+This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the Common Voice 11.0 dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.3128
+- Wer: 0.0
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.001
+- train_batch_size: 3
+- eval_batch_size: 1
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Wer |
+|:-------------:|:-----:|:----:|:---------------:|:---:|
+| 2.9571        | 1.0   | 2    | 1.9745          | 0.0 |
+| 1.7382        | 2.0   | 4    | 1.5435          | 0.0 |
+| 1.4451        | 3.0   | 6    | 1.3128          | 0.0 |
+
+
+### Framework versions
+
+- PEFT 0.12.0
+- Transformers 4.44.0.dev0
+- Pytorch 2.3.1+cu121
+- Datasets 2.20.0
+- Tokenizers 0.19.1

adapter_config.json

@@ -0,0 +1,32 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": {
+    "base_model_class": "WhisperForConditionalGeneration",
+    "parent_library": "transformers.models.whisper.modeling_whisper"
+  },
+  "base_model_name_or_path": "openai/whisper-tiny",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 32,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "task_type": null,
+  "use_dora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:407b2ede2214f1bb02a5da1a4ef96d74be307e0d8e5aa11807e84517ab3ede24
+size 2366008

preprocessor_config.json

@@ -0,0 +1,14 @@
+{
+  "chunk_length": 30,
+  "feature_extractor_type": "WhisperFeatureExtractor",
+  "feature_size": 80,
+  "hop_length": 160,
+  "n_fft": 400,
+  "n_samples": 480000,
+  "nb_max_frames": 3000,
+  "padding_side": "right",
+  "padding_value": 0.0,
+  "processor_class": "WhisperProcessor",
+  "return_attention_mask": false,
+  "sampling_rate": 16000
+}

runs/Jul25_11-29-02_b215e89e2350/events.out.tfevents.1721906965.b215e89e2350.818.11

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aebb96fb6e657896d76488a8d50b9746e8a8606541757917b6c8ea7e8f6caac5
+size 5704

runs/Jul25_11-30-56_b215e89e2350/events.out.tfevents.1721907058.b215e89e2350.818.12

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc047638e147ffd84256dda2290030b4e05ebab40146b795352c9cbedb73d29f
+size 5704

runs/Jul25_11-35-03_b215e89e2350/events.out.tfevents.1721907303.b215e89e2350.818.13

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2b8dc1e738fd3473c5c0e81ff2d664d4360c689f6ab5ec8778999ebecbaac3b
+size 4184

runs/Jul25_11-42-06_b215e89e2350/events.out.tfevents.1721907759.b215e89e2350.40919.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c48f7aee28c0185aa4b600319d2302a7d3590576ffb37291a64d41ec8812f1d
+size 5709

runs/Jul25_11-46-03_b215e89e2350/events.out.tfevents.1721907970.b215e89e2350.40919.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:022dbb6586b5860835fa083be6eb78fba412d852e9382d9cbfacafb316987ab8
+size 5709

runs/Jul25_11-49-02_b215e89e2350/events.out.tfevents.1721908157.b215e89e2350.40919.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:119778c8ddfb184b080de6d5d8715a9614ec0f3bbe787c2c6e3b47b6915b87fa
+size 5708

runs/Jul25_11-49-31_b215e89e2350/events.out.tfevents.1721908178.b215e89e2350.40919.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d2aa07e0f4caa3f0c30f4f87856e3c2f332cdafed699cab5ae9811d906664b4a
+size 6121

runs/Jul25_11-50-40_b215e89e2350/events.out.tfevents.1721908248.b215e89e2350.40919.4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7162d54f11e186608c521df3db2bce38e528f8a43188ebe3d8b057f7c22ec969
+size 7158

runs/Jul25_11-54-03_b215e89e2350/events.out.tfevents.1721908451.b215e89e2350.40919.5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6328aad3a08d5a84e5a5182769c0bc1919599d292a1edd9f3a64a65c078e541
+size 8232

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6dcf389ab9a9e5f3bf5097699cbc9670e0d6fbfe18b388957c490d6a679e31d
+size 5304