gglabs/stt-turbo-multilingual-v0.0.11

README.md

@@ -20,8 +20,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [openai/whisper-large-v3-turbo](https://huggingface.co/openai/whisper-large-v3-turbo) on the custom_multilingual dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3434
-- Wer: 25.3086
+- Loss: 0.3860
+- Wer: 15.9354
 
 ## Model description
 
@@ -40,22 +40,32 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.001
-- train_batch_size: 4
-- eval_batch_size: 4
+- learning_rate: 0.0005
+- train_batch_size: 16
+- eval_batch_size: 32
 - seed: 42
+- gradient_accumulation_steps: 4
+- total_train_batch_size: 64
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 5
-- training_steps: 20
+- lr_scheduler_warmup_steps: 200
+- training_steps: 5000
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch  | Step | Validation Loss | Wer     |
-|:-------------:|:------:|:----:|:---------------:|:-------:|
-| 0.6956        | 0.1754 | 10   | 0.4175          | 32.7160 |
-| 0.2372        | 0.3509 | 20   | 0.3434          | 25.3086 |
+| Training Loss | Epoch   | Step | Validation Loss | Wer     |
+|:-------------:|:-------:|:----:|:---------------:|:-------:|
+| 0.3244        | 1.0971  | 500  | 0.3557          | 19.6171 |
+| 0.2701        | 2.1942  | 1000 | 0.3490          | 19.5934 |
+| 0.224         | 3.2913  | 1500 | 0.3503          | 17.5891 |
+| 0.2132        | 4.3884  | 2000 | 0.3518          | 16.9210 |
+| 0.1865        | 5.4855  | 2500 | 0.3571          | 16.2908 |
+| 0.1661        | 6.5826  | 3000 | 0.3652          | 16.0491 |
+| 0.1467        | 7.6796  | 3500 | 0.3692          | 16.4471 |
+| 0.136         | 8.7767  | 4000 | 0.3762          | 15.9496 |
+| 0.1229        | 9.8738  | 4500 | 0.3816          | 15.8453 |
+| 0.1146        | 10.9709 | 5000 | 0.3860          | 15.9354 |
 
 
 ### Framework versions

adapter_config.json

@@ -27,10 +27,10 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "q_proj",
     "k_proj",
-    "o_proj",
     "v_proj",
-    "q_proj"
+    "o_proj"
   ],
   "task_type": null,
   "trainable_token_indices": null,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:971a4d40e4d95434ebd6f9e529900ad792e01b38087b048a3409ec29a9346cc5
+oid sha256:1ea6247b8e16801be0648d2b73027fcf6408ab2ea750ce6d71f4920d972aae13
 size 78677456

runs/May25_10-55-44_ubuntu/events.out.tfevents.1748138145.ubuntu.39935.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f94efcb27f324102daaf768180810716fca81843af86e0506315f79d0a13f1b0
+size 20470

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fa2b858f2bc182b363340b7fddf20b754d0214ce318bc75b398bf4a899c34c46
+oid sha256:a95a43474a228ffdff8870d11d6af2f6d2aa8fe281c83c3850492a6b5eb71798
 size 5496