opria123 commited on
Commit
88b9d04
·
verified ·
1 Parent(s): d4d2ebb

End of training

Browse files
README.md ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: openai/whisper-tiny
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - PolyAI/minds14
9
+ metrics:
10
+ - wer
11
+ model-index:
12
+ - name: opria123/whisper-tiny-minds14-finetuned
13
+ results:
14
+ - task:
15
+ name: Automatic Speech Recognition
16
+ type: automatic-speech-recognition
17
+ dataset:
18
+ name: PolyAI/minds14
19
+ type: PolyAI/minds14
20
+ config: en-US
21
+ split: train
22
+ args: en-US
23
+ metrics:
24
+ - name: Wer
25
+ type: wer
26
+ value: 0.33436150524367675
27
+ ---
28
+
29
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
+ should probably proofread and complete it, then remove this comment. -->
31
+
32
+ # opria123/whisper-tiny-minds14-finetuned
33
+
34
+ This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the PolyAI/minds14 dataset.
35
+ It achieves the following results on the evaluation set:
36
+ - Loss: 0.8674
37
+ - Wer: 0.3344
38
+ - Wer Ortho: 0.3270
39
+
40
+ ## Model description
41
+
42
+ More information needed
43
+
44
+ ## Intended uses & limitations
45
+
46
+ More information needed
47
+
48
+ ## Training and evaluation data
49
+
50
+ More information needed
51
+
52
+ ## Training procedure
53
+
54
+ ### Training hyperparameters
55
+
56
+ The following hyperparameters were used during training:
57
+ - learning_rate: 1e-05
58
+ - train_batch_size: 8
59
+ - eval_batch_size: 8
60
+ - seed: 42
61
+ - gradient_accumulation_steps: 2
62
+ - total_train_batch_size: 16
63
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
64
+ - lr_scheduler_type: linear
65
+ - lr_scheduler_warmup_steps: 500
66
+ - training_steps: 4000
67
+ - mixed_precision_training: Native AMP
68
+
69
+ ### Training results
70
+
71
+ | Training Loss | Epoch | Step | Validation Loss | Wer | Wer Ortho |
72
+ |:-------------:|:--------:|:----:|:---------------:|:------:|:---------:|
73
+ | 0.0005 | 34.4912 | 1000 | 0.7591 | 0.3368 | 0.3245 |
74
+ | 0.0001 | 68.9825 | 2000 | 0.8217 | 0.3307 | 0.3202 |
75
+ | 0.0001 | 103.4561 | 3000 | 0.8547 | 0.3325 | 0.3239 |
76
+ | 0.0001 | 137.9474 | 4000 | 0.8674 | 0.3344 | 0.3270 |
77
+
78
+
79
+ ### Framework versions
80
+
81
+ - Transformers 4.51.3
82
+ - Pytorch 2.7.0+cu126
83
+ - Datasets 3.5.1
84
+ - Tokenizers 0.21.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:604fe723954293b25269c20e3058c1f70329725a87c2201cf77e7361e6fd7896
3
  size 151061672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ca65852b2aed140b876478f073a60a1ccf4106fe6c10175f16cfa4d85f84307
3
  size 151061672
runs/Apr29_01-57-24_2595a75fa395/events.out.tfevents.1745891846.2595a75fa395.550.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b72264e5e2d90ba99fb9216d5d5934197c3b3c83b5dce576b7d3ddd7872028e2
3
- size 40996
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65fec50ce865e537e50a2d1aae996245c4b80e01362059f84904f6e986831935
3
+ size 41350