MartinRedWhite commited on
Commit
64924e7
·
verified ·
1 Parent(s): 8eb64ac

End of training

Browse files
README.md CHANGED
@@ -23,7 +23,7 @@ model-index:
23
  metrics:
24
  - name: Wer
25
  type: wer
26
- value: 33.293978748524204
27
  ---
28
 
29
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -33,9 +33,9 @@ should probably proofread and complete it, then remove this comment. -->
33
 
34
  This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the PolyAI/minds14 dataset.
35
  It achieves the following results on the evaluation set:
36
- - Loss: 0.7876
37
- - Wer Ortho: 33.1277
38
- - Wer: 33.2940
39
 
40
  ## Model description
41
 
@@ -58,25 +58,31 @@ The following hyperparameters were used during training:
58
  - train_batch_size: 16
59
  - eval_batch_size: 16
60
  - seed: 42
61
- - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
62
  - lr_scheduler_type: constant_with_warmup
63
  - lr_scheduler_warmup_steps: 50
64
- - training_steps: 2000
65
  - mixed_precision_training: Native AMP
66
 
67
  ### Training results
68
 
69
- | Training Loss | Epoch | Step | Validation Loss | Wer Ortho | Wer |
70
- |:-------------:|:-------:|:----:|:---------------:|:---------:|:-------:|
71
- | 0.0006 | 17.8571 | 500 | 0.6634 | 32.8809 | 32.9988 |
72
- | 0.0002 | 35.7143 | 1000 | 0.7228 | 32.5725 | 32.7627 |
73
- | 0.0001 | 53.5714 | 1500 | 0.7594 | 32.2023 | 32.3495 |
74
- | 0.0001 | 71.4286 | 2000 | 0.7876 | 33.1277 | 33.2940 |
 
 
 
 
 
 
75
 
76
 
77
  ### Framework versions
78
 
79
- - Transformers 4.49.0
80
- - Pytorch 2.6.0+cu124
81
  - Datasets 2.15.0
82
- - Tokenizers 0.21.1
 
23
  metrics:
24
  - name: Wer
25
  type: wer
26
+ value: 0.34061393152302244
27
  ---
28
 
29
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
33
 
34
  This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the PolyAI/minds14 dataset.
35
  It achieves the following results on the evaluation set:
36
+ - Loss: 0.9112
37
+ - Wer Ortho: 0.3374
38
+ - Wer: 0.3406
39
 
40
  ## Model description
41
 
 
58
  - train_batch_size: 16
59
  - eval_batch_size: 16
60
  - seed: 42
61
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
62
  - lr_scheduler_type: constant_with_warmup
63
  - lr_scheduler_warmup_steps: 50
64
+ - training_steps: 5000
65
  - mixed_precision_training: Native AMP
66
 
67
  ### Training results
68
 
69
+ | Training Loss | Epoch | Step | Validation Loss | Wer Ortho | Wer |
70
+ |:-------------:|:--------:|:----:|:---------------:|:---------:|:------:|
71
+ | 0.0006 | 17.8571 | 500 | 0.6628 | 0.3239 | 0.3247 |
72
+ | 0.0002 | 35.7143 | 1000 | 0.7220 | 0.3263 | 0.3276 |
73
+ | 0.0001 | 53.5714 | 1500 | 0.7574 | 0.3226 | 0.3241 |
74
+ | 0.0001 | 71.4286 | 2000 | 0.7868 | 0.3300 | 0.3312 |
75
+ | 0.0 | 89.2857 | 2500 | 0.8103 | 0.3319 | 0.3329 |
76
+ | 0.0 | 107.1429 | 3000 | 0.8325 | 0.3331 | 0.3353 |
77
+ | 0.0 | 125.0 | 3500 | 0.8530 | 0.3356 | 0.3383 |
78
+ | 0.0 | 142.8571 | 4000 | 0.8730 | 0.3337 | 0.3371 |
79
+ | 0.0 | 160.7143 | 4500 | 0.8927 | 0.3344 | 0.3371 |
80
+ | 0.0 | 178.5714 | 5000 | 0.9112 | 0.3374 | 0.3406 |
81
 
82
 
83
  ### Framework versions
84
 
85
+ - Transformers 4.47.0
86
+ - Pytorch 2.5.1+cu121
87
  - Datasets 2.15.0
88
+ - Tokenizers 0.21.0
config.json CHANGED
@@ -54,7 +54,7 @@
54
  "pad_token_id": 50257,
55
  "scale_embedding": false,
56
  "torch_dtype": "float32",
57
- "transformers_version": "4.49.0",
58
  "use_cache": false,
59
  "use_weighted_layer_sum": false,
60
  "vocab_size": 51865
 
54
  "pad_token_id": 50257,
55
  "scale_embedding": false,
56
  "torch_dtype": "float32",
57
+ "transformers_version": "4.47.0",
58
  "use_cache": false,
59
  "use_weighted_layer_sum": false,
60
  "vocab_size": 51865
generation_config.json CHANGED
@@ -244,5 +244,5 @@
244
  "transcribe": 50359,
245
  "translate": 50358
246
  },
247
- "transformers_version": "4.49.0"
248
  }
 
244
  "transcribe": 50359,
245
  "translate": 50358
246
  },
247
+ "transformers_version": "4.47.0"
248
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ca618562e54bf4de6bdf24a5cc09b08625b96a806c6be5a63e7b310e1ad4459
3
  size 151061672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe5bfe70a768907d4df924474831876b7e64e543d27010d6416d7264a960d901
3
  size 151061672
runs/Mar23_15-16-25_e8336f4a552a/events.out.tfevents.1742742988.e8336f4a552a.31.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a109fdc01c58d58a9ed993c78d3b7351647f4cfec71ae940d21f255297ce80da
3
+ size 53103
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f50c17ec73d40494cc7946eac0b0724fab53d0a73e3bdccfb8d05841f499f6aa
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf14e810b158955102a7e2fda73bc00d9f0cf3c39345450e9e4d3ca0ab6ffabb
3
  size 5496