MathildeB3 commited on
Commit
c8b94ce
·
verified ·
1 Parent(s): 624af60

End of training

Browse files
Files changed (2) hide show
  1. README.md +84 -0
  2. adapter_model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: peft
3
+ language:
4
+ - fr
5
+ license: apache-2.0
6
+ base_model: openai/whisper-small
7
+ tags:
8
+ - base_model:adapter:openai/whisper-small
9
+ - lora
10
+ - transformers
11
+ metrics:
12
+ - wer
13
+ model-index:
14
+ - name: 52Hz Small Fr - IMT Atlantique X 52 Hertz
15
+ results: []
16
+ ---
17
+
18
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
19
+ should probably proofread and complete it, then remove this comment. -->
20
+
21
+ # 52Hz Small Fr - IMT Atlantique X 52 Hertz
22
+
23
+ This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the Premier dataset organisé de 52 Hertz dataset.
24
+ It achieves the following results on the evaluation set:
25
+ - Loss: 0.5418
26
+ - Wer: 44.3978
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 0.0001
46
+ - train_batch_size: 8
47
+ - eval_batch_size: 8
48
+ - seed: 42
49
+ - gradient_accumulation_steps: 2
50
+ - total_train_batch_size: 16
51
+ - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
+ - lr_scheduler_type: constant_with_warmup
53
+ - lr_scheduler_warmup_ratio: 0.1
54
+ - num_epochs: 15
55
+ - mixed_precision_training: Native AMP
56
+
57
+ ### Training results
58
+
59
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
60
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
61
+ | 1.4744 | 1.0 | 23 | 1.4905 | 103.3613 |
62
+ | 1.2047 | 2.0 | 46 | 1.1278 | 61.3445 |
63
+ | 0.8717 | 3.0 | 69 | 0.8429 | 54.2017 |
64
+ | 0.5948 | 4.0 | 92 | 0.6974 | 50.2801 |
65
+ | 0.4514 | 5.0 | 115 | 0.6192 | 50.0 |
66
+ | 0.3894 | 6.0 | 138 | 0.5874 | 48.8796 |
67
+ | 0.3317 | 7.0 | 161 | 0.5678 | 47.6190 |
68
+ | 0.2881 | 8.0 | 184 | 0.5390 | 49.8599 |
69
+ | 0.2545 | 9.0 | 207 | 0.5351 | 45.7983 |
70
+ | 0.2414 | 10.0 | 230 | 0.5308 | 46.6387 |
71
+ | 0.1757 | 11.0 | 253 | 0.5375 | 46.0784 |
72
+ | 0.173 | 12.0 | 276 | 0.5290 | 45.3782 |
73
+ | 0.1261 | 13.0 | 299 | 0.5295 | 43.6975 |
74
+ | 0.1224 | 14.0 | 322 | 0.5263 | 45.3782 |
75
+ | 0.0956 | 15.0 | 345 | 0.5418 | 44.3978 |
76
+
77
+
78
+ ### Framework versions
79
+
80
+ - PEFT 0.18.1
81
+ - Transformers 4.57.3
82
+ - Pytorch 2.9.1+cu130
83
+ - Datasets 4.4.2
84
+ - Tokenizers 0.22.2
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:87b0e5cc46172ffd6e08486102bb6a960a39683cb196a65b912b9bec72eaf6f9
3
  size 7098064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6240ade302c93fd00747d93eccb849221e434b6cbdf9bc8a8c2463b606a6c132
3
  size 7098064