amenIKh commited on
Commit
a1df0c2
·
verified ·
1 Parent(s): 6306356

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +54 -45
README.md CHANGED
@@ -1,6 +1,29 @@
1
  ---
2
- library_name: transformers
3
- tags: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  ---
5
 
6
  # Model Card for Model ID
@@ -9,21 +32,29 @@ tags: []
9
 
10
 
11
 
 
 
12
  ## Model Details
13
 
14
  ### Model Description
15
 
16
  <!-- Provide a longer summary of what this model is. -->
17
 
18
- This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
 
 
 
 
 
 
19
 
20
- - **Developed by:** [More Information Needed]
21
  - **Funded by [optional]:** [More Information Needed]
22
  - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
  - **Language(s) (NLP):** [More Information Needed]
25
  - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
 
28
  ### Model Sources [optional]
29
 
@@ -33,45 +64,6 @@ This is the model card of a 🤗 transformers model that has been pushed on the
33
  - **Paper [optional]:** [More Information Needed]
34
  - **Demo [optional]:** [More Information Needed]
35
 
36
- ## Uses
37
-
38
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
-
40
- ### Direct Use
41
-
42
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
-
44
- [More Information Needed]
45
-
46
- ### Downstream Use [optional]
47
-
48
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
-
50
- [More Information Needed]
51
-
52
- ### Out-of-Scope Use
53
-
54
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
-
56
- [More Information Needed]
57
-
58
- ## Bias, Risks, and Limitations
59
-
60
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
-
62
- [More Information Needed]
63
-
64
- ### Recommendations
65
-
66
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
-
68
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
-
70
- ## How to Get Started with the Model
71
-
72
- Use the code below to get started with the model.
73
-
74
- [More Information Needed]
75
 
76
  ## Training Details
77
 
@@ -92,6 +84,23 @@ Use the code below to get started with the model.
92
 
93
  #### Training Hyperparameters
94
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
95
  - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
 
97
  #### Speeds, Sizes, Times [optional]
 
1
  ---
2
+ language:
3
+ - ar
4
+ license: apache-2.0
5
+ base_model: openai/whisper-small
6
+ tags:
7
+ - generated_from_trainer
8
+ metrics:
9
+ - wer
10
+ model-index:
11
+ - name: Tunisian Checkpoint1.5
12
+ results:
13
+ - task:
14
+ name: Automatic Speech Recognition
15
+ type: automatic-speech-recognition
16
+ dataset:
17
+ name: custom_tunisian_dataset
18
+ type: dataset
19
+ args: 'config: ar, split: test'
20
+ metrics:
21
+ - name: Wer
22
+ type: wer
23
+ value: 51.80948419301165
24
+ - name: Cer
25
+ type: cer
26
+ value: 25.522807875749052
27
  ---
28
 
29
  # Model Card for Model ID
 
32
 
33
 
34
 
35
+ ### Finetuning Whisper on Tunisian custom dataset
36
+
37
  ## Model Details
38
 
39
  ### Model Description
40
 
41
  <!-- Provide a longer summary of what this model is. -->
42
 
43
+ This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the tunisian_custom dataset (2h and 30mn).
44
+ It achieves the following results on the evaluation set:
45
+ - Train Loss: 0.0029
46
+ - Evaluation Loss: 1.1970311403274536
47
+ - Wer: 51.80948419301165
48
+ - Cer: 25.522807875749052
49
+
50
 
51
+ - **Developed by:** [Ameni Khabthani]
52
  - **Funded by [optional]:** [More Information Needed]
53
  - **Shared by [optional]:** [More Information Needed]
54
+ - **Model type:** [ASR system]
55
  - **Language(s) (NLP):** [More Information Needed]
56
  - **License:** [More Information Needed]
57
+ - **Finetuned from model [optional]:** [whisper small]
58
 
59
  ### Model Sources [optional]
60
 
 
64
  - **Paper [optional]:** [More Information Needed]
65
  - **Demo [optional]:** [More Information Needed]
66
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
67
 
68
  ## Training Details
69
 
 
84
 
85
  #### Training Hyperparameters
86
 
87
+ per_device_train_batch_size=8
88
+ gradient_accumulation_steps=8
89
+ learning_rate= 5e-5
90
+ warmup_steps=100
91
+ max_steps=3000
92
+ gradient_checkpointing=True
93
+ fp16=True
94
+ save_steps=500
95
+ eval_steps=500
96
+ per_device_eval_batch_size=8
97
+ predict_with_generate=True
98
+ generation_max_length=225
99
+ logging_steps=50,
100
+ optim="adamw_bnb_8bit"
101
+ weight_decay=0.01
102
+ dropout=0.1
103
+
104
  - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
105
 
106
  #### Speeds, Sizes, Times [optional]