shikhadiw commited on
Commit
78157f7
·
verified ·
1 Parent(s): a5b9aed

Upload folder using huggingface_hub

Browse files
checkpoint-2500/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/whisper-large-v3
3
+ library_name: peft
4
+ tags:
5
+ - base_model:adapter:unsloth/whisper-large-v3
6
+ - lora
7
+ - transformers
8
+ - unsloth
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.17.1
checkpoint-2500/adapter_config.json ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": {
4
+ "base_model_class": "WhisperForConditionalGeneration",
5
+ "parent_library": "transformers.models.whisper.modeling_whisper"
6
+ },
7
+ "base_model_name_or_path": "unsloth/whisper-large-v3",
8
+ "bias": "none",
9
+ "corda_config": null,
10
+ "eva_config": null,
11
+ "exclude_modules": null,
12
+ "fan_in_fan_out": false,
13
+ "inference_mode": true,
14
+ "init_lora_weights": true,
15
+ "layer_replication": null,
16
+ "layers_pattern": null,
17
+ "layers_to_transform": null,
18
+ "loftq_config": {},
19
+ "lora_alpha": 96,
20
+ "lora_bias": false,
21
+ "lora_dropout": 0.03,
22
+ "megatron_config": null,
23
+ "megatron_core": "megatron.core",
24
+ "modules_to_save": null,
25
+ "peft_type": "LORA",
26
+ "qalora_group_size": 16,
27
+ "r": 64,
28
+ "rank_pattern": {},
29
+ "revision": null,
30
+ "target_modules": [
31
+ "fc2",
32
+ "v_proj",
33
+ "k_proj",
34
+ "out_proj",
35
+ "fc1",
36
+ "q_proj"
37
+ ],
38
+ "target_parameters": null,
39
+ "task_type": null,
40
+ "trainable_token_indices": null,
41
+ "use_dora": false,
42
+ "use_qalora": false,
43
+ "use_rslora": false
44
+ }
checkpoint-2500/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:501eb3d7f9f8b5311e533e02cb9d61628716511864ef95d036648054e454e03c
3
+ size 461518936
checkpoint-2500/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7de45c75114dbb898af678502623f4b74e7281ae72bf5aefd9c066e3ba3512e6
3
+ size 923614691
checkpoint-2500/preprocessor_config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "chunk_length": 30,
3
+ "dither": 0.0,
4
+ "feature_extractor_type": "WhisperFeatureExtractor",
5
+ "feature_size": 128,
6
+ "hop_length": 160,
7
+ "n_fft": 400,
8
+ "n_samples": 480000,
9
+ "nb_max_frames": 3000,
10
+ "padding_side": "right",
11
+ "padding_value": 0.0,
12
+ "processor_class": "WhisperProcessor",
13
+ "return_attention_mask": false,
14
+ "sampling_rate": 16000
15
+ }
checkpoint-2500/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7104350460c05ccddb4e2089ba6f3e04f93ac716a355855e44c838499173fa8
3
+ size 14645
checkpoint-2500/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eeabe13d164dac8d378d855d727cd3376a2cd495027a3f2d372238b9d56b447a
3
+ size 1383
checkpoint-2500/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23d17d87e0a0a3a1c05689c14631ac4d16cf15d1ad2802c69ca29012ebb3f7c8
3
+ size 1465
checkpoint-2500/trainer_state.json ADDED
@@ -0,0 +1,759 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 2500,
3
+ "best_metric": 25.988627552339103,
4
+ "best_model_checkpoint": "./whisper_hindi_improved_20251107_025049/checkpoint-2500",
5
+ "epoch": 4.440888888888889,
6
+ "eval_steps": 2500,
7
+ "global_step": 2500,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.0017777777777777779,
14
+ "grad_norm": 2.3702774047851562,
15
+ "learning_rate": 0.0,
16
+ "loss": 1.709,
17
+ "step": 1
18
+ },
19
+ {
20
+ "epoch": 0.044444444444444446,
21
+ "grad_norm": 1.9324116706848145,
22
+ "learning_rate": 9.600000000000001e-07,
23
+ "loss": 1.6572,
24
+ "step": 25
25
+ },
26
+ {
27
+ "epoch": 0.08888888888888889,
28
+ "grad_norm": 1.2866696119308472,
29
+ "learning_rate": 1.9600000000000003e-06,
30
+ "loss": 1.4396,
31
+ "step": 50
32
+ },
33
+ {
34
+ "epoch": 0.13333333333333333,
35
+ "grad_norm": 1.3138173818588257,
36
+ "learning_rate": 2.96e-06,
37
+ "loss": 1.2875,
38
+ "step": 75
39
+ },
40
+ {
41
+ "epoch": 0.17777777777777778,
42
+ "grad_norm": 1.7148733139038086,
43
+ "learning_rate": 3.96e-06,
44
+ "loss": 1.1774,
45
+ "step": 100
46
+ },
47
+ {
48
+ "epoch": 0.2222222222222222,
49
+ "grad_norm": 1.3908791542053223,
50
+ "learning_rate": 4.960000000000001e-06,
51
+ "loss": 0.9828,
52
+ "step": 125
53
+ },
54
+ {
55
+ "epoch": 0.26666666666666666,
56
+ "grad_norm": 1.2608166933059692,
57
+ "learning_rate": 5.9600000000000005e-06,
58
+ "loss": 0.8516,
59
+ "step": 150
60
+ },
61
+ {
62
+ "epoch": 0.3111111111111111,
63
+ "grad_norm": 1.0959410667419434,
64
+ "learning_rate": 6.96e-06,
65
+ "loss": 0.7003,
66
+ "step": 175
67
+ },
68
+ {
69
+ "epoch": 0.35555555555555557,
70
+ "grad_norm": 0.9897862076759338,
71
+ "learning_rate": 7.960000000000002e-06,
72
+ "loss": 0.5892,
73
+ "step": 200
74
+ },
75
+ {
76
+ "epoch": 0.4,
77
+ "grad_norm": 2.8703014850616455,
78
+ "learning_rate": 8.920000000000001e-06,
79
+ "loss": 0.5283,
80
+ "step": 225
81
+ },
82
+ {
83
+ "epoch": 0.4444444444444444,
84
+ "grad_norm": 1.1597092151641846,
85
+ "learning_rate": 9.88e-06,
86
+ "loss": 0.44,
87
+ "step": 250
88
+ },
89
+ {
90
+ "epoch": 0.4888888888888889,
91
+ "grad_norm": 1.4660991430282593,
92
+ "learning_rate": 1.0880000000000001e-05,
93
+ "loss": 0.3696,
94
+ "step": 275
95
+ },
96
+ {
97
+ "epoch": 0.5333333333333333,
98
+ "grad_norm": 1.0865031480789185,
99
+ "learning_rate": 1.188e-05,
100
+ "loss": 0.3017,
101
+ "step": 300
102
+ },
103
+ {
104
+ "epoch": 0.5777777777777777,
105
+ "grad_norm": 1.193084716796875,
106
+ "learning_rate": 1.2880000000000002e-05,
107
+ "loss": 0.2839,
108
+ "step": 325
109
+ },
110
+ {
111
+ "epoch": 0.6222222222222222,
112
+ "grad_norm": 1.3478896617889404,
113
+ "learning_rate": 1.3880000000000001e-05,
114
+ "loss": 0.27,
115
+ "step": 350
116
+ },
117
+ {
118
+ "epoch": 0.6666666666666666,
119
+ "grad_norm": 0.8208823204040527,
120
+ "learning_rate": 1.4880000000000002e-05,
121
+ "loss": 0.2765,
122
+ "step": 375
123
+ },
124
+ {
125
+ "epoch": 0.7111111111111111,
126
+ "grad_norm": 1.9162499904632568,
127
+ "learning_rate": 1.588e-05,
128
+ "loss": 0.2573,
129
+ "step": 400
130
+ },
131
+ {
132
+ "epoch": 0.7555555555555555,
133
+ "grad_norm": 1.1928578615188599,
134
+ "learning_rate": 1.688e-05,
135
+ "loss": 0.2454,
136
+ "step": 425
137
+ },
138
+ {
139
+ "epoch": 0.8,
140
+ "grad_norm": 0.9198476672172546,
141
+ "learning_rate": 1.788e-05,
142
+ "loss": 0.2584,
143
+ "step": 450
144
+ },
145
+ {
146
+ "epoch": 0.8444444444444444,
147
+ "grad_norm": 1.10727059841156,
148
+ "learning_rate": 1.8880000000000002e-05,
149
+ "loss": 0.2775,
150
+ "step": 475
151
+ },
152
+ {
153
+ "epoch": 0.8888888888888888,
154
+ "grad_norm": 0.9461928606033325,
155
+ "learning_rate": 1.9880000000000003e-05,
156
+ "loss": 0.2326,
157
+ "step": 500
158
+ },
159
+ {
160
+ "epoch": 0.9333333333333333,
161
+ "grad_norm": 1.3022490739822388,
162
+ "learning_rate": 1.9999990252244153e-05,
163
+ "loss": 0.2619,
164
+ "step": 525
165
+ },
166
+ {
167
+ "epoch": 0.9777777777777777,
168
+ "grad_norm": 0.7707226276397705,
169
+ "learning_rate": 1.9999955510784705e-05,
170
+ "loss": 0.2265,
171
+ "step": 550
172
+ },
173
+ {
174
+ "epoch": 1.0213333333333334,
175
+ "grad_norm": 0.9355465173721313,
176
+ "learning_rate": 1.999989559444917e-05,
177
+ "loss": 0.2344,
178
+ "step": 575
179
+ },
180
+ {
181
+ "epoch": 1.0657777777777777,
182
+ "grad_norm": 0.8835461735725403,
183
+ "learning_rate": 1.9999810503388386e-05,
184
+ "loss": 0.2047,
185
+ "step": 600
186
+ },
187
+ {
188
+ "epoch": 1.1102222222222222,
189
+ "grad_norm": 0.9200624823570251,
190
+ "learning_rate": 1.999970023781657e-05,
191
+ "loss": 0.2164,
192
+ "step": 625
193
+ },
194
+ {
195
+ "epoch": 1.1546666666666667,
196
+ "grad_norm": 1.170629620552063,
197
+ "learning_rate": 1.999956479801132e-05,
198
+ "loss": 0.2378,
199
+ "step": 650
200
+ },
201
+ {
202
+ "epoch": 1.199111111111111,
203
+ "grad_norm": 0.9934321641921997,
204
+ "learning_rate": 1.9999404184313595e-05,
205
+ "loss": 0.2198,
206
+ "step": 675
207
+ },
208
+ {
209
+ "epoch": 1.2435555555555555,
210
+ "grad_norm": 1.0553075075149536,
211
+ "learning_rate": 1.999921839712775e-05,
212
+ "loss": 0.2063,
213
+ "step": 700
214
+ },
215
+ {
216
+ "epoch": 1.288,
217
+ "grad_norm": 0.8540263772010803,
218
+ "learning_rate": 1.9999007436921497e-05,
219
+ "loss": 0.1994,
220
+ "step": 725
221
+ },
222
+ {
223
+ "epoch": 1.3324444444444445,
224
+ "grad_norm": 1.1836203336715698,
225
+ "learning_rate": 1.9998771304225933e-05,
226
+ "loss": 0.1885,
227
+ "step": 750
228
+ },
229
+ {
230
+ "epoch": 1.3768888888888888,
231
+ "grad_norm": 1.1124310493469238,
232
+ "learning_rate": 1.999850999963552e-05,
233
+ "loss": 0.2055,
234
+ "step": 775
235
+ },
236
+ {
237
+ "epoch": 1.4213333333333333,
238
+ "grad_norm": 0.9094732999801636,
239
+ "learning_rate": 1.9998223523808092e-05,
240
+ "loss": 0.192,
241
+ "step": 800
242
+ },
243
+ {
244
+ "epoch": 1.4657777777777778,
245
+ "grad_norm": 0.9388139843940735,
246
+ "learning_rate": 1.999791187746485e-05,
247
+ "loss": 0.2103,
248
+ "step": 825
249
+ },
250
+ {
251
+ "epoch": 1.5102222222222221,
252
+ "grad_norm": 0.8892160058021545,
253
+ "learning_rate": 1.9997575061390368e-05,
254
+ "loss": 0.1898,
255
+ "step": 850
256
+ },
257
+ {
258
+ "epoch": 1.5546666666666666,
259
+ "grad_norm": 0.9697235822677612,
260
+ "learning_rate": 1.9997213076432575e-05,
261
+ "loss": 0.1987,
262
+ "step": 875
263
+ },
264
+ {
265
+ "epoch": 1.5991111111111111,
266
+ "grad_norm": 0.886682391166687,
267
+ "learning_rate": 1.9996825923502766e-05,
268
+ "loss": 0.1955,
269
+ "step": 900
270
+ },
271
+ {
272
+ "epoch": 1.6435555555555554,
273
+ "grad_norm": 0.8804945945739746,
274
+ "learning_rate": 1.9996413603575603e-05,
275
+ "loss": 0.1842,
276
+ "step": 925
277
+ },
278
+ {
279
+ "epoch": 1.688,
280
+ "grad_norm": 0.9214787483215332,
281
+ "learning_rate": 1.9995976117689103e-05,
282
+ "loss": 0.1854,
283
+ "step": 950
284
+ },
285
+ {
286
+ "epoch": 1.7324444444444445,
287
+ "grad_norm": 0.7763159275054932,
288
+ "learning_rate": 1.999551346694463e-05,
289
+ "loss": 0.1868,
290
+ "step": 975
291
+ },
292
+ {
293
+ "epoch": 1.7768888888888887,
294
+ "grad_norm": 0.8259502053260803,
295
+ "learning_rate": 1.999502565250691e-05,
296
+ "loss": 0.1915,
297
+ "step": 1000
298
+ },
299
+ {
300
+ "epoch": 1.8213333333333335,
301
+ "grad_norm": 1.0171443223953247,
302
+ "learning_rate": 1.999451267560401e-05,
303
+ "loss": 0.1884,
304
+ "step": 1025
305
+ },
306
+ {
307
+ "epoch": 1.8657777777777778,
308
+ "grad_norm": 0.782338559627533,
309
+ "learning_rate": 1.999397453752736e-05,
310
+ "loss": 0.1931,
311
+ "step": 1050
312
+ },
313
+ {
314
+ "epoch": 1.9102222222222223,
315
+ "grad_norm": 0.7394895553588867,
316
+ "learning_rate": 1.9993411239631713e-05,
317
+ "loss": 0.1926,
318
+ "step": 1075
319
+ },
320
+ {
321
+ "epoch": 1.9546666666666668,
322
+ "grad_norm": 1.1669658422470093,
323
+ "learning_rate": 1.999282278333517e-05,
324
+ "loss": 0.1886,
325
+ "step": 1100
326
+ },
327
+ {
328
+ "epoch": 1.999111111111111,
329
+ "grad_norm": 0.5342193841934204,
330
+ "learning_rate": 1.9992209170119177e-05,
331
+ "loss": 0.1892,
332
+ "step": 1125
333
+ },
334
+ {
335
+ "epoch": 2.042666666666667,
336
+ "grad_norm": 0.9362142086029053,
337
+ "learning_rate": 1.99915704015285e-05,
338
+ "loss": 0.1675,
339
+ "step": 1150
340
+ },
341
+ {
342
+ "epoch": 2.087111111111111,
343
+ "grad_norm": 0.6746439933776855,
344
+ "learning_rate": 1.9990906479171236e-05,
345
+ "loss": 0.1589,
346
+ "step": 1175
347
+ },
348
+ {
349
+ "epoch": 2.1315555555555554,
350
+ "grad_norm": 0.8524124622344971,
351
+ "learning_rate": 1.9990217404718807e-05,
352
+ "loss": 0.1523,
353
+ "step": 1200
354
+ },
355
+ {
356
+ "epoch": 2.176,
357
+ "grad_norm": 1.0020498037338257,
358
+ "learning_rate": 1.9989503179905963e-05,
359
+ "loss": 0.1647,
360
+ "step": 1225
361
+ },
362
+ {
363
+ "epoch": 2.2204444444444444,
364
+ "grad_norm": 0.9763280153274536,
365
+ "learning_rate": 1.9988763806530765e-05,
366
+ "loss": 0.1502,
367
+ "step": 1250
368
+ },
369
+ {
370
+ "epoch": 2.2648888888888887,
371
+ "grad_norm": 0.7576664090156555,
372
+ "learning_rate": 1.998799928645458e-05,
373
+ "loss": 0.1439,
374
+ "step": 1275
375
+ },
376
+ {
377
+ "epoch": 2.3093333333333335,
378
+ "grad_norm": 0.772350549697876,
379
+ "learning_rate": 1.9987209621602086e-05,
380
+ "loss": 0.1539,
381
+ "step": 1300
382
+ },
383
+ {
384
+ "epoch": 2.3537777777777777,
385
+ "grad_norm": 0.5643001198768616,
386
+ "learning_rate": 1.9986394813961267e-05,
387
+ "loss": 0.162,
388
+ "step": 1325
389
+ },
390
+ {
391
+ "epoch": 2.398222222222222,
392
+ "grad_norm": 1.1751031875610352,
393
+ "learning_rate": 1.9985554865583394e-05,
394
+ "loss": 0.1523,
395
+ "step": 1350
396
+ },
397
+ {
398
+ "epoch": 2.4426666666666668,
399
+ "grad_norm": 0.7075941562652588,
400
+ "learning_rate": 1.9984689778583044e-05,
401
+ "loss": 0.16,
402
+ "step": 1375
403
+ },
404
+ {
405
+ "epoch": 2.487111111111111,
406
+ "grad_norm": 0.6978412866592407,
407
+ "learning_rate": 1.998379955513807e-05,
408
+ "loss": 0.1543,
409
+ "step": 1400
410
+ },
411
+ {
412
+ "epoch": 2.5315555555555553,
413
+ "grad_norm": 0.8001956939697266,
414
+ "learning_rate": 1.9982884197489602e-05,
415
+ "loss": 0.149,
416
+ "step": 1425
417
+ },
418
+ {
419
+ "epoch": 2.576,
420
+ "grad_norm": 0.8669373989105225,
421
+ "learning_rate": 1.9981943707942064e-05,
422
+ "loss": 0.1492,
423
+ "step": 1450
424
+ },
425
+ {
426
+ "epoch": 2.6204444444444444,
427
+ "grad_norm": 0.9674304723739624,
428
+ "learning_rate": 1.9980978088863125e-05,
429
+ "loss": 0.152,
430
+ "step": 1475
431
+ },
432
+ {
433
+ "epoch": 2.664888888888889,
434
+ "grad_norm": 0.6418324112892151,
435
+ "learning_rate": 1.9979987342683736e-05,
436
+ "loss": 0.1481,
437
+ "step": 1500
438
+ },
439
+ {
440
+ "epoch": 2.7093333333333334,
441
+ "grad_norm": 0.8923436999320984,
442
+ "learning_rate": 1.9978971471898105e-05,
443
+ "loss": 0.1558,
444
+ "step": 1525
445
+ },
446
+ {
447
+ "epoch": 2.7537777777777777,
448
+ "grad_norm": 0.8257409930229187,
449
+ "learning_rate": 1.997793047906367e-05,
450
+ "loss": 0.1459,
451
+ "step": 1550
452
+ },
453
+ {
454
+ "epoch": 2.7982222222222224,
455
+ "grad_norm": 0.9598385095596313,
456
+ "learning_rate": 1.9976864366801146e-05,
457
+ "loss": 0.1431,
458
+ "step": 1575
459
+ },
460
+ {
461
+ "epoch": 2.8426666666666667,
462
+ "grad_norm": 0.8788126111030579,
463
+ "learning_rate": 1.9975773137794458e-05,
464
+ "loss": 0.1475,
465
+ "step": 1600
466
+ },
467
+ {
468
+ "epoch": 2.887111111111111,
469
+ "grad_norm": 0.9696657657623291,
470
+ "learning_rate": 1.9974656794790777e-05,
471
+ "loss": 0.1679,
472
+ "step": 1625
473
+ },
474
+ {
475
+ "epoch": 2.9315555555555557,
476
+ "grad_norm": 0.7172701358795166,
477
+ "learning_rate": 1.99735153406005e-05,
478
+ "loss": 0.1608,
479
+ "step": 1650
480
+ },
481
+ {
482
+ "epoch": 2.976,
483
+ "grad_norm": 0.7976154685020447,
484
+ "learning_rate": 1.9972348778097225e-05,
485
+ "loss": 0.156,
486
+ "step": 1675
487
+ },
488
+ {
489
+ "epoch": 3.0195555555555558,
490
+ "grad_norm": 0.6643044352531433,
491
+ "learning_rate": 1.9971157110217782e-05,
492
+ "loss": 0.1322,
493
+ "step": 1700
494
+ },
495
+ {
496
+ "epoch": 3.064,
497
+ "grad_norm": 0.8205846548080444,
498
+ "learning_rate": 1.9969940339962192e-05,
499
+ "loss": 0.1173,
500
+ "step": 1725
501
+ },
502
+ {
503
+ "epoch": 3.1084444444444443,
504
+ "grad_norm": 0.5853546261787415,
505
+ "learning_rate": 1.996869847039367e-05,
506
+ "loss": 0.1327,
507
+ "step": 1750
508
+ },
509
+ {
510
+ "epoch": 3.152888888888889,
511
+ "grad_norm": 0.8844691514968872,
512
+ "learning_rate": 1.9967431504638624e-05,
513
+ "loss": 0.1294,
514
+ "step": 1775
515
+ },
516
+ {
517
+ "epoch": 3.1973333333333334,
518
+ "grad_norm": 0.8210035562515259,
519
+ "learning_rate": 1.9966139445886633e-05,
520
+ "loss": 0.1119,
521
+ "step": 1800
522
+ },
523
+ {
524
+ "epoch": 3.2417777777777776,
525
+ "grad_norm": 1.1607897281646729,
526
+ "learning_rate": 1.996482229739046e-05,
527
+ "loss": 0.117,
528
+ "step": 1825
529
+ },
530
+ {
531
+ "epoch": 3.2862222222222224,
532
+ "grad_norm": 1.3166520595550537,
533
+ "learning_rate": 1.9963480062466022e-05,
534
+ "loss": 0.1253,
535
+ "step": 1850
536
+ },
537
+ {
538
+ "epoch": 3.3306666666666667,
539
+ "grad_norm": 0.9852168560028076,
540
+ "learning_rate": 1.996211274449239e-05,
541
+ "loss": 0.1275,
542
+ "step": 1875
543
+ },
544
+ {
545
+ "epoch": 3.375111111111111,
546
+ "grad_norm": 0.6811080574989319,
547
+ "learning_rate": 1.9960720346911798e-05,
548
+ "loss": 0.116,
549
+ "step": 1900
550
+ },
551
+ {
552
+ "epoch": 3.4195555555555557,
553
+ "grad_norm": 0.6788239479064941,
554
+ "learning_rate": 1.995930287322959e-05,
555
+ "loss": 0.1193,
556
+ "step": 1925
557
+ },
558
+ {
559
+ "epoch": 3.464,
560
+ "grad_norm": 0.9439682960510254,
561
+ "learning_rate": 1.9957860327014262e-05,
562
+ "loss": 0.1341,
563
+ "step": 1950
564
+ },
565
+ {
566
+ "epoch": 3.5084444444444447,
567
+ "grad_norm": 0.7991074919700623,
568
+ "learning_rate": 1.995639271189742e-05,
569
+ "loss": 0.1315,
570
+ "step": 1975
571
+ },
572
+ {
573
+ "epoch": 3.552888888888889,
574
+ "grad_norm": 0.7587019205093384,
575
+ "learning_rate": 1.9954900031573788e-05,
576
+ "loss": 0.1317,
577
+ "step": 2000
578
+ },
579
+ {
580
+ "epoch": 3.5973333333333333,
581
+ "grad_norm": 0.801716685295105,
582
+ "learning_rate": 1.995338228980118e-05,
583
+ "loss": 0.1283,
584
+ "step": 2025
585
+ },
586
+ {
587
+ "epoch": 3.6417777777777776,
588
+ "grad_norm": 1.0118695497512817,
589
+ "learning_rate": 1.9951839490400514e-05,
590
+ "loss": 0.1318,
591
+ "step": 2050
592
+ },
593
+ {
594
+ "epoch": 3.6862222222222223,
595
+ "grad_norm": 0.7447464466094971,
596
+ "learning_rate": 1.9950271637255787e-05,
597
+ "loss": 0.1261,
598
+ "step": 2075
599
+ },
600
+ {
601
+ "epoch": 3.7306666666666666,
602
+ "grad_norm": 0.6883965134620667,
603
+ "learning_rate": 1.9948678734314062e-05,
604
+ "loss": 0.1324,
605
+ "step": 2100
606
+ },
607
+ {
608
+ "epoch": 3.7751111111111113,
609
+ "grad_norm": 1.0719166994094849,
610
+ "learning_rate": 1.9947060785585472e-05,
611
+ "loss": 0.1323,
612
+ "step": 2125
613
+ },
614
+ {
615
+ "epoch": 3.8195555555555556,
616
+ "grad_norm": 0.7405015230178833,
617
+ "learning_rate": 1.99454177951432e-05,
618
+ "loss": 0.121,
619
+ "step": 2150
620
+ },
621
+ {
622
+ "epoch": 3.864,
623
+ "grad_norm": 0.8354102373123169,
624
+ "learning_rate": 1.994374976712348e-05,
625
+ "loss": 0.123,
626
+ "step": 2175
627
+ },
628
+ {
629
+ "epoch": 3.9084444444444446,
630
+ "grad_norm": 0.7395333647727966,
631
+ "learning_rate": 1.9942056705725564e-05,
632
+ "loss": 0.1185,
633
+ "step": 2200
634
+ },
635
+ {
636
+ "epoch": 3.952888888888889,
637
+ "grad_norm": 0.8350748419761658,
638
+ "learning_rate": 1.9940338615211732e-05,
639
+ "loss": 0.1316,
640
+ "step": 2225
641
+ },
642
+ {
643
+ "epoch": 3.997333333333333,
644
+ "grad_norm": 0.7887341976165771,
645
+ "learning_rate": 1.9938595499907274e-05,
646
+ "loss": 0.1264,
647
+ "step": 2250
648
+ },
649
+ {
650
+ "epoch": 4.0408888888888885,
651
+ "grad_norm": 1.299972653388977,
652
+ "learning_rate": 1.9936827364200483e-05,
653
+ "loss": 0.1071,
654
+ "step": 2275
655
+ },
656
+ {
657
+ "epoch": 4.085333333333334,
658
+ "grad_norm": 0.6423847675323486,
659
+ "learning_rate": 1.993503421254264e-05,
660
+ "loss": 0.0976,
661
+ "step": 2300
662
+ },
663
+ {
664
+ "epoch": 4.129777777777778,
665
+ "grad_norm": 0.732215404510498,
666
+ "learning_rate": 1.9933216049448003e-05,
667
+ "loss": 0.0944,
668
+ "step": 2325
669
+ },
670
+ {
671
+ "epoch": 4.174222222222222,
672
+ "grad_norm": 1.239856243133545,
673
+ "learning_rate": 1.9931372879493788e-05,
674
+ "loss": 0.0991,
675
+ "step": 2350
676
+ },
677
+ {
678
+ "epoch": 4.218666666666667,
679
+ "grad_norm": 0.661592960357666,
680
+ "learning_rate": 1.9929504707320176e-05,
681
+ "loss": 0.0956,
682
+ "step": 2375
683
+ },
684
+ {
685
+ "epoch": 4.263111111111111,
686
+ "grad_norm": 1.2171379327774048,
687
+ "learning_rate": 1.9927611537630293e-05,
688
+ "loss": 0.0945,
689
+ "step": 2400
690
+ },
691
+ {
692
+ "epoch": 4.307555555555556,
693
+ "grad_norm": 1.1166738271713257,
694
+ "learning_rate": 1.9925693375190187e-05,
695
+ "loss": 0.1044,
696
+ "step": 2425
697
+ },
698
+ {
699
+ "epoch": 4.352,
700
+ "grad_norm": 0.6641908884048462,
701
+ "learning_rate": 1.9923750224828833e-05,
702
+ "loss": 0.0957,
703
+ "step": 2450
704
+ },
705
+ {
706
+ "epoch": 4.396444444444445,
707
+ "grad_norm": 0.683151125907898,
708
+ "learning_rate": 1.9921782091438108e-05,
709
+ "loss": 0.0996,
710
+ "step": 2475
711
+ },
712
+ {
713
+ "epoch": 4.440888888888889,
714
+ "grad_norm": 0.9200541973114014,
715
+ "learning_rate": 1.9919788979972785e-05,
716
+ "loss": 0.1,
717
+ "step": 2500
718
+ },
719
+ {
720
+ "epoch": 4.440888888888889,
721
+ "eval_loss": 0.20267285406589508,
722
+ "eval_runtime": 1404.9789,
723
+ "eval_samples_per_second": 0.712,
724
+ "eval_steps_per_second": 0.089,
725
+ "eval_wer": 25.988627552339103,
726
+ "step": 2500
727
+ }
728
+ ],
729
+ "logging_steps": 25,
730
+ "max_steps": 50000,
731
+ "num_input_tokens_seen": 0,
732
+ "num_train_epochs": 89,
733
+ "save_steps": 2500,
734
+ "stateful_callbacks": {
735
+ "EarlyStoppingCallback": {
736
+ "args": {
737
+ "early_stopping_patience": 10,
738
+ "early_stopping_threshold": 0.001
739
+ },
740
+ "attributes": {
741
+ "early_stopping_patience_counter": 0
742
+ }
743
+ },
744
+ "TrainerControl": {
745
+ "args": {
746
+ "should_epoch_stop": false,
747
+ "should_evaluate": false,
748
+ "should_log": false,
749
+ "should_save": true,
750
+ "should_training_stop": false
751
+ },
752
+ "attributes": {}
753
+ }
754
+ },
755
+ "total_flos": 1.46412752338944e+20,
756
+ "train_batch_size": 8,
757
+ "trial_name": null,
758
+ "trial_params": null
759
+ }
checkpoint-2500/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:027f038ae6f343b4bd6b983c6a2c48944efa6a9718f9ff1866c6b3b364f90e98
3
+ size 6033
logs/events.out.tfevents.1762483946.f66a7246828a.93445.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:707789b00b23b1c62c14400b2705cc9834ae3acbd0386562fb0be38fdb2a564e
3
+ size 27593
wer_log.txt ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ === WER Training Log ===
2
+ Model: openai/whisper-large-v3
3
+ Language: Hindi
4
+
5
+ Step 2500: WER=25.9886%, Loss=0.2027