Rohan432 commited on
Commit
99c8b44
·
verified ·
1 Parent(s): d34e1f6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -16
README.md CHANGED
@@ -1,27 +1,34 @@
1
-
 
 
 
 
 
2
 
3
  Description
4
- This model is a fine-tuned version of openai/whisper-small on Bangla speech data.
 
5
 
6
  Environment:
7
  Python version: 3.12.12
8
  PyTorch version: 2.8.0+cu126
 
9
  NumPy version: 1.26.4
10
 
11
  Training Parameters:
12
- Total epochs: 8
13
- Learning Rate: 2e-5
14
- Batch size per device: 4
15
- Gradient accumulation: 4
16
- Warmup Steps: 200
17
- LR Scheduler: cosine_with_restarts
 
18
 
19
 
20
- Validation Set Evaluation:
21
- | Epoch | Training Loss | Validation Loss | WER (%) | Normalized Levenshtein Similarity (%) |
22
- |-------|----------------|------------------|-------------|----------------------------------------|
23
- | 0 | 1.436900 | 1.500822 | 23.480663 | 84.353535 |
24
- | 2 | 1.433300 | 1.479616 | 20.883978 | 85.525253 |
25
- | 4 | 1.418600 | 1.467377 | 16.022099 | 88.111111 |
26
- | 6 | 1.413600 | 1.469696 | 14.751381 | 89.313131 |
27
- | 8 | 1.413300 | 1.470008 | 14.530387 | 89.444444 |
 
1
+ ---
2
+ license: mit
3
+ base_model:
4
+ - ishmamzarif/bangla_asr_augmented_bangla-whisper-epoch-11
5
+ pipeline_tag: automatic-speech-recognition
6
+ ---
7
 
8
  Description
9
+ This model is a fine-tuned version of ishmamzarif/bangla_asr_augmented_bangla-whisper-epoch-11 .
10
+ ishmamzarif/bangla_asr_augmented_bangla-whisper-epoch-11 is a finetuned version of bangla-speech-processing/BanglaASR on Bangla speech data.
11
 
12
  Environment:
13
  Python version: 3.12.12
14
  PyTorch version: 2.8.0+cu126
15
+ Librosa version: 0.10.1
16
  NumPy version: 1.26.4
17
 
18
  Training Parameters:
19
+
20
+ BATCH_SIZE = 4
21
+ GRADIENT_ACCUMULATION_STEPS = 4 # Effective batch size = 16
22
+ LEARNING_RATE = 2e-5
23
+ WARMUP_STEPS = 400
24
+ NUM_TRAIN_EPOCHS = 8
25
+ LOGGING_STEPS = 50
26
 
27
 
28
+ | **Epoch** | **Training Loss** | **Validation Loss** | **WER (%)** | **Normalized Levenshtein Similarity (%)** |
29
+ | --------- | ----------------- | ------------------- | ----------- | ----------------------------------------- |
30
+ | 0 | 2.3479 | 1.59398 | 26.519 | 83.03 |
31
+ | 2 | 1.5380 | 1.50034 | 18.011 | 87.15 |
32
+ | 4 | 1.4665 | 1.47125 | 12.486 | 91.06 |
33
+ | 6 | 1.4448 | 1.46236 | 10.607 | 91.97 |
34
+ | 7 | 1.4419 | 1.46210 | 10.441 | 92.12 |