Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,27 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
|
| 3 |
+
Description
|
| 4 |
+
This model is a fine-tuned version of openai/whisper-small on Bangla speech data.
|
| 5 |
+
|
| 6 |
+
Environment:
|
| 7 |
+
Python version: 3.12.12
|
| 8 |
+
PyTorch version: 2.8.0+cu126
|
| 9 |
+
NumPy version: 1.26.4
|
| 10 |
+
|
| 11 |
+
Training Parameters:
|
| 12 |
+
Total epochs: 8
|
| 13 |
+
Learning Rate: 2e-5
|
| 14 |
+
Batch size per device: 4
|
| 15 |
+
Gradient accumulation: 4
|
| 16 |
+
Warmup Steps: 200
|
| 17 |
+
LR Scheduler: cosine_with_restarts
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
Validation Set Evaluation:
|
| 21 |
+
| Epoch | Training Loss | Validation Loss | WER (%) | Normalized Levenshtein Similarity (%) |
|
| 22 |
+
|-------|----------------|------------------|-------------|----------------------------------------|
|
| 23 |
+
| 0 | 1.436900 | 1.500822 | 23.480663 | 84.353535 |
|
| 24 |
+
| 2 | 1.433300 | 1.479616 | 20.883978 | 85.525253 |
|
| 25 |
+
| 4 | 1.418600 | 1.467377 | 16.022099 | 88.111111 |
|
| 26 |
+
| 6 | 1.413600 | 1.469696 | 14.751381 | 89.313131 |
|
| 27 |
+
| 8 | 1.413300 | 1.470008 | 14.530387 | 89.444444 |
|