You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

dyu-whisper-small

This model is a fine-tuned version of openai/whisper-small on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 32
eval_batch_size: 16
seed: 42
gradient_accumulation_steps: 2
total_train_batch_size: 64
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: cosine
lr_scheduler_warmup_steps: 500
training_steps: 2000

Training Loss	Epoch	Step	Validation Loss	Wer
3.1601	3.9407	500	1.5885	112.5501
2.5546	7.8775	1000	1.3779	90.0534
2.3779	11.8142	1500	1.3566	89.2301
2.4890	15.7510	2000	1.3561	84.4237

Safetensors

Model size

0.2B params

Tensor type

BF16

Base model

Finetuned

this model