| | --- |
| | language: |
| | - en |
| | - zh |
| | - de |
| | - es |
| | - ru |
| | - ko |
| | - fr |
| | - ja |
| | - pt |
| | - tr |
| | - pl |
| | - ca |
| | - nl |
| | - ar |
| | - sv |
| | - it |
| | - id |
| | - hi |
| | - fi |
| | - vi |
| | - he |
| | - uk |
| | - el |
| | - ms |
| | - cs |
| | - ro |
| | - da |
| | - hu |
| | - ta |
| | - "no" |
| | - th |
| | - ur |
| | - hr |
| | - bg |
| | - lt |
| | - la |
| | - mi |
| | - ml |
| | - cy |
| | - sk |
| | - te |
| | - fa |
| | - lv |
| | - bn |
| | - sr |
| | - az |
| | - sl |
| | - kn |
| | - et |
| | - mk |
| | - br |
| | - eu |
| | - is |
| | - hy |
| | - ne |
| | - mn |
| | - bs |
| | - kk |
| | - sq |
| | - sw |
| | - gl |
| | - mr |
| | - pa |
| | - si |
| | - km |
| | - sn |
| | - yo |
| | - so |
| | - af |
| | - oc |
| | - ka |
| | - be |
| | - tg |
| | - sd |
| | - gu |
| | - am |
| | - yi |
| | - lo |
| | - uz |
| | - fo |
| | - ht |
| | - ps |
| | - tk |
| | - nn |
| | - mt |
| | - sa |
| | - lb |
| | - my |
| | - bo |
| | - tl |
| | - mg |
| | - as |
| | - tt |
| | - haw |
| | - ln |
| | - ha |
| | - ba |
| | - jw |
| | - su |
| | tags: |
| | - audio |
| | - automatic-speech-recognition |
| | - eole |
| | - whisper |
| | license: apache-2.0 |
| | base_model: openai/whisper-small |
| | pipeline_tag: automatic-speech-recognition |
| | --- |
| | |
| | # Whisper Small (eole) |
| |
|
| | This is [openai/whisper-small](https://huggingface.co/openai/whisper-small) converted to [eole](https://github.com/eole-nlp/eole) format using `eole convert --model_dir openai/whisper-small`. |
| |
|
| | No weights were modified — this is a format conversion only. |
| |
|
| | ## Model details |
| |
|
| | | | | |
| | |---|---| |
| | | **Original model** | [openai/whisper-small](https://huggingface.co/openai/whisper-small) | |
| | | **Parameters** | 244M | |
| | | **Encoder layers** | 12 | |
| | | **Decoder layers** | 12 | |
| | | **Hidden size** | 768 | |
| | | **Attention heads** | 12 | |
| | | **Mel bins** | 80 | |
| | | **Vocab size** | 51,865 | |
| | | **License** | Apache 2.0 | |
| |
|
| | ## Usage |
| |
|
| | ```bash |
| | pip install eole[wer] |
| | ``` |
| |
|
| | ### Transcribe |
| |
|
| | ```bash |
| | eole predict \ |
| | -config eval_config.yaml \ |
| | -model_path whisper-small-eole \ |
| | -src audio_files.txt \ |
| | -output transcriptions.txt \ |
| | -language en \ |
| | -task transcribe \ |
| | -gpu_ranks 0 |
| | ``` |
| |
|
| | ## Evaluation |
| |
|
| | All evaluations use beam size 5. |
| |
|
| | | Benchmark | WER | |
| | |---|---| |
| | | LibriSpeech test-clean | 3.30% | |
| |
|
| | ## Conversion |
| |
|
| | ```bash |
| | eole convert --model_dir openai/whisper-small --output whisper-small-eole |
| | ``` |
| |
|
| | ## Citation |
| |
|
| | ```bibtex |
| | @misc{radford2023robust, |
| | title={Robust Speech Recognition via Large-Scale Weak Supervision}, |
| | author={Alec Radford and Jong Wook Kim and Tao Xu and Greg Brockman and Christine McLeavey and Ilya Sutskever}, |
| | year={2023}, |
| | eprint={2212.04356}, |
| | archivePrefix={arXiv}, |
| | primaryClass={eess.AS} |
| | } |
| | ``` |
| |
|
