Whisper Distillation

community

https://github.com/huggingface/distil-whisper

Activity Feed Request to join this org

AI & ML interests

Robust knowledge distillation of the Whisper model via large-scale pseudo-labelling.

Recent Activity

Steveeeeeeen new activity 19 days ago

distil-whisper/distil-large-v3:Add Open ASR Leaderboard evaluation results

Steveeeeeeen new activity 19 days ago

distil-whisper/distil-medium.en:Add Open ASR Leaderboard evaluation results

Steveeeeeeen new activity 19 days ago

distil-whisper/distil-small.en:Add Open ASR Leaderboard evaluation results

View all activity

distil-whisper 's collections 6

distil-large-v3.5

This collection contains the model repositories for distil-large-v3.5, which provides support for the most popular Whisper libraries.

distil-whisper/distil-large-v3.5

Automatic Speech Recognition • 0.8B • Updated 27 days ago • 53.5k • 89
distil-whisper/distil-large-v3.5-ct2

Automatic Speech Recognition • Updated Mar 19, 2025 • 1.8k • 8
distil-whisper/distil-large-v3.5-openai

Automatic Speech Recognition • Updated Mar 19, 2025
distil-whisper/distil-large-v3.5-ggml

Automatic Speech Recognition • Updated Mar 19, 2025 • 7

Training Datasets

A collection of pseudo-labelled datasets used to train the Distil-Whisper model.

distil-whisper/ami-ihm

Preview • Updated Sep 25, 2023 • 14
distil-whisper/ami-sdm

Updated Sep 25, 2023 • 41 • 1
distil-whisper/common_voice_13_0

Updated Sep 25, 2023 • 118 • 1
distil-whisper/gigaspeech-l

Updated Sep 25, 2023 • 29 • 2

Short-Form Test Sets

A collection of short-form (samples < 30s) datasets used to evaluate the Distil-Whisper models.

distil-whisper/earnings22

Viewer • Updated Oct 13, 2023 • 57.5k • 4.59k • 15
google/fleurs

Updated Aug 25, 2024 • 54.5k • 401
kensho/spgispeech

Viewer • Updated Jan 20 • 2.7M • 1.77k • 37

distil-large-v3

This collection contains the model repositories for distil-large-v3, which provides support for the most popular Whisper libraries.

distil-whisper/distil-large-v3

Automatic Speech Recognition • 0.8B • Updated 19 days ago • 1.32M • 376
distil-whisper/distil-large-v3-ggml

Automatic Speech Recognition • Updated Mar 21, 2024 • 24
distil-whisper/distil-large-v3-ct2

Automatic Speech Recognition • Updated Mar 22, 2024 • 186 • 6
distil-whisper/distil-large-v3-openai

Automatic Speech Recognition • Updated Mar 27, 2024 • 4

Distil-Whisper Models

The first version of the Distil-Whisper models released with the Distil-Whisper paper.

Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling

Paper • 2311.00430 • Published Nov 1, 2023 • 56
distil-whisper/distil-large-v2

Automatic Speech Recognition • 0.8B • Updated 19 days ago • 10.1k • 516
distil-whisper/distil-medium.en

Automatic Speech Recognition • 0.4B • Updated 19 days ago • 8.84k • 127
distil-whisper/distil-small.en

Automatic Speech Recognition • 0.2B • Updated 19 days ago • 10.1k • 112

Long-Form Test Sets

A collection of long-form (samples > 30s) datasets used to evaluate the Distil-Whisper models.

distil-whisper/earnings21

Viewer • Updated Oct 13, 2023 • 44 • 292 • 3
distil-whisper/earnings22

Viewer • Updated Oct 13, 2023 • 57.5k • 4.59k • 15
distil-whisper/meanwhile

Viewer • Updated Oct 17, 2023 • 64 • 1.57k • 2
distil-whisper/rev16

Viewer • Updated Oct 17, 2023 • 46 • 140 • 1

distil-large-v3.5

This collection contains the model repositories for distil-large-v3.5, which provides support for the most popular Whisper libraries.

distil-whisper/distil-large-v3.5

Automatic Speech Recognition • 0.8B • Updated 27 days ago • 53.5k • 89
distil-whisper/distil-large-v3.5-ct2

Automatic Speech Recognition • Updated Mar 19, 2025 • 1.8k • 8
distil-whisper/distil-large-v3.5-openai

Automatic Speech Recognition • Updated Mar 19, 2025
distil-whisper/distil-large-v3.5-ggml

Automatic Speech Recognition • Updated Mar 19, 2025 • 7

distil-large-v3

This collection contains the model repositories for distil-large-v3, which provides support for the most popular Whisper libraries.

distil-whisper/distil-large-v3

Automatic Speech Recognition • 0.8B • Updated 19 days ago • 1.32M • 376
distil-whisper/distil-large-v3-ggml

Automatic Speech Recognition • Updated Mar 21, 2024 • 24
distil-whisper/distil-large-v3-ct2

Automatic Speech Recognition • Updated Mar 22, 2024 • 186 • 6
distil-whisper/distil-large-v3-openai

Automatic Speech Recognition • Updated Mar 27, 2024 • 4

Training Datasets

A collection of pseudo-labelled datasets used to train the Distil-Whisper model.

distil-whisper/ami-ihm

Preview • Updated Sep 25, 2023 • 14
distil-whisper/ami-sdm

Updated Sep 25, 2023 • 41 • 1
distil-whisper/common_voice_13_0

Updated Sep 25, 2023 • 118 • 1
distil-whisper/gigaspeech-l

Updated Sep 25, 2023 • 29 • 2

Distil-Whisper Models

The first version of the Distil-Whisper models released with the Distil-Whisper paper.

Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling

Paper • 2311.00430 • Published Nov 1, 2023 • 56
distil-whisper/distil-large-v2

Automatic Speech Recognition • 0.8B • Updated 19 days ago • 10.1k • 516
distil-whisper/distil-medium.en

Automatic Speech Recognition • 0.4B • Updated 19 days ago • 8.84k • 127
distil-whisper/distil-small.en

Automatic Speech Recognition • 0.2B • Updated 19 days ago • 10.1k • 112

Short-Form Test Sets

A collection of short-form (samples < 30s) datasets used to evaluate the Distil-Whisper models.

distil-whisper/earnings22

Viewer • Updated Oct 13, 2023 • 57.5k • 4.59k • 15
google/fleurs

Updated Aug 25, 2024 • 54.5k • 401
kensho/spgispeech

Viewer • Updated Jan 20 • 2.7M • 1.77k • 37

Long-Form Test Sets

A collection of long-form (samples > 30s) datasets used to evaluate the Distil-Whisper models.

distil-whisper/earnings21

Viewer • Updated Oct 13, 2023 • 44 • 292 • 3
distil-whisper/earnings22

Viewer • Updated Oct 13, 2023 • 57.5k • 4.59k • 15
distil-whisper/meanwhile

Viewer • Updated Oct 17, 2023 • 64 • 1.57k • 2
distil-whisper/rev16

Viewer • Updated Oct 17, 2023 • 46 • 140 • 1

AI & ML interests

Recent Activity

Team members 8

distil-whisper 's collections 6