Update README.md
Browse files
README.md
CHANGED
|
@@ -29,6 +29,31 @@ Model size is 50% less then original whisper-tiny:
|
|
| 29 |
| model file size | 151 Mb | 86 Mb |
|
| 30 |
| vocab_size | 51865 | 4705 |
|
| 31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
## Other pruned whisper models
|
| 33 |
* [waveletdeboshir/whisper-base-ru-pruned](https://huggingface.co/waveletdeboshir/whisper-base-ru-pruned)
|
| 34 |
* [waveletdeboshir/whisper-small-ru-pruned](https://huggingface.co/waveletdeboshir/whisper-small-ru-pruned)
|
|
|
|
| 29 |
| model file size | 151 Mb | 86 Mb |
|
| 30 |
| vocab_size | 51865 | 4705 |
|
| 31 |
|
| 32 |
+
## Usage
|
| 33 |
+
Model can be used as an original whisper:
|
| 34 |
+
|
| 35 |
+
```python
|
| 36 |
+
>>> from transformers import WhisperProcessor, WhisperForConditionalGeneration
|
| 37 |
+
>>> import torchaudio
|
| 38 |
+
|
| 39 |
+
>>> # load audio
|
| 40 |
+
>>> wav, sr = torchaudio.load("audio.wav")
|
| 41 |
+
|
| 42 |
+
>>> # load model and processor
|
| 43 |
+
>>> processor = WhisperProcessor.from_pretrained("waveletdeboshir/whisper-tiny-ru-pruned")
|
| 44 |
+
>>> model = WhisperForConditionalGeneration.from_pretrained("waveletdeboshir/whisper-tiny-ru-pruned")
|
| 45 |
+
|
| 46 |
+
>>> input_features = processor(wav[0], sampling_rate=sr, return_tensors="pt").input_features
|
| 47 |
+
|
| 48 |
+
>>> # generate token ids
|
| 49 |
+
>>> predicted_ids = model.generate(input_features)
|
| 50 |
+
>>> # decode token ids to text
|
| 51 |
+
>>> transcription = processor.batch_decode(predicted_ids, skip_special_tokens=False)
|
| 52 |
+
['<|startoftranscript|><|ru|><|transcribe|><|notimestamps|> Начинаем работу.<|endoftext|>']
|
| 53 |
+
|
| 54 |
+
```
|
| 55 |
+
The context tokens can be removed from the start of the transcription by setting `skip_special_tokens=True`.
|
| 56 |
+
|
| 57 |
## Other pruned whisper models
|
| 58 |
* [waveletdeboshir/whisper-base-ru-pruned](https://huggingface.co/waveletdeboshir/whisper-base-ru-pruned)
|
| 59 |
* [waveletdeboshir/whisper-small-ru-pruned](https://huggingface.co/waveletdeboshir/whisper-small-ru-pruned)
|