Add info about model

README.md

@@ -1,3 +1,42 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+language:
+- ru
+library_name: transformers
+pipeline_tag: automatic-speech-recognition
+tags:
+- asr
+- Pytorch
+- pruned
+- audio
+- automatic-speech-recognition
+---
+
+# Whisper-tiny-ru-pruned
+
+## Model info
+This is a pruned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) model with only russian tokens left.
+Pruning was made without any fine-tuning. Method from [this post](https://medium.com/m/global-identity-2?redirectUrl=https%3A%2F%2Ftowardsdatascience.com%2Fhow-to-adapt-a-multilingual-t5-model-for-a-single-language-b9f94f3d9c90) was used.
+
+## Size
+Only 10% tokens was left including special whisper tokens, added whisper tokens, 100 most popular tokens from tokenizer and 3000 most popular Russian tokens computed by tokenization of russian text corpus.
+
+Model size is 50%  less then original whisper-small:
+|  | openai/whisper-tiny | waveletdeboshir/whisper-tiny-ru-pruned |
+| :------ | :------ | :------ |
+| n of parameters | 38 M | 19.6 M |
+| n of parameters (with proj_out layer) | 57.6 M | 21.5 M |
+| model file size | 151 Mb | 86 Mb |
+| vocab_size | 51865 | 4705 |
+
+## Other pruned whisper models
+[waveletdeboshir/whisper-base-ru-pruned](https://huggingface.co/waveletdeboshir/whisper-base-ru-pruned)
+[waveletdeboshir/whisper-small-ru-pruned](https://huggingface.co/waveletdeboshir/whisper-small-ru-pruned)
+
+## Metrics
+TODO
+
+You can fine-tune this model on your data to achive better performance.
+
+## Colab for pruning
+TODO