Fill-Mask
Transformers
PyTorch
Safetensors
Russian
English
bert
pretraining
russian
embeddings
masked-lm
tiny
feature-extraction
sentence-similarity
Instructions to use cointegrated/rubert-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use cointegrated/rubert-tiny with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="cointegrated/rubert-tiny")# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("cointegrated/rubert-tiny") model = AutoModelForPreTraining.from_pretrained("cointegrated/rubert-tiny") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit ·
f47bfe4
1
Parent(s): f191937
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
---
|
| 2 |
-
language:
|
|
|
|
|
|
|
| 3 |
tags:
|
| 4 |
- russian
|
| 5 |
- fill-mask
|
|
@@ -11,7 +13,8 @@ tags:
|
|
| 11 |
- sentence-similarity
|
| 12 |
license: mit
|
| 13 |
widget:
|
| 14 |
-
- text:
|
|
|
|
| 15 |
---
|
| 16 |
This is a very small distilled version of the [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) model for Russian and English (45 MB, 12M parameters). There is also an **updated version of this model**, [rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2), with a larger vocabulary and better quality on practically all Russian NLU tasks.
|
| 17 |
|
|
|
|
| 1 |
---
|
| 2 |
+
language:
|
| 3 |
+
- ru
|
| 4 |
+
- en
|
| 5 |
tags:
|
| 6 |
- russian
|
| 7 |
- fill-mask
|
|
|
|
| 13 |
- sentence-similarity
|
| 14 |
license: mit
|
| 15 |
widget:
|
| 16 |
+
- text: Миниатюрная модель для [MASK] разных задач.
|
| 17 |
+
pipeline_tag: fill-mask
|
| 18 |
---
|
| 19 |
This is a very small distilled version of the [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) model for Russian and English (45 MB, 12M parameters). There is also an **updated version of this model**, [rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2), with a larger vocabulary and better quality on practically all Russian NLU tasks.
|
| 20 |
|