Sentence Similarity
sentence-transformers
PyTorch
Safetensors
Transformers
Russian
bert
pretraining
russian
fill-mask
embeddings
masked-lm
tiny
feature-extraction
text-embeddings-inference
Instructions to use cointegrated/rubert-tiny2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use cointegrated/rubert-tiny2 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("cointegrated/rubert-tiny2") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use cointegrated/rubert-tiny2 with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("cointegrated/rubert-tiny2") model = AutoModelForPreTraining.from_pretrained("cointegrated/rubert-tiny2") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit ·
74d70b9
1
Parent(s): 38d8cf6
Train the model longer
Browse files- config.json +1 -1
- pytorch_model.bin +1 -1
- tinybert-ru-labse-adapter-v2.pt +1 -1
config.json
CHANGED
|
@@ -20,7 +20,7 @@
|
|
| 20 |
"pad_token_id": 0,
|
| 21 |
"position_embedding_type": "absolute",
|
| 22 |
"torch_dtype": "float32",
|
| 23 |
-
"transformers_version": "4.
|
| 24 |
"type_vocab_size": 2,
|
| 25 |
"use_cache": true,
|
| 26 |
"vocab_size": 83828
|
|
|
|
| 20 |
"pad_token_id": 0,
|
| 21 |
"position_embedding_type": "absolute",
|
| 22 |
"torch_dtype": "float32",
|
| 23 |
+
"transformers_version": "4.12.3",
|
| 24 |
"type_vocab_size": 2,
|
| 25 |
"use_cache": true,
|
| 26 |
"vocab_size": 83828
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 117546024
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:137fa2b1d944dae19c74456dfe8fac2f780d9acf34e037f5d1e37acba1157768
|
| 3 |
size 117546024
|
tinybert-ru-labse-adapter-v2.pt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 962983
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3322adeaf437ec8005bd042a64f501458abd5ac58a2eb13f09df5ed9ba59a9af
|
| 3 |
size 962983
|