Feature Extraction
Transformers
Safetensors
sentence-transformers
Russian
English
bert
sentence-similarity
SbertDistil
text-embeddings-inference
Instructions to use FractalGPT/SbertDistil with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FractalGPT/SbertDistil with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="FractalGPT/SbertDistil")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("FractalGPT/SbertDistil") model = AutoModel.from_pretrained("FractalGPT/SbertDistil", device_map="auto") - sentence-transformers
How to use FractalGPT/SbertDistil with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("FractalGPT/SbertDistil") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -45,7 +45,6 @@ print(embeddings)
|
|
| 45 |
## Training
|
| 46 |
|
| 47 |
* The original weights was taken from [cointegrated/rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2).
|
| 48 |
-
*
|
| 49 |
* Training was conducted in two stages:
|
| 50 |
1. In the first stage, the model was trained on Wikipedia texts (4 million texts) for three epochs.
|
| 51 |
<img src="https://github.com/FractalGPT/ModelEmbedderDistilation/blob/main/DistilSBERT/Train/1_st_en.JPG?raw=true" width=700 />
|
|
|
|
| 45 |
## Training
|
| 46 |
|
| 47 |
* The original weights was taken from [cointegrated/rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2).
|
|
|
|
| 48 |
* Training was conducted in two stages:
|
| 49 |
1. In the first stage, the model was trained on Wikipedia texts (4 million texts) for three epochs.
|
| 50 |
<img src="https://github.com/FractalGPT/ModelEmbedderDistilation/blob/main/DistilSBERT/Train/1_st_en.JPG?raw=true" width=700 />
|