Sentence Similarity
sentence-transformers
PyTorch
English
deberta-v2
feature-extraction
Generated from Trainer
dataset_size:314315
loss:AdaptiveLayerLoss
loss:MultipleNegativesRankingLoss
Eval Results (legacy)
text-embeddings-inference
Instructions to use bobox/DeBERTaV3-small-ST-AdaptiveLayerAllNormalized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use bobox/DeBERTaV3-small-ST-AdaptiveLayerAllNormalized with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("bobox/DeBERTaV3-small-ST-AdaptiveLayerAllNormalized") sentences = [ "The pitcher is pitching the ball in a game of baseball.", "the lady digs into the ground", "A group of people are sitting at tables.", "The pitcher throws the ball." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -197,6 +197,9 @@ model-index:
|
|
| 197 |
|
| 198 |
# SentenceTransformer based on microsoft/deberta-v3-small
|
| 199 |
|
|
|
|
|
|
|
|
|
|
| 200 |
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [microsoft/deberta-v3-small](https://huggingface.co/microsoft/deberta-v3-small) on the [stanfordnlp/snli](https://huggingface.co/datasets/stanfordnlp/snli) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
|
| 201 |
|
| 202 |
## Model Details
|
|
|
|
| 197 |
|
| 198 |
# SentenceTransformer based on microsoft/deberta-v3-small
|
| 199 |
|
| 200 |
+
[n_layers_per_step = -1, last_layer_weight = 1 * (model_layers-1), prior_layers_weight= 0.85, kl_div_weight = 2, kl_temperature= 10, lr = 1e-6. batch = 42, schedule = cosine]
|
| 201 |
+
|
| 202 |
+
|
| 203 |
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [microsoft/deberta-v3-small](https://huggingface.co/microsoft/deberta-v3-small) on the [stanfordnlp/snli](https://huggingface.co/datasets/stanfordnlp/snli) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
|
| 204 |
|
| 205 |
## Model Details
|