Sentence Similarity
sentence-transformers
TensorBoard
Safetensors
mpnet
feature-extraction
Generated from Trainer
dataset_size:32351
loss:TripletLoss
Eval Results (legacy)
text-embeddings-inference
Instructions to use hmm404/tmp_trainer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use hmm404/tmp_trainer with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("hmm404/tmp_trainer") sentences = [ "Genetic conditions that cause nutritional deficiencies can prevent a person from removing meat from their diet.", "Ante un estado que no quiere hablar del tema, para Cataluña, solo es posible seguir su propio camino por otras vías.", "Retinol deficiency is a genetically pre-disposed condition that prevents conversion beta-carotene to Vitamin A \\(retinol\\) in humans. Since plants have no retinol \\(only beta-carotene\\), humans with this condition cannot have a vegan diet, only one with animal products.", "People with hemochromatosis \\(a genetic condition\\) can benefit greatly from a vegan diet, due to the lower absorbing non-heme iron in plants \\(compared to heme iron in meat\\)." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
full_data
Browse files
README.md
CHANGED
|
@@ -62,6 +62,24 @@ widget:
|
|
| 62 |
from low socio-economic backgrounds.
|
| 63 |
pipeline_tag: sentence-similarity
|
| 64 |
library_name: sentence-transformers
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
---
|
| 66 |
|
| 67 |
# SentenceTransformer based on sentence-transformers/all-mpnet-base-v2
|
|
@@ -152,6 +170,26 @@ You can finetune this model on your own dataset.
|
|
| 152 |
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
|
| 153 |
-->
|
| 154 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 155 |
<!--
|
| 156 |
## Bias, Risks and Limitations
|
| 157 |
|
|
@@ -315,13 +353,33 @@ You can finetune this model on your own dataset.
|
|
| 315 |
</details>
|
| 316 |
|
| 317 |
### Training Logs
|
| 318 |
-
| Epoch | Step
|
| 319 |
-
|:------:|:----:|:-------------:|
|
| 320 |
-
| 0.1236 | 500
|
| 321 |
-
| 0.2473 | 1000
|
| 322 |
-
| 0.3709 | 1500
|
| 323 |
-
| 0.4946 | 2000
|
| 324 |
-
| 0.6182 | 2500
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 325 |
|
| 326 |
|
| 327 |
### Framework Versions
|
|
|
|
| 62 |
from low socio-economic backgrounds.
|
| 63 |
pipeline_tag: sentence-similarity
|
| 64 |
library_name: sentence-transformers
|
| 65 |
+
metrics:
|
| 66 |
+
- cosine_accuracy
|
| 67 |
+
model-index:
|
| 68 |
+
- name: SentenceTransformer based on sentence-transformers/all-mpnet-base-v2
|
| 69 |
+
results:
|
| 70 |
+
- task:
|
| 71 |
+
type: triplet
|
| 72 |
+
name: Triplet
|
| 73 |
+
dataset:
|
| 74 |
+
name: Unknown
|
| 75 |
+
type: unknown
|
| 76 |
+
metrics:
|
| 77 |
+
- type: cosine_accuracy
|
| 78 |
+
value: 0.9264069199562073
|
| 79 |
+
name: Cosine Accuracy
|
| 80 |
+
- type: cosine_accuracy
|
| 81 |
+
value: 0.9161931872367859
|
| 82 |
+
name: Cosine Accuracy
|
| 83 |
---
|
| 84 |
|
| 85 |
# SentenceTransformer based on sentence-transformers/all-mpnet-base-v2
|
|
|
|
| 170 |
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
|
| 171 |
-->
|
| 172 |
|
| 173 |
+
## Evaluation
|
| 174 |
+
|
| 175 |
+
### Metrics
|
| 176 |
+
|
| 177 |
+
#### Triplet
|
| 178 |
+
|
| 179 |
+
* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
|
| 180 |
+
|
| 181 |
+
| Metric | Value |
|
| 182 |
+
|:--------------------|:-----------|
|
| 183 |
+
| **cosine_accuracy** | **0.9264** |
|
| 184 |
+
|
| 185 |
+
#### Triplet
|
| 186 |
+
|
| 187 |
+
* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
|
| 188 |
+
|
| 189 |
+
| Metric | Value |
|
| 190 |
+
|:--------------------|:-----------|
|
| 191 |
+
| **cosine_accuracy** | **0.9162** |
|
| 192 |
+
|
| 193 |
<!--
|
| 194 |
## Bias, Risks and Limitations
|
| 195 |
|
|
|
|
| 353 |
</details>
|
| 354 |
|
| 355 |
### Training Logs
|
| 356 |
+
| Epoch | Step | Training Loss | cosine_accuracy |
|
| 357 |
+
|:------:|:-----:|:-------------:|:---------------:|
|
| 358 |
+
| 0.1236 | 500 | 0.1872 | - |
|
| 359 |
+
| 0.2473 | 1000 | 0.1954 | - |
|
| 360 |
+
| 0.3709 | 1500 | 0.1854 | - |
|
| 361 |
+
| 0.4946 | 2000 | 0.1891 | - |
|
| 362 |
+
| 0.6182 | 2500 | 0.181 | - |
|
| 363 |
+
| 0.7418 | 3000 | 0.1794 | - |
|
| 364 |
+
| 0.8655 | 3500 | 0.1815 | - |
|
| 365 |
+
| 0.9891 | 4000 | 0.1736 | - |
|
| 366 |
+
| 1.1128 | 4500 | 0.1342 | - |
|
| 367 |
+
| 1.2364 | 5000 | 0.1297 | - |
|
| 368 |
+
| 1.3600 | 5500 | 0.1318 | - |
|
| 369 |
+
| 1.4837 | 6000 | 0.1255 | - |
|
| 370 |
+
| 1.6073 | 6500 | 0.128 | - |
|
| 371 |
+
| 1.7310 | 7000 | 0.1233 | - |
|
| 372 |
+
| 1.8546 | 7500 | 0.1221 | - |
|
| 373 |
+
| 1.9782 | 8000 | 0.1232 | - |
|
| 374 |
+
| 2.1019 | 8500 | 0.0841 | - |
|
| 375 |
+
| 2.2255 | 9000 | 0.0757 | - |
|
| 376 |
+
| 2.3492 | 9500 | 0.0764 | - |
|
| 377 |
+
| 2.4728 | 10000 | 0.0761 | - |
|
| 378 |
+
| 2.5964 | 10500 | 0.0726 | - |
|
| 379 |
+
| 2.7201 | 11000 | 0.0644 | - |
|
| 380 |
+
| 2.8437 | 11500 | 0.073 | - |
|
| 381 |
+
| 2.9674 | 12000 | 0.0725 | - |
|
| 382 |
+
| -1 | -1 | - | 0.9162 |
|
| 383 |
|
| 384 |
|
| 385 |
### Framework Versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 437967672
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7e2f677891e8d67ad09844440fd0eee90a799343209d6f8efcadcc9b19eeb457
|
| 3 |
size 437967672
|
runs/Feb20_23-57-10_c4d6b74f6ef5/events.out.tfevents.1740095850.c4d6b74f6ef5.2977.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e1502e5e66f9f4b58b2839c296c77247a1a0ca608aaadcce18b2ec92cd59798
|
| 3 |
+
size 4375
|
runs/Feb20_23-58-17_c4d6b74f6ef5/events.out.tfevents.1740095945.c4d6b74f6ef5.2977.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:19e5f1d8e4be07748733a82f7bd4ed3e3eba1205d939c91f316fc677ee6c30b0
|
| 3 |
+
size 9793
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5560
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e963d4e69f206c10d59ff7c5c6ca60c80815c4ba250d2a90c6629e88913a2b95
|
| 3 |
size 5560
|