Update README.md
Browse files
README.md
CHANGED
|
@@ -462,26 +462,27 @@ You can finetune this model on your own dataset.
|
|
| 462 |
|
| 463 |
#### Information Retrieval
|
| 464 |
|
| 465 |
-
* Datasets: `
|
| 466 |
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
|
| 467 |
|
| 468 |
-
| Metric |
|
| 469 |
-
|:--------------------|:---------------------|:---------------|
|
| 470 |
-
| cosine_accuracy@1 | 0.
|
| 471 |
-
| cosine_accuracy@3 | 0.
|
| 472 |
-
| cosine_accuracy@5 | 0.
|
| 473 |
-
| cosine_accuracy@10 | 0.
|
| 474 |
-
| cosine_precision@1 | 0.
|
| 475 |
-
| cosine_precision@3 | 0.
|
| 476 |
-
| cosine_precision@5 | 0.
|
| 477 |
-
| cosine_precision@10 | 0.
|
| 478 |
-
| cosine_recall@1 | 0.
|
| 479 |
-
| cosine_recall@3 | 0.
|
| 480 |
-
| cosine_recall@5 | 0.
|
| 481 |
-
| cosine_recall@10 | 0.
|
| 482 |
-
| **cosine_ndcg@10** | **0.
|
| 483 |
-
| cosine_mrr@10 | 0.
|
| 484 |
-
| cosine_map@100 | 0.
|
|
|
|
| 485 |
|
| 486 |
<!--
|
| 487 |
## Bias, Risks and Limitations
|
|
|
|
| 462 |
|
| 463 |
#### Information Retrieval
|
| 464 |
|
| 465 |
+
* Datasets: `clean-val-only`
|
| 466 |
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
|
| 467 |
|
| 468 |
+
| Metric | Base model (clean) | Fine-tuned (clean) |
|
| 469 |
+
|:--------------------|:---------------------|:-------------------|
|
| 470 |
+
| cosine_accuracy@1 | 0.4425 | 0.8471 |
|
| 471 |
+
| cosine_accuracy@3 | 0.6182 | 0.9328 |
|
| 472 |
+
| cosine_accuracy@5 | 0.6779 | 0.9544 |
|
| 473 |
+
| cosine_accuracy@10 | 0.7668 | 0.9772 |
|
| 474 |
+
| cosine_precision@1 | 0.4425 | 0.8471 |
|
| 475 |
+
| cosine_precision@3 | 0.2061 | 0.3109 |
|
| 476 |
+
| cosine_precision@5 | 0.1356 | 0.1909 |
|
| 477 |
+
| cosine_precision@10 | 0.0767 | 0.0977 |
|
| 478 |
+
| cosine_recall@1 | 0.4425 | 0.8471 |
|
| 479 |
+
| cosine_recall@3 | 0.6182 | 0.9328 |
|
| 480 |
+
| cosine_recall@5 | 0.6779 | 0.9544 |
|
| 481 |
+
| cosine_recall@10 | 0.7668 | 0.9772 |
|
| 482 |
+
| **cosine_ndcg@10** | **0.5994** | **0.9151** |
|
| 483 |
+
| cosine_mrr@10 | 0.5465 | 0.8949 |
|
| 484 |
+
| cosine_map@100 | 0.5533 | 0.8957 |
|
| 485 |
+
|
| 486 |
|
| 487 |
<!--
|
| 488 |
## Bias, Risks and Limitations
|