Update README.md
Browse files
README.md
CHANGED
|
@@ -162,6 +162,20 @@ model-index:
|
|
| 162 |
This is a [sentence-transformers](https://www.SBERT.net) model finetuned on NFCorpus from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2).
|
| 163 |
It is specialised for Information retrieval (IR). Here is the relative improvement compared to the original model:
|
| 164 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 165 |
## Model Details
|
| 166 |
|
| 167 |
### Model Description
|
|
@@ -265,14 +279,6 @@ You can finetune this model on your own dataset.
|
|
| 265 |
| cosine_accuracy@3 | 0.6821 |
|
| 266 |
| cosine_accuracy@5 | 0.7593 |
|
| 267 |
| cosine_accuracy@10 | 0.8333 |
|
| 268 |
-
| cosine_precision@1 | 0.4383 |
|
| 269 |
-
| cosine_precision@3 | 0.3765 |
|
| 270 |
-
| cosine_precision@5 | 0.3556 |
|
| 271 |
-
| cosine_precision@10 | 0.3006 |
|
| 272 |
-
| cosine_recall@1 | 0.0606 |
|
| 273 |
-
| cosine_recall@3 | 0.1171 |
|
| 274 |
-
| cosine_recall@5 | 0.1602 |
|
| 275 |
-
| cosine_recall@10 | 0.2369 |
|
| 276 |
| **cosine_ndcg@10** | **0.3885** |
|
| 277 |
| cosine_mrr@10 | 0.5802 |
|
| 278 |
| cosine_map@100 | 0.2538 |
|
|
|
|
| 162 |
This is a [sentence-transformers](https://www.SBERT.net) model finetuned on NFCorpus from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2).
|
| 163 |
It is specialised for Information retrieval (IR). Here is the relative improvement compared to the original model:
|
| 164 |
|
| 165 |
+
| Metric | Value | Value after finetuning |
|
| 166 |
+
|:--------------------|:-----------|:-----------------------|
|
| 167 |
+
| cosine_accuracy@1 | 0.34 | 0.49 |
|
| 168 |
+
| cosine_accuracy@3 | 0.57 | 0.68 |
|
| 169 |
+
| cosine_accuracy@5 | 0.64 | 0.76 |
|
| 170 |
+
| cosine_accuracy@10 | 0.72 | 0.83 |
|
| 171 |
+
| cosine_ndcg@10 | 0.26 | 0.39 |
|
| 172 |
+
| cosine_mrr@10 | 0.47 | 0.58 |
|
| 173 |
+
| cosine_map@100 | 0.12 | 0.26 |
|
| 174 |
+
|
| 175 |
+
More information on training and dev can be found below.
|
| 176 |
+
|
| 177 |
+
|
| 178 |
+
'dev_cosine_ndcg@10': 0.2596277626513332, 'dev_cosine_mrr@10': 0.46781182637664115, 'dev_cosine_map@100': 0.12158349529658409
|
| 179 |
## Model Details
|
| 180 |
|
| 181 |
### Model Description
|
|
|
|
| 279 |
| cosine_accuracy@3 | 0.6821 |
|
| 280 |
| cosine_accuracy@5 | 0.7593 |
|
| 281 |
| cosine_accuracy@10 | 0.8333 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 282 |
| **cosine_ndcg@10** | **0.3885** |
|
| 283 |
| cosine_mrr@10 | 0.5802 |
|
| 284 |
| cosine_map@100 | 0.2538 |
|