dboyker-code commited on
Commit
faa38b3
·
verified ·
1 Parent(s): f9897c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -162,6 +162,20 @@ model-index:
162
  This is a [sentence-transformers](https://www.SBERT.net) model finetuned on NFCorpus from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2).
163
  It is specialised for Information retrieval (IR). Here is the relative improvement compared to the original model:
164
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
165
  ## Model Details
166
 
167
  ### Model Description
@@ -265,14 +279,6 @@ You can finetune this model on your own dataset.
265
  | cosine_accuracy@3 | 0.6821 |
266
  | cosine_accuracy@5 | 0.7593 |
267
  | cosine_accuracy@10 | 0.8333 |
268
- | cosine_precision@1 | 0.4383 |
269
- | cosine_precision@3 | 0.3765 |
270
- | cosine_precision@5 | 0.3556 |
271
- | cosine_precision@10 | 0.3006 |
272
- | cosine_recall@1 | 0.0606 |
273
- | cosine_recall@3 | 0.1171 |
274
- | cosine_recall@5 | 0.1602 |
275
- | cosine_recall@10 | 0.2369 |
276
  | **cosine_ndcg@10** | **0.3885** |
277
  | cosine_mrr@10 | 0.5802 |
278
  | cosine_map@100 | 0.2538 |
 
162
  This is a [sentence-transformers](https://www.SBERT.net) model finetuned on NFCorpus from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2).
163
  It is specialised for Information retrieval (IR). Here is the relative improvement compared to the original model:
164
 
165
+ | Metric | Value | Value after finetuning |
166
+ |:--------------------|:-----------|:-----------------------|
167
+ | cosine_accuracy@1 | 0.34 | 0.49 |
168
+ | cosine_accuracy@3 | 0.57 | 0.68 |
169
+ | cosine_accuracy@5 | 0.64 | 0.76 |
170
+ | cosine_accuracy@10 | 0.72 | 0.83 |
171
+ | cosine_ndcg@10 | 0.26 | 0.39 |
172
+ | cosine_mrr@10 | 0.47 | 0.58 |
173
+ | cosine_map@100 | 0.12 | 0.26 |
174
+
175
+ More information on training and dev can be found below.
176
+
177
+
178
+ 'dev_cosine_ndcg@10': 0.2596277626513332, 'dev_cosine_mrr@10': 0.46781182637664115, 'dev_cosine_map@100': 0.12158349529658409
179
  ## Model Details
180
 
181
  ### Model Description
 
279
  | cosine_accuracy@3 | 0.6821 |
280
  | cosine_accuracy@5 | 0.7593 |
281
  | cosine_accuracy@10 | 0.8333 |
 
 
 
 
 
 
 
 
282
  | **cosine_ndcg@10** | **0.3885** |
283
  | cosine_mrr@10 | 0.5802 |
284
  | cosine_map@100 | 0.2538 |