ClayAtlas commited on
Commit
aa8a738
·
verified ·
1 Parent(s): 2f53557

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1029 -0
README.md CHANGED
@@ -1,3 +1,1032 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: mit
3
  ---
 
1
  ---
2
+ tags:
3
+ - mteb
4
+ model-index:
5
+ - name: windberta
6
+ results:
7
+ - task:
8
+ type: STS
9
+ dataset:
10
+ type: C-MTEB/AFQMC
11
+ name: MTEB AFQMC
12
+ config: default
13
+ split: validation
14
+ revision: None
15
+ metrics:
16
+ - type: cos_sim_pearson
17
+ value: 42.33337754104733
18
+ - type: cos_sim_spearman
19
+ value: 46.77492896615997
20
+ - type: euclidean_pearson
21
+ value: 45.485443713440205
22
+ - type: euclidean_spearman
23
+ value: 46.77492896615997
24
+ - type: manhattan_pearson
25
+ value: 45.47908853063357
26
+ - type: manhattan_spearman
27
+ value: 46.78349339487035
28
+ - task:
29
+ type: STS
30
+ dataset:
31
+ type: C-MTEB/ATEC
32
+ name: MTEB ATEC
33
+ config: default
34
+ split: test
35
+ revision: None
36
+ metrics:
37
+ - type: cos_sim_pearson
38
+ value: 42.4857636418899
39
+ - type: cos_sim_spearman
40
+ value: 50.1796711684779
41
+ - type: euclidean_pearson
42
+ value: 50.19857844860528
43
+ - type: euclidean_spearman
44
+ value: 50.17966891674149
45
+ - type: manhattan_pearson
46
+ value: 50.189134647291425
47
+ - type: manhattan_spearman
48
+ value: 50.186194448855524
49
+ - task:
50
+ type: Classification
51
+ dataset:
52
+ type: mteb/amazon_reviews_multi
53
+ name: MTEB AmazonReviewsClassification (zh)
54
+ config: zh
55
+ split: test
56
+ revision: 1399c76144fd37290681b995c656ef9b2e06e26d
57
+ metrics:
58
+ - type: accuracy
59
+ value: 43.32
60
+ - type: f1
61
+ value: 41.656310147227025
62
+ - task:
63
+ type: STS
64
+ dataset:
65
+ type: C-MTEB/BQ
66
+ name: MTEB BQ
67
+ config: default
68
+ split: test
69
+ revision: None
70
+ metrics:
71
+ - type: cos_sim_pearson
72
+ value: 53.71954834756843
73
+ - type: cos_sim_spearman
74
+ value: 55.24915785430301
75
+ - type: euclidean_pearson
76
+ value: 54.51293350057512
77
+ - type: euclidean_spearman
78
+ value: 55.249150926099745
79
+ - type: manhattan_pearson
80
+ value: 54.47449996486367
81
+ - type: manhattan_spearman
82
+ value: 55.2105677621172
83
+ - task:
84
+ type: Clustering
85
+ dataset:
86
+ type: C-MTEB/CLSClusteringP2P
87
+ name: MTEB CLSClusteringP2P
88
+ config: default
89
+ split: test
90
+ revision: None
91
+ metrics:
92
+ - type: v_measure
93
+ value: 42.45793696381908
94
+ - task:
95
+ type: Clustering
96
+ dataset:
97
+ type: C-MTEB/CLSClusteringS2S
98
+ name: MTEB CLSClusteringS2S
99
+ config: default
100
+ split: test
101
+ revision: None
102
+ metrics:
103
+ - type: v_measure
104
+ value: 40.378561138339656
105
+ - task:
106
+ type: Reranking
107
+ dataset:
108
+ type: C-MTEB/CMedQAv1-reranking
109
+ name: MTEB CMedQAv1
110
+ config: default
111
+ split: test
112
+ revision: None
113
+ metrics:
114
+ - type: map
115
+ value: 77.41779986882574
116
+ - type: mrr
117
+ value: 81.09345238095239
118
+ - task:
119
+ type: Reranking
120
+ dataset:
121
+ type: C-MTEB/CMedQAv2-reranking
122
+ name: MTEB CMedQAv2
123
+ config: default
124
+ split: test
125
+ revision: None
126
+ metrics:
127
+ - type: map
128
+ value: 77.84113571204598
129
+ - type: mrr
130
+ value: 81.18206349206349
131
+ - task:
132
+ type: Retrieval
133
+ dataset:
134
+ type: C-MTEB/CmedqaRetrieval
135
+ name: MTEB CmedqaRetrieval
136
+ config: default
137
+ split: dev
138
+ revision: None
139
+ metrics:
140
+ - type: map_at_1
141
+ value: 18.706
142
+ - type: map_at_10
143
+ value: 27.782
144
+ - type: map_at_100
145
+ value: 29.482000000000003
146
+ - type: map_at_1000
147
+ value: 29.64
148
+ - type: map_at_3
149
+ value: 24.606
150
+ - type: map_at_5
151
+ value: 26.32
152
+ - type: mrr_at_1
153
+ value: 29.307
154
+ - type: mrr_at_10
155
+ value: 36.226
156
+ - type: mrr_at_100
157
+ value: 37.262
158
+ - type: mrr_at_1000
159
+ value: 37.335
160
+ - type: mrr_at_3
161
+ value: 33.928999999999995
162
+ - type: mrr_at_5
163
+ value: 35.181000000000004
164
+ - type: ndcg_at_1
165
+ value: 29.307
166
+ - type: ndcg_at_10
167
+ value: 33.452
168
+ - type: ndcg_at_100
169
+ value: 40.747
170
+ - type: ndcg_at_1000
171
+ value: 43.881
172
+ - type: ndcg_at_3
173
+ value: 29.186
174
+ - type: ndcg_at_5
175
+ value: 30.866
176
+ - type: precision_at_1
177
+ value: 29.307
178
+ - type: precision_at_10
179
+ value: 7.632
180
+ - type: precision_at_100
181
+ value: 1.357
182
+ - type: precision_at_1000
183
+ value: 0.17600000000000002
184
+ - type: precision_at_3
185
+ value: 16.688
186
+ - type: precision_at_5
187
+ value: 12.173
188
+ - type: recall_at_1
189
+ value: 18.706
190
+ - type: recall_at_10
191
+ value: 41.925000000000004
192
+ - type: recall_at_100
193
+ value: 72.817
194
+ - type: recall_at_1000
195
+ value: 94.33500000000001
196
+ - type: recall_at_3
197
+ value: 28.968
198
+ - type: recall_at_5
199
+ value: 34.29
200
+ - task:
201
+ type: PairClassification
202
+ dataset:
203
+ type: C-MTEB/CMNLI
204
+ name: MTEB Cmnli
205
+ config: default
206
+ split: validation
207
+ revision: None
208
+ metrics:
209
+ - type: cos_sim_accuracy
210
+ value: 79.84365604329525
211
+ - type: cos_sim_ap
212
+ value: 87.54800685674849
213
+ - type: cos_sim_f1
214
+ value: 81.0654184776552
215
+ - type: cos_sim_precision
216
+ value: 77.4488926746167
217
+ - type: cos_sim_recall
218
+ value: 85.0362403553893
219
+ - type: dot_accuracy
220
+ value: 79.84365604329525
221
+ - type: dot_ap
222
+ value: 87.55923139984687
223
+ - type: dot_f1
224
+ value: 81.0654184776552
225
+ - type: dot_precision
226
+ value: 77.4488926746167
227
+ - type: dot_recall
228
+ value: 85.0362403553893
229
+ - type: euclidean_accuracy
230
+ value: 79.84365604329525
231
+ - type: euclidean_ap
232
+ value: 87.54800685674849
233
+ - type: euclidean_f1
234
+ value: 81.0654184776552
235
+ - type: euclidean_precision
236
+ value: 77.4488926746167
237
+ - type: euclidean_recall
238
+ value: 85.0362403553893
239
+ - type: manhattan_accuracy
240
+ value: 79.7714972940469
241
+ - type: manhattan_ap
242
+ value: 87.55523320840679
243
+ - type: manhattan_f1
244
+ value: 80.99598034836983
245
+ - type: manhattan_precision
246
+ value: 77.51656336824108
247
+ - type: manhattan_recall
248
+ value: 84.80243161094225
249
+ - type: max_accuracy
250
+ value: 79.84365604329525
251
+ - type: max_ap
252
+ value: 87.55923139984687
253
+ - type: max_f1
254
+ value: 81.0654184776552
255
+ - task:
256
+ type: Retrieval
257
+ dataset:
258
+ type: C-MTEB/CovidRetrieval
259
+ name: MTEB CovidRetrieval
260
+ config: default
261
+ split: dev
262
+ revision: None
263
+ metrics:
264
+ - type: map_at_1
265
+ value: 60.589999999999996
266
+ - type: map_at_10
267
+ value: 69.27600000000001
268
+ - type: map_at_100
269
+ value: 69.812
270
+ - type: map_at_1000
271
+ value: 69.82300000000001
272
+ - type: map_at_3
273
+ value: 67.448
274
+ - type: map_at_5
275
+ value: 68.537
276
+ - type: mrr_at_1
277
+ value: 60.695
278
+ - type: mrr_at_10
279
+ value: 69.32300000000001
280
+ - type: mrr_at_100
281
+ value: 69.854
282
+ - type: mrr_at_1000
283
+ value: 69.865
284
+ - type: mrr_at_3
285
+ value: 67.545
286
+ - type: mrr_at_5
287
+ value: 68.625
288
+ - type: ndcg_at_1
289
+ value: 60.695
290
+ - type: ndcg_at_10
291
+ value: 73.36
292
+ - type: ndcg_at_100
293
+ value: 75.78200000000001
294
+ - type: ndcg_at_1000
295
+ value: 76.077
296
+ - type: ndcg_at_3
297
+ value: 69.639
298
+ - type: ndcg_at_5
299
+ value: 71.59400000000001
300
+ - type: precision_at_1
301
+ value: 60.695
302
+ - type: precision_at_10
303
+ value: 8.704
304
+ - type: precision_at_100
305
+ value: 0.98
306
+ - type: precision_at_1000
307
+ value: 0.1
308
+ - type: precision_at_3
309
+ value: 25.430000000000003
310
+ - type: precision_at_5
311
+ value: 16.27
312
+ - type: recall_at_1
313
+ value: 60.589999999999996
314
+ - type: recall_at_10
315
+ value: 86.038
316
+ - type: recall_at_100
317
+ value: 96.944
318
+ - type: recall_at_1000
319
+ value: 99.262
320
+ - type: recall_at_3
321
+ value: 75.869
322
+ - type: recall_at_5
323
+ value: 80.55799999999999
324
+ - task:
325
+ type: Retrieval
326
+ dataset:
327
+ type: C-MTEB/DuRetrieval
328
+ name: MTEB DuRetrieval
329
+ config: default
330
+ split: dev
331
+ revision: None
332
+ metrics:
333
+ - type: map_at_1
334
+ value: 23.294999999999998
335
+ - type: map_at_10
336
+ value: 70.99499999999999
337
+ - type: map_at_100
338
+ value: 74.126
339
+ - type: map_at_1000
340
+ value: 74.205
341
+ - type: map_at_3
342
+ value: 48.845
343
+ - type: map_at_5
344
+ value: 61.551
345
+ - type: mrr_at_1
346
+ value: 83.3
347
+ - type: mrr_at_10
348
+ value: 88.446
349
+ - type: mrr_at_100
350
+ value: 88.564
351
+ - type: mrr_at_1000
352
+ value: 88.57000000000001
353
+ - type: mrr_at_3
354
+ value: 88.0
355
+ - type: mrr_at_5
356
+ value: 88.25
357
+ - type: ndcg_at_1
358
+ value: 83.3
359
+ - type: ndcg_at_10
360
+ value: 80.128
361
+ - type: ndcg_at_100
362
+ value: 84.009
363
+ - type: ndcg_at_1000
364
+ value: 84.798
365
+ - type: ndcg_at_3
366
+ value: 78.79
367
+ - type: ndcg_at_5
368
+ value: 77.405
369
+ - type: precision_at_1
370
+ value: 83.3
371
+ - type: precision_at_10
372
+ value: 38.82
373
+ - type: precision_at_100
374
+ value: 4.657
375
+ - type: precision_at_1000
376
+ value: 0.484
377
+ - type: precision_at_3
378
+ value: 70.89999999999999
379
+ - type: precision_at_5
380
+ value: 59.550000000000004
381
+ - type: recall_at_1
382
+ value: 23.294999999999998
383
+ - type: recall_at_10
384
+ value: 82.12
385
+ - type: recall_at_100
386
+ value: 94.223
387
+ - type: recall_at_1000
388
+ value: 98.264
389
+ - type: recall_at_3
390
+ value: 51.946000000000005
391
+ - type: recall_at_5
392
+ value: 67.54299999999999
393
+ - task:
394
+ type: Retrieval
395
+ dataset:
396
+ type: C-MTEB/EcomRetrieval
397
+ name: MTEB EcomRetrieval
398
+ config: default
399
+ split: dev
400
+ revision: None
401
+ metrics:
402
+ - type: map_at_1
403
+ value: 42.0
404
+ - type: map_at_10
405
+ value: 51.207
406
+ - type: map_at_100
407
+ value: 51.964
408
+ - type: map_at_1000
409
+ value: 51.993
410
+ - type: map_at_3
411
+ value: 48.9
412
+ - type: map_at_5
413
+ value: 50.239999999999995
414
+ - type: mrr_at_1
415
+ value: 42.0
416
+ - type: mrr_at_10
417
+ value: 51.207
418
+ - type: mrr_at_100
419
+ value: 51.964
420
+ - type: mrr_at_1000
421
+ value: 51.993
422
+ - type: mrr_at_3
423
+ value: 48.9
424
+ - type: mrr_at_5
425
+ value: 50.239999999999995
426
+ - type: ndcg_at_1
427
+ value: 42.0
428
+ - type: ndcg_at_10
429
+ value: 55.886
430
+ - type: ndcg_at_100
431
+ value: 59.622
432
+ - type: ndcg_at_1000
433
+ value: 60.480999999999995
434
+ - type: ndcg_at_3
435
+ value: 51.112
436
+ - type: ndcg_at_5
437
+ value: 53.513
438
+ - type: precision_at_1
439
+ value: 42.0
440
+ - type: precision_at_10
441
+ value: 7.07
442
+ - type: precision_at_100
443
+ value: 0.8829999999999999
444
+ - type: precision_at_1000
445
+ value: 0.095
446
+ - type: precision_at_3
447
+ value: 19.167
448
+ - type: precision_at_5
449
+ value: 12.659999999999998
450
+ - type: recall_at_1
451
+ value: 42.0
452
+ - type: recall_at_10
453
+ value: 70.7
454
+ - type: recall_at_100
455
+ value: 88.3
456
+ - type: recall_at_1000
457
+ value: 95.19999999999999
458
+ - type: recall_at_3
459
+ value: 57.49999999999999
460
+ - type: recall_at_5
461
+ value: 63.3
462
+ - task:
463
+ type: Classification
464
+ dataset:
465
+ type: C-MTEB/IFlyTek-classification
466
+ name: MTEB IFlyTek
467
+ config: default
468
+ split: validation
469
+ revision: None
470
+ metrics:
471
+ - type: accuracy
472
+ value: 47.07964601769912
473
+ - type: f1
474
+ value: 35.71948030119852
475
+ - task:
476
+ type: Classification
477
+ dataset:
478
+ type: C-MTEB/JDReview-classification
479
+ name: MTEB JDReview
480
+ config: default
481
+ split: test
482
+ revision: None
483
+ metrics:
484
+ - type: accuracy
485
+ value: 84.48405253283303
486
+ - type: ap
487
+ value: 51.641044322555516
488
+ - type: f1
489
+ value: 79.09258868144057
490
+ - task:
491
+ type: STS
492
+ dataset:
493
+ type: C-MTEB/LCQMC
494
+ name: MTEB LCQMC
495
+ config: default
496
+ split: test
497
+ revision: None
498
+ metrics:
499
+ - type: cos_sim_pearson
500
+ value: 68.02458550340191
501
+ - type: cos_sim_spearman
502
+ value: 74.28734803466209
503
+ - type: euclidean_pearson
504
+ value: 73.34335009219284
505
+ - type: euclidean_spearman
506
+ value: 74.28734803466209
507
+ - type: manhattan_pearson
508
+ value: 73.34314353425192
509
+ - type: manhattan_spearman
510
+ value: 74.28417768884727
511
+ - task:
512
+ type: Reranking
513
+ dataset:
514
+ type: C-MTEB/Mmarco-reranking
515
+ name: MTEB MMarcoReranking
516
+ config: default
517
+ split: dev
518
+ revision: None
519
+ metrics:
520
+ - type: map
521
+ value: 30.17193800028175
522
+ - type: mrr
523
+ value: 29.161904761904765
524
+ - task:
525
+ type: Retrieval
526
+ dataset:
527
+ type: C-MTEB/MMarcoRetrieval
528
+ name: MTEB MMarcoRetrieval
529
+ config: default
530
+ split: dev
531
+ revision: None
532
+ metrics:
533
+ - type: map_at_1
534
+ value: 61.039
535
+ - type: map_at_10
536
+ value: 70.19999999999999
537
+ - type: map_at_100
538
+ value: 70.602
539
+ - type: map_at_1000
540
+ value: 70.62
541
+ - type: map_at_3
542
+ value: 68.133
543
+ - type: map_at_5
544
+ value: 69.503
545
+ - type: mrr_at_1
546
+ value: 63.066
547
+ - type: mrr_at_10
548
+ value: 70.831
549
+ - type: mrr_at_100
550
+ value: 71.186
551
+ - type: mrr_at_1000
552
+ value: 71.202
553
+ - type: mrr_at_3
554
+ value: 69.00699999999999
555
+ - type: mrr_at_5
556
+ value: 70.22699999999999
557
+ - type: ndcg_at_1
558
+ value: 63.066
559
+ - type: ndcg_at_10
560
+ value: 74.141
561
+ - type: ndcg_at_100
562
+ value: 75.976
563
+ - type: ndcg_at_1000
564
+ value: 76.462
565
+ - type: ndcg_at_3
566
+ value: 70.242
567
+ - type: ndcg_at_5
568
+ value: 72.58099999999999
569
+ - type: precision_at_1
570
+ value: 63.066
571
+ - type: precision_at_10
572
+ value: 9.097
573
+ - type: precision_at_100
574
+ value: 1.001
575
+ - type: precision_at_1000
576
+ value: 0.104
577
+ - type: precision_at_3
578
+ value: 26.571
579
+ - type: precision_at_5
580
+ value: 17.166
581
+ - type: recall_at_1
582
+ value: 61.039
583
+ - type: recall_at_10
584
+ value: 85.666
585
+ - type: recall_at_100
586
+ value: 94.017
587
+ - type: recall_at_1000
588
+ value: 97.819
589
+ - type: recall_at_3
590
+ value: 75.45100000000001
591
+ - type: recall_at_5
592
+ value: 81.02000000000001
593
+ - task:
594
+ type: Retrieval
595
+ dataset:
596
+ type: C-MTEB/MedicalRetrieval
597
+ name: MTEB MedicalRetrieval
598
+ config: default
599
+ split: dev
600
+ revision: None
601
+ metrics:
602
+ - type: map_at_1
603
+ value: 42.199999999999996
604
+ - type: map_at_10
605
+ value: 47.774
606
+ - type: map_at_100
607
+ value: 48.324
608
+ - type: map_at_1000
609
+ value: 48.392
610
+ - type: map_at_3
611
+ value: 46.317
612
+ - type: map_at_5
613
+ value: 47.072
614
+ - type: mrr_at_1
615
+ value: 42.3
616
+ - type: mrr_at_10
617
+ value: 47.827
618
+ - type: mrr_at_100
619
+ value: 48.378
620
+ - type: mrr_at_1000
621
+ value: 48.446
622
+ - type: mrr_at_3
623
+ value: 46.367000000000004
624
+ - type: mrr_at_5
625
+ value: 47.142
626
+ - type: ndcg_at_1
627
+ value: 42.199999999999996
628
+ - type: ndcg_at_10
629
+ value: 50.671
630
+ - type: ndcg_at_100
631
+ value: 53.724000000000004
632
+ - type: ndcg_at_1000
633
+ value: 55.694
634
+ - type: ndcg_at_3
635
+ value: 47.625
636
+ - type: ndcg_at_5
637
+ value: 48.964
638
+ - type: precision_at_1
639
+ value: 42.199999999999996
640
+ - type: precision_at_10
641
+ value: 5.99
642
+ - type: precision_at_100
643
+ value: 0.751
644
+ - type: precision_at_1000
645
+ value: 0.091
646
+ - type: precision_at_3
647
+ value: 17.133000000000003
648
+ - type: precision_at_5
649
+ value: 10.92
650
+ - type: recall_at_1
651
+ value: 42.199999999999996
652
+ - type: recall_at_10
653
+ value: 59.9
654
+ - type: recall_at_100
655
+ value: 75.1
656
+ - type: recall_at_1000
657
+ value: 91.0
658
+ - type: recall_at_3
659
+ value: 51.4
660
+ - type: recall_at_5
661
+ value: 54.6
662
+ - task:
663
+ type: Classification
664
+ dataset:
665
+ type: C-MTEB/MultilingualSentiment-classification
666
+ name: MTEB MultilingualSentiment
667
+ config: default
668
+ split: validation
669
+ revision: None
670
+ metrics:
671
+ - type: accuracy
672
+ value: 72.68333333333334
673
+ - type: f1
674
+ value: 72.53084383657173
675
+ - task:
676
+ type: PairClassification
677
+ dataset:
678
+ type: C-MTEB/OCNLI
679
+ name: MTEB Ocnli
680
+ config: default
681
+ split: validation
682
+ revision: None
683
+ metrics:
684
+ - type: cos_sim_accuracy
685
+ value: 72.92907417433676
686
+ - type: cos_sim_ap
687
+ value: 77.2067217322648
688
+ - type: cos_sim_f1
689
+ value: 76.53631284916202
690
+ - type: cos_sim_precision
691
+ value: 68.44296419650291
692
+ - type: cos_sim_recall
693
+ value: 86.80042238648363
694
+ - type: dot_accuracy
695
+ value: 72.92907417433676
696
+ - type: dot_ap
697
+ value: 77.2067217322648
698
+ - type: dot_f1
699
+ value: 76.53631284916202
700
+ - type: dot_precision
701
+ value: 68.44296419650291
702
+ - type: dot_recall
703
+ value: 86.80042238648363
704
+ - type: euclidean_accuracy
705
+ value: 72.92907417433676
706
+ - type: euclidean_ap
707
+ value: 77.2067217322648
708
+ - type: euclidean_f1
709
+ value: 76.53631284916202
710
+ - type: euclidean_precision
711
+ value: 68.44296419650291
712
+ - type: euclidean_recall
713
+ value: 86.80042238648363
714
+ - type: manhattan_accuracy
715
+ value: 72.98321602598809
716
+ - type: manhattan_ap
717
+ value: 77.10385348859928
718
+ - type: manhattan_f1
719
+ value: 76.67134174848059
720
+ - type: manhattan_precision
721
+ value: 68.79194630872483
722
+ - type: manhattan_recall
723
+ value: 86.58922914466737
724
+ - type: max_accuracy
725
+ value: 72.98321602598809
726
+ - type: max_ap
727
+ value: 77.2067217322648
728
+ - type: max_f1
729
+ value: 76.67134174848059
730
+ - task:
731
+ type: Classification
732
+ dataset:
733
+ type: C-MTEB/OnlineShopping-classification
734
+ name: MTEB OnlineShopping
735
+ config: default
736
+ split: test
737
+ revision: None
738
+ metrics:
739
+ - type: accuracy
740
+ value: 92.11000000000003
741
+ - type: ap
742
+ value: 90.49414877664759
743
+ - type: f1
744
+ value: 92.10539417755511
745
+ - task:
746
+ type: STS
747
+ dataset:
748
+ type: C-MTEB/PAWSX
749
+ name: MTEB PAWSX
750
+ config: default
751
+ split: test
752
+ revision: None
753
+ metrics:
754
+ - type: cos_sim_pearson
755
+ value: 29.106919865870793
756
+ - type: cos_sim_spearman
757
+ value: 33.23892524348652
758
+ - type: euclidean_pearson
759
+ value: 33.62483348491917
760
+ - type: euclidean_spearman
761
+ value: 33.23892524348652
762
+ - type: manhattan_pearson
763
+ value: 33.63464275000747
764
+ - type: manhattan_spearman
765
+ value: 33.250596030941196
766
+ - task:
767
+ type: STS
768
+ dataset:
769
+ type: C-MTEB/QBQTC
770
+ name: MTEB QBQTC
771
+ config: default
772
+ split: test
773
+ revision: None
774
+ metrics:
775
+ - type: cos_sim_pearson
776
+ value: 28.83792748309052
777
+ - type: cos_sim_spearman
778
+ value: 30.92395949947476
779
+ - type: euclidean_pearson
780
+ value: 29.296076928835973
781
+ - type: euclidean_spearman
782
+ value: 30.92395949947476
783
+ - type: manhattan_pearson
784
+ value: 29.220578930008596
785
+ - type: manhattan_spearman
786
+ value: 30.848850181684227
787
+ - task:
788
+ type: STS
789
+ dataset:
790
+ type: mteb/sts22-crosslingual-sts
791
+ name: MTEB STS22 (zh)
792
+ config: zh
793
+ split: test
794
+ revision: 6d1ba47164174a496b7fa5d3569dae26a6813b80
795
+ metrics:
796
+ - type: cos_sim_pearson
797
+ value: 62.485183619582465
798
+ - type: cos_sim_spearman
799
+ value: 64.41414883218417
800
+ - type: euclidean_pearson
801
+ value: 63.53854165422046
802
+ - type: euclidean_spearman
803
+ value: 64.41414883218417
804
+ - type: manhattan_pearson
805
+ value: 63.57621522539751
806
+ - type: manhattan_spearman
807
+ value: 64.49062238421523
808
+ - task:
809
+ type: STS
810
+ dataset:
811
+ type: C-MTEB/STSB
812
+ name: MTEB STSB
813
+ config: default
814
+ split: test
815
+ revision: None
816
+ metrics:
817
+ - type: cos_sim_pearson
818
+ value: 78.96466421469466
819
+ - type: cos_sim_spearman
820
+ value: 79.74344126074892
821
+ - type: euclidean_pearson
822
+ value: 79.57588420768205
823
+ - type: euclidean_spearman
824
+ value: 79.74344126074892
825
+ - type: manhattan_pearson
826
+ value: 79.50301779470537
827
+ - type: manhattan_spearman
828
+ value: 79.67817007436709
829
+ - task:
830
+ type: Reranking
831
+ dataset:
832
+ type: C-MTEB/T2Reranking
833
+ name: MTEB T2Reranking
834
+ config: default
835
+ split: dev
836
+ revision: None
837
+ metrics:
838
+ - type: map
839
+ value: 65.85321176285859
840
+ - type: mrr
841
+ value: 75.72496534158688
842
+ - task:
843
+ type: Retrieval
844
+ dataset:
845
+ type: C-MTEB/T2Retrieval
846
+ name: MTEB T2Retrieval
847
+ config: default
848
+ split: dev
849
+ revision: None
850
+ metrics:
851
+ - type: map_at_1
852
+ value: 24.437
853
+ - type: map_at_10
854
+ value: 67.85799999999999
855
+ - type: map_at_100
856
+ value: 71.65599999999999
857
+ - type: map_at_1000
858
+ value: 71.771
859
+ - type: map_at_3
860
+ value: 47.752
861
+ - type: map_at_5
862
+ value: 58.620000000000005
863
+ - type: mrr_at_1
864
+ value: 83.776
865
+ - type: mrr_at_10
866
+ value: 87.36699999999999
867
+ - type: mrr_at_100
868
+ value: 87.529
869
+ - type: mrr_at_1000
870
+ value: 87.535
871
+ - type: mrr_at_3
872
+ value: 86.669
873
+ - type: mrr_at_5
874
+ value: 87.126
875
+ - type: ndcg_at_1
876
+ value: 83.776
877
+ - type: ndcg_at_10
878
+ value: 76.839
879
+ - type: ndcg_at_100
880
+ value: 81.547
881
+ - type: ndcg_at_1000
882
+ value: 82.723
883
+ - type: ndcg_at_3
884
+ value: 78.731
885
+ - type: ndcg_at_5
886
+ value: 76.982
887
+ - type: precision_at_1
888
+ value: 83.776
889
+ - type: precision_at_10
890
+ value: 38.507999999999996
891
+ - type: precision_at_100
892
+ value: 4.809
893
+ - type: precision_at_1000
894
+ value: 0.509
895
+ - type: precision_at_3
896
+ value: 69.151
897
+ - type: precision_at_5
898
+ value: 57.74399999999999
899
+ - type: recall_at_1
900
+ value: 24.437
901
+ - type: recall_at_10
902
+ value: 75.887
903
+ - type: recall_at_100
904
+ value: 91.104
905
+ - type: recall_at_1000
906
+ value: 97.024
907
+ - type: recall_at_3
908
+ value: 49.835
909
+ - type: recall_at_5
910
+ value: 62.854
911
+ - task:
912
+ type: Classification
913
+ dataset:
914
+ type: C-MTEB/TNews-classification
915
+ name: MTEB TNews
916
+ config: default
917
+ split: validation
918
+ revision: None
919
+ metrics:
920
+ - type: accuracy
921
+ value: 49.851
922
+ - type: f1
923
+ value: 48.115308719873006
924
+ - task:
925
+ type: Clustering
926
+ dataset:
927
+ type: C-MTEB/ThuNewsClusteringP2P
928
+ name: MTEB ThuNewsClusteringP2P
929
+ config: default
930
+ split: test
931
+ revision: None
932
+ metrics:
933
+ - type: v_measure
934
+ value: 58.53624772949936
935
+ - task:
936
+ type: Clustering
937
+ dataset:
938
+ type: C-MTEB/ThuNewsClusteringS2S
939
+ name: MTEB ThuNewsClusteringS2S
940
+ config: default
941
+ split: test
942
+ revision: None
943
+ metrics:
944
+ - type: v_measure
945
+ value: 54.145039782849956
946
+ - task:
947
+ type: Retrieval
948
+ dataset:
949
+ type: C-MTEB/VideoRetrieval
950
+ name: MTEB VideoRetrieval
951
+ config: default
952
+ split: dev
953
+ revision: None
954
+ metrics:
955
+ - type: map_at_1
956
+ value: 49.0
957
+ - type: map_at_10
958
+ value: 58.888
959
+ - type: map_at_100
960
+ value: 59.512
961
+ - type: map_at_1000
962
+ value: 59.532
963
+ - type: map_at_3
964
+ value: 56.65
965
+ - type: map_at_5
966
+ value: 57.91
967
+ - type: mrr_at_1
968
+ value: 49.0
969
+ - type: mrr_at_10
970
+ value: 58.888
971
+ - type: mrr_at_100
972
+ value: 59.512
973
+ - type: mrr_at_1000
974
+ value: 59.532
975
+ - type: mrr_at_3
976
+ value: 56.65
977
+ - type: mrr_at_5
978
+ value: 57.91
979
+ - type: ndcg_at_1
980
+ value: 49.0
981
+ - type: ndcg_at_10
982
+ value: 63.656
983
+ - type: ndcg_at_100
984
+ value: 66.666
985
+ - type: ndcg_at_1000
986
+ value: 67.269
987
+ - type: ndcg_at_3
988
+ value: 59.082
989
+ - type: ndcg_at_5
990
+ value: 61.35
991
+ - type: precision_at_1
992
+ value: 49.0
993
+ - type: precision_at_10
994
+ value: 7.86
995
+ - type: precision_at_100
996
+ value: 0.9259999999999999
997
+ - type: precision_at_1000
998
+ value: 0.098
999
+ - type: precision_at_3
1000
+ value: 22.033
1001
+ - type: precision_at_5
1002
+ value: 14.32
1003
+ - type: recall_at_1
1004
+ value: 49.0
1005
+ - type: recall_at_10
1006
+ value: 78.60000000000001
1007
+ - type: recall_at_100
1008
+ value: 92.60000000000001
1009
+ - type: recall_at_1000
1010
+ value: 97.5
1011
+ - type: recall_at_3
1012
+ value: 66.10000000000001
1013
+ - type: recall_at_5
1014
+ value: 71.6
1015
+ - task:
1016
+ type: Classification
1017
+ dataset:
1018
+ type: C-MTEB/waimai-classification
1019
+ name: MTEB Waimai
1020
+ config: default
1021
+ split: test
1022
+ revision: None
1023
+ metrics:
1024
+ - type: accuracy
1025
+ value: 86.44000000000001
1026
+ - type: ap
1027
+ value: 69.51298270778649
1028
+ - type: f1
1029
+ value: 84.72728998827236
1030
+ ---
1031
  license: mit
1032
  ---