Hugging Face's logo

mteb
/
baseline-bm25s

Text Ranking
mteb
Eval Results
Model card Files
xet
 Community
8

Add evaluation results for model mteb/baseline-bm25s revision 0_1_10

#8
by KennethEnevoldsen - opened
base: refs/heads/main
←
from: refs/pr/8
Discussion Files changed
+6181
-0

YAML Metadata Error:Invalid Eval Result format in .eval_results/BelebeleRetrieval.yaml

Check out the documentation for more information.

Show details
✖ Invalid input: expected string, received null → at [24].notes

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_256" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_512" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_1024" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_2048" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_4096" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_8192" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_16384" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval_default_test_32768" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/LEMBPasskeyRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "LEMBPasskeyRetrieval" does not match any task in dataset "mteb/LEMBPasskeyRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/StackOverflowQA.yaml

Check out the documentation for more information.

Show details
Task ID "StackOverflowQA_default_test" does not match any task in dataset "mteb/StackOverflowQA". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/StackOverflowQA.yaml

Check out the documentation for more information.

Show details
Task ID "StackOverflowQA" does not match any task in dataset "mteb/StackOverflowQA". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/StatcanDialogueDatasetRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "StatcanDialogueDatasetRetrieval_english_dev" does not match any task in dataset "mteb/StatcanDialogueDatasetRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/StatcanDialogueDatasetRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "StatcanDialogueDatasetRetrieval_french_dev" does not match any task in dataset "mteb/StatcanDialogueDatasetRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/StatcanDialogueDatasetRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "StatcanDialogueDatasetRetrieval_english_test" does not match any task in dataset "mteb/StatcanDialogueDatasetRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/StatcanDialogueDatasetRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "StatcanDialogueDatasetRetrieval_french_test" does not match any task in dataset "mteb/StatcanDialogueDatasetRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/StatcanDialogueDatasetRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "StatcanDialogueDatasetRetrieval" does not match any task in dataset "mteb/StatcanDialogueDatasetRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/TwitterHjerneRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "TwitterHjerneRetrieval_default_train" does not match any task in dataset "mteb/TwitterHjerneRetrieval". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/TwitterHjerneRetrieval.yaml

Check out the documentation for more information.

Show details
Task ID "TwitterHjerneRetrieval" does not match any task in dataset "mteb/TwitterHjerneRetrieval". Available: none
Files changed (23) hide show
  1. .eval_results/AlloprofReranking.yaml +22 -0
  2. .eval_results/BelebeleRetrieval.yaml +0 -0
  3. .eval_results/Core17InstructionRetrieval.yaml +22 -0
  4. .eval_results/CovidRetrieval.yaml +22 -0
  5. .eval_results/HagridRetrieval.yaml +22 -0
  6. .eval_results/LEMBPasskeyRetrieval.yaml +99 -0
  7. .eval_results/LegalBenchCorporateLobbying.yaml +22 -0
  8. .eval_results/MLQARetrieval.yaml +1089 -0
  9. .eval_results/MTEB(Multilingual, v2).yaml +10 -0
  10. .eval_results/News21InstructionRetrieval.yaml +22 -0
  11. .eval_results/Robust04InstructionRetrieval.yaml +22 -0
  12. .eval_results/RuBQReranking.yaml +22 -0
  13. .eval_results/SpartQA.yaml +22 -0
  14. .eval_results/StackOverflowQA.yaml +22 -0
  15. .eval_results/StatcanDialogueDatasetRetrieval.yaml +55 -0
  16. .eval_results/T2Reranking.yaml +22 -0
  17. .eval_results/TempReasonL1.yaml +22 -0
  18. .eval_results/TwitterHjerneRetrieval.yaml +22 -0
  19. .eval_results/VoyageMMarcoReranking.yaml +22 -0
  20. .eval_results/WebLINXCandidatesReranking.yaml +77 -0
  21. .eval_results/WikipediaRerankingMultilingual.yaml +187 -0
  22. .eval_results/WikipediaRetrievalMultilingual.yaml +187 -0
  23. .eval_results/WinoGrande.yaml +22 -0
.eval_results/AlloprofReranking.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/AlloprofReranking
3
+ task_id: AlloprofReranking_default_test
4
+ revision: a7d2d793f2e5ba55139bb10088c2e8ee2df2ce02
5
+ value: 44.604
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/AlloprofReranking
14
+ task_id: AlloprofReranking
15
+ revision: a7d2d793f2e5ba55139bb10088c2e8ee2df2ce02
16
+ value: 44.604
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/BelebeleRetrieval.yaml ADDED
The diff for this file is too large to render. See raw diff
 
.eval_results/Core17InstructionRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/Core17InstructionRetrieval
3
+ task_id: Core17InstructionRetrieval_default_test
4
+ revision: 67d8733dd0691f08f34ed9dda5941578cba8d91c
5
+ value: -2.0438
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/Core17InstructionRetrieval
14
+ task_id: Core17InstructionRetrieval
15
+ revision: 67d8733dd0691f08f34ed9dda5941578cba8d91c
16
+ value: -2.0438
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/CovidRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/CovidRetrieval
3
+ task_id: CovidRetrieval_default_dev
4
+ revision: 9c6dc4b276bb47c3ff725bbc5ffcafd56dded38b
5
+ value: 15.245
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/CovidRetrieval
14
+ task_id: CovidRetrieval
15
+ revision: 9c6dc4b276bb47c3ff725bbc5ffcafd56dded38b
16
+ value: 15.245
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/HagridRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/HagridRetrieval
3
+ task_id: HagridRetrieval_default_dev
4
+ revision: ae4f8bebcb82af2028863b778e1eebf4f5f23628
5
+ value: 97.619
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/HagridRetrieval
14
+ task_id: HagridRetrieval
15
+ revision: ae4f8bebcb82af2028863b778e1eebf4f5f23628
16
+ value: 97.619
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/LEMBPasskeyRetrieval.yaml ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/LEMBPasskeyRetrieval
3
+ task_id: LEMBPasskeyRetrieval_default_test_256
4
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
5
+ value: 100.0
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/LEMBPasskeyRetrieval
14
+ task_id: LEMBPasskeyRetrieval_default_test_512
15
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
16
+ value: 100.0
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
23
+ - dataset:
24
+ id: mteb/LEMBPasskeyRetrieval
25
+ task_id: LEMBPasskeyRetrieval_default_test_1024
26
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
27
+ value: 100.0
28
+ date: '2026-03-09'
29
+ notes: Obtained using MTEB v2.10.8
30
+ source:
31
+ url: https://github.com/embeddings-benchmark/mteb/
32
+ name: Obtained using MTEB v2.10.8
33
+ user: mteb
34
+ - dataset:
35
+ id: mteb/LEMBPasskeyRetrieval
36
+ task_id: LEMBPasskeyRetrieval_default_test_2048
37
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
38
+ value: 100.0
39
+ date: '2026-03-09'
40
+ notes: Obtained using MTEB v2.10.8
41
+ source:
42
+ url: https://github.com/embeddings-benchmark/mteb/
43
+ name: Obtained using MTEB v2.10.8
44
+ user: mteb
45
+ - dataset:
46
+ id: mteb/LEMBPasskeyRetrieval
47
+ task_id: LEMBPasskeyRetrieval_default_test_4096
48
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
49
+ value: 100.0
50
+ date: '2026-03-09'
51
+ notes: Obtained using MTEB v2.10.8
52
+ source:
53
+ url: https://github.com/embeddings-benchmark/mteb/
54
+ name: Obtained using MTEB v2.10.8
55
+ user: mteb
56
+ - dataset:
57
+ id: mteb/LEMBPasskeyRetrieval
58
+ task_id: LEMBPasskeyRetrieval_default_test_8192
59
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
60
+ value: 100.0
61
+ date: '2026-03-09'
62
+ notes: Obtained using MTEB v2.10.8
63
+ source:
64
+ url: https://github.com/embeddings-benchmark/mteb/
65
+ name: Obtained using MTEB v2.10.8
66
+ user: mteb
67
+ - dataset:
68
+ id: mteb/LEMBPasskeyRetrieval
69
+ task_id: LEMBPasskeyRetrieval_default_test_16384
70
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
71
+ value: 100.0
72
+ date: '2026-03-09'
73
+ notes: Obtained using MTEB v2.10.8
74
+ source:
75
+ url: https://github.com/embeddings-benchmark/mteb/
76
+ name: Obtained using MTEB v2.10.8
77
+ user: mteb
78
+ - dataset:
79
+ id: mteb/LEMBPasskeyRetrieval
80
+ task_id: LEMBPasskeyRetrieval_default_test_32768
81
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
82
+ value: 100.0
83
+ date: '2026-03-09'
84
+ notes: Obtained using MTEB v2.10.8
85
+ source:
86
+ url: https://github.com/embeddings-benchmark/mteb/
87
+ name: Obtained using MTEB v2.10.8
88
+ user: mteb
89
+ - dataset:
90
+ id: mteb/LEMBPasskeyRetrieval
91
+ task_id: LEMBPasskeyRetrieval
92
+ revision: 86ac5a6437198a94ecd666440c78b3e78f258274
93
+ value: 100.0
94
+ date: '2026-03-09'
95
+ notes: Obtained using MTEB v2.10.8
96
+ source:
97
+ url: https://github.com/embeddings-benchmark/mteb/
98
+ name: Obtained using MTEB v2.10.8
99
+ user: mteb
.eval_results/LegalBenchCorporateLobbying.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/legalbench_corporate_lobbying
3
+ task_id: LegalBenchCorporateLobbying_default_test
4
+ revision: f69691c650464e62546d7f2a4536f8f87c891e38
5
+ value: 90.946
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/legalbench_corporate_lobbying
14
+ task_id: LegalBenchCorporateLobbying
15
+ revision: f69691c650464e62546d7f2a4536f8f87c891e38
16
+ value: 90.946
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/MLQARetrieval.yaml ADDED
@@ -0,0 +1,1089 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/MLQARetrieval
3
+ task_id: MLQARetrieval_ara-ara_validation
4
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
5
+ value: 61.889
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/MLQARetrieval
14
+ task_id: MLQARetrieval_ara-deu_validation
15
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
16
+ value: 2.747
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
23
+ - dataset:
24
+ id: mteb/MLQARetrieval
25
+ task_id: MLQARetrieval_ara-eng_validation
26
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
27
+ value: 12.341
28
+ date: '2026-03-09'
29
+ notes: Obtained using MTEB v2.10.8
30
+ source:
31
+ url: https://github.com/embeddings-benchmark/mteb/
32
+ name: Obtained using MTEB v2.10.8
33
+ user: mteb
34
+ - dataset:
35
+ id: mteb/MLQARetrieval
36
+ task_id: MLQARetrieval_ara-spa_validation
37
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
38
+ value: 12.211
39
+ date: '2026-03-09'
40
+ notes: Obtained using MTEB v2.10.8
41
+ source:
42
+ url: https://github.com/embeddings-benchmark/mteb/
43
+ name: Obtained using MTEB v2.10.8
44
+ user: mteb
45
+ - dataset:
46
+ id: mteb/MLQARetrieval
47
+ task_id: MLQARetrieval_ara-hin_validation
48
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
49
+ value: 9.072
50
+ date: '2026-03-09'
51
+ notes: Obtained using MTEB v2.10.8
52
+ source:
53
+ url: https://github.com/embeddings-benchmark/mteb/
54
+ name: Obtained using MTEB v2.10.8
55
+ user: mteb
56
+ - dataset:
57
+ id: mteb/MLQARetrieval
58
+ task_id: MLQARetrieval_ara-vie_validation
59
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
60
+ value: 11.158
61
+ date: '2026-03-09'
62
+ notes: Obtained using MTEB v2.10.8
63
+ source:
64
+ url: https://github.com/embeddings-benchmark/mteb/
65
+ name: Obtained using MTEB v2.10.8
66
+ user: mteb
67
+ - dataset:
68
+ id: mteb/MLQARetrieval
69
+ task_id: MLQARetrieval_ara-zho_validation
70
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
71
+ value: 5.412
72
+ date: '2026-03-09'
73
+ notes: Obtained using MTEB v2.10.8
74
+ source:
75
+ url: https://github.com/embeddings-benchmark/mteb/
76
+ name: Obtained using MTEB v2.10.8
77
+ user: mteb
78
+ - dataset:
79
+ id: mteb/MLQARetrieval
80
+ task_id: MLQARetrieval_deu-ara_validation
81
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
82
+ value: 10.001
83
+ date: '2026-03-09'
84
+ notes: Obtained using MTEB v2.10.8
85
+ source:
86
+ url: https://github.com/embeddings-benchmark/mteb/
87
+ name: Obtained using MTEB v2.10.8
88
+ user: mteb
89
+ - dataset:
90
+ id: mteb/MLQARetrieval
91
+ task_id: MLQARetrieval_deu-deu_validation
92
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
93
+ value: 65.36
94
+ date: '2026-03-09'
95
+ notes: Obtained using MTEB v2.10.8
96
+ source:
97
+ url: https://github.com/embeddings-benchmark/mteb/
98
+ name: Obtained using MTEB v2.10.8
99
+ user: mteb
100
+ - dataset:
101
+ id: mteb/MLQARetrieval
102
+ task_id: MLQARetrieval_deu-eng_validation
103
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
104
+ value: 45.34
105
+ date: '2026-03-09'
106
+ notes: Obtained using MTEB v2.10.8
107
+ source:
108
+ url: https://github.com/embeddings-benchmark/mteb/
109
+ name: Obtained using MTEB v2.10.8
110
+ user: mteb
111
+ - dataset:
112
+ id: mteb/MLQARetrieval
113
+ task_id: MLQARetrieval_deu-spa_validation
114
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
115
+ value: 34.527
116
+ date: '2026-03-09'
117
+ notes: Obtained using MTEB v2.10.8
118
+ source:
119
+ url: https://github.com/embeddings-benchmark/mteb/
120
+ name: Obtained using MTEB v2.10.8
121
+ user: mteb
122
+ - dataset:
123
+ id: mteb/MLQARetrieval
124
+ task_id: MLQARetrieval_deu-hin_validation
125
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
126
+ value: 12.813
127
+ date: '2026-03-09'
128
+ notes: Obtained using MTEB v2.10.8
129
+ source:
130
+ url: https://github.com/embeddings-benchmark/mteb/
131
+ name: Obtained using MTEB v2.10.8
132
+ user: mteb
133
+ - dataset:
134
+ id: mteb/MLQARetrieval
135
+ task_id: MLQARetrieval_deu-vie_validation
136
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
137
+ value: 47.141
138
+ date: '2026-03-09'
139
+ notes: Obtained using MTEB v2.10.8
140
+ source:
141
+ url: https://github.com/embeddings-benchmark/mteb/
142
+ name: Obtained using MTEB v2.10.8
143
+ user: mteb
144
+ - dataset:
145
+ id: mteb/MLQARetrieval
146
+ task_id: MLQARetrieval_deu-zho_validation
147
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
148
+ value: 3.444
149
+ date: '2026-03-09'
150
+ notes: Obtained using MTEB v2.10.8
151
+ source:
152
+ url: https://github.com/embeddings-benchmark/mteb/
153
+ name: Obtained using MTEB v2.10.8
154
+ user: mteb
155
+ - dataset:
156
+ id: mteb/MLQARetrieval
157
+ task_id: MLQARetrieval_eng-ara_validation
158
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
159
+ value: 7.532
160
+ date: '2026-03-09'
161
+ notes: Obtained using MTEB v2.10.8
162
+ source:
163
+ url: https://github.com/embeddings-benchmark/mteb/
164
+ name: Obtained using MTEB v2.10.8
165
+ user: mteb
166
+ - dataset:
167
+ id: mteb/MLQARetrieval
168
+ task_id: MLQARetrieval_eng-deu_validation
169
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
170
+ value: 45.91
171
+ date: '2026-03-09'
172
+ notes: Obtained using MTEB v2.10.8
173
+ source:
174
+ url: https://github.com/embeddings-benchmark/mteb/
175
+ name: Obtained using MTEB v2.10.8
176
+ user: mteb
177
+ - dataset:
178
+ id: mteb/MLQARetrieval
179
+ task_id: MLQARetrieval_eng-eng_validation
180
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
181
+ value: 85.047
182
+ date: '2026-03-09'
183
+ notes: Obtained using MTEB v2.10.8
184
+ source:
185
+ url: https://github.com/embeddings-benchmark/mteb/
186
+ name: Obtained using MTEB v2.10.8
187
+ user: mteb
188
+ - dataset:
189
+ id: mteb/MLQARetrieval
190
+ task_id: MLQARetrieval_eng-spa_validation
191
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
192
+ value: 38.111
193
+ date: '2026-03-09'
194
+ notes: Obtained using MTEB v2.10.8
195
+ source:
196
+ url: https://github.com/embeddings-benchmark/mteb/
197
+ name: Obtained using MTEB v2.10.8
198
+ user: mteb
199
+ - dataset:
200
+ id: mteb/MLQARetrieval
201
+ task_id: MLQARetrieval_eng-hin_validation
202
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
203
+ value: 9.525
204
+ date: '2026-03-09'
205
+ notes: Obtained using MTEB v2.10.8
206
+ source:
207
+ url: https://github.com/embeddings-benchmark/mteb/
208
+ name: Obtained using MTEB v2.10.8
209
+ user: mteb
210
+ - dataset:
211
+ id: mteb/MLQARetrieval
212
+ task_id: MLQARetrieval_eng-vie_validation
213
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
214
+ value: 46.598
215
+ date: '2026-03-09'
216
+ notes: Obtained using MTEB v2.10.8
217
+ source:
218
+ url: https://github.com/embeddings-benchmark/mteb/
219
+ name: Obtained using MTEB v2.10.8
220
+ user: mteb
221
+ - dataset:
222
+ id: mteb/MLQARetrieval
223
+ task_id: MLQARetrieval_eng-zho_validation
224
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
225
+ value: 3.366
226
+ date: '2026-03-09'
227
+ notes: Obtained using MTEB v2.10.8
228
+ source:
229
+ url: https://github.com/embeddings-benchmark/mteb/
230
+ name: Obtained using MTEB v2.10.8
231
+ user: mteb
232
+ - dataset:
233
+ id: mteb/MLQARetrieval
234
+ task_id: MLQARetrieval_spa-ara_validation
235
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
236
+ value: 10.046
237
+ date: '2026-03-09'
238
+ notes: Obtained using MTEB v2.10.8
239
+ source:
240
+ url: https://github.com/embeddings-benchmark/mteb/
241
+ name: Obtained using MTEB v2.10.8
242
+ user: mteb
243
+ - dataset:
244
+ id: mteb/MLQARetrieval
245
+ task_id: MLQARetrieval_spa-deu_validation
246
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
247
+ value: 34.554
248
+ date: '2026-03-09'
249
+ notes: Obtained using MTEB v2.10.8
250
+ source:
251
+ url: https://github.com/embeddings-benchmark/mteb/
252
+ name: Obtained using MTEB v2.10.8
253
+ user: mteb
254
+ - dataset:
255
+ id: mteb/MLQARetrieval
256
+ task_id: MLQARetrieval_spa-eng_validation
257
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
258
+ value: 39.193
259
+ date: '2026-03-09'
260
+ notes: Obtained using MTEB v2.10.8
261
+ source:
262
+ url: https://github.com/embeddings-benchmark/mteb/
263
+ name: Obtained using MTEB v2.10.8
264
+ user: mteb
265
+ - dataset:
266
+ id: mteb/MLQARetrieval
267
+ task_id: MLQARetrieval_spa-spa_validation
268
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
269
+ value: 78.434
270
+ date: '2026-03-09'
271
+ notes: Obtained using MTEB v2.10.8
272
+ source:
273
+ url: https://github.com/embeddings-benchmark/mteb/
274
+ name: Obtained using MTEB v2.10.8
275
+ user: mteb
276
+ - dataset:
277
+ id: mteb/MLQARetrieval
278
+ task_id: MLQARetrieval_spa-hin_validation
279
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
280
+ value: 8.977
281
+ date: '2026-03-09'
282
+ notes: Obtained using MTEB v2.10.8
283
+ source:
284
+ url: https://github.com/embeddings-benchmark/mteb/
285
+ name: Obtained using MTEB v2.10.8
286
+ user: mteb
287
+ - dataset:
288
+ id: mteb/MLQARetrieval
289
+ task_id: MLQARetrieval_spa-vie_validation
290
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
291
+ value: 41.08
292
+ date: '2026-03-09'
293
+ notes: Obtained using MTEB v2.10.8
294
+ source:
295
+ url: https://github.com/embeddings-benchmark/mteb/
296
+ name: Obtained using MTEB v2.10.8
297
+ user: mteb
298
+ - dataset:
299
+ id: mteb/MLQARetrieval
300
+ task_id: MLQARetrieval_spa-zho_validation
301
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
302
+ value: 6.941
303
+ date: '2026-03-09'
304
+ notes: Obtained using MTEB v2.10.8
305
+ source:
306
+ url: https://github.com/embeddings-benchmark/mteb/
307
+ name: Obtained using MTEB v2.10.8
308
+ user: mteb
309
+ - dataset:
310
+ id: mteb/MLQARetrieval
311
+ task_id: MLQARetrieval_hin-ara_validation
312
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
313
+ value: 9.323
314
+ date: '2026-03-09'
315
+ notes: Obtained using MTEB v2.10.8
316
+ source:
317
+ url: https://github.com/embeddings-benchmark/mteb/
318
+ name: Obtained using MTEB v2.10.8
319
+ user: mteb
320
+ - dataset:
321
+ id: mteb/MLQARetrieval
322
+ task_id: MLQARetrieval_hin-deu_validation
323
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
324
+ value: 12.872
325
+ date: '2026-03-09'
326
+ notes: Obtained using MTEB v2.10.8
327
+ source:
328
+ url: https://github.com/embeddings-benchmark/mteb/
329
+ name: Obtained using MTEB v2.10.8
330
+ user: mteb
331
+ - dataset:
332
+ id: mteb/MLQARetrieval
333
+ task_id: MLQARetrieval_hin-eng_validation
334
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
335
+ value: 11.771
336
+ date: '2026-03-09'
337
+ notes: Obtained using MTEB v2.10.8
338
+ source:
339
+ url: https://github.com/embeddings-benchmark/mteb/
340
+ name: Obtained using MTEB v2.10.8
341
+ user: mteb
342
+ - dataset:
343
+ id: mteb/MLQARetrieval
344
+ task_id: MLQARetrieval_hin-spa_validation
345
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
346
+ value: 12.546
347
+ date: '2026-03-09'
348
+ notes: Obtained using MTEB v2.10.8
349
+ source:
350
+ url: https://github.com/embeddings-benchmark/mteb/
351
+ name: Obtained using MTEB v2.10.8
352
+ user: mteb
353
+ - dataset:
354
+ id: mteb/MLQARetrieval
355
+ task_id: MLQARetrieval_hin-hin_validation
356
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
357
+ value: 47.237
358
+ date: '2026-03-09'
359
+ notes: Obtained using MTEB v2.10.8
360
+ source:
361
+ url: https://github.com/embeddings-benchmark/mteb/
362
+ name: Obtained using MTEB v2.10.8
363
+ user: mteb
364
+ - dataset:
365
+ id: mteb/MLQARetrieval
366
+ task_id: MLQARetrieval_hin-vie_validation
367
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
368
+ value: 11.189
369
+ date: '2026-03-09'
370
+ notes: Obtained using MTEB v2.10.8
371
+ source:
372
+ url: https://github.com/embeddings-benchmark/mteb/
373
+ name: Obtained using MTEB v2.10.8
374
+ user: mteb
375
+ - dataset:
376
+ id: mteb/MLQARetrieval
377
+ task_id: MLQARetrieval_hin-zho_validation
378
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
379
+ value: 4.52
380
+ date: '2026-03-09'
381
+ notes: Obtained using MTEB v2.10.8
382
+ source:
383
+ url: https://github.com/embeddings-benchmark/mteb/
384
+ name: Obtained using MTEB v2.10.8
385
+ user: mteb
386
+ - dataset:
387
+ id: mteb/MLQARetrieval
388
+ task_id: MLQARetrieval_vie-ara_validation
389
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
390
+ value: 6.322
391
+ date: '2026-03-09'
392
+ notes: Obtained using MTEB v2.10.8
393
+ source:
394
+ url: https://github.com/embeddings-benchmark/mteb/
395
+ name: Obtained using MTEB v2.10.8
396
+ user: mteb
397
+ - dataset:
398
+ id: mteb/MLQARetrieval
399
+ task_id: MLQARetrieval_vie-deu_validation
400
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
401
+ value: 47.773
402
+ date: '2026-03-09'
403
+ notes: Obtained using MTEB v2.10.8
404
+ source:
405
+ url: https://github.com/embeddings-benchmark/mteb/
406
+ name: Obtained using MTEB v2.10.8
407
+ user: mteb
408
+ - dataset:
409
+ id: mteb/MLQARetrieval
410
+ task_id: MLQARetrieval_vie-eng_validation
411
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
412
+ value: 41.077
413
+ date: '2026-03-09'
414
+ notes: Obtained using MTEB v2.10.8
415
+ source:
416
+ url: https://github.com/embeddings-benchmark/mteb/
417
+ name: Obtained using MTEB v2.10.8
418
+ user: mteb
419
+ - dataset:
420
+ id: mteb/MLQARetrieval
421
+ task_id: MLQARetrieval_vie-spa_validation
422
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
423
+ value: 37.154
424
+ date: '2026-03-09'
425
+ notes: Obtained using MTEB v2.10.8
426
+ source:
427
+ url: https://github.com/embeddings-benchmark/mteb/
428
+ name: Obtained using MTEB v2.10.8
429
+ user: mteb
430
+ - dataset:
431
+ id: mteb/MLQARetrieval
432
+ task_id: MLQARetrieval_vie-hin_validation
433
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
434
+ value: 8.398
435
+ date: '2026-03-09'
436
+ notes: Obtained using MTEB v2.10.8
437
+ source:
438
+ url: https://github.com/embeddings-benchmark/mteb/
439
+ name: Obtained using MTEB v2.10.8
440
+ user: mteb
441
+ - dataset:
442
+ id: mteb/MLQARetrieval
443
+ task_id: MLQARetrieval_vie-vie_validation
444
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
445
+ value: 79.92
446
+ date: '2026-03-09'
447
+ notes: Obtained using MTEB v2.10.8
448
+ source:
449
+ url: https://github.com/embeddings-benchmark/mteb/
450
+ name: Obtained using MTEB v2.10.8
451
+ user: mteb
452
+ - dataset:
453
+ id: mteb/MLQARetrieval
454
+ task_id: MLQARetrieval_vie-zho_validation
455
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
456
+ value: 5.738
457
+ date: '2026-03-09'
458
+ notes: Obtained using MTEB v2.10.8
459
+ source:
460
+ url: https://github.com/embeddings-benchmark/mteb/
461
+ name: Obtained using MTEB v2.10.8
462
+ user: mteb
463
+ - dataset:
464
+ id: mteb/MLQARetrieval
465
+ task_id: MLQARetrieval_zho-ara_validation
466
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
467
+ value: 3.878
468
+ date: '2026-03-09'
469
+ notes: Obtained using MTEB v2.10.8
470
+ source:
471
+ url: https://github.com/embeddings-benchmark/mteb/
472
+ name: Obtained using MTEB v2.10.8
473
+ user: mteb
474
+ - dataset:
475
+ id: mteb/MLQARetrieval
476
+ task_id: MLQARetrieval_zho-deu_validation
477
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
478
+ value: 14.955
479
+ date: '2026-03-09'
480
+ notes: Obtained using MTEB v2.10.8
481
+ source:
482
+ url: https://github.com/embeddings-benchmark/mteb/
483
+ name: Obtained using MTEB v2.10.8
484
+ user: mteb
485
+ - dataset:
486
+ id: mteb/MLQARetrieval
487
+ task_id: MLQARetrieval_zho-eng_validation
488
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
489
+ value: 13.471
490
+ date: '2026-03-09'
491
+ notes: Obtained using MTEB v2.10.8
492
+ source:
493
+ url: https://github.com/embeddings-benchmark/mteb/
494
+ name: Obtained using MTEB v2.10.8
495
+ user: mteb
496
+ - dataset:
497
+ id: mteb/MLQARetrieval
498
+ task_id: MLQARetrieval_zho-spa_validation
499
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
500
+ value: 17.15
501
+ date: '2026-03-09'
502
+ notes: Obtained using MTEB v2.10.8
503
+ source:
504
+ url: https://github.com/embeddings-benchmark/mteb/
505
+ name: Obtained using MTEB v2.10.8
506
+ user: mteb
507
+ - dataset:
508
+ id: mteb/MLQARetrieval
509
+ task_id: MLQARetrieval_zho-hin_validation
510
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
511
+ value: 4.725
512
+ date: '2026-03-09'
513
+ notes: Obtained using MTEB v2.10.8
514
+ source:
515
+ url: https://github.com/embeddings-benchmark/mteb/
516
+ name: Obtained using MTEB v2.10.8
517
+ user: mteb
518
+ - dataset:
519
+ id: mteb/MLQARetrieval
520
+ task_id: MLQARetrieval_zho-vie_validation
521
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
522
+ value: 13.795
523
+ date: '2026-03-09'
524
+ notes: Obtained using MTEB v2.10.8
525
+ source:
526
+ url: https://github.com/embeddings-benchmark/mteb/
527
+ name: Obtained using MTEB v2.10.8
528
+ user: mteb
529
+ - dataset:
530
+ id: mteb/MLQARetrieval
531
+ task_id: MLQARetrieval_zho-zho_validation
532
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
533
+ value: 7.644
534
+ date: '2026-03-09'
535
+ notes: Obtained using MTEB v2.10.8
536
+ source:
537
+ url: https://github.com/embeddings-benchmark/mteb/
538
+ name: Obtained using MTEB v2.10.8
539
+ user: mteb
540
+ - dataset:
541
+ id: mteb/MLQARetrieval
542
+ task_id: MLQARetrieval_ara-ara_test
543
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
544
+ value: 47.924
545
+ date: '2026-03-09'
546
+ notes: Obtained using MTEB v2.10.8
547
+ source:
548
+ url: https://github.com/embeddings-benchmark/mteb/
549
+ name: Obtained using MTEB v2.10.8
550
+ user: mteb
551
+ - dataset:
552
+ id: mteb/MLQARetrieval
553
+ task_id: MLQARetrieval_ara-deu_test
554
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
555
+ value: 0.338
556
+ date: '2026-03-09'
557
+ notes: Obtained using MTEB v2.10.8
558
+ source:
559
+ url: https://github.com/embeddings-benchmark/mteb/
560
+ name: Obtained using MTEB v2.10.8
561
+ user: mteb
562
+ - dataset:
563
+ id: mteb/MLQARetrieval
564
+ task_id: MLQARetrieval_ara-eng_test
565
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
566
+ value: 6.876
567
+ date: '2026-03-09'
568
+ notes: Obtained using MTEB v2.10.8
569
+ source:
570
+ url: https://github.com/embeddings-benchmark/mteb/
571
+ name: Obtained using MTEB v2.10.8
572
+ user: mteb
573
+ - dataset:
574
+ id: mteb/MLQARetrieval
575
+ task_id: MLQARetrieval_ara-spa_test
576
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
577
+ value: 5.715
578
+ date: '2026-03-09'
579
+ notes: Obtained using MTEB v2.10.8
580
+ source:
581
+ url: https://github.com/embeddings-benchmark/mteb/
582
+ name: Obtained using MTEB v2.10.8
583
+ user: mteb
584
+ - dataset:
585
+ id: mteb/MLQARetrieval
586
+ task_id: MLQARetrieval_ara-hin_test
587
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
588
+ value: 3.146
589
+ date: '2026-03-09'
590
+ notes: Obtained using MTEB v2.10.8
591
+ source:
592
+ url: https://github.com/embeddings-benchmark/mteb/
593
+ name: Obtained using MTEB v2.10.8
594
+ user: mteb
595
+ - dataset:
596
+ id: mteb/MLQARetrieval
597
+ task_id: MLQARetrieval_ara-vie_test
598
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
599
+ value: 7.145
600
+ date: '2026-03-09'
601
+ notes: Obtained using MTEB v2.10.8
602
+ source:
603
+ url: https://github.com/embeddings-benchmark/mteb/
604
+ name: Obtained using MTEB v2.10.8
605
+ user: mteb
606
+ - dataset:
607
+ id: mteb/MLQARetrieval
608
+ task_id: MLQARetrieval_ara-zho_test
609
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
610
+ value: 1.005
611
+ date: '2026-03-09'
612
+ notes: Obtained using MTEB v2.10.8
613
+ source:
614
+ url: https://github.com/embeddings-benchmark/mteb/
615
+ name: Obtained using MTEB v2.10.8
616
+ user: mteb
617
+ - dataset:
618
+ id: mteb/MLQARetrieval
619
+ task_id: MLQARetrieval_deu-ara_test
620
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
621
+ value: 5.303
622
+ date: '2026-03-09'
623
+ notes: Obtained using MTEB v2.10.8
624
+ source:
625
+ url: https://github.com/embeddings-benchmark/mteb/
626
+ name: Obtained using MTEB v2.10.8
627
+ user: mteb
628
+ - dataset:
629
+ id: mteb/MLQARetrieval
630
+ task_id: MLQARetrieval_deu-deu_test
631
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
632
+ value: 56.37
633
+ date: '2026-03-09'
634
+ notes: Obtained using MTEB v2.10.8
635
+ source:
636
+ url: https://github.com/embeddings-benchmark/mteb/
637
+ name: Obtained using MTEB v2.10.8
638
+ user: mteb
639
+ - dataset:
640
+ id: mteb/MLQARetrieval
641
+ task_id: MLQARetrieval_deu-eng_test
642
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
643
+ value: 33.717
644
+ date: '2026-03-09'
645
+ notes: Obtained using MTEB v2.10.8
646
+ source:
647
+ url: https://github.com/embeddings-benchmark/mteb/
648
+ name: Obtained using MTEB v2.10.8
649
+ user: mteb
650
+ - dataset:
651
+ id: mteb/MLQARetrieval
652
+ task_id: MLQARetrieval_deu-spa_test
653
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
654
+ value: 27.389
655
+ date: '2026-03-09'
656
+ notes: Obtained using MTEB v2.10.8
657
+ source:
658
+ url: https://github.com/embeddings-benchmark/mteb/
659
+ name: Obtained using MTEB v2.10.8
660
+ user: mteb
661
+ - dataset:
662
+ id: mteb/MLQARetrieval
663
+ task_id: MLQARetrieval_deu-hin_test
664
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
665
+ value: 4.467
666
+ date: '2026-03-09'
667
+ notes: Obtained using MTEB v2.10.8
668
+ source:
669
+ url: https://github.com/embeddings-benchmark/mteb/
670
+ name: Obtained using MTEB v2.10.8
671
+ user: mteb
672
+ - dataset:
673
+ id: mteb/MLQARetrieval
674
+ task_id: MLQARetrieval_deu-vie_test
675
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
676
+ value: 34.574
677
+ date: '2026-03-09'
678
+ notes: Obtained using MTEB v2.10.8
679
+ source:
680
+ url: https://github.com/embeddings-benchmark/mteb/
681
+ name: Obtained using MTEB v2.10.8
682
+ user: mteb
683
+ - dataset:
684
+ id: mteb/MLQARetrieval
685
+ task_id: MLQARetrieval_deu-zho_test
686
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
687
+ value: 2.416
688
+ date: '2026-03-09'
689
+ notes: Obtained using MTEB v2.10.8
690
+ source:
691
+ url: https://github.com/embeddings-benchmark/mteb/
692
+ name: Obtained using MTEB v2.10.8
693
+ user: mteb
694
+ - dataset:
695
+ id: mteb/MLQARetrieval
696
+ task_id: MLQARetrieval_eng-ara_test
697
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
698
+ value: 4.226
699
+ date: '2026-03-09'
700
+ notes: Obtained using MTEB v2.10.8
701
+ source:
702
+ url: https://github.com/embeddings-benchmark/mteb/
703
+ name: Obtained using MTEB v2.10.8
704
+ user: mteb
705
+ - dataset:
706
+ id: mteb/MLQARetrieval
707
+ task_id: MLQARetrieval_eng-deu_test
708
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
709
+ value: 38.658
710
+ date: '2026-03-09'
711
+ notes: Obtained using MTEB v2.10.8
712
+ source:
713
+ url: https://github.com/embeddings-benchmark/mteb/
714
+ name: Obtained using MTEB v2.10.8
715
+ user: mteb
716
+ - dataset:
717
+ id: mteb/MLQARetrieval
718
+ task_id: MLQARetrieval_eng-eng_test
719
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
720
+ value: 72.426
721
+ date: '2026-03-09'
722
+ notes: Obtained using MTEB v2.10.8
723
+ source:
724
+ url: https://github.com/embeddings-benchmark/mteb/
725
+ name: Obtained using MTEB v2.10.8
726
+ user: mteb
727
+ - dataset:
728
+ id: mteb/MLQARetrieval
729
+ task_id: MLQARetrieval_eng-spa_test
730
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
731
+ value: 27.401
732
+ date: '2026-03-09'
733
+ notes: Obtained using MTEB v2.10.8
734
+ source:
735
+ url: https://github.com/embeddings-benchmark/mteb/
736
+ name: Obtained using MTEB v2.10.8
737
+ user: mteb
738
+ - dataset:
739
+ id: mteb/MLQARetrieval
740
+ task_id: MLQARetrieval_eng-hin_test
741
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
742
+ value: 4.199
743
+ date: '2026-03-09'
744
+ notes: Obtained using MTEB v2.10.8
745
+ source:
746
+ url: https://github.com/embeddings-benchmark/mteb/
747
+ name: Obtained using MTEB v2.10.8
748
+ user: mteb
749
+ - dataset:
750
+ id: mteb/MLQARetrieval
751
+ task_id: MLQARetrieval_eng-vie_test
752
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
753
+ value: 35.439
754
+ date: '2026-03-09'
755
+ notes: Obtained using MTEB v2.10.8
756
+ source:
757
+ url: https://github.com/embeddings-benchmark/mteb/
758
+ name: Obtained using MTEB v2.10.8
759
+ user: mteb
760
+ - dataset:
761
+ id: mteb/MLQARetrieval
762
+ task_id: MLQARetrieval_eng-zho_test
763
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
764
+ value: 2.272
765
+ date: '2026-03-09'
766
+ notes: Obtained using MTEB v2.10.8
767
+ source:
768
+ url: https://github.com/embeddings-benchmark/mteb/
769
+ name: Obtained using MTEB v2.10.8
770
+ user: mteb
771
+ - dataset:
772
+ id: mteb/MLQARetrieval
773
+ task_id: MLQARetrieval_spa-ara_test
774
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
775
+ value: 4.212
776
+ date: '2026-03-09'
777
+ notes: Obtained using MTEB v2.10.8
778
+ source:
779
+ url: https://github.com/embeddings-benchmark/mteb/
780
+ name: Obtained using MTEB v2.10.8
781
+ user: mteb
782
+ - dataset:
783
+ id: mteb/MLQARetrieval
784
+ task_id: MLQARetrieval_spa-deu_test
785
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
786
+ value: 29.68
787
+ date: '2026-03-09'
788
+ notes: Obtained using MTEB v2.10.8
789
+ source:
790
+ url: https://github.com/embeddings-benchmark/mteb/
791
+ name: Obtained using MTEB v2.10.8
792
+ user: mteb
793
+ - dataset:
794
+ id: mteb/MLQARetrieval
795
+ task_id: MLQARetrieval_spa-eng_test
796
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
797
+ value: 27.934
798
+ date: '2026-03-09'
799
+ notes: Obtained using MTEB v2.10.8
800
+ source:
801
+ url: https://github.com/embeddings-benchmark/mteb/
802
+ name: Obtained using MTEB v2.10.8
803
+ user: mteb
804
+ - dataset:
805
+ id: mteb/MLQARetrieval
806
+ task_id: MLQARetrieval_spa-spa_test
807
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
808
+ value: 64.22
809
+ date: '2026-03-09'
810
+ notes: Obtained using MTEB v2.10.8
811
+ source:
812
+ url: https://github.com/embeddings-benchmark/mteb/
813
+ name: Obtained using MTEB v2.10.8
814
+ user: mteb
815
+ - dataset:
816
+ id: mteb/MLQARetrieval
817
+ task_id: MLQARetrieval_spa-hin_test
818
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
819
+ value: 4.381
820
+ date: '2026-03-09'
821
+ notes: Obtained using MTEB v2.10.8
822
+ source:
823
+ url: https://github.com/embeddings-benchmark/mteb/
824
+ name: Obtained using MTEB v2.10.8
825
+ user: mteb
826
+ - dataset:
827
+ id: mteb/MLQARetrieval
828
+ task_id: MLQARetrieval_spa-vie_test
829
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
830
+ value: 31.611
831
+ date: '2026-03-09'
832
+ notes: Obtained using MTEB v2.10.8
833
+ source:
834
+ url: https://github.com/embeddings-benchmark/mteb/
835
+ name: Obtained using MTEB v2.10.8
836
+ user: mteb
837
+ - dataset:
838
+ id: mteb/MLQARetrieval
839
+ task_id: MLQARetrieval_spa-zho_test
840
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
841
+ value: 2.39
842
+ date: '2026-03-09'
843
+ notes: Obtained using MTEB v2.10.8
844
+ source:
845
+ url: https://github.com/embeddings-benchmark/mteb/
846
+ name: Obtained using MTEB v2.10.8
847
+ user: mteb
848
+ - dataset:
849
+ id: mteb/MLQARetrieval
850
+ task_id: MLQARetrieval_hin-ara_test
851
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
852
+ value: 3.2
853
+ date: '2026-03-09'
854
+ notes: Obtained using MTEB v2.10.8
855
+ source:
856
+ url: https://github.com/embeddings-benchmark/mteb/
857
+ name: Obtained using MTEB v2.10.8
858
+ user: mteb
859
+ - dataset:
860
+ id: mteb/MLQARetrieval
861
+ task_id: MLQARetrieval_hin-deu_test
862
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
863
+ value: 8.414
864
+ date: '2026-03-09'
865
+ notes: Obtained using MTEB v2.10.8
866
+ source:
867
+ url: https://github.com/embeddings-benchmark/mteb/
868
+ name: Obtained using MTEB v2.10.8
869
+ user: mteb
870
+ - dataset:
871
+ id: mteb/MLQARetrieval
872
+ task_id: MLQARetrieval_hin-eng_test
873
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
874
+ value: 7.428
875
+ date: '2026-03-09'
876
+ notes: Obtained using MTEB v2.10.8
877
+ source:
878
+ url: https://github.com/embeddings-benchmark/mteb/
879
+ name: Obtained using MTEB v2.10.8
880
+ user: mteb
881
+ - dataset:
882
+ id: mteb/MLQARetrieval
883
+ task_id: MLQARetrieval_hin-spa_test
884
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
885
+ value: 6.05
886
+ date: '2026-03-09'
887
+ notes: Obtained using MTEB v2.10.8
888
+ source:
889
+ url: https://github.com/embeddings-benchmark/mteb/
890
+ name: Obtained using MTEB v2.10.8
891
+ user: mteb
892
+ - dataset:
893
+ id: mteb/MLQARetrieval
894
+ task_id: MLQARetrieval_hin-hin_test
895
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
896
+ value: 26.827
897
+ date: '2026-03-09'
898
+ notes: Obtained using MTEB v2.10.8
899
+ source:
900
+ url: https://github.com/embeddings-benchmark/mteb/
901
+ name: Obtained using MTEB v2.10.8
902
+ user: mteb
903
+ - dataset:
904
+ id: mteb/MLQARetrieval
905
+ task_id: MLQARetrieval_hin-vie_test
906
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
907
+ value: 7.181
908
+ date: '2026-03-09'
909
+ notes: Obtained using MTEB v2.10.8
910
+ source:
911
+ url: https://github.com/embeddings-benchmark/mteb/
912
+ name: Obtained using MTEB v2.10.8
913
+ user: mteb
914
+ - dataset:
915
+ id: mteb/MLQARetrieval
916
+ task_id: MLQARetrieval_hin-zho_test
917
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
918
+ value: 0.989
919
+ date: '2026-03-09'
920
+ notes: Obtained using MTEB v2.10.8
921
+ source:
922
+ url: https://github.com/embeddings-benchmark/mteb/
923
+ name: Obtained using MTEB v2.10.8
924
+ user: mteb
925
+ - dataset:
926
+ id: mteb/MLQARetrieval
927
+ task_id: MLQARetrieval_vie-ara_test
928
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
929
+ value: 3.558
930
+ date: '2026-03-09'
931
+ notes: Obtained using MTEB v2.10.8
932
+ source:
933
+ url: https://github.com/embeddings-benchmark/mteb/
934
+ name: Obtained using MTEB v2.10.8
935
+ user: mteb
936
+ - dataset:
937
+ id: mteb/MLQARetrieval
938
+ task_id: MLQARetrieval_vie-deu_test
939
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
940
+ value: 37.045
941
+ date: '2026-03-09'
942
+ notes: Obtained using MTEB v2.10.8
943
+ source:
944
+ url: https://github.com/embeddings-benchmark/mteb/
945
+ name: Obtained using MTEB v2.10.8
946
+ user: mteb
947
+ - dataset:
948
+ id: mteb/MLQARetrieval
949
+ task_id: MLQARetrieval_vie-eng_test
950
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
951
+ value: 29.02
952
+ date: '2026-03-09'
953
+ notes: Obtained using MTEB v2.10.8
954
+ source:
955
+ url: https://github.com/embeddings-benchmark/mteb/
956
+ name: Obtained using MTEB v2.10.8
957
+ user: mteb
958
+ - dataset:
959
+ id: mteb/MLQARetrieval
960
+ task_id: MLQARetrieval_vie-spa_test
961
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
962
+ value: 28.411
963
+ date: '2026-03-09'
964
+ notes: Obtained using MTEB v2.10.8
965
+ source:
966
+ url: https://github.com/embeddings-benchmark/mteb/
967
+ name: Obtained using MTEB v2.10.8
968
+ user: mteb
969
+ - dataset:
970
+ id: mteb/MLQARetrieval
971
+ task_id: MLQARetrieval_vie-hin_test
972
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
973
+ value: 4.046
974
+ date: '2026-03-09'
975
+ notes: Obtained using MTEB v2.10.8
976
+ source:
977
+ url: https://github.com/embeddings-benchmark/mteb/
978
+ name: Obtained using MTEB v2.10.8
979
+ user: mteb
980
+ - dataset:
981
+ id: mteb/MLQARetrieval
982
+ task_id: MLQARetrieval_vie-vie_test
983
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
984
+ value: 63.947
985
+ date: '2026-03-09'
986
+ notes: Obtained using MTEB v2.10.8
987
+ source:
988
+ url: https://github.com/embeddings-benchmark/mteb/
989
+ name: Obtained using MTEB v2.10.8
990
+ user: mteb
991
+ - dataset:
992
+ id: mteb/MLQARetrieval
993
+ task_id: MLQARetrieval_vie-zho_test
994
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
995
+ value: 2.15
996
+ date: '2026-03-09'
997
+ notes: Obtained using MTEB v2.10.8
998
+ source:
999
+ url: https://github.com/embeddings-benchmark/mteb/
1000
+ name: Obtained using MTEB v2.10.8
1001
+ user: mteb
1002
+ - dataset:
1003
+ id: mteb/MLQARetrieval
1004
+ task_id: MLQARetrieval_zho-ara_test
1005
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1006
+ value: 2.266
1007
+ date: '2026-03-09'
1008
+ notes: Obtained using MTEB v2.10.8
1009
+ source:
1010
+ url: https://github.com/embeddings-benchmark/mteb/
1011
+ name: Obtained using MTEB v2.10.8
1012
+ user: mteb
1013
+ - dataset:
1014
+ id: mteb/MLQARetrieval
1015
+ task_id: MLQARetrieval_zho-deu_test
1016
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1017
+ value: 11.901
1018
+ date: '2026-03-09'
1019
+ notes: Obtained using MTEB v2.10.8
1020
+ source:
1021
+ url: https://github.com/embeddings-benchmark/mteb/
1022
+ name: Obtained using MTEB v2.10.8
1023
+ user: mteb
1024
+ - dataset:
1025
+ id: mteb/MLQARetrieval
1026
+ task_id: MLQARetrieval_zho-eng_test
1027
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1028
+ value: 10.412
1029
+ date: '2026-03-09'
1030
+ notes: Obtained using MTEB v2.10.8
1031
+ source:
1032
+ url: https://github.com/embeddings-benchmark/mteb/
1033
+ name: Obtained using MTEB v2.10.8
1034
+ user: mteb
1035
+ - dataset:
1036
+ id: mteb/MLQARetrieval
1037
+ task_id: MLQARetrieval_zho-spa_test
1038
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1039
+ value: 8.467
1040
+ date: '2026-03-09'
1041
+ notes: Obtained using MTEB v2.10.8
1042
+ source:
1043
+ url: https://github.com/embeddings-benchmark/mteb/
1044
+ name: Obtained using MTEB v2.10.8
1045
+ user: mteb
1046
+ - dataset:
1047
+ id: mteb/MLQARetrieval
1048
+ task_id: MLQARetrieval_zho-hin_test
1049
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1050
+ value: 1.553
1051
+ date: '2026-03-09'
1052
+ notes: Obtained using MTEB v2.10.8
1053
+ source:
1054
+ url: https://github.com/embeddings-benchmark/mteb/
1055
+ name: Obtained using MTEB v2.10.8
1056
+ user: mteb
1057
+ - dataset:
1058
+ id: mteb/MLQARetrieval
1059
+ task_id: MLQARetrieval_zho-vie_test
1060
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1061
+ value: 10.315
1062
+ date: '2026-03-09'
1063
+ notes: Obtained using MTEB v2.10.8
1064
+ source:
1065
+ url: https://github.com/embeddings-benchmark/mteb/
1066
+ name: Obtained using MTEB v2.10.8
1067
+ user: mteb
1068
+ - dataset:
1069
+ id: mteb/MLQARetrieval
1070
+ task_id: MLQARetrieval_zho-zho_test
1071
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1072
+ value: 5.882
1073
+ date: '2026-03-09'
1074
+ notes: Obtained using MTEB v2.10.8
1075
+ source:
1076
+ url: https://github.com/embeddings-benchmark/mteb/
1077
+ name: Obtained using MTEB v2.10.8
1078
+ user: mteb
1079
+ - dataset:
1080
+ id: mteb/MLQARetrieval
1081
+ task_id: MLQARetrieval
1082
+ revision: 5bef8b6e2601af974fb1a1cca03fd702229be4b6
1083
+ value: 21.06861
1084
+ date: '2026-03-09'
1085
+ notes: Obtained using MTEB v2.10.8
1086
+ source:
1087
+ url: https://github.com/embeddings-benchmark/mteb/
1088
+ name: Obtained using MTEB v2.10.8
1089
+ user: mteb
.eval_results/MTEB(Multilingual, v2).yaml ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/MMTEB-Multilingual-v2
3
+ task_id: MTEB(Multilingual, v2)
4
+ revision: '1'
5
+ value: 0.3569814123037315
6
+ notes: Obtained using MTEB
7
+ source:
8
+ url: https://github.com/embeddings-benchmark/mteb/
9
+ name: Obtained using MTEB
10
+ user: mteb
.eval_results/News21InstructionRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/News21InstructionRetrieval
3
+ task_id: News21InstructionRetrieval_default_test
4
+ revision: c6fffeb9cdd95c1ffa81c62c687b48b56352872b
5
+ value: -2.9196
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/News21InstructionRetrieval
14
+ task_id: News21InstructionRetrieval
15
+ revision: c6fffeb9cdd95c1ffa81c62c687b48b56352872b
16
+ value: -2.9196
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/Robust04InstructionRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/Robust04InstructionRetrieval
3
+ task_id: Robust04InstructionRetrieval_default_test
4
+ revision: 0495a5cb69aa8fa5bca81bd56ac248911c19eeb6
5
+ value: -3.8835
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/Robust04InstructionRetrieval
14
+ task_id: Robust04InstructionRetrieval
15
+ revision: 0495a5cb69aa8fa5bca81bd56ac248911c19eeb6
16
+ value: -3.8835
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/RuBQReranking.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/RuBQReranking
3
+ task_id: RuBQReranking_default_test
4
+ revision: e8233e2234f8b24ab47f203b69d1161c3c0bc5a1
5
+ value: 38.773
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/RuBQReranking
14
+ task_id: RuBQReranking
15
+ revision: e8233e2234f8b24ab47f203b69d1161c3c0bc5a1
16
+ value: 38.773
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/SpartQA.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/SpartQA
3
+ task_id: SpartQA_default_test
4
+ revision: 1c858df377e57725a014a1b7321ebd79d62016b6
5
+ value: 21.435
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/SpartQA
14
+ task_id: SpartQA
15
+ revision: 1c858df377e57725a014a1b7321ebd79d62016b6
16
+ value: 21.435
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/StackOverflowQA.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/StackOverflowQA
3
+ task_id: StackOverflowQA_default_test
4
+ revision: 7b46f5ebd2365278c1bb025986dda2fee893bbf5
5
+ value: 70.26
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/StackOverflowQA
14
+ task_id: StackOverflowQA
15
+ revision: 7b46f5ebd2365278c1bb025986dda2fee893bbf5
16
+ value: 70.26
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/StatcanDialogueDatasetRetrieval.yaml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/StatcanDialogueDatasetRetrieval
3
+ task_id: StatcanDialogueDatasetRetrieval_english_dev
4
+ revision: 6f9747b22a93c6cf714945bca43576089fb80de3
5
+ value: 6.522
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/StatcanDialogueDatasetRetrieval
14
+ task_id: StatcanDialogueDatasetRetrieval_french_dev
15
+ revision: 6f9747b22a93c6cf714945bca43576089fb80de3
16
+ value: 4.098
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
23
+ - dataset:
24
+ id: mteb/StatcanDialogueDatasetRetrieval
25
+ task_id: StatcanDialogueDatasetRetrieval_english_test
26
+ revision: 6f9747b22a93c6cf714945bca43576089fb80de3
27
+ value: 9.888
28
+ date: '2026-03-09'
29
+ notes: Obtained using MTEB v2.10.8
30
+ source:
31
+ url: https://github.com/embeddings-benchmark/mteb/
32
+ name: Obtained using MTEB v2.10.8
33
+ user: mteb
34
+ - dataset:
35
+ id: mteb/StatcanDialogueDatasetRetrieval
36
+ task_id: StatcanDialogueDatasetRetrieval_french_test
37
+ revision: 6f9747b22a93c6cf714945bca43576089fb80de3
38
+ value: 3.704
39
+ date: '2026-03-09'
40
+ notes: Obtained using MTEB v2.10.8
41
+ source:
42
+ url: https://github.com/embeddings-benchmark/mteb/
43
+ name: Obtained using MTEB v2.10.8
44
+ user: mteb
45
+ - dataset:
46
+ id: mteb/StatcanDialogueDatasetRetrieval
47
+ task_id: StatcanDialogueDatasetRetrieval
48
+ revision: 6f9747b22a93c6cf714945bca43576089fb80de3
49
+ value: 6.053
50
+ date: '2026-03-09'
51
+ notes: Obtained using MTEB v2.10.8
52
+ source:
53
+ url: https://github.com/embeddings-benchmark/mteb/
54
+ name: Obtained using MTEB v2.10.8
55
+ user: mteb
.eval_results/T2Reranking.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/T2Reranking
3
+ task_id: T2Reranking_default_dev
4
+ revision: a34fe6bc0dff185af1228e49a0f6fb1de1565627
5
+ value: 1.88
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/T2Reranking
14
+ task_id: T2Reranking
15
+ revision: a34fe6bc0dff185af1228e49a0f6fb1de1565627
16
+ value: 1.88
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/TempReasonL1.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/TempReasonL1
3
+ task_id: TempReasonL1_default_test
4
+ revision: 2065ce0bde70750ed98bb91abd96d0d68ab94324
5
+ value: 1.132
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/TempReasonL1
14
+ task_id: TempReasonL1
15
+ revision: 2065ce0bde70750ed98bb91abd96d0d68ab94324
16
+ value: 1.132
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/TwitterHjerneRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/TwitterHjerneRetrieval
3
+ task_id: TwitterHjerneRetrieval_default_train
4
+ revision: 97ad55673cf9746f8e4b3aaa92b1bb92d82e52db
5
+ value: 25.955
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/TwitterHjerneRetrieval
14
+ task_id: TwitterHjerneRetrieval
15
+ revision: 97ad55673cf9746f8e4b3aaa92b1bb92d82e52db
16
+ value: 25.955
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/VoyageMMarcoReranking.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/VoyageMMarcoReranking
3
+ task_id: VoyageMMarcoReranking_default_test
4
+ revision: bd2050c52b480e48c51372b4ec98a1cbbc4515f2
5
+ value: 2.558
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/VoyageMMarcoReranking
14
+ task_id: VoyageMMarcoReranking
15
+ revision: bd2050c52b480e48c51372b4ec98a1cbbc4515f2
16
+ value: 2.558
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
.eval_results/WebLINXCandidatesReranking.yaml ADDED
@@ -0,0 +1,77 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/WebLINXCandidatesReranking
3
+ task_id: WebLINXCandidatesReranking_default_validation
4
+ revision: 107fdc2402d2c4bfb2a720dfcfe1f6ff9d21151b
5
+ value: 9.9676
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/WebLINXCandidatesReranking
14
+ task_id: WebLINXCandidatesReranking_default_test_iid
15
+ revision: 107fdc2402d2c4bfb2a720dfcfe1f6ff9d21151b
16
+ value: 8.3278
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
23
+ - dataset:
24
+ id: mteb/WebLINXCandidatesReranking
25
+ task_id: WebLINXCandidatesReranking_default_test_cat
26
+ revision: 107fdc2402d2c4bfb2a720dfcfe1f6ff9d21151b
27
+ value: 4.8032
28
+ date: '2026-03-23'
29
+ notes: Obtained using MTEB v2.10.8
30
+ source:
31
+ url: https://github.com/embeddings-benchmark/mteb/
32
+ name: Obtained using MTEB v2.10.8
33
+ user: mteb
34
+ - dataset:
35
+ id: mteb/WebLINXCandidatesReranking
36
+ task_id: WebLINXCandidatesReranking_default_test_geo
37
+ revision: 107fdc2402d2c4bfb2a720dfcfe1f6ff9d21151b
38
+ value: 5.4362
39
+ date: '2026-03-23'
40
+ notes: Obtained using MTEB v2.10.8
41
+ source:
42
+ url: https://github.com/embeddings-benchmark/mteb/
43
+ name: Obtained using MTEB v2.10.8
44
+ user: mteb
45
+ - dataset:
46
+ id: mteb/WebLINXCandidatesReranking
47
+ task_id: WebLINXCandidatesReranking_default_test_vis
48
+ revision: 107fdc2402d2c4bfb2a720dfcfe1f6ff9d21151b
49
+ value: 6.4502
50
+ date: '2026-03-23'
51
+ notes: Obtained using MTEB v2.10.8
52
+ source:
53
+ url: https://github.com/embeddings-benchmark/mteb/
54
+ name: Obtained using MTEB v2.10.8
55
+ user: mteb
56
+ - dataset:
57
+ id: mteb/WebLINXCandidatesReranking
58
+ task_id: WebLINXCandidatesReranking_default_test_web
59
+ revision: 107fdc2402d2c4bfb2a720dfcfe1f6ff9d21151b
60
+ value: 6.7928
61
+ date: '2026-03-23'
62
+ notes: Obtained using MTEB v2.10.8
63
+ source:
64
+ url: https://github.com/embeddings-benchmark/mteb/
65
+ name: Obtained using MTEB v2.10.8
66
+ user: mteb
67
+ - dataset:
68
+ id: mteb/WebLINXCandidatesReranking
69
+ task_id: WebLINXCandidatesReranking
70
+ revision: 107fdc2402d2c4bfb2a720dfcfe1f6ff9d21151b
71
+ value: 6.96297
72
+ date: '2026-03-23'
73
+ notes: Obtained using MTEB v2.10.8
74
+ source:
75
+ url: https://github.com/embeddings-benchmark/mteb/
76
+ name: Obtained using MTEB v2.10.8
77
+ user: mteb
.eval_results/WikipediaRerankingMultilingual.yaml ADDED
@@ -0,0 +1,187 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/WikipediaRerankingMultilingual
3
+ task_id: WikipediaRerankingMultilingual_bg_test
4
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
5
+ value: 84.151
6
+ date: '2026-03-23'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/WikipediaRerankingMultilingual
14
+ task_id: WikipediaRerankingMultilingual_bn_test
15
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
16
+ value: 72.781
17
+ date: '2026-03-23'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
23
+ - dataset:
24
+ id: mteb/WikipediaRerankingMultilingual
25
+ task_id: WikipediaRerankingMultilingual_cs_test
26
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
27
+ value: 83.286
28
+ date: '2026-03-23'
29
+ notes: Obtained using MTEB v2.10.8
30
+ source:
31
+ url: https://github.com/embeddings-benchmark/mteb/
32
+ name: Obtained using MTEB v2.10.8
33
+ user: mteb
34
+ - dataset:
35
+ id: mteb/WikipediaRerankingMultilingual
36
+ task_id: WikipediaRerankingMultilingual_da_test
37
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
38
+ value: 86.243
39
+ date: '2026-03-23'
40
+ notes: Obtained using MTEB v2.10.8
41
+ source:
42
+ url: https://github.com/embeddings-benchmark/mteb/
43
+ name: Obtained using MTEB v2.10.8
44
+ user: mteb
45
+ - dataset:
46
+ id: mteb/WikipediaRerankingMultilingual
47
+ task_id: WikipediaRerankingMultilingual_de_test
48
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
49
+ value: 86.526
50
+ date: '2026-03-23'
51
+ notes: Obtained using MTEB v2.10.8
52
+ source:
53
+ url: https://github.com/embeddings-benchmark/mteb/
54
+ name: Obtained using MTEB v2.10.8
55
+ user: mteb
56
+ - dataset:
57
+ id: mteb/WikipediaRerankingMultilingual
58
+ task_id: WikipediaRerankingMultilingual_en_test
59
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
60
+ value: 89.469
61
+ date: '2026-03-23'
62
+ notes: Obtained using MTEB v2.10.8
63
+ source:
64
+ url: https://github.com/embeddings-benchmark/mteb/
65
+ name: Obtained using MTEB v2.10.8
66
+ user: mteb
67
+ - dataset:
68
+ id: mteb/WikipediaRerankingMultilingual
69
+ task_id: WikipediaRerankingMultilingual_fa_test
70
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
71
+ value: 86.844
72
+ date: '2026-03-23'
73
+ notes: Obtained using MTEB v2.10.8
74
+ source:
75
+ url: https://github.com/embeddings-benchmark/mteb/
76
+ name: Obtained using MTEB v2.10.8
77
+ user: mteb
78
+ - dataset:
79
+ id: mteb/WikipediaRerankingMultilingual
80
+ task_id: WikipediaRerankingMultilingual_fi_test
81
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
82
+ value: 78.462
83
+ date: '2026-03-23'
84
+ notes: Obtained using MTEB v2.10.8
85
+ source:
86
+ url: https://github.com/embeddings-benchmark/mteb/
87
+ name: Obtained using MTEB v2.10.8
88
+ user: mteb
89
+ - dataset:
90
+ id: mteb/WikipediaRerankingMultilingual
91
+ task_id: WikipediaRerankingMultilingual_hi_test
92
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
93
+ value: 71.937
94
+ date: '2026-03-23'
95
+ notes: Obtained using MTEB v2.10.8
96
+ source:
97
+ url: https://github.com/embeddings-benchmark/mteb/
98
+ name: Obtained using MTEB v2.10.8
99
+ user: mteb
100
+ - dataset:
101
+ id: mteb/WikipediaRerankingMultilingual
102
+ task_id: WikipediaRerankingMultilingual_it_test
103
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
104
+ value: 86.983
105
+ date: '2026-03-23'
106
+ notes: Obtained using MTEB v2.10.8
107
+ source:
108
+ url: https://github.com/embeddings-benchmark/mteb/
109
+ name: Obtained using MTEB v2.10.8
110
+ user: mteb
111
+ - dataset:
112
+ id: mteb/WikipediaRerankingMultilingual
113
+ task_id: WikipediaRerankingMultilingual_nl_test
114
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
115
+ value: 86.714
116
+ date: '2026-03-23'
117
+ notes: Obtained using MTEB v2.10.8
118
+ source:
119
+ url: https://github.com/embeddings-benchmark/mteb/
120
+ name: Obtained using MTEB v2.10.8
121
+ user: mteb
122
+ - dataset:
123
+ id: mteb/WikipediaRerankingMultilingual
124
+ task_id: WikipediaRerankingMultilingual_pt_test
125
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
126
+ value: 85.175
127
+ date: '2026-03-23'
128
+ notes: Obtained using MTEB v2.10.8
129
+ source:
130
+ url: https://github.com/embeddings-benchmark/mteb/
131
+ name: Obtained using MTEB v2.10.8
132
+ user: mteb
133
+ - dataset:
134
+ id: mteb/WikipediaRerankingMultilingual
135
+ task_id: WikipediaRerankingMultilingual_ro_test
136
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
137
+ value: 83.811
138
+ date: '2026-03-23'
139
+ notes: Obtained using MTEB v2.10.8
140
+ source:
141
+ url: https://github.com/embeddings-benchmark/mteb/
142
+ name: Obtained using MTEB v2.10.8
143
+ user: mteb
144
+ - dataset:
145
+ id: mteb/WikipediaRerankingMultilingual
146
+ task_id: WikipediaRerankingMultilingual_sr_test
147
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
148
+ value: 82.822
149
+ date: '2026-03-23'
150
+ notes: Obtained using MTEB v2.10.8
151
+ source:
152
+ url: https://github.com/embeddings-benchmark/mteb/
153
+ name: Obtained using MTEB v2.10.8
154
+ user: mteb
155
+ - dataset:
156
+ id: mteb/WikipediaRerankingMultilingual
157
+ task_id: WikipediaRerankingMultilingual_no_test
158
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
159
+ value: 83.126
160
+ date: '2026-03-23'
161
+ notes: Obtained using MTEB v2.10.8
162
+ source:
163
+ url: https://github.com/embeddings-benchmark/mteb/
164
+ name: Obtained using MTEB v2.10.8
165
+ user: mteb
166
+ - dataset:
167
+ id: mteb/WikipediaRerankingMultilingual
168
+ task_id: WikipediaRerankingMultilingual_sv_test
169
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
170
+ value: 86.452
171
+ date: '2026-03-23'
172
+ notes: Obtained using MTEB v2.10.8
173
+ source:
174
+ url: https://github.com/embeddings-benchmark/mteb/
175
+ name: Obtained using MTEB v2.10.8
176
+ user: mteb
177
+ - dataset:
178
+ id: mteb/WikipediaRerankingMultilingual
179
+ task_id: WikipediaRerankingMultilingual
180
+ revision: 803771c366038ed587b21e3d8fe25f8f73134fad
181
+ value: 83.42388
182
+ date: '2026-03-23'
183
+ notes: Obtained using MTEB v2.10.8
184
+ source:
185
+ url: https://github.com/embeddings-benchmark/mteb/
186
+ name: Obtained using MTEB v2.10.8
187
+ user: mteb
.eval_results/WikipediaRetrievalMultilingual.yaml ADDED
@@ -0,0 +1,187 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/WikipediaRetrievalMultilingual
3
+ task_id: WikipediaRetrievalMultilingual_bg_test
4
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
5
+ value: 80.072
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/WikipediaRetrievalMultilingual
14
+ task_id: WikipediaRetrievalMultilingual_bn_test
15
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
16
+ value: 54.288
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb
23
+ - dataset:
24
+ id: mteb/WikipediaRetrievalMultilingual
25
+ task_id: WikipediaRetrievalMultilingual_cs_test
26
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
27
+ value: 76.964
28
+ date: '2026-03-09'
29
+ notes: Obtained using MTEB v2.10.8
30
+ source:
31
+ url: https://github.com/embeddings-benchmark/mteb/
32
+ name: Obtained using MTEB v2.10.8
33
+ user: mteb
34
+ - dataset:
35
+ id: mteb/WikipediaRetrievalMultilingual
36
+ task_id: WikipediaRetrievalMultilingual_da_test
37
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
38
+ value: 83.881
39
+ date: '2026-03-09'
40
+ notes: Obtained using MTEB v2.10.8
41
+ source:
42
+ url: https://github.com/embeddings-benchmark/mteb/
43
+ name: Obtained using MTEB v2.10.8
44
+ user: mteb
45
+ - dataset:
46
+ id: mteb/WikipediaRetrievalMultilingual
47
+ task_id: WikipediaRetrievalMultilingual_de_test
48
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
49
+ value: 84.545
50
+ date: '2026-03-09'
51
+ notes: Obtained using MTEB v2.10.8
52
+ source:
53
+ url: https://github.com/embeddings-benchmark/mteb/
54
+ name: Obtained using MTEB v2.10.8
55
+ user: mteb
56
+ - dataset:
57
+ id: mteb/WikipediaRetrievalMultilingual
58
+ task_id: WikipediaRetrievalMultilingual_en_test
59
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
60
+ value: 89.746
61
+ date: '2026-03-09'
62
+ notes: Obtained using MTEB v2.10.8
63
+ source:
64
+ url: https://github.com/embeddings-benchmark/mteb/
65
+ name: Obtained using MTEB v2.10.8
66
+ user: mteb
67
+ - dataset:
68
+ id: mteb/WikipediaRetrievalMultilingual
69
+ task_id: WikipediaRetrievalMultilingual_fa_test
70
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
71
+ value: 85.351
72
+ date: '2026-03-09'
73
+ notes: Obtained using MTEB v2.10.8
74
+ source:
75
+ url: https://github.com/embeddings-benchmark/mteb/
76
+ name: Obtained using MTEB v2.10.8
77
+ user: mteb
78
+ - dataset:
79
+ id: mteb/WikipediaRetrievalMultilingual
80
+ task_id: WikipediaRetrievalMultilingual_fi_test
81
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
82
+ value: 72.759
83
+ date: '2026-03-09'
84
+ notes: Obtained using MTEB v2.10.8
85
+ source:
86
+ url: https://github.com/embeddings-benchmark/mteb/
87
+ name: Obtained using MTEB v2.10.8
88
+ user: mteb
89
+ - dataset:
90
+ id: mteb/WikipediaRetrievalMultilingual
91
+ task_id: WikipediaRetrievalMultilingual_hi_test
92
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
93
+ value: 51.342
94
+ date: '2026-03-09'
95
+ notes: Obtained using MTEB v2.10.8
96
+ source:
97
+ url: https://github.com/embeddings-benchmark/mteb/
98
+ name: Obtained using MTEB v2.10.8
99
+ user: mteb
100
+ - dataset:
101
+ id: mteb/WikipediaRetrievalMultilingual
102
+ task_id: WikipediaRetrievalMultilingual_it_test
103
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
104
+ value: 84.36
105
+ date: '2026-03-09'
106
+ notes: Obtained using MTEB v2.10.8
107
+ source:
108
+ url: https://github.com/embeddings-benchmark/mteb/
109
+ name: Obtained using MTEB v2.10.8
110
+ user: mteb
111
+ - dataset:
112
+ id: mteb/WikipediaRetrievalMultilingual
113
+ task_id: WikipediaRetrievalMultilingual_nl_test
114
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
115
+ value: 84.377
116
+ date: '2026-03-09'
117
+ notes: Obtained using MTEB v2.10.8
118
+ source:
119
+ url: https://github.com/embeddings-benchmark/mteb/
120
+ name: Obtained using MTEB v2.10.8
121
+ user: mteb
122
+ - dataset:
123
+ id: mteb/WikipediaRetrievalMultilingual
124
+ task_id: WikipediaRetrievalMultilingual_pt_test
125
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
126
+ value: 84.059
127
+ date: '2026-03-09'
128
+ notes: Obtained using MTEB v2.10.8
129
+ source:
130
+ url: https://github.com/embeddings-benchmark/mteb/
131
+ name: Obtained using MTEB v2.10.8
132
+ user: mteb
133
+ - dataset:
134
+ id: mteb/WikipediaRetrievalMultilingual
135
+ task_id: WikipediaRetrievalMultilingual_ro_test
136
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
137
+ value: 78.126
138
+ date: '2026-03-09'
139
+ notes: Obtained using MTEB v2.10.8
140
+ source:
141
+ url: https://github.com/embeddings-benchmark/mteb/
142
+ name: Obtained using MTEB v2.10.8
143
+ user: mteb
144
+ - dataset:
145
+ id: mteb/WikipediaRetrievalMultilingual
146
+ task_id: WikipediaRetrievalMultilingual_sr_test
147
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
148
+ value: 75.955
149
+ date: '2026-03-09'
150
+ notes: Obtained using MTEB v2.10.8
151
+ source:
152
+ url: https://github.com/embeddings-benchmark/mteb/
153
+ name: Obtained using MTEB v2.10.8
154
+ user: mteb
155
+ - dataset:
156
+ id: mteb/WikipediaRetrievalMultilingual
157
+ task_id: WikipediaRetrievalMultilingual_no_test
158
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
159
+ value: 80.21
160
+ date: '2026-03-09'
161
+ notes: Obtained using MTEB v2.10.8
162
+ source:
163
+ url: https://github.com/embeddings-benchmark/mteb/
164
+ name: Obtained using MTEB v2.10.8
165
+ user: mteb
166
+ - dataset:
167
+ id: mteb/WikipediaRetrievalMultilingual
168
+ task_id: WikipediaRetrievalMultilingual_sv_test
169
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
170
+ value: 83.108
171
+ date: '2026-03-09'
172
+ notes: Obtained using MTEB v2.10.8
173
+ source:
174
+ url: https://github.com/embeddings-benchmark/mteb/
175
+ name: Obtained using MTEB v2.10.8
176
+ user: mteb
177
+ - dataset:
178
+ id: mteb/WikipediaRetrievalMultilingual
179
+ task_id: WikipediaRetrievalMultilingual
180
+ revision: 5f6c91d21f2f5b9afb663858d19848fbd223c775
181
+ value: 78.07144
182
+ date: '2026-03-09'
183
+ notes: Obtained using MTEB v2.10.8
184
+ source:
185
+ url: https://github.com/embeddings-benchmark/mteb/
186
+ name: Obtained using MTEB v2.10.8
187
+ user: mteb
.eval_results/WinoGrande.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/WinoGrande
3
+ task_id: WinoGrande_default_test
4
+ revision: 4dec9c5666e9f84702ac614363db6d96a68bc6de
5
+ value: 55.443
6
+ date: '2026-03-09'
7
+ notes: Obtained using MTEB v2.10.8
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.8
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/WinoGrande
14
+ task_id: WinoGrande
15
+ revision: 4dec9c5666e9f84702ac614363db6d96a68bc6de
16
+ value: 55.443
17
+ date: '2026-03-09'
18
+ notes: Obtained using MTEB v2.10.8
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.8
22
+ user: mteb