Upload README.md
Browse files
README.md
CHANGED
|
@@ -55,20 +55,20 @@ The table below shows the average BEIR benchmark scores (nDCG@10) for `mdbr-leaf
|
|
| 55 |
|
| 56 |
`mdbr-leaf-ir` ranks #1 on the BEIR public leaderboard, and when run in asymmetric "**(asym.)**" mode as described [here](#asymmetric-retrieval-setup), the results improve even further.
|
| 57 |
|
| 58 |
-
| Model | Size
|
| 59 |
-
|------------------------------------|------|----------------------|
|
| 60 |
-
|
|
| 61 |
-
|
|
| 62 |
-
|
|
| 63 |
-
|
|
| 64 |
-
|
|
| 65 |
-
|
|
| 66 |
-
|
|
| 67 |
-
|
|
| 68 |
-
|
|
| 69 |
-
|
|
| 70 |
-
|
| 71 |
-
|
| 72 |
|
| 73 |
|
| 74 |
# Quickstart
|
|
|
|
| 55 |
|
| 56 |
`mdbr-leaf-ir` ranks #1 on the BEIR public leaderboard, and when run in asymmetric "**(asym.)**" mode as described [here](#asymmetric-retrieval-setup), the results improve even further.
|
| 57 |
|
| 58 |
+
| Model | Size | BEIR Avg. (nDCG@10) |
|
| 59 |
+
|------------------------------------|---------|----------------------|
|
| 60 |
+
| Google text-embedding-005 | Unknown | 55.81 |
|
| 61 |
+
| OpenAI text-embedding-3-large | Unknown | 55.43 |
|
| 62 |
+
| **mdbr-leaf-ir (asym.)** | 23M | **54.03** |
|
| 63 |
+
| **mdbr-leaf-ir** | 23M | **53.55** |
|
| 64 |
+
| snowflake-arctic-embed-s | 32M | 51.98 |
|
| 65 |
+
| bge-small-en-v1.5 | 33M | 51.65 |
|
| 66 |
+
| granite-embedding-small-english-r2 | 47M | 50.87 |
|
| 67 |
+
| snowflake-arctic-embed-xs | 23M | 50.15 |
|
| 68 |
+
| e5-small-v2 | 33M | 49.04 |
|
| 69 |
+
| SPLADE++ | 110M | 48.88 |
|
| 70 |
+
| MiniLM-L6-v2 | 23M | 41.95 |
|
| 71 |
+
| BM25 | – | 41.14 |
|
| 72 |
|
| 73 |
|
| 74 |
# Quickstart
|