Update README.md
Browse files
README.md
CHANGED
|
@@ -54,10 +54,6 @@ computed by summing, over query tokens, the maximum similarity to a document tok
|
|
| 54 |
| [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | **92.02** | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | **89.67** | **21.90** | 76.61 | 83.60 | 30.52 |
|
| 55 |
| **GLINT-base** | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | 47.68 | 92.45 | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
|
| 56 |
|
| 57 |
-
GLINT-base was evaluated with the project BEIR protocol: corpus IDs are excluded from their own
|
| 58 |
-
query results for ArguAna and Quora, and ArguAna uses 64 query tokens. The 57.43 average is one
|
| 59 |
-
run; it should not be interpreted as a seed-variance estimate.
|
| 60 |
-
|
| 61 |
## Training data and reproducibility
|
| 62 |
|
| 63 |
The corresponding private training artifacts are in
|
|
|
|
| 54 |
| [LateOn](https://huggingface.co/lightonai/LateOn) | 57.22 | 149 | 128 | 50.52 | 47.36 | **39.67** | 45.99 | **92.02** | **53.12** | 79.98 | 45.67 | 37.79 | 63.91 | **89.67** | **21.90** | 76.61 | 83.60 | 30.52 |
|
| 55 |
| **GLINT-base** | **57.43** | 149 | 128 | 52.38 | 46.49 | 34.17 | 47.68 | 92.45 | 50.85 | **82.54** | 46.38 | 37.51 | **68.03** | **90.08** | 20.65 | **77.13** | 84.78 | 30.26 |
|
| 56 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
## Training data and reproducibility
|
| 58 |
|
| 59 |
The corresponding private training artifacts are in
|