Update README.md
Browse files
README.md
CHANGED
|
@@ -114,9 +114,9 @@ for i, definition in enumerate(definitions):
|
|
| 114 |
|
| 115 |
### Benchmark Results
|
| 116 |
- **Dataset:** Zero-Shot Entity Linking [(Logeswaran et al., 2019)](https://arxiv.org/abs/1906.07348) test set.
|
| 117 |
-
- **Metric:** Recall@64 (Average performance across the set of test worlds was computed by macroaveraging - we followed the same pattern as
|
| 118 |
- **Score:** 80.29%
|
| 119 |
-
- **Comparison:**
|
| 120 |
- **Conclusion:** Our model has strong zero-shot performance
|
| 121 |
|
| 122 |
### Usage Recommendations
|
|
|
|
| 114 |
|
| 115 |
### Benchmark Results
|
| 116 |
- **Dataset:** Zero-Shot Entity Linking [(Logeswaran et al., 2019)](https://arxiv.org/abs/1906.07348) test set.
|
| 117 |
+
- **Metric:** Recall@64 (Average performance across the set of test worlds was computed by macroaveraging - we followed the same pattern as [Meta AI's BLINK paper](https://arxiv.org/pdf/1911.03814))
|
| 118 |
- **Score:** 80.29%
|
| 119 |
+
- **Comparison:** Meta AI's BLINK achieves 82.06% on the same test set - slightly higher than ours, however, their model was trained on the training set but ours was not.
|
| 120 |
- **Conclusion:** Our model has strong zero-shot performance
|
| 121 |
|
| 122 |
### Usage Recommendations
|