SunSiShining commited on
Commit
d98e833
·
1 Parent(s): 097b38b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -1,3 +1,21 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+ This model is the passage encoder of ANCE-Tele trained on NQ, described in the EMNLP 2022 paper ["Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negatives"](https://arxiv.org/pdf/2210.17167.pdf). The associated GitHub repository is available at https://github.com/OpenMatch/ANCE-Tele.
5
+
6
+ ANCE-Tele only trains with self-mined negatives (teleportation negatives) without using additional negatives (e.g., BM25, other DR systems) and eliminates the dependency on filtering strategies and distillation modules.
7
+
8
+
9
+ |NQ (Test)|R@5|R@20|R@20|
10
+ |:---|:---|:---|:---|
11
+ |ANCE-Tele|77.0|84.9|89.7|
12
+
13
+
14
+ ```
15
+ @inproceedings{sun2022ancetele,
16
+ title={Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negatives},
17
+ author={Si Sun, Chenyan Xiong, Yue Yu, Arnold Overwijk, Zhiyuan Liu and Jie Bao},
18
+ booktitle={Proceedings of EMNLP 2022},
19
+ year={2022}
20
+ }
21
+ ```