qlemesle commited on
Commit
35a61d4
·
1 Parent(s): 50bd00a
Files changed (1) hide show
  1. README.md +1 -12
README.md CHANGED
@@ -86,19 +86,8 @@ This metric is based on an LLM and therefore is limited by the LLM used.
86
  Lolive, Damien and
87
  Delhay, Arnaud and
88
  Barbot, Nelly",
89
- editor = "Rambow, Owen and
90
- Wanner, Leo and
91
- Apidianaki, Marianna and
92
- Al-Khalifa, Hend and
93
- Eugenio, Barbara Di and
94
- Schockaert, Steven",
95
  booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
96
- month = jan,
97
  year = "2025",
98
- address = "Abu Dhabi, UAE",
99
- publisher = "Association for Computational Linguistics",
100
- url = "https://aclanthology.org/2025.coling-main.538/",
101
- pages = "8057--8087",
102
- abstract = "Evaluating automatic paraphrase production systems is a difficult task as it involves, among other things, assessing the semantic proximity between two sentences. Usual measures are based on lexical distances, or at least on semantic embedding alignments. The rise of Large Language Models (LLM) has provided tools to model relationships within a text thanks to the attention mechanism. In this article, we introduce ParaPLUIE, a new measure based on a log likelihood ratio from an LLM, to assess the quality of a potential paraphrase. This measure is compared with usual measures on two known by the NLP community datasets prior to this study. Three new small datasets have been built to allow metrics to be compared in different scenario and to avoid data contamination bias. According to evaluations, the proposed measure is better for sorting pairs of sentences by semantic proximity. In particular, it is much more independent to lexical distance and provides an interpretable classification threshold between paraphrases and non-paraphrases."
103
  }
104
  ```
 
86
  Lolive, Damien and
87
  Delhay, Arnaud and
88
  Barbot, Nelly",
 
 
 
 
 
 
89
  booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
 
90
  year = "2025",
91
+ url = "https://aclanthology.org/2025.coling-main.538/"
 
 
 
 
92
  }
93
  ```