bib
Browse files
README.md
CHANGED
|
@@ -86,19 +86,8 @@ This metric is based on an LLM and therefore is limited by the LLM used.
|
|
| 86 |
Lolive, Damien and
|
| 87 |
Delhay, Arnaud and
|
| 88 |
Barbot, Nelly",
|
| 89 |
-
editor = "Rambow, Owen and
|
| 90 |
-
Wanner, Leo and
|
| 91 |
-
Apidianaki, Marianna and
|
| 92 |
-
Al-Khalifa, Hend and
|
| 93 |
-
Eugenio, Barbara Di and
|
| 94 |
-
Schockaert, Steven",
|
| 95 |
booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
|
| 96 |
-
month = jan,
|
| 97 |
year = "2025",
|
| 98 |
-
|
| 99 |
-
publisher = "Association for Computational Linguistics",
|
| 100 |
-
url = "https://aclanthology.org/2025.coling-main.538/",
|
| 101 |
-
pages = "8057--8087",
|
| 102 |
-
abstract = "Evaluating automatic paraphrase production systems is a difficult task as it involves, among other things, assessing the semantic proximity between two sentences. Usual measures are based on lexical distances, or at least on semantic embedding alignments. The rise of Large Language Models (LLM) has provided tools to model relationships within a text thanks to the attention mechanism. In this article, we introduce ParaPLUIE, a new measure based on a log likelihood ratio from an LLM, to assess the quality of a potential paraphrase. This measure is compared with usual measures on two known by the NLP community datasets prior to this study. Three new small datasets have been built to allow metrics to be compared in different scenario and to avoid data contamination bias. According to evaluations, the proposed measure is better for sorting pairs of sentences by semantic proximity. In particular, it is much more independent to lexical distance and provides an interpretable classification threshold between paraphrases and non-paraphrases."
|
| 103 |
}
|
| 104 |
```
|
|
|
|
| 86 |
Lolive, Damien and
|
| 87 |
Delhay, Arnaud and
|
| 88 |
Barbot, Nelly",
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 89 |
booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
|
|
|
|
| 90 |
year = "2025",
|
| 91 |
+
url = "https://aclanthology.org/2025.coling-main.538/"
|
|
|
|
|
|
|
|
|
|
|
|
|
| 92 |
}
|
| 93 |
```
|