Commit ·
d1524b0
1
Parent(s): 4684339
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,30 +1,38 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: cc-by-nc-sa-3.0
|
| 3 |
-
metrics:
|
| 4 |
-
- f1
|
| 5 |
-
- accuracy
|
| 6 |
-
widget:
|
| 7 |
-
- text: "We are at a relationship crossroad"
|
| 8 |
-
example_title: "Metaphoric1"
|
| 9 |
-
- text: "The car waits at a crossroad"
|
| 10 |
-
example_title: "Literal1"
|
| 11 |
-
- text: "I win the argument"
|
| 12 |
-
example_title: "Metaphoric2"
|
| 13 |
-
- text: "I win the game"
|
| 14 |
-
example_title: "Literal2"
|
| 15 |
-
---
|
| 16 |
-
|
| 17 |
-
# Multilingual-Metaphor-Detection
|
| 18 |
-
|
| 19 |
-
This page provides a fine-tuned multilingual language model [XLM-RoBERTa](https://arxiv.org/pdf/1911.02116.pdf) for metaphor detection on a token-level using the [Huggingface token-classification approach](https://huggingface.co/tasks/token-classification). Label 1 corresponds to metaphoric usage.
|
| 20 |
-
|
| 21 |
-
# Dataset
|
| 22 |
-
The dataset the model is trained on is the [VU Amsterdam Metaphor Corpus](http://www.vismet.org/metcor/documentation/home.html) that was annotated on a word-level following the metaphor identification protocol. The training corpus is restricted to English, however, XLM-R shows decent zero-shot performances when tested on other languages.
|
| 23 |
-
|
| 24 |
-
# Results
|
| 25 |
-
Following the evaluation criteria from the [2020 Second Shared Task on Metaphor detection](https://competitions.codalab.org/competitions/22188#results) our model achieves a F1-Score of 0.76 for the metaphor-class when training XLM-R<sub>Base</sub> and 0.77 when training XLM-R<sub>Large.</sub>.
|
| 26 |
-
|
| 27 |
-
We train for 8 epochs loading the model with the best evaluation performance at the end and using a learning rate of 2e-5. From the allocated training data 10% are utilized for validation while the final test set is being kept seperate and only used for the final evaluation.
|
| 28 |
-
|
| 29 |
-
# Code for Training
|
| 30 |
-
The training and evaluation code is available on [Github](https://github.com/lwachowiak/Multilingual-Metaphor-Detection/)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-nc-sa-3.0
|
| 3 |
+
metrics:
|
| 4 |
+
- f1
|
| 5 |
+
- accuracy
|
| 6 |
+
widget:
|
| 7 |
+
- text: "We are at a relationship crossroad"
|
| 8 |
+
example_title: "Metaphoric1"
|
| 9 |
+
- text: "The car waits at a crossroad"
|
| 10 |
+
example_title: "Literal1"
|
| 11 |
+
- text: "I win the argument"
|
| 12 |
+
example_title: "Metaphoric2"
|
| 13 |
+
- text: "I win the game"
|
| 14 |
+
example_title: "Literal2"
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Multilingual-Metaphor-Detection
|
| 18 |
+
|
| 19 |
+
This page provides a fine-tuned multilingual language model [XLM-RoBERTa](https://arxiv.org/pdf/1911.02116.pdf) for metaphor detection on a token-level using the [Huggingface token-classification approach](https://huggingface.co/tasks/token-classification). Label 1 corresponds to metaphoric usage.
|
| 20 |
+
|
| 21 |
+
# Dataset
|
| 22 |
+
The dataset the model is trained on is the [VU Amsterdam Metaphor Corpus](http://www.vismet.org/metcor/documentation/home.html) that was annotated on a word-level following the metaphor identification protocol. The training corpus is restricted to English, however, XLM-R shows decent zero-shot performances when tested on other languages.
|
| 23 |
+
|
| 24 |
+
# Results
|
| 25 |
+
Following the evaluation criteria from the [2020 Second Shared Task on Metaphor detection](https://competitions.codalab.org/competitions/22188#results) our model achieves a F1-Score of 0.76 for the metaphor-class when training XLM-R<sub>Base</sub> and 0.77 when training XLM-R<sub>Large.</sub>.
|
| 26 |
+
|
| 27 |
+
We train for 8 epochs loading the model with the best evaluation performance at the end and using a learning rate of 2e-5. From the allocated training data 10% are utilized for validation while the final test set is being kept seperate and only used for the final evaluation.
|
| 28 |
+
|
| 29 |
+
# Code for Training and Reference
|
| 30 |
+
The training and evaluation code is available on [Github](https://github.com/lwachowiak/Multilingual-Metaphor-Detection/).
|
| 31 |
+
Our [paper](https://aclanthology.org/2022.flp-1.7/) describing training and model application is available online:
|
| 32 |
+
>@inproceedings{wachowiak2022drum,
|
| 33 |
+
> title={Drum Up SUPPORT: Systematic Analysis of Image-Schematic Conceptual Metaphors},
|
| 34 |
+
> author={Wachowiak, Lennart and Gromann, Dagmar and Xu, Chao},
|
| 35 |
+
> booktitle={Proceedings of the 3rd Workshop on Figurative Language Processing (FLP)},
|
| 36 |
+
> pages={44--53},
|
| 37 |
+
> year={2022}
|
| 38 |
+
>}
|