jfeil
/

GermanDefinitionGeneration-Wiktionary

DefinitionGeneration

definition-modeling

Model card Files Files and versions

jfeil commited on Nov 21, 2024

Commit

a1c4114

·

verified ·

1 Parent(s): ec2dbf3

Update README.md

Files changed (1) hide show

README.md +7 -1

README.md CHANGED Viewed

@@ -48,7 +48,13 @@ adapter_name = model.load_adapter("jfeil/GermanDefinitionGeneration-Wiktionary",
 ## Evaluation results
-<!-- Add some description here -->
 ## Citation

 ## Evaluation results
+Tested on Wiktionary test set
+|              | MeteorScore | ROUGE-L | BERTscore-F1 | MoverScore | Sentence Embedding Score |
+|--------------|-------------|---------|--------------|------------|--------------------------|
+| Wiktionary   | 0.175       | 0.187   | 0.751        | 0.568      | 0.478                    |
+| Distillation | 0.103       | 0.109   | 0.675        | 0.536      | 0.369                    |
 ## Citation