File size: 1,614 Bytes
77a5266 8652eee 77a5266 75633aa 77a5266 e87abbd 65d24dd ec2dbf3 e87abbd 77a5266 1b212e5 a1c4114 77a5266 75633aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 |
---
tags:
- mt5
- adapter-transformers
- DefinitionGeneration
- definition-modeling
license: gpl-3.0
language:
- de
base_model:
- google/mt5-base
datasets:
- jfeil/GermanDefinitionGeneration-Wiktionary
---
# Adapter `jfeil/GermanDefinitionGeneration-Wiktionary` for google/mt5-base
An [adapter](https://adapterhub.ml) for the `google/mt5-base` model that was trained on the [jfeil/GermanDefinitionGeneration-Wiktionary](https://huggingface.co/datasets/jfeil/GermanDefinitionGeneration-Wiktionary/) dataset.
This adapter was created for usage with the **[Adapters](https://github.com/Adapter-Hub/adapters)** library.
## Usage
First, install `adapters`:
```
pip install -U adapters
```
Now, the adapter can be loaded and activated like this:
```python
from adapters import AutoAdapterModel
model = AutoAdapterModel.from_pretrained("google/mt5-base")
adapter_name = model.load_adapter("jfeil/GermanDefinitionGeneration-Wiktionary", source="hf", set_active=True)
```
## Architecture & Training
TODO
## Optimal Inferencing Parameters
* num_beams 5
* repetition_penalty 1.5
* Prompt: `<EXAMPLE_SENTENCE> Was ist die Definition von <EXAMPLE_WORD>?`
## Evaluation results
Tested on Wiktionary test set:
| | MeteorScore | ROUGE-L | BERTscore-F1 | MoverScore | Sentence Embedding Score |
|--------------|-------------|---------|--------------|------------|--------------------------|
| Wiktionary | 0.175 | 0.187 | 0.751 | 0.568 | 0.478 |
| Distillation | 0.103 | 0.109 | 0.675 | 0.536 | 0.369 |
## Citation
TODO |