Slavic Byt5 for Kashubian Inflection
Collection
Please refer to https://github.com/TUM-NLP/kashubian-morphological-inflection for a model description. โข 14 items โข Updated
This model is a fine-tuned version of google/byt5-small on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.7002 | 1.0 | 625 | 0.1894 |
| 0.2449 | 2.0 | 1250 | 0.0806 |
| 0.1344 | 3.0 | 1875 | 0.0419 |
| 0.0764 | 4.0 | 2500 | 0.0317 |
Base model
google/byt5-small