Slavic Byt5 for Kashubian Inflection
Collection
Please refer to https://github.com/TUM-NLP/kashubian-morphological-inflection for a model description. โข 14 items โข Updated
How to use livles/slavic-distant with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("livles/slavic-distant")
model = AutoModelForSeq2SeqLM.from_pretrained("livles/slavic-distant", device_map="auto")This model is a fine-tuned version of google/byt5-small on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 0.1188 | 1.0 | 4375 | 0.0825 |
| 0.0553 | 2.0 | 8750 | 0.0601 |
| 0.0441 | 3.0 | 13125 | 0.0577 |
| 0.0357 | 4.0 | 17500 | 0.0579 |
Base model
google/byt5-small