Slavic Byt5 for Kashubian Inflection
Collection
Please refer to https://github.com/TUM-NLP/kashubian-morphological-inflection for a model description. โข 14 items โข Updated
How to use livles/hier-csb-gemini with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("livles/hier-csb-gemini")
model = AutoModelForSeq2SeqLM.from_pretrained("livles/hier-csb-gemini", device_map="auto")This model is a fine-tuned version of google/byt5-small on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 2.4567 | 1.0 | 625 | 0.4717 |
| 0.5463 | 2.0 | 1250 | 0.3791 |
| 0.4463 | 3.0 | 1875 | 0.3564 |
| 0.3584 | 4.0 | 2500 | 0.3455 |
| 0.3416 | 5.0 | 3125 | 0.3344 |
| 0.3269 | 6.0 | 3750 | 0.3194 |
| 0.3111 | 7.0 | 4375 | 0.3179 |
| 0.2926 | 8.0 | 5000 | 0.3161 |
| 0.2833 | 9.0 | 5625 | 0.3120 |
| 0.2738 | 10.0 | 6250 | 0.3138 |
| 0.2712 | 11.0 | 6875 | 0.3145 |
| 0.2649 | 12.0 | 7500 | 0.3139 |
Base model
google/byt5-small