File size: 1,915 Bytes
8c3ee17 055b4f0 122a515 b4eae49 055b4f0 172309b 055b4f0 172309b 055b4f0 172309b b4eae49 172309b 8c3ee17 172309b 122a515 172309b 8c3ee17 172309b 122a515 8c3ee17 122a515 8c3ee17 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 | ---
license: apache-2.0
tags:
- generated_from_trainer
metrics:
- bleu
model-index:
- name: hieroglyph_unicode_translator_t5_small
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# Hieroglyph Unicode Translator Model
This model was created to translate hieroglyphs into english.
Egyptian Hieroglyphs have been grouped into different classes and given a referencing method called Gardiner Codes using Gardiner Classification.
Using the Gardiner Codes we can assign meanings to different combinations of hieroglyphs.
To Translate any sequence of hieroglyphs using this model, provide the following input :-
"Translate hieroglyph unicode sequence to English: {Gardiner Codes of the Hieroglyphs}."
## Model description
This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on a custom dataset derived from the [Dictionary of Middle Egyptian](https://archive.org/details/DictionaryOfMiddleEgyptian).
## Intended uses & limitations
The Model is intended to be used to translate hieroglyphs.
The model does not provide full sentences, it only outputs bits and keywords.
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 2
### Training results
| Training Loss | Epoch | Step | Validation Loss | Gen Len |
|:-------------:|:-----:|:----:|:---------------:|:-------:|
| 5.0665 | 1.0 | 688 | 4.2034 | 6.946 |
| 4.4621 | 2.0 | 1376 | 4.1388 | 6.946 |
### Framework versions
- Transformers 4.27.4
- Pytorch 2.2.0.dev20231113
- Datasets 2.12.0
- Tokenizers 0.13.3
|