This transformer model is fine-tuned to understand by the context of the sentence the definition of the homonym "ბარი" (Transl: "Bari")
It is a simple Transformer model fine-tuned on a dataset comprising 4800 hand-classified sentences.
It shows 95% accuracy on a test set comprising 1200 hand-classified sentences.
The original 6000 sentences were split into 80% training data and 20% testing data. link to dataset
The model identifies 3 definitions: label_0 - "Shovel", label_1 - "Lowland", label_2 - "Cafe-Restaurant."
My fine-tuned transformer model is based on a pre-trained transformer model which was downloaded from: https://huggingface.co/Davit6174/georgian-distilbert-mlm
- Downloads last month
- 9