nik kon commited on
Commit
5a56106
·
1 Parent(s): 2abdff3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -1,5 +1,5 @@
1
- Dataset
2
- The dataset used is a variant of the Persona-Chat dataset, which contains 19319 short dialogues in Greek.
3
 
4
 
5
  Using the pre-trained gpt2-greek(https://huggingface.co/nikokons/gpt2-greek) model, we fine-tune the model on this Greek version of translated Persona-Chat dataset for 3 epochs until there is no progress in validation loss. The model's input is customized to the Greek version of the PERSONA-CHAT dataset to perform the fine-tuning procedure. A batch size of 4 is used, and gradients are accumulated over 8 iterations, resulting in a total batch size of 32. The Adam optimization scheme is used, with a learning rate of 5.7e-5.
 
1
+ Dataset:
2
+ A variant of the Persona-Chat dataset was used, which contains 19319 short dialogues. MarianMT, a free and efficient Neural Machine Translation framework, was used to translate this dataset into Greek.
3
 
4
 
5
  Using the pre-trained gpt2-greek(https://huggingface.co/nikokons/gpt2-greek) model, we fine-tune the model on this Greek version of translated Persona-Chat dataset for 3 epochs until there is no progress in validation loss. The model's input is customized to the Greek version of the PERSONA-CHAT dataset to perform the fine-tuning procedure. A batch size of 4 is used, and gradients are accumulated over 8 iterations, resulting in a total batch size of 32. The Adam optimization scheme is used, with a learning rate of 5.7e-5.