End of training

README.md

@@ -33,11 +33,11 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0005
-- train_batch_size: 32
-- eval_batch_size: 32
+- train_batch_size: 16
+- eval_batch_size: 16
 - seed: 42
-- gradient_accumulation_steps: 16
-- total_train_batch_size: 512
+- gradient_accumulation_steps: 8
+- total_train_batch_size: 128
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 1000
@@ -50,7 +50,7 @@ The following hyperparameters were used during training:
 
 ### Framework versions
 
-- Transformers 4.41.2
-- Pytorch 2.3.0+cu121
-- Datasets 2.19.2
+- Transformers 4.42.4
+- Pytorch 2.3.1+cu121
+- Datasets 2.21.0
 - Tokenizers 0.19.1

generation_config.json

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 0,
   "eos_token_id": 0,
-  "transformers_version": "4.41.2"
+  "transformers_version": "4.42.4"
 }