End of training

README.md

@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.1270
-- Bleu: 0.1514
-- Gen Len: 19.0
+- Loss: 2.1911
+- Bleu: 0.1208
+- Gen Len: 18.9504
 
 ## Model description
 
@@ -50,13 +50,13 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Bleu   | Gen Len |
 |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
-| No log        | 1.0   | 8    | 2.2852          | 0.1544 | 19.0    |
-| No log        | 2.0   | 16   | 2.1270          | 0.1514 | 19.0    |
+| No log        | 1.0   | 8    | 2.3434          | 0.1222 | 18.9504 |
+| No log        | 2.0   | 16   | 2.1911          | 0.1208 | 18.9504 |
 
 
 ### Framework versions
 
-- Transformers 4.31.0
-- Pytorch 2.0.0a0+git70f6d0c
-- Datasets 2.14.0
+- Transformers 4.32.0
+- Pytorch 2.1.0a0+git794e397
+- Datasets 2.14.4
 - Tokenizers 0.13.3

config.json

@@ -3,6 +3,7 @@
   "architectures": [
     "T5ForConditionalGeneration"
   ],
+  "classifier_dropout": 0.0,
   "d_ff": 2048,
   "d_kv": 64,
   "d_model": 512,
@@ -54,7 +55,7 @@
     }
   },
   "torch_dtype": "float32",
-  "transformers_version": "4.31.0",
+  "transformers_version": "4.32.0",
   "use_cache": true,
   "vocab_size": 32128
 }

generation_config.json

@@ -2,5 +2,5 @@
   "decoder_start_token_id": 0,
   "eos_token_id": 1,
   "pad_token_id": 0,
-  "transformers_version": "4.31.0"
+  "transformers_version": "4.32.0"
 }

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b605c8c0b2a967b15633d65b80a060e44c862550b2e016193390696b062ba092
-size 242071641
+oid sha256:51e4583b4bd952e7f488dbe49d7f2731ebb2d58a66e99d549ff2abf9233667b4
+size 242071838

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5c170dd0d3dfb4bcfe7e4d394d1cdc059c8263f17c8cec937f8e33e660606f77
-size 4091
+oid sha256:2df2faf3a2e2848a20c008bc528b31cfd02062b8ea00f7711c06b9f21f06c069
+size 4416