End of training

README.md

@@ -2,7 +2,6 @@
 license: mit
 base_model: gpt2
 tags:
-- text-generation
 - generated_from_trainer
 model-index:
 - name: codeparrot-ds
@@ -15,6 +14,8 @@ should probably proofread and complete it, then remove this comment. -->
 # codeparrot-ds
 
 This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.1626
 
 ## Model description
 
@@ -47,11 +48,15 @@ The following hyperparameters were used during training:
 
 ### Training results
 
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 3.7408        | 0.4647 | 1000 | 3.0204          |
+| 2.4439        | 0.9293 | 2000 | 2.1626          |
 
 
 ### Framework versions
 
-- Transformers 4.36.2
-- Pytorch 2.1.1
-- Datasets 2.16.1
-- Tokenizers 0.15.0
+- Transformers 4.40.1
+- Pytorch 2.1.0
+- Datasets 2.19.0
+- Tokenizers 0.19.1

generation_config.json

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 0,
   "eos_token_id": 0,
-  "transformers_version": "4.36.2"
+  "transformers_version": "4.40.1"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cd7b503403a63e3a44d8c03956dd0f6d51acbfe336cf43a747a26a1e5fa2e0d7
+oid sha256:109d59f36c00666977d3f7001b49b1db38d682ad15f0cd72279307667ec9b116
 size 496984704