End of training

README.md

@@ -1,6 +1,4 @@
 ---
-license: mit
-base_model: gpt2
 tags:
 - generated_from_trainer
 model-index:
@@ -13,7 +11,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # gpt2-wikitext2
 
-This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
+This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
 
 ## Model description
 
@@ -32,16 +30,16 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0005
+- learning_rate: 0.01
 - train_batch_size: 32
 - eval_batch_size: 32
 - seed: 42
-- gradient_accumulation_steps: 8
-- total_train_batch_size: 256
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 64
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
-- lr_scheduler_warmup_steps: 1000
-- num_epochs: 1
+- lr_scheduler_warmup_steps: 100
+- num_epochs: 5
 - mixed_precision_training: Native AMP
 
 ### Training results

generation_config.json

@@ -1,6 +1,4 @@
 {
   "_from_model_config": true,
-  "bos_token_id": 0,
-  "eos_token_id": 0,
   "transformers_version": "4.41.2"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ff40cb9be47b6ce12eaffd4c13864dec001e62cf62ad3f37cfdf22b3518abf2c
+oid sha256:8415dbbe364d4d318f11ed5d27d0de378c72adc52493bd380919a331546bb1d6
 size 46040892

runs/Jun02_12-19-09_ip-10-192-11-99/events.out.tfevents.1717330750.ip-10-192-11-99.3471.9

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:13e1ef3ec559ee216b5303cf0443fe1846aa8ce61920f02157f298694cc0c5fb
-size 5629
+oid sha256:583a91545c6f0d38a75084e8924a1e5c9e60137436727ccc28a9857e3b4c6120
+size 6851