End of training

README.md

@@ -0,0 +1,87 @@
+---
+library_name: transformers
+license: mit
+base_model: gpt2
+tags:
+- generated_from_trainer
+model-index:
+- name: gpt2-wikitext2
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# gpt2-wikitext2
+
+This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.4411
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- num_epochs: 30
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| No log        | 1.0   | 136  | 2.6125          |
+| No log        | 2.0   | 272  | 2.3027          |
+| No log        | 3.0   | 408  | 2.1283          |
+| 2.7351        | 4.0   | 544  | 1.9970          |
+| 2.7351        | 5.0   | 680  | 1.8977          |
+| 2.7351        | 6.0   | 816  | 1.8174          |
+| 2.7351        | 7.0   | 952  | 1.7532          |
+| 1.9296        | 8.0   | 1088 | 1.6992          |
+| 1.9296        | 9.0   | 1224 | 1.6594          |
+| 1.9296        | 10.0  | 1360 | 1.6301          |
+| 1.9296        | 11.0  | 1496 | 1.5985          |
+| 1.6853        | 12.0  | 1632 | 1.5784          |
+| 1.6853        | 13.0  | 1768 | 1.5560          |
+| 1.6853        | 14.0  | 1904 | 1.5433          |
+| 1.5639        | 15.0  | 2040 | 1.5262          |
+| 1.5639        | 16.0  | 2176 | 1.5109          |
+| 1.5639        | 17.0  | 2312 | 1.5018          |
+| 1.5639        | 18.0  | 2448 | 1.4957          |
+| 1.4932        | 19.0  | 2584 | 1.4823          |
+| 1.4932        | 20.0  | 2720 | 1.4741          |
+| 1.4932        | 21.0  | 2856 | 1.4681          |
+| 1.4932        | 22.0  | 2992 | 1.4618          |
+| 1.448         | 23.0  | 3128 | 1.4559          |
+| 1.448         | 24.0  | 3264 | 1.4543          |
+| 1.448         | 25.0  | 3400 | 1.4487          |
+| 1.4177        | 26.0  | 3536 | 1.4463          |
+| 1.4177        | 27.0  | 3672 | 1.4435          |
+| 1.4177        | 28.0  | 3808 | 1.4429          |
+| 1.4177        | 29.0  | 3944 | 1.4424          |
+| 1.4044        | 30.0  | 4080 | 1.4411          |
+
+
+### Framework versions
+
+- Transformers 4.46.1
+- Pytorch 2.3.0+cu121
+- Datasets 3.1.0
+- Tokenizers 0.20.1

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 50256,
+  "eos_token_id": 50256,
+  "transformers_version": "4.46.1"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:708084547512a67839958c752aa618baebb9452c652491605e021b3277241cda
+oid sha256:a70e9c1d4f75985d0f3b42140c603f3c226549bcf09774f772fb1abb16f96154
 size 497774208

runs/Nov04_14-05-48_autodl-container-b0b64ab924-20ecb542/events.out.tfevents.1730700356.autodl-container-b0b64ab924-20ecb542.1318.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f0056c0f868532fecb0f38198cb1f44fe9d4d7360754637a91365c4058d74f3c
-size 14815
+oid sha256:4c2b1e98601a616fcfd2217fb896549f312ce2e6dc2f994e999554216a2a278e
+size 15440

runs/Nov04_14-05-48_autodl-container-b0b64ab924-20ecb542/events.out.tfevents.1730702206.autodl-container-b0b64ab924-20ecb542.1318.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18773c21c32db24dae76b8a4018c9c1fee3520b17c15d167eb0751495dba28c3
+size 359