End of training
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 16 |
|
| 17 |
This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
|
| 18 |
It achieves the following results on the evaluation set:
|
| 19 |
-
- Loss:
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|
|
@@ -41,15 +41,22 @@ The following hyperparameters were used during training:
|
|
| 41 |
- seed: 42
|
| 42 |
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 43 |
- lr_scheduler_type: linear
|
| 44 |
-
- num_epochs:
|
| 45 |
|
| 46 |
### Training results
|
| 47 |
|
| 48 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 49 |
|:-------------:|:-----:|:----:|:---------------:|
|
| 50 |
-
| No log | 1.0 | 140 | 3.
|
| 51 |
-
| No log | 2.0 | 280 | 3.
|
| 52 |
-
| No log | 3.0 | 420 | 3.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
|
| 54 |
|
| 55 |
### Framework versions
|
|
|
|
| 16 |
|
| 17 |
This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
|
| 18 |
It achieves the following results on the evaluation set:
|
| 19 |
+
- Loss: 2.9980
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|
|
|
|
| 41 |
- seed: 42
|
| 42 |
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 43 |
- lr_scheduler_type: linear
|
| 44 |
+
- num_epochs: 10
|
| 45 |
|
| 46 |
### Training results
|
| 47 |
|
| 48 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 49 |
|:-------------:|:-----:|:----:|:---------------:|
|
| 50 |
+
| No log | 1.0 | 140 | 3.2420 |
|
| 51 |
+
| No log | 2.0 | 280 | 3.1426 |
|
| 52 |
+
| No log | 3.0 | 420 | 3.0921 |
|
| 53 |
+
| 3.2444 | 4.0 | 560 | 3.0593 |
|
| 54 |
+
| 3.2444 | 5.0 | 700 | 3.0417 |
|
| 55 |
+
| 3.2444 | 6.0 | 840 | 3.0215 |
|
| 56 |
+
| 3.2444 | 7.0 | 980 | 3.0117 |
|
| 57 |
+
| 2.9628 | 8.0 | 1120 | 3.0048 |
|
| 58 |
+
| 2.9628 | 9.0 | 1260 | 3.0008 |
|
| 59 |
+
| 2.9628 | 10.0 | 1400 | 2.9980 |
|
| 60 |
|
| 61 |
|
| 62 |
### Framework versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 327657928
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:32b3ec8f54edd8e78bb84fa33faf365514d89ae12028972e9e356d0882955bfb
|
| 3 |
size 327657928
|
runs/Dec10_22-17-17_ltrcgpu2/events.out.tfevents.1733849237.ltrcgpu2.3487582.0
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:27babb2a019a9e3ef5cfc82623e7118c6893d9f5217393ad168c6093acf400eb
|
| 3 |
+
size 8886
|
runs/Dec10_22-17-17_ltrcgpu2/events.out.tfevents.1733849465.ltrcgpu2.3487582.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4047a57e595858d07fecc6695d0246d9439728b43ed5b2c6fb6aca7c99eb4aa
|
| 3 |
+
size 359
|