End of training

README.md

@@ -0,0 +1,57 @@
+---
+license: apache-2.0
+base_model: distilbert-base-uncased
+tags:
+- generated_from_trainer
+model-index:
+- name: squad-distil-bert
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# squad-distil-bert
+
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: nan
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 1e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 2
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss |
+|:-------------:|:-----:|:-----:|:---------------:|
+| 0.0           | 1.0   | 10852 | nan             |
+| 0.0           | 2.0   | 21704 | nan             |
+
+
+### Framework versions
+
+- Transformers 4.37.2
+- Pytorch 2.2.0+cu121
+- Tokenizers 0.15.1

config.json

@@ -18,7 +18,7 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
-  "torch_dtype": "float32",
+  "torch_dtype": "float16",
   "transformers_version": "4.37.2",
   "vocab_size": 30522
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7a1d0e330d263149334dc80e3a61ac995a981d25afd913d45b1aee61e609d403
-size 265470032
+oid sha256:89e2e8bebe98a807d5e54a8987f39c2235f27a82a1334de4f178940fbd0a6760
+size 132741084

runs/Feb04_00-29-29_nikos-IdeaPad-Gaming-3-16ARH7/events.out.tfevents.1706999372.nikos-IdeaPad-Gaming-3-16ARH7.21675.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b033c98c4a028eaa1fc51ac2c3135582744c323790e09c0c7a793286e862809b
-size 13989
+oid sha256:413761d86950891af94500083a4bdf1113bc5cbcb5234cc84f2f93a230c462df
+size 14309

runs/Feb04_10-33-20_nikos-IdeaPad-Gaming-3-16ARH7/events.out.tfevents.1707035602.nikos-IdeaPad-Gaming-3-16ARH7.6915.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a712ec948a330afa3c3961a6d2f37a98056ff56bfdeb597a65f4ccb4ffed49b0
+size 4240

runs/Feb04_10-34-59_nikos-IdeaPad-Gaming-3-16ARH7/events.out.tfevents.1707035701.nikos-IdeaPad-Gaming-3-16ARH7.6986.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5a3df0d1bcf08952cb52834b0b2f16cf517bb629eee1cc69ab9169839b1c4fc
+size 11929

tmp-checkpoint-31000/config.json

@@ -0,0 +1,24 @@
+{
+  "_name_or_path": "distilbert-base-uncased",
+  "activation": "gelu",
+  "architectures": [
+    "DistilBertForQuestionAnswering"
+  ],
+  "attention_dropout": 0.1,
+  "dim": 768,
+  "dropout": 0.1,
+  "hidden_dim": 3072,
+  "initializer_range": 0.02,
+  "max_position_embeddings": 512,
+  "model_type": "distilbert",
+  "n_heads": 12,
+  "n_layers": 6,
+  "pad_token_id": 0,
+  "qa_dropout": 0.1,
+  "seq_classif_dropout": 0.2,
+  "sinusoidal_pos_embds": false,
+  "tie_weights_": true,
+  "torch_dtype": "float32",
+  "transformers_version": "4.37.2",
+  "vocab_size": 30522
+}

tmp-checkpoint-31000/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:39c0fc2ff98853f6d0dcdd0f1fbeaf024d5bdd050c56d1cb76fcf0e2ce87e4ed
+size 265470032

tmp-checkpoint-31000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84f6aeecfc0903b94c3d798cdcbf543cad466e15ad358bf7f2baeb20dea94ca8
+size 51515729

tmp-checkpoint-31000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b31626c6a12bb2d16190e00edd2c45229b666383bf8dedc98021f40fb727580
+size 4792

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6b31626c6a12bb2d16190e00edd2c45229b666383bf8dedc98021f40fb727580
+oid sha256:7940770d5303f66b9d06a710da92855d0e2debe2445f01d0a4f6be93972e4886
 size 4792