End of training

README.md

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.5621
+- Loss: 6.8803
 
 ## Model description
 
@@ -39,17 +39,22 @@ The following hyperparameters were used during training:
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
-- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 3.0
 
 ### Training results
 
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 7.5607        | 1.0   | 584  | 7.0272          |
+| 6.9412        | 2.0   | 1168 | 6.8951          |
+| 6.8829        | 3.0   | 1752 | 6.8661          |
 
 
 ### Framework versions
 
-- Transformers 4.46.2
-- Pytorch 2.5.1
+- Transformers 4.44.2
+- Pytorch 2.5.0+cu121
 - Datasets 3.1.0
-- Tokenizers 0.20.3
+- Tokenizers 0.19.1

config.json

@@ -1,7 +1,7 @@
 {
   "_name_or_path": "bert-base-cased",
   "architectures": [
-    "BertLMHeadModel"
+    "BertForMaskedLM"
   ],
   "attention_probs_dropout_prob": 0.1,
   "classifier_dropout": null,
@@ -19,7 +19,7 @@
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
   "torch_dtype": "float32",
-  "transformers_version": "4.46.2",
+  "transformers_version": "4.44.2",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 28996

generation_config.json

@@ -1,5 +1,5 @@
 {
   "_from_model_config": true,
   "pad_token_id": 0,
-  "transformers_version": "4.46.2"
+  "transformers_version": "4.44.2"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2be65c15ae15fa7b2e0eff4119315c81c859b4b29707cc4183c1d96e1e8b392e
+oid sha256:679539594431ee218f471e09e2d85971c4d74012ce5a504a4c2f333e15dff818
 size 433386912

runs/Nov08_07-16-57_ae7ae834c67d/events.out.tfevents.1731050227.ae7ae834c67d.3578.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b3baaf7e104182e349a941f642482d982b7822c37fc67432410b160a8b7f691
+size 6740

runs/Nov08_07-16-57_ae7ae834c67d/events.out.tfevents.1731050641.ae7ae834c67d.3578.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c599dd1e2fbaa1d2ac9f2dd592cac3ebe9df70bf85a042b80841a071451a8ba5
+size 359

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:88d6c7e1bc173f76f823993fc7fc3b2a6ffe4af73f0888fe6f35844a1dc757e3
-size 5240
+oid sha256:3a160eacdbfec3ce50183c89273b093e83fa336984bdfc2de0962a5bd3e3fe45
+size 5304