SumedhJoshi/ST_2_trial_task2

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.6944
+- Loss: 0.6705
 
 ## Model description
 
@@ -35,8 +35,8 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
-- train_batch_size: 8
-- eval_batch_size: 8
+- train_batch_size: 16
+- eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -48,6 +48,7 @@ The following hyperparameters were used during training:
 
 ### Framework versions
 
-- Transformers 4.40.0
-- Pytorch 2.2.1+cu121
-- Tokenizers 0.19.1
+- Transformers 4.39.3
+- Pytorch 2.1.2
+- Datasets 2.18.0
+- Tokenizers 0.15.2

config.json

@@ -13,9 +13,7 @@
     "0": "LABEL_0",
     "1": "LABEL_1",
     "2": "LABEL_2",
-    "3": "LABEL_3",
-    "4": "LABEL_4",
-    "5": "LABEL_5"
+    "3": "LABEL_3"
   },
   "initializer_range": 0.02,
   "intermediate_size": 3072,
@@ -23,9 +21,7 @@
     "LABEL_0": 0,
     "LABEL_1": 1,
     "LABEL_2": 2,
-    "LABEL_3": 3,
-    "LABEL_4": 4,
-    "LABEL_5": 5
+    "LABEL_3": 3
   },
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
@@ -36,7 +32,7 @@
   "position_embedding_type": "absolute",
   "problem_type": "single_label_classification",
   "torch_dtype": "float32",
-  "transformers_version": "4.40.0",
+  "transformers_version": "4.39.3",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 30522

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e13182e0b112a05b9d4b0af528ec43801c320bf9410f9a61496bba5edac8b97f
-size 437970952
+oid sha256:5a96de56ed47ae8b84dcf5c1601e045ac21ec0caa78669bd6bddebdeb4d34299
+size 437964800

runs/Apr23_11-06-26_e0ea9f2a0b74/events.out.tfevents.1713870576.e0ea9f2a0b74.34.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17245ef1f6d6295029cc7c668bb7442d0eec686b3ec624334b400e22e395b56d
+size 6167

runs/Apr23_11-06-26_e0ea9f2a0b74/events.out.tfevents.1713871316.e0ea9f2a0b74.34.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c0f30c70a1f8f5001ee61061bb66b8776a7bfc0acafb736968dbc8dcb3a2f6a
+size 359

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a176b6e57cc9c07143c4350327bd67e6c1566e3b47eb21e5b889ca1fa80fd827
-size 4984
+oid sha256:195ce219d76827e22e1113ec62bd8eac81ed7927c31a4bda7d9e76de38671c02
+size 4920