ashuc27/DistiliBert_tweetEval

README.md

@@ -3,26 +3,11 @@ license: apache-2.0
 base_model: distilbert-base-uncased
 tags:
 - generated_from_trainer
-datasets:
-- emotion
 metrics:
 - accuracy
 model-index:
 - name: results
-  results:
-  - task:
-      name: Text Classification
-      type: text-classification
-    dataset:
-      name: emotion
-      type: emotion
-      config: split
-      split: validation
-      args: split
-    metrics:
-    - name: Accuracy
-      type: accuracy
-      value: 0.9225
+  results: []
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -30,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 # results
 
-This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the emotion dataset.
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1764
-- Accuracy: 0.9225
+- Loss: 1.4324
+- Accuracy: 0.6735
 
 ## Model description
 
@@ -52,9 +37,9 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-05
-- train_batch_size: 16
-- eval_batch_size: 16
+- learning_rate: 2.8e-05
+- train_batch_size: 4
+- eval_batch_size: 64
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -64,9 +49,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| 0.2274        | 1.0   | 1000 | 0.1880          | 0.927    |
-| 0.123         | 2.0   | 2000 | 0.1549          | 0.934    |
-| 0.0878        | 3.0   | 3000 | 0.1683          | 0.941    |
+| 0.7114        | 1.0   | 716  | 0.6388          | 0.6283   |
+| 0.556         | 2.0   | 1432 | 0.7971          | 0.6890   |
+| 0.3142        | 3.0   | 2148 | 1.4232          | 0.6775   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d317e96afc798d6518d09e0579aa84750eaa167d04435480e056e0dfc000e627
+oid sha256:ecd68f30f498a582b8e800bc016ab1bc93f1232839fd44baac1d0e36a14d1596
 size 267844872

runs/Mar14_21-58-16_f1e69196f830/events.out.tfevents.1710453504.f1e69196f830.1367.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c1541bb0b5fda23e6f6af3b4a4ad323e766496645b2646b83db4430b926b132
+size 7166

runs/Mar14_21-58-16_f1e69196f830/events.out.tfevents.1710453722.f1e69196f830.1367.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef045774bb6885e4c6ea54b8822be48b80ae825bcb6e6a76381576c906e5ecb9
+size 1057

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:227cc9e7ece8302dd56ed2412f6d8a13d33e95c6d8ce91367950b7200d61fe18
+oid sha256:b9ddc761cab49090c0cfb69ea5e413ba8c5856cfcb9935b2221bbf8b511e6837
 size 4856