hamzasidat commited on
Commit
648f95e
·
verified ·
1 Parent(s): 96f37ff

hamzasidat/Hamzas_Distilbert_Irony

Browse files
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.5985
21
- - Accuracy: 0.6806
22
 
23
  ## Model description
24
 
@@ -38,8 +38,8 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
- - train_batch_size: 32
42
- - eval_batch_size: 32
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
@@ -49,9 +49,9 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
- | No log | 1.0 | 90 | 0.6265 | 0.6429 |
53
- | No log | 2.0 | 180 | 0.5992 | 0.6838 |
54
- | No log | 3.0 | 270 | 0.5985 | 0.6806 |
55
 
56
 
57
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.6016
21
+ - Accuracy: 0.6859
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
+ - train_batch_size: 16
42
+ - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
+ | No log | 1.0 | 179 | 0.6267 | 0.6241 |
53
+ | No log | 2.0 | 358 | 0.6016 | 0.6859 |
54
+ | 0.5294 | 3.0 | 537 | 0.6459 | 0.6764 |
55
 
56
 
57
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2f3c09461cc44bcb66d7c69857d2504d7814c072296c5355ad0b6e5b55167533
3
  size 267832560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac3b0525d818e0b876f119f0c38c66a2249a460c17b9147e60563740649e25eb
3
  size 267832560
runs/Mar10_16-49-07_0e4aa7e1afd8/events.out.tfevents.1710089348.0e4aa7e1afd8.6349.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:231570b0716270d4924ef580b09a9bc1697052bcc564ef8935420f457695c90a
3
+ size 6004
runs/Mar10_16-49-07_0e4aa7e1afd8/events.out.tfevents.1710089817.0e4aa7e1afd8.6349.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0952ac739786aca132ba9eb68d55cf0f9d06e87e29b55fa8639c3d65285324d
3
+ size 1057
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:529e091d63f0ab41188cd149c3b955ded649deea9eda392a3711cc3639097c5d
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:347ceb389740900f3242a24b0c987ba1a186c6c633c2fb11ae0972140ae38af4
3
  size 4920