Hugging Face's logo

ahmed792002
/
Finetuning_Longformer_IMDb_movie_reviews_Classification

Text Classification
Transformers
TensorBoard
Safetensors
longformer
Generated from Trainer
Model card Files
xet
 Metrics Community
ahmed792002 commited on
Commit
4c64754
·
verified ·
1 Parent(s): 49ee569

ahmed792002/Finetuning_Longformer_IMDb_movie_reviews_Classification

Browse files
Files changed (4) hide show
  1. README.md +9 -6
  2. model.safetensors +1 -1
  3. runs/Dec06_22-34-42_0cfe01417b33/events.out.tfevents.1733524483.0cfe01417b33.23.0 +3 -0
  4. training_args.bin +1 -1
README.md CHANGED
@@ -19,9 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.4183
23
- - Accuracy: 0.917
24
- - F1: 0.9170
25
 
26
  ## Model description
27
 
@@ -46,14 +46,17 @@ The following hyperparameters were used during training:
46
  - seed: 42
47
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
- - num_epochs: 2
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|
55
- | 0.3747 | 1.0 | 9000 | 0.4516 | 0.9038 | 0.9036 |
56
- | 0.2755 | 2.0 | 18000 | 0.4183 | 0.917 | 0.9170 |
 
 
 
57
 
58
 
59
  ### Framework versions
 
19
 
20
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.5280
23
+ - Accuracy: 0.9203
24
+ - F1: 0.9202
25
 
26
  ## Model description
27
 
 
46
  - seed: 42
47
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
+ - num_epochs: 5
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|
55
+ | 0.393 | 1.0 | 9000 | 0.3941 | 0.9103 | 0.9102 |
56
+ | 0.2937 | 2.0 | 18000 | 0.3846 | 0.9163 | 0.9162 |
57
+ | 0.1886 | 3.0 | 27000 | 0.4201 | 0.9247 | 0.9248 |
58
+ | 0.1554 | 4.0 | 36000 | 0.4752 | 0.9175 | 0.9175 |
59
+ | 0.0916 | 5.0 | 45000 | 0.5280 | 0.9203 | 0.9202 |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72f415c07e7c878c94d375bcc5334ba16e2a6d0de077412e7c91707839d80088
3
  size 594678184
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68a2c10e25c09287c6c963a3e7d1ed034a76f33d5f9a508a9825caae99ebd1a4
3
  size 594678184
runs/Dec06_22-34-42_0cfe01417b33/events.out.tfevents.1733524483.0cfe01417b33.23.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:262a0fb4b0e9bdfa4c3bee90402aaf6ff0167fcb79470d7cfb600396358086f7
3
+ size 26796
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d27a20a8baafa9240b22ca438ddd1ad658d00debca32839bbf3bf72cdf2e023b
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92e3a5c35ddf4603b5a569b9cf6738e1fc8cde2b37d03cf3945bb79a861647a1
3
  size 5368