Hugging Face's logo

NaeemCSECUET18
/
bangla-bert-base-MLTC-1

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Community
NaeemCSECUET18 commited on
Commit
cc789a5
·
verified ·
1 Parent(s): 6b793c3

End of training

Browse files
Files changed (2) hide show
  1. README.md +14 -14
  2. model.safetensors +1 -1
README.md CHANGED
@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [sagorsarker/bangla-bert-base](https://huggingface.co/sagorsarker/bangla-bert-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.3641
22
- - F1: 0.8505
23
- - Roc Auc: 0.8470
24
- - Accuracy: 0.5578
25
- - Hamming Loss: 0.1530
26
- - Jaccard Score: 0.7399
27
- - Zero One Loss: 0.4422
28
 
29
  ## Model description
30
 
@@ -44,8 +44,8 @@ More information needed
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
- - train_batch_size: 16
48
- - eval_batch_size: 16
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
@@ -55,11 +55,11 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | F1 | Roc Auc | Accuracy | Hamming Loss | Jaccard Score | Zero One Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|:--------:|:------------:|:-------------:|:-------------:|
58
- | 0.3991 | 1.0 | 73 | 0.4026 | 0.8245 | 0.8193 | 0.4884 | 0.1806 | 0.7014 | 0.5116 |
59
- | 0.3621 | 2.0 | 146 | 0.3670 | 0.8479 | 0.8464 | 0.5578 | 0.1536 | 0.7359 | 0.4422 |
60
- | 0.2817 | 3.0 | 219 | 0.3620 | 0.8502 | 0.8463 | 0.5604 | 0.1536 | 0.7394 | 0.4396 |
61
- | 0.2081 | 4.0 | 292 | 0.3630 | 0.8532 | 0.8496 | 0.5630 | 0.1504 | 0.7440 | 0.4370 |
62
- | 0.1962 | 5.0 | 365 | 0.3641 | 0.8505 | 0.8470 | 0.5578 | 0.1530 | 0.7399 | 0.4422 |
63
 
64
 
65
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [sagorsarker/bangla-bert-base](https://huggingface.co/sagorsarker/bangla-bert-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.3627
22
+ - F1: 0.8553
23
+ - Roc Auc: 0.8521
24
+ - Accuracy: 0.5707
25
+ - Hamming Loss: 0.1478
26
+ - Jaccard Score: 0.7473
27
+ - Zero One Loss: 0.4293
28
 
29
  ## Model description
30
 
 
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
+ - train_batch_size: 8
48
+ - eval_batch_size: 8
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
 
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | F1 | Roc Auc | Accuracy | Hamming Loss | Jaccard Score | Zero One Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|:--------:|:------------:|:-------------:|:-------------:|
58
+ | 0.3717 | 1.0 | 146 | 0.3740 | 0.8447 | 0.8438 | 0.5398 | 0.1562 | 0.7312 | 0.4602 |
59
+ | 0.3812 | 2.0 | 292 | 0.3627 | 0.8373 | 0.8420 | 0.5476 | 0.1581 | 0.7201 | 0.4524 |
60
+ | 0.2373 | 3.0 | 438 | 0.3830 | 0.8450 | 0.8386 | 0.5476 | 0.1613 | 0.7316 | 0.4524 |
61
+ | 0.1688 | 4.0 | 584 | 0.3610 | 0.8555 | 0.8534 | 0.5758 | 0.1465 | 0.7475 | 0.4242 |
62
+ | 0.153 | 5.0 | 730 | 0.3627 | 0.8553 | 0.8521 | 0.5707 | 0.1478 | 0.7473 | 0.4293 |
63
 
64
 
65
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:39590c08dec15e1998d1e689e4d5d450c4241a3f6900d1a2dd6fc0457826d695
3
  size 657622024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9abf0c5360cdb1b26f03cf5bbe673ac8b218c158efe9e339258dbe3687c18d37
3
  size 657622024