Hugging Face's logo

duynhatran
/
deberta_textclassification

Text Classification
Transformers
TensorBoard
Safetensors
deberta
Generated from Trainer
Model card Files
xet
Metrics Community
duynhatran commited on
Commit
bfc7a84
·
verified ·
1 Parent(s): 569f11e

End of training

Browse files
Files changed (2) hide show
  1. README.md +13 -13
  2. model.safetensors +1 -1
README.md CHANGED
@@ -1,11 +1,12 @@
1
  ---
2
  library_name: transformers
3
  license: mit
4
- base_model: microsoft/deberta-v3-base
5
  tags:
6
  - generated_from_trainer
7
  metrics:
8
  - accuracy
 
9
  model-index:
10
  - name: deberta_textclassification
11
  results: []
@@ -16,10 +17,11 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # deberta_textclassification
18
 
19
- This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.3802
22
- - Accuracy: 0.9487
 
23
 
24
  ## Model description
25
 
@@ -38,23 +40,21 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 2e-05
42
  - train_batch_size: 8
43
  - eval_batch_size: 8
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
- - num_epochs: 5
48
 
49
  ### Training results
50
 
51
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
- | 0.2717 | 1.0 | 1330 | 0.2609 | 0.9351 |
54
- | 0.1697 | 2.0 | 2660 | 0.2156 | 0.9452 |
55
- | 0.0895 | 3.0 | 3990 | 0.3175 | 0.9465 |
56
- | 0.0343 | 4.0 | 5320 | 0.3872 | 0.9450 |
57
- | 0.0165 | 5.0 | 6650 | 0.3802 | 0.9487 |
58
 
59
 
60
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
  license: mit
4
+ base_model: microsoft/deberta-base
5
  tags:
6
  - generated_from_trainer
7
  metrics:
8
  - accuracy
9
+ - f1
10
  model-index:
11
  - name: deberta_textclassification
12
  results: []
 
17
 
18
  # deberta_textclassification
19
 
20
+ This model is a fine-tuned version of [microsoft/deberta-base](https://huggingface.co/microsoft/deberta-base) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.2786
23
+ - Accuracy: 0.9467
24
+ - F1: 0.9622
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 1e-05
44
  - train_batch_size: 8
45
  - eval_batch_size: 8
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
+ - num_epochs: 3
50
 
51
  ### Training results
52
 
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
55
+ | 0.2349 | 1.0 | 1520 | 0.2316 | 0.9388 | 0.9565 |
56
+ | 0.1801 | 2.0 | 3040 | 0.2382 | 0.9467 | 0.9621 |
57
+ | 0.0914 | 3.0 | 4560 | 0.2786 | 0.9467 | 0.9622 |
 
 
58
 
59
 
60
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:499416ced77d6cd228fb333360f4f8bfafafda4383aeedcf2a9aaec0d4526357
3
  size 556799560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f37a86b2a85d9678d0f01016a904024b67f0071cd2efe8bfdcff67a797b32358
3
  size 556799560