Hugging Face's logo

mcanoglu
/
salesforce-codet5p-220m-finetuned-defect-detection

Text Classification
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
Model card Files
xet
 Metrics Community
mcanoglu commited on
Commit
06add4b
·
verified ·
1 Parent(s): e14238e

End of training

Browse files
Files changed (2) hide show
  1. README.md +20 -17
  2. model.safetensors +1 -1
README.md CHANGED
@@ -5,7 +5,6 @@ tags:
5
  - generated_from_trainer
6
  metrics:
7
  - accuracy
8
- - f1
9
  - precision
10
  - recall
11
  model-index:
@@ -20,11 +19,11 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [Salesforce/codet5p-220m](https://huggingface.co/Salesforce/codet5p-220m) on an unknown dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.5107
24
- - Accuracy: 0.7108
25
- - F1: 0.7079
26
- - Precision: 0.6987
27
- - Recall: 0.7174
28
 
29
  ## Model description
30
 
@@ -44,26 +43,30 @@ More information needed
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
- - train_batch_size: 32
48
  - eval_batch_size: 8
49
  - seed: 4711
 
 
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 3
53
  - mixed_precision_training: Native AMP
54
 
55
  ### Training results
56
 
57
- | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
58
- |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
59
- | 0.6934 | 1.0 | 997 | 0.5894 | 0.6632 | 0.5788 | 0.7435 | 0.4738 |
60
- | 0.572 | 2.0 | 1994 | 0.5250 | 0.7063 | 0.7057 | 0.6911 | 0.7210 |
61
- | 0.4947 | 3.0 | 2991 | 0.5107 | 0.7108 | 0.7079 | 0.6987 | 0.7174 |
 
 
62
 
63
 
64
  ### Framework versions
65
 
66
- - Transformers 4.36.2
67
- - Pytorch 2.1.2+cu121
68
- - Datasets 2.16.1
69
- - Tokenizers 0.15.0
 
5
  - generated_from_trainer
6
  metrics:
7
  - accuracy
 
8
  - precision
9
  - recall
10
  model-index:
 
19
 
20
  This model is a fine-tuned version of [Salesforce/codet5p-220m](https://huggingface.co/Salesforce/codet5p-220m) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.5331
23
+ - Accuracy: 0.7289
24
+ - Roc Auc: 0.7292
25
+ - Precision: 0.7152
26
+ - Recall: 0.7395
27
 
28
  ## Model description
29
 
 
43
 
44
  The following hyperparameters were used during training:
45
  - learning_rate: 2e-05
46
+ - train_batch_size: 8
47
  - eval_batch_size: 8
48
  - seed: 4711
49
+ - gradient_accumulation_steps: 4
50
+ - total_train_batch_size: 32
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 5
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | Roc Auc | Precision | Recall |
59
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:-------:|:---------:|:------:|
60
+ | 0.6935 | 1.0 | 996 | 0.5783 | 0.6689 | 0.6657 | 0.7197 | 0.5277 |
61
+ | 0.5694 | 2.0 | 1993 | 0.5279 | 0.7013 | 0.7026 | 0.6723 | 0.7580 |
62
+ | 0.4812 | 3.0 | 2989 | 0.5058 | 0.7181 | 0.7179 | 0.7129 | 0.7081 |
63
+ | 0.4235 | 4.0 | 3986 | 0.5088 | 0.7292 | 0.7291 | 0.7213 | 0.7261 |
64
+ | 0.3658 | 5.0 | 4980 | 0.5331 | 0.7289 | 0.7292 | 0.7152 | 0.7395 |
65
 
66
 
67
  ### Framework versions
68
 
69
+ - Transformers 4.37.2
70
+ - Pytorch 2.2.0+cu121
71
+ - Datasets 2.17.1
72
+ - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1294b47c99dc2cdd6b41216342a51f08d5233abf78a54f58dca5820b8233c596
3
  size 893930696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fb0c73f1c46b8be9be83e17f8e823932ea2e82acf17362f17fda2ea243d24c1
3
  size 893930696