Hugging Face's logo

mamiksik
/
CodeBertaCLM

Text Generation
Transformers
PyTorch
roberta
Generated from Trainer
Model card Files
xet
Community
2
mamiksik commited on
Commit
a2cfd15
·
1 Parent(s): 2470f3e

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -13
README.md CHANGED
@@ -16,10 +16,10 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [microsoft/codebert-base](https://huggingface.co/microsoft/codebert-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 14.6482
20
- - Accuracy: 0.0
21
- - F1: 0.0
22
- - Bleu4: 0.0592
23
 
24
  ## Model description
25
 
@@ -39,8 +39,8 @@ More information needed
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 2e-05
42
- - train_batch_size: 16
43
- - eval_batch_size: 16
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
@@ -48,17 +48,18 @@ The following hyperparameters were used during training:
48
 
49
  ### Training results
50
 
51
- | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Bleu4 |
52
- |:-------------:|:-----:|:----:|:---------------:|:--------:|:---:|:------:|
53
- | No log | 1.0 | 1 | 16.4835 | 0.0 | 0.0 | 0.1118 |
54
- | No log | 2.0 | 2 | 15.8217 | 0.0 | 0.0 | 0.0940 |
55
- | No log | 3.0 | 3 | 15.2096 | 0.0 | 0.0 | 0.0648 |
56
- | No log | 4.0 | 4 | 14.6482 | 0.0 | 0.0 | 0.0592 |
 
57
 
58
 
59
  ### Framework versions
60
 
61
  - Transformers 4.25.1
62
- - Pytorch 1.13.0
63
  - Datasets 2.7.1
64
  - Tokenizers 0.13.2
 
16
 
17
  This model is a fine-tuned version of [microsoft/codebert-base](https://huggingface.co/microsoft/codebert-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0068
20
+ - Accuracy: 0.0126
21
+ - F1: 0.0126
22
+ - Bleu4: 0.0363
23
 
24
  ## Model description
25
 
 
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 2e-05
42
+ - train_batch_size: 32
43
+ - eval_batch_size: 32
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
 
48
 
49
  ### Training results
50
 
51
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Bleu4 |
52
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|
53
+ | 2.6008 | 1.0 | 687 | 0.0221 | 0.0173 | 0.0173 | 0.1220 |
54
+ | 0.0455 | 2.0 | 1374 | 0.0171 | 0.0233 | 0.0233 | 0.1751 |
55
+ | 0.0199 | 3.0 | 2061 | 0.0163 | 0.0154 | 0.0154 | 0.0993 |
56
+ | 0.0119 | 4.0 | 2748 | 0.0068 | 0.0198 | 0.0198 | 0.1486 |
57
+ | 0.0086 | 5.0 | 3435 | 0.0068 | 0.0126 | 0.0126 | 0.0363 |
58
 
59
 
60
  ### Framework versions
61
 
62
  - Transformers 4.25.1
63
+ - Pytorch 1.13.0+cu117
64
  - Datasets 2.7.1
65
  - Tokenizers 0.13.2