Martynas Vaidanavičius commited on
Commit
ff17153
·
verified ·
1 Parent(s): 564395a

End of training

Browse files
Files changed (2) hide show
  1. README.md +17 -9
  2. model.safetensors +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google-bert/bert-base-cased](https://huggingface.co/google-bert/bert-base-cased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.7397
21
- - Accuracy: 0.3431
22
 
23
  ## Model description
24
 
@@ -38,21 +38,29 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
- - train_batch_size: 16
42
- - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - num_epochs: 4
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
- | No log | 1.0 | 44 | 1.8679 | 0.2598 |
53
- | No log | 2.0 | 88 | 1.8270 | 0.25 |
54
- | No log | 3.0 | 132 | 1.7757 | 0.3333 |
55
- | No log | 4.0 | 176 | 1.7397 | 0.3431 |
 
 
 
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [google-bert/bert-base-cased](https://huggingface.co/google-bert/bert-base-cased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.4498
21
+ - Accuracy: 0.4657
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
+ - train_batch_size: 32
42
+ - eval_batch_size: 32
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - num_epochs: 12
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
+ | No log | 1.0 | 22 | 1.8823 | 0.25 |
53
+ | No log | 2.0 | 44 | 1.7918 | 0.2892 |
54
+ | No log | 3.0 | 66 | 1.7041 | 0.3578 |
55
+ | No log | 4.0 | 88 | 1.6625 | 0.3480 |
56
+ | No log | 5.0 | 110 | 1.6353 | 0.3971 |
57
+ | No log | 6.0 | 132 | 1.5817 | 0.4118 |
58
+ | No log | 7.0 | 154 | 1.5344 | 0.4069 |
59
+ | No log | 8.0 | 176 | 1.5128 | 0.4804 |
60
+ | No log | 9.0 | 198 | 1.4906 | 0.4559 |
61
+ | No log | 10.0 | 220 | 1.4587 | 0.4755 |
62
+ | No log | 11.0 | 242 | 1.4590 | 0.4951 |
63
+ | No log | 12.0 | 264 | 1.4498 | 0.4657 |
64
 
65
 
66
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e12b1a8bf4cb07d4213cca6d3a05347de75b13a09b347f68464d07daa02ad879
3
  size 433286148
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3047a8f83e3651225db1af61fd7f6497c0aece279697cfc9f7e1e56b6849f520
3
  size 433286148