Hugging Face's logo

hung200504
/
bert-31

Question Answering
Transformers
PyTorch
bert
Generated from Trainer
Model card Files
xet
Community
1
hung200504 commited on
Commit
ec51588
路
1 Parent(s): ab3f64b

bert-cased

Browse files
Files changed (3) hide show
  1. README.md +47 -47
  2. pytorch_model.bin +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [hung200504/bert-21](https://huggingface.co/hung200504/bert-21) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 11.6244
19
 
20
  ## Model description
21
 
@@ -35,60 +35,60 @@ More information needed
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 3e-07
38
- - train_batch_size: 8
39
- - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 2
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 10.4595 | 0.05 | 5 | 11.9220 |
50
- | 10.4917 | 0.09 | 10 | 11.9078 |
51
- | 10.7603 | 0.14 | 15 | 11.8942 |
52
- | 11.3788 | 0.18 | 20 | 11.8816 |
53
- | 11.2043 | 0.23 | 25 | 11.8684 |
54
- | 10.4152 | 0.28 | 30 | 11.8558 |
55
- | 10.6386 | 0.32 | 35 | 11.8436 |
56
- | 10.7594 | 0.37 | 40 | 11.8319 |
57
- | 10.9593 | 0.41 | 45 | 11.8201 |
58
- | 10.3177 | 0.46 | 50 | 11.8090 |
59
- | 11.2145 | 0.5 | 55 | 11.7982 |
60
- | 10.4266 | 0.55 | 60 | 11.7877 |
61
- | 9.9668 | 0.6 | 65 | 11.7774 |
62
- | 9.8843 | 0.64 | 70 | 11.7681 |
63
- | 10.6546 | 0.69 | 75 | 11.7585 |
64
- | 10.9206 | 0.73 | 80 | 11.7497 |
65
- | 10.5989 | 0.78 | 85 | 11.7411 |
66
- | 10.1503 | 0.83 | 90 | 11.7322 |
67
- | 10.241 | 0.87 | 95 | 11.7242 |
68
- | 10.3243 | 0.92 | 100 | 11.7163 |
69
- | 10.0939 | 0.96 | 105 | 11.7089 |
70
- | 10.2936 | 1.01 | 110 | 11.7015 |
71
- | 9.8946 | 1.06 | 115 | 11.6947 |
72
- | 10.806 | 1.1 | 120 | 11.6880 |
73
- | 10.3278 | 1.15 | 125 | 11.6818 |
74
- | 9.9841 | 1.19 | 130 | 11.6760 |
75
- | 10.375 | 1.24 | 135 | 11.6701 |
76
- | 10.7491 | 1.28 | 140 | 11.6654 |
77
- | 10.0501 | 1.33 | 145 | 11.6600 |
78
- | 10.4491 | 1.38 | 150 | 11.6553 |
79
- | 9.9726 | 1.42 | 155 | 11.6511 |
80
- | 10.2234 | 1.47 | 160 | 11.6471 |
81
- | 10.2598 | 1.51 | 165 | 11.6434 |
82
- | 9.9445 | 1.56 | 170 | 11.6407 |
83
- | 9.9564 | 1.61 | 175 | 11.6372 |
84
- | 10.7074 | 1.65 | 180 | 11.6345 |
85
- | 10.7075 | 1.7 | 185 | 11.6321 |
86
- | 10.3899 | 1.74 | 190 | 11.6301 |
87
- | 10.5313 | 1.79 | 195 | 11.6285 |
88
- | 10.8444 | 1.83 | 200 | 11.6271 |
89
- | 10.8303 | 1.88 | 205 | 11.6257 |
90
- | 10.7634 | 1.93 | 210 | 11.6249 |
91
- | 10.237 | 1.97 | 215 | 11.6244 |
92
 
93
 
94
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [hung200504/bert-21](https://huggingface.co/hung200504/bert-21) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 11.6562
19
 
20
  ## Model description
21
 
 
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 3e-07
38
+ - train_batch_size: 4
39
+ - eval_batch_size: 4
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 1
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 9.9408 | 0.02 | 5 | 11.9244 |
50
+ | 10.9745 | 0.05 | 10 | 11.9123 |
51
+ | 11.7105 | 0.07 | 15 | 11.8995 |
52
+ | 10.574 | 0.09 | 20 | 11.8876 |
53
+ | 11.2567 | 0.11 | 25 | 11.8761 |
54
+ | 10.1985 | 0.14 | 30 | 11.8651 |
55
+ | 11.1306 | 0.16 | 35 | 11.8543 |
56
+ | 11.0848 | 0.18 | 40 | 11.8435 |
57
+ | 10.9051 | 0.21 | 45 | 11.8331 |
58
+ | 11.2139 | 0.23 | 50 | 11.8228 |
59
+ | 9.4434 | 0.25 | 55 | 11.8132 |
60
+ | 10.6242 | 0.28 | 60 | 11.8038 |
61
+ | 10.2756 | 0.3 | 65 | 11.7948 |
62
+ | 11.1823 | 0.32 | 70 | 11.7861 |
63
+ | 11.3154 | 0.34 | 75 | 11.7776 |
64
+ | 10.4026 | 0.37 | 80 | 11.7694 |
65
+ | 11.4274 | 0.39 | 85 | 11.7615 |
66
+ | 10.1923 | 0.41 | 90 | 11.7535 |
67
+ | 10.8907 | 0.44 | 95 | 11.7463 |
68
+ | 10.5215 | 0.46 | 100 | 11.7395 |
69
+ | 11.2088 | 0.48 | 105 | 11.7323 |
70
+ | 10.3167 | 0.5 | 110 | 11.7258 |
71
+ | 10.6535 | 0.53 | 115 | 11.7197 |
72
+ | 10.8819 | 0.55 | 120 | 11.7137 |
73
+ | 10.0389 | 0.57 | 125 | 11.7080 |
74
+ | 10.0161 | 0.6 | 130 | 11.7025 |
75
+ | 10.4476 | 0.62 | 135 | 11.6975 |
76
+ | 10.3089 | 0.64 | 140 | 11.6930 |
77
+ | 10.6388 | 0.67 | 145 | 11.6885 |
78
+ | 11.1704 | 0.69 | 150 | 11.6842 |
79
+ | 10.6095 | 0.71 | 155 | 11.6804 |
80
+ | 10.8112 | 0.73 | 160 | 11.6766 |
81
+ | 10.0912 | 0.76 | 165 | 11.6734 |
82
+ | 10.8292 | 0.78 | 170 | 11.6704 |
83
+ | 10.3543 | 0.8 | 175 | 11.6676 |
84
+ | 9.7421 | 0.83 | 180 | 11.6649 |
85
+ | 11.3465 | 0.85 | 185 | 11.6626 |
86
+ | 9.4446 | 0.87 | 190 | 11.6609 |
87
+ | 10.4486 | 0.89 | 195 | 11.6593 |
88
+ | 10.2593 | 0.92 | 200 | 11.6579 |
89
+ | 10.379 | 0.94 | 205 | 11.6571 |
90
+ | 9.7728 | 0.96 | 210 | 11.6567 |
91
+ | 9.7654 | 0.99 | 215 | 11.6562 |
92
 
93
 
94
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bc4b819c8118003d79c5a4cb1b003ab4e88942c03748c0d70d3fdf525fe1a210
3
  size 430953062
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebbb68b88b8ab428f75c82ef3ec0e86a2f1773f1c6c91c79be4efe5b1083273f
3
  size 430953062
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4cd01788aa90ffc91925a66d54b57acec31dd28521190aeaaf5f69e33c6d9a33
3
  size 4472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00da6c47f2c88e65093029c1d97ed5c3d3676aa2f00f2c2e6e6cfa916f4058e7
3
  size 4472