Hugging Face's logo

helling100
/
Regression_bert_1

Text Classification
Transformers
TensorFlow
distilbert
generated_from_keras_callback
Model card Files
xet
 Community
helling100 commited on
Commit
40ea54f
·
1 Parent(s): d9dbb04

Upload TFBertForSequenceClassification

Browse files
Files changed (3) hide show
  1. README.md +20 -20
  2. config.json +20 -2
  3. tf_model.h5 +2 -2
README.md CHANGED
@@ -14,16 +14,16 @@ probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Train Loss: 0.4893
18
- - Train Mae: 0.3046
19
- - Train Mse: 0.1329
20
- - Train R2-score: 0.7411
21
- - Train Accuracy: 0.5615
22
- - Validation Loss: 0.3333
23
- - Validation Mae: 0.3317
24
- - Validation Mse: 0.1327
25
- - Validation R2-score: 0.8816
26
- - Validation Accuracy: 0.2703
27
  - Epoch: 9
28
 
29
  ## Model description
@@ -50,16 +50,16 @@ The following hyperparameters were used during training:
50
 
51
  | Train Loss | Train Mae | Train Mse | Train R2-score | Train Accuracy | Validation Loss | Validation Mae | Validation Mse | Validation R2-score | Validation Accuracy | Epoch |
52
  |:----------:|:---------:|:---------:|:--------------:|:--------------:|:---------------:|:--------------:|:--------------:|:-------------------:|:-------------------:|:-----:|
53
- | 0.4663 | 0.3382 | 0.1856 | 0.6803 | 0.5231 | 0.3295 | 0.3278 | 0.1280 | 0.8831 | 0.2703 | 0 |
54
- | 0.4395 | 0.3199 | 0.1515 | 0.7074 | 0.5462 | 0.3503 | 0.3489 | 0.1568 | 0.8714 | 0.2703 | 1 |
55
- | 0.5018 | 0.3120 | 0.1403 | 0.6400 | 0.5462 | 0.2535 | 0.2512 | 0.0837 | 0.8559 | 0.6757 | 2 |
56
- | 0.5881 | 0.3602 | 0.1923 | 0.3795 | 0.4538 | 0.4672 | 0.4662 | 0.2662 | 0.8014 | 0.2703 | 3 |
57
- | 0.4176 | 0.3324 | 0.1672 | 0.7333 | 0.5154 | 0.3716 | 0.3703 | 0.1859 | 0.8555 | 0.2703 | 4 |
58
- | 0.4885 | 0.3136 | 0.1458 | 0.6244 | 0.6231 | 0.5000 | 0.4991 | 0.2992 | 0.7767 | 0.2703 | 5 |
59
- | 0.4312 | 0.2927 | 0.1279 | 0.5553 | 0.5846 | 0.3057 | 0.3039 | 0.1040 | 0.8864 | 0.2703 | 6 |
60
- | 0.5013 | 0.3242 | 0.1486 | 0.6517 | 0.5 | 0.4892 | 0.4882 | 0.2879 | 0.7852 | 0.2703 | 7 |
61
- | 0.4581 | 0.3535 | 0.1797 | 0.5703 | 0.4846 | 0.3611 | 0.3597 | 0.1744 | 0.8621 | 0.2703 | 8 |
62
- | 0.4893 | 0.3046 | 0.1329 | 0.7411 | 0.5615 | 0.3333 | 0.3317 | 0.1327 | 0.8816 | 0.2703 | 9 |
63
 
64
 
65
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 0.5177
18
+ - Train Mae: 0.3287
19
+ - Train Mse: 0.1635
20
+ - Train R2-score: -3.2462
21
+ - Train Accuracy: 0.5354
22
+ - Validation Loss: 0.1634
23
+ - Validation Mae: 0.3519
24
+ - Validation Mse: 0.1614
25
+ - Validation R2-score: -0.4800
26
+ - Validation Accuracy: 0.4459
27
  - Epoch: 9
28
 
29
  ## Model description
 
50
 
51
  | Train Loss | Train Mae | Train Mse | Train R2-score | Train Accuracy | Validation Loss | Validation Mae | Validation Mse | Validation R2-score | Validation Accuracy | Epoch |
52
  |:----------:|:---------:|:---------:|:--------------:|:--------------:|:---------------:|:--------------:|:--------------:|:-------------------:|:-------------------:|:-----:|
53
+ | 0.5954 | 0.3730 | 0.2146 | -3.4803 | 0.4931 | 0.2190 | 0.4056 | 0.2174 | -0.8845 | 0.3622 | 0 |
54
+ | 0.8021 | 0.3763 | 0.2082 | -2.7115 | 0.4777 | 0.1827 | 0.3730 | 0.1810 | -0.5508 | 0.3838 | 1 |
55
+ | 0.6147 | 0.3404 | 0.1752 | -2.1219 | 0.5223 | 0.2622 | 0.4567 | 0.2613 | -0.9969 | 0.2811 | 2 |
56
+ | 0.6303 | 0.3447 | 0.1768 | -2.9520 | 0.5154 | 0.2331 | 0.4248 | 0.2321 | -0.7839 | 0.2811 | 3 |
57
+ | 0.3887 | 0.3369 | 0.1734 | -2.7189 | 0.5262 | 0.2114 | 0.4056 | 0.2101 | -0.6812 | 0.2865 | 4 |
58
+ | 0.3735 | 0.3176 | 0.1515 | -5.1147 | 0.5292 | 0.1646 | 0.3546 | 0.1630 | -0.3295 | 0.2703 | 5 |
59
+ | 0.4549 | 0.3358 | 0.1716 | -1.5835 | 0.5323 | 0.1803 | 0.3670 | 0.1786 | -0.5113 | 0.3108 | 6 |
60
+ | 0.5800 | 0.3221 | 0.1587 | -2.4273 | 0.5385 | 0.2369 | 0.4334 | 0.2358 | -0.8347 | 0.2919 | 7 |
61
+ | 0.4042 | 0.3339 | 0.1714 | -3.7265 | 0.5300 | 0.1818 | 0.3766 | 0.1804 | -0.4590 | 0.2703 | 8 |
62
+ | 0.5177 | 0.3287 | 0.1635 | -3.2462 | 0.5354 | 0.1634 | 0.3519 | 0.1614 | -0.4800 | 0.4459 | 9 |
63
 
64
 
65
  ### Framework versions
config.json CHANGED
@@ -10,12 +10,30 @@
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
- "0": "LABEL_0"
 
 
 
 
 
 
 
 
 
14
  },
15
  "initializer_range": 0.02,
16
  "intermediate_size": 3072,
17
  "label2id": {
18
- "LABEL_0": 0
 
 
 
 
 
 
 
 
 
19
  },
20
  "layer_norm_eps": 1e-12,
21
  "max_position_embeddings": 512,
 
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
+ "0": "LABEL_0",
14
+ "1": "LABEL_1",
15
+ "2": "LABEL_2",
16
+ "3": "LABEL_3",
17
+ "4": "LABEL_4",
18
+ "5": "LABEL_5",
19
+ "6": "LABEL_6",
20
+ "7": "LABEL_7",
21
+ "8": "LABEL_8",
22
+ "9": "LABEL_9"
23
  },
24
  "initializer_range": 0.02,
25
  "intermediate_size": 3072,
26
  "label2id": {
27
+ "LABEL_0": 0,
28
+ "LABEL_1": 1,
29
+ "LABEL_2": 2,
30
+ "LABEL_3": 3,
31
+ "LABEL_4": 4,
32
+ "LABEL_5": 5,
33
+ "LABEL_6": 6,
34
+ "LABEL_7": 7,
35
+ "LABEL_8": 8,
36
+ "LABEL_9": 9
37
  },
38
  "layer_norm_eps": 1e-12,
39
  "max_position_embeddings": 512,
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:19949039e0755ae907f37444bf432613e5c98d8bcdd51cc314a5ce1555bfd9ad
3
- size 433532180
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e22a4ec42198041fd75037b5d17133f4323ecdc6e32db4ea73cb46e0a0da8de7
3
+ size 433559864