tKah commited on
Commit
fb43704
·
1 Parent(s): 8931ecf

Upload TFRobertaForSequenceClassification

Browse files
Files changed (3) hide show
  1. README.md +10 -9
  2. config.json +1 -1
  3. tf_model.h5 +1 -1
README.md CHANGED
@@ -12,10 +12,11 @@ probably proofread and complete it, then remove this comment. -->
12
 
13
  # TextClassification-RoBERTa
14
 
15
- This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on GLUE(CoLA) dataset.
16
  It achieves the following results on the evaluation set:
17
- - Train Loss: 0.1953
18
- - Validation Loss: 0.5320
 
19
  - Epoch: 2
20
 
21
  ## Model description
@@ -40,16 +41,16 @@ The following hyperparameters were used during training:
40
 
41
  ### Training results
42
 
43
- | Train Loss | Validation Loss | Epoch |
44
- |:----------:|:---------------:|:-----:|
45
- | 0.5069 | 0.4623 | 0 |
46
- | 0.3180 | 0.4570 | 1 |
47
- | 0.1953 | 0.5320 | 2 |
48
 
49
 
50
  ### Framework versions
51
 
52
- - Transformers 4.28.1
53
  - TensorFlow 2.12.0
54
  - Datasets 2.12.0
55
  - Tokenizers 0.13.3
 
12
 
13
  # TextClassification-RoBERTa
14
 
15
+ This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 0.1854
18
+ - Validation Loss: 0.5199
19
+ - Train Matthews Correlation: 0.5982
20
  - Epoch: 2
21
 
22
  ## Model description
 
41
 
42
  ### Training results
43
 
44
+ | Train Loss | Validation Loss | Train Matthews Correlation | Epoch |
45
+ |:----------:|:---------------:|:--------------------------:|:-----:|
46
+ | 0.5037 | 0.4198 | 0.5498 | 0 |
47
+ | 0.3035 | 0.4965 | 0.5727 | 1 |
48
+ | 0.1854 | 0.5199 | 0.5982 | 2 |
49
 
50
 
51
  ### Framework versions
52
 
53
+ - Transformers 4.29.2
54
  - TensorFlow 2.12.0
55
  - Datasets 2.12.0
56
  - Tokenizers 0.13.3
config.json CHANGED
@@ -27,7 +27,7 @@
27
  "num_hidden_layers": 12,
28
  "pad_token_id": 1,
29
  "position_embedding_type": "absolute",
30
- "transformers_version": "4.28.1",
31
  "type_vocab_size": 1,
32
  "use_cache": true,
33
  "vocab_size": 50265
 
27
  "num_hidden_layers": 12,
28
  "pad_token_id": 1,
29
  "position_embedding_type": "absolute",
30
+ "transformers_version": "4.29.2",
31
  "type_vocab_size": 1,
32
  "use_cache": true,
33
  "vocab_size": 50265
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5146a2ecabb9ddea7fd8ae6c1ce41cdca274f4df9646da5b70535f69d3c36a7d
3
  size 498878272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ceda952c99d1d01cbf207995a5fd7a0b7b625898862006594588bec515a95941
3
  size 498878272