Hugging Face's logo

tKah
/
DistilBERT-TxtClassification

Text Classification
Transformers
TensorFlow
distilbert
generated_from_keras_callback
text-embeddings-inference
Model card Files
xet
Community
1
tKah commited on
Commit
c02e8cb
·
1 Parent(s): 6226f4b

Upload TFDistilBertForSequenceClassification

Browse files
Files changed (3) hide show
  1. README.md +10 -9
  2. config.json +1 -1
  3. tf_model.h5 +1 -1
README.md CHANGED
@@ -12,10 +12,11 @@ probably proofread and complete it, then remove this comment. -->
12
 
13
  # DistilBERT-TxtClassification
14
 
15
- This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an CoLA dataset.
16
  It achieves the following results on the evaluation set:
17
- - Train Loss: 0.1911
18
- - Validation Loss: 0.5444
 
19
  - Epoch: 2
20
 
21
  ## Model description
@@ -40,16 +41,16 @@ The following hyperparameters were used during training:
40
 
41
  ### Training results
42
 
43
- | Train Loss | Validation Loss | Epoch |
44
- |:----------:|:---------------:|:-----:|
45
- | 0.5225 | 0.5430 | 0 |
46
- | 0.3219 | 0.4792 | 1 |
47
- | 0.1911 | 0.5444 | 2 |
48
 
49
 
50
  ### Framework versions
51
 
52
- - Transformers 4.28.1
53
  - TensorFlow 2.12.0
54
  - Datasets 2.12.0
55
  - Tokenizers 0.13.3
 
12
 
13
  # DistilBERT-TxtClassification
14
 
15
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 0.1885
18
+ - Validation Loss: 0.5463
19
+ - Train Matthews Correlation: 0.5220
20
  - Epoch: 2
21
 
22
  ## Model description
 
41
 
42
  ### Training results
43
 
44
+ | Train Loss | Validation Loss | Train Matthews Correlation | Epoch |
45
+ |:----------:|:---------------:|:--------------------------:|:-----:|
46
+ | 0.5236 | 0.4886 | 0.3976 | 0 |
47
+ | 0.3248 | 0.4883 | 0.5074 | 1 |
48
+ | 0.1885 | 0.5463 | 0.5220 | 2 |
49
 
50
 
51
  ### Framework versions
52
 
53
+ - Transformers 4.29.2
54
  - TensorFlow 2.12.0
55
  - Datasets 2.12.0
56
  - Tokenizers 0.13.3
config.json CHANGED
@@ -26,6 +26,6 @@
26
  "seq_classif_dropout": 0.2,
27
  "sinusoidal_pos_embds": false,
28
  "tie_weights_": true,
29
- "transformers_version": "4.28.1",
30
  "vocab_size": 30522
31
  }
 
26
  "seq_classif_dropout": 0.2,
27
  "sinusoidal_pos_embds": false,
28
  "tie_weights_": true,
29
+ "transformers_version": "4.29.2",
30
  "vocab_size": 30522
31
  }
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:792c54b31717c6947543ebfdca69a3ae0f06e5c03695943761d2c33bdfc27aa7
3
  size 267951808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:450de2ddb722413e717f6efaa25a840e6ca18cbc1f1a27f6938cbc50576ed85f
3
  size 267951808