Hugging Face's logo

amrisaurus
/
pretrained-m-bert

Transformers
TensorFlow
bert
pretraining
generated_from_keras_callback
Model card Files
xet
Community
amrisaurus commited on
Commit
8caf4d9
·
1 Parent(s): b6b7682

Upload TFBertForPreTraining

Browse files
Files changed (2) hide show
  1. README.md +5 -14
  2. tf_model.h5 +1 -1
README.md CHANGED
@@ -13,9 +13,9 @@ probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Train Loss: 6.0589
17
- - Validation Loss: 12.2793
18
- - Epoch: 9
19
 
20
  ## Model description
21
 
@@ -41,21 +41,12 @@ The following hyperparameters were used during training:
41
 
42
  | Train Loss | Validation Loss | Epoch |
43
  |:----------:|:---------------:|:-----:|
44
- | 10.2772 | 11.0091 | 0 |
45
- | 7.9077 | 11.0096 | 1 |
46
- | 6.8422 | 11.0426 | 2 |
47
- | 6.6196 | 11.1006 | 3 |
48
- | 6.4596 | 11.5412 | 4 |
49
- | 6.9657 | 11.7570 | 5 |
50
- | 6.3738 | 11.7909 | 6 |
51
- | 6.1480 | 12.0058 | 7 |
52
- | 6.2503 | 11.9410 | 8 |
53
- | 6.0589 | 12.2793 | 9 |
54
 
55
 
56
  ### Framework versions
57
 
58
  - Transformers 4.27.0.dev0
59
  - TensorFlow 2.9.2
60
- - Datasets 2.8.0
61
  - Tokenizers 0.13.2
 
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Train Loss: 10.2757
17
+ - Validation Loss: 10.9468
18
+ - Epoch: 0
19
 
20
  ## Model description
21
 
 
41
 
42
  | Train Loss | Validation Loss | Epoch |
43
  |:----------:|:---------------:|:-----:|
44
+ | 10.2757 | 10.9468 | 0 |
 
 
 
 
 
 
 
 
 
45
 
46
 
47
  ### Framework versions
48
 
49
  - Transformers 4.27.0.dev0
50
  - TensorFlow 2.9.2
51
+ - Datasets 2.9.0
52
  - Tokenizers 0.13.2
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee16c899da3b4047597557aae1b300660d935ffb668141fa31c010622e24a158
3
  size 1083389236
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c5f71aa90f4fc1ac05c6c4d1ee351d081e5b1aed65f3984f36579c7abd52d1b
3
  size 1083389236