Hugging Face's logo

Hartunka
/
tiny_bert_rand_50_v2

Safetensors
distilbert
Generated from Trainer
Eval Results (legacy)
Model card Files
xet
Community
Hartunka commited on
Commit
2164628
·
verified ·
1 Parent(s): 2e9c7e4

Model save

Browse files
Files changed (2) hide show
  1. README.md +9 -21
  2. model.safetensors +1 -1
README.md CHANGED
@@ -1,23 +1,11 @@
1
  ---
2
  tags:
3
  - generated_from_trainer
4
- datasets:
5
- - Hartunka/processed_wikitext-103-raw-v1-rand-50
6
  metrics:
7
  - accuracy
8
  model-index:
9
  - name: tiny_bert_rand_50_v2
10
- results:
11
- - task:
12
- name: Masked Language Modeling
13
- type: fill-mask
14
- dataset:
15
- name: Hartunka/processed_wikitext-103-raw-v1-rand-50
16
- type: Hartunka/processed_wikitext-103-raw-v1-rand-50
17
- metrics:
18
- - name: Accuracy
19
- type: accuracy
20
- value: 0.15211617788325704
21
  ---
22
 
23
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -25,10 +13,10 @@ should probably proofread and complete it, then remove this comment. -->
25
 
26
  # tiny_bert_rand_50_v2
27
 
28
- This model is a fine-tuned version of [](https://huggingface.co/) on the Hartunka/processed_wikitext-103-raw-v1-rand-50 dataset.
29
  It achieves the following results on the evaluation set:
30
- - Loss: 10.2442
31
- - Accuracy: 0.1521
32
 
33
  ## Model description
34
 
@@ -60,11 +48,11 @@ The following hyperparameters were used during training:
60
 
61
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
62
  |:-------------:|:-------:|:-----:|:---------------:|:--------:|
63
- | 9.9984 | 4.1982 | 10000 | 10.2164 | 0.1499 |
64
- | 9.4873 | 8.3963 | 20000 | 10.3714 | 0.1531 |
65
- | 8.8082 | 12.5945 | 30000 | 11.0172 | 0.1531 |
66
- | 7.984 | 16.7926 | 40000 | 11.9222 | 0.1513 |
67
- | 7.3546 | 20.9908 | 50000 | 12.6745 | 0.1518 |
68
 
69
 
70
  ### Framework versions
 
1
  ---
2
  tags:
3
  - generated_from_trainer
 
 
4
  metrics:
5
  - accuracy
6
  model-index:
7
  - name: tiny_bert_rand_50_v2
8
+ results: []
 
 
 
 
 
 
 
 
 
 
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
13
 
14
  # tiny_bert_rand_50_v2
15
 
16
+ This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 12.6425
19
+ - Accuracy: 0.1511
20
 
21
  ## Model description
22
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
  |:-------------:|:-------:|:-----:|:---------------:|:--------:|
51
+ | 9.9992 | 4.1982 | 10000 | 10.2192 | 0.1499 |
52
+ | 9.4707 | 8.3963 | 20000 | 10.4744 | 0.1523 |
53
+ | 8.7418 | 12.5945 | 30000 | 11.1043 | 0.1532 |
54
+ | 7.9122 | 16.7926 | 40000 | 11.8956 | 0.1523 |
55
+ | 7.2963 | 20.9908 | 50000 | 12.6425 | 0.1511 |
56
 
57
 
58
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93b506243e80c6995d15eaa73d0dab1d0c64135dae7e1b9fb83e84998eb83e66
3
  size 133132568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c870db151b3198f4725324a5745c49d61e70c96acb3f0d821b26e58c7e72fac
3
  size 133132568