Hartunka commited on
Commit
bd043b4
·
verified ·
1 Parent(s): df3a3c7

Model save

Browse files
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Hartunka/tiny_bert_rand_100_v1
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - accuracy
7
+ - f1
8
+ model-index:
9
+ - name: tiny_bert_rand_100_v1_qqp
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # tiny_bert_rand_100_v1_qqp
17
+
18
+ This model is a fine-tuned version of [Hartunka/tiny_bert_rand_100_v1](https://huggingface.co/Hartunka/tiny_bert_rand_100_v1) on an unknown dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.5052
21
+ - Accuracy: 0.8201
22
+ - F1: 0.7678
23
+ - Combined Score: 0.7939
24
+
25
+ ## Model description
26
+
27
+ More information needed
28
+
29
+ ## Intended uses & limitations
30
+
31
+ More information needed
32
+
33
+ ## Training and evaluation data
34
+
35
+ More information needed
36
+
37
+ ## Training procedure
38
+
39
+ ### Training hyperparameters
40
+
41
+ The following hyperparameters were used during training:
42
+ - learning_rate: 5e-05
43
+ - train_batch_size: 256
44
+ - eval_batch_size: 256
45
+ - seed: 10
46
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
+ - lr_scheduler_type: linear
48
+ - num_epochs: 50
49
+
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Combined Score |
53
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:--------------:|
54
+ | 0.496 | 1.0 | 1422 | 0.4492 | 0.7838 | 0.6806 | 0.7322 |
55
+ | 0.4089 | 2.0 | 2844 | 0.4196 | 0.8034 | 0.7191 | 0.7612 |
56
+ | 0.3518 | 3.0 | 4266 | 0.4153 | 0.8110 | 0.7420 | 0.7765 |
57
+ | 0.3062 | 4.0 | 5688 | 0.4296 | 0.8186 | 0.7423 | 0.7805 |
58
+ | 0.2689 | 5.0 | 7110 | 0.4466 | 0.8198 | 0.7533 | 0.7866 |
59
+ | 0.239 | 6.0 | 8532 | 0.4361 | 0.8202 | 0.7623 | 0.7912 |
60
+ | 0.2131 | 7.0 | 9954 | 0.4664 | 0.8231 | 0.7650 | 0.7941 |
61
+ | 0.1896 | 8.0 | 11376 | 0.5052 | 0.8201 | 0.7678 | 0.7939 |
62
+
63
+
64
+ ### Framework versions
65
+
66
+ - Transformers 4.40.0
67
+ - Pytorch 2.6.0+cu124
68
+ - Datasets 3.5.0
69
+ - Tokenizers 0.19.1
logs/events.out.tfevents.1744830759.s_004_m CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c17d310de4293dd28f8c1d4bce0e1dfec2255c395e8bec82c5c9b6188a88f35d
3
- size 8697
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ec8c322f4f3b043534976f657778d56ab2bae4dbd7d1eec3051b509e50ada04
3
+ size 10116
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:95ce47b40633fa4c99277fa5e8172054f8a41b375e2880af7bb9f97a76e68aff
3
  size 131856744
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b11dcb74da9f84cd92ec0324b18c63f36c9e701064cd7fbd31f3b7444de77a5e
3
  size 131856744