ymlee commited on
Commit
15154cd
·
verified ·
1 Parent(s): 80fe07f

End of training

Browse files
README.md CHANGED
@@ -1,64 +1,64 @@
1
- ---
2
- license: apache-2.0
3
- base_model: bert-base-cased
4
- tags:
5
- - generated_from_trainer
6
- metrics:
7
- - accuracy
8
- - f1
9
- model-index:
10
- - name: finetuned-bert-mrpc
11
- results: []
12
- ---
13
-
14
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
- should probably proofread and complete it, then remove this comment. -->
16
-
17
- # finetuned-bert-mrpc
18
-
19
- This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
20
- It achieves the following results on the evaluation set:
21
- - Loss: 0.4707
22
- - Accuracy: 0.8505
23
- - F1: 0.8961
24
-
25
- ## Model description
26
-
27
- More information needed
28
-
29
- ## Intended uses & limitations
30
-
31
- More information needed
32
-
33
- ## Training and evaluation data
34
-
35
- More information needed
36
-
37
- ## Training procedure
38
-
39
- ### Training hyperparameters
40
-
41
- The following hyperparameters were used during training:
42
- - learning_rate: 2e-05
43
- - train_batch_size: 16
44
- - eval_batch_size: 16
45
- - seed: 42
46
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
- - lr_scheduler_type: linear
48
- - num_epochs: 3.0
49
-
50
- ### Training results
51
-
52
- | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
53
- |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
54
- | 0.5734 | 1.0 | 230 | 0.4219 | 0.8260 | 0.8757 |
55
- | 0.3508 | 2.0 | 460 | 0.3693 | 0.8382 | 0.8870 |
56
- | 0.1863 | 3.0 | 690 | 0.4707 | 0.8505 | 0.8961 |
57
-
58
-
59
- ### Framework versions
60
-
61
- - Transformers 4.40.2
62
- - Pytorch 2.1.2
63
- - Datasets 2.19.1
64
- - Tokenizers 0.19.1
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: bert-base-cased
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - accuracy
8
+ - f1
9
+ model-index:
10
+ - name: finetuned-bert-mrpc
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # finetuned-bert-mrpc
18
+
19
+ This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.5326
22
+ - Accuracy: 0.8529
23
+ - F1: 0.8997
24
+
25
+ ## Model description
26
+
27
+ More information needed
28
+
29
+ ## Intended uses & limitations
30
+
31
+ More information needed
32
+
33
+ ## Training and evaluation data
34
+
35
+ More information needed
36
+
37
+ ## Training procedure
38
+
39
+ ### Training hyperparameters
40
+
41
+ The following hyperparameters were used during training:
42
+ - learning_rate: 2e-05
43
+ - train_batch_size: 16
44
+ - eval_batch_size: 16
45
+ - seed: 42
46
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
+ - lr_scheduler_type: linear
48
+ - num_epochs: 3.0
49
+
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
53
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
54
+ | 0.5726 | 1.0 | 230 | 0.4435 | 0.8039 | 0.8667 |
55
+ | 0.3639 | 2.0 | 460 | 0.4053 | 0.8456 | 0.8919 |
56
+ | 0.2098 | 3.0 | 690 | 0.5326 | 0.8529 | 0.8997 |
57
+
58
+
59
+ ### Framework versions
60
+
61
+ - Transformers 4.40.2
62
+ - Pytorch 2.1.1
63
+ - Datasets 2.19.1
64
+ - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8d9141208e8a02c8ae0ea2fe3685e2a37312c3f80aa271cc7e158085fbec61ef
3
  size 433270768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86ee52d5b39417b757a286d7ec12408a58f86e992e8a9ba45bb56a7c400db969
3
  size 433270768
runs/May31_23-50-15_DESKTOP-E3PR3AO/events.out.tfevents.1717167020.DESKTOP-E3PR3AO.26876.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6b7a7eebf0cfabf2a0e4bb23ad7a0db0e8cc865fe2b2b3c649a74471d5816bc
3
- size 5875
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afe2cbfb38c938c1e822052d9411291f2564d0e6ca20ef2befe360501f9c7d22
3
+ size 6809