model_15M_medium_ds_masking_0.5_explicit_hs_predicted_hparamas
Browse files- README.md +22 -28
- model.safetensors +1 -1
- training_args.bin +1 -1
README.md
CHANGED
|
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 16 |
|
| 17 |
This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
|
| 18 |
It achieves the following results on the evaluation set:
|
| 19 |
-
- Loss: 0.
|
| 20 |
-
- Accuracy: 0.
|
| 21 |
|
| 22 |
## Model description
|
| 23 |
|
|
@@ -50,32 +50,26 @@ The following hyperparameters were used during training:
|
|
| 50 |
|
| 51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
| 52 |
|:-------------:|:------:|:-----:|:---------------:|:--------:|
|
| 53 |
-
| No log | 0 | 0 | 4.
|
| 54 |
-
| 0.
|
| 55 |
-
| 0.
|
| 56 |
-
| 0.
|
| 57 |
-
| 0.
|
| 58 |
-
| 0.
|
| 59 |
-
| 0.
|
| 60 |
-
| 0.
|
| 61 |
-
| 0.
|
| 62 |
-
| 0.
|
| 63 |
-
| 0.
|
| 64 |
-
| 0.
|
| 65 |
-
| 0.
|
| 66 |
-
| 0.
|
| 67 |
-
| 0.
|
| 68 |
-
| 0.
|
| 69 |
-
| 0.
|
| 70 |
-
| 0.
|
| 71 |
-
| 0.
|
| 72 |
-
| 0.
|
| 73 |
-
| 0.1013 | 4.3794 | 39060 | 0.0963 | 0.9674 |
|
| 74 |
-
| 0.0994 | 4.5984 | 41013 | 0.0948 | 0.9680 |
|
| 75 |
-
| 0.0975 | 4.8174 | 42966 | 0.0940 | 0.9683 |
|
| 76 |
-
| 0.0972 | 5.0363 | 44919 | 0.0928 | 0.9685 |
|
| 77 |
-
| 0.0964 | 5.2553 | 46872 | 0.0928 | 0.9686 |
|
| 78 |
-
| 0.0964 | 5.4743 | 48825 | 0.0918 | 0.9691 |
|
| 79 |
|
| 80 |
|
| 81 |
### Framework versions
|
|
|
|
| 16 |
|
| 17 |
This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
|
| 18 |
It achieves the following results on the evaluation set:
|
| 19 |
+
- Loss: 0.0525
|
| 20 |
+
- Accuracy: 0.9821
|
| 21 |
|
| 22 |
## Model description
|
| 23 |
|
|
|
|
| 50 |
|
| 51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
| 52 |
|:-------------:|:------:|:-----:|:---------------:|:--------:|
|
| 53 |
+
| No log | 0 | 0 | 4.5649 | 0.0016 |
|
| 54 |
+
| 0.1871 | 0.2190 | 1953 | 0.1446 | 0.9529 |
|
| 55 |
+
| 0.1236 | 0.4379 | 3906 | 0.1085 | 0.9642 |
|
| 56 |
+
| 0.1039 | 0.6569 | 5859 | 0.0930 | 0.9693 |
|
| 57 |
+
| 0.0919 | 0.8759 | 7812 | 0.0838 | 0.9721 |
|
| 58 |
+
| 0.1111 | 1.0949 | 9765 | 0.0806 | 0.9733 |
|
| 59 |
+
| 0.0803 | 1.3138 | 11718 | 0.0749 | 0.9749 |
|
| 60 |
+
| 0.0757 | 1.5328 | 13671 | 0.0719 | 0.9760 |
|
| 61 |
+
| 0.0726 | 1.7518 | 15624 | 0.0689 | 0.9770 |
|
| 62 |
+
| 0.0833 | 1.9707 | 17577 | 0.0701 | 0.9768 |
|
| 63 |
+
| 0.0674 | 2.1897 | 19530 | 0.0639 | 0.9786 |
|
| 64 |
+
| 0.0662 | 2.4087 | 21483 | 0.0616 | 0.9793 |
|
| 65 |
+
| 0.0637 | 2.6276 | 23436 | 0.0596 | 0.9799 |
|
| 66 |
+
| 0.0626 | 2.8466 | 25389 | 0.0576 | 0.9804 |
|
| 67 |
+
| 0.0606 | 3.0656 | 27342 | 0.0564 | 0.9808 |
|
| 68 |
+
| 0.0591 | 3.2846 | 29295 | 0.0561 | 0.9809 |
|
| 69 |
+
| 0.0577 | 3.5035 | 31248 | 0.0541 | 0.9816 |
|
| 70 |
+
| 0.0568 | 3.7225 | 33201 | 0.0531 | 0.9820 |
|
| 71 |
+
| 0.0554 | 3.9415 | 35154 | 0.0531 | 0.9819 |
|
| 72 |
+
| 0.0548 | 4.1604 | 37107 | 0.0522 | 0.9823 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 73 |
|
| 74 |
|
| 75 |
### Framework versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 60925776
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8283e7f9121dc1b54f71ffef5be43957675ef9985af4a0fcd4fce79c166b48f2
|
| 3 |
size 60925776
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5905
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0badb615ce60bba228e5b53db0c9eeea374936c6055321d8f983a5fe70372d9e
|
| 3 |
size 5905
|