model_5M_large_ds_masking_0.4_predicted_hparamas

README.md

@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3592
-- Accuracy: 0.8820
+- Loss: 0.2523
+- Accuracy: 0.9142
 
 ## Model description
 
@@ -52,13 +52,43 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss | Accuracy |
 |:-------------:|:------:|:----:|:---------------:|:--------:|
-| No log        | 0      | 0    | 4.5828          | 0.0102   |
-| No log        | 0.0044 | 122  | 0.6880          | 0.7866   |
-| No log        | 0.0087 | 244  | 0.4368          | 0.8569   |
-| No log        | 0.0131 | 366  | 0.4019          | 0.8682   |
-| No log        | 0.0175 | 488  | 0.3571          | 0.8823   |
-| 6.242         | 0.0218 | 610  | 0.3568          | 0.8831   |
-| 6.242         | 0.0262 | 732  | 0.3879          | 0.8729   |
+| No log        | 0      | 0    | 4.4578          | 0.0029   |
+| No log        | 0.0044 | 122  | 1.0031          | 0.6944   |
+| No log        | 0.0087 | 244  | 0.6903          | 0.7791   |
+| No log        | 0.0131 | 366  | 0.5695          | 0.8139   |
+| No log        | 0.0175 | 488  | 0.5445          | 0.8215   |
+| 8.1688        | 0.0218 | 610  | 0.5206          | 0.8292   |
+| 8.1688        | 0.0262 | 732  | 0.4568          | 0.8489   |
+| 8.1688        | 0.0306 | 854  | 0.4226          | 0.8600   |
+| 8.1688        | 0.0349 | 976  | 0.3945          | 0.8684   |
+| 4.0756        | 0.0393 | 1098 | 0.3686          | 0.8767   |
+| 4.0756        | 0.0437 | 1220 | 0.3483          | 0.8831   |
+| 4.0756        | 0.0480 | 1342 | 0.3363          | 0.8869   |
+| 4.0756        | 0.0524 | 1464 | 0.3249          | 0.8906   |
+| 2.945         | 0.0568 | 1586 | 0.3184          | 0.8928   |
+| 2.945         | 0.0611 | 1708 | 0.3092          | 0.8954   |
+| 2.945         | 0.0655 | 1830 | 0.3072          | 0.8962   |
+| 2.945         | 0.0699 | 1952 | 0.2999          | 0.8985   |
+| 2.5794        | 0.0743 | 2074 | 0.2950          | 0.9002   |
+| 2.5794        | 0.0786 | 2196 | 0.2924          | 0.9008   |
+| 2.5794        | 0.0830 | 2318 | 0.2876          | 0.9022   |
+| 2.5794        | 0.0874 | 2440 | 0.2836          | 0.9036   |
+| 2.4062        | 0.0917 | 2562 | 0.2790          | 0.9052   |
+| 2.4062        | 0.0961 | 2684 | 0.2764          | 0.9062   |
+| 2.4062        | 0.1005 | 2806 | 0.2759          | 0.9061   |
+| 2.4062        | 0.1048 | 2928 | 0.2735          | 0.9070   |
+| 2.3491        | 0.1092 | 3050 | 0.2710          | 0.9080   |
+| 2.3491        | 0.1136 | 3172 | 0.2669          | 0.9093   |
+| 2.3491        | 0.1179 | 3294 | 0.2656          | 0.9096   |
+| 2.3491        | 0.1223 | 3416 | 0.2644          | 0.9100   |
+| 2.2145        | 0.1267 | 3538 | 0.2615          | 0.9112   |
+| 2.2145        | 0.1310 | 3660 | 0.2603          | 0.9113   |
+| 2.2145        | 0.1354 | 3782 | 0.2563          | 0.9129   |
+| 2.2145        | 0.1398 | 3904 | 0.2553          | 0.9131   |
+| 2.1421        | 0.1441 | 4026 | 0.2527          | 0.9141   |
+| 2.1421        | 0.1485 | 4148 | 0.2503          | 0.9148   |
+| 2.1421        | 0.1529 | 4270 | 0.2516          | 0.9143   |
+| 2.1421        | 0.1572 | 4392 | 0.2515          | 0.9141   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ea1e850c5c7a32e410c0889f182bc7748967c48f7e09c8367cc4176ad7dd679c
+oid sha256:9db8d5b41a2151b5c2bd62514c305b449eb96ed6fed1c33eb38ac5c1fab8a48b
 size 18195880

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b84d5daf60035789cf715d153a5bee4499ce6f2dd288bf595a618494c24931bc
+oid sha256:ebdac9aced14dee41c7a014115093947be8f4cde7c874511e3c7acd2deeb9e4a
 size 5905