teacher_electra_small

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [google/electra-small-discriminator](https://huggingface.co/google/electra-small-discriminator) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3884
+- Loss: 0.2845
 
 ## Model description
 
@@ -45,16 +45,10 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step  | Validation Loss |
-|:-------------:|:-----:|:-----:|:---------------:|
-| 0.8696        | 0.35  | 3000  | 0.5508          |
-| 0.5071        | 0.71  | 6000  | 0.4578          |
-| 0.448         | 1.06  | 9000  | 0.4210          |
-| 0.4084        | 1.41  | 12000 | 0.4109          |
-| 0.3878        | 1.77  | 15000 | 0.3913          |
-| 0.3832        | 2.12  | 18000 | 0.3884          |
-| 0.3529        | 2.47  | 21000 | 0.3900          |
-| 0.3492        | 2.83  | 24000 | 0.3884          |
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 0.3877        | 1.99  | 3000 | 0.2785          |
+| 0.2475        | 3.98  | 6000 | 0.2845          |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:83a42e8edd3aec979aa6cbb629e8f7df596eaf1271759543d8f2cf1fd4f82e80
+oid sha256:501e4ab2267ccc2fbc51344b63a2acd256056ef22413617874d1b6d15c49b34b
 size 54267318