eskayML/interview_electra

README.md

@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mrm8488/electra-small-finetuned-squadv2](https://huggingface.co/mrm8488/electra-small-finetuned-squadv2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.6988
-- Accuracy: 0.7407
+- Loss: 1.6205
+- Accuracy: 0.8981
 
 ## Model description
 
@@ -49,26 +49,26 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 54   | 2.2849          | 0.1667   |
-| No log        | 2.0   | 108  | 2.2588          | 0.2407   |
-| No log        | 3.0   | 162  | 2.2142          | 0.3611   |
-| No log        | 4.0   | 216  | 2.1773          | 0.4259   |
-| No log        | 5.0   | 270  | 2.1220          | 0.4352   |
-| No log        | 6.0   | 324  | 2.0728          | 0.4722   |
-| No log        | 7.0   | 378  | 2.0330          | 0.4444   |
-| No log        | 8.0   | 432  | 1.9932          | 0.5926   |
-| No log        | 9.0   | 486  | 1.9483          | 0.5463   |
-| 2.1678        | 10.0  | 540  | 1.9101          | 0.6296   |
-| 2.1678        | 11.0  | 594  | 1.8723          | 0.6204   |
-| 2.1678        | 12.0  | 648  | 1.8451          | 0.6296   |
-| 2.1678        | 13.0  | 702  | 1.8032          | 0.7130   |
-| 2.1678        | 14.0  | 756  | 1.7804          | 0.7037   |
-| 2.1678        | 15.0  | 810  | 1.7568          | 0.7315   |
-| 2.1678        | 16.0  | 864  | 1.7362          | 0.7315   |
-| 2.1678        | 17.0  | 918  | 1.7211          | 0.7315   |
-| 2.1678        | 18.0  | 972  | 1.7084          | 0.7407   |
-| 1.8545        | 19.0  | 1026 | 1.7017          | 0.7407   |
-| 1.8545        | 20.0  | 1080 | 1.6988          | 0.7407   |
+| No log        | 1.0   | 54   | 2.2879          | 0.1481   |
+| No log        | 2.0   | 108  | 2.2626          | 0.2963   |
+| No log        | 3.0   | 162  | 2.2317          | 0.3704   |
+| No log        | 4.0   | 216  | 2.1939          | 0.3704   |
+| No log        | 5.0   | 270  | 2.1577          | 0.3796   |
+| No log        | 6.0   | 324  | 2.0902          | 0.5741   |
+| No log        | 7.0   | 378  | 2.0270          | 0.7407   |
+| No log        | 8.0   | 432  | 1.9740          | 0.7222   |
+| No log        | 9.0   | 486  | 1.9228          | 0.7685   |
+| 2.1738        | 10.0  | 540  | 1.8774          | 0.7778   |
+| 2.1738        | 11.0  | 594  | 1.8201          | 0.8519   |
+| 2.1738        | 12.0  | 648  | 1.7920          | 0.8611   |
+| 2.1738        | 13.0  | 702  | 1.7574          | 0.8333   |
+| 2.1738        | 14.0  | 756  | 1.7125          | 0.8704   |
+| 2.1738        | 15.0  | 810  | 1.6907          | 0.8611   |
+| 2.1738        | 16.0  | 864  | 1.6571          | 0.8981   |
+| 2.1738        | 17.0  | 918  | 1.6424          | 0.8981   |
+| 2.1738        | 18.0  | 972  | 1.6284          | 0.8981   |
+| 1.7996        | 19.0  | 1026 | 1.6225          | 0.8981   |
+| 1.7996        | 20.0  | 1080 | 1.6205          | 0.8981   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5408666c16ac05b429464b194af52d60173908b26990ddbfa36d959c193d5c54
+oid sha256:6955f6b521a9cdc5a5c9c28c4e89deb76d60850c8835d285addadec9097204d0
 size 54229432

runs/Jul06_17-42-04_93aa368a7843/events.out.tfevents.1720287725.93aa368a7843.585.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:857c0acfe36f74b93046046204560dd8f5df665a7638490ec5daef89ca752ef8
+size 13012

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:43206a5d74891ee488728cc391904453f0a6256a7eae70cafa133c796a5cfbd1
+oid sha256:81f54b2cd5340bed4ef76683aa2951f979fc12e7b1fe816fb1479b166b9e15e7
 size 5112