Commit
·
d132d07
1
Parent(s):
9b6e9af
Update README.md
Browse files
README.md
CHANGED
|
@@ -159,14 +159,14 @@ The following table contains test results on the HuggingFace model in comparison
|
|
| 159 |
|
| 160 |
| Task | Metric | Result | | Training time | |
|
| 161 |
| ----- | ---------------------- | ------------------------------------------------------------------------------- | ------------------------------------------------------------------------- | ------------- | -------- |
|
| 162 |
-
| | | Bert | FNet
|
| 163 |
| MNLI | Accuracy | [84.10](https://huggingface.co/gchhablani/bert-base-cased-finetuned-mnli) | [76.75](https://huggingface.co/gchhablani/fnet-base-finetuned-mnli) | 09:52:33 | 06:40:55 |
|
| 164 |
-
| QQP | mean(Accuracy,F1) | [
|
| 165 |
| QNLI | Accuracy | [90.99](https://huggingface.co/gchhablani/bert-base-cased-finetuned-qnli) | [84.39](https://huggingface.co/gchhablani/fnet-base-finetuned-qnli) | 02:40:22 | 01:48:22 |
|
| 166 |
| SST-2 | Accuracy | [92.32](https://huggingface.co/gchhablani/bert-base-cased-finetuned-sst2) | [89.45](https://huggingface.co/gchhablani/fnet-base-finetuned-sst2) | 01:42:17 | 01:09:27 |
|
| 167 |
| CoLA | Matthews corr | [59.57](https://huggingface.co/gchhablani/bert-base-cased-finetuned-cola) | [35.94](https://huggingface.co/gchhablani/fnet-base-finetuned-cola) | 14:20 | 09:47 |
|
| 168 |
| STS-B | Spearman corr. | [89.26/88.98](https://huggingface.co/gchhablani/bert-base-cased-finetuned-stsb) | [82.56/82.19](https://huggingface.co/gchhablani/fnet-base-finetuned-stsb) | 10:24 | 07:09 |
|
| 169 |
-
| MRPC | mean(F1/Accuracy) | [
|
| 170 |
| RTE | Accuracy | [67.15](https://huggingface.co/gchhablani/bert-base-cased-finetuned-qnli) | [62.82](https://huggingface.co/gchhablani/fnet-base-finetuned-qnli) | 04:51 | 03:24 |
|
| 171 |
| WNLI | Accuracy | [46.48](https://huggingface.co/gchhablani/bert-base-cased-finetuned-wnli) | [54.93](https://huggingface.co/gchhablani/fnet-base-finetuned-wnli) | 03:23 | 02:37 |
|
| 172 |
|
|
|
|
| 159 |
|
| 160 |
| Task | Metric | Result | | Training time | |
|
| 161 |
| ----- | ---------------------- | ------------------------------------------------------------------------------- | ------------------------------------------------------------------------- | ------------- | -------- |
|
| 162 |
+
| | | Bert (PyTorch) - Reproduced | FNet (PyTorch) - Reproduced | Bert | FNet |
|
| 163 |
| MNLI | Accuracy | [84.10](https://huggingface.co/gchhablani/bert-base-cased-finetuned-mnli) | [76.75](https://huggingface.co/gchhablani/fnet-base-finetuned-mnli) | 09:52:33 | 06:40:55 |
|
| 164 |
+
| QQP | mean(Accuracy,F1) | [89.26](https://huggingface.co/gchhablani/bert-base-cased-finetuned-qqp) | [86.5](https://huggingface.co/gchhablani/fnet-base-finetuned-qqp) | 09:25:01 | 06:21:16 |
|
| 165 |
| QNLI | Accuracy | [90.99](https://huggingface.co/gchhablani/bert-base-cased-finetuned-qnli) | [84.39](https://huggingface.co/gchhablani/fnet-base-finetuned-qnli) | 02:40:22 | 01:48:22 |
|
| 166 |
| SST-2 | Accuracy | [92.32](https://huggingface.co/gchhablani/bert-base-cased-finetuned-sst2) | [89.45](https://huggingface.co/gchhablani/fnet-base-finetuned-sst2) | 01:42:17 | 01:09:27 |
|
| 167 |
| CoLA | Matthews corr | [59.57](https://huggingface.co/gchhablani/bert-base-cased-finetuned-cola) | [35.94](https://huggingface.co/gchhablani/fnet-base-finetuned-cola) | 14:20 | 09:47 |
|
| 168 |
| STS-B | Spearman corr. | [89.26/88.98](https://huggingface.co/gchhablani/bert-base-cased-finetuned-stsb) | [82.56/82.19](https://huggingface.co/gchhablani/fnet-base-finetuned-stsb) | 10:24 | 07:09 |
|
| 169 |
+
| MRPC | mean(F1/Accuracy) | [88.15](https://huggingface.co/gchhablani/bert-base-cased-finetuned-mrpc) | [81.15](https://huggingface.co/gchhablani/fnet-base-finetuned-mrpc) | 11:12 | 07:48 |
|
| 170 |
| RTE | Accuracy | [67.15](https://huggingface.co/gchhablani/bert-base-cased-finetuned-qnli) | [62.82](https://huggingface.co/gchhablani/fnet-base-finetuned-qnli) | 04:51 | 03:24 |
|
| 171 |
| WNLI | Accuracy | [46.48](https://huggingface.co/gchhablani/bert-base-cased-finetuned-wnli) | [54.93](https://huggingface.co/gchhablani/fnet-base-finetuned-wnli) | 03:23 | 02:37 |
|
| 172 |
|