Update README.md
Browse files
README.md
CHANGED
|
@@ -67,7 +67,7 @@ Rather than using the whole test set at once for evaluation, we split it into 3
|
|
| 67 |
Each model is evaluated on all 3 samples, and we report the mean scores and 95% confidence interval for all scores.
|
| 68 |
Additionally, we report the average predicted quote length, the number of epochs, and the total training time.
|
| 69 |
|
| 70 |
-
|
|
| 71 |
| -------------- | --------------- | --------------- | --------------- | --------------- | ---------------- | ------ | ------- |
|
| 72 |
| T5-base | 0.3758 ± 0.0175 | 0.2990 ± 0.0128 | 0.3628 ± 0.0189 | 0.3684 ± 0.0201 | 18.1576 ± 0.1084 | 1.01 | 3:39:14 |
|
| 73 |
| BART-base | 0.4236 ± 0.0133 | 0.3498 ± 0.0116 | 0.4112 ± 0.0135 | 0.4165 ± 0.0107 | 19.1027 ± 0.1755 | 12.10 | 0:44:48 |
|
|
|
|
| 67 |
Each model is evaluated on all 3 samples, and we report the mean scores and 95% confidence interval for all scores.
|
| 68 |
Additionally, we report the average predicted quote length, the number of epochs, and the total training time.
|
| 69 |
|
| 70 |
+
| Checkpoint | ROUGE-1 | ROUGE-2 | ROUGE-L | ROUGE-Lsum | Avg Quote Length | Epochs | Time |
|
| 71 |
| -------------- | --------------- | --------------- | --------------- | --------------- | ---------------- | ------ | ------- |
|
| 72 |
| T5-base | 0.3758 ± 0.0175 | 0.2990 ± 0.0128 | 0.3628 ± 0.0189 | 0.3684 ± 0.0201 | 18.1576 ± 0.1084 | 1.01 | 3:39:14 |
|
| 73 |
| BART-base | 0.4236 ± 0.0133 | 0.3498 ± 0.0116 | 0.4112 ± 0.0135 | 0.4165 ± 0.0107 | 19.1027 ± 0.1755 | 12.10 | 0:44:48 |
|