Add evaluation results on the ARTeLab--fanpage config and test split of ARTeLab/fanpage

by autoevaluator HF Staff - opened Oct 27, 2022

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

+34

-1

autoevaluator

Oct 27, 2022

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!
Your model has been evaluated on the ARTeLab--fanpage config and test split of the ARTeLab/fanpage dataset by @morenolq , using the predictions stored here.
Accept this pull request to see the results displayed on the Hub leaderboard.
Evaluate your model on more datasets here.

Add evaluation results on the ARTeLab--fanpage config and test split of ARTeLab/fanpage3cf55435

morenolq

Oct 27, 2022

•

edited Oct 27, 2022

Out of curiosity, I evaluated the model using the automatic evaluator. However, the results reported by the evaluator ARE NOT correct! Running the test on my own machine I got similar results wrt. what was reported by the authors:

ROUGE-1: 0.3398450558489963
ROUGE-2: 0.15581617114835214
ROUGE-L: 0.2489955973458257
ROUGE-Lsum: 0.24907289562535354
BERTScore P: 0.7061309858324744
BERTScore R: 0.7007822649193782
BERTScore F1: 0.7030036912945559

Thanks!
Moreno

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Cannot merge

This branch has merge conflicts in the following files:

README.md

· Sign up or log in to comment