Commit ·
bf0cf33
1
Parent(s): 6657e3a
Add evaluation results on the dbert config and validation split of adversarial_qa
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the dbert config and validation split of the [adversarial_qa](https://huggingface.co/datasets/adversarial_qa) dataset by @kritirwa , using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-adversarial_qa-dbert-5b493d-61553145435).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=adversarial_qa).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=adversarial_qa).
README.md
CHANGED
|
@@ -7,7 +7,51 @@ datasets:
|
|
| 7 |
- cnn_dailymail
|
| 8 |
model-index:
|
| 9 |
- name: bart-base-finetuned-summarization-cnn-ver1.1
|
| 10 |
-
results:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
|
| 7 |
- cnn_dailymail
|
| 8 |
model-index:
|
| 9 |
- name: bart-base-finetuned-summarization-cnn-ver1.1
|
| 10 |
+
results:
|
| 11 |
+
- task:
|
| 12 |
+
type: summarization
|
| 13 |
+
name: Summarization
|
| 14 |
+
dataset:
|
| 15 |
+
name: adversarial_qa
|
| 16 |
+
type: adversarial_qa
|
| 17 |
+
config: dbert
|
| 18 |
+
split: validation
|
| 19 |
+
metrics:
|
| 20 |
+
- type: rouge
|
| 21 |
+
value: 8.5395
|
| 22 |
+
name: ROUGE-1
|
| 23 |
+
verified: true
|
| 24 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMDRlYzJkYjhlOTcwOTNiMjdmNWZjNTU3ZTM4YmQwOWMyZmQ3M2VlYmJhNmQzMDdjYTU2NTA2ZDAxMTJhMDNiMiIsInZlcnNpb24iOjF9.y9KkCBCE9_FI4t3oP830hyDwc-3EL5Ka3ZpVO4YJQVsxwJC6gInyqsgsTBQq8_-zkwaXSif5X-xZJV_mGTygCw
|
| 25 |
+
- type: rouge
|
| 26 |
+
value: 2.438
|
| 27 |
+
name: ROUGE-2
|
| 28 |
+
verified: true
|
| 29 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODAzZTkzZDYxYTU2ZjYyYWI1ZjBmNDI5OTZkMDAxNzEwNjE4MTAwODIwZTZjZGVlNDJjNDUxZjA3M2U3ZDE1MyIsInZlcnNpb24iOjF9.LzYZ_CfrIkL7i11Fsr37JaZ3LOTiWXWazjCIH4bkSaKY29HdnkiPzo9jt70eeCHtm7X1vWAfwHtsGckw_nZgBQ
|
| 30 |
+
- type: rouge
|
| 31 |
+
value: 6.9625
|
| 32 |
+
name: ROUGE-L
|
| 33 |
+
verified: true
|
| 34 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzExNTczY2YxZDMxNTExYjYzOTE5ZjM5ZTQyYmUzOGRjZWQ5MTc1Nzg1ZmEwNGRiMDRkOWI3MTZiOTg5ODA0MCIsInZlcnNpb24iOjF9.AzPWkqHjbbuM7VcHQoH5QXzhHlERIKpaVrvqEmZtT4TJVgPqlItFDXXSc0wzQnNcrNC7L6wwKQLe0ZB5qWTPAA
|
| 35 |
+
- type: rouge
|
| 36 |
+
value: 7.6894
|
| 37 |
+
name: ROUGE-LSUM
|
| 38 |
+
verified: true
|
| 39 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiY2NmY2ZjN2MzNDQ0YWUyZDVhNTVlYTNhMWZmZDQwN2MwM2EzNWNlNDY0OTc5ZWQzYTJmMTNjMzVkMWI1NGFmMyIsInZlcnNpb24iOjF9.qscHn3SwHUvG-7AQav49eAYxtlrkhVuEC7zhQ21zLqmheXrP7Jo29aHgK1A8GnnwIAVhUBxQzb2g6zNFFNhmDQ
|
| 40 |
+
- type: loss
|
| 41 |
+
value: 8.343116760253906
|
| 42 |
+
name: loss
|
| 43 |
+
verified: true
|
| 44 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzRjMDliZWY5ODk0YThkMmVhMjY1OWZlMzQyYmY4YjIzMWE1M2FjZjg5Yzc2NWM0OWUxZjRhZTNiMGY4NGQxZiIsInZlcnNpb24iOjF9.05EZ-BaoRSkunJfpyiFq4XoJK9NXpoGkkD8Vp5EgE-U8IG6Rz3-oGxU2zxHfcEs5g3SWMFVj00GZx7phDcNnDw
|
| 45 |
+
- type: google_bleu
|
| 46 |
+
value: 0.013
|
| 47 |
+
name: google_bleu
|
| 48 |
+
verified: true
|
| 49 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWU3ODc3MmFkY2E5YjBkMmQyNTlkMzZlMDRlZjg3NzdhZGY3ZDliY2ZhODllZTJlNTNhZGZjM2Q5ZjFjYTRiMyIsInZlcnNpb24iOjF9.idRIOR3DwVo3cWQdEbQiR_PqdsO8VkvrpLy-rSHoKeY1xvsvDjfeLz3nRacn0eB2PeybHVYo09zPMmoeuVQeDA
|
| 50 |
+
- type: gen_len
|
| 51 |
+
value: 14.369
|
| 52 |
+
name: gen_len
|
| 53 |
+
verified: true
|
| 54 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjMwNzJmZDM2YzUzZmRjYjkxZmZjMWNhZTM1NjYzNGU2ZTkxOWViOWYxMjljZjI5M2NkMmNlMThkZDM5ZDM4NSIsInZlcnNpb24iOjF9.hAVWEDNqZiR4447Z3aBGU_xi5XgcRhjP5L6xWjUVUR2Bd3XKywjtMQXCo3HsNZ8Z5Bq12SNP8RqH6Lpsup_hDQ
|
| 55 |
---
|
| 56 |
|
| 57 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|