QA_HUIT
Collection
10 items • Updated
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Fine-tuned from VietAI/vit5-base for Vietnamese
question answering on BaoNhan/FAIR_Dataset_QA.
raw| Metric | Value |
|---|---|
| Exact_Match | 30.09 |
| Token_F1 | 36.02 |
| ROUGE_1_F1 | 36.02 |
| ROUGE_2_F1 | 31.11 |
| ROUGE_L_F1 | 35.02 |
| BLEU | 4.76 |
| chrF | 16.91 |
| BERTScore_F1 | 86.38 |
predict.py is included in this repo:
python predict.py --model BaoNhan/vi-qa-vit5-base-noctx --mode raw \
--question "Viet Nam co bao nhieu tinh thanh?"
A paper describing this benchmark is in preparation. If you use this code or the released checkpoints, please cite it once it is available — the entry below is a placeholder and will be updated with the final venue, authors, and year.
@misc{TODO_citation_key,
title = {TODO: paper title},
author = {TODO: author list},
year = {TODO},
howpublished = {TODO: venue / arXiv preprint},
note = {Preprint in preparation},
url = {https://github.com/chaubaonhan/QA_Huit}
}