QA_HUIT
Collection
10 items • Updated
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Fine-tuned from google/byt5-small for Vietnamese
question answering on BaoNhan/FAIR_Dataset_QA.
raw| Metric | Value |
|---|---|
| Exact_Match | 31.78 |
| Token_F1 | 36.79 |
| ROUGE_1_F1 | 36.79 |
| ROUGE_2_F1 | 32.30 |
| ROUGE_L_F1 | 35.91 |
| BLEU | 3.73 |
| chrF | 16.72 |
| BERTScore_F1 | 86.43 |
predict.py is included in this repo:
python predict.py --model BaoNhan/vi-qa-byt5-small-ctx --mode raw --use_context --context "..." \
--question "Viet Nam co bao nhieu tinh thanh?"
A paper describing this benchmark is in preparation. If you use this code or the released checkpoints, please cite it once it is available — the entry below is a placeholder and will be updated with the final venue, authors, and year.
@misc{TODO_citation_key,
title = {TODO: paper title},
author = {TODO: author list},
year = {TODO},
howpublished = {TODO: venue / arXiv preprint},
note = {Preprint in preparation},
url = {https://github.com/chaubaonhan/QA_Huit}
}