Sean Lee commited on
Commit ·
51138da
1
Parent(s): a834a0e
readme updated
Browse files
README.md
CHANGED
|
@@ -5,4 +5,25 @@ language:
|
|
| 5 |
pipeline_tag: visual-question-answering
|
| 6 |
tags:
|
| 7 |
- beit3
|
| 8 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
pipeline_tag: visual-question-answering
|
| 6 |
tags:
|
| 7 |
- beit3
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
# BEiT3 based Korean VQA Model #
|
| 12 |
+
|
| 13 |
+
## Basic information ##
|
| 14 |
+
### Model ###
|
| 15 |
+
- Base Model : beit3_large_indomain_patch16_224 (https://github.com/microsoft/unilm/tree/master/beit3)
|
| 16 |
+
- best epoch : 8
|
| 17 |
+
- learning rate : 2e-5
|
| 18 |
+
- fixed seed : 42
|
| 19 |
+
|
| 20 |
+
- Tokenizer
|
| 21 |
+
- korean sentencepiece tokenizer trained on korean wikipedia
|
| 22 |
+
|
| 23 |
+
### Dataset ###
|
| 24 |
+
- KoBEiT3
|
| 25 |
+
- aihub 시각정보 기반 질의응답 (https://aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=realm&dataSetSn=104)
|
| 26 |
+
* Only Korean can access to the dataset
|
| 27 |
+
- Tokenizer
|
| 28 |
+
- kowiki-latest-pages-articles.xml.bz2 (https://dumps.wikimedia.org/kowiki/latest/)
|
| 29 |
+
|