Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Question Generation Model with KorQuAD
|
| 2 |
+
___
|
| 3 |
+
|
| 4 |
+
This model is a fine-tuend version of paust/pko-t5-base on the KorQuAD v1.0 Dataset.
|
| 5 |
+
Most ideas were inspired by [Leaf-Question-Generation](https://github.com/KristiyanVachev/Leaf-Question-Generation).
|
| 6 |
+
|
| 7 |
+
### Dataset
|
| 8 |
+
KorQuAD v1.0 Dataset (csv)
|
| 9 |
+
[Train](https://drive.google.com/file/d/1p0LYPBQE8OW6XRFEW5nxc8P03wgD_plE/view?usp=sharing)
|
| 10 |
+
[Valid](https://drive.google.com/file/d/1O0-8BCsYn3PpEmIUjiEBnPz4sBBmQmud/view?usp=sharing)
|
| 11 |
+
|
| 12 |
+
### Train
|
| 13 |
+
|
| 14 |
+
30% ํ๋ฅ ๋ก input answer ๋์ '[MASK]'๋ฅผ ๋ฃ์ด ์ง๋ฌธ ๋ฌธ์ฅ์ ์์ฑํ๋๋ก ํ์ตํ๋ค.
|
| 15 |
+
๊ทธ ๊ฒฐ๊ณผ, input answer๊ฐ ์์ ๋๋ ์ ์ ํ answer์ ์ฐพ์ ์ง๋ฌธ์ ์์ฑํ ์ ์๋ค.
|
| 16 |
+
|
| 17 |
+
### Question Generation without Input Answer
|
| 18 |
+
|
| 19 |
+
```python
|
| 20 |
+
context = """ CONTEXT """"
|
| 21 |
+
input_answer = '[MASK]'
|
| 22 |
+
|
| 23 |
+
generated = generate(best_model, input_answer, context)
|
| 24 |
+
|
| 25 |
+
show_result(generated)
|
| 26 |
+
```
|
| 27 |
+
|
| 28 |
+
### References
|
| 29 |
+
____
|
| 30 |
+
Leaf-Question-Generation :https://github.com/KristiyanVachev/Leaf-Question-Generation
|
| 31 |
+
pko-t5-base : https://huggingface.co/paust/pko-t5-base
|
| 32 |
+
KorQuAD v1.0 : https://korquad.github.io/KorQuad%201.0/
|
| 33 |
+
|