Text Generation
Transformers
Safetensors
Korean
gptj
ANHSY_test / README.md
blueapple8259's picture
์ž˜๋ชป ์ˆ˜์ •ํ•ด์„œ ๋ณต๊ตฌ
c1db036
---
license: mit
datasets:
- nlpai-lab/kullm-v2
- maywell/ko_wikidata_QA
- eaglewatch/Korean_Wikipedia_Dataset_for_GPT2_August_2022
language:
- ko
---
[kogpt-j-base](https://huggingface.co/heegyu/kogpt-j-base)๋ชจ๋ธ์„ ๋ฐ์ดํ„ฐ์…‹ [์„ธ](https://huggingface.co/datasets/nlpai-lab/kullm-v2)[๊ฐ€](https://huggingface.co/datasets/maywell/ko_wikidata_QA)[์ง€](https://huggingface.co/datasets/eaglewatch/Korean_Wikipedia_Dataset_for_GPT2_August_2022)๋ฅผ ์‚ฌ์šฉํ•ด์„œ 45k step(0.27 epoch)๋งŒํผ ํ•™์Šต์‹œํ‚จ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
ํ”„๋กฌํ”„ํŠธ:
```
<|im_start|>system
๋‹น์‹ ์€ ์‚ฌ๋žŒ๋“ค์„ ๋„์™€์ฃผ๋Š” ์ธ๊ณต์ง€๋Šฅ ๋น„์„œ์ž…๋‹ˆ๋‹ค. ์งˆ๋ฌธ์„ ์ฝ๊ณ  ์•Œ๋งž์€ ๋‹ต๋ณ€์„ ์ œ๊ณตํ•˜์„ธ์š”.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
๋ฐ์ดํ„ฐ์…‹:
[nlpai-lab/kullm-v2](https://huggingface.co/datasets/nlpai-lab/kullm-v2)
[maywell/ko_wikidata_QA](https://huggingface.co/datasets/maywell/ko_wikidata_QA)
[eaglewatch/Korean_Wikipedia_Dataset_for_GPT2_August_2022](https://huggingface.co/datasets/eaglewatch/Korean_Wikipedia_Dataset_for_GPT2_August_2022)