kogpt2-chatbot-lora / README.md
cheoljoon's picture
Upload README.md with huggingface_hub
c192003 verified
---
license: cc-by-nc-nd-4.0
base_model: skt/kogpt2-base-v2
tags:
- gpt2
- lora
- korean
- chatbot
language:
- ko
---
# ๋ชจ๋ธ ์ด๋ฆ„
skt/kogpt2-base-v2
## ๋ชจ๋ธ ์„ค๋ช…
ํ•œ๊ตญ์–ด๋กœ ํ•™์Šต๋œ ์˜คํ”ˆ์†Œ์Šค ๊ธฐ๋ฐ˜ GPT-2 ๋ชจ๋ธ
## ๋ชจ๋ธ ์ƒ์„ธ
์ฑ—๋ด‡ ๊ตฌ์ถ•, ํ…์ŠคํŠธ ๊ฐ์„ฑ ์˜ˆ์ธก, ํ…์ŠคํŠธ ๋ถ„์„ ๊ธฐ๋ฐ˜ ์‘๋‹ต ์ƒ์„ฑ์— ์‚ฌ์šฉ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ๊ด€์‹ฌ ์žˆ๋Š” ๊ฐœ๋ฐœ์ž๋Š” ๋ชจ๋ธ๊ณผ ๊ด€๋ จ ์†Œ์Šค๋ฅผ ๋‹ค์šด๋กœ๋“œํ•ด ํ”„๋กœ์ ํŠธ์— ์ ์šฉํ•˜๊ฑฐ๋‚˜ ์ˆ˜์ •ํ•˜๋ฉด ๋œ๋‹ค.
## LoRA ์„ค์ •
lora_config = LoraConfig(
r=16,
lora_alpha=32,
target_modules=["c_attn", "c_proj", "c_fc"],
lora_dropout=0.05,
bias="none",
task_type=TaskType.CAUSAL_LM
)
## ํ•™์Šต ์„ค์ •
## ํ•™์Šต ๊ฒฐ๊ณผ
## ์‚ฌ์šฉ ๋ฐฉ๋ฒ•
```python
```
## ๋ชจ๋ธ ์ •๋ณด