momo commited on
Commit
366824c
Β·
1 Parent(s): 5c8908a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -18
README.md CHANGED
@@ -1,25 +1,28 @@
1
- kiosk_bot
2
- KoGPT2λ₯Ό μ΄μš©ν•œ κ°„λ‹¨ν•œ kiosk chatbot μž…λ‹ˆλ‹€.
3
 
4
- λ°μ΄ν„°λŠ” AiHub의 ν•œκ΅­μ–΄λŒ€ν™” 데이터λ₯Ό μ‚¬μš©ν–ˆμŠ΅λ‹ˆλ‹€.
5
 
6
- λ°μ΄ν„°λŠ” ν•™μŠ΅λ§Œ μ§„ν–‰ν•˜μ˜€κ³  κ³΅κ°œλŠ” ν•˜μ§€ μ•ŠμŠ΅λ‹ˆλ‹€.
7
 
8
- Architecture
9
- Hugging face의 μ˜ˆμ œλ“€μ„ 보며 κ΅¬ν˜„ν•˜μ˜€μŠ΅λ‹ˆλ‹€.
 
10
 
11
- gpt
12
- input 은 User + <BOS> + System + <EOS>둜 κ΅¬ν˜„ν•˜μ˜€λ‹€.
13
 
14
- output 은 P(system|user)λ₯Ό μ΅œλŒ€ν™” μ‹œν‚€κΈ°μœ„ν•΄ λͺ¨λΈμ„ ν•™μŠ΅ν•˜μ˜€λ‹€.
15
 
16
- Install
 
 
 
17
  git clone https://github.com/momozzing/kiosk_bot.git
18
- git lfs pull ## lfs κ°€ μ—†μœΌλ©΄ μ„€μΉ˜ν•˜μ…”μ•Ό ν•©λ‹ˆλ‹€.
19
  pip install requirements.txt
20
- How to train?
21
- κΈ°μ‘΄ ν•™μŠ΅λœ λ°μ΄ν„°λ‘œ λŒ€ν™”λ₯Ό ν•˜κ³  μ‹ΆμœΌμ‹œλ©΄ install ν›„ How to chat 으둜 λ„˜μ–΄κ°€μ…”λ„ λ©λ‹ˆλ‹€.
22
 
 
 
 
23
  cd kiosk_bot/data ## μ•ˆμ— μ›ν•˜μ‹œλŠ” 데이터λ₯Ό λ„£μœΌμ‹œλ©΄ λ©λ‹ˆλ‹€.
24
 
25
  kiosk_bot/GPT-2_fine_tune.py ## μ•ˆμ— 데이터 loaderλ“€μ˜ νŒŒμΌμ΄λ¦„μ„ λ³€κ²½ν•΄μ£Όμ‹œλ©΄ λ©λ‹ˆλ‹€.
@@ -27,7 +30,10 @@ kiosk_bot/GPT-2_fine_tune.py ## μ•ˆμ— 데이터 loaderλ“€μ˜ νŒŒμΌμ΄λ¦„μ„
27
  deepspeed --num_gpus=1 GPT-2_fine_tune.py ## λ³€κ²½ν›„ μ΄κ²ƒμœΌλ‘œ μ‹€ν–‰ν•˜μ‹œλ©΄ λ©λ‹ˆλ‹€.
28
 
29
  κ·Έν›„ μƒμ„±λœ skt-kogpt2-base-v2.pt λ₯Ό μ‚¬μš©ν•˜μ‹œλ©΄ λ©λ‹ˆλ‹€.
30
- How to chat?
 
 
 
31
  python interactive.py ##κΈ°μ‘΄ λ°μ΄ν„°λ‘œ μ±„νŒ…ν•˜κΈ°
32
 
33
  python new_data_interactive.py ##μƒˆλ‘œμš΄ λ°μ΄ν„°λ‘œ νŒŒμΈνŠœλ‹ν•œκ²ƒ pt파일 λΆˆλŸ¬μ™€μ„œ μ±„νŒ…ν•˜κΈ°.
@@ -51,9 +57,11 @@ System: λ„€ 그럼 λ¨Έκ·Έμž”μœΌλ‘œ μ€€λΉ„ν•΄λ“œλ¦¬κ² μŠ΅λ‹ˆλ‹€
51
 
52
  User: κ°μ‚¬ν•©λ‹ˆλ‹€
53
  System: 쒋은 ν•˜λ£¨ λ³΄λ‚΄μ„Έμš”
54
- Reference
55
- HuggingFace
 
 
56
 
57
- KoGPT2
58
 
59
- AIHUB
 
1
+ # kiosk_bot
 
2
 
3
+ KoGPT2λ₯Ό μ΄μš©ν•œ κ°„λ‹¨ν•œ kiosk chatbot μž…λ‹ˆλ‹€.
4
 
5
+ λ°μ΄ν„°λŠ” AiHub의 [ν•œκ΅­μ–΄λŒ€ν™” 데이터](https://aihub.or.kr/aidata/85)λ₯Ό μ‚¬μš©ν–ˆμŠ΅λ‹ˆλ‹€.
6
 
7
+ λ°μ΄ν„°λŠ” ν•™μŠ΅λ§Œ μ§„ν–‰ν•˜μ˜€κ³  κ³΅κ°œλŠ” ν•˜μ§€ μ•ŠμŠ΅λ‹ˆλ‹€.
8
+ ## Architecture
9
+ Hugging face의 μ˜ˆμ œλ“€μ„ 보며 κ΅¬ν˜„ν•˜μ˜€μŠ΅λ‹ˆλ‹€.
10
 
11
+ <img width="549" alt="gpt" src="https://user-images.githubusercontent.com/60643542/142431681-85db3d74-172d-45f0-9433-de43a8aeae17.png">
 
12
 
13
+ ```input``` 은 ```User + <BOS> + System + <EOS>```둜 κ΅¬ν˜„ν•˜μ˜€λ‹€.
14
 
15
+ ```output``` 은 ```P(system|user)```λ₯Ό μ΅œλŒ€ν™” μ‹œν‚€κΈ°μœ„ν•΄ λͺ¨λΈμ„ ν•™μŠ΅ν•˜μ˜€λ‹€.
16
+
17
+ ## Install
18
+ ```
19
  git clone https://github.com/momozzing/kiosk_bot.git
 
20
  pip install requirements.txt
21
+ ```
 
22
 
23
+ ## How to train?
24
+ κΈ°μ‘΄ ν•™μŠ΅λœ λ°μ΄ν„°λ‘œ λŒ€ν™”λ₯Ό ν•˜κ³  μ‹ΆμœΌμ‹œλ©΄ ```install``` ν›„ ```How to chat``` 으둜 λ„˜μ–΄κ°€μ…”λ„ λ©λ‹ˆλ‹€.
25
+ ```
26
  cd kiosk_bot/data ## μ•ˆμ— μ›ν•˜μ‹œλŠ” 데이터λ₯Ό λ„£μœΌμ‹œλ©΄ λ©λ‹ˆλ‹€.
27
 
28
  kiosk_bot/GPT-2_fine_tune.py ## μ•ˆμ— 데이터 loaderλ“€μ˜ νŒŒμΌμ΄λ¦„μ„ λ³€κ²½ν•΄μ£Όμ‹œλ©΄ λ©λ‹ˆλ‹€.
 
30
  deepspeed --num_gpus=1 GPT-2_fine_tune.py ## λ³€κ²½ν›„ μ΄κ²ƒμœΌλ‘œ μ‹€ν–‰ν•˜μ‹œλ©΄ λ©λ‹ˆλ‹€.
31
 
32
  κ·Έν›„ μƒμ„±λœ skt-kogpt2-base-v2.pt λ₯Ό μ‚¬μš©ν•˜μ‹œλ©΄ λ©λ‹ˆλ‹€.
33
+ ```
34
+
35
+ ## How to chat?
36
+ ```
37
  python interactive.py ##κΈ°μ‘΄ λ°μ΄ν„°λ‘œ μ±„νŒ…ν•˜κΈ°
38
 
39
  python new_data_interactive.py ##μƒˆλ‘œμš΄ λ°μ΄ν„°λ‘œ νŒŒμΈνŠœλ‹ν•œκ²ƒ pt파일 λΆˆλŸ¬μ™€μ„œ μ±„νŒ…ν•˜κΈ°.
 
57
 
58
  User: κ°μ‚¬ν•©λ‹ˆλ‹€
59
  System: 쒋은 ν•˜λ£¨ λ³΄λ‚΄μ„Έμš”
60
+ ```
61
+
62
+ ## Reference
63
+ [HuggingFace](https://huggingface.co/transformers/index.html)
64
 
65
+ [KoGPT2](https://github.com/SKT-AI/KoGPT2)
66
 
67
+ [AIHUB](https://aihub.or.kr/)