Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,65 +9,80 @@ app_file: app.py
|
|
| 9 |
pinned: false
|
| 10 |
---
|
| 11 |
|
| 12 |
-
# Megumin
|
| 13 |
|
| 14 |
-
|
| 15 |
|
| 16 |
-
|
|
|
|
| 17 |
|
| 18 |
-
|
| 19 |
|
| 20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
-
|
| 23 |
-
- ๋ฃจํธ `requirements.txt`
|
| 24 |
-
- Space Secret์ Gemini API ํค ๋ฑ๋ก
|
| 25 |
|
| 26 |
-
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
-
|
| 29 |
|
| 30 |
-
- `
|
| 31 |
-
-
|
|
|
|
| 32 |
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
```text
|
| 36 |
-
GOOGLE_API_KEY=๋ฐ๊ธ๋ฐ์_์ค์ _Gemini_API_ํค
|
| 37 |
-
```
|
| 38 |
-
|
| 39 |
-
## ๋ก์ปฌ ์คํ
|
| 40 |
|
| 41 |
```bash
|
| 42 |
python app_gradio.py
|
| 43 |
```
|
| 44 |
|
| 45 |
-
|
| 46 |
|
| 47 |
```bash
|
| 48 |
python app.py
|
| 49 |
```
|
| 50 |
|
| 51 |
-
##
|
| 52 |
|
| 53 |
-
|
|
|
|
| 54 |
|
| 55 |
-
|
| 56 |
|
| 57 |
-
```
|
| 58 |
-
|
| 59 |
```
|
| 60 |
|
| 61 |
-
##
|
| 62 |
|
| 63 |
-
์๋ณธ
|
| 64 |
|
| 65 |
```bash
|
| 66 |
-
python scripts/
|
| 67 |
```
|
| 68 |
|
| 69 |
-
|
| 70 |
|
| 71 |
-
|
| 72 |
-
|
|
|
|
|
|
|
| 73 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
pinned: false
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# Megumin Chatbot Spec
|
| 13 |
|
| 14 |
+
## ๊ฐ์
|
| 15 |
|
| 16 |
+
๋ฉ๊ตฌ๋ฐ ํ๋ฅด์๋๋ก ๋ํํ๋ Gradio ๊ธฐ๋ฐ ์ฑ๋ด์
๋๋ค.
|
| 17 |
+
Google ADK Agent๋ฅผ ์ฌ์ฉํ๋ฉฐ, ๋ต๋ณ ์ ์ RAG๋ก ์ ์ฌ ์ฌ๋ก๋ฅผ ์ฐพ์ ๋งํฌ์ ์ค์ ์ ์ฐธ๊ณ ํฉ๋๋ค.
|
| 18 |
|
| 19 |
+
## ํต์ฌ ๊ตฌ์ฑ
|
| 20 |
|
| 21 |
+
- LLM: `gemini-3.1-flash-lite-preview`
|
| 22 |
+
- Agent: Google ADK `LlmAgent`
|
| 23 |
+
- UI: Gradio
|
| 24 |
+
- ๊ฒ์: Gemini Embedding + FAISS
|
| 25 |
+
- ์ธ์
: `InMemorySessionService`
|
| 26 |
|
| 27 |
+
## ๋์ ๋ฐฉ์
|
|
|
|
|
|
|
| 28 |
|
| 29 |
+
1. ์ฌ์ฉ์์ ์ง๋ฌธ์ด ๋ค์ด์ค๋ฉด Agent๊ฐ RAG tool์ ํธ์ถํฉ๋๋ค.
|
| 30 |
+
2. ์ง๋ฌธ ์๋ฒ ๋ฉ์ ๊ธฐ์ค์ผ๋ก FAISS์์ ์ ์ฌ ์ฌ๋ก top-3๋ฅผ ์ฐพ์ต๋๋ค.
|
| 31 |
+
3. ๊ฒ์๋ ๋ต๋ณ ์ฌ๋ก์ ํ์ฌ ์ง๋ฌธ์ ํจ๊ป ์ฐธ๊ณ ํด ๋ฉ๊ตฌ๋ฐ ํ๋ฅด์๋๋ก ์๋ตํฉ๋๋ค.
|
| 32 |
+
4. ๋ฉํฐํด ๋ํ์์๋ ์ต๊ทผ 6ํด์ ์ ์งํ๊ณ , ๊ทธ ์ด์ ๋ด์ฉ์ ์งง์ ์์ฝ์ผ๋ก ์์ถํฉ๋๋ค.
|
| 33 |
|
| 34 |
+
## ๋ฐ์ดํฐ ๊ตฌ์ฑ
|
| 35 |
|
| 36 |
+
- `megumin_qa_dataset.json`: ์๋ณธ Q/A ๋ฐ์ดํฐ์
|
| 37 |
+
- `megumin_questions.faiss`: ์ง๋ฌธ ์๋ฒ ๋ฉ ์ธ๋ฑ์ค
|
| 38 |
+
- `megumin_questions_meta.json`: ์ธ๋ฑ์ค์ ์๋ฌธ ๋ ์ฝ๋ ๋งคํ ์ ๋ณด
|
| 39 |
|
| 40 |
+
## ์คํ
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
|
| 42 |
```bash
|
| 43 |
python app_gradio.py
|
| 44 |
```
|
| 45 |
|
| 46 |
+
Spaces ์ง์
์ :
|
| 47 |
|
| 48 |
```bash
|
| 49 |
python app.py
|
| 50 |
```
|
| 51 |
|
| 52 |
+
## ํ์ ํ๊ฒฝ๋ณ์
|
| 53 |
|
| 54 |
+
- `GOOGLE_API_KEY`: Gemini API ํค
|
| 55 |
+
- `HF_TOKEN`: private dataset repo๋ฅผ ์ฝ์ ๋ ํ์
|
| 56 |
|
| 57 |
+
๊ถ์ฅ:
|
| 58 |
|
| 59 |
+
```env
|
| 60 |
+
GOOGLE_API_KEY=your_gemini_api_key
|
| 61 |
```
|
| 62 |
|
| 63 |
+
## ์ธ๋ฑ์ค ์์ฑ
|
| 64 |
|
| 65 |
+
์๋ณธ JSON์์ FAISS ์ธ๋ฑ์ค๋ฅผ ๋ง๋ค๋ ค๋ฉด:
|
| 66 |
|
| 67 |
```bash
|
| 68 |
+
python scripts/build_faiss_index.py
|
| 69 |
```
|
| 70 |
|
| 71 |
+
## ๋๋ฌด์ํค QA ๋ณํ
|
| 72 |
|
| 73 |
+
์ ๋ณํ ๋๋ฌด์ํค ๋ฌธ์๋ฅผ QA JSON์ผ๋ก ๋ณํํ๋ ค๋ฉด:
|
| 74 |
+
|
| 75 |
+
```bash
|
| 76 |
+
python scripts/crawl_namuwiki_to_qa.py --title ๋ฉ๊ตฌ๋ฐ --title ์นด์ฆ๋ง
|
| 77 |
```
|
| 78 |
+
|
| 79 |
+
๋ณํ ๊ท์น:
|
| 80 |
+
|
| 81 |
+
- `question`: ์ง๋ฌธํ์ด ์๋๋ผ ๊ฒ์์ฉ ์์ ๋ชฉ ์์ฝ
|
| 82 |
+
- `answer`: ์ฝ 200์ ๋ด์ธ์ ์ค๋ฆฝ ์์ฝ
|
| 83 |
+
- chunk overlap: 1~2๋ฌธ์ฅ
|
| 84 |
+
- ํ/์ด๋ฏธ์ง ์ ์ธ
|
| 85 |
+
|
| 86 |
+
## ๋ฐฐํฌ ๋ฉ๋ชจ
|
| 87 |
+
|
| 88 |
+
Hugging Face Spaces์์๋ dataset repo์์ JSON, FAISS, metadata๋ฅผ ๋ฐํ์์ ๋ด๋ ค๋ฐ์ ์ฌ์ฉํฉ๋๋ค.
|