Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,21 @@ language:
|
|
| 8 |
- ko
|
| 9 |
---
|
| 10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
### ์ฌ์ฉ ์์
|
| 13 |
|
|
|
|
| 8 |
- ko
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# ํ๊ตญ์ด Prometheus ๋ชจ๋ธ (beta)
|
| 12 |
+
|
| 13 |
+
LoRA ํ์ตํ ๋ค, [LogicKor](https://github.com/instructkr/LogicKor)์ ๊ณต๊ฐ๋ GPT-4 evaluation๊ณผ ๋น๊ตํด๋ณด์์ต๋๋ค.
|
| 14 |
+
์์ ์ ์๋ ํ๋กฌํํธ๋ก ์๊ด๊ณ์๋ฅผ ๋ถ์ํ์์ผ๋ (Spearman), ์๊ด๊ณ์๋ 0.3647๋ก ๋์ง ์์์ต๋๋ค.
|
| 15 |
+
|
| 16 |
+
์นดํ
๊ณ ๋ฆฌ๋ณ ์๊ด๊ณ์
|
| 17 |
+
|
| 18 |
+
- ๊ธ์ฐ๊ธฐ: 0.436584
|
| 19 |
+
- ์ํ: 0.551298
|
| 20 |
+
- ์ถ๋ก : 0.395449
|
| 21 |
+
- ๋ฌธ๋ฒ: 0.262858
|
| 22 |
+
- ์ดํด: 0.436034
|
| 23 |
+
- ์ฝ๋ฉ: 0.290976
|
| 24 |
+
|
| 25 |
+
๋ฌธ๋ฒ๊ณผ ์ฝ๋ฉ ๋ถ๋ถ์ด ๋น๊ต์ ์ฝํ ๊ฒ์ ์ ์ ์์ต๋๋ค.
|
| 26 |
|
| 27 |
### ์ฌ์ฉ ์์
|
| 28 |
|