heegyu commited on
Commit
cc907ab
ยท
verified ยท
1 Parent(s): 13784ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -8,6 +8,21 @@ language:
8
  - ko
9
  ---
10
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
 
12
  ### ์‚ฌ์šฉ ์˜ˆ์ œ
13
 
 
8
  - ko
9
  ---
10
 
11
+ # ํ•œ๊ตญ์–ด Prometheus ๋ชจ๋ธ (beta)
12
+
13
+ LoRA ํ•™์Šตํ•œ ๋’ค, [LogicKor](https://github.com/instructkr/LogicKor)์— ๊ณต๊ฐœ๋œ GPT-4 evaluation๊ณผ ๋น„๊ตํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค.
14
+ ์˜ˆ์ œ์— ์žˆ๋Š” ํ”„๋กฌํ”„ํŠธ๋กœ ์ƒ๊ด€๊ณ„์ˆ˜๋ฅผ ๋ถ„์„ํ•˜์˜€์œผ๋‚˜ (Spearman), ์ƒ๊ด€๊ณ„์ˆ˜๋Š” 0.3647๋กœ ๋†’์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
15
+
16
+ ์นดํ…Œ๊ณ ๋ฆฌ๋ณ„ ์ƒ๊ด€๊ณ„์ˆ˜
17
+
18
+ - ๊ธ€์“ฐ๊ธฐ: 0.436584
19
+ - ์ˆ˜ํ•™: 0.551298
20
+ - ์ถ”๋ก : 0.395449
21
+ - ๋ฌธ๋ฒ•: 0.262858
22
+ - ์ดํ•ด: 0.436034
23
+ - ์ฝ”๋”ฉ: 0.290976
24
+
25
+ ๋ฌธ๋ฒ•๊ณผ ์ฝ”๋”ฉ ๋ถ€๋ถ„์ด ๋น„๊ต์  ์•ฝํ•œ ๊ฒƒ์„ ์•Œ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
26
 
27
  ### ์‚ฌ์šฉ ์˜ˆ์ œ
28