madcows commited on
Commit
ad30761
·
verified ·
1 Parent(s): 05f6f92

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -100,6 +100,17 @@ response = tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_speci
100
  print(response)
101
  ```
102
 
 
 
 
 
 
 
 
 
 
 
 
103
  ## 📌 Caution
104
  * Commercial use is strictly prohibited.
105
 
 
100
  print(response)
101
  ```
102
 
103
+ ## 📊 Model Performance Comparison
104
+ Performance scores across three Korean language benchmarks (KMMLU, ko_best, pawsx_ko).
105
+
106
+ | Model | KMMLU (0-shot) | ko_best (5-shot) | pawsx_ko |
107
+ |-------------------------------|----------------|------------------|----------|
108
+ | Phi-4-mini-instruct | 0.3161 | 0.6341 | 0.5300 |
109
+ | kanana-1.5-2.1b-instruct-2505 | 0.1577 | 0.7165 | 0.5070 |
110
+ | EXAONE-3.5-2.4B-Instruct | 0.3071 | 0.6496 | 0.5655 |
111
+ | siwon-mini-instruct-0626 | 0.3387 | 0.5576 | 0.5485 |
112
+
113
+
114
  ## 📌 Caution
115
  * Commercial use is strictly prohibited.
116