Update README.md
Browse files
README.md
CHANGED
|
@@ -100,6 +100,17 @@ response = tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_speci
|
|
| 100 |
print(response)
|
| 101 |
```
|
| 102 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
## 📌 Caution
|
| 104 |
* Commercial use is strictly prohibited.
|
| 105 |
|
|
|
|
| 100 |
print(response)
|
| 101 |
```
|
| 102 |
|
| 103 |
+
## 📊 Model Performance Comparison
|
| 104 |
+
Performance scores across three Korean language benchmarks (KMMLU, ko_best, pawsx_ko).
|
| 105 |
+
|
| 106 |
+
| Model | KMMLU (0-shot) | ko_best (5-shot) | pawsx_ko |
|
| 107 |
+
|-------------------------------|----------------|------------------|----------|
|
| 108 |
+
| Phi-4-mini-instruct | 0.3161 | 0.6341 | 0.5300 |
|
| 109 |
+
| kanana-1.5-2.1b-instruct-2505 | 0.1577 | 0.7165 | 0.5070 |
|
| 110 |
+
| EXAONE-3.5-2.4B-Instruct | 0.3071 | 0.6496 | 0.5655 |
|
| 111 |
+
| siwon-mini-instruct-0626 | 0.3387 | 0.5576 | 0.5485 |
|
| 112 |
+
|
| 113 |
+
|
| 114 |
## 📌 Caution
|
| 115 |
* Commercial use is strictly prohibited.
|
| 116 |
|