Update README.md
Browse files
README.md
CHANGED
|
@@ -114,4 +114,18 @@ ko_text 아이리스는 딥러닝을 기반으로 한 한국어-영어 문장
|
|
| 114 |
|
| 115 |
|
| 116 |
## Evaluation
|
| 117 |
-
will be updated soon.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 114 |
|
| 115 |
|
| 116 |
## Evaluation
|
| 117 |
+
will be updated soon.
|
| 118 |
+
|
| 119 |
+
https://github.com/davidkim205/translation
|
| 120 |
+
|
| 121 |
+
|
| 122 |
+
| TYPE | Model | BLEU | SBLEU | Duplicate | Length Exceeds |
|
| 123 |
+
| ----------- | :------------------------------- | ---- | ----- | --------- | -------------- |
|
| 124 |
+
| HuggingFace | facebook/nllb-200-distilled-1.3B | 0.26 | 0.30 | 1 | 3 |
|
| 125 |
+
| HuggingFace | jbochi/madlad400-10b-mt | 0.29 | 0.38 | 3 | 6 |
|
| 126 |
+
| HuggingFace | Unbabel/TowerInstruct-7B-v0.1 | 0.32 | 0.39 | 1 | 9 |
|
| 127 |
+
| HuggingFace | squarelike/Gugugo-koen-7B-V1.1 | 0.32 | 0.36 | 1 | 3 |
|
| 128 |
+
| Cloud | deepl | 0.39 | 0.45 | 0 | 1 |
|
| 129 |
+
| Cloud | azure | 0.40 | 0.49 | 0 | 3 |
|
| 130 |
+
| Cloud | google | 0.40 | 0.49 | 0 | 2 |
|
| 131 |
+
| HuggingFace | davidkim205/iris-7b(**ours**) | 0.40 | 0.43 | 0 | 3 |
|