Update README.md
Browse files
README.md
CHANGED
|
@@ -21,6 +21,20 @@ Chinese and English
|
|
| 21 |
Icelandic and English
|
| 22 |
Czech and English
|
| 23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
[Sample Code For Free Colab](https://github.com/webbigdata-jp/python_sample/blob/main/ALMA_7B_Ja_Free_Colab_sample.ipynb)
|
| 26 |
|
|
|
|
| 21 |
Icelandic and English
|
| 22 |
Czech and English
|
| 23 |
|
| 24 |
+
Models | de | cs | is | zh | ru/jp | Avg. |
|
| 25 |
+
|----------------|--------|--------|--------|--------|--------|--------|
|
| 26 |
+
Translating from English (en→xx) BLEU/COMET
|
| 27 |
+
NLLB-54B | 34.50/86.45 | 37.60/90.15 | 24.15/81.76 | 27.38/78.91 | 30.96/87.92 | 30.92/85.04 |
|
| 28 |
+
GPT-3.5-D | 31.80/85.61 | 31.30/88.57 | 15.90/76.28 | 38.30/85.76 | 27.50/86.74 | 28.96/84.59 |
|
| 29 |
+
ALMA-7B(Original)| 30.31/85.59 | 29.88/89.10 | 25.71/85.52 | 36.87/85.11 | 27.13/86.98 | 29.89/86.49 |
|
| 30 |
+
ALMA-7B-Ja(Ours) | 23.70/82.04 | 18.58/81.36 | 12.20/71.59 | 29.06/82.45 | 14.82/85.40 | 19.67/80.57 |
|
| 31 |
+
Translating to English (xx→en) BLEU/COMET
|
| 32 |
+
NLLB-54B | 26.89/78.94 | 39.11/80.13 | 23.09/71.66 | 16.56/70.70 | 39.11/81.88 | 28.95/76.66 |
|
| 33 |
+
GPT-3.5-D | 30.90/84.79 | 44.50/86.16 | 31.90/82.13 | 25.00/81.62 | 38.50/84.80 | 34.16/83.90 |
|
| 34 |
+
ALMA-7B(Original)| 30.26/84.00 | 43.91/85.86 | 35.97/86.03 | 23.75/79.85 | 39.37/84.58 | 34.55/84.02 |
|
| 35 |
+
ALMA-7B-Ja(Ours) | 26.41/83.13 | 34.39/83.50 | 24.77/81.12 | 20.60/78.54 | 15.57/78.61 | 24.35/81.76 |
|
| 36 |
+
|
| 37 |
+
|
| 38 |
|
| 39 |
[Sample Code For Free Colab](https://github.com/webbigdata-jp/python_sample/blob/main/ALMA_7B_Ja_Free_Colab_sample.ipynb)
|
| 40 |
|