|
|
--- |
|
|
language: |
|
|
- en |
|
|
- is |
|
|
tags: |
|
|
- translation |
|
|
license: cc-by-4.0 |
|
|
datasets: |
|
|
- quickmt/quickmt-train.is-en |
|
|
- quickmt/newscrawl2024-en-backtranslated-is |
|
|
model-index: |
|
|
- name: quickmt-is-en |
|
|
results: |
|
|
- task: |
|
|
name: Translation isl-eng |
|
|
type: translation |
|
|
args: isl-eng |
|
|
dataset: |
|
|
name: flores101-devtest |
|
|
type: flores_101 |
|
|
args: isl_Latn eng_Latn devtest |
|
|
metrics: |
|
|
- name: BLEU |
|
|
type: bleu |
|
|
value: 34.76 |
|
|
- name: CHRF |
|
|
type: chrf |
|
|
value: 60.13 |
|
|
- name: COMET |
|
|
type: comet |
|
|
value: 85.39 |
|
|
--- |
|
|
|
|
|
|
|
|
# `quickmt-is-en` Neural Machine Translation Model |
|
|
|
|
|
`quickmt-is-en` is a reasonably fast and reasonably accurate neural machine translation model for translation from `is` into `en`. |
|
|
|
|
|
|
|
|
## Try it on our Huggingface Space |
|
|
|
|
|
Give it a try before downloading here: https://huggingface.co/spaces/quickmt/QuickMT-Demo |
|
|
|
|
|
|
|
|
## Model Information |
|
|
|
|
|
* Trained using [`eole`](https://github.com/eole-nlp/eole) |
|
|
* 200M parameter transformer 'big' with 8 encoder layers and 2 decoder layers |
|
|
* 32k separate Sentencepiece vocabs |
|
|
* Exported for fast inference to [CTranslate2](https://github.com/OpenNMT/CTranslate2) format |
|
|
* The pytorch model (for use with [`eole`](https://github.com/eole-nlp/eole)) is available in this repository in the `eole-model` folder |
|
|
|
|
|
See the `eole` model configuration in this repository for further details and the `eole-model` for the raw `eole` (pytorch) model. |
|
|
|
|
|
|
|
|
## Usage with `quickmt` |
|
|
|
|
|
You must install the Nvidia cuda toolkit first, if you want to do GPU inference. |
|
|
|
|
|
Next, install the `quickmt` python library and download the model: |
|
|
|
|
|
```bash |
|
|
git clone https://github.com/quickmt/quickmt.git |
|
|
pip install ./quickmt/ |
|
|
|
|
|
quickmt-model-download quickmt/quickmt-is-en ./quickmt-is-en |
|
|
``` |
|
|
|
|
|
Finally use the model in python: |
|
|
|
|
|
```python |
|
|
from quickmt import Translator |
|
|
|
|
|
# Auto-detects GPU, set to "cpu" to force CPU inference |
|
|
t = Translator("./quickmt-is-en/", device="auto") |
|
|
|
|
|
# Translate - set beam size to 1 for faster speed (but lower quality) |
|
|
sample_text = 'Dr. Ehud Ur, læknaprófessor við Dalhousie-háskólann í Halifax í Nova Scotia og formaður klínískrar vísindadeildar Kanadíska sykursýkissambandsins, minnti á að rannsóknin væri rétt nýhafin.' |
|
|
|
|
|
t(sample_text, beam_size=5) |
|
|
``` |
|
|
|
|
|
> 'Dr. Ehud Ur, a medical professor at Dalhousie University in Halifax, Nova Scotia, and chair of the clinical science department of the Canadian Diabetes Association, recalled that the study had just begun.' |
|
|
|
|
|
```python |
|
|
# Get alternative translations by sampling |
|
|
# You can pass any cTranslate2 `translate_batch` arguments |
|
|
t([sample_text], sampling_temperature=1.2, beam_size=1, sampling_topk=50, sampling_topp=0.9) |
|
|
``` |
|
|
|
|
|
> 'Dr Ehud Ur, a medical professor at Dalhousie University in Halifax, Nova Scotia and chair of the clinical science section of the Canadian Diabetes Union, mentioned that the investigation was just beginning.' |
|
|
|
|
|
The model is in `ctranslate2` format, and the tokenizers are `sentencepiece`, so you can use `ctranslate2` directly instead of through `quickmt`. It is also possible to get this model to work with e.g. [LibreTranslate](https://libretranslate.com/) which also uses `ctranslate2` and `sentencepiece`. A model in safetensors format to be used with `eole` is also provided. |
|
|
|
|
|
|
|
|
## Metrics |
|
|
|
|
|
`bleu` and `chrf2` are calculated with [sacrebleu](https://github.com/mjpost/sacrebleu) on the [Flores200 `devtest` test set](https://huggingface.co/datasets/facebook/flores) ("isl_Latn"->"eng_Latn"). `comet22` with the [`comet`](https://github.com/Unbabel/COMET) library and the [default model](https://huggingface.co/Unbabel/wmt22-comet-da). "Time (s)" is the time in seconds to translate the flores-devtest dataset (1012 sentences) on an RTX 4070s GPU with batch size 32. |
|
|
|
|
|
|
|
|
| | bleu | chrf2 | comet22 | Time (s) | |
|
|
|:---------------------------------|-------:|--------:|----------:|-----------:| |
|
|
| quickmt/quickmt-is-en | 34.76 | 60.13 | 85.39 | 1.22 | |
|
|
| Helsinki-NLP/opus-mt-is-en | 25.91 | 52.03 | 79.99 | 3.5 | |
|
|
| facebook/nllb-200-distilled-600M | 30.13 | 54.77 | 82.23 | 21.3 | |
|
|
| facebook/nllb-200-distilled-1.3B | 33.71 | 57.73 | 84.71 | 37.21 | |
|
|
| facebook/m2m100_418M | 20.38 | 46.47 | 70.95 | 18.8 | |
|
|
| facebook/m2m100_1.2B | 28.89 | 54.54 | 81.09 | 34.72 | |
