Add files using upload-large-folder tool

packages/en_ar/README.md

@@ -0,0 +1,6 @@
+# English-Arabic
+
+Trained on [OpenSubtitles](opus.nlpl.eu/OpenSubtitles.php), and [UNPC](http://opus.nlpl.eu/UNPC.php) parallel corpuses compiled by [Opus](http://opus.nlpl.eu/index.php)
+
+Includes pretrained models from [Stanza](https://github.com/stanfordnlp/stanza/blob/master/LICENSE).
+

packages/en_ar/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.0",
+    "argos_version": "1.0",
+    "from_code": "en",
+    "from_name": "English",
+    "to_code": "ar",
+    "to_name": "Arabic"
+}

packages/en_es/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.0",
+    "argos_version": "1.0",
+    "from_code": "en",
+    "from_name": "English",
+    "to_code": "es",
+    "to_name": "Spanish"
+}

packages/en_uk/README.md

@@ -0,0 +1,25 @@
+# English-Ukranian
+
+Data compiled by [Opus](https://opus.nlpl.eu/).
+
+Dictionary data from Wiktionary using [Wiktextract](https://github.com/tatuylonen/wiktextract).
+
+Includes pretrained models from [Stanza](https://github.com/stanfordnlp/stanza/).
+
+Credits:
+Holger Schwenk, Vishrav Chaudhary, Shuo Sun, Hongyu Gong and Paco Guzman, WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia, arXiv, July 11 2019.
+
+J. Tiedemann, 2012, Parallel Data, Tools and Interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)
+
+@inproceedings{elkishky_ccaligned_2020,
+author = {El-Kishky, Ahmed and Chaudhary, Vishrav and Guzmán, Francisco and Koehn, Philipp},
+booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)},
+month = {November},
+title = {{CCAligned}: A Massive Collection of Cross-lingual Web-Document Pairs},
+year = {2020}
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://www.aclweb.org/anthology/2020.emnlp-main.480",
+doi = "10.18653/v1/2020.emnlp-main.480",
+pages = "5960--5969"
+}

packages/en_uk/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.4",
+    "argos_version": "1.4",
+    "from_code": "en",
+    "from_name": "English",
+    "to_code": "uk",
+    "to_name": "Ukranian"
+}

packages/ga_en/README.md

@@ -0,0 +1,13 @@
+# Irish-English
+
+Data compiled by [Opus](https://opus.nlpl.eu/).
+
+Dictionary data from Wiktionary using [Wiktextract](https://github.com/tatuylonen/wiktextract).
+
+Includes pretrained models from [Stanza](https://github.com/stanfordnlp/stanza/).
+
+Credits:
+Please, acknowledge the ParaCrawl project at http://paracrawl.eu. 
+
+J. Tiedemann, 2012, Parallel Data, Tools and Interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)
+

packages/ga_en/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.1",
+    "argos_version": "1.1",
+    "from_code": "ga",
+    "from_name": "Irish",
+    "to_code": "en",
+    "to_name": "English"
+}

packages/translate-ca_en-1_7/model/model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e94e77459539b21bca095374f2846ab3313b1c969b71009f449485bb8151752f
+size 80969273

packages/translate-en_da-1_9/README.md

@@ -0,0 +1,9 @@
+# English - Danish version 1.0
+
+Authors: Jörg Tiedemann and Santhosh Thottingal
+Title: "OPUS-MT — Building open translation services for the World"
+Book Title: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT)
+Year: 2020
+Location: Lisbon, Portugal
+
+The original OPUS model from which this packaged model is derived is licensed CC-BY 4.0

packages/translate-en_da-1_9/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.9",
+    "argos_version": "1.9.0",
+    "from_code": "en",
+    "from_name": "English",
+    "to_code": "da",
+    "to_name": "Danish"
+}

packages/translate-en_da-1_9/model/config.json

@@ -0,0 +1,10 @@
+{
+  "add_source_bos": false,
+  "add_source_eos": true,
+  "bos_token": "<s>",
+  "decoder_start_token": "<s>",
+  "eos_token": "</s>",
+  "layer_norm_epsilon": null,
+  "multi_query_attention": false,
+  "unk_token": "<unk>"
+}

packages/translate-en_fa-1_5/README.md

@@ -0,0 +1,26 @@
+# English-Persian
+
+Data compiled by [Opus](https://opus.nlpl.eu/).
+
+Dictionary data from Wiktionary using [Wiktextract](https://github.com/tatuylonen/wiktextract).
+
+Includes pretrained models from [Stanza](https://github.com/stanfordnlp/stanza/).
+
+Credits:
+
+Krzysztof Wołk and Krzysztof Marasek: Building Subject-aligned Comparable Corpora and Mining it for Truly Parallel Sentence Pairs., Procedia Technology, 18, Elsevier, p.126-132, 2014
+
+J. Tiedemann, 2012, Parallel Data, Tools and Interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)
+
+Holger Schwenk, Vishrav Chaudhary, Shuo Sun, Hongyu Gong and Paco Guzman, WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia, arXiv, July 11 2019.
+
+Kashefi, O. (2018). MIZAN: a large persian-english parallel corpus. Computing Research Repository, arXiv:1801.02107.
+
+El-Kishky, Ahmed and Renduchintala, Adi and Cross, James and Guzmán, Francisco and Koehn, Philipp - XLEnt: Mining Cross-lingual Entities with Lexical-Semantic-Phonetic Word Alignment
+
+El-Kishky, Ahmed and Chaudhary, Vishrav and Guzmán, Francisco and Koehn, Philipp - Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)
+
+P. Lison and J. Tiedemann, 2016, OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016)
+
+Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave, Armand Joulin and Angela Fan, CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB
+

packages/translate-en_fa-1_5/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.5",
+    "argos_version": "1.5",
+    "from_code": "en",
+    "from_name": "English",
+    "to_code": "fa",
+    "to_name": "Persian"
+}

packages/translate-en_he-1_5/README.md

@@ -0,0 +1,24 @@
+# English-Hebrew
+
+Data compiled by [Opus](https://opus.nlpl.eu/).
+
+Dictionary data from Wiktionary using [Wiktextract](https://github.com/tatuylonen/wiktextract).
+
+Includes pretrained models from [Stanza](https://github.com/stanfordnlp/stanza/).
+
+Credits:
+
+J. Tiedemann, 2012, Parallel Data, Tools and Interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)
+
+J. Tiedemann, 2012, Parallel Data, Tools and Interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)
+
+Holger Schwenk, Vishrav Chaudhary, Shuo Sun, Hongyu Gong and Paco Guzman, WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia, arXiv, July 11 2019.
+
+El-Kishky, Ahmed and Renduchintala, Adi and Cross, James and Guzmán, Francisco and Koehn, Philip - XLEnt: Mining Cross-lingual Entities with Lexical-Semantic-Phonetic Word Alignment
+
+El-Kishky, Ahmed and Chaudhary, Vishrav and Guzmán, Francisco and Koehn, Philip - ,Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)
+
+Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave, Armand Joulin and Angela Fan, CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB
+
+Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Edouard Grave, Michael Auli, and Armand Joulin. Beyond English-Centric Multilingual Machine Translation
+

packages/translate-en_he-1_5/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.5",
+    "argos_version": "1.5",
+    "from_code": "en",
+    "from_name": "English",
+    "to_code": "he",
+    "to_name": "Hebrew"
+}

packages/translate-en_nb-1_9/README.md

@@ -0,0 +1,10 @@
+# English - Norwegian version 1.9
+
+Authors: Jörg Tiedemann and Santhosh Thottingal
+Title: "OPUS-MT — Building open translation services for the World"
+Book Title: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT)
+Year: 2020
+Location: Lisbon, Portugal
+
+The original OPUS model from which this packaged model is derived is licensed CC-BY 4.0
+

packages/translate-en_nb-1_9/metadata.json

@@ -0,0 +1 @@
+{"package_version": "1.9", "argos_version": "1.9.0", "from_code": "en", "from_name": "English", "to_code": "nb", "to_name": "Norwegian"}

packages/translate-en_nb-1_9/model/config.json

@@ -0,0 +1,9 @@
+{
+    "add_source_bos": true,
+    "add_source_eos": true,
+    "bos_token": ">>nob<<",
+    "decoder_start_token": "<s>",
+    "eos_token": "</s>",
+    "layer_norm_epsilon": null,
+    "unk_token": "<unk>"
+}

packages/translate-en_pl-1_9/README.md

@@ -0,0 +1,9 @@
+# English - Polish version 1.9
+
+Authors: Jörg Tiedemann and Santhosh Thottingal
+Title: "OPUS-MT — Building open translation services for the World"
+Book Title: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT)
+Year: 2020
+Location: Lisbon, Portugal
+
+The original OPUS model from which this packaged model is derived is licensed CC-BY 4.0

packages/translate-en_pl-1_9/metadata.json

@@ -0,0 +1 @@
+{"package_version": "1.9", "argos_version": "1.9.0", "from_code": "en", "from_name": "English", "to_code": "pl", "to_name": "Polish"}

packages/translate-en_pl-1_9/model/config.json

@@ -0,0 +1,9 @@
+{
+  "add_source_bos": false,
+  "add_source_eos": true,
+  "bos_token": "<s>",
+  "decoder_start_token": "<s>",
+  "eos_token": "</s>",
+  "layer_norm_epsilon": null,
+  "unk_token": "<unk>"
+}

packages/translate-en_ro-1_9/README.md

@@ -0,0 +1,10 @@
+# English - Romanian version 1.9
+
+Authors: Jörg Tiedemann and Santhosh Thottingal
+Title: "OPUS-MT — Building open translation services for the World"
+Book Title: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT)
+Year: 2020
+Location: Lisbon, Portugal
+
+The original OPUS model from which this packaged model is derived is licensed CC-BY 4.0
+

packages/translate-en_ro-1_9/metadata.json

@@ -0,0 +1 @@
+{"package_version": "1.9", "argos_version": "1.9.0", "from_code": "en", "from_name": "English", "to_code": "ro", "to_name": "Romanian"}

packages/translate-en_ro-1_9/model/config.json

@@ -0,0 +1,9 @@
+{
+  "add_source_bos": false,
+  "add_source_eos": true,
+  "bos_token": "<s>",
+  "decoder_start_token": "<s>",
+  "eos_token": "</s>",
+  "layer_norm_epsilon": null,
+  "unk_token": "<unk>"
+}

packages/translate-en_vi-1_0/README.md

@@ -0,0 +1,9 @@
+# English - Vietnamese version 1.0
+
+Authors: Jörg Tiedemann and Santhosh Thottingal
+Title: "OPUS-MT — Building open translation services for the World"
+Book Title: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT)
+Year: 2020
+Location: Lisbon, Portugal
+
+The original OPUS model from which this packaged model is derived is licensed CC-BY 4.0

packages/translate-en_vi-1_0/metadata.json

@@ -0,0 +1 @@
+{"package_version": "1.0", "argos_version": "1.9.0", "from_code": "en", "from_name": "English", "to_code": "vi", "to_name": "Vietnamese"}

packages/translate-en_vi-1_0/model/config.json

@@ -0,0 +1,9 @@
+{
+    "add_source_bos": true,
+    "add_source_eos": true,
+    "bos_token": ">>vie<<",
+    "decoder_start_token": "<s>",
+    "eos_token": "</s>",
+    "layer_norm_epsilon": null,
+    "unk_token": "<unk>"
+}

packages/translate-eo_en-1_5/README.md

@@ -0,0 +1,20 @@
+# Esperanto-English
+
+Data compiled by [Opus](https://opus.nlpl.eu/).
+
+Dictionary data from Wiktionary using [Wiktextract](https://github.com/tatuylonen/wiktextract).
+
+Includes pretrained models from [Stanza](https://github.com/stanfordnlp/stanza/).
+
+Credits:
+
+J. Tiedemann, 2012, Parallel Data, Tools and Interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)
+
+P. Lison and J. Tiedemann, 2016, OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016)
+
+Holger Schwenk, Vishrav Chaudhary, Shuo Sun, Hongyu Gong and Paco Guzman, WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia, arXiv, July 11 2019.
+
+El-Kishky, Ahmed and Renduchintala, Adi and Cross, James and Guzmán, Francisco and Koehn, Philipp - XLEnt: Mining Cross-lingual Entities with Lexical-Semantic-Phonetic Word Alignment
+
+Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave, Armand Joulin and Angela Fan, CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB
+

packages/translate-eo_en-1_5/metadata.json

@@ -0,0 +1,8 @@
+{
+    "package_version": "1.5",
+    "argos_version": "1.5",
+    "from_code": "eo",
+    "from_name": "Esperanto",
+    "to_code": "en",
+    "to_name": "English"
+}