Initial commit

.gitattributes

@@ -25,3 +25,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zstandard filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.bin filter=lfs diff=lfs merge=lfs -text
+sp_m.model filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,56 @@
----
-license: mit
----
+---
+language: 
+- ca
+- en
+
+tags:
+- translation
+- opennmt
+
+license: mit
+metrics:
+- bleu
+---
+
+### Introduction
+
+English - Catalan translation models based on OpenNMT.
+
+### Usage
+
+
+```pip3 install ctranslate2 pyonmttok```
+
+Simple translation using Python:
+
+```python
+
+import ctranslate2
+translator = ctranslate2.Translator("ctranslate2/")
+translator.translate_batch([["▁Hello", "▁world", "!"]])
+[[{'tokens': ['▁Hola', '▁món', '!']}]]
+
+```
+
+Simple tokenization & translation using Python:
+
+
+```python
+
+import pyonmttok
+tokenizer=pyonmttok.Tokenizer(mode="none", sp_model_path = "tokenizer/sp_m.model")
+tokenized=tokenizer.tokenize("Hello world!")
+
+import ctranslate2
+translator = ctranslate2.Translator("ctranslate2/")
+translated = translator.translate_batch([tokenized[0]])
+print(tokenizer.detokenize(translated[0][0]['tokens']))
+Hola món!
+```
+
+## Benchmarks
+
+| testset               | BLEU  |
+|-----------------------|-------|
+| Tatoeba-test.zho.eng 	| 45.2	|
+

model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc75eff7e5976b04ea15c0bc5232989bda1e29234e6b7d3b9bd8d0b827f93f09
+size 122582230

sp_m.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4d30a95cc16610280dbce9f2802532a7441b608f12442fddace6de93ae52477
+size 1146685