2212/2212.01936.md

Title: Democratizing Machine Translation with OPUS-MT

URL Source: https://arxiv.org/html/2212.01936

Markdown Content: \jyear 2021

[1,2]\fnm First \sur Author

\equalcont These authors contributed equally to this work.

\equalcont These authors contributed equally to this work.

[1]\orgdiv Department, \orgname Organization, \orgaddress\street Street, \city City, \postcode 100190, \state State, \country Country

2]\orgdiv Department, \orgname Organization, \orgaddress\street Street, \city City, \postcode 10587, \state State, \country Country

3]\orgdiv Department, \orgname Organization, \orgaddress\street Street, \city City, \postcode 610101, \state State, \country Country

Abstract

This paper presents the OPUS ecosystem ….

keywords:

keyword1, Keyword2, Keyword3, Keyword4

1 Introduction

2 The Open Parallel Data Corpus OPUS

2.1 Finding Data Sets using the OPUS-API

2.2 Fetching and Processing Parallel Data with OpusTools

2.3 Cleaning and Preparing Data Sets with OpusFilter

3 Open Machine Translation with OPUS-MT

3.1 Training Pipelines

3.2 Machine Translation Server Applications

3.3 Platform Integration

3.4 Professional Workflows with OPUS-CAT

4 Benchmarks and Evaluation

4.1 Wide-Coverage Test Sets

4.2 The OPUS-MT Leader Board

4.3 Monitoring Language Coverage

5 Scaling-Up and Scaling-Down

5.1 Modular NMT

5.2 Knowledge Distillation

6 Conclusions and Future Work

7 Introduction

The Introduction section, of referenced text bib1 expands on the background of the work (some overlap with the Abstract is acceptable). The introduction should not include subheadings.

Springer Nature does not impose a strict layout as standard however authors are advised to check the individual requirements for the journal they are planning to submit to as there may be journal-level preferences. When preparing your text please also be aware that some stylistic choices are not supported in full text XML (publication version), including coloured font. These will not be replicated in the typeset article if it is accepted.

8 Results

Sample body text. Sample body text. Sample body text. Sample body text. Sample body text. Sample body text. Sample body text. Sample body text.

9 This is an example for first level head—section head

9.1 This is an example for second level head—subsection head

9.1.1 This is an example for third level head—subsubsection head

Sample body text. Sample body text. Sample body text. Sample body text. Sample body text. Sample body text. Sample body text. Sample body text.

10 Equations

Equations in L A T E X can either be inline or on-a-line by itself (“display equations”). For inline equations use the $...$ commands. E.g.: The equation H⁢ψ=E⁢ψ 𝐻 𝜓 𝐸 𝜓 H\psi=E\psi italic_H italic_ψ = italic_E italic_ψ is written via the command $H \psi = E \psi$.

For display equations (with auto generated equation numbers) one can use the equation or align environments:

‖X⁢(k)‖2≤∑i=1 p‖Yi⁢(k)‖2+∑j=1 q‖Zj⁢(k)‖2 p+q.superscript norm𝑋 𝑘 2 superscript subscript 𝑖 1 𝑝 superscript norm subscript𝑌 𝑖 𝑘 2 superscript subscript 𝑗 1 𝑞 superscript norm subscript𝑍 𝑗 𝑘 2 𝑝 𝑞|\tilde{X}(k)|^{2}\leq\frac{\sum\limits_{i=1}^{p}\left|\tilde{Y}{i}(k)% \right|^{2}+\sum\limits{j=1}^{q}\left|\tilde{Z}_{j}(k)\right|^{2}}{p+q}.∥ over~ start_ARG italic_X end_ARG ( italic_k ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ divide start_ARG ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_p end_POSTSUPERSCRIPT ∥ over~ start_ARG italic_Y end_ARG start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ( italic_k ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_q end_POSTSUPERSCRIPT ∥ over~ start_ARG italic_Z end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ( italic_k ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG start_ARG italic_p + italic_q end_ARG .(1)

where,

D μ subscript 𝐷 𝜇\displaystyle D_{\mu}italic_D start_POSTSUBSCRIPT italic_μ end_POSTSUBSCRIPT=∂μ−i⁢g⁢λ a 2⁢A μ a absent subscript 𝜇 𝑖 𝑔 superscript 𝜆 𝑎 2 subscript superscript 𝐴 𝑎 𝜇\displaystyle=\partial_{\mu}-ig\frac{\lambda^{a}}{2}A^{a}{\mu}= ∂ start_POSTSUBSCRIPT italic_μ end_POSTSUBSCRIPT - italic_i italic_g divide start_ARG italic_λ start_POSTSUPERSCRIPT italic_a end_POSTSUPERSCRIPT end_ARG start_ARG 2 end_ARG italic_A start_POSTSUPERSCRIPT italic_a end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_μ end_POSTSUBSCRIPT F μ⁢ν a subscript superscript 𝐹 𝑎 𝜇 𝜈\displaystyle F^{a}{\mu\nu}italic_F start_POSTSUPERSCRIPT italic_a end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_μ italic_ν end_POSTSUBSCRIPT=∂μ A ν a−∂ν A μ a+g⁢f a⁢b⁢c⁢A μ b⁢A ν a absent subscript 𝜇 subscript superscript 𝐴 𝑎 𝜈 subscript 𝜈 subscript superscript 𝐴 𝑎 𝜇 𝑔 superscript 𝑓 𝑎 𝑏 𝑐 subscript superscript 𝐴 𝑏 𝜇 subscript superscript 𝐴 𝑎 𝜈\displaystyle=\partial_{\mu}A^{a}{\nu}-\partial{\nu}A^{a}{\mu}+gf^{abc}A^{b% }{\mu}A^{a}_{\nu}= ∂ start_POSTSUBSCRIPT italic_μ end_POSTSUBSCRIPT italic_A start_POSTSUPERSCRIPT italic_a end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_ν end_POSTSUBSCRIPT - ∂ start_POSTSUBSCRIPT italic_ν end_POSTSUBSCRIPT italic_A start_POSTSUPERSCRIPT italic_a end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_μ end_POSTSUBSCRIPT + italic_g italic_f start_POSTSUPERSCRIPT italic_a italic_b italic_c end_POSTSUPERSCRIPT italic_A start_POSTSUPERSCRIPT italic_b end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_μ end_POSTSUBSCRIPT italic_A start_POSTSUPERSCRIPT italic_a end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_ν end_POSTSUBSCRIPT(2)

Notice the use of \nonumber in the align environment at the end of each line, except the last, so as not to produce equation numbers on lines where no equation numbers are required. The \label{} command should only be used at the last line of an align environment where \nonumber is not used.

Y∞=(m GeV)−3⁢[1+3⁢ln⁡(m/GeV)15+ln⁡(c 2/5)15]subscript 𝑌 superscript 𝑚 GeV 3 delimited-[]1 3 𝑚 GeV 15 subscript 𝑐 2 5 15 Y_{\infty}=\left(\frac{m}{\textrm{GeV}}\right)^{-3}\left[1+\frac{3\ln(m/% \textrm{GeV})}{15}+\frac{\ln(c_{2}/5)}{15}\right]italic_Y start_POSTSUBSCRIPT ∞ end_POSTSUBSCRIPT = ( divide start_ARG italic_m end_ARG start_ARG GeV end_ARG ) start_POSTSUPERSCRIPT - 3 end_POSTSUPERSCRIPT 1 + divide start_ARG 3 roman_ln ( italic_m / GeV ) end_ARG start_ARG 15 end_ARG + divide start_ARG roman_ln ( italic_c start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT / 5 ) end_ARG start_ARG 15 end_ARG

The class file also supports the use of \mathbb{}, \mathscr{} and \mathcal{} commands. As such \mathbb{R}, \mathscr{R} and \mathcal{R} produces ℝ ℝ\mathbb{R}blackboard_R, ℛ ℛ\mathscr{R}script_R and ℛ ℛ\mathcal{R}caligraphic_R respectively (refer Subsubsection9.1.1).

11 Tables

Tables can be inserted via the normal table and tabular environment. To put footnotes inside tables you should use \footnotetext[]{...} tag. The footnote appears just below the table itself (refer Tables1 and 2). For the corresponding footnotemark use \footnotemark[...]

Table 1: Caption text

0 0 footnotetext: Source: This is an example of table footnote. This is an example of table footnote. The input format for the above table is as follows:

\begin{table}[] \begin{center} \begin{minipage}{} \caption{}\label{}% \begin{tabular}{@{}llll@{}} \toprule Column 1 & Column 2 & Column 3 & Column 4\ \midrule row 1 & data 1 & data 2Ψ & data 3 \ row 2 & data 4 & data 5\footnotemark[1] & data 6 \ row 3 & data 7 & data 8Ψ & data 9\footnotemark[2]\ \botrule \end{tabular} \footnotetext{Source: This is an example of table footnote. This is an example of table footnote.} \footnotetext[1]{Example for a first table footnote. This is an example of table footnote.} \footnotetext[2]{Example for a second table footnote. This is an example of table footnote.} \end{minipage} \end{center} \end{table}

Table 2: Example of a lengthy table which is set to full textwidth

Element 1 1 1 1 Example for a first table footnote.Element 2 2 2 2 Example for a second table footnote. Project Energy σ c⁢a⁢l⁢c subscript 𝜎 𝑐 𝑎 𝑙 𝑐\sigma_{calc}italic_σ start_POSTSUBSCRIPT italic_c italic_a italic_l italic_c end_POSTSUBSCRIPT σ e⁢x⁢p⁢t subscript 𝜎 𝑒 𝑥 𝑝 𝑡\sigma_{expt}italic_σ start_POSTSUBSCRIPT italic_e italic_x italic_p italic_t end_POSTSUBSCRIPT Energy σ c⁢a⁢l⁢c subscript 𝜎 𝑐 𝑎 𝑙 𝑐\sigma_{calc}italic_σ start_POSTSUBSCRIPT italic_c italic_a italic_l italic_c end_POSTSUBSCRIPT σ e⁢x⁢p⁢t subscript 𝜎 𝑒 𝑥 𝑝 𝑡\sigma_{expt}italic_σ start_POSTSUBSCRIPT italic_e italic_x italic_p italic_t end_POSTSUBSCRIPT Element 3 990 A 1168 1547±12 plus-or-minus 1547 12 1547\pm 12 1547 ± 12 780 A 1166 1239±100 plus-or-minus 1239 100 1239\pm 100 1239 ± 100 Element 4 500 A 961 922±10 plus-or-minus 922 10 922\pm 10 922 ± 10 900 A 1268 1092±40 plus-or-minus 1092 40 1092\pm 40 1092 ± 40 \botrule 0 0 footnotetext: Note: This is an example of table footnote. This is an example of table footnote this is an example of table footnote this is an example of table footnote this is an example of table footnote. In case of double column layout, tables which do not fit in single column width should be set to full text width. For this, you need to use \begin{table*}``...``\end{table*} instead of \begin{table}``...``\end{table} environment. Lengthy tables which do not fit in textwidth should be set as rotated table. For this, you need to use \begin{sidewaystable}``...``\end{sidewaystable} instead of \begin{table*}``...``\end{table*} environment. This environment puts tables rotated to single column width. For tables rotated to double column width, use \begin{sidewaystable*}``...``\end{sidewaystable*}.

\sidewaystablefn

Table 3: Tables which are too long to fit, should be written using the “sidewaystable” environment as shown here

Element 1 1 1 1 This is an example of table footnote.Element 2 2 footnotemark: 2 Projectile Energy σ c⁢a⁢l⁢c subscript 𝜎 𝑐 𝑎 𝑙 𝑐\sigma_{calc}italic_σ start_POSTSUBSCRIPT italic_c italic_a italic_l italic_c end_POSTSUBSCRIPT σ e⁢x⁢p⁢t subscript 𝜎 𝑒 𝑥 𝑝 𝑡\sigma_{expt}italic_σ start_POSTSUBSCRIPT italic_e italic_x italic_p italic_t end_POSTSUBSCRIPT Energy σ c⁢a⁢l⁢c subscript 𝜎 𝑐 𝑎 𝑙 𝑐\sigma_{calc}italic_σ start_POSTSUBSCRIPT italic_c italic_a italic_l italic_c end_POSTSUBSCRIPT σ e⁢x⁢p⁢t subscript 𝜎 𝑒 𝑥 𝑝 𝑡\sigma_{expt}italic_σ start_POSTSUBSCRIPT italic_e italic_x italic_p italic_t end_POSTSUBSCRIPT Element 3 990 A 1168 1547±12 plus-or-minus 1547 12 1547\pm 12 1547 ± 12 780 A 1166 1239±100 plus-or-minus 1239 100 1239\pm 100 1239 ± 100 Element 4 500 A 961 922±10 plus-or-minus 922 10 922\pm 10 922 ± 10 900 A 1268 1092±40 plus-or-minus 1092 40 1092\pm 40 1092 ± 40 Element 5 990 A 1168 1547±12 plus-or-minus 1547 12 1547\pm 12 1547 ± 12 780 A 1166 1239±100 plus-or-minus 1239 100 1239\pm 100 1239 ± 100 Element 6 500 A 961 922±10 plus-or-minus 922 10 922\pm 10 922 ± 10 900 A 1268 1092±40 plus-or-minus 1092 40 1092\pm 40 1092 ± 40 \botrule 0 0 footnotetext: Note: This is an example of table footnote this is an example of table footnote this is an example of table footnote this is an example of table footnote this is an example of table footnote.

12 Figures

As per the L A T E X standards you need to use eps images for L A T E X compilation and pdf/jpg/png images for PDFLaTeX compilation. This is one of the major difference between L A T E X and PDFLaTeX. Each image should be from a single input .eps/vector image file. Avoid using subfigures. The command for inserting images for L A T E X and PDFLaTeX can be generalized. The package used to insert images in LaTeX/PDFLaTeX is the graphicx package. Figures can be inserted via the normal figure environment as shown in the below example:

\begin{figure}[] \centering \includegraphics{} \caption{}\label{} \end{figure}

Figure 1: This is a widefig. This is an example of long caption this is an example of long caption this is an example of long caption this is an example of long caption

In case of double column layout, the above format puts figure captions/images to single column width. To get spanned images, we need to provide \begin{figure*}``...``\end{figure*}.

For sample purpose, we have included the width of images in the optional argument of \includegraphics tag. Please ignore this.

13 Algorithms, Program codes and Listings

Packages algorithm, algorithmicx and algpseudocode are used for setting algorithms in L A T E X using the format:

\begin{algorithm} \caption{}\label{} \begin{algorithmic}[1] . . . \end{algorithmic} \end{algorithm}

You may refer above listed package documentations for more details before setting algorithm environment. For program codes, the “program” package is required and the command to be used is \begin{program}``...``\end{program}. A fast exponentiation procedure:

• =+begin for=+i:=1 assign 𝑖 1 i:=1 italic_i := 1@ifatmargin⁢𝗍𝗈⁢ 10@ifatmargin 𝗍𝗈 10@ifatmargin\ \mbox{\rm\bf\sf to}\ 10 to 10@ifatmargin⁢𝗌𝗍𝖾𝗉⁢ 1@ifatmargin 𝗌𝗍𝖾𝗉 1@ifatmargin\ \mbox{\rm\bf\sf step}\ 1 step 1@ifatmargin⁢𝖽𝗈@ifatmargin 𝖽𝗈@ifatmargin\ \mbox{\rm\bf\sf do}\ do