opus-mt-ja-en-ct2

CTranslate2 int8 quantized conversion of Helsinki-NLP/opus-mt-ja-en, packaged for offline use in Playto.

Purpose

Lightweight Japanese → English NMT for the Playto desktop game-language-learning tool, used as a low-spec / no-GPU fallback when local LLM inference is not available.

Source model

• Upstream: Helsinki-NLP/opus-mt-ja-en — MarianMT, transformer-align architecture, OPUS dataset
• License: CC-BY 4.0
• No fine-tuning, no weight modification — purely a format conversion + int8 quantization of the upstream weights

Conversion

pip install ctranslate2 transformers sentencepiece
ct2-transformers-converter \
  --model Helsinki-NLP/opus-mt-ja-en \
  --output_dir opus-mt-ja-en-ct2 \
  --quantization int8 \
  --copy_files source.spm target.spm
tar czf opus-mt-ja-en-ct2.tar.gz opus-mt-ja-en-ct2

File layout (inside opus-mt-ja-en-ct2.tar.gz)

File	Size	Purpose
model.bin	~74 MB	CTranslate2 int8 quantized weights
shared_vocabulary.json	~1.2 MB	CTranslate2 vocab
source.spm	~780 KB	SentencePiece source tokenizer
target.spm	~800 KB	SentencePiece target tokenizer
config.json	~250 B	CTranslate2 config

Usage

With ctranslate2 (Python)

import ctranslate2
import sentencepiece

translator = ctranslate2.Translator("opus-mt-ja-en-ct2", device="cpu", compute_type="int8")
sp_source = sentencepiece.SentencePieceProcessor("opus-mt-ja-en-ct2/source.spm")
sp_target = sentencepiece.SentencePieceProcessor("opus-mt-ja-en-ct2/target.spm")

source_tokens = sp_source.encode("せっかくまた、なるほどくんに会えたのに", out_type=str) + ["</s>"]
results = translator.translate_batch([source_tokens])
print(sp_target.decode(results[0].hypotheses[0]))
# → "I can't believe I met you again."

With ct2rs (Rust)

use ct2rs::{Translator, Tokenizer};

let tokenizer = Tokenizer::new("opus-mt-ja-en-ct2")?;
let translator = Translator::with_tokenizer("opus-mt-ja-en-ct2", tokenizer, /* config */)?;
let result = translator.translate_batch(&["せっかくまた、なるほどくんに会えたのに".to_string()], /* options */)?;

Important: MarianMT models require </s> appended to source token sequences. The ct2rs::Tokenizer wrapper handles this automatically; raw SentencePiece calls must add it manually.

Quality

Evaluated on Playto's fixture corpus (= 55 ja→en game text samples across 7 games):

• ~73 % Good (= with per-line translation mode, Playto-internal eyeball judgment)
• See Playto NMT quality notes for game-text-specific characterization

Attribution

This is a derivative work of Helsinki-NLP/opus-mt-ja-en. License is CC-BY 4.0 inherited from upstream.

Helsinki-NLP. OPUS-MT — Open Machine Translation Models.
https://github.com/Helsinki-NLP/Opus-MT

Disclaimer

NMT output quality is significantly lower than modern LLM-based translation. This model is intended as a lightweight fallback for environments where LLM inference is not viable (= low VRAM, mobile, slow connection). For higher-quality translation, Playto's LLM-based translation path is recommended.