HERIT: Enabling Global Access to Hanja-to-English Historical Translation by Mitigating Temporal Bias
Abstract
HERIT adapts machine translation to historical archives via retrieval-augmented pseudo-labeling, improving accuracy across time periods and unlocking global access.
Historical archives are invaluable for multidisciplinary research but remain inaccessible globally due to severe language barriers. While manual translation is prohibitively expensive and time-consuming, simply applying existing machine translation models is inadequate due to unique linguistic nuances and the temporal bias inherent in scarce human-labeled corpora. To address these challenges, we propose HERIT, a systematic domain-adaptation pipeline that leverages retrieval-augmented generation (RAG) to generate high-quality pseudo-labeled data from abundant Hanja-Korean corpora. This approach substantially expands the training dataset, mitigating both data scarcity and temporal overfitting across different historical periods. Extensive automated and human evaluations demonstrate that HERIT consistently outperforms baselines. Finally, we translate previously untranslated portions of the archives using our model, thereby enabling global access to these resources for researchers.
Community
HERIT, a Hanja-English RAG-based Intelligent Translation model for historical archives, is a systematic domain-adaptation pipeline that leverages retrieval-augmented generation (RAG) to generate high-quality pseudo-labeled data from abundant Hanja-Korean corpora.
- High-Quality Synthetic Corpus: Scaled up domain-adapted Hanja–English parallel pairs using pseudo-labeling.
- Effective Two-Stage Scheduling: HERIT consistently outperforms human-only baselines across extensive evaluations.
- Mitigation of Temporal Bias: First to observe and address historical temporal bias in Hanja → English translation.
- Large-Scale Public Release: Fully translated 2.09M entries spanning the entire corpora of AJD and JRS.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Doc2FRC: Length-Consistent Document-Level Machine Translation via Fixed-Range Chunking (2026)
- COILD: An Indic-Centric Parallel Corpus and Benchmark for Machine Translation Across Indian Languages (2026)
- HeRE: A Novel Benchmark for Hebrew Relation Extraction via LLM-Guided Denoising of Knowledge Graph Alignments (2026)
- BaatCheet: A Multilingual Corpus for Dialogue Translation in Indian Languages (2026)
- Precision over Scale: A Polish–Silesian Benchmark and a Translation System Outperforming Open-Source and Commercial Models (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper