SEA-Embedding: Open and Reproducible Text Embeddings for Southeast Asia
Abstract
SEA-Embedding provides an open and reproducible text embedding solution for Southeast Asian languages with improved robustness through systematic analysis of data composition, training objectives, and encoder initialization.
Text embeddings are fundamental to many downstream applications, making robustness important for real-world NLP. However, most recent state-of-the-art embedding models are not reproducible because they rely on closed or undisclosed training data, and they remain insufficiently robust for Southeast Asian languages. We present SEA-Embedding, a fully open and reproducible text-embedding pipeline for Southeast Asian languages trained only on publicly available data, and use it to study three core factors of robust embedding design: data composition, training objective, and base encoder initialization. SEA-Embedding achieves state-of-the-art results on SEA-BED while enabling systematic and reproducible analysis of robust text embeddings for the region.
Get this paper in your agent:
hf papers read 2606.03027 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 3
aisingapore/SEA-LION-ModernBERT-Embedding-300M
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper