Papers
arxiv:2606.03027

SEA-Embedding: Open and Reproducible Text Embeddings for Southeast Asia

Published on Jun 2
Authors:
,
,
,

Abstract

SEA-Embedding provides an open and reproducible text embedding solution for Southeast Asian languages with improved robustness through systematic analysis of data composition, training objectives, and encoder initialization.

Text embeddings are fundamental to many downstream applications, making robustness important for real-world NLP. However, most recent state-of-the-art embedding models are not reproducible because they rely on closed or undisclosed training data, and they remain insufficiently robust for Southeast Asian languages. We present SEA-Embedding, a fully open and reproducible text-embedding pipeline for Southeast Asian languages trained only on publicly available data, and use it to study three core factors of robust embedding design: data composition, training objective, and base encoder initialization. SEA-Embedding achieves state-of-the-art results on SEA-BED while enabling systematic and reproducible analysis of robust text embeddings for the region.

Community

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2606.03027
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 3

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2606.03027 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2606.03027 in a Space README.md to link it from this page.

Collections including this paper 1