Harrier-Arabic-Matryoshka-0.6B

A 0.6B-parameter Arabic sentence embedding model based on microsoft/harrier-oss-v1-0.6b, fine-tuned for Arabic semantic similarity with Matryoshka Representation Learning.

Matryoshka training was applied across the dimension ladder 1024 → 768 → 512 → 256 → 128 → 64, so you can truncate the output embedding to any of these sizes with minimal quality loss — useful for faster retrieval and lighter indexes.

Model details

Field	Value
Base model	`microsoft/harrier-oss-v1-0.6b`
Parameters	~0.6B
Full embedding dimension	1024
Matryoshka dims	1024, 768, 512, 256, 128, 64
Max sequence length	32,768
Pooling	inherited from base
Language	Arabic (cross-lingual capabilities inherited from base)

Usage

Standard (full 1024-dim embeddings)

from sentence_transformers import SentenceTransformer

model = SentenceTransformer(
    "Omartificial-Intelligence-Space/Harrier-Arabic-Matryoshka-0.6B",
    trust_remote_code=True,
)

sentences = [
    "تعلم اللغة العربية ممتع ومثير.",
    "دراسة العربية تجربة شيقة.",
    "القطط تحب اللعب في الحديقة.",
]

embeddings = model.encode(sentences, normalize_embeddings=True)
print(embeddings.shape)  # (3, 1024)

Truncated (Matryoshka) embeddings

Pick any dim from the ladder for smaller, faster vectors:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer(
    "Omartificial-Intelligence-Space/Harrier-Arabic-Matryoshka-0.6B",
    trust_remote_code=True,
    truncate_dim=256,  # one of: 1024, 768, 512, 256, 128, 64
)

embeddings = model.encode(["..."], normalize_embeddings=True)
print(embeddings.shape)  # (1, 256)

Cosine similarity

from sentence_transformers import SentenceTransformer
from sentence_transformers.util import cos_sim

model = SentenceTransformer(
    "Omartificial-Intelligence-Space/Harrier-Arabic-Matryoshka-0.6B",
    trust_remote_code=True,
)

a = model.encode("تعلم اللغة العربية ممتع ومثير.", normalize_embeddings=True)
b = model.encode("دراسة العربية تجربة شيقة.", normalize_embeddings=True)
print(cos_sim(a, b))

Intended use

Arabic semantic textual similarity
Arabic sentence/passage retrieval and re-ranking
Cross-lingual retrieval against the base model's supported languages
Clustering and deduplication of Arabic text

Citation

If you use this model, please cite the base model and Matryoshka Representation Learning:

@misc{harrieross,
  title  = {Harrier OSS v1},
  author = {Microsoft},
  url    = {https://huggingface.co/microsoft/harrier-oss-v1-0.6b}
}

@inproceedings{kusupati2022matryoshka,
  title     = {Matryoshka Representation Learning},
  author    = {Kusupati, Aditya and others},
  booktitle = {NeurIPS},
  year      = {2022}
}