TyKaoz/bge-m3-8bit

BGE-M3 — 8-bit MLX

8-bit MLX quantization of BAAI/bge-m3, for Apple Silicon (~592 MB). Multilingual text-embedding model (1024-dim dense vectors).

Usage

pip install -U mlx-embeddings

from mlx_embeddings import load, generate

model, tokenizer = load("TyKaoz/bge-m3-8bit")
out = generate(model, tokenizer, texts=["Bonjour", "Hello", "你好"])
print(out.text_embeds.shape)  # (3, 1024)

Base	Tool	Precision	Size
BAAI/bge-m3	mlx-embeddings	8-bit · group 64	~592 MB

By TyKaoz — privacy-first native macOS LLM chat client. Apache 2.0, inherited from the base model.