Leonis Embedder β€” multilingual-e5-base (int8 ONNX)

On-device query embedder for the Leonis AI maritime assistant (Android). This is intfloat/multilingual-e5-base exported to ONNX and dynamically quantized to int8, paired with a SentencePiece tokenizer baked into an onnxruntime-extensions graph so the model takes a raw "query: …" string.

It must match the model the desktop app indexes passages with, so query and passage vectors share one 768-dim space.

File Size Purpose
model_int8.onnx ~278 MB e5-base int8 encoder β†’ last_hidden_state
tokenizer.onnx ~5 MB SentencePiece tokenizer (string β†’ token ids)

Pipeline: "query: " + text β†’ tokenizer.onnx β†’ model_int8.onnx β†’ mean-pool (attention mask) β†’ L2-normalize β†’ 768-dim unit vector.

Verified parity vs the desktop sentence-transformers embedder: cosine 0.974–0.983 (full int8 chain), 1.000 for the fp32 export.

License: MIT (inherits from the base model).

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Leonorog/Leonis-Embedder-e5

Quantized
(265)
this model