jrc2139/e5-large-v2-ONNX

ONNX Quantized versions of intfloat/e5-large-v2

This repository contains ONNX export and multiple quantized versions of intfloat/e5-large-v2.

Usage

from sentence_transformers import SentenceTransformer

# Load Int8 model (ARM64 example)
model = SentenceTransformer(
    "jrc2139/granite-embedding-small-english-r2-onnx",
    backend="onnx",
    model_kwargs={"file_name": "onnx/model_qint8_arm64.onnx"},
    trust_remote_code=True
)