intextus/answerai-colbert-small-v1-onnx
This repository contains the ONNX version of answerdotai/answerai-colbert-small-v1 exported specifically for the intextus accelerated C++ late-interaction engine.
Model Details
- Base Model:
answerdotai/answerai-colbert-small-v1 - Output Embedding Dimension: 96
- Opset Version: 18
- Exported using: PyTorch ONNX Dynamo Exporter
Usage with Intextus
from intextus import LateInteractionEncoder
model = LateInteractionEncoder("intextus/answerai-colbert-small-v1-onnx")
q = model.encode_queries("What is late interaction?")
d = model.encode_docs("ColBERT uses late interaction with token-level representation.")
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support