colbertv2.0-onnx / README.md
thlurte's picture
Upload folder using huggingface_hub
54742e4 verified
|
Raw
History Blame Contribute Delete
747 Bytes
---
library_name: intextus
tags:
- late-interaction
- colbert
- onnx
- onnxruntime
- text-embeddings
---
# intextus/colbertv2.0-onnx
This repository contains the ONNX version of `colbert-ir/colbertv2.0` exported specifically for the `intextus` accelerated C++ late-interaction engine.
## Model Details
- **Base Model:** `colbert-ir/colbertv2.0`
- **Output Embedding Dimension:** 128
- **Opset Version:** 18
- **Exported using:** PyTorch ONNX Dynamo Exporter
## Usage with Intextus
```python
from intextus import LateInteractionEncoder
model = LateInteractionEncoder("intextus/colbertv2.0-onnx")
q = model.encode_queries("What is late interaction?")
d = model.encode_docs("ColBERT uses late interaction with token-level representation.")
```