sentence-transformers
ONNX
Safetensors
English
bert
ColBERT
multi-vector
RAGatouille
passage-retrieval
Instructions to use answerdotai/answerai-colbert-small-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use answerdotai/answerai-colbert-small-v1 with sentence-transformers:
from sentence_transformers import MultiVectorEncoder model = MultiVectorEncoder("answerdotai/answerai-colbert-small-v1") queries = ["Which planet is known as the Red Planet?"] documents = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", ] query_embeddings = model.encode_query(queries) document_embeddings = model.encode_document(documents) similarities = model.similarity(query_embeddings, document_embeddings) print(similarities) - Notebooks
- Google Colab
- Kaggle
Onnx models lack linear layer
#6
by jmzzomg - opened
Models in onnx directory produce outputs of shape (x, 384) instead of (x, 96), like with the torch counterpart.
However, vespa_colbert.onnx produce outputs of the correct shape
Is it a bug, or is it supposed to be this way?
Thank you
Whoops no this isn't intended behaviour! My guess as to what happened is that @Xenova converted the weights as a normal BERTModel, without wrapping the linear downcasting layer at the end. Can you confirm @Xenova ? Is there any way I can assist you in generating proper ones?
Thanks for flagging @jmzzomg !