lightonai

/

ColBERT-Zero-unsupervised-noprompts

like 0

Follow

LightOn AI 773

Hello!

As of Sentence Transformers v6.0.0, this checkpoint loads directly as a multi-vector (ColBERT-style late interaction) retriever through the new MultiVectorEncoder. This PR adds a usage section to the model card and the multi-vector tag. The weights and the existing files are untouched.

from sentence_transformers import MultiVectorEncoder

model = MultiVectorEncoder("lightonai/ColBERT-Zero-unsupervised-noprompts")

query = "What is the capital of France?"
documents = [
    "Paris is the capital and largest city of France.",
    "Berlin is the capital of Germany.",
]

query_embeddings = model.encode_query(query)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings[0].shape)
# torch.Size([10, 128]) torch.Size([12, 128])

# MaxSim late-interaction scoring (higher is more relevant)
scores = model.similarity(query_embeddings, document_embeddings)
print(scores)
# tensor([[7.2047, 5.4773]], device='cuda:0')

Verified against a PyLate reference: the snippet reproduces exactly, and the token embeddings match with per-token cosine similarity above 0.999 and matching MaxSim scores. For reference, loaded through this integration the model scores 0.6430 mean nDCG@10 on NanoBEIR.

• Tom Aarsen