How to use tasksource/tasksource-jev-nano-v1 with sentence-transformers:
from pylate import models queries = [ "Which planet is known as the Red Planet?", "What is the largest planet in our solar system?", ] documents = [ ["Mars is the Red Planet.", "Venus is Earth's twin."], ["Jupiter is the largest planet.", "Saturn has rings."], ] model = models.ColBERT(model_name_or_path="tasksource/tasksource-jev-nano-v1") queries_emb = model.encode(queries, is_query=True) docs_emb = model.encode(documents, is_query=False)
https://huggingface.co/tasksource/tasksource-jev-nano-v1/resolve/main/tokenizer.json
hf download hf://tasksource/tasksource-jev-nano-v1/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/tasksource/tasksource-jev-nano-v1/resolve/main/tokenizer.json
