Instructions to use vocab-transformers/cross_encoder-msmarco-distilbert-word2vec256k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vocab-transformers/cross_encoder-msmarco-distilbert-word2vec256k with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="vocab-transformers/cross_encoder-msmarco-distilbert-word2vec256k")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("vocab-transformers/cross_encoder-msmarco-distilbert-word2vec256k") model = AutoModelForSequenceClassification.from_pretrained("vocab-transformers/cross_encoder-msmarco-distilbert-word2vec256k") - Notebooks
- Google Colab
- Kaggle
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
#cross_encoder-msmarco-word2vec256k
This CrossEncoder was trained with MarginMSE loss from the nicoladecao/msmarco-word2vec256000-distilbert-base-uncased checkpoint. Word embedding matrix has been frozen during training.
You can load the model with sentence-transformers:
from sentence_transformers import CrossEncoder
from torch import nn
model = CrossEncoder(model_name, default_activation_function=nn.Identity())
Performance on TREC Deep Learning (nDCG@10):
- TREC-DL 19: 72.49
- TREC-DL 20: 72.71
- Downloads last month
- 5