How to use distilbert/distilbert-base-cased with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="distilbert/distilbert-base-cased")
# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("distilbert/distilbert-base-cased") model = AutoModelForMaskedLM.from_pretrained("distilbert/distilbert-base-cased")
Update link to the distillation process
Thanks for fixing!
· Sign up or log in to comment