DistilBERT
Collection
Smaller BERT models for question answering and text classification • 10 items • Updated
How to use Intel/distilbert-base-uncased-sparse-80-1x4-block-pruneofa with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="Intel/distilbert-base-uncased-sparse-80-1x4-block-pruneofa") # Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("Intel/distilbert-base-uncased-sparse-80-1x4-block-pruneofa")
model = AutoModelForMaskedLM.from_pretrained("Intel/distilbert-base-uncased-sparse-80-1x4-block-pruneofa")No model card