Hugging Face's logo

Matthijs0
/
DistilBERT

Question Answering
Transformers
Safetensors
distilbert
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("question-answering", model="Matthijs0/DistilBERT")
# Load model directly
from transformers import AutoTokenizer, AutoModelForQuestionAnswering

tokenizer = AutoTokenizer.from_pretrained("Matthijs0/DistilBERT")
model = AutoModelForQuestionAnswering.from_pretrained("Matthijs0/DistilBERT")
Quick Links

DistilBERT

The DistilBERT model is a BERT model fine-tuned on the NewsQA dataset.

Hyperparameters 

batch_size = 16
n_epochs = 3
max_seq_len = 512
learning_rate = 2e-5
optimizer=AdamW
lr_schedule = LinearWarmup
weight_decay=0.01
embeds_dropout_prob = 0.1
Downloads last month
7
Safetensors
Model size
66.4M params
Tensor type
F32
路
Inference Providers NEW
Question Answering
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support