flaitenberger/wnut_17
Viewer • Updated • 5.69k • 144 • 1
How to use sbartlett97/distilbert-ner-finetune with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("token-classification", model="sbartlett97/distilbert-ner-finetune") # Load model directly
from transformers import AutoTokenizer, AutoModelForTokenClassification
tokenizer = AutoTokenizer.from_pretrained("sbartlett97/distilbert-ner-finetune")
model = AutoModelForTokenClassification.from_pretrained("sbartlett97/distilbert-ner-finetune")distilbert finetune for NER task on wnut_17 dataset.
Metrics:
{
'eval_loss': 0.3013164699077606,
'eval_precision': 0.5748987854251012,
'eval_recall': 0.3948100092678406,
'eval_f1': 0.46813186813186813,
'eval_accuracy': 0.9475439271514685,
'eval_runtime': 6.3283,
'eval_samples_per_second': 203.372,
'eval_steps_per_second': 25.441,
'epoch': 4.0
}
Base model
distilbert/distilbert-base-uncased