ZihanWangKi/conllpp
Updated • 1.14k • 17
How to use dayannex/distilbert-tuned-4labels with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("token-classification", model="dayannex/distilbert-tuned-4labels") # Load model directly
from transformers import AutoTokenizer, AutoModelForTokenClassification
tokenizer = AutoTokenizer.from_pretrained("dayannex/distilbert-tuned-4labels")
model = AutoModelForTokenClassification.from_pretrained("dayannex/distilbert-tuned-4labels")To train this model, the base model distilbert/distilbert-base-cased is used as a starting point, which is a reduced and optimized version of the original BERT model (google-bert/bert-base-cased) This model was trained from the conllpp dataset, updating the data to recognize date data and adding the B-DATE, I-DATE tags to the model