eriktks/conll2003
Updated • 37.3k • 167
How to use webmichaelnosenko/rust-bert-base-NER with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("token-classification", model="webmichaelnosenko/rust-bert-base-NER") # Load model directly
from transformers import AutoTokenizer, AutoModelForTokenClassification
tokenizer = AutoTokenizer.from_pretrained("webmichaelnosenko/rust-bert-base-NER")
model = AutoModelForTokenClassification.from_pretrained("webmichaelnosenko/rust-bert-base-NER")This is a rust-adapted ready to use version of https://huggingface.co/dslim/bert-base-NER
I've generated the rust_model.ot file using the convert_model.py script provided by the rust_bert crate