statmt/cc100
Updated โข 2.32k โข 106
How to use KoichiYasuoka/roberta-small-belarusian with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="KoichiYasuoka/roberta-small-belarusian") # Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("KoichiYasuoka/roberta-small-belarusian")
model = AutoModelForMaskedLM.from_pretrained("KoichiYasuoka/roberta-small-belarusian")This is a RoBERTa model pre-trained on CC-100. You can fine-tune roberta-small-belarusian for downstream tasks, such as POS-tagging, dependency-parsing, and so on.
from transformers import AutoTokenizer,AutoModelForMaskedLM
tokenizer=AutoTokenizer.from_pretrained("KoichiYasuoka/roberta-small-belarusian")
model=AutoModelForMaskedLM.from_pretrained("KoichiYasuoka/roberta-small-belarusian")