How to use FacebookAI/xlm-roberta-large with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="FacebookAI/xlm-roberta-large")
# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("FacebookAI/xlm-roberta-large") model = AutoModelForMaskedLM.from_pretrained("FacebookAI/xlm-roberta-large")
Adds TF weights. Validated by the pt_to_tf CLI: crossload_diff=2.956390380859375e-05, converted_diff=2.956390380859375e-05
pt_to_tf
Very cool!
· Sign up or log in to comment
