IlyaGusev
/

rubert_telegram_headlines

encoder-decoder

text2text-generation

Model card Files Files and versions

IlyaGusev commited on Mar 16, 2021

Commit

a5db3b1

·

1 Parent(s): 8f3eeb4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -23,7 +23,7 @@ Based on [RuBERT](http://docs.deeppavlov.ai/en/master/features/models/bert.html)
 from transformers import AutoTokenizer, EncoderDecoderModel
 model_name = "IlyaGusev/rubert_telegram_headlines"
-tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = EncoderDecoderModel.from_pretrained(model_name)
 article_text = "..."

 from transformers import AutoTokenizer, EncoderDecoderModel
 model_name = "IlyaGusev/rubert_telegram_headlines"
+tokenizer = AutoTokenizer.from_pretrained(model_name, do_lower_case=False, do_basic_tokenize=False, strip_accents=False)
 model = EncoderDecoderModel.from_pretrained(model_name)
 article_text = "..."