Generated with:
from transformers import AutoTokenizer tokenizer = AutoTokenizer.from_pretrained("ai-forever/mGPT") assert tokenizer.is_fast tokenizer.save_pretrained("...")
· Sign up or log in to comment