File size: 155 Bytes
4387ce7 | 1 2 3 4 5 | from transformers import BertTokenizer
tokenizer = BertTokenizer.from_pretrained("bert-base-uncased")
tokenizer.save_pretrained("path_to_save_tokenizer")
|
4387ce7 | 1 2 3 4 5 | from transformers import BertTokenizer
tokenizer = BertTokenizer.from_pretrained("bert-base-uncased")
tokenizer.save_pretrained("path_to_save_tokenizer")
|