File size: 109 Bytes
2ab6482
 
1
2
tokenizer = T5Tokenizer.from_pretrained("t5-small")
tokenizer.save_pretrained("/Users/airalex/Documents/LLM")