tokenizer folder contains tokenizer.vocab and tokenizer.model trained using sentence piece.
ok
· Sign up or log in to comment
