sgugger
/

my-new-shiny-tokenizer

Model card Files Files and versions

my-new-shiny-tokenizer / tokenizer.json

sgugger's picture

add tokenizer

ec1d381 about 5 years ago

History Contribute Delete

676 kB

File too large to display, you can check the raw version instead.