stefan-it
/

secret-gpt2-tokenizer

Text Generation

Model card Files Files and versions

secret-gpt2-tokenizer / tokenizer.json

stefan-it's picture

tokenizer: add new post processor: </s> is prepended to input sequence

3021b3d almost 3 years ago

history contribute delete

2.19 MB

File too large to display, you can check the raw version instead.