CatBarks
/

GPT2ES_ClassWeighted01_tokenizer

Model card Files Files and versions

GPT2ES_ClassWeighted01_tokenizer / added_tokens.json

CatBarks's picture

Upload tokenizer

8ebb30e verified about 2 years ago

history blame contribute delete

57 Bytes

	{
	"<EOS>": 50258,
	"<PAD>": 50259,
	"<SOS>": 50257
	}