CatBarks
/

GPT2ES_ClassWeighted10_tokenizer

Model card Files Files and versions

GPT2ES_ClassWeighted10_tokenizer / added_tokens.json

CatBarks's picture

Upload tokenizer

281438c verified about 2 years ago

history blame contribute delete

57 Bytes

	{
	"<EOS>": 50258,
	"<PAD>": 50259,
	"<SOS>": 50257
	}