nosuchjihyun
/

wirebert-tokenizer

Model card Files Files and versions

wirebert-tokenizer / added_tokens.json

nosuchjihyun's picture

Upload tokenizer

3e7d3c1 verified about 1 year ago

history blame contribute delete

29 Bytes

	{
	"<\|endoftext\|>": 32768
	}