zluvolyote
/

S288C_WordPiece_Tokenizer_k6

Model card Files Files and versions

S288C_WordPiece_Tokenizer_k6 / special_tokens_map.json

zluvolyote's picture

add tokenizer

4d0dfdd almost 4 years ago

history blame contribute delete

53 Bytes

	{
	"mask_token": "[MASK]",
	"pad_token": "[PAD]"
	}