davaa33
/

mns_tokenizer_normalized

Model card Files Files and versions

mns_tokenizer_normalized / added_tokens.json

davaa33's picture

Upload tokenizer

c470a98 verified 5 months ago

history blame contribute delete

38 Bytes

	{
	"<pad>": 8000,
	"[MASK]": 8001
	}