rg1683
/

hindi_bpe_tokenizer_mask

Model card Files Files and versions

hindi_bpe_tokenizer_mask / added_tokens.json

rg1683's picture

Upload tokenizer

796cb68 verified almost 2 years ago

history blame contribute delete

94 Bytes

	{
	"[CLS]": 50003,
	"[MASK]": 50004,
	"[PAD]": 50002,
	"[SEP]": 50001,
	"[UNK]": 50000
	}