davaa33
/

joint_tokenizer

Model card Files Files and versions

joint_tokenizer / added_tokens.json

davaa33's picture

Upload tokenizer

14f32e9 verified 3 months ago

history blame contribute delete

76 Bytes

	{
	"<pad>": 32002,
	"[CLS]": 32000,
	"[MASK]": 32003,
	"[SEP]": 32001
	}