hf-internal-testing
/

test_dynamic_tokenizer

Model card Files Files and versions

test_dynamic_tokenizer / vocab.txt

sgugger's picture

Initial commit

08a3578 about 4 years ago

history blame contribute delete

40 Bytes

	[UNK]
	[CLS]
	[SEP]
	[PAD]
	[MASK]
	bla
	blou