Vlasta
/

TEST_TOKENIZER_LIM

Model card Files Files and versions

TEST_TOKENIZER_LIM / tokenizer_config.json

Vlasta's picture

add tokenizer

753c490 over 3 years ago

history blame contribute delete

51 Bytes

	{
	"tokenizer_class": "PreTrainedTokenizerFast"
	}