hmteams
/

teams-tokenizer

Model card Files Files and versions

teams-tokenizer / tokenizer_config.json

stefan-it's picture

tokenizer: add config and vocab

26db266 over 2 years ago

history blame contribute delete

60 Bytes

	{"do_lower_case": false, "max_len": 512, "init_inputs": []}