Heimrih
/

code-tokenizer-0526

Model card Files Files and versions

code-tokenizer-0526 / special_tokens_map.json

Heimrih's picture

Upload tokenizer

cb6daee verified 8 months ago

history blame contribute delete

51 Bytes

	{
	"pad_token": "<pad>",
	"unk_token": "<unk>"
	}