Spaces:

1c1
/

Hh

Runtime error

App Files Files Community

Hh / tokenizer /tokenizer_config.json

1c1's picture

Create tokenizer/tokenizer_config.json

692417a verified about 1 month ago

history blame contribute delete

99 Bytes

	{
	"model_type": "dummy",
	"unk_token": "[UNK]",
	"bos_token": "[BOS]",
	"eos_token": "[EOS]"
	}