dnakov
/

nanochat-d20

Text Generation

Model card Files Files and versions

nanochat-d20 / tokenizer_config.json

dnakov's picture

Add tokenizer_config.json to specify PreTrainedTokenizerFast

864a063 verified 3 months ago

history blame contribute delete

50 Bytes

	{
	"tokenizer_class": "PreTrainedTokenizerFast"
	}