michaelbzhu
/

test-3.2B-base

custom-mbz-test

model_hub_mixin

pytorch_model_hub_mixin

Model card Files Files and versions

test-3.2B-base / tokenizer_config.json

michaelbzhu's picture

Update tokenizer_config.json

0aaabcf verified 4 months ago

history blame contribute delete

72 Bytes

	{
	"model_max_length": 1024,
	"tokenizer_class": "GPT2TokenizerFast"
	}