Tasfiya025
/

shorif-textgen-basic

Model card Files Files and versions

shorif-textgen-basic / tokenizer_config.json

Tasfiya025's picture

Create tokenizer_config.json

a40a9bb verified 28 days ago

history blame contribute delete

124 Bytes

	{
	"tokenizer_class": "GPT2Tokenizer",
	"model_max_length": 256,
	"padding_side": "left",
	"truncation_side": "right"
	}