justjuu
/

pico-gpt

Text Generation

small-language-model

Model card Files Files and versions

pico-gpt / tokenizer_config.json

justjuu's picture

Upload folder using huggingface_hub

073e95f verified 21 days ago

history blame contribute delete

127 Bytes

	{
	"tokenizer_class": "GPT2Tokenizer",
	"eos_token": "<\|endoftext\|>",
	"model_max_length": 128,
	"tokenizer_type": "gpt2"
	}