raygx
/

GNePT-V2

Text Generation

generated_from_keras_callback

Model card Files Files and versions

GNePT-V2 / tokenizer_config.json

raygx's picture

Upload tokenizer

af03338 verified almost 2 years ago

history blame contribute delete

118 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 256,
	"tokenizer_class": "PreTrainedTokenizerFast"
	}