mimba
/

test

test / xe_tokenizer_config.json

Rename tokenizer_config.json to xe_tokenizer_config.json

b0a30a5 verified about 1 month ago

119 Bytes

	{
	"tokenizer_class": "PreTrainedTokenizerFast",
	"model_max_length": 1000,
	"pad_token": " ",
	"pad_token_id": 0
	}