InstaDeepAI
/

nucleotide-transformer-2.5b-multi-species

Model card Files Files and versions

nucleotide-transformer-2.5b-multi-species / tokenizer_config.json

hdallatorre's picture

Upload tokenizer

c171e63 about 3 years ago

108 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 1024,
	"tokenizer_class": "EsmTokenizer"
	}