i3-lab
/

i3-22m

Text Generation

i3-architecture

Model card Files Files and versions

i3-22m / tokenizer_config.json

FlameF0X's picture

Upload 6 files

7e7ec39 verified 2 months ago

history blame contribute delete

191 Bytes

	{
	"tokenizer_class": "ChunkTokenizer",
	"model_max_length": 256,
	"vocab_size": 4466,
	"chunk_strategy": "variable_2_3",
	"special_tokens": {},
	"clean_up_tokenization_spaces": false
	}