wikilangs
/

tokenizers_bantu-all

Model card Files Files and versions

tokenizers_bantu-all / special_tokens_map.json

omarkamali's picture

Upload folder using huggingface_hub

b6d9359 verified about 1 month ago

history blame contribute delete

65 Bytes

	{
	"eos_token": "<\|im_end\|>",
	"pad_token": "<\|vision_pad\|>"
	}