optimum-intel-internal-testing
/

tiny-random-PersimmonForCausalLM

Model card Files Files and versions

tiny-random-PersimmonForCausalLM / special_tokens_map.json

IlyasMoutawwakil's picture

IlyasMoutawwakil HF Staff

Mirror from hf-internal-testing/tiny-random-PersimmonForCausalLM

749347e verified 3 months ago

history blame contribute delete

283 Bytes

	{
	"bos_token": {
	"content": "\|ENDOFTEXT\|",
	"lstrip": false,
	"normalized": true,
	"rstrip": false,
	"single_word": false
	},
	"unk_token": {
	"content": "<unk>",
	"lstrip": false,
	"normalized": true,
	"rstrip": false,
	"single_word": false
	}
	}