rpreite
/

test

Text Generation

text-generation-inference

Model card Files Files and versions

test / added_tokens.json

rpreite's picture

Upload tokenizer

b0e732d verified 2 months ago

history blame contribute delete

107 Bytes

	{
	"<\|PAD_TOKEN\|>": 151646,
	"<\|endoftext\|>": 151643,
	"<\|im_end\|>": 151645,
	"<\|im_start\|>": 151644
	}