hf-internal-testing
/

tiny-random-GPTNeoXJapaneseForCausalLM

Text Generation

gpt_neox_japanese

Model card Files Files and versions

tiny-random-GPTNeoXJapaneseForCausalLM / special_tokens_map.json

ydshieh's picture

ydshieh HF Staff

Upload tiny models for GPTNeoXJapaneseForCausalLM

5fca247 about 3 years ago

history blame contribute delete

133 Bytes

	{
	"bos_token": "<\|startoftext\|>",
	"eos_token": "<\|endoftext\|>",
	"pad_token": "<\|endoftext\|>",
	"unk_token": "<\|endoftext\|>"
	}