chongli17
/

TokAlign-Pythia-1b-LLaMA3-Tokenizer

Model card Files Files and versions

TokAlign-Pythia-1b-LLaMA3-Tokenizer / generation_config.json

chongli17's picture

Upload GPTNeoXForCausalLM

4e52ef7 verified 11 months ago

history blame contribute delete

111 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 0,
	"eos_token_id": 0,
	"transformers_version": "4.44.2"
	}