CrystaLLM-pi_base / tokenizer_config.json
c-bone's picture
Upload base model checkpoint
9f2bfdb verified
raw
history blame contribute delete
82 Bytes
{"unk_token": "<unk>", "vocab_size": 377, "tokenizer_class": "CustomCIFTokenizer"}