GhostLM / tokenizer_config.json
Ghostgim's picture
v0.5.0 chat-tuned ghost-small (CTIBench MCQ 36.9%)
2ac3661 verified
raw
history blame contribute delete
76 Bytes
{
"tokenizer_type": "tiktoken",
"vocab_size": 50261,
"model": "gpt2"
}