ghost-small-gen / tokenizer_config.json
Ghostgim's picture
ghost-small-gen: 45M from-scratch generalist (GhostLM v0.12.0)
ea0bf93 verified
Raw
History Blame Contribute Delete
76 Bytes
{
"tokenizer_type": "tiktoken",
"vocab_size": 50264,
"model": "gpt2"
}