Axon-352M / tokenizer_config.json
DuoNeural's picture
Axon-352M research baseline — DuoNeural 2026-07-05
9a773e4 verified
Raw
History Blame Contribute Delete
132 Bytes
{
"tokenizer_class": "GPT2Tokenizer",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"model_max_length": 2048
}