Cosmos3-nano-dummy / text_tokenizer /tokenizer_config.json
serizard1005's picture
Add dummy Cosmos3-Nano weights (real shapes, zero-initialized)
e0f9c54 verified
raw
history blame contribute delete
223 Bytes
{
"backend": "tokenizers",
"eos_token": "<|endoftext|>",
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}