testingmodel / hybrid_tokenizer_config.json
shivash's picture
Upload Enhanced Hybrid Transformer 416M weights πŸš€
701cfd9 verified
raw
history blame contribute delete
128 Bytes
{
"add_bos_token": false,
"add_eos_token": true,
"optimize_for_generation": true,
"tokenizer_class": "HybridTokenizer"
}