Add custom JeevesTokenizer (wraps SentencePiece directly), fix config 204acd7 verified Anurich commited on 3 days ago
Fix tokenizer: update tokenizer_config.json for transformers 5.x compat 96b318d verified Anurich commited on 4 days ago
Fix tokenizer: update tokenizer_config.json for transformers 5.x compat 3c31ed0 verified Anurich commited on 4 days ago