Add custom JeevesTokenizer (wraps SentencePiece directly), fix config 204acd7 verified Anurich commited on 3 days ago
Fix tokenizer: update special_tokens_map.json for transformers 5.x compat 3d56650 verified Anurich commited on 3 days ago
Fix tokenizer: update tokenizer_config.json for transformers 5.x compat 96b318d verified Anurich commited on 3 days ago
Fix: set tie_word_embeddings=false (weights stored separately in safetensors) 31292f1 verified Anurich commited on 3 days ago
Fix tokenizer: update special_tokens_map.json for transformers 5.x compat dcbdf66 verified Anurich commited on 3 days ago
Fix tokenizer: update tokenizer_config.json for transformers 5.x compat 3c31ed0 verified Anurich commited on 3 days ago
Fix tokenizer: update tokenizer.json for transformers 5.x compat 707ee1a verified Anurich commited on 3 days ago