Generator_new_tokenizer / tokenizer.py

Commit History

Update tokenizer source and config vocab_size to 4260
47922fc

XuJP264 commited on

Add updated vocab with CRISPR/Cas special tokens
4357886

XuJP264 commited on