Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
metaXu264
/
Generator_new_tokenizer
like
0
Text Generation
Transformers
Safetensors
llama
biology
genomics
long-context
text-generation-inference
arxiv:
2502.07272
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Generator_new_tokenizer
/
tokenizer.py
Commit History
Update tokenizer source and config vocab_size to 4260
47922fc
XuJP264
commited on
6 days ago
Add updated vocab with CRISPR/Cas special tokens
4357886
XuJP264
commited on
7 days ago