Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
metaXu264
/
Generator_new_tokenizer
like
0
Text Generation
Transformers
Safetensors
llama
biology
genomics
long-context
text-generation-inference
arxiv:
2502.07272
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Generator_new_tokenizer
/
config.json
Commit History
Resize embeddings to match 4260-token tokenizer
192f9c4
XuJP264
commited on
7 days ago
Update tokenizer source and config vocab_size to 4260
47922fc
XuJP264
commited on
7 days ago
Add updated vocab with CRISPR/Cas special tokens
4357886
XuJP264
commited on
8 days ago