Hugging Face
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
nancyH
/
supp_tokenizer_bench
Like
0
Model card
Files
Files and versions
xet
Community
Copy to bucket
main
supp_tokenizer_bench
/
tokenizers
/
DNAMotifTokenizer
107 kB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
nancyH
Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure
9801f83
verified
17 days ago
motifs_dedup.txt
Safe
20.7 kB
Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure
17 days ago
motifs_hardcode_trie.pkl
Unsafe
pickle
Detected Pickle imports (2)
"__main__.Trie"
,
"__main__.TrieNode"
How to fix it?
77.7 kB
xet
Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure
17 days ago
vocab_dedup.txt
Safe
8.38 kB
Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure
17 days ago