Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

nancyH
/
supp_tokenizer_bench

Model card Files Files and versions
xet
Community
supp_tokenizer_bench / tokenizers /DNAMotifTokenizer
107 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
nancyH's picture
nancyH
Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure
9801f83 verified 17 days ago
  • motifs_dedup.txt
    20.7 kB
    Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure 17 days ago
  • motifs_hardcode_trie.pkl

    Detected Pickle imports (2)

    • "__main__.Trie",
    • "__main__.TrieNode"

    How to fix it?

    77.7 kB
    xet
    Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure 17 days ago
  • vocab_dedup.txt
    8.38 kB
    Add Supp. Fig. 2a motif-preservation benchmark: code, data, results, tokenizers, figure 17 days ago