Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

2ira
/
Byte-lingua-code

Model card Files Files and versions
xet
Community
Byte-lingua-code / superbpe /tokenizers_superbpe /tokenizers /src /decoders
27.5 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
2ira's picture
2ira
offline_compression_graph_code
72c0672 verified 4 months ago
  • bpe.rs
    955 Bytes
    offline_compression_graph_code 4 months ago
  • byte_fallback.rs
    3.51 kB
    offline_compression_graph_code 4 months ago
  • ctc.rs
    6.41 kB
    offline_compression_graph_code 4 months ago
  • fuse.rs
    1.01 kB
    offline_compression_graph_code 4 months ago
  • mod.rs
    9.42 kB
    offline_compression_graph_code 4 months ago
  • sequence.rs
    1.47 kB
    offline_compression_graph_code 4 months ago
  • strip.rs
    2.28 kB
    offline_compression_graph_code 4 months ago
  • wordpiece.rs
    2.4 kB
    offline_compression_graph_code 4 months ago