Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Spaces:
yhavinga
/
dutch-tokenizer-arena
Running

App Files Files Community
1
Fetching metadata from the HF Docker repository...
dutch-tokenizer-arena
126 MB
Ctrl+K
Ctrl+K
  • 3 contributors
History: 80 commits
yhavinga's picture
yhavinga
Update requirements.txt
1a95d5b verified over 1 year ago
  • css
    add compression leaderboard about 2 years ago
  • images
    update over 2 years ago
  • js
    add grok mixtral about 2 years ago
  • patcher
    add compression leaderboard about 2 years ago
  • stats
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 2 years ago
  • utils
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 2 years ago
  • vocab
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 2 years ago
  • .gitattributes
    2.32 kB
    add grok mixtral about 2 years ago
  • .gitignore
    171 Bytes
    update almost 3 years ago
  • README.md
    25.5 kB
    Hack some Dutch tokenizers into it over 2 years ago
  • app.py
    565 Bytes
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 2 years ago
  • app_compression.py
    4.75 kB
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 2 years ago
  • app_playground.py
    9.81 kB
    update about 2 years ago
  • config.py
    1.72 kB
    Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 2 years ago
  • examples.py
    3.16 kB
    add compression leaderboard about 2 years ago
  • requirements.txt
    111 Bytes
    Update requirements.txt over 1 year ago
  • util.py
    8.15 kB
    Hack some Dutch tokenizers into it over 2 years ago