Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Spaces:
Chintan-Shah
/
HindiTokenizerFromScratch
Running

App Files Files Community
Fetching metadata from the HF Docker repository...
HindiTokenizerFromScratch
319 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 38 commits
Chintan-Shah's picture
Chintan-Shah
Update app.py
847ca07 verified almost 2 years ago
  • .gitattributes
    1.52 kB
    initial commit almost 2 years ago
  • 180548df513ce4f4.css
    18.9 kB
    Upload 180548df513ce4f4.css almost 2 years ago
  • README.md
    244 Bytes
    initial commit almost 2 years ago
  • app.py
    14.4 kB
    Update app.py almost 2 years ago
  • merges.pkl

    Pickle imports

    • No problematic imports detected

    What is a pickle import?

    106 kB
    xet
    Updated merges and vocab with 10000 vocab size and merging the 3 byte char tokens for devnagari script first almost 2 years ago
  • requirements.txt
    0 Bytes
    Update requirements.txt almost 2 years ago
  • vocab.pkl

    Pickle imports

    • No problematic imports detected

    What is a pickle import?

    179 kB
    xet
    Updated merges and vocab with 10000 vocab size and merging the 3 byte char tokens for devnagari script first almost 2 years ago