Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Spaces:

toksuite
/

quick-tokenizer-accuracy

Sleeping

App Files Files Community

Fetching metadata from the HF Docker repository...

quick-tokenizer-accuracy

66 kB

Ctrl+K

Ctrl+K

2 contributors

History: 21 commits

gsaltintas's picture

Update supertoken.py

cf73d0b verified 3 days ago

.gitattributes

1.52 kB
initial commit 12 months ago
.gitignore

10 Bytes
- Save with prefix 10 months ago
README.md

712 Bytes
Merge branch 'main' of https://huggingface.co/spaces/toksuite/quick-tokenizer-accuracy 5 months ago
app.py

45.8 kB
Updated hf paths for toksuite models 5 months ago
requirements.txt

82 Bytes
- Removed header 11 months ago
serve_on_killarney.sh

6.89 kB
Now accepts multiline! 10 months ago
supertoken.py

10.9 kB
Update supertoken.py 3 days ago