Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Qvinfor
/
BloatTokenizer32K
Like
1
English
tokenizer
tokenization
code
mathematics
nlp
llm
cpp
language-modeling
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
BloatTokenizer32K
/
engine
/
src
38 kB
Ctrl+K
Ctrl+K
1 contributor
History:
4 commits
Qvinfor
Upload 2 files
c941ae3
verified
4 days ago
.gitkeep
Safe
0 Bytes
Create engine/src/.gitkeep
4 days ago
bindings.cpp
Safe
2.62 kB
Upload 2 files
4 days ago
tokenizer.cpp
Safe
35.4 kB
Upload 2 files
4 days ago
