Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Qvinfor
/
BloatTokenizer32K
Like
1
English
tokenizer
tokenization
code
mathematics
nlp
llm
cpp
language-modeling
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
BloatTokenizer32K
/
engine
/
include
3.82 kB
Ctrl+K
Ctrl+K
1 contributor
History:
4 commits
Qvinfor
Upload tokenizer.hpp
bf1bec7
verified
4 days ago
.gitkeep
Safe
0 Bytes
Create engine/include/.gitkeep
4 days ago
tokenizer.hpp
Safe
3.82 kB
Upload tokenizer.hpp
4 days ago
