Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Qvinfor
/
BloatTokenizer32K
Like
1
English
tokenizer
tokenization
code
mathematics
nlp
llm
cpp
language-modeling
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
BloatTokenizer32K
/
engine
632 kB
Ctrl+K
Ctrl+K
1 contributor
History:
22 commits
Qvinfor
Delete engine/python/.gitkeep
38807f6
verified
3 days ago
include
Upload tokenizer.hpp
3 days ago
python
Delete engine/python/.gitkeep
3 days ago
src
Upload 2 files
3 days ago
CMakeLists.txt
1.84 kB
Upload 3 files
3 days ago
pyproject.toml
672 Bytes
Upload 3 files
3 days ago
setup.py
1.13 kB
Upload 3 files
3 days ago