Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
16dvnk
/
Tokenizer
like
1
License:
cc0-1.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
Tokenizer
Commit History
Update config.json
f0b71f3
verified
16dvnk
commited on
Dec 22, 2025
Create config.json
a0b43a0
verified
16dvnk
commited on
Dec 22, 2025
Update README.md
16d89df
verified
16dvnk
commited on
Dec 22, 2025
Upload bpe-tokenizer.json
e072d17
verified
16dvnk
commited on
Dec 22, 2025
initial commit
bd294d6
verified
16dvnk
commited on
Dec 22, 2025