Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TencentARC
/
IBQ-Tokenizer-1024
like
1
Follow
ARC Lab, Tencent PCG
807
English
Autoregressive
Tokenizer
arxiv:
2412.02692
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
refs/pr/1
IBQ-Tokenizer-1024
/
README.md
Commit History
Add pipeline tag and library name
9acddac
verified
nielsr
HF Staff
commited on
Mar 11, 2025
Update README.md
854bbe6
verified
shifengyuan
commited on
Dec 4, 2024
initial commit
66514ea
verified
shifengyuan
commited on
Dec 4, 2024