Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
chengzl18
/
cctokenizer
like
0
Fill-Mask
Transformers
bert
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
cctokenizer
Commit History
Add EOS special token
a460612
chengzl18
commited on
Mar 25, 2023
A Chinese Character Tokenizer with a Many-to-one Mapping.
9836307
chengzl18
commited on
Mar 24, 2023
A Chinese Character Tokenizer with a Many-to-one Mapping.
008b0e2
chengzl18
commited on
Mar 24, 2023
initial commit
f16d068
chengzl18
commited on
Mar 24, 2023
chengzl18
commited on
