Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
ace-1
/
mgpt2-tokenizer
like
1
Model card
Files
Files and versions
xet
Community
main
mgpt2-tokenizer
File size: 80 Bytes
24cf5c6
1
2
3
4
from
tokenizer.hf_tokenizer
import
MGPT2Tokenizer __all__ = [
'MGPT2Tokenizer'
]