Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
LULab
/
myNLP-Tokenization
like
0
Follow
Language Understanding Laboratory
16
License:
mit
Model card
Files
Files and versions
xet
Community
main
myNLP-Tokenization
File size: 44 Bytes
b245c5c
1
{
"<PAD>"
:
0
,
"-"
:
1
,
"<"
:
2
,
">"
:
3
,
"|"
:
4
}