Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

XiaHan19
/

shami-token

Model card Files Files and versions

8.26 MB

2 contributors

History: 6 commits

jstzwj

update tokenizer

6283007 over 2 years ago

.gitattributes
1.48 kB

initial commit over 2 years ago
README.md
88 Bytes

init repo over 2 years ago
merges.txt
1.27 MB

update tokenizer over 2 years ago
requirements.txt
55 Bytes

init repo over 2 years ago
special_tokens_map.json
99 Bytes

init repo over 2 years ago
tokenization_shami.py
10.3 kB

add code over 2 years ago
tokenization_shami_fast.py
3.5 kB

add code over 2 years ago
tokenizer.json
4.99 MB

update tokenizer over 2 years ago
tokenizer_config.json
234 Bytes

update tokenizer over 2 years ago
train_tokenizer.py
764 Bytes

update tokenizer over 2 years ago
vocab.json
1.98 MB

update tokenizer over 2 years ago