Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

Tural
/

tokenizer-from-scratch-4k

Model card Files Files and versions

tokenizer-from-scratch-4k

182 kB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

Tural's picture

Upload tokenizer

88445d4 over 2 years ago

.gitattributes

1.52 kB
initial commit over 2 years ago
special_tokens_map.json

125 Bytes
Upload tokenizer over 2 years ago
tokenizer.json

144 kB
Upload tokenizer over 2 years ago
tokenizer_config.json

342 Bytes
Upload tokenizer over 2 years ago
vocab.txt

35.9 kB
Upload tokenizer over 2 years ago