Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

martindevoto
/

my-test-tokenizer

Model card Files Files and versions

my-test-tokenizer

3.23 MB

1 contributor

History: 2 commits

martindevoto's picture

Upload tokenizer

03bdc85 over 2 years ago

.gitattributes
1.52 kB

initial commit over 2 years ago
sentencepiece.bpe.model
811 kB
xet

Upload tokenizer over 2 years ago
special_tokens_map.json
354 Bytes

Upload tokenizer over 2 years ago
tokenizer.json
2.42 MB

Upload tokenizer over 2 years ago
tokenizer_config.json
491 Bytes

Upload tokenizer over 2 years ago