Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

heilerich
/

llama-tokenizer-fast

Model card Files Files and versions

llama-tokenizer-fast

2.35 MB

1 contributor

History: 2 commits

heilerich's picture

Upload tokenizer

e16f8e0 over 2 years ago

.gitattributes
1.48 kB

initial commit over 2 years ago
special_tokens_map.json
411 Bytes

Upload tokenizer over 2 years ago
tokenizer.json
1.84 MB

Upload tokenizer over 2 years ago
tokenizer.model
500 kB
xet

Upload tokenizer over 2 years ago
tokenizer_config.json
727 Bytes

Upload tokenizer over 2 years ago