Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
clearloop
/
tokenizer
like
0
English
tokenizer
License:
other
Model card
Files
Files and versions
xet
Community
main
tokenizer
/
gemma2
17.5 MB
1 contributor
History:
1 commit
clearloop
feat(gemma2): add gemma2 tokenizer
04dabc7
about 1 year ago
.gitattributes
51 Bytes
feat(gemma2): add gemma2 tokenizer
about 1 year ago
README.md
143 Bytes
feat(gemma2): add gemma2 tokenizer
about 1 year ago
tokenizer.json
17.5 MB
xet
feat(gemma2): add gemma2 tokenizer
about 1 year ago