Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

boffire
/

gemma-2b-kabyle-tokenizer

Text Generation

Model card Files Files and versions

gemma-2b-kabyle-tokenizer

35.3 MB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

boffire's picture

Update README.md

cbbb1f2 verified 21 days ago

.gitattributes

1.57 kB
Initial release of Gemma tokenizer with native noise-free Kabyle sub-word support 21 days ago
README.md

3.94 kB
Update README.md 21 days ago
tokenizer.json

35.3 MB
xet

Initial release of Gemma tokenizer with native noise-free Kabyle sub-word support 21 days ago
tokenizer_config.json

518 Bytes
Initial release of Gemma tokenizer with native noise-free Kabyle sub-word support 21 days ago