Hugging Face's logo

boffire
/
gemma-2b-kabyle-tokenizer

Text Generation
Kabyle
tokenizers
gemma
amz
Model card Files
xet
 Community
gemma-2b-kabyle-tokenizer / tokenizer_config.json

Commit History

Initial release of Gemma tokenizer with native noise-free Kabyle sub-word support
67a9890
verified

boffire commited on