metadata
library_name: transformers
tags: []
Gemma-3 Tokenizer
This is the tokenizer used by the Gemma-3 models, and is used in the EuroEval testing suite. We're using this repo rather than the original ones since the original ones are gated, causing CI problems.