Hugging Face's logo

google
/
gemma-4-12B-it

Any-to-Any
Transformers
Safetensors
gemma4_unified
image-text-to-text
Eval Results
Model card Files
xet
 Community
20

fix max_position_embeddings 128Ki --> 256Ki

#11
by ddh0 - opened
base: refs/heads/main
←
from: refs/pr/11
Discussion Files changed
+2
-2
Preparing for release!e18f459f
ddh0

The model card and blog post both say the model supports 256Ki tokens. The config did not reflect this. This PR changes the max_position_embeddings in the config.json from 131072 to 262144.
fix max_position_embeddings 128Ki --> 256Ki3aefcc21
Cannot merge
This branch has merge conflicts in the following files:
  • config.json
  • model.safetensors

Sign up or log in to comment