Context Window and max_position_embeddings
#15
by Linukso1D - opened
"max_position_embeddings": 8190 or "max_position_embeddings": 262144 ?
Hi @Linukso1D ,
Thanks for addressing the issue!
The maximum position embedding value for the text config (embedding_gemma2_txt) is 262,144, while the vision config (gemma4_vision) uses 131,072. You can find the details here.