Is there any native settings to extend the context window to 8k?
#19
by sihanzeng233 - opened
Hi, thanks for releasing the embedding model! Wondering if there's any native settings that can extend the context window from 2k to larger than 8k?
Hi @sihanzeng233 ,
Welcome to Google's Gemma family of open source models, thanks for reaching out to us. The google/embeddinggemma-300m model is having context widow size of 2048 that's the max positional embedding (max_position_embeddings) settings provided to this model. Please refer the config.json file from the file sections to know more about this model settings.
Thanks.