How to set the max length from 512 to 2048?
#11
by kk3dmax - opened
How to set the max length from 512 to 2048?
embed_model.client.max_seq_length = 2048 is what I found, not sure is it correct.
The max length for bge is limited to 512. For sentences whose length is larger than 512, it will process only the first 512 tokens.
Therefore, setting the max_seq_length has no effect. We suggest splitting the long document into several passages.
ok, thanks for your clairify.