initial prompt is greater than the context length
#2
by
Bitsmakerde - opened
I get on my M4 max 64GB RAM always this error. Hoe I can fix this?
The number of tokens to keep from the initial prompt is greater than the context length. Try to load the model with a larger context length, or provide a shorter input. Error Data: n/a, Additional Data: n/a