Max Length of 32768
#18
by hugginghugging - opened
Thank you for open-sourcing this great model! In the example code, max_length is set to 32768. Is there a reason for setting the max length to this large number? I took a look at the paper and this argument is set to 512 for fair comparison with baselines.
What is the token length for this model?