max_len_tokens
#10
by
mansurealism
- opened
if we need to generate 1 token, with len(query) = 256 + len(document)=1024 + constant instuction prompt, what would be the correct max_len_tokens size?
if we need to generate 1 token, with len(query) = 256 + len(document)=1024 + constant instuction prompt, what would be the correct max_len_tokens size?