no_repeat_ngram_size in vllm backend

#15

by ducknificient - opened Jan 27

Jan 27

hi, is there any options to use .generate() arguments, for example like no_repeat_ngram_size, etc ?

thanks ,best regards

ducknificient changed discussion status to closed Jan 27

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment