sampling params
#1
by
owao
- opened
Hey guys! I want to give a try to your model but I was confused about the sampling params because I see
in args.json:
"temperature": null,
"top_k": 50,
"top_p": 0.9,
"repetition_penalty": 1.0,
but in your vllm usage example:
temperature=0.6,
top_p=0.95,
Which one is the good one? :)
Thanks
vllm usage is the correct one!
mertunsal
changed discussion status to
closed
thanks!