sampling params

#1
by owao - opened

Hey guys! I want to give a try to your model but I was confused about the sampling params because I see

in args.json:

  "temperature": null,
  "top_k": 50,
  "top_p": 0.9,
  "repetition_penalty": 1.0,

but in your vllm usage example:

    temperature=0.6,
    top_p=0.95,

Which one is the good one? :)

Thanks

Browser Use org

vllm usage is the correct one!

mertunsal changed discussion status to closed

thanks!

Sign up or log in to comment