Update generation_config.json
#5
by nbroad - opened
The SKT team has told me these values produce better results. vllm and sglang will load these as sampling parameter defaults if they are stored in this file.
Thanks for the suggestion.
These values are indeed the settings we recommended internally, and we agree that reflecting them directly in this file makes sense so that vllm and sglang can pick them up as defaults.
We’re happy to accept this change. Thanks for taking the initiative.
singleheart changed pull request status to merged