Recommended sampling parameters

#6
by sszymczyk - opened

What are the recommended values of sampling parameters - temperature/top_p/top_k?

I always test Qwen3-based thinking MoE models at:

Temp 0.6
Top K 20
Repeat Penalty 1.05
Min P 0.05
Top P 0.95

Before seeing other explicit guidance, I will judge model performance based on these values.

Sign up or log in to comment