xcjthu commited on
Commit
6170bc9
·
2 Parent(s): 8ab8cc2 72c952d

Merge branch 'main' of hf.co:openbmb/MiniCPM4.1-8B

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -63,6 +63,11 @@ MiniCPM4.1 launches end-side versions with 8B parameter scale, both achieving be
63
 
64
  ![benchmark](https://github.com/OpenBMB/MiniCPM/blob/main/assets/minicpm4/benchmark4.1.png?raw=true)
65
 
 
 
 
 
 
66
  ### Efficiency Evaluation
67
  MiniCPM4.1 adopts sparse attention and speculative decoding to improve the inference efficiency. On RTX 4090, MiniCPM4.1 achieves 3x decoding speed improvement in reasoning.
68
 
 
63
 
64
  ![benchmark](https://github.com/OpenBMB/MiniCPM/blob/main/assets/minicpm4/benchmark4.1.png?raw=true)
65
 
66
+ ### Best Practices
67
+ 1. It is advisable to use temperature=0.9, topp=0.95. And we suggest setting max_output_token to 65,536 tokens.
68
+ 2. For math problems, we recommend using "Please reason step by step, and put your final answer within \boxed{}."
69
+ 3. And for English multiple-choice questions, we recommend starting with "Answer the following multiple choice question. The last line of your response should be of the following format: 'ANSWER: $LETTER' (without quotes) where LETTER is one of ABCD. Think step by step before answering." And "你回答的最后一行必须是以下格式 '答案:$选项' (不带引号), 其中选项是ABCD之一。请在回答之前一步步思考" for Chinese MCQ.
70
+
71
  ### Efficiency Evaluation
72
  MiniCPM4.1 adopts sparse attention and speculative decoding to improve the inference efficiency. On RTX 4090, MiniCPM4.1 achieves 3x decoding speed improvement in reasoning.
73