Update README.md
Browse files
README.md
CHANGED
|
@@ -19,7 +19,7 @@ As such, this model will be updated soon when we have trained it on the full dat
|
|
| 19 |
|
| 20 |
## Sampling Parameters
|
| 21 |
|
| 22 |
-
We've had success with top_p=0.95, top_k=30, repetition_penalty=1.15 and temperature=0.
|
| 23 |
|
| 24 |
```python
|
| 25 |
input_text = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
|
|
|
|
| 19 |
|
| 20 |
## Sampling Parameters
|
| 21 |
|
| 22 |
+
We've had success with top_p=0.95, top_k=30, repetition_penalty=1.15 and temperature=0.4 and it's also recommended to append \<think\> to force reasoning like this:
|
| 23 |
|
| 24 |
```python
|
| 25 |
input_text = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
|