Temperature Tip
#4
by
pandora-s - opened
README.md
CHANGED
|
@@ -117,6 +117,9 @@ outputs = model.generate(**inputs, max_new_tokens=20)
|
|
| 117 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 118 |
```
|
| 119 |
|
|
|
|
|
|
|
|
|
|
| 120 |
## Note
|
| 121 |
|
| 122 |
`Mistral-Nemo-Base-2407` is a pretrained base model and therefore does not have any moderation mechanisms.
|
|
|
|
| 117 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 118 |
```
|
| 119 |
|
| 120 |
+
> [!TIP]
|
| 121 |
+
> Unlike previous Mistral models, Mistral Nemo requires smaller temperatures. We recommend to use a temperature of 0.3.
|
| 122 |
+
|
| 123 |
## Note
|
| 124 |
|
| 125 |
`Mistral-Nemo-Base-2407` is a pretrained base model and therefore does not have any moderation mechanisms.
|