Commit
·
43380ec
1
Parent(s):
7742090
Update README.md
Browse files
README.md
CHANGED
|
@@ -31,6 +31,7 @@ inference:
|
|
| 31 |
top_p: 0.34
|
| 32 |
top_k: 30
|
| 33 |
max_new_tokens: 250
|
|
|
|
| 34 |
---
|
| 35 |
Base model Locutusque/TinyMistral-248M fully fine-tuned on Locutusque/InstructMix. During validation, this model achieved an average perplexity of 3.23 on Locutusque/InstructMix dataset.
|
| 36 |
It has so far been trained on approximately 608,000 examples. More epochs are planned for this model.
|
|
|
|
| 31 |
top_p: 0.34
|
| 32 |
top_k: 30
|
| 33 |
max_new_tokens: 250
|
| 34 |
+
repetition_penalty: 1.15
|
| 35 |
---
|
| 36 |
Base model Locutusque/TinyMistral-248M fully fine-tuned on Locutusque/InstructMix. During validation, this model achieved an average perplexity of 3.23 on Locutusque/InstructMix dataset.
|
| 37 |
It has so far been trained on approximately 608,000 examples. More epochs are planned for this model.
|