Update README.md
Browse files
README.md
CHANGED
|
@@ -86,7 +86,7 @@ The recommended sampling parameters for Andy-4.1 are as follows:
|
|
| 86 |
|
| 87 |
| Name | Value |
|
| 88 |
| :--- | :--- |
|
| 89 |
-
| **Temperature** | 0.
|
| 90 |
| **Repeat Penalty** | 1.15 |
|
| 91 |
| **Top P Sampling** | 0.9 |
|
| 92 |
| **Min P Sampling** | 0.05 |
|
|
@@ -222,6 +222,22 @@ Andy-4.1 *does* have a non-thinking mode via changing the chat template, which i
|
|
| 222 |
|
| 223 |
</details>
|
| 224 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 225 |
## What's Next?
|
| 226 |
|
| 227 |
Based on the lessons from Andy-4.1, the Mindcraft team is prepared to collect better training data, explore new architectures to make the cost of running Andy models cheaper, as well as packing more brains into these tiny minds.
|
|
|
|
| 86 |
|
| 87 |
| Name | Value |
|
| 88 |
| :--- | :--- |
|
| 89 |
+
| **Temperature** | 0.8 |
|
| 90 |
| **Repeat Penalty** | 1.15 |
|
| 91 |
| **Top P Sampling** | 0.9 |
|
| 92 |
| **Min P Sampling** | 0.05 |
|
|
|
|
| 222 |
|
| 223 |
</details>
|
| 224 |
|
| 225 |
+
## Acknowledgements
|
| 226 |
+
|
| 227 |
+
There are user reported errors from Andy-4.1 right now, below is a debug section to help you.
|
| 228 |
+
|
| 229 |
+
<details>
|
| 230 |
+
<summary>How to fix issues with Andy-4.1</summary>
|
| 231 |
+
|
| 232 |
+
`Error rendering prompt with jinja template: "Expected iterable or object type in for loop: got UndefinedValue"`
|
| 233 |
+
Should be expected using the GGUFs of Andy-4.1. Somewhere in the pipeline between llama.cpp or LM Studio itself, the chat template changes, which makes the model not work. Follow [this LM Studio Guide](https://lmstudio.ai/docs/app/advanced/prompt-template) for how to set the chat template of the model, and use [this chat template](https://huggingface.co/Mindcraft-CE/Andy-4.1/blob/main/chat_template.jinja).
|
| 234 |
+
|
| 235 |
+
If you notice Andy-4.1 "thinking out loud," most likely your issue is **Context Length Truncation.** LM Studio doesn't automatically set the context to the longest amount. When you go to load a model there is a toggle that says "Manually choose model load parameters," **activate that.** Afterwards, click on `andy-4.1` in the "Your Models" section.
|
| 236 |
+
|
| 237 |
+
Next, find the "Context Length" section, and ensure it is **at least** `16000` *(Note that LM Studio doesn't use commas for large numbers).* For insurance sake, check the "Remember settings for `andy-4.1`" box in the bottom left of that menu, and Load the Model.
|
| 238 |
+
|
| 239 |
+
</details>
|
| 240 |
+
|
| 241 |
## What's Next?
|
| 242 |
|
| 243 |
Based on the lessons from Andy-4.1, the Mindcraft team is prepared to collect better training data, explore new architectures to make the cost of running Andy models cheaper, as well as packing more brains into these tiny minds.
|