Sweaterdog commited on
Commit
4fcf3df
·
verified ·
1 Parent(s): 012af4a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -86,7 +86,7 @@ The recommended sampling parameters for Andy-4.1 are as follows:
86
 
87
  | Name | Value |
88
  | :--- | :--- |
89
- | **Temperature** | 0.4 |
90
  | **Repeat Penalty** | 1.15 |
91
  | **Top P Sampling** | 0.9 |
92
  | **Min P Sampling** | 0.05 |
@@ -222,6 +222,22 @@ Andy-4.1 *does* have a non-thinking mode via changing the chat template, which i
222
 
223
  </details>
224
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
225
  ## What's Next?
226
 
227
  Based on the lessons from Andy-4.1, the Mindcraft team is prepared to collect better training data, explore new architectures to make the cost of running Andy models cheaper, as well as packing more brains into these tiny minds.
 
86
 
87
  | Name | Value |
88
  | :--- | :--- |
89
+ | **Temperature** | 0.8 |
90
  | **Repeat Penalty** | 1.15 |
91
  | **Top P Sampling** | 0.9 |
92
  | **Min P Sampling** | 0.05 |
 
222
 
223
  </details>
224
 
225
+ ## Acknowledgements
226
+
227
+ There are user reported errors from Andy-4.1 right now, below is a debug section to help you.
228
+
229
+ <details>
230
+ <summary>How to fix issues with Andy-4.1</summary>
231
+
232
+ `Error rendering prompt with jinja template: "Expected iterable or object type in for loop: got UndefinedValue"`
233
+ Should be expected using the GGUFs of Andy-4.1. Somewhere in the pipeline between llama.cpp or LM Studio itself, the chat template changes, which makes the model not work. Follow [this LM Studio Guide](https://lmstudio.ai/docs/app/advanced/prompt-template) for how to set the chat template of the model, and use [this chat template](https://huggingface.co/Mindcraft-CE/Andy-4.1/blob/main/chat_template.jinja).
234
+
235
+ If you notice Andy-4.1 "thinking out loud," most likely your issue is **Context Length Truncation.** LM Studio doesn't automatically set the context to the longest amount. When you go to load a model there is a toggle that says "Manually choose model load parameters," **activate that.** Afterwards, click on `andy-4.1` in the "Your Models" section.
236
+
237
+ Next, find the "Context Length" section, and ensure it is **at least** `16000` *(Note that LM Studio doesn't use commas for large numbers).* For insurance sake, check the "Remember settings for `andy-4.1`" box in the bottom left of that menu, and Load the Model.
238
+
239
+ </details>
240
+
241
  ## What's Next?
242
 
243
  Based on the lessons from Andy-4.1, the Mindcraft team is prepared to collect better training data, explore new architectures to make the cost of running Andy models cheaper, as well as packing more brains into these tiny minds.