txgsync commited on
Commit
503c435
·
verified ·
1 Parent(s): 8a97eb0

Document Maple sampler and context settings

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -31,6 +31,22 @@ This repository contains an enhanced mixed-precision oQ4e MLX quantization of [`
31
 
32
  This is an MLX conversion for local inference on Apple Silicon. Please follow the base model's MIT license and usage terms.
33
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  ---
35
 
36
  ## Base model description
 
31
 
32
  This is an MLX conversion for local inference on Apple Silicon. Please follow the base model's MIT license and usage terms.
33
 
34
+ ## Recommended generation settings
35
+
36
+ Maple is a reasoning-heavy model and may spend a substantial part of its response budget thinking. For the OpenAI-compatible API or oMLX UI, start with:
37
+
38
+ ```text
39
+ temperature: 1.0
40
+ top_p: 0.95
41
+ top_k: 40
42
+ min_p: 0.05
43
+ repetition_penalty: 1.0
44
+ max_tokens: 8192 or higher
45
+ max context: 131072 tokens (native model limit)
46
+ ```
47
+
48
+ These sampler values match DeepGrove's Maple `llama.cpp` setup. The model declares a native 131,072-token context window and does not require RoPE/YARN scaling for that window. Actual usable context may be lower on systems constrained by KV-cache memory; do not assume that extending beyond 131,072 tokens is supported.
49
+
50
  ---
51
 
52
  ## Base model description