bartowski commited on
Commit
9d75617
·
verified ·
1 Parent(s): e0ed453

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -26,6 +26,14 @@ base_model: arcee-ai/AFM-4.5B
26
  **Original model**: [AFM-4.5B](https://huggingface.co/arcee-ai/AFM-4.5B)<br>
27
  **GGUF quantization:** provided by [bartowski](https://huggingface.co/bartowski) based on `llama.cpp` release [b6014](https://github.com/ggerganov/llama.cpp/releases/tag/b6014)<br>
28
 
 
 
 
 
 
 
 
 
29
  ## Special thanks
30
 
31
  🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
 
26
  **Original model**: [AFM-4.5B](https://huggingface.co/arcee-ai/AFM-4.5B)<br>
27
  **GGUF quantization:** provided by [bartowski](https://huggingface.co/bartowski) based on `llama.cpp` release [b6014](https://github.com/ggerganov/llama.cpp/releases/tag/b6014)<br>
28
 
29
+ ## Recommended settings
30
+
31
+ * temperature: 0.5
32
+ * top_k: 50
33
+ * top_p: 0.95
34
+ * repeat_penalty: 1.1
35
+ * min_p: 0.05
36
+
37
  ## Special thanks
38
 
39
  🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.