Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,14 @@ base_model: arcee-ai/AFM-4.5B
|
|
| 26 |
**Original model**: [AFM-4.5B](https://huggingface.co/arcee-ai/AFM-4.5B)<br>
|
| 27 |
**GGUF quantization:** provided by [bartowski](https://huggingface.co/bartowski) based on `llama.cpp` release [b6014](https://github.com/ggerganov/llama.cpp/releases/tag/b6014)<br>
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
## Special thanks
|
| 30 |
|
| 31 |
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|
|
|
|
| 26 |
**Original model**: [AFM-4.5B](https://huggingface.co/arcee-ai/AFM-4.5B)<br>
|
| 27 |
**GGUF quantization:** provided by [bartowski](https://huggingface.co/bartowski) based on `llama.cpp` release [b6014](https://github.com/ggerganov/llama.cpp/releases/tag/b6014)<br>
|
| 28 |
|
| 29 |
+
## Recommended settings
|
| 30 |
+
|
| 31 |
+
* temperature: 0.5
|
| 32 |
+
* top_k: 50
|
| 33 |
+
* top_p: 0.95
|
| 34 |
+
* repeat_penalty: 1.1
|
| 35 |
+
* min_p: 0.05
|
| 36 |
+
|
| 37 |
## Special thanks
|
| 38 |
|
| 39 |
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|