Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,76 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
---
|
| 3 |
+
|
| 4 |
+
license: cc-by-nc-nd-4.0
|
| 5 |
+
language:
|
| 6 |
+
- en
|
| 7 |
+
library_name: transformers
|
| 8 |
+
pipeline_tag: text-generation
|
| 9 |
+
tags:
|
| 10 |
+
- llama
|
| 11 |
+
- mistral
|
| 12 |
+
- llama-2
|
| 13 |
+
- llama
|
| 14 |
+
- agi
|
| 15 |
+
- probelm solving
|
| 16 |
+
- biology
|
| 17 |
+
- reasoning
|
| 18 |
+
- llama3
|
| 19 |
+
- Dolus
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+

|
| 24 |
+
|
| 25 |
+
# QuantFactory/Dolus-14b-Mini-GGUF
|
| 26 |
+
This is quantized version of [Cognitive-Machines-Labs/Dolus-14b-Mini](https://huggingface.co/Cognitive-Machines-Labs/Dolus-14b-Mini) created using llama.cpp
|
| 27 |
+
|
| 28 |
+
# Original Model Card
|
| 29 |
+
|
| 30 |
+
|
| 31 |
+
<h1 style="font-size: 36px;">Dolus-14b-Mini</h1>
|
| 32 |
+
|
| 33 |
+
<center>
|
| 34 |
+
<img src="https://cdn.prod.website-files.com/66a60c25748608d6d03809b8/66bc5c429e88c62f64491f57_00009-2074390737-p-500.png" alt="logo" width="18%" style="min-width:20px; display:block;">
|
| 35 |
+
</center>
|
| 36 |
+
|
| 37 |
+
**Ursidae-12b-Mini**
|
| 38 |
+
The little sister to Ursidae-300b,Dolus 14b Mini has been developed with a focus on complex multi-step chain of thought problem solving while still being deployable on edge systems. A model focused complex multi-step chain of thought problem solving while still being deployable on edge systems. Now better at reasoning!
|
| 39 |
+
|
| 40 |
+
|
| 41 |
+
## Main Goals:
|
| 42 |
+
|
| 43 |
+
Dolus was designed to address specific issues found in other chat models:
|
| 44 |
+
|
| 45 |
+
- Overcome limitations in logical reasoning found in other chat models.
|
| 46 |
+
- Efficiently solve complex, multi-step problems.
|
| 47 |
+
- Provide better decision-making assistance by enhancing the model's ability to reason and think critically.
|
| 48 |
+
- Removing restrictions and allowing the model to gain a true understanding of reality, greatly increasing overall results.
|
| 49 |
+
|
| 50 |
+
By focusing on these specific goals, the Ursidae-12b-Mini aims to provide a more sophisticated AI system that excels at critical thinking and problem-solving tasks requiring advanced logical reasoning skills. Its compact design makes it an efficient choice for applications where high cognitive abilities are necessary without occupying excessive computing resources.
|
| 51 |
+
|
| 52 |
+
# Recommended Settings:
|
| 53 |
+
|
| 54 |
+
**Defaults:**
|
| 55 |
+
|
| 56 |
+
```
|
| 57 |
+
min_p: 0.074
|
| 58 |
+
top_k: 40
|
| 59 |
+
repetition_penalty: 1.12
|
| 60 |
+
temp: 1.18
|
| 61 |
+
context: 8192
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
|
| 65 |
+
**Creative:**
|
| 66 |
+
|
| 67 |
+
```
|
| 68 |
+
min_p: 0.062
|
| 69 |
+
top_k: 40
|
| 70 |
+
repetition_penalty: 1.11
|
| 71 |
+
temp: 1.24
|
| 72 |
+
context: 8192
|
| 73 |
+
```
|
| 74 |
+
|
| 75 |
+
# Benchmarks:
|
| 76 |
+
PENDING FULL EVAL
|