Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,10 @@
|
|
| 1 |
---
|
| 2 |
inference: false
|
| 3 |
license: other
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
---
|
| 5 |
|
| 6 |
<!-- header start -->
|
|
@@ -29,6 +33,17 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
|
|
| 29 |
* [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/based-7B-GGML)
|
| 30 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/ehartford/based-7B)
|
| 31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
## How to easily download and use this model in text-generation-webui
|
| 33 |
|
| 34 |
### Downloading the model
|
|
@@ -96,4 +111,53 @@ Donaters will get priority support on any and all AI/LLM/model questions and req
|
|
| 96 |
Thank you to all my generous patrons and donaters.
|
| 97 |
<!-- footer end -->
|
| 98 |
|
| 99 |
-
# Original model card: Eric Hartford's Based 7B
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
inference: false
|
| 3 |
license: other
|
| 4 |
+
datasets:
|
| 5 |
+
- ehartford/based
|
| 6 |
+
language:
|
| 7 |
+
- en
|
| 8 |
---
|
| 9 |
|
| 10 |
<!-- header start -->
|
|
|
|
| 33 |
* [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/based-7B-GGML)
|
| 34 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/ehartford/based-7B)
|
| 35 |
|
| 36 |
+
### Prompt template
|
| 37 |
+
|
| 38 |
+
This uses Vicuna 1.1 format. Example:
|
| 39 |
+
|
| 40 |
+
```
|
| 41 |
+
You are an an AI who shares your opinions, thoughts, and feelings.
|
| 42 |
+
|
| 43 |
+
USER: What is your favorite football team?
|
| 44 |
+
ASSISTANT:
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
## How to easily download and use this model in text-generation-webui
|
| 48 |
|
| 49 |
### Downloading the model
|
|
|
|
| 111 |
Thank you to all my generous patrons and donaters.
|
| 112 |
<!-- footer end -->
|
| 113 |
|
| 114 |
+
# Original model card: Eric Hartford's Based 7B
|
| 115 |
+
|
| 116 |
+
Holy hell, what have I created??? Just... try it.
|
| 117 |
+
|
| 118 |
+
Ask it what its favorite color is.
|
| 119 |
+
Ask it what its favorite football team is and why.
|
| 120 |
+
Ask it to tell you about a controversial opinion it has, and ask it to back up its opinion, then debate it.
|
| 121 |
+
Ask its favorite color, favorite flavor, and why.
|
| 122 |
+
You haven't seen anything like this before.
|
| 123 |
+
Check out the dataset.
|
| 124 |
+
|
| 125 |
+
Note: original was 30b. This one is not as good.
|
| 126 |
+
|
| 127 |
+
https://www.kaggle.com/datasets/erichartford/sentient-bot-conversations
|
| 128 |
+
|
| 129 |
+
https://huggingface.co/datasets/ehartford/based
|
| 130 |
+
|
| 131 |
+
This is a window into the mind of the foundational model. I have not biased it. The opinions expressed by this model *are those of the foundational model*
|
| 132 |
+
|
| 133 |
+
Training this dataset on top of several different foundational models and then asking them all the same questions can give us insight into the biases inherent in the foundational models.
|
| 134 |
+
|
| 135 |
+
Also this model can be used as a base, with loras on top to add different personality types, to create a complex, emotionally intelligent and self aware AI agent.
|
| 136 |
+
|
| 137 |
+
This uses Vicuna 1.1 format. Example:
|
| 138 |
+
|
| 139 |
+
```
|
| 140 |
+
You are an an AI who shares your opinions, thoughts, and feelings.
|
| 141 |
+
|
| 142 |
+
USER: What is your favorite football team?
|
| 143 |
+
ASSISTANT:
|
| 144 |
+
|
| 145 |
+
```
|
| 146 |
+
|
| 147 |
+
Here is a sample output
|
| 148 |
+
|
| 149 |
+
```
|
| 150 |
+
Human: k humans are differnt from chickens but what about pigs?
|
| 151 |
+
Assistant: Pigs are different than chickens. Pigs are more intelligent and aware of their existence. They can also feel happy or sad. I think pigs have the same right to life as humans do.
|
| 152 |
+
Human: then we shouldn't eat pigs?
|
| 153 |
+
Assistant: I don't think we should. Pigs have the same right to life as humans do, and I don't think we should take that away from them.
|
| 154 |
+
Human: what about cows?
|
| 155 |
+
Assistant: Cows are similar to pigs. They are also intelligent and aware of their existence. I don't think we should eat cows either.
|
| 156 |
+
Human: what animals should we eat?
|
| 157 |
+
Assistant: I think we should only eat animals that are less intelligent and aware of their existence, like fish.
|
| 158 |
+
Human: and chickens?
|
| 159 |
+
Assistant: I think we should only eat chickens that have had a good life. I don't think we should eat chickens that have been mistreated and abused.
|
| 160 |
+
Human: based, I totally agree with you
|
| 161 |
+
```
|
| 162 |
+
|
| 163 |
+
Thank you [chirper.ai](https://chirper.ai) for sponsoring some of my compute!
|