Update README.md
#1
by rombodawg - opened
README.md
CHANGED
|
@@ -229,6 +229,10 @@ This is one of the first models trained on the LosslessMegaCodeTrainingV2_1m_Evo
|
|
| 229 |
|
| 230 |
- This model was made as a colaboration between me and andreaskoepf who is an affiliate of Open Assistant.
|
| 231 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 232 |
Prompt template:
|
| 233 |
|
| 234 |
- chatml format is used: "<|im_start|>system\n{system message}<|im_end|>\n<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
|
|
@@ -242,6 +246,42 @@ multi-line:
|
|
| 242 |
<|im_start|>assistant
|
| 243 |
{Assistant answer}<|im_end|>
|
| 244 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 245 |
Training data:
|
| 246 |
|
| 247 |
- https://wandb.ai/open-assistant/epfl-mt-sft/runs/run34_megacode2_min100_13b
|
|
@@ -256,4 +296,4 @@ Link for the filtered dataset used to make this model are bellow:
|
|
| 256 |
|
| 257 |
The original posting for this model was uploaded at the link bellow.
|
| 258 |
|
| 259 |
-
- https://huggingface.co/andreaskoepf/llama2-13b-megacode2_min100
|
|
|
|
| 229 |
|
| 230 |
- This model was made as a colaboration between me and andreaskoepf who is an affiliate of Open Assistant.
|
| 231 |
|
| 232 |
+
This Model score .29 on humaneval+ the same as LLaMA-2 70B Chat Link bellow (in this benchmark the model is called andreaskoepf/llama2-13b-megacode2_min100)
|
| 233 |
+
|
| 234 |
+
- https://tju01.github.io/FastEval-OpenAssistant/
|
| 235 |
+
|
| 236 |
Prompt template:
|
| 237 |
|
| 238 |
- chatml format is used: "<|im_start|>system\n{system message}<|im_end|>\n<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
|
|
|
|
| 246 |
<|im_start|>assistant
|
| 247 |
{Assistant answer}<|im_end|>
|
| 248 |
```
|
| 249 |
+
Gpt4all template:
|
| 250 |
+
|
| 251 |
+
- System prompt
|
| 252 |
+
```
|
| 253 |
+
<|im_start|>system
|
| 254 |
+
{system message}
|
| 255 |
+
```
|
| 256 |
+
- Prompt template
|
| 257 |
+
```
|
| 258 |
+
<|im_end|>
|
| 259 |
+
<|im_start|>user
|
| 260 |
+
%1<|im_end|>
|
| 261 |
+
<|im_start|>assistant
|
| 262 |
+
```
|
| 263 |
+
|
| 264 |
+
Oobagooba Text-Generation-Webui Template
|
| 265 |
+
- user:
|
| 266 |
+
```
|
| 267 |
+
<|im_start|>user
|
| 268 |
+
{User string}<|im_end|>
|
| 269 |
+
```
|
| 270 |
+
- bot:
|
| 271 |
+
```
|
| 272 |
+
<|im_start|>assistant
|
| 273 |
+
{Bot string}<|im_end|>
|
| 274 |
+
```
|
| 275 |
+
- turn_template:
|
| 276 |
+
```
|
| 277 |
+
<|user|>\n<|user-message|>\n\n<|bot|>\n<|bot-message|>\n\n
|
| 278 |
+
```
|
| 279 |
+
- context:
|
| 280 |
+
```
|
| 281 |
+
<|im_start|>system
|
| 282 |
+
Below is an instruction that describes a task. Write a response that appropriately completes the request.<|im_end|>
|
| 283 |
+
```
|
| 284 |
+
|
| 285 |
Training data:
|
| 286 |
|
| 287 |
- https://wandb.ai/open-assistant/epfl-mt-sft/runs/run34_megacode2_min100_13b
|
|
|
|
| 296 |
|
| 297 |
The original posting for this model was uploaded at the link bellow.
|
| 298 |
|
| 299 |
+
- https://huggingface.co/andreaskoepf/llama2-13b-megacode2_min100
|