Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,16 @@ tags:
|
|
| 16 |
|
| 17 |
The purpose of the experiment is to understand the quality of the pre-trained Phi-2 model. The good news is that `phi-2-sft` can follow open-ended user instructions well.
|
| 18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
## Training
|
| 20 |
|
| 21 |
The model was fine-tuned on a sanitized version of the single-turn OASST dataset linked above.
|
|
|
|
| 16 |
|
| 17 |
The purpose of the experiment is to understand the quality of the pre-trained Phi-2 model. The good news is that `phi-2-sft` can follow open-ended user instructions well.
|
| 18 |
|
| 19 |
+
## Decoding
|
| 20 |
+
|
| 21 |
+
Format your prompt as
|
| 22 |
+
```
|
| 23 |
+
"""### Human: {instruction}
|
| 24 |
+
|
| 25 |
+
### Assistant:"""
|
| 26 |
+
```
|
| 27 |
+
where `instruction` is your query.
|
| 28 |
+
|
| 29 |
## Training
|
| 30 |
|
| 31 |
The model was fine-tuned on a sanitized version of the single-turn OASST dataset linked above.
|