Update README.md
Browse files
README.md
CHANGED
|
@@ -69,30 +69,16 @@ which means that lists of messages can be formatted for you with the `apply_chat
|
|
| 69 |
|
| 70 |
```python
|
| 71 |
chat = [
|
| 72 |
-
{"role": "
|
| 73 |
-
{"role": "
|
| 74 |
-
{"role": "
|
|
|
|
| 75 |
]
|
| 76 |
tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
|
| 77 |
```
|
| 78 |
|
| 79 |
which will yield:
|
| 80 |
|
| 81 |
-
```
|
| 82 |
-
<|im_start|>user
|
| 83 |
-
Hello, how are you?<|im_end|>
|
| 84 |
-
<|im_start|>assistant
|
| 85 |
-
I'm doing great. How can I help you today?<|im_end|>
|
| 86 |
-
<|im_start|>user
|
| 87 |
-
I'd like to show off how chat templating works!<|im_end|>
|
| 88 |
-
<|im_start|>assistant
|
| 89 |
-
```
|
| 90 |
-
|
| 91 |
-
If you use `tokenize=True` and `return_tensors="pt"` instead, then you will get a tokenized
|
| 92 |
-
and formatted conversation ready to pass to `model.generate()`.
|
| 93 |
-
|
| 94 |
-
## Example Prompt Exchange
|
| 95 |
-
|
| 96 |
```
|
| 97 |
<|im_start|>system
|
| 98 |
You are MistralOrca, a large language model trained by Alignment Lab AI. Write out your reasoning step-by-step to be sure you get the right answers!
|
|
@@ -103,8 +89,12 @@ How are you?<|im_end|>
|
|
| 103 |
I am doing well!<|im_end|>
|
| 104 |
<|im_start|>user
|
| 105 |
Please tell me about how mistral winds have attracted super-orcas.<|im_end|>
|
|
|
|
| 106 |
```
|
| 107 |
|
|
|
|
|
|
|
|
|
|
| 108 |
|
| 109 |
# Inference
|
| 110 |
|
|
|
|
| 69 |
|
| 70 |
```python
|
| 71 |
chat = [
|
| 72 |
+
{"role": "system", "content": "You are MistralOrca, a large language model trained by Alignment Lab AI. Write out your reasoning step-by-step to be sure you get the right answers!"}
|
| 73 |
+
{"role": "user", "content": "How are you?"},
|
| 74 |
+
{"role": "assistant", "content": "I am doing well!"},
|
| 75 |
+
{"role": "user", "content": "Please tell me about how mistral winds have attracted super-orcas."},
|
| 76 |
]
|
| 77 |
tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
|
| 78 |
```
|
| 79 |
|
| 80 |
which will yield:
|
| 81 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
```
|
| 83 |
<|im_start|>system
|
| 84 |
You are MistralOrca, a large language model trained by Alignment Lab AI. Write out your reasoning step-by-step to be sure you get the right answers!
|
|
|
|
| 89 |
I am doing well!<|im_end|>
|
| 90 |
<|im_start|>user
|
| 91 |
Please tell me about how mistral winds have attracted super-orcas.<|im_end|>
|
| 92 |
+
<|im_start|>assistant
|
| 93 |
```
|
| 94 |
|
| 95 |
+
If you use `tokenize=True` and `return_tensors="pt"` instead, then you will get a tokenized
|
| 96 |
+
and formatted conversation ready to pass to `model.generate()`.
|
| 97 |
+
|
| 98 |
|
| 99 |
# Inference
|
| 100 |
|