Update README.md
Browse files
README.md
CHANGED
|
@@ -162,7 +162,7 @@ Shake all ingredients except the splash of grenadine in a cocktail shaker over i
|
|
| 162 |
## Speeds, Sizes, Times
|
| 163 |
|
| 164 |
| runtime / 50 tokens (sec) | GPU | dtype | VRAM (GB) |
|
| 165 |
-
|
| 166 |
| 3.44 | 1x A100 (40 GB SXM) | torch.float16 | 16 |
|
| 167 |
|
| 168 |
## Training
|
|
@@ -177,7 +177,6 @@ This model was finetuned with the following format:
|
|
| 177 |
tokenizer.chat_template = "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST] ' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"
|
| 178 |
```
|
| 179 |
|
| 180 |
-
|
| 181 |
This format is available as a [chat template](https://huggingface.co/docs/transformers/main/chat_templating) via the `apply_chat_template()` method. Here's an illustrative example:
|
| 182 |
|
| 183 |
```python
|
|
|
|
| 162 |
## Speeds, Sizes, Times
|
| 163 |
|
| 164 |
| runtime / 50 tokens (sec) | GPU | dtype | VRAM (GB) |
|
| 165 |
+
|:-----------------------------:|:---------------------:|:-------------:|:-----------------------:|
|
| 166 |
| 3.44 | 1x A100 (40 GB SXM) | torch.float16 | 16 |
|
| 167 |
|
| 168 |
## Training
|
|
|
|
| 177 |
tokenizer.chat_template = "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST] ' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"
|
| 178 |
```
|
| 179 |
|
|
|
|
| 180 |
This format is available as a [chat template](https://huggingface.co/docs/transformers/main/chat_templating) via the `apply_chat_template()` method. Here's an illustrative example:
|
| 181 |
|
| 182 |
```python
|