Update README.md
Browse files
README.md
CHANGED
|
@@ -43,6 +43,12 @@ This repo contains the **Seed-X-Instruct** model, with the following features:
|
|
| 43 |
|Seed-X-RM | Reward model to evaluate the quality of translation.| 🤗 [Model](https://huggingface.co/ByteDance-Seed/Seed-X-RM-7B)|
|
| 44 |
|
| 45 |
## Quickstart
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
Here is a simple example demonstrating how to load the model and perform translation using ```vllm```
|
| 47 |
```python
|
| 48 |
from vllm import LLM, SamplingParams, BeamSearchParams
|
|
|
|
| 43 |
|Seed-X-RM | Reward model to evaluate the quality of translation.| 🤗 [Model](https://huggingface.co/ByteDance-Seed/Seed-X-RM-7B)|
|
| 44 |
|
| 45 |
## Quickstart
|
| 46 |
+
|
| 47 |
+
* The **language tags** at the end of the prompt is necessary, which are used in PPO training. For example, when the target language is German, \<de\> needs to be added. You can refer to the above table for language abbreviations.
|
| 48 |
+
* This model is specialized in multilingual translation, which is unexpected to support other tasks.
|
| 49 |
+
* We don't have any chat template, thus you don't have to perform ```tokenizer.apply_chat_template```. Please avoid prompting the model in a multi-round conversation format.
|
| 50 |
+
* We recommend against using unofficial quantized versions for local deployment. We will soon release an official quantized model and develop a demo on Hugging Face Space.
|
| 51 |
+
|
| 52 |
Here is a simple example demonstrating how to load the model and perform translation using ```vllm```
|
| 53 |
```python
|
| 54 |
from vllm import LLM, SamplingParams, BeamSearchParams
|