File size: 1,916 Bytes
4adc028 4918db8 4adc028 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 | ---
license: apache-2.0
---
> [!NOTE]
> The **ST format** is converted from **PTH**, designed for use with RWKV webgpu inference engines such as [Ai00](https://github.com/Ai00-X/ai00_server) and [web-rwkv](https://github.com/cryscan/web-rwkv).
## 1️⃣ What are G0 / G1 / G1a2 / G1b?
The labels G0a / G1a / G1a2, etc., indicate different versions of the training data.
Data quality ranking: **G1b > G1a3 > G1a2 > G1a > G1 > G0a2 > G0**.
The **RWKV7-G1a** model is an advanced version of **RWKV7-G1**, further trained on **1T of high-quality inference and instruction data**.
Future updates will continue to add more high-quality data to form the **G1b dataset**, along with the release of the **RWKV7-G1b** model series.
## 2️⃣ How to choose the best model?
**Check the date in the model name.**
For models with the same parameter size, newer models are better!
For example, a **2.9B model** released on `251005` will definitely outperform a version released on `250606`.
## 3️⃣ Prompt Format
The **RWKV7-G series** supports both **no-think-mode** and **think-mode**.
**no-think-mode** Chat prompt
> [!TIP]
>
> better replace all \n\n in USER_PROMPT to \n as i am using \n\n as "chat round separator" in pretrain data)
```
System: YOU_CAN_USE_SYSTEM_IF_NEEDED
User: PREVIOUS_STUFF
Assistant: PREVIOUS_STUFF
User: USER_PROMPT
Assistant:
```
**think-mode** prompt:
```
User: USER_PROMPT
Assistant: <think
```
---
Think prompt, alternative style output, **valid for 20250922 and newer** models. Note there is a space before the "think" after USER_PROMPT:
```
User: USER_PROMPT think
Assistant: <think
```
Shorter think (think a bit), same style:
```
User: USER_PROMPT think a bit
Assistant: <think
```
Longer think (think a lot), same style:
```
User: USER_PROMPT think a lot
Assistant: <think
```
---
Fake think prompt:
```
User: USER_PROMPT
Assistant: <think>
</think
```
|