Update README.md
Browse files
README.md
CHANGED
|
@@ -9,7 +9,7 @@ model-index:
|
|
| 9 |
- name: TinyLlama-v2ray
|
| 10 |
results: []
|
| 11 |
datasets:
|
| 12 |
-
-
|
| 13 |
library_name: transformers
|
| 14 |
widget:
|
| 15 |
- text: "<|im_start|>user\nWho are you?<|im_end|>\n<|im_start|>assistant"
|
|
@@ -21,7 +21,7 @@ widget:
|
|
| 21 |
|
| 22 |
# TinyLlama-v2ray
|
| 23 |
|
| 24 |
-
This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v0.6](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.6) on the [
|
| 25 |
|
| 26 |
## Model description
|
| 27 |
Prompt format is as follows:
|
|
@@ -38,8 +38,8 @@ The model is intended to mimic the behavior of v2ray, so results will most likel
|
|
| 38 |
import torch
|
| 39 |
from transformers import pipeline, AutoTokenizer
|
| 40 |
import re
|
| 41 |
-
tokenizer = AutoTokenizer.from_pretrained("
|
| 42 |
-
pipe = pipeline("text-generation", model="
|
| 43 |
|
| 44 |
def formatted_prompt(prompt)-> str:
|
| 45 |
return f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant"
|
|
|
|
| 9 |
- name: TinyLlama-v2ray
|
| 10 |
results: []
|
| 11 |
datasets:
|
| 12 |
+
- theminji/v2ray
|
| 13 |
library_name: transformers
|
| 14 |
widget:
|
| 15 |
- text: "<|im_start|>user\nWho are you?<|im_end|>\n<|im_start|>assistant"
|
|
|
|
| 21 |
|
| 22 |
# TinyLlama-v2ray
|
| 23 |
|
| 24 |
+
This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v0.6](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.6) on the [theminji/v2ray](https://huggingface.co/datasets/theminji/v2ray) dataset.
|
| 25 |
|
| 26 |
## Model description
|
| 27 |
Prompt format is as follows:
|
|
|
|
| 38 |
import torch
|
| 39 |
from transformers import pipeline, AutoTokenizer
|
| 40 |
import re
|
| 41 |
+
tokenizer = AutoTokenizer.from_pretrained("theminji/TinyLlama-v2ray")
|
| 42 |
+
pipe = pipeline("text-generation", model="theminji/TinyLlama-v2ray", torch_dtype=torch.bfloat16, device_map="auto")
|
| 43 |
|
| 44 |
def formatted_prompt(prompt)-> str:
|
| 45 |
return f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant"
|