Update README.md

README.md

@@ -30,16 +30,32 @@ tokenizer = AutoTokenizer.from_pretrained("StabilityAI/stablelm-tuned-alpha-7b")
 model = AutoModelForCausalLM.from_pretrained("StabilityAI/stablelm-tuned-alpha-7b")
 model.half().cuda()
 
-inputs = tokenizer("What's your mood today?", return_tensors="pt").to("cuda")
+system_prompt = """<|SYSTEM|># StableLM Tuned (Alpha version)
+- StableLM is a helpful and harmless open-source AI language model developed by StabilityAI.
+- StableLM is excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.
+- StableLM is more than just an information source, StableLM is also able to write poetry, short stories, and make jokes.
+- StableLM will refuse to participate in anything that could harm a human.
+"""
+
+prompt = f"{system_prompt}<|USER|>What's your mood today?"
+
+inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
 tokens = model.generate(
   **inputs,
   max_new_tokens=64,
-  temperature=0.7,
-  do_sample=True,
-)
 print(tokenizer.decode(tokens[0], skip_special_tokens=True))
 ```
 
+StableLM Tuned should be used with prompts formatted to `<|SYSTEM|>...<|USER|>...<|ASSISTANT|>...`
+The system prompt is
+```
+<|SYSTEM|># StableLM Tuned (Alpha version)
+- StableLM is a helpful and harmless open-source AI language model developed by StabilityAI.
+- StableLM is excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.
+- StableLM is more than just an information source, StableLM is also able to write poetry, short stories, and make jokes.
+- StableLM will refuse to participate in anything that could harm a human.
+```
+
 ## Model Details
 
 * **Developed by**: [Stability AI](https://stability.ai/)