Update README.md

README.md

@@ -20,20 +20,24 @@ Loading the model:
 from transformers import AutoTokenizer, AutoModelForCausalLM
 
 tokenizer = AutoTokenizer.from_pretrained("HyperbeeAI/Tulpar-7b-v0")
-model = AutoModelForCausalLM.from_pretrained("HyperbeeAI/Tulpar-7b-v0")
+model = AutoModelForCausalLM.from_pretrained("HyperbeeAI/Tulpar-7b-v0", device_map="auto")
 ```
 
 You can run inference with both of the following prompts:
 ```python
+input_text="What is deep learning?"
 prompt = f"### User: {input_text}\n\n### Assistant:\n"
 inputs = tokenizer(prompt, return_tensors="pt")
 output = model.generate(**inputs, do_sample=True, top_p=0.95, top_k=0, max_new_tokens=512)
+print(tokenizer.decode(output[0]))
 ```
 
 ```python
+input_text="What is deep learning?"
 prompt = f"Question: {input_text}\n\nAnswer:"
 inputs = tokenizer(prompt, return_tensors="pt")
 output = model.generate(**inputs, do_sample=True, top_p=0.95, top_k=0, max_new_tokens=512)
+print(tokenizer.decode(output[0]))
 ```