Update README.md

README.md

@@ -15,6 +15,28 @@ SNOWTEAM/sft_medico-mistral is a specialized language model designed for medical
 **Model type:** Transformer-based decoder-only language model  
 **Language(s) (NLP):** English  
 
+## How to Get Started with the Model
+```python
+import transformers
+import torch
+
+model_path = "SNOWTEAM/medico-mistral"
+model = AutoModelForCausalLM.from_pretrained(
+    model_path,device_map="auto", 
+    max_memory=max_memory_mapping,
+    torch_dtype=torch.float16,
+)
+tokenizer = AutoTokenizer.from_pretrained("SNOWTEAM/medico-mistral")
+input_text = ""
+input_ids = tokenizer(input_text, return_tensors="pt").input_ids
+output_ids = model.generate(input_ids=input_ids.cuda(),
+                            max_new_tokens=300,
+                            pad_token_id=tokenizer.eos_token_id,)
+output_text = tokenizer.batch_decode(output_ids[:, input_ids.shape[1]:],skip_special_tokens=True)[0]
+print(output_text)
+```
+
+
 ### Instruction Tuning Datasets
 
 Using open source instruction tuning datasets are composed of 4 main parts: (Some datasets are from [https://huggingface.co/datasets/axiong/pmc_llama_instructions](https://huggingface.co/datasets/axiong/pmc_llama_instructions))