Update README.md

README.md

@@ -11,6 +11,48 @@ tags:
 
 
 
+
+```markdown
+
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
+from peft import PeftConfig, PeftModel
+torch.random.manual_seed(0)
+config = PeftConfig.from_pretrained("bpalacios/Phi-3-Finetuned")
+model = AutoModelForCausalLM.from_pretrained(
+    "microsoft/Phi-3-mini-4k-instruct",
+    device_map="auto",
+    torch_dtype="auto",
+    trust_remote_code=True)
+tokenizer = AutoTokenizer.from_pretrained("bpalacios/Phi-3-Finetuned")
+model = PeftModel.from_pretrained(model, "bpalacios/Phi-3-Finetuned")
+```
+
+```markdown
+
+model = AutoModelForCausalLM.from_pretrained(
+    "bpalacios/Phi-3-Finetuned",
+    device_map="auto",
+    torch_dtype="auto",
+    trust_remote_code=True)
+tokenizer = AutoTokenizer.from_pretrained("bpalacios/Phi-3-Finetuned")
+
+```
+```markdown
+
+pipe = pipeline(
+    "text-generation",
+    model=model,
+    tokenizer=tokenizer,
+)
+
+generation_args = {
+    "max_new_tokens": 500,
+    "return_full_text": False,
+    "temperature": 0.3,
+    "do_sample": False,
+}
+```
 ## Model Details
 
 ### Model Description