Update README.md

README.md

@@ -26,8 +26,32 @@ Generate 4GL Scripts from english prompts
 <!-- Provide the basic links for the model. -->
 
 - **Repository:** https://huggingface.co/amithsourya/Script-Generate-4GL-V1.0/blob/main/adapter_model.safetensors
-- **Demo:** https://colab.research.google.com/drive/1wdveoznPyiKrb-kZ4gTRRMpq82Qih8Z_?usp=sharing#scrollTo=N40paBum-cc7
+- **Demo:**
+```python
+from huggingface_hub import notebook_login
+notebook_login()
 
+from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
+from peft import PeftModel, PeftConfig
+
+lora_path = "amithsourya/Script-Generate-4GL-V1.0"
+peft_config = PeftConfig.from_pretrained(lora_path)
+
+base_model = AutoModelForCausalLM.from_pretrained(
+    peft_config.base_model_name_or_path,
+    device_map="auto",
+    torch_dtype="auto"
+)
+
+model = PeftModel.from_pretrained(base_model, lora_path)
+tokenizer = AutoTokenizer.from_pretrained(peft_config.base_model_name_or_path)
+
+pipe = pipeline("text-generation", model=model, tokenizer=tokenizer, device_map="auto")
+prompt = "invoke a BO for read"
+outputs = pipe(prompt, max_new_tokens=256)
+
+print(outputs[0]["generated_text"])
+```
 
 ## Environmental Impact