Update README.md

README.md

@@ -19,4 +19,35 @@ tags:
 
 This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
-[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
+## Using the model
+```python
+from transformers import AutoModelForCausalLM, BitsAndBytesConfig
+
+quantization_config = BitsAndBytesConfig(load_in_4bit=True)
+
+model = AutoModelForCausalLM.from_pretrained("Majipa/text-to-SQL",
+                                             device_map="cuda",
+                                             torch_dtype="auto",
+                                             quantization_config=quantization_config)
+from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline 
+
+tokenizer = AutoTokenizer.from_pretrained("microsoft/Phi-3-mini-4k-instruct") 
+
+messages = [ 
+    {"role": "system", "content": "You are a helpful text-to-SQL assistant."}, 
+    {"role": "user", "content": "question: How many heads of the departments are older than 56 ? context: CREATE TABLE head (age INTEGER)"}, 
+] 
+
+pipe = pipeline( 
+    "text-generation", 
+    model=model, 
+    tokenizer=tokenizer, 
+) 
+
+generation_args = { 
+    "max_new_tokens": 500, 
+    "temperature": 0.7, 
+} 
+
+output = pipe(messages, **generation_args) 
+print(output[0]['generated_text'])