Update README.md

README.md

@@ -8,22 +8,19 @@ tags:
 - merge
 
 ---
-# sql-specialist
+# llama3-8b-code-sql-slerp
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
-
-## Merge Details
-### Merge Method
-
-This model was merged using the SLERP merge method.
+llama3-8b-code-sql-slerp is a merge of two fine tuned Llama 3 8B models for coding, intended to have a solid programming foundation with an expertise in SQL.
 
 ### Models Merged
 
+Merge of pre-trained language models merged using the SLERP merge method with [mergekit](https://github.com/cg123/mergekit).
+
 The following models were included in the merge:
 * [ajibawa-2023/Code-Llama-3-8B](https://huggingface.co/ajibawa-2023/Code-Llama-3-8B)
 * [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b)
 
-### Configuration
+### 🧩 Configuration
 
 The following YAML configuration was used to produce this model:
 
@@ -45,3 +42,44 @@ parameters:
     - value: 0.4 # fallback for rest of tensors
 dtype: bfloat16
 ```
+
+### 💻 Usage
+
+Loading in 8-bit Quantization
+
+```python
+from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
+
+tokenizer = AutoTokenizer.from_pretrained("AdamLucek/sql-expert")
+model = AutoModelForCausalLM.from_pretrained(
+    "AdamLucek/sql-expert",
+    device_map="cuda",
+    quantization_config=BitsAndBytesConfig(load_in_8bit=True)
+)
+
+# Prepare the input text
+input_text = "Can you write a query to retrieve the names and email addresses of all customers who have made purchases totaling over $1000 in the last month from our 'sales' database?"
+input_ids = tokenizer(input_text, return_tensors="pt").to("cuda")
+
+# Generate the output
+outputs = model.generate(
+    **input_ids,
+    max_new_tokens=256,
+    pad_token_id=tokenizer.eos_token_id
+)
+
+# Decode and print the generated text
+print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+```
+
+**Output**
+>\```sql  
+>SELECT c.name, c.email  
+>FROM customers c  
+>JOIN sales s ON c.customer_id = s.customer_id  
+>WHERE s.purchase_date >= DATE_SUB(CURRENT_DATE, INTERVAL 1 MONTH)  
+>GROUP BY c.name, c.email  
+>HAVING SUM(s.amount) > 1000;  
+>\```
+>
+>This query joins the 'customers' and'sales' tables on the 'customer_id' field, filters for sales made in the last month, groups the results by customer name and email, and then applies a condition to only include customers whose total purchase amount exceeds $1000. The result will be a list of names and email addresses for customers who have made purchases totaling over $1000 in the last month.