---
license: mit
base_model: unsloth/Phi-3-mini-4k-instruct-bnb-4bit
tags:
- text-to-sql
- sql
- phi-3
- unsloth
- gguf
- ollama
datasets:
- b-mc2/sql-create-context
language:
- en
---

# Phi-3-SQL-Expert (GGUF)

This model is a fine-tuned version of **Microsoft Phi-3-mini-4k-instruct**, specialized for **Text-to-SQL** conversion. It was trained using the `b-mc2/sql-create-context` dataset and is optimized for local inference on consumer hardware.

## Model Details
- **Architecture:** Phi-3-mini (3.8B parameters)
- **Quantization:** Q4_K_M GGUF (Optimised for balance of speed/accuracy)
- **Fine-tuning Technique:** LoRA (Low-Rank Adaptation) via Unsloth
- **Primary Task:** Natural Language to SQL Query generation

## Usage (Ollama)
To run this model locally, create a `Modelfile` with the following content:

```dockerfile
FROM ./phi3-sql-expert.Q4_K_M.gguf

TEMPLATE """<|system|>
You are a helpful assistant that writes SQL queries. Given a user question and a table schema, output only the SQL code.<|end|>
<|user|>
{{ .Prompt }}<|end|>
<|assistant|>
"""

PARAMETER stop "<|end|>"
PARAMETER temperature 0.1