Update README.md

README.md

@@ -5,18 +5,21 @@ license: cc-by-sa-4.0
 tags:
 - trl
 - sft
-- generated_from_trainer
+- QLora
+- peft
+- SQL
+- causal-lm
 model-index:
 - name: sqlcoder-7b-2_FineTuned_PEFT_QLORA_adapter
   results: []
+language:
+- en
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
 
-# sqlcoder-7b-2_FineTuned_PEFT_QLORA_adapter
+# sqlcoder-7b-2_FineTuned_QLORA_Adapter
 
-This model is a fine-tuned version of [defog/sqlcoder-7b-2](https://huggingface.co/defog/sqlcoder-7b-2) on an unknown dataset.
+This model is a fine-tuned version of [defog/sqlcoder-7b-2](https://huggingface.co/defog/sqlcoder-7b-2) on 260 MS SQL examples (Task, Schema and Answer pairs).
 
 ## Model description
 
@@ -24,11 +27,15 @@ More information needed
 
 ## Intended uses & limitations
 
-More information needed
+SQL Query Generation
 
 ## Training and evaluation data
 
-More information needed
+This model was re-trained using the QLoRA method, with the following configurations:
+- 'r = 32', 'lora_alpha = 32', 'lora_dropout = 0.1', bias='none', task_type='CAUSAL_LM'
+
+Quantization parameters: 
+- load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16
 
 ## Training procedure
 
@@ -47,10 +54,6 @@ The following hyperparameters were used during training:
 - num_epochs: 5
 - mixed_precision_training: Native AMP
 
-### Training results
-
-
-
 ### Framework versions
 
 - PEFT 0.13.2