Training completed using PEFT

README.md

@@ -1,5 +1,5 @@
 ---
-base_model: google-t5/t5-base
+base_model: cssupport/t5-small-awesome-text-to-sql
 library_name: peft
 license: apache-2.0
 tags:
@@ -12,11 +12,12 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/boghdady95/huggingface/runs/haitu93v)
 # t5-base-2-lora
 
-This model is a fine-tuned version of [google-t5/t5-base](https://huggingface.co/google-t5/t5-base) on an unknown dataset.
+This model is a fine-tuned version of [cssupport/t5-small-awesome-text-to-sql](https://huggingface.co/cssupport/t5-small-awesome-text-to-sql) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3831
+- Loss: 1.5747
 
 ## Model description
 
@@ -48,14 +49,14 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.3842        | 1.0   | 3750 | 0.4037          |
-| 0.3375        | 2.0   | 7500 | 0.3831          |
+| 1.7227        | 1.0   | 3750 | 1.6501          |
+| 1.5207        | 2.0   | 7500 | 1.5747          |
 
 
 ### Framework versions
 
 - PEFT 0.12.0
-- Transformers 4.44.0
+- Transformers 4.42.3
 - Pytorch 2.1.2
 - Datasets 2.20.0
 - Tokenizers 0.19.1

adapter_config.json

@@ -1,7 +1,7 @@
 {
   "alpha_pattern": {},
   "auto_mapping": null,
-  "base_model_name_or_path": "google-t5/t5-base",
+  "base_model_name_or_path": "cssupport/t5-small-awesome-text-to-sql",
   "bias": "none",
   "fan_in_fan_out": false,
   "inference_mode": true,
@@ -16,7 +16,7 @@
   "megatron_core": "megatron.core",
   "modules_to_save": null,
   "peft_type": "LORA",
-  "r": 32,
+  "r": 16,
   "rank_pattern": {},
   "revision": null,
   "target_modules": [

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ff77aab80258356c5b1b71b70e23766cad4444a0be5695b21e490494cf8b2152
-size 14176016
+oid sha256:9d7149e48cc3aba2d64939a34da2bf8f6b90f58348abaa2b7a63ad3c9b05fbf2
+size 2369320

runs/Aug18_08-56-05_76751c052902/events.out.tfevents.1723971371.76751c052902.34.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9eedc6043a66027493e26a4be9651f439099b4b27e0c5ac1ac9219c98557e99e
-size 9133
+oid sha256:8f76539655562520797e41c31cb4e26b019199ae99fcb3ce9e01f001adc7cd2c
+size 9758