Update README.md
Browse files
README.md
CHANGED
|
@@ -3,19 +3,20 @@ license: apache-2.0
|
|
| 3 |
pipeline_tag: text-generation
|
| 4 |
tags:
|
| 5 |
- code
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
-
# Model Card for T5-3B/SynQL-Spider
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
License: [Apache-2.0]
|
| 15 |
-
|
| 16 |
-
Finetuned from model: [google-t5/t5-3b]
|
| 17 |
-
|
| 18 |
-
Dataset used for finetuning: [semiotic/SynQL-Spider]
|
| 19 |
|
| 20 |
## Model Context
|
| 21 |
|
|
@@ -28,14 +29,12 @@ Example metadata can be found below, context represents the prompt that is prese
|
|
| 28 |
```
|
| 29 |
## Model Results
|
| 30 |
|
| 31 |
-
Evaluation set: [Spider/dev]
|
| 32 |
|
| 33 |
Evaluation metrics: [Test-Suite-Execution, Execution Accuracy]
|
| 34 |
|
| 35 |
| Model | Data | Run | Execution Accuracy | Test-Suite Execution Accuracy |
|
| 36 |
|-------|------|-----|-------------------|-------------------------------|
|
| 37 |
-
| T5-3B | semiotic/SynQL-Spider | 00 | 0.7021 | 0.5996 |
|
| 38 |
-
| T5-3B | semiotic/SynQL-Spider | 01 | 0.6992 | 0.5464 |
|
| 39 |
-
| T5-3B | semiotic/SynQL-Spider | 02 | 0.7002 | 0.5861 |
|
| 40 |
-
|
| 41 |
-
|
|
|
|
| 3 |
pipeline_tag: text-generation
|
| 4 |
tags:
|
| 5 |
- code
|
| 6 |
+
datasets:
|
| 7 |
+
- semiotic/SynQL-Spider-Train
|
| 8 |
+
language:
|
| 9 |
+
- en
|
| 10 |
+
base_model:
|
| 11 |
+
- google-t5/t5-3b
|
| 12 |
---
|
| 13 |
|
| 14 |
+
# Model Card for T5-3B/SynQL-Spider-Train-Run-01
|
| 15 |
+
- Developed by: Semiotic Labs
|
| 16 |
+
- Model type: [Text to SQL]
|
| 17 |
+
- License: [Apache-2.0]
|
| 18 |
+
- Finetuned from model: [google-t5/t5-3b](https://huggingface.co/google-t5/t5-3b)
|
| 19 |
+
- Dataset used for finetuning: [semiotic/SynQL-Spider-Train](https://huggingface.co/datasets/semiotic/SynQL-Spider-Train)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
## Model Context
|
| 22 |
|
|
|
|
| 29 |
```
|
| 30 |
## Model Results
|
| 31 |
|
| 32 |
+
Evaluation set: [Spider/dev](https://github.com/taoyds/test-suite-sql-eval)
|
| 33 |
|
| 34 |
Evaluation metrics: [Test-Suite-Execution, Execution Accuracy]
|
| 35 |
|
| 36 |
| Model | Data | Run | Execution Accuracy | Test-Suite Execution Accuracy |
|
| 37 |
|-------|------|-----|-------------------|-------------------------------|
|
| 38 |
+
| T5-3B | semiotic/SynQL-Spider-Train | 00 | 0.7021 | 0.5996 |
|
| 39 |
+
| T5-3B | semiotic/SynQL-Spider-Train | 01 | 0.6992 | 0.5464 |
|
| 40 |
+
| T5-3B | semiotic/SynQL-Spider-Train | 02 | 0.7002 | 0.5861 |
|
|
|
|
|
|