Commit ·
647f9ea
1
Parent(s): b97699e
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,8 +7,7 @@ tags:
|
|
| 7 |
license: llama2
|
| 8 |
---
|
| 9 |
# **PandasSolver**
|
| 10 |
-
PandasSolver is a fine-tuned generative text models with 7 billion parameters. It achieves 54.98% on [DS-1000](https://ds1000-code-gen.github.io/) Pandas Completion tasks,
|
| 11 |
-
while the accuracy of GPT-4 (August 2023 version) is 43.99%.
|
| 12 |
|
| 13 |
## Model Use
|
| 14 |
|
|
@@ -80,7 +79,7 @@ for seq in sequences:
|
|
| 80 |
|
| 81 |
## Evaluation Results
|
| 82 |
|
| 83 |
-
Performance on DS-1000:
|
| 84 |
|
| 85 |
```
|
| 86 |
Pandas Avg. Acc: 54.98%
|
|
|
|
| 7 |
license: llama2
|
| 8 |
---
|
| 9 |
# **PandasSolver**
|
| 10 |
+
PandasSolver is a fine-tuned generative text models with 7 billion parameters. It achieves 54.98% on [DS-1000](https://ds1000-code-gen.github.io/) Pandas Completion tasks, which is ~11% better than GPT-4 (43.99%, tested with August 2023 version).
|
|
|
|
| 11 |
|
| 12 |
## Model Use
|
| 13 |
|
|
|
|
| 79 |
|
| 80 |
## Evaluation Results
|
| 81 |
|
| 82 |
+
Performance on DS-1000 Completion:
|
| 83 |
|
| 84 |
```
|
| 85 |
Pandas Avg. Acc: 54.98%
|