XTransformer
commited on
Commit
•
647f9ea
1
Parent(s):
b97699e
Update README.md
Browse files
README.md
CHANGED
@@ -7,8 +7,7 @@ tags:
|
|
7 |
license: llama2
|
8 |
---
|
9 |
# **PandasSolver**
|
10 |
-
PandasSolver is a fine-tuned generative text models with 7 billion parameters. It achieves 54.98% on [DS-1000](https://ds1000-code-gen.github.io/) Pandas Completion tasks,
|
11 |
-
while the accuracy of GPT-4 (August 2023 version) is 43.99%.
|
12 |
|
13 |
## Model Use
|
14 |
|
@@ -80,7 +79,7 @@ for seq in sequences:
|
|
80 |
|
81 |
## Evaluation Results
|
82 |
|
83 |
-
Performance on DS-1000:
|
84 |
|
85 |
```
|
86 |
Pandas Avg. Acc: 54.98%
|
|
|
7 |
license: llama2
|
8 |
---
|
9 |
# **PandasSolver**
|
10 |
+
PandasSolver is a fine-tuned generative text models with 7 billion parameters. It achieves 54.98% on [DS-1000](https://ds1000-code-gen.github.io/) Pandas Completion tasks, which is ~11% better than GPT-4 (43.99%, tested with August 2023 version).
|
|
|
11 |
|
12 |
## Model Use
|
13 |
|
|
|
79 |
|
80 |
## Evaluation Results
|
81 |
|
82 |
+
Performance on DS-1000 Completion:
|
83 |
|
84 |
```
|
85 |
Pandas Avg. Acc: 54.98%
|