XTransformer commited on
Commit
647f9ea
1 Parent(s): b97699e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -7,8 +7,7 @@ tags:
7
  license: llama2
8
  ---
9
  # **PandasSolver**
10
- PandasSolver is a fine-tuned generative text models with 7 billion parameters. It achieves 54.98% on [DS-1000](https://ds1000-code-gen.github.io/) Pandas Completion tasks,
11
- while the accuracy of GPT-4 (August 2023 version) is 43.99%.
12
 
13
  ## Model Use
14
 
@@ -80,7 +79,7 @@ for seq in sequences:
80
 
81
  ## Evaluation Results
82
 
83
- Performance on DS-1000:
84
 
85
  ```
86
  Pandas Avg. Acc: 54.98%
 
7
  license: llama2
8
  ---
9
  # **PandasSolver**
10
+ PandasSolver is a fine-tuned generative text models with 7 billion parameters. It achieves 54.98% on [DS-1000](https://ds1000-code-gen.github.io/) Pandas Completion tasks, which is ~11% better than GPT-4 (43.99%, tested with August 2023 version).
 
11
 
12
  ## Model Use
13
 
 
79
 
80
  ## Evaluation Results
81
 
82
+ Performance on DS-1000 Completion:
83
 
84
  ```
85
  Pandas Avg. Acc: 54.98%