mhhmm
/

typescript-instruct-20k-v2

Text Generation

instruction-tuning

code-generation

Model card Files Files and versions Metrics Training metrics Community

mhhmm commited on Dec 21, 2023

Commit

dc7be24

•

1 Parent(s): ac9fcca

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -88,7 +88,7 @@ I'm using MultiPL-E benchmark, the same as Code Llmama using in their paper
 | Dataset                                          | Pass@k | Estimate             | NumProblems | MinCompletions | MaxCompletions |
 |--------------------------------------------------|--------|----------------------|-------------|----------------|----------------|
-| mhhmm/typescript-instruct-20k | 1      | 0.4240791832736455   | 159         | 13             | 20             |
 How to reproduce my evaluation? Just run like the offical document of MultiPL-E: https://nuprl.github.io/MultiPL-E/tutorial.html, change the modal name by my model here: `mhhmm/typescript-instruct-20k`

 | Dataset                                          | Pass@k | Estimate             | NumProblems | MinCompletions | MaxCompletions |
 |--------------------------------------------------|--------|----------------------|-------------|----------------|----------------|
+| mhhmm/typescript-instruct-20k | 1      | 0.4241   | 159         | 13             | 20             |
 How to reproduce my evaluation? Just run like the offical document of MultiPL-E: https://nuprl.github.io/MultiPL-E/tutorial.html, change the modal name by my model here: `mhhmm/typescript-instruct-20k`