Update README.md
Browse files
README.md
CHANGED
@@ -83,6 +83,8 @@ We clean the content of the remaining dataset entries according to the following
|
|
83 |
* We remove all package lines, such as _package kotlinx.coroutines.channels_
|
84 |
* We remove half of the import lines
|
85 |
|
|
|
|
|
86 |
# Evaluation
|
87 |
|
88 |
For evaluation, we used the [Kotlin HumanEval](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval) dataset, which contains all 161 tasks from HumanEval translated into Kotlin by human experts. You can find more details about the pre-processing necessary to obtain our results, including the code for running, on the [datasets's page](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval).
|
|
|
83 |
* We remove all package lines, such as _package kotlinx.coroutines.channels_
|
84 |
* We remove half of the import lines
|
85 |
|
86 |
+
We removed half of the imports to avoid potential hallucinations by the model, where it might attempt to import unnecessary libraries. Additionally, packages were removed because this information is only useful at the project level and may introduce additional noise during the learning process.
|
87 |
+
|
88 |
# Evaluation
|
89 |
|
90 |
For evaluation, we used the [Kotlin HumanEval](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval) dataset, which contains all 161 tasks from HumanEval translated into Kotlin by human experts. You can find more details about the pre-processing necessary to obtain our results, including the code for running, on the [datasets's page](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval).
|