TajaKuzman
commited on
Commit
•
470fa16
1
Parent(s):
c613f0e
Update README.md
Browse files
README.md
CHANGED
@@ -171,7 +171,7 @@ In an out-of-dataset scenario (evaluating a model on a [manually-annotated Engli
|
|
171 |
|
172 |
An example of preparing data for genre identification and post-processing of the results can be found [here](https://github.com/TajaKuzman/Applying-GENRE-on-MaCoCu-bilingual) where we applied X-GENRE classifier to the English part of [MaCoCu](https://macocu.eu/) parallel corpora.
|
173 |
|
174 |
-
For reliable results, genre classifier should be applied to documents of sufficient length (the rule of
|
175 |
|
176 |
After proposed post-processing (removal of low-confidence predictions, labels "Other" and in this specific case also label "Forum"), the performance on the MaCoCu data based on manual inspection reached macro and micro F1 of 0.92.
|
177 |
|
|
|
171 |
|
172 |
An example of preparing data for genre identification and post-processing of the results can be found [here](https://github.com/TajaKuzman/Applying-GENRE-on-MaCoCu-bilingual) where we applied X-GENRE classifier to the English part of [MaCoCu](https://macocu.eu/) parallel corpora.
|
173 |
|
174 |
+
For reliable results, genre classifier should be applied to documents of sufficient length (the rule of thumb is at least 75 words). It is advised that the predictions, predicted with confidence lower than 0.9, are not used. Furthermore, the label "Other" can be used as another indicator of low confidence of the predictions, as it often indicates that the text does not have enough features of any genre, and these predictions can be discarded as well.
|
175 |
|
176 |
After proposed post-processing (removal of low-confidence predictions, labels "Other" and in this specific case also label "Forum"), the performance on the MaCoCu data based on manual inspection reached macro and micro F1 of 0.92.
|
177 |
|