tags: | |
- Issue_fixed | |
- textattack | |
- textclassification | |
- entailment | |
license: mit | |
datasets: | |
- mnli | |
metrics: | |
- accuracy | |
Fixed label mapping issue for textattack/bert-base-uncased-MNLI, if using the original model, the predicted label has systematic confusion with the huggingface MNLI dataset. See the Github issue: https://github.com/QData/TextAttack/issues/684. The fixed accuracy_mm is 84.44% and is 7% before the fix applied. |